The FBI arrested a woman Wednesday who they allege was plotting to attack the New York State Capitol building in Albany.