The Federal Aviation Administration on Saturday urged U.S. airlines and pilots to "use caution" when flying in Israeli airspace.