At least 3,500 Long Island Rail Road workers are walking off the job after negotiations on a new labor deal failed overnight.