The Pentagon released a statement on social media saying Navy Secretary John Phelan "is departing the administration, effective immediately."