Secretary of the Navy John Phelan “is departing the administration, effective immediately,” the Pentagon’s top spokesman Sean Parnell said Wednesday.