A wildfire is raging on an uninhabited island off Southern California after rescuers saved a shipwrecked boater there.