Speaker Mike Johnson said Monday that he doesn't believe "it's time" to call for Rep. Tony Gonzales, R-Texas, to resign amid an alleged affair scandal.