I'm not happy with Johnson as Speaker, but it's more important to get Trump in office and his nominees confirmed. If the Pubs vote that 4-5 members can vote to vacate the chair that would seem like a good mechanism to remove Johnson if he is a problem.
Chip Roy does seem to be doing everything he can to stick it to Trump.