While I've always been skeptical of these types of reports, it wouldn't surprise me in the least if he's had enough. The guy's been smeared on both the left and the right, and besides, most indications were that he never wanted the Speaker job in the first place and only took it because they couldn't agree on anyone else.
I hope he has the ability to spin this in a way that can save some face.