While the Senate has yet to act on any of these bills, West said it would make sense for both the House and Senate to return, given the short deadline.

"We've got work to do, and I don't think that this is the time for me to sit back and point fingers at the Senate," he said. "But America right now needs leadership, and I would say that America is like a rudderless ship at sea in a very tumultuous storm and we're headed toward the rocks and no one's at the helm."

He also said that while he has emailed House Majority Leader Eric CantorEric Ivan CantorScalise allies upset over Ryan blindside on McCarthy endorsement 2018 will test the power of political nobodies Ryan signals support for McCarthy as next GOP leader MORE (R-Va.) on the need to return to work, he has not gotten a reply.

"But I can tell you, I saw an email from some of my other freshman colleagues, and you're starting to see a lot of people in their districts talking about, 'You need to get back up to Washington, D.C. You need to press on,' " he said.

When asked about the possibility of trying to lead the effort to return to Congress by returning alone, West said that could be a possibility.

"I believe that sometimes, you do have to stand alone, and maybe that's something I would have to come back and do and I'd be more than willing to do that," he said. "And I think that the constituents down here in CD-22 would understand me doing that, and possibly others will follow suit."