While the Senate has yet to act on any of these bills, West said it would make sense for both the House and Senate to return, given the short deadline.

"We've got work to do, and I don't think that this is the time for me to sit back and point fingers at the Senate," he said. "But America right now needs leadership, and I would say that America is like a rudderless ship at sea in a very tumultuous storm and we're headed toward the rocks and no one's at the helm."

He also said that while he has emailed House Majority Leader Eric CantorEric CantorTop Lobbyists 2017: Hired Guns GOP Rep. Jeb Hensarling to retire after end of current term A tyranny of the minority is raising your health care costs MORE (R-Va.) on the need to return to work, he has not gotten a reply.

"But I can tell you, I saw an email from some of my other freshman colleagues, and you're starting to see a lot of people in their districts talking about, 'You need to get back up to Washington, D.C. You need to press on,' " he said.

When asked about the possibility of trying to lead the effort to return to Congress by returning alone, West said that could be a possibility.

"I believe that sometimes, you do have to stand alone, and maybe that's something I would have to come back and do and I'd be more than willing to do that," he said. "And I think that the constituents down here in CD-22 would understand me doing that, and possibly others will follow suit."