The Senate adjourned over the weekend after the overwhelming passage of a two-month payroll tax cut extension. House Republicans rejected the two-month extension as not long enough and House Speaker John BoehnerJohn Andrew BoehnerFormer top Treasury official to head private equity group GOP strategist Steve Schmidt denounces party, will vote for Democrats Zeal, this time from the center MORE (R-Ohio) has called on Obama to call the Senate back to Washington for further negotiations. 

"Why isn't he calling us in, why doesn't he join us here to try to make this happen?" Cantor said of Obama. "The differences aren't very great."

Reid's office has said he will not call the Senate back to Washington because there is "absolutely no reason" the House should not pass the compromise that passed the Senate with bipartisan support.

"Where people are frustrated is because they don't see Congress getting anything done," Cantor said. "We have members here in Washington ready to go back to work. ... We've got time before the end of the year — let's do our work like the American people are willing to do."

The payroll tax cut is set to expire at the end of the year.