Some of the Democratic defectors, like Rep. Kurt Schrader (D-Ore.), who is also heading into a tough race in 2014, said the budget didn't offer a balanced approach.

"It is not enough entitlement reform in there going forward. It needs to be a more complete and balanced picture and it wasn't bipartisan in the end of the day," Schrader told The Hill.

Rep. Ann McLane Kuster (D-N.H.), who also voted no on the budget, said in a statement that "none of the budget proposals on the table this week reflect the type of bipartisan compromise that New Hampshire families expect and deserve."

Aside from policy implications, most of the members who voted no on the budget had political implications to consider as well.

The NRCC has already begun to use the Senate budget to attack House Democrats. The committee issued a release on Tuesday charging that average household income would drop by more than $2,400 if the Senate budget were passed. The NRCC cited a report from Republican staff on the Senate Budget Committee.

That release targeted Kuster, Kirkpatrick, and Reps. Ami BeraAmerish (Ami) Babulal BeraCook Political Report moves 9 House races toward Dems Dems float revoking congressional medal for Myanmar leader Week ahead: Defense spending ties up budget talks MORE (Calif.), Paul Ruiz (Calif.), Scott Peters (Calif.), Patrick Murphy (Fla.), Brad Schneider (Ill.), Sean Patrick Maloney (N.Y.), Pete GallegoPete Pena GallegoTexas Democrats smell blood in the water for 2018 ObamaCare repeal vote: 15 GOP lawmakers to watch Vulnerable Texas GOP lawmaker survives rematch MORE (Texas) and Suzan DelBeneSuzan Kay DelBeneLawmakers question FBI director on encryption Lobbying World House panel begins evaluation of expired tax breaks MORE (Wash.). All but DelBene voted against the Senate budget on Wednesday.

The NRCC continued the attack on Wednesday with a paid web ad that featured average Americans urging their members to balance the budget, and calling for viewers to "co-sign Paul RyanPaul Davis RyanLieu rips Ryan after Waffle House shooting: ‘When will you stop silencing us?’ To succeed in Syria, Democrats should not resist Trump policy House Republicans prepare to battle for leadership slots MORE's plan to balance the budget in 10 years."

Rep. Paul Ryan's (R-Wis.) budget is due for a vote on Thursday, and it is expected to pass with majority Republican support. It has come under fire from Democrats, as it balances the budget by scaling back Medicare and other entitlements.