Some of the Democratic defectors, like Rep. Kurt Schrader (D-Ore.), who is also heading into a tough race in 2014, said the budget didn't offer a balanced approach.

"It is not enough entitlement reform in there going forward. It needs to be a more complete and balanced picture and it wasn't bipartisan in the end of the day," Schrader told The Hill.

Rep. Ann McLane Kuster (D-N.H.), who also voted no on the budget, said in a statement that "none of the budget proposals on the table this week reflect the type of bipartisan compromise that New Hampshire families expect and deserve."

Aside from policy implications, most of the members who voted no on the budget had political implications to consider as well.

The NRCC has already begun to use the Senate budget to attack House Democrats. The committee issued a release on Tuesday charging that average household income would drop by more than $2,400 if the Senate budget were passed. The NRCC cited a report from Republican staff on the Senate Budget Committee.

That release targeted Kuster, Kirkpatrick, and Reps. Ami BeraAmerish (Ami) Babulal BeraDefense & National Security — Troops secretly train with Taiwan as tensions with China continue Lawmakers call for end to 'strategic ambiguity' on Taiwan Overnight Defense & National Security — Blinken heads to the hot seat MORE (Calif.), Paul Ruiz (Calif.), Scott Peters (Calif.), Patrick Murphy (Fla.), Brad Schneider (Ill.), Sean Patrick Maloney (N.Y.), Pete GallegoPete Pena GallegoER doctor chosen to lead Hispanic Caucus 4 Texas GOP congressional primary runoffs to watch GOP candidate scores upset win in Texas state Senate runoff MORE (Texas) and Suzan DelBeneSuzan Kay DelBeneLawmakers push for more funding on chronic kidney disease treatment Democrats need a win — now Seattle-area lawmakers say colleague's campaign flyer is racist, 'horrifying' MORE (Wash.). All but DelBene voted against the Senate budget on Wednesday.

The NRCC continued the attack on Wednesday with a paid web ad that featured average Americans urging their members to balance the budget, and calling for viewers to "co-sign Paul RyanPaul Davis RyanJuan Williams: Pelosi shows her power Cheney takes shot at Trump: 'I like Republican presidents who win re-election' Cheney allies flock to her defense against Trump challenge MORE's plan to balance the budget in 10 years."

Rep. Paul Ryan's (R-Wis.) budget is due for a vote on Thursday, and it is expected to pass with majority Republican support. It has come under fire from Democrats, as it balances the budget by scaling back Medicare and other entitlements.