Even though Rep. Walt Minnick (D-Idaho) became the second House Democrat to call for Rep. Charles Rangel's (D-N.Y.) ouster Tuesday, he said he is confident the embattled congressman won't be a campaign problem for Democrats in the fall. 

Asked whether Rangel could be a distraction for House Democrats on the campaign trail, Minnick told The Hill, "I don't think so."

"In my state, most people don't even know who Congressman Rangel is," he added. 

Minnick represents a largely conservative district and is a top Republican target this fall. 

The freshman Democrat said while he still thinks Rangel should step down "if the facts are as alleged," he said government spending and fiscal responsibility are more important issues for voters in his district. 

On Friday, Rep. Betty Sutton (D-Ohio) became the first House Democrat to call for Rangel to resign his seat.

Republicans are working to tie congressional Democrats to Rangel in light of the ethics charges, and the congressman's woes are likely to be a major part of the GOP's message this fall.