Rep. Louie GohmertLouis (Louie) Buller GohmertThis week: Congress seeks to avoid a shutdown Lawmakers call on Treasury to take tougher stance on Hamas in Qatar Colbert spoofs Louie Gohmert's Uranium One chart MORE (R-Texas), who clashed with Attorney General Eric HolderEric H. HolderFBI director defends agency after Trump attacks: It's an 'honor to represent you' FBI agents fire back at Trump: Saying we're not dedicated is 'simply false' Holder hits back at Trump: The FBI’s reputation is not in 'tatters' MORE during a hearing this week, disputed accusations that the GOP's investigations of the Obama administration were racially motivated.

"There are some of us that could care less about someone's party or someone's race or someone's gender, someone's age. We don't care. We care about whether you are helping or hurting our country if you are in a position to do one or the other," Gohmert said in a House floor speech Thursday. 

Holder suggested in remarks before Rev. Al Sharpton's annual National Action Network convention on Wednesday that Republicans have behaved differently toward him and President Obama compared to their predecessors. 

"You look at the way the attorney general of the United States was treated yesterday by a House committee. Forget about me. What attorney general has ever had to deal with that kind of treatment? What president has ever had to deal with that kind of treatment?” Holder said.

Gohmert said the House GOP's investigations, such as the Fast and Furious arms trafficking investigation that led to a 2012 vote holding the attorney general in contempt of Congress, were simply standard oversight.

"If somebody wants to try to make something out of that, that's their problem," Gohmert said.

In a testy exchange during a House Judiciary Committee hearing on Tuesday, Gohmert pressed Holder again for documents related to the Fast and Furious investigation.

"You don't want to go there, buddy, all right? You don't want to go there," Holder said.

"Sir, we've been trying to get to the bottom of Fast and Furious where at least a couple hundred Mexicans died," Gohmert retorted. "So I don't need any lectures from you about contempt."

Eric Garland contributed to this report.