"I don't think I need to make any decisions right now, really," he said when asked about his future political plans, according to the New Hampshire Union-Leader

"I'm not quite sure what I'm going to do, to be honest with you."

Brown has fueled speculation about a potential Senate bid in New Hampshire in 2014 with five appearances across the state over the past month. He spoke Saturday night at a fundraising gala for a nonprofit.

He'd enter the race an underdog, with Democrats seeking to make his residency in Massachusetts an issue. But Brown would easily pull in millions of dollars for a campaign, and Democrats privately admit he could give Shaheen a headache in her reelection contest.

And though he isn't yet officially facing Shaheen, Brown did take the opportunity to jab her in his response to an attack from the New Hampshire Democratic Party that called New Hampshire Republicans "desperate" for turning to Brown for fundraisers.

"It shows that [Democrats] must be concerned," he said.

He added: "You know what's desperate is the fact that you have a senator who voted for ObamaCare that's crushing businesses and has never hesitated to raise taxes."

"What's desperate is that Washington is broken and they want to make sure that people like me don't get back down there to solve problems," he said.