Holder said Thursday he was still weighing whether to return for a second term during a speech to law students at the University of Baltimore School of Law.

According to the report, the attorney general said he still needed to consult with the president and his family before making a decision on a second term. And, Holder said, he needed to ask himself, "Do I have some gas left in the tank?"

Earlier this year, Patrick looked to downplay speculation about a potential appointment to either the president's Cabinet or the Supreme Court at a meeting with business leaders in Boston.

ā€œIā€™m not going anywhere,ā€ Patrick said, according to the Boston Herald.