Panetta said he hopes a "partisan presentation" is avoided.
Homeland Security funding and the fight against ISIS will be among the topics.
“I don’t think we can take anything for granted,” he said.
An initial Pentagon review found the book revealed classified information.
Holder said he wouldn't "even consider" writing a critical book with Obama in office.
Panetta added that he thinks Washington is at its worst right now.
Panetta's memoir has garnered attention for its critique of Obama's foreign policy.
The former secretary said lawmakers should act soon "because this is war."
White House spokesman says it is "customary" for people to leave after midterm election.
"I would have taken some very tough positions with regards to Putin," he said.
he Pentagon's top military commander in Africa sparked alarm Tuesday.
Panetta said Obama hoped other countries could "step up to the plate."
The former Defense secretary said ISIS represents "a whole new phase" in war on terror.
He left the administration in 2013 after stints as CIA chief and Defense secretary.
Pentagon has struggled to produce records government and outside groups can accurately audit.
The U.S. launched a new wave of strikes and dropped arms for the Kurdish town.
“I don't think anybody intentionally made a decision not to help these people," Panetta says.
"I think Hillary put him up to it,” Morris said.
The Hill's Editor in Chief Bob Cusack recaps the biggest news stories of the week.
Panetta also said lawmakers have "a hard time trying to find the bathroom."
Former spokesman Bill Burton lashes out at Obama's ex-CIA chief.
Ex-CIA chief blasts the president; White House shrugs off criticism.
"It was important for us to stand by our word and go in," said the former DOD chief.
Panetta's memoir is already causing headaches for the administration.