The committee said Obama will take the oath of office at the White House on Sunday in "a small private" ceremony.
It was the word "private" that led to questions about whether the press would be allowed to cover the event.
"The White House is working on details with the pool and the press corps," he said.
This is the seventh time a president has taken the oath on Sunday and then ceremonially on Monday.
The last was Ronald Reagan in 1985, when he took the oath at the White House on Sunday, which was televised, and then had another swearing-in on Monday at the Capitol.