“Any time the president leaves the White House complex, there are risks,” a spokesman said.
The agents were reportedly sent to protect a friend of the agency's director in 2011.
Jay Carney said Obama also has confidence in its director after latest incident.
Mario Edward Garnett was shot and killed Saturday.
The Secret Service is investigating the breach, a spokesman confirmed to The Hill.
The agents were reportedly pulled from White House patrols.
The service is also implementing tighter rules on drinking.
Officers apprehended a man who tried to scale the White House fence with two bags.
The report gives 14 recommendations to make the steps for reporting misconduct clearer.
Whistle-blowers disclosed the information to Senate Homeland Security Committee members.