Sen. Joe Lieberman (I-Conn.) isn't feeling as safe in federal buildings after a Government Accountability Office (GAO) report found major flaws in the Federal Protective Service (FPS), which guards a number of federal buildings.

"Well I did until after I saw this investigation," Lieberman said on Fox News in response to a question about whether he feels safe in federal buildings.

The GAO report released Tuesday found that the FPS often failed to detect bomb-making materials smuggled into high-profile federal buildings in the past year. One of those test targets included the office of an unnamed U.S. Senator, according to the Washington Post.

"It was jaw-dropping; it was infuriating," Lieberman said of the report, going after the guards in the FPS themselves for their performance, calling them "guards who obviously don't appreciate the importance of what they're doing in an age of terrorism."

Lieberman called for a dramatic "shake-up" of the agency, but stopped short of calling for the firing of the director. The Connecticut centrist, who is the chairman of the Senate Homeland Security Committee, said he's unwilling to give the FPS much more money, too.

"This is outrageously unacceptable failure by a federal government agency," he said. "This is a sick agency, and its sickness endangers a lot of Americans."