The sandwich chain opened its first store in 2008, and has since expanded to seven locations. During that trip, the president ordered a Spruce Street roasted turkey sandwich.
The impromptu trip prompted Brendan Buck, a spokesman for Speaker John Boehner (R-Ohio), to tweet that the leaders had found "common ground" amid the government shutdown.
"John Boehner really likes Taylor Gourmet," Buck said.
In fact, the restaurant chain catered a lunch with the president and congressional leaders last year.
It's possible Obama made the trip because he was getting tired of the menu options at the White House on the fourth day of the shutdown.
With a skeleton staff, the White House mess below the West Wing has been been serving a limited menu during the shutdown.