U.S. -- not Cuba -- is the isolated party in longstanding feud between the two nations, said Rep. Barbara LeeBarbara Jean LeeAfghanistan moves reignite war authorization debate Lawmakers push Microsoft to ban private arbitration in all discrimination cases Hundreds demand US, UK, French action to end Yemen civil war MORE (D-Calif.), one of the lawmakers who traveled to Cuba this week.

"We have to remember, every country in Latin America, 15 countries, have normal relations with Cuba -- most of the E.U.," Lee said Wednesday morning on CNN. "We're the country which is isolated."

Lee said U.S. citizens should have a "right" to travel to Cuba, and said the members of the Congressional Black Caucus (CBC) who met with the country's communist leaders would press their cause soon with President Obama.

"We will communicate this to our president prior to the Summit of the Americas, which will be held in Trinidad, April 17," Lee asserted.

The several members of the CBC to have traveled to Cuba met with former dictator Fidel Castro and current President Raul Castro.