WATCH: Perry says he’s had ‘no conversation’ about taking over VA

Energy Secretary Rick PerryJames (Rick) Richard PerryWhite House staggers after tumultuous 48 hours Perry won't comply with subpoena in impeachment inquiry Overnight Energy: Trump taps deputy energy secretary to replace Perry | Praises pick Dan Brouillette as 'total professional' | Perry denies quid pro quo over Ukraine MORE shot down talk that he could move to the Department of Veteran Affairs (VA) if President Trump fires current VA Secretary David ShulkinDavid Jonathon ShulkinVA under pressure to ease medical marijuana rules Press: Acosta, latest to walk the plank Senior Trump administration official to leave post next week MORE

Asked if he has talked to the White House about making the move, Perry told reporters Wednesday: “Not offered, no conversation about it." 

Following President Trump's abrupt firing of Secretary of State Rex Tillerson on Tuesday and his comments that he almost has the Cabinet that he wants in place, speculation has swirled on Capitol Hill over which administration official may be replaced next. 

Multiple news outlets, led by The New York Times, reported Tuesday that President Trump was considering firing Shulkin and moving Perry into the job.

Lawmakers tell The Hill privately that the president seems displeased with Shulkin's performance and he may be the next official to go.