WATCH: Perry says he’s had ‘no conversation’ about taking over VA

Energy Secretary Rick PerryJames (Rick) Richard PerryOvernight Energy: OPEC strikes deal to boost crude production | Pruitt sent one work email outside EPA in first 10 months | Perry, oil execs head to gas conference Overnight Energy: DNC to reject fossil fuel donations | Regulators see no security risk in coal plant closures | Senate committee rejects Trump EPA, Interior budgets DNC to reject fossil fuel company donations MORE shot down talk that he could move to the Department of Veteran Affairs (VA) if President Trump fires current VA Secretary David ShulkinDavid Jonathon ShulkinOvernight Defense: Trump orders Pentagon to help house immigrant families | Mattis says 'space force' needs legislation | VA pick gets hearing date Senate panel schedules hearing on Trump VA pick Press: Drain the swamp – of Scott Pruitt MORE

Asked if he has talked to the White House about making the move, Perry told reporters Wednesday: “Not offered, no conversation about it." 

Following President Trump's abrupt firing of Secretary of State Rex Tillerson on Tuesday and his comments that he almost has the Cabinet that he wants in place, speculation has swirled on Capitol Hill over which administration official may be replaced next. 

Multiple news outlets, led by The New York Times, reported Tuesday that President Trump was considering firing Shulkin and moving Perry into the job.

Lawmakers tell The Hill privately that the president seems displeased with Shulkin's performance and he may be the next official to go.