WATCH: Perry says he’s had ‘no conversation’ about taking over VA

Energy Secretary Rick PerryJames (Rick) Richard PerryOvernight Cybersecurity: Senators want info on 'stingray' surveillance in DC | Bills to secure energy infrastructure advance | GOP lawmaker offers cyber deterrence bill House panel advances bills to guard energy grid from cyberattacks The ‘victim card’ always obscures the truth MORE shot down talk that he could move to the Department of Veteran Affairs (VA) if President Trump fires current VA Secretary David ShulkinDavid Jonathon ShulkinTrump VA pick faces challenge to convince senators he’s ready for job Trump campaign staffer accused of sexual harassment tapped for VA post Overnight Health Care: Rep. Debbie Dingell on the pain and tragedy of the opioids crisis | DEA moves to curb opioid oversupply | Dem says Trump pick opposes VA privatization MORE

Asked if he has talked to the White House about making the move, Perry told reporters Wednesday: “Not offered, no conversation about it." 

Following President Trump's abrupt firing of Secretary of State Rex Tillerson on Tuesday and his comments that he almost has the Cabinet that he wants in place, speculation has swirled on Capitol Hill over which administration official may be replaced next. 

Multiple news outlets, led by The New York Times, reported Tuesday that President Trump was considering firing Shulkin and moving Perry into the job.

Lawmakers tell The Hill privately that the president seems displeased with Shulkin's performance and he may be the next official to go.