They say "Heavy is the head that wears the crown".
IMO, many Presidents look MUCH older when leaving office, when compared to their first arrival (at the White House) photos.
Probably the stress associated with the job.
I can only imagine insider knowledge of an "ET Presence" is one of those stressful issues that could age a man prematurely. Especially if the topic is presented purely from a Threat Assessment POV.