The moment a Cabinet minister had to check her phone on Good Morning Britain to see if she had Boris Johnson's number