But, if Boris Johnson thought things were going to be easier away from London then he was in for a shock when he visited Leeds.
The Prime Minister was heckled for being in Yorkshire instead of Brussels to negotiate Britain’s exit from the European Union.
The incident, which came just hours after Boris Johnson discovered his own brother had quit his government, was captured by the BBC.
TV cameras showed a man approaching Mr Johnson in the market town of Morley in Leeds, and immediately gave the prime minister his view on Brexit.
"You should be in Brussels negotiating!" the man shouted as Boris Johnson arrived in town.
"I have been negotiating!" insisted an agitated prime minister.
"You are not! You are in Morley in Leeds!" the man shouted back.
He added: "You are playing games, you are playing games!"
An uncomfortable-looking prime minister replied: "I think what people want us to do is leave the European Union on October 31st."
"Well we all know that!" continued the man.
"Well that's fantastic then, that's what we're going to do," said the prime minister.
It was not the only altercation the PM had with a member of the public in Morley.
He was also told - politely - to “please leave my town” by an elderly gentleman who was shaking the PM’s hand at the time.
Mr Johnson replied: “I will, very soon.”
Read more on Yahoo News UK
Burglar caught out after leaving traces of DNA while eating fishcake
At least 30 injured after express train derails in Japan
Man and woman found dead in Burton house, child rescued
The incident led to the hashtag #PleaseLeaveMyTown trending on social media.
To cap off his bad day in Yorkshire, it was hours later that he appeared in Wakefield with police officers.
Critics have accused the PM of undermining the impartiality of police officers by using them as a backdrop for a political speech.