The PM previously said the image of the Tory doyenne was taken down because he does not like 'pictures of people staring down at me'.