It’s been a rough few years for Simon Cowell