Although we maintain that is has been a cracking series, viewing figures are down by about a quarter compared to the final last year when Little Mix won.
In just under two years, the ratings have halved, Saturday night's final reached a seven-year low of 9.7 million.
[Related story: Catch up on the X Factor Final LIVE BLOG]
[Related story: Chris Maloney banned from final, goes on Twitter rant and witch-hunt]
As a result, producers are frantically trying to give the show what they see as a much needed revamp to get the numbers back up.
A senior source said: "It doesn't take a genius to work out that the show is not in the best health. We have had some very strong singers this year but the show is feeling in need of a reboot."
The plan is to start shows earlier (watch out Strictly Come Dancing!) and reinstate the original audition structure where hopefuls sing acapella to the judges in an empty room.
So basically, taking things back to basics.
Show bosses are desperate for Simon Cowell to make a return however, with his busy schedule in America it is seeming almost impossible.
As a compromise, it is reported that he could be on the panel as solely a judge and not a mentor - which would mean he could fly back and forth to America in the week.
This also means he would have no loyalties which reads as 'GREAT TELLY' to us.
It's not sure yet which judges will be back however, there are rumours Nicole Scheriznger is leaving the show to focus on her music career.
This makes us very sad as Nicole was easily the best thing about this series.
Louis Walsh is almost definitely not going anywhere however, it is believed Tulisa may be replaced, perhaps with Sharon Osbourne.
It is also reported that Simon Cowell part blames Gary Barlow for the slump in ratings and is considering replacements.
However, as Tulisa pointed out on The Xtra Factor last night, no one really knows until around February when the judges hear about their contracts.
We are crossing our fingers and toes that Chery Cole is in the running!