Potter’s dismal spell in charge of Chelsea came to an end on Sunday evening as the former Brighton boss was sacked after less than seven months in the role.
The 47-year-old won just 12 of his 31 games in charge, with Chelsea dropping into the bottom-half of the Premier League after Saturday’s 2-0 defeat at home to Southampton.
Chelsea’s underwhelming form has come despite new owner Todd Boehly spending almost £600m on new signings over the last two transfer windows.
‘I thought Graham Potter would see out the season, I was wrong about that,’ Ferdinand said on the FIVE YouTube channel.
‘I’m not saying he was the perfect choice – I don’t think they should have got rid of Thomas Tuchel in the first place – but we can spin it another way because everyone says how English coaches don’t get the opportunities.
‘He was doing well at Brighton and looking back I think he was a decent choice. What really went against him was all those signings.
‘You can say it was the experience but loads of managers get big jobs without huge amounts of experience. Signing all those players and having to deal with that wasn’t easy.
‘It was a tough, tough job for him. When all those elements come together, I think any manager would have struggled.’
Former Brighton midfielder Bruno Saltor has been put in temporary charge of Chelsea while they search for Potter’s permanent successor.
The Stamford Bridge hierarchy are believed to be willing to wait until the summer to unveil a new manager, with Julian Nagelsmann and Mauricio Pochettino heavily linked with the job.
The Blues are not the only Premier League club in London searching for a new manager, with Tottenham also in the hunt for a new head coach after sacking Antonio Conte.
Like Chelsea, Spurs are also expected to hold off until the end of the season to appoint a manager, with similar names being linked with the north London club.
Ferdinand reckons Tottenham could poach former Bayern Munich boss Nagelsmann, giving Chelsea a clear run at ex-Spurs manager Pochettino.
The former Manchester United and England defender added: ‘I think Mauricio Pochettino goes to Chelsea.
‘Daniel Levy doesn’t look that interested in him at the moment. If he was keen he would have got him in already. I think Julian Nagelsmann might go to Spurs.’
For more stories like this, check our sport page.