The Portuguese has brought the club into disrepute with a number of controversial comments and an ex-player says he has now gone too far