The claim was made by Peter Herbert, chair of the Society of Black Lawyers, who also criticised the FA and Chelsea after the police dropped an investigation into referee Mark Clattenburg.
David Bernstein: "These ill-informed and unhelpful remarks are at odds with the progressive and responsible approach being followed by the game with the support of Government to deal with these serious issues.
"The FA will continue working to strengthen processes to eradicate all forms of discrimination in football."
The Football Association have been criticised by a campaigning group after the police announced no action will be taken over alleged comments made by referee Mark Clattenburg.
Yesterday's article ...
Chelsea made a complaint to the FA alleging the referee had used inappropriate language, understood to have been interpreted as a racist remark, to midfielder John Obi Mikel.
Although the club did not involve the police, the Society of Black Lawyers (SBL) made a complaint to the Metropolitan Police based on media reports of the alleged incident.
Scotland Yard announced on Tuesday night no action would be taken "because no victims had come forward" - and that has prompted criticism of Chelsea and the FA by SBL chair Peter Herbert for not going to the police.
Peter Herbert: "It would appear that there is a cosy little agreement between Chelsea FC and the FA not to report these matters to the Metropolitan Police but to have them dealt with solely by the FA.
"The FA have a dreadful record of indifference on hate crime generally; failing to challenge anti-Semitism at Tottenham Hotspur and at other grounds; eventually finding John Terry made a racist remark but remarkably found him not to be a "racist"; whilst the derisory penalty of a four or eight-match ban [Luis Suarez] is believed to be a suitable punishment for what in any other industry would be summary dismissal for gross misconduct."
The FA is expected to announce the outcome of its investigation into Chelsea's complaint within 48 hours.