Meta's AI Moderation Is Banning Real Businesses by Mistake

The complaint has become common enough to sound like a pattern. A small business logs in one morning to find its Instagram or Facebook account gone, years of posts and followers wiped out, with no clear reason and no obvious way to reach a person. Users say Meta's automated moderation is deleting legitimate accounts by mistake, and that when they appeal, the appeal is often judged by more AI. Some accounts were only restored after journalists got involved, including one with close to a million followers.

Meta has not denied the problem. In its own words, the company acknowledged that when it enforces its policies, error rates are too high, harmless content gets taken down, and too many people are penalized unfairly. That is a striking admission from a platform that has spent years arguing automated systems are the only workable way to moderate at its scale.

The numbers Meta prefers

The company's defense rests on comparison. Meta says its newer AI moderation tools make 13 percent fewer mistakes than human reviewers and catch 10 percent more genuine violations, and that the accounts making headlines were mostly banned by older systems, not its latest models. Both things can be true. A system can be better than the humans it replaced and still ruin someone's livelihood when it gets a case wrong, because the person on the other end has no realistic route to a fair second look.

That is the part the percentages miss. Meta's own Oversight Board warned in June that account bans lack due process and transparency, and the appeals loop is exactly where that failure lands hardest. When the machine that banned you is also the machine that hears your appeal, being right is not enough. There is a broader lesson here for anyone deploying AI as a gatekeeper. Accuracy on average is not the same as fairness in the individual case, and it is the individual cases that people actually live inside. A 13 percent improvement is cold comfort to the shop owner who was on the wrong side of it.