Google Photos Labels Black Users as Gorillas — Fix: Remove Gorillas from Labels
What happened
Google Photos' image recognition system classified photos of Black individuals as "gorillas." Google's temporary fix was to suppress the label entirely, and in 2018 it was revealed that gorillas, chimps, and related animals remained uncategorised in Google Photos — a suppression that persisted for years.[1]
What went wrong
The training dataset was insufficiently diverse, leading to a model that performed poorly on darker-skinned subjects. The remediation — removing animal categories — addressed the symptom rather than the root cause of biased training data and evaluation metrics.[1]
Lesson learned
Training data diversity is a safety requirement, not a nice-to-have. Evaluating model performance must include disaggregated metrics across demographic groups. Removing labels to avoid bias is not a fix — it shifts the failure from visible to invisible.
Sources
- [1]
External links can go dark — pages move, paywalls appear, domains expire. Every source above includes a Wayback Machine snapshot link as a fallback. All citations are best-effort research; if a source contradicts our summary, the primary source takes precedence.