Telegram CEO says extortionist planted CSAM to get app removed from Apple's App Store
A malicious actor allegedly used illegal content to trigger Apple's moderation systems, highlighting platform trust and safety risks
Telegram CEO Pavel Durov has accused an extortionist of planting child sexual abuse material (CSAM) in a public chat on the messaging platform, leading to Telegram's temporary removal from Apple's App Store on Monday night. According to Durov, Apple removed the app without first contacting Telegram. The incident raises concerns about how platform moderation systems can be weaponized by bad actors to cause reputational and operational harm.
Durov stated in a post on X that the removal was triggered by the planted CSAM, which Apple's automated systems likely detected. The exact nature of the extortion demand or the identity of the alleged perpetrator has not been disclosed. Telegram has not yet commented on whether it has appealed the removal or what steps it is taking to prevent similar abuse.
Why it matters
This event illustrates a growing vulnerability in platform trust and safety: content moderation systems, especially those relying on automated detection, can be exploited by malicious actors to cause collateral damage. As digital platforms increasingly rely on algorithmic enforcement, the risk of false positives or targeted abuse rises. This affects not only large platforms like Telegram but also any service that hosts user-generated content and relies on third-party app stores for distribution.
Extortionist plants CSAM
Malicious actor uploads illegal content to a public Telegram chat
Apple's automated scanner detects CSAM
Apple's system flags the content using hash matching or AI
Apple removes Telegram without notice
Automated enforcement triggers app takedown from App Store
What you can learn from this
- Content moderation pipelines are attack surfaces. Automated systems that scan for prohibited content (e.g., CSAM hashes, text classifiers) can be triggered by deliberately planted material. As a learner, understand that any automated moderation system you build or integrate should have human-in-the-loop review for high-stakes actions like app removal, and implement rate limiting or anomaly detection to flag suspicious upload patterns.
- App store policies create single points of failure. Apple's centralized control over iOS app distribution means a single moderation decision can remove a service from millions of devices. When designing systems that depend on third-party platforms, consider building fallback channels (e.g., web-based access, alternative distribution) and maintaining direct communication lines with platform trust and safety teams.
- Trust and safety teams need adversarial thinking. The extortionist's tactic—planting illegal content to trigger a takedown—is a form of adversarial attack on moderation systems. Learn to model threats not only from external hackers but also from users who might abuse reporting or detection mechanisms. Practise red-teaming your moderation pipeline by asking: "How could someone force a false positive?"
- Incident response plans should include platform dependencies. If your app relies on an app store for distribution, your incident response plan should include steps for communicating with the store operator, preparing a public statement, and activating backup distribution methods. This event shows that even large companies can be caught off guard by a sudden removal.
- Automated detection is not infallible—design for appeals. Durov's complaint that Apple removed Telegram before contacting them highlights the need for transparent appeals processes. When building moderation systems, always provide a clear, timely path for content creators or service owners to contest decisions, and log all automated actions for audit.
We teach this
Sources
- Telegram CEO says an extortionist planted CSAM in a chat to get it pulled from the App Store — The Verge
Our reporting is an original summary; full coverage is at the links above.
Don't just read about it — build it.
Square 1 teaches the skills behind the headlines, with every line of your work graded by AI. Find your starting point in 3 minutes.
Get your free skill report