Our summary
A community filter needs to distinguish harassment from harsh criticism and an attack from a discussion about attacks. This recipe asks Jev separate questions about several hazards. Each question explains both what counts and what should not count as that risk.
The program applies different action rules to the resulting probabilities. Strong signals can block a message, uncertain cases go to moderators, and lower signals allow publication. Possible self-harm follows a separate route to a person who can help rather than simply being blocked.
The author's examples show how an overly simple blocking cutoff rejected harmless posts. That small test does not establish protection against unfamiliar attacks or a different community's language. The recipe is explicitly a first filter, not a replacement for human moderators or crisis services.
Key takeaways
- Describe harmless boundary cases in every risk question.
- Make the next action depend on the kind of harm and the cost of mistakes.
- Test difficult examples from the actual community before relying on a filter.