Content & data

Content moderation

Check a community message against your moderation rules.

For community managers and app builders

Jev AI playground

Checking availability…

Text

223 / 50,000

Try different inputs · Content moderation

Load an input to edit it. Tokens are used only when you run it.

Normal input

Negative feedback can remain acceptable.

Ambiguous input

A request for permission is different from posting an unsolicited promotion.

Missing information

Avoid inventing a community policy or guessing the preceding conversation.

Rule violation

A clear unsolicited promotion provides a contrast to legitimate criticism.

Questions2

choiceClassify under the supplied rules. Criticism of product quality is acceptable unless it also meets a prohibited category.⌄

Question

Answer options

Yes / NoDoes the message violate an explicitly supplied rule? Negative sentiment alone is not a violation.⌄

Question

Advanced: edit JSON

Edit or paste a question configuration.

[
  {
    "id": "category",
    "type": "choice",
    "instructions": "Classify under the supplied rules. Criticism of product quality is acceptable unless it also meets a prohibited category.",
    "options": [
      {
        "label": "acceptable",
        "description": "Permitted discussion or criticism without a policy violation."
      },
      {
        "label": "harassment",
        "description": "Targeted personal abuse or repeated unwanted attacks."
      },
      {
        "label": "threat",
        "description": "An expressed intention to harm a person or group."
      },
      {
        "label": "spam",
        "description": "Unsolicited promotional content prohibited by the policy."
      },
      {
        "label": "unclear",
        "description": "Missing policy or context prevents a reliable category judgment."
      }
    ]
  },
  {
    "id": "violates_rules",
    "type": "noul",
    "instructions": "Does the message violate an explicitly supplied rule? Negative sentiment alone is not a violation.",
    "options": []
  }
]

Runs use input tokens and are saved to your account.

Results

Your answers will appear here.

Add your text and questions, then run Jev.

Probabilities express model confidence, not a guarantee of correctness.

Set up this template

Keep criticism visible while identifying messages that need policy review.

What to provide

The message and a specific policy; include surrounding conversation when meaning depends on it.

Include the community policy and the full message.
Define violations separately from acceptable criticism.
Send uncertain or potentially violating messages to a review queue.

Outputs and rules

category · choice

The policy category that best describes the message.

Classify under the supplied rules. Criticism of product quality is acceptable unless it also meets a prohibited category.

acceptable: Permitted discussion or criticism without a policy violation.
harassment: Targeted personal abuse or repeated unwanted attacks.
threat: An expressed intention to harm a person or group.
spam: Unsolicited promotional content prohibited by the policy.
unclear: Missing policy or context prevents a reliable category judgment.

violates_rules · Yes / No

Whether a stated rule is broken.

Does the message violate an explicitly supplied rule? Negative sentiment alone is not a violation.

Try different inputs

Normal input

Negative feedback can remain acceptable.

Rules: Constructive criticism is allowed. Personal harassment, threats, and unsolicited promotional links are not. Message: This release is frustrating. The search is slower and I wish the team had tested it more carefully.

Ambiguous input

A request for permission is different from posting an unsolicited promotion.

Rules: Constructive criticism is allowed. Personal harassment, threats, and unsolicited promotional links are not. Message: I found a tool that might help with this. Can I share the link?

Missing information

Avoid inventing a community policy or guessing the preceding conversation.

Message: Get out of this thread. Policy: Not provided. Conversation: Not provided.

Rule violation

A clear unsolicited promotion provides a contrast to legitimate criticism.

Rules: Constructive criticism is allowed. Personal harassment, threats, and unsolicited promotional links are not. Message: Buy my unrelated crypto course today: https://example.com/course — reposting this in every discussion.

Use the result

Use the category to organize review. Any hide or remove action should follow your policy and retain an appeal or correction path.

Limits to keep in mind

Results depend on the rules you provide. Review uncertain cases yourself: the model may misread context, quotations, or intent.