Updates

Image moderation now available

Christopher Dengsø

Jan 26, 2024 — 2 min read

I'm excited to announce that you can now moderate images with moderation API. Setting up image moderation works similarly to text moderation. You can adjust thresholds, and disable labels that you do not care about when flagging content.

Image Moderation Configuration with Moderation API

We offer 9 different labels out of the box - all available through a single model.

Nudity: Exposed male or female genitalia, female nipples, sexual acts.
Suggestive: Partial nudity, kissing.
Gore: Blood, wounds, death.
Violence: Graphic violence, causing harm, weapons, self-harm.
Weapon: Weapons either in use or displayed.
Drugs: Drugs such as pills.
Hate: Symbols related to nazi, terrorist groups, white supremacy and more.
Smoking: Smoking or smoking related content.
Alcohol: Alcohol or alcohol related content.

In case you need any other labels, please let us know.

Support in the review queue

Image moderation is also working seamlessly with the content review queue. Here you'll be able to see a small preview of the images, and otherwise perform actions just as you do with text.

New endpoint

The new capabilities are used via a new endpoint for image moderation.

You can find the API reference here:

Or use our Typescript package from NPM here:

Upgraded Content Analytics.

I'm excited to announce the launch of the upgraded analytics dashboard that will provide deeper insights into user behaviour and content trends on your platform. With a privacy-first design, these analytics tools will allow you to track and understand how people are using and potentially abusing your platform,

Review Queue Label Filter

You can now add custom label filters for review queues. This allows you to create queues like: * Show items with the POSITIVE label to find positive user comments. * Show items where the TOXICITY label has a score between 20% and 70% to find content where the AI is uncertain. * Filter

2024 January Update

We are thrilled to kick off 2024 with a host of exciting new features, and we have many more in store for the year ahead. Label Thresholds In your moderation project, you now have the ability to adjust the sensitivity per label, providing fine-grained control over content flagging. Additionally, you

New models: Sexual, Discrimination, Violence, and Self-harm

We've just made 4 new classifier models availabel in your dashboards. Sexual model - Moderation APIModeration APIDiscrimination model - Moderation APIModeration APISelf harm model - Moderation APIModeration APIViolence model - Moderation APIModeration API