Jevdit: A social network moderated by Jev

If you think you can create a website and allow anyone to post content on there without moderation, then bless your heart, as my imaginary southern grandma would say. Being able to post anything anonymously means, for some people, that they will do exactly this. I won’t mention the content you’ll end up with, as this is a family-friendly blog.

Reddit “solved” content moderation by outsourcing it to the communities themselves. Being a moderator on Reddit is a huge time investment. Everyone wants your attention, and Reddit gets a lot of it, so any decently successful subreddit gets flooded with ads, bots and things that are not in the interest of the subreddit. This also led to the cliché of the typical Reddit mod: unemployed, always online and hungry for power, as you need the first two things to be able to successfully moderate.

The issue then arises that these mods can shape their communities however they want, for better or worse. Often for the worse, sadly. But somebody has to do it, and the community would be waaaay worse without anyone moderating it.

With the advent of AI and ML, our computers can understand language well enough to even understand irony. The paper LLMs vs. humans in sarcasm detection on German soccer tweets created a small dataset and tested it against models. While their paper showed that humans were still better, they used older models. I ran it against the latest breed of OpenAI models as well as Jev, and the results are that your computer is now better at recognizing when you're joking than the average human. It's a fairly small dataset, though — only 100 tweets — but it clearly paints a picture.

Automoderation is thus actually widely used in moderating the internet; for example, YouTube is basically fully auto-moderated by now . Every other social network most certainly is similar. Humans should not have to review the filth of the internet.

These automoderation techniques are now accessible to anyone, basically. You don't need your own huge training corpus anymore — no fancy pipelines, no huge infra costs. One very interesting one was just released.

Jev is a general classifier that you don't have to train to use. It's quite good at classifying anything you throw at it. As it is very fast and cheap, I was wondering: could you automoderate a Reddit-like website purely with Jev? It is cheap enough that I could run a decently sized community with it: at the cost measured in my benchmark, 10,000 posts and comments a day would cost about $15 for a 30-day month.

For scale, Reddit reported 4.4 billion posts and comments in 2025. Running that volume through Jev at the same rate would come to roughly $18,000 a month. So actually quite attainable.

So I built Jevdit — a Reddit-like social network, where everything is moderated by Jevdit. You can post and create subreddits however you want, as long as Jev permits it. You can even change the rules of a subreddit — by creating a Jevdit post where you argue with the community about it, and Jev then decides if it thinks that enough people agree with the changes.

To make sure I don’t just blindly put my hand into the fire here while Jev looks at me with a smirk, saying “Trust me, bro,” I ran some of my own benchmarks to calm down my anxiety about putting an open website into the birthplace of 4chan.

There are gladly several public datasets that you can use to see how well your automoderation technique performs. I also ran it with the latest models as well as some other interesting models. I combined here the results of all datasets for an average; below, you can see the detailed results if you care.

A moderator has two jobs: stop the bad stuff and let people talk. You want a balance — if you just block every comment, you definitely catch 100% of the bad stuff. So we have two bars here: how much of the bad stuff was caught vs. how much of the good content was allowed.

Jev did quite well here! Due to its nature, you can select how strict you want to be — every result has a confidence; you set the cutoff yourself, which made it actually the best model for my purpose here — I wanted to be very strict.

So, with all this analysis, I feel a little bit confident I won't create another Tay. So check out jevdit.com and see if Jev can handle the moderation.