Advanced application of GigaChat at Rabota.ru. Recommendations and auto-moderation

Artem Sebalo25 May 2024

Problem

A job site such as Rabota.ru must keep discriminatory vacancy texts ("only women", "Slavic appearance") off the site, while honest employers should get through fast. Human moderators cost about 15.5 rubles per vacancy. Collections like "Work with daily payments" were assembled with regular expressions that are hard to maintain: about 20% of vacancies in that collection had no information about daily payments.

Example from the article: a mechanic vacancy for repairing GAZelle vans ("4,000 rubles per shift, in hand at the end of each day") was missing from the collection because no regular expression matched it, while an LLM flagged it correctly.

Solution in brief

Send the vacancy text to GigaChat with a short prompt that forces a binary answer. For moderation, the model answers "violates / does not violate" and the flagged items go to a human; for collections, it answers YES or NO. No model training is needed, only a service that calls the API and stores the answer.

Questions this case answers
  • How to replace hand-written regular expressions with a large language model for yes/no classification of short non-English texts when no training set exists
  • How to route a short-text moderation decision to a human reviewer while keeping the per-item cost of the automated check low
  • How to moderate job vacancy texts for discrimination with an LLM at a lower cost per item than manual review
  • How to classify vacancies or listings into thematic collections with an LLM instead of regular expressions

Tools and methods

  • GigaChat Pro and GigaChat Lite — LLM tiers compared on moderation and classification
  • Zero-shot prompting with a binary answer — one system prompt, vacancy text appended
  • GigaChain — fork of LangChain with GigaChat APIs; used for the RAG pipeline
  • Hybrid retrieval (BM25 + FAISS, multilingual-e5-base embeddings) — review assistant PoC
Continue reading — it's free

Google or a one-time email code. No password.