Data Annotator/SQL

One of the leading Russian food retail companies is looking for a Data Annotator with SQL knowledge to analyze user queries addressed to the company’s internal chatbot — a product that provides information and analytics on key corporate reporting.

Key Responsibilities

1. Analysis of user queries and dialogues

• Analyze dialogues through the product’s admin panel.
• Review traces in Langfuse to see the full pipeline of how a request is processed.
• Identify problematic scenarios.

2. Building and expanding the set of queries

• Enrich the list of user queries used as few-shots and for quality evaluation.
• Create SQL queries needed to verify data correctness or improve chatbot performance.

3. Product improvement

• Highlight issues related to the admin panel’s functionality.
• Suggest improvements to the interface and workflow.
• Participate in refining and fixing existing SQL queries when needed.

Requirements

• 3+ years of experience in data/dialogue/content annotation.
• Ability to analyze complex user–system interaction scenarios.
• Strong attention to detail, structured thinking, and ability to follow guidelines.
• Basic SQL skills: simple SELECT / JOIN / WHERE queries, understanding of table structures, ability to adjust existing queries.
• Willingness to work with Langfuse and the internal admin panel.

Nice to Have

• Experience with ML products or chatbots.
• Understanding of LLM response quality evaluation principles.
• Skills in creating few-shots and test query sets.