Data Annotation Project Manager

As a Data Annotation Project Manager you will play a vital role in leveraging the potential of AI technology in Allegro by enabling business, technology and research teams to secure and maintain high-quality annotated datasets.

We are looking for people with:

• Demonstrated ability to manage data annotation projects across multiple teams, building sustainable processes, coordinating release schedules and building consensus on difficult issues
• Practical knowledge of data annotation and quality assurance methods
• Good understanding of machine learning concepts, tasks, and metrics
• Understanding of statistical concepts applicable to data annotation tasks
• Strong verbal and written communication skills in Polish and English
• Demonstrated experience of creating annotation guidelines 
• High attention to detail and demonstrated commitment to data accuracy
• High organizational skills, strengths in problem solving, issue-resolution, ability to work in a deadline-driven work environment
• Proficiency in standard workflow software (JIRA, Excel, etc.)

The following are also a plus:

• Degree in Linguistics or STEM related fields
• Demonstrated ability to use metrics to back up assumptions and evaluate outcomes e.g. peer-reviewed scientific publications
• Basic knowledge of scripting languages (Python, SQL) and regular expressions for data analysis 
• Ability to evaluate and benchmark annotation tools and methods

What we offer:

• A hybrid work model that you will agree on with your leader and the team. We have well-located offices (with fully equipped kitchens and bicycle parking facilities) and excellent working tools (height-adjustable desks, interactive conference rooms)
• Annual bonus up to 10% of the annual salary gross (depending on your annual assessment and the company's results)
• A wide selection of fringe benefits in a cafeteria plan – you choose what you like (e.g. medical, sports or lunch packages, insurance, purchase vouchers)
• English classes that we pay for related to the specific nature of your job
• An internal educational platform, MindUp (including training courses on work organization, means of communications, motivation to work and various technologies and subject-matter issues)
• If you want to learn more, check it out

In your daily work you will handle the following tasks:

• Own the annotation pipelines from raw to annotated ground truth datasets which satisfy both technical and operational constraints
• Work with data from multiple sources and domains, such as text, images, and structured datasets in multiple languages.
• Cooperate closely with Product Managers and Tech Leaders across the organization to understand business needs, collect requirements for new annotation pipelines and allocate resources (budgets, subject domain experts)
• Prepare and improve guidelines by gathering feedback, analyzing annotations and quality/efficiency metrics.
• Implement and improve quality assurance processes for data annotation pipelines, optimizing both cost and quality of delivered datasets
• Analyze annotated datasets, ensuring their high quality, finding potential biases and risks in using them for training ML models
• Dive into the details including occasionally annotating data yourself, providing feedback for existing tools, and proposing new features

Why is it worth working with us:

• You will be part of an interdisciplinary team of Localization, Product Management and Machine Learning experts working on various AI-based solutions driving the future of Allegro technology
• You will have a key role in the process of ensuring a quality AI-based solutions
• You will have access to AI education programs and hands-on training delivered by leading AI researchers in Poland

This may also be of interest to you:

https://podcast.allegro.tech/ - Allegro Tech Podcast

https://ml.allegro.tech/  - Machine Learning in Allegro

Send in your CV and see why it is #dobrzetubyć (#goodtobehere)