Data Annotation & AI Training Data Program Manager

Other Jobs To Apply

No other job posts for this day.

🚀 Join our AI team and lead the data operations that power our next-generation LLMs

About the Role
We're seeking a Machine Learning Data Operations / Data Annotation Lead who has built models end-to-end and has hands-on experience training LLMs, with some manufacturing domain knowledge. You'll own the entire data lifecycle—from annotation workflows to model deployment—and lead teams that create the high-quality datasets powering our AI systems.
This is a senior technical leadership role for someone who has done this before, not learned about it.

Candidates with hands-on experience in text-based (NLP) data labeling and annotation are encouraged to apply; experience focused only on image/computer vision annotation will not be considered.

Must-Have Experience (Non-Negotiable)

🎯 Data Annotation Mastery

  • Built and scaled data labeling workflows from scratch
  • Created annotation rubrics and guidelines for complex datasets
  • Trained and managed annotator teams (10+ people)
  • Implemented inter-annotator agreement (IAA) processes and QA systems
  • Experience with gold seeding and quality control mechanisms

🛠️ Platform & Tools Expertise

  • Hands-on experience with Label Studio, Argilla, Labelbox, Scale AI, or similar platforms
  • Experience setting up annotation pipelines and workflow automation

đź‘Ą Team Leadership

  • Managed teams of Subject Matter Expert (SME) annotators in technical domains
  • Experience managing annotators for Manufacturing/Mechanical Engineering use cases
  • Led cross-functional teams including data scientists, ML engineers, and domain experts

🤖 LLM Fine-Tuning (CRITICAL)

Created datasets for LLM fine-tuning including:

  • Instruction-response pairs
  • Preference ranking datasets (RLHF/DPO)
  • Task-specific fine-tuning datasets
  • Experience with supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF)

đź“Š Pre-Training Data Operations (CRITICAL)

Hands-on experience with pre-training data preparation:

  • Data deduplication at scale
  • Content filtering and cleaning pipelines
  • Document-level metadata tracking
  • Data quality assessment and improvement

Experience with petabyte-scale data processing

🏗️ End-to-End Model Building

  • Built and trained models from data collection to deployment
  • Experience with model evaluation, validation, and monitoring
  • Understanding of MLOps and model lifecycle management

Day-to-Day Responsibilities

  • Design & implement annotation workflows for complex AI training datasets
  • Lead and scale teams of 20+ annotators across multiple domains
  • Build data pipelines for pre-training data preparation and LLM fine-tuning
  • Collaborate with ML engineers on model training requirements and data specifications
  • Establish QA processes ensuring dataset quality and consistency
  • Drive cross-functional projects from ideation to model deployment
  • Mentor junior team members and establish data operations best practices

Technical Requirements

Programming & Tools:

Python, SQL, and experience with data processing frameworks
Cloud platforms (AWS, GCP, Azure) for large-scale data operations
ML frameworks: PyTorch, Transformers, DeepSpeed, or similar
Data pipeline tools: Airflow, Prefect, or equivalent

Domain Knowledge:

  • Deep understanding of transformer architectures and LLM training
  • Experience with manufacturing/mechanical engineering data and terminology
  • Knowledge of annotation standards and data quality metrics
  • Understanding of AI safety and alignment considerations
  • Manufacturing experience is a huge plus

What Makes You Stand Out

  • PhD or Masters in Computer Science, Machine Learning, or related field
  • 5+ years of hands-on ML data operations experience
  • Previous experience at annotation vendors (Scale AI, Appen, Labelbox, etc.)
  • Background in AI product startups or Big Tech ML operations
  • Publications or contributions to open-source ML data tools
  • Experience with multimodal data (text, image, video, audio)

Why Join Us?

  • Lead cutting-edge AI initiatives that impact millions of users
  • Competitive equity in a fast-growing AI company
  • Work with world-class ML talent and shape the future of AI
  • Remote-first culture with flexible working arrangements
  • Top-tier benefits and professional development opportunities
Back to blog

About United Kingdom

The United Kingdom is an island nation located on the northwest coast of Europe. The United Kingdom includes the entire island of Great Britain, which includes England, Wales, and Scotland, as well as the northern part of the island of Ireland. The name Great Britain is sometimes used to refer to the United Kingdom as a whole. The capital is London, which is one of the business, financial, and cultural centers of the world. Other major cities are Birmingham, Liverpool, and Manchester in England, Belfast and Londonderry in Northern Ireland, Edinburgh and Glasgow in Scotland, and Swansea and Cardiff in Wales.

Common Interview Questions

  • Tell me about yourself.
  • Walk me through your resume.
  • How did you hear about this position?
  • Why do you want to work at this company?
  • Why do you want this job?
  • Why should we hire you?
  • What can you bring to the company?
  • What are your greatest strengths?
  • What do you consider to be your weaknesses?
  • What is your greatest professional achievement?
  • Tell me about a challenge or conflict you’ve faced at work, and how you dealt with it.
  • Tell me about a time you demonstrated leadership skills.
  • What’s a time you disagreed with a decision that was made at work?
  • Tell me about a time you made a mistake.
  • Tell me about a time you failed.
  • Why are you leaving your current job?
  • Why were you fired?
  • Why was there a gap in your employment?
  • Can you explain why you changed career paths?
  • What’s your current salary?
  • What do you like least about your job?
  • What are you looking for in a new position?
  • What type of work environment do you prefer?
  • What’s your work style?
  • What’s your management style?
  • How would your boss and coworkers describe you?
  • How do you deal with pressure or stressful situations?
  • What do you like to do outside of work?
  • Are you planning on having children?
  • How do you stay organized?
  • How do you prioritize your work?
  • What are you passionate about?
  • What motivates you?
  • What are your pet peeves?
  • How do you like to be managed?
  • Do you consider yourself successful?
  • Where do you see yourself in five years?
  • How do you plan to achieve your career goals?
  • What are your career aspirations?
  • What’s your dream job?
  • What other companies are you interviewing with?
  • What makes you unique?
  • What should I know that’s not on your resume?
  • What would your first few months look like in this role?
  • What are your salary expectations?
  • What do you think we could do better or differently?
  • When can you start?
  • Are you willing to relocate?
  • How many tennis balls can you fit into a limousine?
  • If you were an animal, which one would you want to be?
  • Sell me this pen.
  • Is there anything else you’d like us to know?
  • Do you have any questions for us?

Educational Qualification

Candidates Who Have Passed Graduate or its Equivalent from a Recognized Board or University Are Eligible For this recruitment. Kindly check the Official Notification for more qualification details. Notification Link Is Given Below.

Document Required

Required Documents for This recruitment: Candidate should have these documents before applying online. Candidates are suggested to read the official notification before applying.

  • Qualification certificate with mark sheets.
  • Passport size photographs.
  • Signature.

How to Apply

All the eligible candidates can apply for this job as mentioned below:

  • Read official notification carefully from the official website.
  • Read notification carefully before applying.
  • Fill the application form (link is given below).
  • Attach required documents and passport size photo with signature.
  • Then submit. Done.

Related Posts