Opportunity QA & Test work from LinkedIn, X, Reddit and Upwork, in one list. Find me work
techroles

Lead Data Quality Assurance Engineer, Data Annotation Services

Cat (CaterpillarCareers) Open
On-site Irving Full-time Senior QA & Test

At a glance

Senior QA & Test role at Cat (CaterpillarCareers). Irving · full-time · $128,470–$208,770 base.

SalaryStated by Cat (CaterpillarCareers)
$128,470 – $208,770
Base salary for this role, in USD per year, as published in the posting.
RoleQA & Test
SenioritySenior
LocationIrving
WorkplaceOn-site
EmploymentFull-time
Base pay$128,470–$208,770
PostedNov 18, 2026
Role brief

techroles summary, based on the employer's posting.

What you'll do

  • Set the roadmap and quality rules for perception and VLA annotation, while guiding a small QA engineering team
  • Build automated checks and quality gates for annotation correctness, completeness, schema fit and sensor timing across multimodal data
  • Track dataset health through metrics, dashboards and audits, then trace labeling defects and improve quality with providers
  • Test human and AI-based labeling approaches, including NVIDIA Cosmos tools, and develop scalable automated review workflows
  • Connect quality checks to data pipelines with engineering, product and vendor teams, and flag delivery risks and tradeoffs

What you bring

  • A bachelor's degree in a technical area such as computer science, data science or robotics
  • At least five years in data quality, annotation QA or test automation for machine learning, computer vision or related systems
  • Experience mentoring technical teammates, setting direction and coordinating with vendors or distributed teams
  • Strong Python skills for building automated validation tools and production software in containerized environments
  • Experience checking camera and LiDAR datasets, using annotation platforms and SQL, and applying machine learning evaluation metrics

Who this fits

This senior role suits someone who can lead a small QA team while building hands-on validation systems for perception and VLA data. You must work full-time onsite in Irving, Texas; domestic relocation assistance and visa sponsorship are available.

From the employer

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Help Build the Future of Caterpillar

At Caterpillar, technology always has a purpose: solving our customers’ toughest challenges. Through Cat Technology, we are building the intelligence layer that connects machines, data, and people to make jobsites safer, more productive, and more sustainable. With over 1.6 million connected assets generating real-world data daily, we are creating the foundation for AI, autonomy, edge computing, and intelligent machines that continuously learn and improve at global scale.


Be Part of What’s Next in Autonomous Construction Sites

Construction autonomy is one of the most challenging applications of AI. As a Lead Data Quality Assurance Engineer, you will lead the quality strategy for training data powering robotics, computer vision, autonomous systems, Physical AI, and Vision-Language-Action (VLA) models. You will combine data quality engineering, test automation, and machine learning expertise to ensure the datasets used by Caterpillar’s AI systems are accurate, scalable, and trustworthy while leading a small team of QA engineers and collaborating across engineering, annotation, and product teams.


Job Summary:

Lead the development and execution of quality assurance processes, standards, and automation frameworks for annotation and captioning datasets supporting robotics, autonomous driving, computer vision, and Physical AI initiatives. Drive continuous improvement of dataset quality by establishing metrics, evaluating AI-assisted labeling technologies, managing vendor quality, and implementing scalable validation solutions across the data lifecycle.


What You Will Do:

  • Lead the annotation quality strategy and roadmap, providing technical leadership and mentorship to a team of QA engineers while defining standards, guidelines, acceptance criteria, and governance processes for perception and VLA datasets.
  • Design and implement automated validation frameworks, testing methodologies, and quality gates that verify annotation accuracy, consistency, completeness, schema compliance, and sensor synchronization across multimodal datasets.
  • Define and monitor dataset quality metrics, dashboards, audits, and benchmarking processes to measure dataset health, identify root causes of labeling defects, and drive continuous quality improvements with internal teams and external annotation providers.
  • Evaluate and validate human, AI-assisted, and automated labeling solutions, including technologies such as NVIDIA Cosmos Curator and Cosmos Reason, while helping develop AI-driven QA capabilities and agentic workflows for scalable review and defect analysis.
  • Partner with machine learning, platform, product, and vendor teams to integrate quality processes into data pipelines, communicate risks and tradeoffs, and ensure trusted datasets are delivered to support AI model development.

What You Will Have:

  • Bachelor’s degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, Robotics, or a related technical field.
  • 5+ years of experience in data quality engineering, annotation quality assurance, or test automation for computer vision, robotics, autonomous systems, Physical AI, or machine learning environments.
  • Experience leading small technical teams, providing mentorship, setting technical direction, and collaborating with external vendors or distributed teams.
  • Strong Python development skills with experience building automated validation frameworks, data quality tooling, and production-grade software using modern engineering practices and containerized environments.
  • Experience with annotation platforms (Labelbox, Supervisely, Roboflow, or similar), SQL, data analysis tools, and machine learning evaluation metrics such as precision, recall, IoU, F1, and mAP.
  • Experience validating perception datasets that include camera and LiDAR sensor data and investigating data quality issues across collection, annotation, and processing workflows.

Top Candidates Will Have:

  • Experience with computer vision, robotics, autonomous driving, multimodal AI, Physical AI, and 3D perception systems.
  • Experience evaluating AI-assisted annotation workflows, auto-labeling technologies, agentic AI systems, or LLM/VLM-based quality automation solutions.
  • Familiarity with ML frameworks and tooling such as PyTorch, TensorFlow, ONNX, MLflow, or Weights & Biases.
  • Experience with Vision-Language-Action (VLA) datasets, caption quality evaluation, sensor fusion, and autonomous machine data pipelines.
  • Experience building human-in-the-loop quality processes, managing annotation vendor performance, and working with cloud-based data platforms and MLOps environments.

Additional Details:

  • This position requires the candidate to work full-time onsite in Irving, TX (Dallas).
  • Domestic relocation assistance is available for this position.
  • Visa sponsorship is available for this position.

Summary Pay Range:

$128,470.00 - $208,770.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar.

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

  • Medical, dental, and vision benefits*

  • Paid time off plan (Vacation, Holidays, Volunteer, etc.)*

  • 401(k) savings plans*

  • Health Savings Account (HSA)*

  • Flexible Spending Accounts (FSAs)*

  • Health Lifestyle Programs*

  • Employee Assistance Program*

  • Voluntary Benefits and Employee Discounts*

  • Career Development*

  • Incentive bonus*

  • Disability benefits

  • Life Insurance

  • Parental leave

  • Adoption benefits

  • Tuition Reimbursement

* These benefits also apply to part-time employees

Posting Dates:

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.

Not ready to apply? Join our Talent Community.

Opportunity

QA & Test work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

QA & Test$120k+

Find me work

By the team behind techroles.

Find me work
Opportunity

QA & Test work from LinkedIn, X, Reddit and Upwork, in one list.

Each morning you get everything that fits, strongest first.

Find me work

By the team behind techroles.