Senior Software Engineer, Data Science
Procore Open At a glance
Senior Software Engineering role at Procore. Auckland · full-time · NZ$112,000–NZ$154,000 base.
techroles summary, based on the employer's posting.
What you'll do
- Build datasets and evaluation systems with controls that keep ground-truth labels reliable
- Trace accuracy gaps between offline testing and live production, then fix the measurement path
- Take prompts from candidate testing through rollout, and check their performance after launch
- Automate evaluation runs across AI products and create tools for error reviews, audits and experiments
- Improve labeling and knowledge-capture systems, and assess how ontology or schema changes affect models
What you bring
- Strong professional Python skills for data work, analysis and tooling
- Solid SQL and database experience, including data modeling and large datasets
- A data science background with understanding of LLM accuracy, especially visual reasoning
- Experience creating evaluation datasets, debugging evaluations and analyzing errors
- Experience with ground-truth labeling systems, label agreement and data quality
Who this fits
You’ll suit a senior engineer who can work across engineering, product and AI teams, take ownership, and improve systems iteratively. The role is based in Auckland, with at least two office days each week and overlap with the 9-5 schedule. Expect occasional on-call support and domestic or international travel.
From the employer
We’re looking for a Senior Software Engineer to join Procore’s Data Science team. In this role, you’ll own the accuracy of the LLM-powered features at the core of our platform, which turn drone and robotics data into trustworthy insights. Your primary goal is to make our AI measurably better by building the systems that measure model quality, diagnosing where accuracy breaks down, and taking prompts and models from candidate selection through to production.
As a Senior Software Engineer, you’ll partner with engineering, product, and AI teams to build the data, tooling, and evaluation infrastructure that make accuracy work repeatable. Use your Python, SQL, and LLM evaluation skills to prioritize by likely impact and raise the quality of every AI product we ship. Join a company trusted by users across industries to transform how they collect, manage, and analyze worksite data. Apply today.
This position reports into the Director of Engineering and will be based in our Auckland office. We’re looking for someone to join us immediately.
What you’ll do:
- Build and maintain robust dataset and evaluation infrastructure, including ground-truth quality controls.
- Diagnose and fix measurement-path issues between offline evals and production accuracy.
- Own prompt optimization across its full lifecycle, from candidate selection through production rollout and post-launch validation.
- Automate eval pipelines and build the tooling to run them at scale across multiple AI products.
- Create reusable internal tooling for error analysis, audits, and experimentation.
- Iterate on and scale existing labeling frameworks and knowledge capture systems.
- Analyze how changes to our ontology and schema propagate across models and infrastructure.
- Prioritize work by likely impact.
What we’re looking for:
- Strong professional experience with Python for data manipulation, analysis, and tooling (for example, pandas and NumPy).
- Solid SQL and database experience, including querying, data modeling, and working with large datasets.
- A data science background with knowledge of LLM accuracy, particularly visual reasoning.
- Experience building evaluation datasets, running and debugging evals with tools such as Braintrust or Langfuse, and conducting error analysis.
- Experience designing ground-truth and labeling systems, and measuring label agreement and data quality.
- Familiarity with prompt engineering and the full prompt lifecycle, plus the ability to reason about ontology and schema design and its downstream impact.
- A collaborative, ownership-driven mindset with a preference for iterative, team-oriented development. Construction or industrial inspection domain knowledge is a plus.
- Location in Auckland, with at least 2 days per week in the office, good overlap with our 9–5 schedule, occasional on-call support, and occasional domestic and international travel.
Additional Information
Base Pay Range:
112,000.00 - 154,000.00 NZD AnnualThis role may also be eligible for Equity Compensation and/or Bonus Incentive Compensation. Procore is committed to offering competitive, fair, and commensurate compensation. Actual compensation will be based on a candidate’s job-related skills, experience, education or training, and location.
Software Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Software Engineering
Find me workBy the team behind techroles.