Senior Machine Learning Test Engineer

Salary: £65,000 - 105,000 per year

Requirements

• We require a bachelors degree in Computer Science, Engineering, or equivalent experience.
• We require 7+ years of professional experience in software engineering or QA for ML/AI systems.
• We require strong programming skills in Python, with experience in test automation.
• We require familiarity with popular CAD environments tooling.
• We require proficiency in automation and UAT test suite/frameworks.
• We require experience designing QA frameworks or platforms used by multiple teams.
• We require excellent problem-solving skills and attention to detail.
• We require strong communication and collaboration skills.
• We require understanding of software architecture and design patterns.
• We require the ability to work in an agile development environment.

Responsibilities

• We define ML quality strategy and acceptance criteria across data, model, and system levels.
• We design and maintain model evaluation suites, metrics, and test datasets.
• We evaluate CAD RL model outputs for geometric validity or policy stability.
• We define structured rubrics that translate qualitative findings into measurable evaluation gates.
• We test ML models from the product side.
• We perform API testing.
• We automate ML QA workflows using Python and CI/CD tools such as GitHub Actions and Jenkins.
• We create and maintain test harnesses for ML services and APIs.
• We mentor teams on ML QA best practices and consistent evaluation standards.
• We build quality gates for training and deployment pipelines, including regression checks and drift detection.
• We contribute to multi-team projects and codebases, ensuring code quality and consistency.
• We participate in code reviews and provide constructive feedback to peers.
• We document and present findings and ideas across the company.

Technologies

• AI
• API
• CI/CD
• GitHub
• Jenkins
• Machine Learning
• Python
• Airflow
• AWS
• Azure
• Cloud
• MLflow
• MLOps
• PyTorch
• TensorFlow

More

We are Autodesk, a global hybrid-first team with colleagues in London, San Francisco, Toronto, and remote locations. We build software that helps innovators turn ideas into reality, supporting work across buildings, cars, factories, and films. As part of our culture of belonging, we offer a competitive compensation package that may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package. This Senior Machine Learning QA Engineer role sits in our Research Enablement team and reports to an Engineering Manager, with locations available across the United Kingdom, including London, Cambridge, Birmingham, Sheffield, Newcastle upon Tyne, and Newbury.

last updated 33 week of 2026