Senior Software Developer in Test (AI Portfolio)
Vena Solutions Open Remote Canada Full-time Senior Software Engineering
At a glance
Senior Software Engineering role at Vena Solutions. Remote, Canada · full-time · CA$114,750–CA$155,250 base.
SalaryStated by Vena Solutions
CA$114,750 – CA$155,250
Base salary for this role, in CAD per year, as published in the posting.
RoleSoftware Engineering
SenioritySenior
LocationCanada
WorkplaceRemote
EmploymentFull-time
Base payCA$114,750–CA$155,250
PostedOct 21, 2026
Role brief
techroles summary, based on the employer's posting.
What you'll do
- Build and maintain automated UI and API tests for agentic AI products, including functional, integration and regression coverage
- Plan exploratory and performance testing, then check AI outputs for accuracy, consistency, edge cases and quality
- Improve automation frameworks and pipelines so tests run reliably, scale effectively and connect with CI/CD
- Work with product and development teams to turn requirements into test strategies and broader coverage
- Investigate failures, trace defects to their causes and help teams prevent them from recurring
What you bring
- At least five years in QA or test automation roles, working in an Agile environment
- A track record testing AI or machine-learning products, such as evaluating prompts, detecting bias or testing model boundaries
- Practical experience using AI tools or LLM APIs in CI/CD to speed tests or identify flaky runs
- At least three years using a UI and API automation framework, plus skill in a listed programming language
Who this fits
This senior role suits someone who combines test automation with hands-on AI product testing and can reason across system components. The position is remote in Canada.
From the employer
As a Senior Software Developer in Test, you will be responsible for the development, execution, and maintenance of automated tests to support the Software Test Life Cycle for Vena’s agentic AI solutions. You will collaborate closely with development and product teams to define and execute functional, integration, and regression testing strategies, while continuously improving the scalability, stability, and reliability of testing processes.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
You will play a key role in defining and implementing testing approaches for AI-powered products, validating model accuracy, output consistency, performance, edge cases, and overall product quality. Additionally, you will leverage Generative AI and modern AI tools to enhance test automation, streamline test case development, and improve testing efficiency and coverage.
- Analyze functional and technical requirements to define comprehensive test strategies and automation needs
- Design, write, maintain, and manage automated UI and API test suites
- Contribute to building and enhancing scalable automation frameworks (e.g., Playwright, Rest-Assured)
- Identify, plan, and execute exploratory, functional, integration, performance, and regression tests
- Collaborate with development and product teams to validate testing requirements and optimize test coverage
- Champion best practices for automation, test data management, CI/CD integration, and code quality
- Monitor, troubleshoot, and optimize automation pipelines and test frameworks for dependability, scalability, and stability
- Perform root cause analysis and support teams in identifying and preventing defects
- 5+ years’ experience in QA/QE and test automation development roles, within a fast-paced Agile environment
- AI Testing Expertise: Proven track record testing AI/ML products (including prompt evaluation, bias detection, or model boundary testing)
- Hands-on experience integrating AI tools or LLM APIs into CI/CD pipelines to accelerate test execution and automatically detect flaky tests.
- Strong understanding of software testing methodologies, automation design patterns, and the fundamentals of high-quality test case development
- 3+ years of hands-on experience with at least one automation framework for both UI and API test automation (Playwright, Cypress, Selenium, RestAssured, RestSharp, Pytest, etc.)
- Hands-on experience with version control, issue tracking, and test case management tools (GitHub, Gitlab, JIRA, Xray, Zephyr, Qase, etc.)
- Proficiency with relational databases and data validation (SQL, MS SQL, Oracle, GraphQL, or DB2)
- Proficiency in one or more programming languages (Java, JavaScript, Typescript, C#, or Python)
- Ability to think critically about system architecture and assess the impact of product changes across components
- Strong troubleshooting, analytical, and problem-solving skills
- Exceptional written and verbal communication skills, with the ability to articulate both technical and non-technical concepts
- Interest in AI and willingness to explore AI-driven solutions to enhance performance and drive efficiencies
*Our salaries are tailored to roles, levels and locations. Your individual pay within this range is influenced by factors like work location, skills, experience and education. As you progress in your role, your compensation may adapt, offering flexibility for growth beyond initial levels. For specifics, your recruiter will provide details and address any questions during the hiring process.
Software Engineering work from LinkedIn, X, Reddit and Upwork, in one list.
Each morning you get everything that fits, strongest first.
Software EngineeringRemote
Find me workBy the team behind techroles.