Top Benefits
About the role
Job Description
What's the opportunity?
We are seeking a Lead Data and AI Quality Engineering to join our Risk and Compliance team and take ownership of quality assurance for AI and Non-Financial Risk Reporting initiatives. This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.
What will you do?
Ensures that products being built and processes being used adhere to all standards and requirements. Applies extensive, in-depth knowledge, skills, and practices to perform complex assignments.
Test Strategy & Planning
- Design and implement comprehensive test strategies aligned with risk, compliance, and regulatory requirements
- Define test scope, acceptance criteria, and quality gates for AI and risk reporting solutions
- Collaborate with Risk and Compliance stakeholders to understand requirements and translate them into testable specifications
- Identify quality risks and develop mitigation plans in alignment with compliance frameworks
Application Development & Testing
- Design and code application programs for testing purposes, including test utilities and quality assurance tools
- Perform comprehensive testing for developed applications, including functional, integration, and system-level testing
- Validate system performance and reliability across Risk and Compliance workflows
- Proven expertise building production server applications (APIs, microservices, backends)
AI Code Agent Testing
- Design and execute comprehensive test strategies for AI code agents and autonomous systems
- Test AI code agents' ability to generate, review, and validate code across risk and compliance applications
- Perform edge case testing and failure scenario analysis for AI agent decision-making processes
- Evaluate AI agent performance metrics, including accuracy rates, false positives, and code quality standards
Database & Data Modeling
- Validate database schemas, data models, and data integrity for risk and compliance reporting systems
- Design and execute SQL queries to test data consistency, accuracy, and completeness across databases
Test Automation
- Develop and maintain scalable, automated test frameworks and test suites using extensive Python expertise
- Leverage Python libraries (pytest, requests, django, fastapi) for comprehensive test coverage
- Execute automated tests as part of CI/CD pipelines and regression testing cycles
What you need to succeed?
Must Haves
- Extensive Python proficiency with 5+ years of hands-on development experience
- Advanced Python expertise including OOP principles, design patterns, async programming, and advanced data structures
- Strong software development background with experience in designing, coding, and debugging applications
- Hands-on experience testing AI models and machine learning systems
- Experience designing and testing AI code agents, autonomous systems, or LLM-powered applications
- Demonstrated expertise in Large Language Model (LLM) testing, including prompt engineering, output validation, and hallucination detection
- Experience testing Model Context Protocol (MCP) implementations and integrations
- Knowledge of relational and non-relational databases (e.g., Oracle, SQL Server, PostgreSQL, MongoDB)
- Solid understanding of DevOps practices and containerization
- Proficiency with Git and GitHub Actions for CI/CD pipeline automation and workflow orchestration
Nice to have
- Software development certifications or advanced programming credentials
- Experience with data governance, data quality frameworks, and metadata management
- Experience with AI agent frameworks and orchestration tools
- Knowledge of Infrastructure as Code (IaC) and containerization best practices
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Opportunities to do challenging work
- Opportunities to take on progressively greater accountabilities
- Access to a variety of job opportunities across business and geographies
#LI-ASPost
#TECHPJ
Job Skills
Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Software Product Testing, Test Automation
Additional Job Details
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTO
City:
Toronto
Country:
Canada
Work hours/week:
37.5
Employment Type:
Full time
Platform:
TECHNOLOGY AND OPERATIONS
Job Type:
Regular
Pay Type:
Salaried
Posted Date:
2026-04-15
Application Deadline:
2026-05-13
Note**:** Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.
Not the right fit? Search for Data and AI Quality Engineer jobs in Toronto, ON
About RBC
Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 94,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada's biggest bank and one of the largest in the world, based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our more than 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com. We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities. See how at www.rbc.com/community-social-impact.
La Banque Royale du Canada est une institution financière mondiale définie par sa raison d'être, guidée par des principes et orientée vers l'excellence en matière de rendement. Notre succès est attribuable aux quelque 94 000+ employés qui mettent à profit leur créativité et leur savoir faire pour concrétiser notre vision, nos valeurs et notre stratégie afin que nous puissions contribuer à la prospérité de nos clients et au dynamisme des collectivités. Selon la capitalisation boursière, nous sommes la plus importante banque du Canada et l'une des plus grandes banques du monde. Nous avons adopté un modèle d'affaires diversifié axé sur l'innovation et l'offre d'expériences exceptionnelles à nos plus de 17 millions de clients au Canada, aux États Unis et dans 27 autres pays. Pour en savoir plus, visitez le site rbc.com/francais
Nous sommes fiers d'appuyer une grande diversité d'initiatives communautaires par des dons, des investissements dans la collectivité et le travail bénévole de nos employés. Pour de plus amples renseignements, visitez le site www.rbc.com/collectivite-impact-social.
Similar jobs you might like
Top Benefits
About the role
Job Description
What's the opportunity?
We are seeking a Lead Data and AI Quality Engineering to join our Risk and Compliance team and take ownership of quality assurance for AI and Non-Financial Risk Reporting initiatives. This role combines strategic test planning with hands-on automation and manual testing expertise to ensure the delivery of robust, high-quality solutions that meet regulatory and compliance standards.
What will you do?
Ensures that products being built and processes being used adhere to all standards and requirements. Applies extensive, in-depth knowledge, skills, and practices to perform complex assignments.
Test Strategy & Planning
- Design and implement comprehensive test strategies aligned with risk, compliance, and regulatory requirements
- Define test scope, acceptance criteria, and quality gates for AI and risk reporting solutions
- Collaborate with Risk and Compliance stakeholders to understand requirements and translate them into testable specifications
- Identify quality risks and develop mitigation plans in alignment with compliance frameworks
Application Development & Testing
- Design and code application programs for testing purposes, including test utilities and quality assurance tools
- Perform comprehensive testing for developed applications, including functional, integration, and system-level testing
- Validate system performance and reliability across Risk and Compliance workflows
- Proven expertise building production server applications (APIs, microservices, backends)
AI Code Agent Testing
- Design and execute comprehensive test strategies for AI code agents and autonomous systems
- Test AI code agents' ability to generate, review, and validate code across risk and compliance applications
- Perform edge case testing and failure scenario analysis for AI agent decision-making processes
- Evaluate AI agent performance metrics, including accuracy rates, false positives, and code quality standards
Database & Data Modeling
- Validate database schemas, data models, and data integrity for risk and compliance reporting systems
- Design and execute SQL queries to test data consistency, accuracy, and completeness across databases
Test Automation
- Develop and maintain scalable, automated test frameworks and test suites using extensive Python expertise
- Leverage Python libraries (pytest, requests, django, fastapi) for comprehensive test coverage
- Execute automated tests as part of CI/CD pipelines and regression testing cycles
What you need to succeed?
Must Haves
- Extensive Python proficiency with 5+ years of hands-on development experience
- Advanced Python expertise including OOP principles, design patterns, async programming, and advanced data structures
- Strong software development background with experience in designing, coding, and debugging applications
- Hands-on experience testing AI models and machine learning systems
- Experience designing and testing AI code agents, autonomous systems, or LLM-powered applications
- Demonstrated expertise in Large Language Model (LLM) testing, including prompt engineering, output validation, and hallucination detection
- Experience testing Model Context Protocol (MCP) implementations and integrations
- Knowledge of relational and non-relational databases (e.g., Oracle, SQL Server, PostgreSQL, MongoDB)
- Solid understanding of DevOps practices and containerization
- Proficiency with Git and GitHub Actions for CI/CD pipeline automation and workflow orchestration
Nice to have
- Software development certifications or advanced programming credentials
- Experience with data governance, data quality frameworks, and metadata management
- Experience with AI agent frameworks and orchestration tools
- Knowledge of Infrastructure as Code (IaC) and containerization best practices
What’s in it for you?
We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.
- A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact.
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Opportunities to do challenging work
- Opportunities to take on progressively greater accountabilities
- Access to a variety of job opportunities across business and geographies
#LI-ASPost
#TECHPJ
Job Skills
Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Software Product Testing, Test Automation
Additional Job Details
Address:
RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTO
City:
Toronto
Country:
Canada
Work hours/week:
37.5
Employment Type:
Full time
Platform:
TECHNOLOGY AND OPERATIONS
Job Type:
Regular
Pay Type:
Salaried
Posted Date:
2026-04-15
Application Deadline:
2026-05-13
Note**:** Applications will be accepted until 11:59 PM on the day prior to the application deadline date above
Our Employment Opportunities
At RBC, we are guided by living shared values of Client First, Integrity, Collaboration, Respect and Excellence and winning together as One RBC. We believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.
Join our Talent Community
Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.
Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.
RBC is presently inviting candidates to apply for this existing vacancy. Applying to this posting allows you to express your interest in this current career opportunity at RBC. Qualified applicants may be contacted to review their resume in more detail.
Not the right fit? Search for Data and AI Quality Engineer jobs in Toronto, ON
About RBC
Royal Bank of Canada is a global financial institution with a purpose-driven, principles-led approach to delivering leading performance. Our success comes from the 94,000+ employees who leverage their imaginations and insights to bring our vision, values and strategy to life so we can help our clients thrive and communities prosper. As Canada's biggest bank and one of the largest in the world, based on market capitalization, we have a diversified business model with a focus on innovation and providing exceptional experiences to our more than 17 million clients in Canada, the U.S. and 27 other countries. Learn more at rbc.com. We are proud to support a broad range of community initiatives through donations, community investments and employee volunteer activities. See how at www.rbc.com/community-social-impact.
La Banque Royale du Canada est une institution financière mondiale définie par sa raison d'être, guidée par des principes et orientée vers l'excellence en matière de rendement. Notre succès est attribuable aux quelque 94 000+ employés qui mettent à profit leur créativité et leur savoir faire pour concrétiser notre vision, nos valeurs et notre stratégie afin que nous puissions contribuer à la prospérité de nos clients et au dynamisme des collectivités. Selon la capitalisation boursière, nous sommes la plus importante banque du Canada et l'une des plus grandes banques du monde. Nous avons adopté un modèle d'affaires diversifié axé sur l'innovation et l'offre d'expériences exceptionnelles à nos plus de 17 millions de clients au Canada, aux États Unis et dans 27 autres pays. Pour en savoir plus, visitez le site rbc.com/francais
Nous sommes fiers d'appuyer une grande diversité d'initiatives communautaires par des dons, des investissements dans la collectivité et le travail bénévole de nos employés. Pour de plus amples renseignements, visitez le site www.rbc.com/collectivite-impact-social.