Senior Databricks Engineer

We are seeking a Senior Databricks Engineer to support a high-priority, fast-tracked platform enablement initiative for a premier Canadian banking client. This role focuses on early-phase design, exploratory architecture, and moving Unity Catalog assets onto an enterprise AI platform in a regulated environment. Key Responsibilities Build and execute the underlying logic to migrate Unity Catalog assets (catalogs, schemas, data, views, and materialized views) onto the central enterprise AI platform. Design and implement access patterns, Active Directory (AD) / Entra ID groups, and governance framework logic for business unit users. Develop robust, testable Python code using pytest following standard software engineering best practices. Execute a Proof of Concept (PoC) migrating initial pilot datasets to staging environments, laying the foundation for scaling to 100+ datasets. Integrate data platform pipelines into automated CI/CD workflows using GitHub and Jenkins. Required Qualifications Tech Stack: Advanced proficiency in Python, Databricks (specifically Unity Catalog & Delta Lake), and cloud infrastructure. Engineering Standards: Hands-on experience with unit testing (pytest), version control (GitHub), and automated build pipelines (Jenkins CI/CD). Domain Experience: Prior experience delivering data platform or cloud engineering solutions within Canadian Tier-1 banking or capital markets. Platform & Infrastructure: Familiarity with cloud/ML platform orchestration, access control models, and containerized environments (Kubernetes/K8s exposure). Location & Presence: Must be available to work on-site in Downtown Toronto. Nice to Have Experience with MLOps frameworks, model governance, and catalog migrations at scale. Prior consulting experience within major professional services or enterprise IT environments.

The role involves designing and executing the migration of Unity Catalog assets onto an enterprise AI platform for a Canadian bank. Responsibilities include implementing access patterns, developing testable Python code, and integrating pipelines into automated CI/CD workflows.

Candidates must have advanced proficiency in Python, Databricks, and cloud infrastructure, with a strong background in unit testing and version control. Prior experience delivering data platform solutions within Canadian Tier-1 banking or capital markets is required.

• KubernetesSouhaitée
• GitHubSouhaitée
• CI/CDSouhaitée
• PythonSouhaitée

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Python
• Databricks
• Unity Catalog
• Delta Lake
• Pytest
• GitHub
• Jenkins
• CI/CD
• Kubernetes
• Entra ID
• Cloud Infrastructure
• MLOps
• Data Migration
• Access Control Models
• Governance Frameworks
• Software Engineering

• Data & Analytics
• Software
• Engineering
• Technology
• Consulting

Expérience minimale

5+ ans

Postuler avant le

20 févr. 2027

Langue de l’offre

anglais

Heures de travail

40 heures par semaine

Niveau d’expérience

Mid-Senior level

Mode de candidature

La candidature directe est offerte