GCP Data Engineer

Résumé du poste

Design, build, and maintain scalable cloud-based data pipelines and platforms using Google Cloud Platform. Collaborate with stakeholders to transform complex requirements into production-ready solutions while optimizing BigQuery performance and cost.

Détails du poste

GCP Data Engineer Job Type: Contract Contract Duration: 6 months (strong potential for extension) Pay Rate: $45-50/hour Location: North York, ON | Hybrid [1 day onsite] Your New Company Our client is a leading Canadian retail organisation undertaking significant investment in its enterprise data and cloud capabilities. They are looking for an experienced GCP Data Engineer to support the design, development, and optimisation of scalable data solutions within a collaborative, high-performing technology environment. Your New Role As a GCP Data Engineer, you will design, build, and maintain reliable cloud-based data pipelines and platforms using Google Cloud Platform. You will work closely with data architects, analysts, software engineers, and business stakeholders to transform complex data requirements into secure, scalable, and production-ready solutions. The role will involve developing batch and real-time data pipelines, integrating data from multiple enterprise systems, improving data quality, and supporting the ongoing modernisation of the organisation’s cloud data ecosystem. What You Need to Do Design, develop, test, and maintain scalable data pipelines on GCP. Build batch and streaming solutions using services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer. Develop data transformation and integration processes using Python and SQL. Create reusable frameworks and components that improve engineering consistency and delivery speed. Integrate structured and unstructured data from APIs, databases, files, and enterprise applications. Optimise BigQuery datasets, queries, partitioning, and data-processing workloads for performance and cost. Implement automated testing, monitoring, logging, and data-quality controls. Support infrastructure-as-code and CI/CD practices using tools such as Terraform, Git, and cloud-native deployment services. Troubleshoot pipeline failures, performance issues, and production data incidents. Apply security, privacy, governance, and access-control standards across data solutions. Produce clear technical documentation covering data pipelines, architecture, dependencies, and operational processes. Participate in code reviews and contribute to data engineering standards and best practices. What You’ll Need to Succeed Ideally five or more years of professional experience in data engineering, software engineering, or a closely related field. Strong hands-on experience building production-grade data solutions on Google Cloud Platform. Practical experience with BigQuery and GCP data services such as Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer. Advanced proficiency in Python and SQL. Experience developing ETL or ELT pipelines for large and complex datasets. Strong understanding of data modelling, data warehousing, pipeline orchestration, and distributed data-processing concepts. Experience with Apache Beam, Airflow, Spark, or comparable data-processing and orchestration technologies. Knowledge of CI/CD, Git-based development practices, automated testing, and infrastructure as code. Experience with Terraform is highly desirable. Familiarity with dbt, Dataproc, Cloud Functions, Cloud Run, or Kubernetes would be an asset. Understanding of data security, governance, lineage, and quality-management principles. Strong analytical and troubleshooting skills with the ability to resolve complex data and pipeline issues. Effective written and verbal communication skills, with the ability to collaborate across technical and business teams. A degree or diploma in computer science, software engineering, information technology, or a related discipline is preferred. What You’ll Get in Return You will have the opportunity to work with a talented team of professionals in a dynamic and supportive environment. The client is offering competitive compensation, professional development opportunities, and the chance to make a meaningful contribution to a large-scale cloud data environment. What You Need to Do Now If you’re interested in this role, click “Apply now” to forward an up-to-date copy of your CV, or contact us for further information. This posting is for an existing vacancy with the organisation. AI may be used to screen, assess, or select applicants for the position.

Ce que vous ferez

Design, build, and maintain scalable cloud-based data pipelines and platforms using Google Cloud Platform. Collaborate with stakeholders to transform complex requirements into production-ready solutions while optimizing BigQuery performance and cost.

Exigences

Requires five or more years of experience in data engineering with strong proficiency in Python, SQL, and GCP services. A degree in computer science or a related field is preferred, along with experience in CI/CD and infrastructure-as-code.

Avantages

• Competitive compensation • Professional development opportunities

Compétences indiquées

• SQL · Souhaitée
• CI/CD · Souhaitée
• Terraform · Souhaitée
• Git · Souhaitée
• Python · Souhaitée

Autres compétences pertinentes

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Google Cloud Platform
• BigQuery
• Dataflow
• Pub/Sub
• Cloud Storage
• Cloud Composer
• Python
• SQL
• Terraform
• Apache Beam
• Airflow
• Spark
• CI/CD
• Git
• ETL/ELT
• Data Modelling

Domaines d’emploi

• Data & Analytics
• Technology
• Software
• Engineering
• Retail