Data Engineer

Immediate need for a talented Data Engineer. This is a 12+ months contract opportunity with long-term potential and is located in Mexico (Onsite). Please review the job description below and contact me ASAP if you are interested. Job Diva ID: 26-25001 Pay Range: $50 - $60/hour. Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location). Key Responsibilities: - Note- Candidates must be willing to relocate and work onsite in the USA from Day 1 Design, develop, and maintain scalable data pipelines using Python, PySpark, and Apache Spark. Build and optimize ETL/ELT pipelines to ingest, transform, and process large volumes of structured and unstructured data. Develop real-time and batch data pipelines using Apache Kafka and Airflow for data ingestion and workflow orchestration. Build and manage cloud-based data solutions using AWS S3, Glue, EMR, and Redshift. Develop and optimize data processing workloads using Databricks and PySpark. Write complex SQL queries and optimize data processing for performance and scalability. Design and maintain data warehouses, data models, and scalable data architectures. Develop reusable data ingestion and transformation frameworks to support analytics and reporting requirements. Implement workflow scheduling, dependency management, monitoring, and failure handling using Airflow and other orchestration tools. Ensure data quality, accuracy, reliability, and consistency across data pipelines and downstream systems. Collaborate with data scientists, analysts, architects, and business stakeholders to understand data requirements and deliver scalable data solutions. Troubleshoot pipeline failures and performance issues and continuously improve the reliability and efficiency of data platforms. Key Requirements and Technology Experience: Must have skills: - Python, Apache Spark, SQL, Kafka, Airflow, AWS (S3, Glue, EMR, Redshift), Databricks, ETL/ELT pipelines, data warehousing, PySpark, data modeling, orchestration tools Our client is a leading IT Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. By applying to our jobs, you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.

Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Python, PySpark, and Apache Spark. Manage cloud-based data solutions on AWS and optimize data processing workloads using Databricks and Airflow.

Candidates must have expertise in Python, SQL, Kafka, and the AWS ecosystem, specifically S3, Glue, EMR, and Redshift. Experience with Databricks and data modeling for scalable architectures is required.

• Health insurance • Medical • Dental • Vision • 401(k) plan • Paid sick leave

• SQLSouhaitée
• PythonSouhaitée

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Python
• Apache Spark
• SQL
• Kafka
• Airflow
• AWS S3
• AWS Glue
• AWS EMR
• AWS Redshift
• Databricks
• ETL/ELT Pipelines
• Data Warehousing
• PySpark
• Data Modeling
• Orchestration Tools

• Data & Analytics
• Technology
• Software
• Engineering
• Finance & Accounting

Expérience minimale

5+ ans

Postuler avant le

20 sept. 2026

Langue de l’offre

anglais

Heures de travail

40 heures par semaine

Niveau d’expérience

Mid-Senior level

Mode de candidature

La candidature directe est offerte