Big Data Systems Engineer

Résumé du poste

Migrate and refactor existing Java-based Spark modules into Scala to improve performance and scalability. Design, develop, and productionize new Scala Spark modules with minimal supervision.

Détails du poste

Immediate need for a talented Big Data Systems Engineer. This is a 06+months contract opportunity with long-term potential and is located in Toronto, ON(Hybrid). Please review the job description below and contact me ASAP if you are interested. Job ID:26-19758 Pay Range: CAD 56 - CAD 57.14/hour. Key Requirements and Technology Experience: Key Skills: SENIOR SPARK DEVELOPER, SCALA BIG DATA DEVELOPER, DATA ENGINEER, APACHE SPARK,JAVA, SPRING BOOT. 8+ years • Big Data: Apache Spark, Hadoop ecosystem(HDFS, Hive, Yarn). Programming : Expert in Scala and Java . Backend :Spring Boot, RESTful APIs . Database : Microsoft SQL Server(MSSQL) . Nice to have : Experience in migrating on-premise applications to cloud (Azure/AWS), familiarity with machine-learning concepts and workflows Primary Responsibility . Migrate and refactor existing Java based Spark modules to Scala, ensuring code quality, performance, and scalability. Individually design, develop, test, and productionize the new Scala spark module with minimal supervision Our client is a leading IT Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration. Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here.

Ce que vous ferez

Migrate and refactor existing Java-based Spark modules into Scala to improve performance and scalability. Design, develop, and productionize new Scala Spark modules with minimal supervision.

Exigences

Requires over 8 years of experience in Big Data technologies, specifically Apache Spark and the Hadoop ecosystem. Expertise in Scala, Java, Spring Boot, and MSSQL is essential.

Compétences indiquées

• Java · Souhaitée
• Spring Boot · Souhaitée

Autres compétences pertinentes

Relevées dans la description du poste. Confirmez les exigences importantes ci-dessus.

• Apache Spark
• Scala
• Java
• Spring Boot
• Hadoop
• HDFS
• Hive
• Yarn
• Microsoft SQL Server
• RESTful APIs
• Data Engineering

Domaines d’emploi

• Data & Analytics
• Software
• Technology
• Engineering
• Consulting