Cloud Data Pipeline Specialist at VLink

Enhance your data engineering career as a Cloud Data Pipeline Specialist focusing on Scala and Spark at VLink in Montreal, QC. This contract role is integral to migrating complex reporting systems to a cloud data platform.

In this position, you will spearhead the transition of legacy reporting pipelines to a Databricks and Snowflake architecture. Proficiency in Scala, SQL, and a solid grasp of Azure infrastructure is essential for success. Your role will also prioritize automated testing and data quality assurance for effective data management.

Key Responsibilities: • Migrate regulatory reporting pipelines to cloud solutions • Design, test, and deploy production data pipelines • Develop Spark applications leveraging Scala DataFrame API • Implement automated checks to ensure data quality • Manage CI/CD processes utilizing Artifactory

Requirements: • Proven Scala and Spark skills in production settings • Strong SQL capabilities for transaction handling • Familiarity with Azure data services • Understanding of Airflow orchestration • Background in ScalaTest and testing frameworks

Your expertise in data engineering will be pivotal in advancing VLink's data practices. #J-18808-Ljbffr