Senior Data Engineer with Databricks Expertise

Join VLink as a Senior Data Engineering Specialist in Montreal, focusing on Databricks, Scala, and Spark in an onsite role. Contribute to complex migration projects and develop production pipelines. This contract position calls for an experienced specialist to design and implement essential production pipelines for regulatory reporting. You will leverage your skills in Scala, SQL, and Azure services as you migrate legacy systems to cutting-edge solutions with Databricks and Snowflake. Your role will greatly enhance the data architecture and reporting capabilities of the organization. Key Responsibilities:

• Design production pipelines for regulatory reports
• Migrate ETL processes to Databricks and Snowflake
• Write and optimize Spark applications in Scala
• Develop automated testing practices
• Ensure data quality through reconciliation checks

Requirements:

• Proven skills in Scala, Spark, Databricks
• Strong SQL for data manipulation
• Experience with Azure services
• Familiarity with CI/CD tools like GitHub Actions
• Knowledge of orchestration tools like Airflow

Leverage your data engineering expertise to drive impactful migrations at VLink. #J-18808-Ljbffr