Data Bricks & Spark Engineering Expert Vancouver

Drive innovation in data engineering with VLink as a Senior Engineering Expert in Montreal. You will oversee the migration of regulatory report pipelines to Databricks using Scala and Spark.

This onsite position calls for a hands‑on approach to redesign and implement ETL processes in a up‑to‑date cloud‑based system. Candidates must be adept in managing complex data frameworks within Azure, utilizing tools such as Snowflake and Airflow for orchestration, and ensuring data integrity across migrations.

Key Responsibilities

• Implement and test regulatory reporting pipelines on Databricks
• Develop robust Spark applications using Scala
• Analyze and extract requirements from complex SQL queries
• Design data quality frameworks for consistency and accuracy
• Execute CI/CD pipelines for effective deployment

Requirements

• Extensive experience with Databricks and Spark
• Proficient in SQL and data analysis
• Familiarity with Azure and contemporary data practices
• Experience with testing frameworks in Scala
• Background in migrating legacy ETL systems

Capitalize on your expertise in data engineering and cloud migration with VLink to drive impactful solutions.

J-18808-Ljbffr