Databricks Etl Pipeline Engineer

Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The assignment emphasizes data ingestion, transformation, and pipeline maintenance across medallion architecture layers. You will work with SQL Server, Db2, structured feeds, card networks, and file-based sources while supporting data consumers.Key Responsibilities:
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr