Senior Azure Databricks Data Engineer

Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze, Silver, and Gold layers while optimizing clusters hosted in Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure SQL Server.Key Responsibilities:
Design scalable ETL and ELT pipelines using Python and PySparkMaintain Bronze, Silver, and Gold data layersConfigure Databricks clusters, workflows, and Unity Catalog governanceOptimize Azure SQL Server schemas, queries, and integrationsEstablish automated quality checks and schema evolution standardsRequirements:
Production experience building Azure Databricks Lakehouse solutionsAdvanced Python, PySpark, Spark SQL, and Delta Lake proficiencyHands-on Unity Catalog access control and lineage experienceAzure SQL Server modeling, normalization, and query tuning knowledgeStrong communication with business and executive stakeholdersApply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.
#J-18808-Ljbffr