Senior Lead Databricks Data Engineer
Vanguard
Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms. You will apply Lakehouse architecture, Delta Lake, Unity Catalog, Spark, PySpark, SQL, and Python. The work supports analytics, operational decision-making, machine learning, Generative AI, and intelligent business applications.Key Responsibilities:
Lead enterprise data solution architecture using Databricks and AWSDesign reusable batch, streaming, and event-driven data pipelinesBuild Delta Live Tables and Lakeflow PipelinesEstablish metadata-driven engineering frameworks and standardsMentor engineers and lead architecture reviewsRequirements:
9–12+ years in Data, Platform, or Analytics Engineering5+ years building enterprise Databricks solutionsExpertise in Lakehouse architecture, Delta Lake, and Unity CatalogProficiency with Spark, PySpark, SQL, and PythonExperience with AWS, CI/CD, and Infrastructure-as-CodeApply Databricks, AWS, and Lakehouse expertise to lead governed data platforms supporting analytics and Generative AI initiatives.
#J-18808-Ljbffr
Lead enterprise data solution architecture using Databricks and AWSDesign reusable batch, streaming, and event-driven data pipelinesBuild Delta Live Tables and Lakeflow PipelinesEstablish metadata-driven engineering frameworks and standardsMentor engineers and lead architecture reviewsRequirements:
9–12+ years in Data, Platform, or Analytics Engineering5+ years building enterprise Databricks solutionsExpertise in Lakehouse architecture, Delta Lake, and Unity CatalogProficiency with Spark, PySpark, SQL, and PythonExperience with AWS, CI/CD, and Infrastructure-as-CodeApply Databricks, AWS, and Lakehouse expertise to lead governed data platforms supporting analytics and Generative AI initiatives.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Lead Databricks Data Engineer. Be the first to apply!
Related searches
- senior financial accountant Winnipeg, MB
- senior sales consultant Winnipeg, MB
- senior communications specialist Winnipeg, MB
- senior bookkeeper Winnipeg, MB
- senior system administrator Winnipeg, MB
- senior technical recruiter Winnipeg, MB
- senior director Winnipeg, MB
- senior technical specialist Winnipeg, MB
- senior internal auditor Winnipeg, MB
- senior line cook Winnipeg, MB
