Principal Databricks Data Engineer
Astra-North Infoteck Inc.
12–18 years of overall Data Engineering experience
8+ years of experience with enterprise Data Warehouse and Data Lake platforms
5+ years of hands‑on experience with Databricks and Apache Spark at scale
Strong experience modernizing legacy Cloudera platforms including:
Modernize Cloudera platforms to Databricks Lakehouse architecture
Redesign ingestion, transformation, and consumption patterns from HDFS-based architecture to Cloud Object Storage and Delta Lake
Refactor legacy Hive and Impala logic into PySpark and Spark SQL ELT pipelines
Ensure data reconciliation, audit integrity, and consistency during migration
Design and govern enterprise Data Warehouse and Data Lake/Lakehouse architectures
Curated / Conformed Layer
Semantic / Consumption Layer
Modernize traditional Enterprise Data Warehouse platforms into scalable Lakehouse architectures
Strong experience with finance and risk data models including:
Financial Hierarchies
Liquidity Risk
Enable reporting capabilities including:
Build and manage semantic and consumption layers for BI, reporting, and analytics
Define business metrics, dimensions, hierarchies, and KPIs
Experience with:
Develop and optimize large‑scale data pipelines using:
Optimize workloads using:
Data Quality Frameworks
Establish data lineage and metadata management
Ensure data security, access control, and compliance standards
Experience with AWS or Azure cloud platforms
Experience with CI/CD pipelines using:
Familiarity with:
Experience with dbt is an advantage
Act as a technical authority and lead enterprise architecture decisions
Mentor senior engineers and establish engineering standards
Collaborate with finance, risk, analytics, and governance stakeholders
Translate complex data structures into business‑ready insights
Nice‑to‑Have Skills
Experience in BFSI, Capital Markets, or Regulatory Reporting
Oracle Financials
Experience supporting AI/ML workloads
Databricks and Cloud Certifications
Key Responsibilities
Lead Cloudera to Databricks transformation initiatives
Shape enterprise finance and risk data platforms
Support regulatory, management, and analytical reporting systems
#J-18808-Ljbffr
8+ years of experience with enterprise Data Warehouse and Data Lake platforms
5+ years of hands‑on experience with Databricks and Apache Spark at scale
Strong experience modernizing legacy Cloudera platforms including:
Modernize Cloudera platforms to Databricks Lakehouse architecture
Redesign ingestion, transformation, and consumption patterns from HDFS-based architecture to Cloud Object Storage and Delta Lake
Refactor legacy Hive and Impala logic into PySpark and Spark SQL ELT pipelines
Ensure data reconciliation, audit integrity, and consistency during migration
Design and govern enterprise Data Warehouse and Data Lake/Lakehouse architectures
Curated / Conformed Layer
Semantic / Consumption Layer
Modernize traditional Enterprise Data Warehouse platforms into scalable Lakehouse architectures
Strong experience with finance and risk data models including:
Financial Hierarchies
Liquidity Risk
Enable reporting capabilities including:
Build and manage semantic and consumption layers for BI, reporting, and analytics
Define business metrics, dimensions, hierarchies, and KPIs
Experience with:
Develop and optimize large‑scale data pipelines using:
Optimize workloads using:
Data Quality Frameworks
Establish data lineage and metadata management
Ensure data security, access control, and compliance standards
Experience with AWS or Azure cloud platforms
Experience with CI/CD pipelines using:
Familiarity with:
Experience with dbt is an advantage
Act as a technical authority and lead enterprise architecture decisions
Mentor senior engineers and establish engineering standards
Collaborate with finance, risk, analytics, and governance stakeholders
Translate complex data structures into business‑ready insights
Nice‑to‑Have Skills
Experience in BFSI, Capital Markets, or Regulatory Reporting
Oracle Financials
Experience supporting AI/ML workloads
Databricks and Cloud Certifications
Key Responsibilities
Lead Cloudera to Databricks transformation initiatives
Shape enterprise finance and risk data platforms
Support regulatory, management, and analytical reporting systems
#J-18808-Ljbffr
Vacancy posted 32 minutes ago
Similar jobs that could be interesting for youBased on the Principal Databricks Data Engineer in Winnipeg, MB vacancy
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...PrincipalDatabricks
- Principal Data Engineer work in Toronto centers on Databricks, Apache Spark, and Lakehouse modernization. This onsite role requires four days weekly.This principal-level position leads enterprise data engineering initiatives across Databricks, Spark, Delta Lake, PySpark, and...PrincipalDatabricksWork at office
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...DatabricksHourly payContract workManual labor
- ...Hybrid – 3 days remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing, building and... ...Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within the agile SCRUM work...DatabricksLong term contract
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking for...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This hands-on role focuses on... ...ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications. This role is essential for creating, supporting, and optimizing data lake and warehouse...Databricks
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length: 2 Months Key ResponsibilitiesDatabricks Engineering and Migration Migrate and refactor existing ETL/ELT pipelines,...DatabricksContract workWork at office2 days per week
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance... .... Build the platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Python, PySpark, SQL, Scala et Databricks structurent ce poste de Lead Technique Data chez Quality Foundations, Ubisoft.Vous contribuerez aux plateformes de données modernes, aux pipelines et aux architectures analytiques. La mission comprend l’adoption de solutions configurables...Databricks
- Lead Databricks and Azure data engineering at BDO Digital, building scalable pipelines and guiding client engagements within Technology Advisory Services.As a Senior Data Engineer, you will combine technical leadership with hands-on delivery for production-grade data solutions...Databricks
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work...DatabricksContract workRemote work
$105k - $120k per year
...yr - CA$120,000.00/yrThe Opportunity We are looking for a Principal Data Engineer to join our Data and Analytics Group within the Technology... ...CloudImplement modern data and analytics practices using tools such as Databricks, Snowflake, Salesforce, Python, and SQLDesign, develop,...PrincipalDatabricksLong term contractInternship$84k - $128k per year
...personal and professional growth. Your OpportunityBDO Digital is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This role blends technical leadership with hands‑on data...DatabricksManual laborWork at officeLocal areaFlexible hours- Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto office. Shape cloud... ...solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production...DatabricksWork at office
$135k - $175k per year
...investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical... ...Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks. This role requires a deep, hands‑on understanding of Databricks...DatabricksWorldwideFlexible hours- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL...DatabricksWork at office
- Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms....Databricks
$120k - $150k per year
...days onsite. On behalf of our client, Affinity is seeking a Principal Engineer, Data Solutions who will hold a senior technical leadership... ...transformation frameworks Modern cloud data warehouses (Fabric, Databricks) Power BI or Tableau (DAX, calculated fields, performance...PrincipalDatabricksLong term contractManual labor- ...About the Role Our client, a rapidly expanding telecommunications firm, is seeking a highly experienced Principal Data Engineer to establish and lead their data infrastructure initiatives. This role offers the flexibility of remote work and the opportunity to build robust...PrincipalRemote workHome office
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and automate... ...optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your work will enable...DatabricksRemote work
- ...1984, we started out as a team of three engineers. Today, we have grown to become a global... ...locations - Remote About The Role The Data Fabric team is a cross-functional team... ...-tenant, multi-cloud data platform on Databricks (GCP & Azure) to connect, govern,...DatabricksLong term contractWork at officeRemote workFlexible hours
- NTT DATA seeks a Senior Data Engineer to join our Toronto, Ontario team. The role focuses on designing, building, and optimizing scalable data solutions... ...workflows. Ideal candidates will have 8+ years with Databricks, PySpark, Python and SQL, plus strong Azure data services...Databricks
- ...Ledcor is seeking a Senior Data Engineer to design, build, and maintain enterprise-scale data solutions across construction and infrastructure businesses. You’ll work on a Databricks-based platform with medallion architecture, partnering with analysts, developers, and stakeholders...Databricks
- Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building...DatabricksContract workRemote work
- ...Pathlion is seeking a skilled Data Engineer to join our cloud data platform team in Fredericton, NB. You will analyze requirements, design... ...implement lakehouse solutions and automated pipelines using Azure and Databricks. You will collaborate with IT and business partners,...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Databricks Data Engineer. Be the first to apply!
Related searches
- mechanical engineering director Winnipeg, MB
- mechanical engineering project manager Winnipeg, MB
- directeur ingénierie Winnipeg, MB
- chief power engineer Winnipeg, MB
- director software engineering Winnipeg, MB
- project engineer assistant project manager Winnipeg, MB
- engineering project manager Winnipeg, MB
- chief engineer Winnipeg, MB
- general engineer Winnipeg, MB
- data integration developer Winnipeg, MB

