Databricks Engineer
Compunnel Inc.
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
Vacancy posted 41 minutes ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Winnipeg, MB vacancy
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes recruitment, talent development, and process efficiency. As an Engineering Manager, you will oversee a full stack engineering team...DatabricksLong term contract
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...DatabricksHourly payContract workManual labor
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length: 2 Months Key ResponsibilitiesDatabricks Engineering and Migration Migrate and refactor existing ETL/ELT pipelines,...DatabricksContract workWork at office2 days per week
- Work with Databricks, Azure, and Claude at BCI, delivering AI-powered solutions for Private Equity in Victoria or Vancouver.In this Senior Software Engineer role, you will replace manual processes with agentic workflows and internal applications. You will build LLM-powered tools...Databricks
- Turn large-scale listener data into production intelligence with Databricks, Delta Lake, structured streaming, and feature engineering. Work fully remotely within Canada.As an MLOps / Data Engineer, you will productionize machine learning models supporting digital audio advertising...DatabricksRemote work
- Are you ready to lead reliability engineering in a complex cloud environment? Working with one of our top financial clients, this role calls for aCloud Platform Engineer-Databricks to support a new project focused on processing critical data. This is a contract opportunity...DatabricksContract work
- Montreal-based Senior Databricks Platform Engineer specializing in Lakehouse automation, Unity Catalog governance, and reliable remote platform operations.This contract role owns enterprise Databricks environments across development, test, and production. You will build reusable...DatabricksContract workRemote work
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Databricks expertise meets customer intelligence at Xplore Inc. in this hands-on technical lead role, focused on gold-layer data and AI-ready analytics foundations.As Senior Intelligence Analytics Engineer, you will design curated datasets, validate pipelines, and build production...Databricks
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work...DatabricksContract workRemote work
- Engineer secure, scalable Azure data platforms with Databricks, Spark, and Delta Lake for BDO Digital’s Technology Advisory Services practice.This senior engineering role combines platform development with technical leadership across client engagements. Build reliable pipelines...Databricks
- Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The...Databricks
- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
- TekStaff's Client has a current vacancy for a Site Reliability Engineer ( Databricks) This is a 12 month contract located in Toronto, ON/ Hybrid SUMMARY OF THE ROLE: Appetite for contributing within a complex and critical environment Experience deploying, managing...DatabricksContract work
- Optimize Databricks costs and automate delivery remotely in Canada using FinOps, Terraform, CI/CD, and platform administration skills.Mindtris is seeking a Senior Databricks Data Platform Engineer for a one-year contract with possible extension. The role emphasizes platform...DatabricksContract workRemote work
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This... ...Databricks, Spark, streaming ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance Tuesdays... ...platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Transform data insights into impactful applications as a Fullstack Software Engineer at Databricks in Vancouver. Collaborate on innovative projects focusing on user experience, scalability, and product excellence. At Databricks, you will be part of a mission-driven team specializing...Databricks
- Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL...DatabricksWork at office
- Lead Azure Databricks platform engineering at Canada Life in a hybrid Toronto or London role, using cloud administration and operational support expertise.As a Senior Data Platform Engineer, you will design, adapt, and maintain cloud solutions supporting Canada Life business...Databricks
- Principal Data Engineer work in Toronto centers on Databricks, Apache Spark, and Lakehouse modernization. This onsite role requires four days weekly.This principal-level position leads enterprise data engineering initiatives across Databricks, Spark, Delta Lake, PySpark, and...DatabricksWork at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

