Databricks Engineer
Compunnel Inc.
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Winnipeg, MB vacancy
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines...Databricks
- ...3 days remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing, building and supporting... ...Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within the agile SCRUM work...DatabricksLong term contract
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes recruitment, talent development, and process efficiency. As an Engineering Manager, you will oversee a full stack engineering team...DatabricksLong term contract
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...DatabricksHourly payContract workManual labor
$130k - $135k per year
...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design,...DatabricksLong term contractFull timeContract workFlexible hours- We are seeking an experienced Databricks Engineer to join our delivery team on a contract basis in Calgary to design, build, and optimize modern data platforms on Azure Databricks. In this strategic role, you will work directly with both Data Elephant and client data...DatabricksContract work
- Work with Databricks, Azure, and Claude at BCI, delivering AI-powered solutions for Private Equity in Victoria or Vancouver.In this Senior Software Engineer role, you will replace manual processes with agentic workflows and internal applications. You will build LLM-powered tools...Databricks
- Montreal-based Senior Databricks Platform Engineer specializing in Lakehouse automation, Unity Catalog governance, and reliable remote platform operations.This contract role owns enterprise Databricks environments across development, test, and production. You will build reusable...DatabricksContract workRemote work
- ...Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement... ..., and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training...Databricks
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length: 2 Months Key ResponsibilitiesDatabricks Engineering and Migration Migrate and refactor existing ETL/ELT pipelines,...DatabricksContract workWork at office2 days per week
- TekStaff's Client has a current vacancy for a Site Reliability Engineer ( Databricks) This is a 12 month contract located in Toronto, ON/ Hybrid SUMMARY OF THE ROLE: Appetite for contributing within a complex and critical environment Experience deploying, managing...DatabricksContract work
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Engineer secure, scalable Azure data platforms with Databricks, Spark, and Delta Lake for BDO Digital’s Technology Advisory Services practice.This senior engineering role combines platform development with technical leadership across client engagements. Build reliable pipelines...Databricks
- Shape the future of data and AI as a Fullstack Engineer at Databricks in Vancouver. We are looking for innovative minds ready to tackle technical challenges. Join Databricks' mission to democratize data in this exciting Fullstack Engineering role located in Vancouver. You...Databricks
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The...Databricks
- Optimize Databricks costs and automate delivery remotely in Canada using FinOps, Terraform, CI/CD, and platform administration skills.Mindtris is seeking a Senior Databricks Data Platform Engineer for a one-year contract with possible extension. The role emphasizes platform...DatabricksContract workRemote work
- Turn large-scale listener data into production intelligence with Databricks, Delta Lake, structured streaming, and feature engineering. Work fully remotely within Canada.As an MLOps / Data Engineer, you will productionize machine learning models supporting digital audio advertising...DatabricksRemote work
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Databricks expertise meets customer intelligence at Xplore Inc. in this hands-on technical lead role, focused on gold-layer data and AI-ready analytics foundations.As Senior Intelligence Analytics Engineer, you will design curated datasets, validate pipelines, and build production...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...Databricks
- Transform data insights into impactful applications as a Fullstack Software Engineer at Databricks in Vancouver. Collaborate on innovative projects focusing on user experience, scalability, and product excellence. At Databricks, you will be part of a mission-driven team specializing...Databricks
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance Tuesdays... ...platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications. This role is essential for creating, supporting, and optimizing data lake and warehouse...Databricks
- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
Related searches
- solid waste engineer Winnipeg, MB
- voip engineer Winnipeg, MB
- resident engineer Winnipeg, MB
- ingenieur Winnipeg, MB
- certification engineer Winnipeg, MB
- failure analysis engineer Winnipeg, MB
- engineering summer student Winnipeg, MB
- graduate engineer Winnipeg, MB
- junior engineer Winnipeg, MB
- forklift engineer Winnipeg, MB

