Databricks Engineer
Compunnel Inc.
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Winnipeg, MB vacancy
$130k - $135k per year
...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design,...DatabricksLong term contractFull timeContract workFlexible hours- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...DatabricksHourly payContract workManual labor
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines...Databricks
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes recruitment, talent development, and process efficiency. As an Engineering Manager, you will oversee a full stack engineering team...DatabricksLong term contract
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
- Turn large-scale listener data into production intelligence with Databricks, Delta Lake, structured streaming, and feature engineering. Work fully remotely within Canada.As an MLOps / Data Engineer, you will productionize machine learning models supporting digital audio advertising...DatabricksRemote work
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work...DatabricksContract workRemote work
- Transform data insights into impactful applications as a Fullstack Software Engineer at Databricks in Vancouver. Collaborate on innovative projects focusing on user experience, scalability, and product excellence. At Databricks, you will be part of a mission-driven team specializing...Databricks
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length: 2 Months Key ResponsibilitiesDatabricks Engineering and Migration Migrate and refactor existing ETL/ELT pipelines,...DatabricksContract workWork at office2 days per week
- Optimize Databricks costs and automate delivery remotely in Canada using FinOps, Terraform, CI/CD, and platform administration skills.Mindtris is seeking a Senior Databricks Data Platform Engineer for a one-year contract with possible extension. The role emphasizes platform...DatabricksContract workRemote work
- ...Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement... ..., and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training...Databricks
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance Tuesdays... ...platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
- TekStaff's Client has a current vacancy for a Site Reliability Engineer ( Databricks) This is a 12 month contract located in Toronto, ON/ Hybrid SUMMARY OF THE ROLE: Appetite for contributing within a complex and critical environment Experience deploying, managing...DatabricksContract work
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications. This role is essential for creating, supporting, and optimizing data lake and warehouse...Databricks
- Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...Databricks
- Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The...Databricks
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- Montreal-based Senior Databricks Platform Engineer specializing in Lakehouse automation, Unity Catalog governance, and reliable remote platform operations.This contract role owns enterprise Databricks environments across development, test, and production. You will build reusable...DatabricksContract workRemote work
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- Shape the future of data and AI as a Fullstack Engineer at Databricks in Vancouver. We are looking for innovative minds ready to tackle technical challenges. Join Databricks' mission to democratize data in this exciting Fullstack Engineering role located in Vancouver. You...Databricks
- Databricks expertise meets customer intelligence at Xplore Inc. in this hands-on technical lead role, focused on gold-layer data and AI-ready analytics foundations.As Senior Intelligence Analytics Engineer, you will design curated datasets, validate pipelines, and build production...Databricks
- Use Azure, Python, and DevOps expertise as a Site Reliability Engineer supporting Databricks in Toronto, Ontario, with hybrid work.TekStaff's Client seeks a Site Reliability Engineer for a 12-month contract. The work involves deploying, managing, and operating complex applications...DatabricksContract work
- Build advertising data infrastructure remotely across Canada with Databricks, Apache Spark, and AI-native engineering practices. Own pipelines powering campaign analytics.This Senior Data Engineer role focuses on advertising analytics, campaign performance, and business intelligence...DatabricksRemote work
- ...Fluent, LLC in Canada is seeking a Senior MLOps Engineer to co-own MLOps practices, establishing standards for deployment, serving, scaling and cost-efficient infrastructure. You will work with ML scientists, Data Engineering and Product to ensure reliable production systems...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

