Databricks Engineer
Compunnel Inc.
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
Build and maintain scalable ETL/ELT data pipelines using Databricks.
Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
Work with teams across the organization to prepare data for BI dashboards and reporting tools.
Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.
Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.
Ensure compliance with enterprise data policies and regulatory standards.
Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
10+ years of overall experience in data engineering.
Recent experience in financial services, banking, or capital markets.
Strong expertise in Databricks, including:
Unity Catalog
Lakehouse Architecture
Table Triggers
Databricks Runtime
Proficiency with Azure cloud services.
Deep understanding of Spark and PySpark for big data processing.
Strong programming skills in Python.
Experience with relational databases.
Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.
Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Databricks Engineer in Winnipeg, MB vacancy
$130k - $135k per year
...Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and... ...seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design,...DatabricksLong term contractFull timeContract workFlexible hours- ...3 days remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing, building and supporting... ...Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within the agile SCRUM work...DatabricksLong term contract
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise...DatabricksHourly payContract workManual labor
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize enterprise-grade lakehouse solutions. In this role, you will take technical ownership of end-to-end batch and streaming pipelines...Databricks
- We are seeking an experienced Databricks Engineer to join our delivery team on a contract basis in Calgary to design, build, and optimize modern data platforms on Azure Databricks. In this strategic role, you will work directly with both Data Elephant and client data...DatabricksContract work
- Lead a talented engineering team at Databricks, focused on building innovative software solutions in a SaaS environment. This role emphasizes recruitment, talent development, and process efficiency. As an Engineering Manager, you will oversee a full stack engineering team...DatabricksLong term contract
- Shape the future of data and AI as a Fullstack Engineer at Databricks in Vancouver. We are looking for innovative minds ready to tackle technical challenges. Join Databricks' mission to democratize data in this exciting Fullstack Engineering role located in Vancouver. You...Databricks
- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
- Are you ready to lead reliability engineering in a complex cloud environment? Working with one of our top financial clients, this role calls for aCloud Platform Engineer-Databricks to support a new project focused on processing critical data. This is a contract opportunity...DatabricksContract work
- Work with Databricks, Azure, and Claude at BCI, delivering AI-powered solutions for Private Equity in Victoria or Vancouver.In this Senior Software Engineer role, you will replace manual processes with agentic workflows and internal applications. You will build LLM-powered tools...Databricks
- TekStaff's Client has a current vacancy for a Site Reliability Engineer ( Databricks) This is a 12 month contract located in Toronto, ON/ Hybrid SUMMARY OF THE ROLE: Appetite for contributing within a complex and critical environment Experience deploying, managing...DatabricksContract work
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications. This role is essential for creating, supporting, and optimizing data lake and warehouse...Databricks
- Montreal-based Senior Databricks Platform Engineer specializing in Lakehouse automation, Unity Catalog governance, and reliable remote platform operations.This contract role owns enterprise Databricks environments across development, test, and production. You will build reusable...DatabricksContract workRemote work
- Lead Databricks and Azure data engineering at BDO Digital, building scalable pipelines and guiding client engagements within Technology Advisory Services.As a Senior Data Engineer, you will combine technical leadership with hands-on delivery for production-grade data solutions...Databricks
- ...Rubicon Path is seeking a Databricks Administrator to design, secure, and optimize Databricks environments in Canada. You will implement... ..., and a focus on governance and compliance. Collaboration with engineers and analytics teams is essential, with opportunities for training...Databricks
- Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...Databricks
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This... ...Databricks, Spark, streaming ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- Transform data insights into impactful applications as a Fullstack Software Engineer at Databricks in Vancouver. Collaborate on innovative projects focusing on user experience, scalability, and product excellence. At Databricks, you will be part of a mission-driven team specializing...Databricks
- Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The...Databricks
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance Tuesdays... ...platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length: 2 Months Key ResponsibilitiesDatabricks Engineering and Migration Migrate and refactor existing ETL/ELT pipelines,...DatabricksContract workWork at office2 days per week
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Engineer secure, scalable Azure data platforms with Databricks, Spark, and Delta Lake for BDO Digital’s Technology Advisory Services practice.This senior engineering role combines platform development with technical leadership across client engagements. Build reliable pipelines...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Python, PySpark, SQL, Scala et Databricks structurent ce poste de Lead Technique Data chez Quality Foundations, Ubisoft.Vous contribuerez aux plateformes de données modernes, aux pipelines et aux architectures analytiques. La mission comprend l’adoption de solutions configurables...Databricks
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Engineer. Be the first to apply!
Related searches
- ingénieur d'usine Winnipeg, MB
- vibration engineer Winnipeg, MB
- evaluation engineer Winnipeg, MB
- architectural engineer Winnipeg, MB
- ingénieur génie rural Winnipeg, MB
- contact center engineer Winnipeg, MB
- stage ingenieur Winnipeg, MB
- antenna engineer Winnipeg, MB
- completions engineer Winnipeg, MB
- junior aws engineer Winnipeg, MB

