Databricks Spark Data Engineer
BeachHead
Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale datasets and distributed computing environments. Build batch and streaming ETL with Auto Loader and Spark Structured Streaming. Apply Unity Catalog, Lakehouse Federation, SCD methodologies, and change data capture while collaborating with stakeholders on practical solution design.Key Responsibilities:
Design and optimise Databricks and Apache Spark data pipelinesBuild batch and streaming ETL using Auto LoaderMaintain catalogs, schemas, tables, views, functions, and volumesImplement SCD 1, SCD 2, and change data captureApply partitioning and liquid clustering for performanceRequirements:
Hands-on Databricks and Apache Spark development experienceExperience with Azure Databricks or Delta LakeStrong Unity Catalog and Lakehouse Federation experienceEnterprise experience;
banking experience preferredStrong communication and stakeholder management skillsApply Databricks, Spark, ETL, and governance expertise to deliver reliable enterprise data solutions for financial services.
#J-18808-Ljbffr
Design and optimise Databricks and Apache Spark data pipelinesBuild batch and streaming ETL using Auto LoaderMaintain catalogs, schemas, tables, views, functions, and volumesImplement SCD 1, SCD 2, and change data captureApply partitioning and liquid clustering for performanceRequirements:
Hands-on Databricks and Apache Spark development experienceExperience with Azure Databricks or Delta LakeStrong Unity Catalog and Lakehouse Federation experienceEnterprise experience;
banking experience preferredStrong communication and stakeholder management skillsApply Databricks, Spark, ETL, and governance expertise to deliver reliable enterprise data solutions for financial services.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Databricks Spark Data Engineer in Winnipeg, MB vacancy
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This hands-on role focuses on... ...ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and... ...pipelines, optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your work will...DatabricksRemote work
- ...in Canada is seeking an experienced Databricks Architect to build and optimize ETL... ...strong expertise in Databricks, Spark, SQL, and Python. Responsibilities... ...implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a...Databricks
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in... ...or Databricks Certified Developer for Apache Spark. *Everforth Apex is a world-class IT services...DatabricksHourly payContract workManual labor
- ...remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing,... ...Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork... ...using technologies such as Python, Spark and SQL, consuming data sources in XML,...DatabricksLong term contract
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval... ...Engineering Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and...DatabricksWork at office
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase... ...beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs... ...operate Kafka and Debezium pipelines, Spark streaming into Delta, Unity Catalog, warehouses...DatabricksWork from home
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications... ...leverage your expertise in Python, SQL, and Spark to solve complex data challenges. Your...Databricks
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length... ...development skills in: Python PySpark / Apache Spark SQL Experience designing and implementing ETL/ELT and large...DatabricksContract workWork at office2 days per week
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...Optimize ADLS Gen2 / S3 storage and retention policies. Tune Spark and SQL workloads. Identify and resolve small-file...DatabricksContract workRemote work
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- We are seeking a hands-on Data Engineer with 5+ years of experience to design and deliver scalable... ...ideal candidate has strong expertise in Databricks, PySpark, SQL and Python, with proven... ...with Databricks workflows/jobs, Spark optimization and pipeline monitoring....DatabricksFor subcontractor
- Build reliable data pipelines with SparkSQL and PySpark as a remote Data Engineer at Samsara, serving candidates across Canada. Transform IoT data into actionable models... ...pipelinesExpertise in SQL, Python, REST APIs, and Spark platformsApply data modeling, orchestration, and...Remote work
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform... ...-to-end data pipelines, Python production code, Spark or Flink, and SQL. The role offers bonus opportunities...- ...leading institutional investment organization as a Senior Data Engineer supporting a major Eagle platform upgrade. You’ll play a... ...and regression-testing solutions using Azure Databricks, Python/PySpark, Spark SQL, and Oracle SQL/PLSQL. You’ll compare current and...DatabricksContract work2 days per week3 days per week
- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL...DatabricksWork at office
$84k - $128k per year
Senior Data Engineer (Databricks Focused)This site uses cookies to provide you with a more responsive and personalised service. By using this site... ...robust data pipelines using Databricks, Delta Lake, and Apache Spark.* Develop scalable ETL processes for structured and...DatabricksFull timeManual laborWork at officeLocal areaFlexible hours- Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks... ...apply Lakehouse architecture, Delta Lake, Unity Catalog, Spark, PySpark, SQL, and Python. The work supports analytics,...Databricks
- Principal Data Engineer work in Toronto centers on Databricks, Apache Spark, and Lakehouse modernization. This onsite role requires four days weekly.This principal-level position leads enterprise data engineering initiatives across Databricks, Spark, Delta Lake, PySpark, and...DatabricksWork at office
- Shape client data initiatives at BDO through Databricks architecture, stakeholder communication, and hands-on cloud data engineering.BDO Digital seeks a Senior Data Engineer who can lead client... ...experienceThree years with Databricks, Apache Spark, and cloud platformsExcellent written...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking for...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto office. Shape cloud solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production deployment...DatabricksWork at office
$135k - $175k per year
...multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most... ...Data Platform (CDP) built on Databricks. This role requires a deep, hands‑on... ...Configure and optimize Databricks clusters and Spark jobs for optimal performance. Utilize...DatabricksWorldwideFlexible hours- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Python, PySpark, SQL, Scala et Databricks structurent ce poste de Lead Technique Data chez Quality Foundations, Ubisoft.Vous contribuerez aux plateformes de données modernes, aux pipelines et aux architectures analytiques. La mission comprend l’adoption de solutions configurables...Databricks
- Build scalable data integration solutions with Databricks and PySpark at Teqfocus, using SQL and Python to process enterprise data. Work hands-on across... ...master data ingestion workflows.Teqfocus seeks a Data Engineer with five or more years of professional experience in data...Databricks
- LTM in Mississauga, Ontario is seeking a Specialist with 5 to 7 years of experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL ecosystem. You will design, implement, and optimize data pipelines...
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Spark Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

