Databricks Spark Data Engineer
BeachHead
Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale datasets and distributed computing environments. Build batch and streaming ETL with Auto Loader and Spark Structured Streaming. Apply Unity Catalog, Lakehouse Federation, SCD methodologies, and change data capture while collaborating with stakeholders on practical solution design.Key Responsibilities:
Design and optimise Databricks and Apache Spark data pipelinesBuild batch and streaming ETL using Auto LoaderMaintain catalogs, schemas, tables, views, functions, and volumesImplement SCD 1, SCD 2, and change data captureApply partitioning and liquid clustering for performanceRequirements:
Hands-on Databricks and Apache Spark development experienceExperience with Azure Databricks or Delta LakeStrong Unity Catalog and Lakehouse Federation experienceEnterprise experience;
banking experience preferredStrong communication and stakeholder management skillsApply Databricks, Spark, ETL, and governance expertise to deliver reliable enterprise data solutions for financial services.
#J-18808-Ljbffr
Design and optimise Databricks and Apache Spark data pipelinesBuild batch and streaming ETL using Auto LoaderMaintain catalogs, schemas, tables, views, functions, and volumesImplement SCD 1, SCD 2, and change data captureApply partitioning and liquid clustering for performanceRequirements:
Hands-on Databricks and Apache Spark development experienceExperience with Azure Databricks or Delta LakeStrong Unity Catalog and Lakehouse Federation experienceEnterprise experience;
banking experience preferredStrong communication and stakeholder management skillsApply Databricks, Spark, ETL, and governance expertise to deliver reliable enterprise data solutions for financial services.
#J-18808-Ljbffr
Vacancy posted 54 minutes ago
Similar jobs that could be interesting for youBased on the Databricks Spark Data Engineer in Winnipeg, MB vacancy
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This hands-on role focuses on... ...ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and... ...pipelines, optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your work will...DatabricksRemote work
- ...in Canada is seeking an experienced Databricks Architect to build and optimize ETL... ...strong expertise in Databricks, Spark, SQL, and Python. Responsibilities... ...implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a...Databricks
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in... ...or Databricks Certified Developer for Apache Spark. *Everforth Apex is a world-class IT services...DatabricksHourly payContract workManual labor
- ...remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing,... ...Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork... ...using technologies such as Python, Spark and SQL, consuming data sources in XML,...DatabricksLong term contract
- Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval... ...Engineering Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and...DatabricksWork at office
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length... ...development skills in: Python PySpark / Apache Spark SQL Experience designing and implementing ETL/ELT and large...DatabricksContract workWork at office2 days per week
- Lead Databricks and Azure data engineering at BDO Digital, building scalable pipelines and guiding client engagements within Technology Advisory Services... .... Your work spans Databricks, Delta Lake, Apache Spark, Azure Data Lake, and scalable ETL. You will align data initiatives...Databricks
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...Optimize ADLS Gen2 / S3 storage and retention policies. Tune Spark and SQL workloads. Identify and resolve small-file...DatabricksContract workRemote work
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite (4 days/week) Key Requirements 12–18 years of overall Data Engineering experience. 8+ years of experience with Enterprise...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data Warehouse and Data Lake platforms ~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience modernizing legacy Cloudera platforms including...Databricks
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications... ...leverage your expertise in Python, SQL, and Spark to solve complex data challenges. Your...Databricks
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase... ...beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs... ...operate Kafka and Debezium pipelines, Spark streaming into Delta, Unity Catalog, warehouses...DatabricksWork from home
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...Databricks
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position... ...performance. You will transform datasets with PySpark and Spark, integrate Azure data sources, and prepare information for...Databricks
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation, and ML across our platform... ...-to-end data pipelines, Python production code, Spark or Flink, and SQL. The role offers bonus opportunities...- Build reliable data pipelines with SparkSQL and PySpark as a remote Data Engineer at Samsara, serving candidates across Canada. Transform IoT data into actionable models... ...pipelinesExpertise in SQL, Python, REST APIs, and Spark platformsApply data modeling, orchestration, and...Remote work
- Principal Data Engineer work in Toronto centers on Databricks, Apache Spark, and Lakehouse modernization. This onsite role requires four days weekly.This principal-level position leads enterprise data engineering initiatives across Databricks, Spark, Delta Lake, PySpark, and...DatabricksWork at office
- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL...DatabricksWork at office
- We are looking for a Data Engineer with significant experience (9+ years) in Python and Spark for a full-time onsite position, five days a week. This role is crucial for developing effective software solutions. As a Data Engineer, you will utilize your Python and Pyspark...Full time
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions of users. Our projects involve large-scale datasets, complex distributed pipelines, and real business impact. We’re looking for...DatabricksFull timeRemote workMonday to fridayFlexible hours
$84k - $128k per year
...is seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice.... ...robust data pipelines using Databricks, Delta Lake, and Apache Spark.Develop scalable ETL processes for structured and...DatabricksManual laborWork at officeLocal areaFlexible hours- Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto office. Shape cloud solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production deployment...DatabricksWork at office
- Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks... ...apply Lakehouse architecture, Delta Lake, Unity Catalog, Spark, PySpark, SQL, and Python. The work supports analytics,...Databricks
$135k - $175k per year
...multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most... ...Data Platform (CDP) built on Databricks. This role requires a deep, hands‑on... ...Configure and optimize Databricks clusters and Spark jobs for optimal performance. Utilize...DatabricksWorldwideFlexible hours- Python, PySpark, SQL, Scala et Databricks structurent ce poste de Lead Technique Data chez Quality Foundations, Ubisoft.Vous contribuerez aux plateformes de données modernes, aux pipelines et aux architectures analytiques. La mission comprend l’adoption de solutions configurables...Databricks
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...Remote work
- ...Week in Office Job Overview We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design,... ...ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with...Work at office3 days per week
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Sensor Tower is seeking a Senior Data Engineer to build and own end-to-end data products. You will work with a global team of engineers and collaborate with product managers and data scientists to deliver impactful data solutions. You will develop PySpark-based data programs...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Spark Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

