Databricks Etl Pipeline Engineer
Apex Systems, LLC
Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The assignment emphasizes data ingestion, transformation, and pipeline maintenance across medallion architecture layers. You will work with SQL Server, Db2, structured feeds, card networks, and file-based sources while supporting data consumers.Key Responsibilities:
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Vacancy posted 36 minutes ago
Similar jobs that could be interesting for youBased on the Databricks Etl Pipeline Engineer in Winnipeg, MB vacancy
- Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT...DatabricksWork at office
KUMARAN SYSTEMS
Winnipeg, MB44 minutes ago - Build Azure data pipelines with Databricks, Python, and SQL for the Government of Ontario’s Ontario Data... ...organizations through scalable engineering and reliable processing.This Data Engineer... ...Spark processing jobsBuild ingestion, ETL/ELT, validation, and reconciliation processesManage...Databricks
Softline Technology Inc.
Winnipeg, MB36 minutes ago - The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark... ...ResponsibilitiesBuild and maintain scalable ETL/ELT data pipelines using Databricks.Use PySpark...Databricks
Compunnel Inc.
Winnipeg, MB37 minutes ago - À Montréal, Avanquest recherche un ingénieur ETL maîtrisant Databricks, Python et SQL pour développer des pipelines de données fiables. Le poste s’exerce selon un mode hybride flexible, avec télétravail possible depuis l’étranger.Vous prendrez en charge l’ingestion, le nettoyage...DatabricksRemote workFlexible hours
Avanquest
Winnipeg, MB41 minutes ago - ...a Senior Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include designing data pipelines, developing automated testing frameworks, and...Databricks
Rubicon Path
Winnipeg, MB36 minutes ago - Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing... ...warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-...
Compunnel, Inc.
Winnipeg, MB42 minutes ago - ...CanadaRequisition ID153517BRInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based... ...Preferred Qualifications Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.Build and maintain data...DatabricksRelocation
Infosys Limited
Winnipeg, MB40 minutes ago - Develop Python ETL pipelines and CI/CD operations onsite five days weekly, supporting accurate... ...modular, testable solutions.In this Data Engineer role, you will build and maintain... ...preferredExperience with BigQuery, Snowflake, or Databricks preferredBring Python development, ETL,...Databricks
Lahal Management LP
Winnipeg, MB40 minutes ago - A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python...DatabricksWork at office3 days per week
Rubicon Path
Winnipeg, MB39 minutes ago - ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You will integrate sources, build data models, and ensure scalable data flows for analytics and AI initiatives...
COFOMO
Winnipeg, MB40 minutes ago - ...Samsara Inc. in Canada is seeking a Data Engineer to join our Data team. You will design and maintain data pipelines using SparkSQL and PySpark in our central data lake, transforming data from IoT devices into our core data model for analytics and dashboards. This remote...Remote workFlexible hours
Samsara Inc.
Winnipeg, MB38 minutes ago - ...HRbrain Inc. is seeking a Data Science Developer to deliver and sustain analytics pipelines, models, and data products. The role focuses on building scalable storage, automating pipelines, and crafting dashboards for insights. Responsibilities include knowledge transfer...DatabricksWork at office
HRBrain Inc.
Winnipeg, MB40 minutes ago - ...operate classic, generative and agentic AI solutions on Azure and Databricks for a major public energy player in Quebec. Montreal-based with... ...mandate; deliverables in French. You will implement MLflow pipelines, model registries and deployment, and lead CI/CD, IaC, and...Databricks
Abbeal
Winnipeg, MB36 minutes ago - Build scalable ETL pipelines and data integrations as a Senior Software Developer supporting enterprise AI and analytics initiatives.This senior role develops trusted data access across enterprise systems. You will create reusable services, prepare structured and unstructured...
Pathlion
Winnipeg, MB41 minutes ago - ...analysis, development, integration and automation of various data pipelines and data infrastructure within the ecosystem of Air Canada... ...role. 5+ years hands-on experience developing and maintaining ETL/ELT data pipelines. (SSIS or Spark based platforms) 5+ years experience...Permanent employmentFull timeWork at office
Vacances Air Canada / Air Canada Vacations
Winnipeg, MB38 minutes ago - ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job... ...Description:****Databricks Data Engineer****Overview:**Apex Systems is... ...will focus on building data pipelines, ingesting and transforming data... .../PySpark, data migration and ETL development, with experience working...DatabricksHourly payContract workManual labor
Apex Systems, LLC
Winnipeg, MB38 minutes ago - ...solutions company in Canada is seeking an experienced Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have... ...pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance to work on...Databricks
Acunor
Winnipeg, MB37 minutes ago - Databricks and Apache Spark specialists can build scalable data solutions... ...focuses on enterprise-grade pipelines and large-scale datasets.The... ..., Auto Loader, and streaming ETL pipelinesMaintain catalogs,... ...expertise to enterprise data engineering for a financial client. #J-...DatabricksContract work
BeachHead
Winnipeg, MB38 minutes ago - Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms... ...-scale datasets, complex distributed pipelines, and real business impact. We’re looking... ..., build, and maintain scalable ETL / ELT pipelines using Databricks,...DatabricksFull timeRemote workMonday to fridayFlexible hours
Lumenalta
Winnipeg, MB38 minutes ago - Lead Databricks and Azure data engineering at BDO Digital through a blended work model spanning offices, client... ...Services, you will build production-grade pipelines and lead client engagements. Your... ...Lake, and Apache SparkDevelop scalable ETL for structured and unstructured...Databricks
BDO Canada LLP
Winnipeg, MB37 minutes ago - Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your... ...optimize and deliver large-scale data pipelines. This role demands over 10 years of... ...institutions. You will design ETL/ELT pipelines and collaborate with various...Databricks
Compunnel Inc.
Winnipeg, MB37 minutes ago - Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto... ...engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
Raise - find a more meaningful working experience
Winnipeg, MB39 minutes ago - Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract... ...and Migration Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads into Databricks. Develop...DatabricksContract workWork at office2 days per week
Raise - find a more meaningful working experience
Winnipeg, MB43 minutes ago - ...au développement, à l’intégration et à l’automatisation de divers pipelines de données et de l’infrastructure de données au sein de l’... ...dans le développement et la maintenance de pipelines de données ETL/ELT (plateformes basées sur SSIS ou Spark); Plus de 5ans d’expérience...Permanent employmentFull timeWork at officeWork from home
Vacances Air Canada / Air Canada Vacations
Winnipeg, MB44 minutes ago - Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
Rivago Infotech Inc
Winnipeg, MB39 minutes ago - Build scalable data pipelines and lakehouse systems at Spade Technologies... .... Work full time.As a Data Engineer reporting to the CTO, you will... ...ingestion pipelinesImplement ETL/ELT workflows and validation layersDevelop... ...experienceExpertise with Databricks, Airflow, dbt, Spark, or...DatabricksFull time
Sarsfield Group
Winnipeg, MB39 minutes ago - Lead LLMOps and MLOps engineering with Databricks, MLflow, Unity Catalog, and Azure across production AI solutions in financial services.This AI Engineer... ...machine learning use cases. You will establish evaluation pipelines, monitoring, versioning, guardrails, content safety, cost...Databricks
Fortiv Technical Inc.
Winnipeg, MB38 minutes ago $34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract workCapgemini
Winnipeg, MB36 minutes ago- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...take technical ownership of end-to-end batch and streaming pipelines, implement robust governance and security controls via Unity...Databricks
KData AI
Winnipeg, MB43 minutes ago - ...and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory... ...scalable, secure, and production‑grade data pipelines using Azure and Databricks. The... ..., and Apache Spark. Develop scalable ETL processes for structured and unstructured...DatabricksManual laborWork at officeLocal areaFlexible hours
BDO Canada LLP
Winnipeg, MB41 minutes ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Etl Pipeline Engineer. Be the first to apply!
Related searches