Databricks Etl Pipeline Engineer
Apex Systems, LLC
Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The assignment emphasizes data ingestion, transformation, and pipeline maintenance across medallion architecture layers. You will work with SQL Server, Db2, structured feeds, card networks, and file-based sources while supporting data consumers.Key Responsibilities:
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Databricks Etl Pipeline Engineer in Winnipeg, MB vacancy
- Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT...DatabricksWork at office
- À Montréal, Avanquest recherche un ingénieur ETL maîtrisant Databricks, Python et SQL pour développer des pipelines de données fiables. Le poste s’exerce selon un mode hybride flexible, avec télétravail possible depuis l’étranger.Vous prendrez en charge l’ingestion, le nettoyage...DatabricksRemote workFlexible hours
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark... ...ResponsibilitiesBuild and maintain scalable ETL/ELT data pipelines using Databricks.Use PySpark...Databricks
- ...CanadaRequisition ID153517BRInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based... ...Preferred Qualifications Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.Build and maintain data...DatabricksRelocation
- ...a Senior Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include designing data pipelines, developing automated testing frameworks, and...Databricks
- Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing... ...warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-...
- Develop Python ETL pipelines and CI/CD operations onsite five days weekly, supporting accurate... ...modular, testable solutions.In this Data Engineer role, you will build and maintain... ...preferredExperience with BigQuery, Snowflake, or Databricks preferredBring Python development, ETL,...Databricks
- A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python...DatabricksWork at office3 days per week
- ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You will integrate sources, build data models, and ensure scalable data flows for analytics and AI initiatives...
- ...Samsara Inc. in Canada is seeking a Data Engineer to join our Data team. You will design and maintain data pipelines using SparkSQL and PySpark in our central data lake, transforming data from IoT devices into our core data model for analytics and dashboards. This remote...Remote workFlexible hours
- ...HRbrain Inc. is seeking a Data Science Developer to deliver and sustain analytics pipelines, models, and data products. The role focuses on building scalable storage, automating pipelines, and crafting dashboards for insights. Responsibilities include knowledge transfer...DatabricksWork at office
- ...operate classic, generative and agentic AI solutions on Azure and Databricks for a major public energy player in Quebec. Montreal-based with... ...mandate; deliverables in French. You will implement MLflow pipelines, model registries and deployment, and lead CI/CD, IaC, and...Databricks
- Build scalable ETL pipelines and data integrations as a Senior Software Developer supporting enterprise AI and analytics initiatives.This senior role develops trusted data access across enterprise systems. You will create reusable services, prepare structured and unstructured...
- ...analysis, development, integration and automation of various data pipelines and data infrastructure within the ecosystem of Air Canada... ...role. 5+ years hands-on experience developing and maintaining ETL/ELT data pipelines. (SSIS or Spark based platforms) 5+ years experience...Permanent employmentFull timeWork at office
- ...solutions company in Canada is seeking an experienced Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have... ...pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance to work on...Databricks
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job... ...Description:****Databricks Data Engineer****Overview:**Apex Systems is... ...will focus on building data pipelines, ingesting and transforming data... .../PySpark, data migration and ETL development, with experience working...DatabricksHourly payContract workManual labor
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your... ...optimize and deliver large-scale data pipelines. This role demands over 10 years of... ...institutions. You will design ETL/ELT pipelines and collaborate with various...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial... ...focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks... .... Build batch and streaming ETL with Auto Loader and Spark...DatabricksContract work
- Databricks and Apache Spark specialists can build scalable data solutions... ...focuses on enterprise-grade pipelines and large-scale datasets.The... ..., Auto Loader, and streaming ETL pipelinesMaintain catalogs,... ...expertise to enterprise data engineering for a financial client. #J-...DatabricksContract work
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms... ...-scale datasets, complex distributed pipelines, and real business impact. We’re looking... ..., build, and maintain scalable ETL / ELT pipelines using Databricks,...DatabricksFull timeRemote workMonday to fridayFlexible hours
- ...au développement, à l’intégration et à l’automatisation de divers pipelines de données et de l’infrastructure de données au sein de l’... ...dans le développement et la maintenance de pipelines de données ETL/ELT (plateformes basées sur SSIS ou Spark); Plus de 5ans d’expérience...Permanent employmentFull timeWork at officeWork from home
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...take technical ownership of end-to-end batch and streaming pipelines, implement robust governance and security controls via Unity...Databricks
- Lead ETL testing at Tangerine using SQL, Python, and rigorous data validation across Data Warehouse environments. This senior role supports reliable data pipelines.As a Senior Quality Engineer, you will test ETL workflows, validate transformations, and reconcile source-to-target...
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work$84k - $128k per year
...and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory... ...scalable, secure, and production‑grade data pipelines using Azure and Databricks. The... ..., and Apache Spark. Develop scalable ETL processes for structured and unstructured...DatabricksManual laborWork at officeLocal areaFlexible hours- Master PySpark and Databricks as a Data Engineering Specialist with Pratt & Whitney Canada in Longueuil, working... ..., and storageDevelop complex pipelines using Apache Spark, PySpark, Python, and... ...architectures in Databricks and AWSDeploy ETL and ELT scripts across data sources and...DatabricksMonday to friday
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992,... ...OverviewWe are looking for an ETL QA Engineer with strong experience... ...validating large-scale data pipelines, ensuring data quality, and... ...hands‑on experience in Databricks (notebooks, jobs, clusters,...Databricks
- AWS ETL leadership meets hands-on data engineering at BrainRidge Consulting, delivering reliable pipelines for a major Canadian bank. Design medallion architectures using Glue, Redshift, and Step Functions.As an experienced, client-facing ETL Lead, you will own projects from...
- Build ETL pipelines and cloud infrastructure as a Data Engineer at REW.Ca, supporting real estate data and analytics. Work at least one day weekly in Vancouver.This 12-month contract role runs through 2027, with early December 2026 availability welcomed. You will help evolve...Contract work1 day per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Etl Pipeline Engineer. Be the first to apply!
Related searches

