Databricks Etl Pipeline Engineer
Apex Systems, LLC
Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The assignment emphasizes data ingestion, transformation, and pipeline maintenance across medallion architecture layers. You will work with SQL Server, Db2, structured feeds, card networks, and file-based sources while supporting data consumers.Key Responsibilities:
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Develop ETL and ELT ingestion pipelinesTransform data using SQL, Python, and PySparkBuild materialized and metric viewsMaintain Bronze, Silver, and Gold datasetsResolve pipeline, data, and transformation problemsRequirements:
Strong Databricks data engineering backgroundExperience maintaining ETL and ingestion pipelinesHands-on Python, PySpark, and SQL skillsAzure Data Factory pipeline experienceUnderstanding of Databricks tables and workflowsUse Databricks ETL, ADF, SQL, and PySpark skills to deliver migration-focused data pipelines for Apex Systems in Toronto.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Databricks Etl Pipeline Engineer in Winnipeg, MB vacancy
- Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT...DatabricksWork at office
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark... ...ResponsibilitiesBuild and maintain scalable ETL/ELT data pipelines using Databricks.Use PySpark...Databricks
- ...CanadaRequisition ID153517BRInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based... ...Preferred Qualifications Design and develop scalable ETL/ELT pipelines using Azure Databricks and PySpark.Build and maintain data...DatabricksRelocation
- Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing... ...warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica) and APIs. The ideal candidate is a self-...Suggested
- A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python...DatabricksWork at office3 days per week
- Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise... ...strong Python, PySpark, and SQL skills, experience with Databricks and cloud platforms, and a solid background in data #J-18808-...Databricks
- ...CoFoMo Inc. is seeking an experienced data engineer to design, develop, and optimize ETL/ELT pipelines for structured and unstructured data across cloud platforms. You will integrate sources, build data models, and ensure scalable data flows for analytics and AI initiatives...
- ...HRbrain Inc. is seeking a Data Science Developer to deliver and sustain analytics pipelines, models, and data products. The role focuses on building scalable storage, automating pipelines, and crafting dashboards for insights. Responsibilities include knowledge transfer...DatabricksWork at office
- Build scalable ETL pipelines and data integrations as a Senior Software Developer supporting enterprise AI and analytics initiatives.This senior role develops trusted data access across enterprise systems. You will create reusable services, prepare structured and unstructured...
- Astra-North Infoteck Inc. in Toronto, Canada, seeks an experienced L4 Engineer with hands-on data engineering, cloud platforms, and application development. You will work across Azure Databricks, Databricks ML, and Java/Python backend tasks to support complex data solutions....Databricks
- ...solutions company in Canada is seeking an experienced Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have... ...pipelines, integrating data using APIs, and leading data engineering initiatives. The role offers a chance to work on...Databricks
- ...analysis, development, integration and automation of various data pipelines and data infrastructure within the ecosystem of Air Canada... ...role. 5+ years hands-on experience developing and maintaining ETL/ELT data pipelines. (SSIS or Spark based platforms) 5+ years experience...Permanent employmentFull timeWork at office
$130k - $135k per year
...& DevOps, Data, and Software Engineering, servicing an array of noteworthy... ...with strong expertise in Databricks to join our data team. The ideal... ...optimize large-scale data pipeline, ensuring scalability, reliability... ...:Build and maintain scalable ETL/ELT pipelines using...DatabricksLong term contractFull timeContract workFlexible hours- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job... ...Description:****Databricks Data Engineer****Overview:**Apex Systems is... ...will focus on building data pipelines, ingesting and transforming data... .../PySpark, data migration and ETL development, with experience working...DatabricksHourly payContract workManual labor
- ...GoTo Technologies Canada Ltd. recrute un Développeur de données senior, niveau 2, pour concevoir et construire des pipelines sur Databricks et orchestrer des flux de données variés. Vous travaillerez sur des architectures scalables et innovantes qui alimentent des équipes à...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms... ...-scale datasets, complex distributed pipelines, and real business impact. We’re looking... ..., build, and maintain scalable ETL / ELT pipelines using Databricks,...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial... ...focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks... .... Build batch and streaming ETL with Auto Loader and Spark...DatabricksContract work
- A leading insurance firm in Canada is seeking a Senior ETL Developer to join their hybrid team. The role involves building efficient data pipelines and operationalizing high-quality data solutions. Candidates should have extensive experience in data modeling, SQL, and using...
- ...au développement, à l’intégration et à l’automatisation de divers pipelines de données et de l’infrastructure de données au sein de l’... ...dans le développement et la maintenance de pipelines de données ETL/ELT (plateformes basées sur SSIS ou Spark); Plus de 5ans d’expérience...Permanent employmentFull timeWork at officeWork from home
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract... ...and Migration Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads into Databricks. Develop...DatabricksContract workWork at office2 days per week
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven... ...Responsibilities: • Design and implement scalable data ELT/ETL pipelines • Build reliable data lake and warehouse...Databricks
- Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto... ...engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks....DatabricksContract work
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your... ...optimize and deliver large-scale data pipelines. This role demands over 10 years of... ...institutions. You will design ETL/ELT pipelines and collaborate with various...Databricks
- CIBC is seeking a Sr. Consultant, Data Developer to lead end-to-end data solutions for CAM, spanning ETL, ODS, and large migrations in a Azure-centric SaaS/PaaS ecosystem. You will set technical direction, own data layer design, and partner with architecture and vendors. You...DatabricksRemote work
- We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...take technical ownership of end-to-end batch and streaming pipelines, implement robust governance and security controls via Unity...Databricks
$34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from mining operation source systems across South America and load it into Databricks. The role focuses on ensuring high-quality, reliable...DatabricksContract work- Lead ETL testing at Tangerine using SQL, Python, and rigorous data validation across Data Warehouse environments. This senior role supports reliable data pipelines.As a Senior Quality Engineer, you will test ETL workflows, validate transformations, and reconcile source-to-target...
$135k - $175k per year
...and private clients worldwide. Our data engineering initiatives represent one of our most... ...Centralized Data Platform (CDP) built on Databricks. This role requires a deep, hands‑on... ...and analytics. Develop and optimize ETL/ELT pipelines. Create and manage structured...DatabricksWorldwideFlexible hours$84k - $128k per year
Senior Data Engineer (Databricks Focused)This site uses cookies to provide you with a more responsive... ...scalable, secure, and production-grade data pipelines using Azure and Databricks. The... ...Lake, and Apache Spark.* Develop scalable ETL processes for structured and unstructured...DatabricksFull timeManual laborWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Databricks Etl Pipeline Engineer. Be the first to apply!
Related searches

