Azure Data Engineer Databricks Pipelines
Softline Technology Inc.
Build Azure data pipelines with Databricks, Python, and SQL for the Government of Ontario’s Ontario Data Platform, working five days onsite. Support enterprise data solutions across government organizations through scalable engineering and reliable processing.This Data Engineer / Software Developer role focuses on designing, developing, and operating cloud data solutions. You will use Azure Data Factory, Azure Data Lake Storage, Databricks, Delta Lake, and Spark to enable analytics and reporting. The work also supports data quality, governance, integration, and platform improvement.Key Responsibilities:
Design batch and near real-time pipelines with Azure Data FactoryDevelop Databricks notebooks, workflows, and Spark processing jobsBuild ingestion, ETL/ELT, validation, and reconciliation processesManage Delta Lake tables and optimize workloadsAutomate processes through reusable frameworks and DevOps practicesRequirements:
Degree or diploma in computing or related fieldExperience with ADF, ADLS, Databricks, Delta Lake, and Lakehouse architectureStrong Python, SQL, and Spark proficiencyExperience with Azure DevOps, Git, CI/CD, and deployment automationKnowledge of governance, security, privacy, and access controlApply Azure Data Factory, Databricks, Spark, Python, and SQL expertise to Ontario Data Platform delivery onsite.
#J-18808-Ljbffr
Design batch and near real-time pipelines with Azure Data FactoryDevelop Databricks notebooks, workflows, and Spark processing jobsBuild ingestion, ETL/ELT, validation, and reconciliation processesManage Delta Lake tables and optimize workloadsAutomate processes through reusable frameworks and DevOps practicesRequirements:
Degree or diploma in computing or related fieldExperience with ADF, ADLS, Databricks, Delta Lake, and Lakehouse architectureStrong Python, SQL, and Spark proficiencyExperience with Azure DevOps, Git, CI/CD, and deployment automationKnowledge of governance, security, privacy, and access controlApply Azure Data Factory, Databricks, Spark, Python, and SQL expertise to Ontario Data Platform delivery onsite.
#J-18808-Ljbffr
Vacancy posted 49 minutes ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer Databricks Pipelines in Winnipeg, MB vacancy
- The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will...PipelineDatabricks
- ...HRbrain Inc. is seeking a Data Science Developer to deliver and sustain analytics pipelines, models, and data products. The role focuses on building scalable storage, automating pipelines, and crafting dashboards for insights. Responsibilities include knowledge transfer...PipelineDatabricksWork at office
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...PipelineDatabricks
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...PipelineDatabricks
- BDO Canada is seeking an experienced Senior Data Engineer (Databricks focused) to lead data engineering initiatives within the Digital/Technology... .... You will design, implement, and optimize scalable data pipelines on Databricks and Azure, ensuring quality, security, and production...PipelineDatabricks
- Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze...PipelineDatabricksRemote work
- Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements...PipelineDatabricks
- BDO Digital is seeking an experienced Senior Data Engineer (Databricks focused) to join our Technology Advisory Services practice in Canada. This... ...hands-on data engineering to deliver scalable, secure data pipelines on Azure and Databricks. You will lead client engagements...PipelineDatabricks
- ...and operate classic, generative and agentic AI solutions on Azure and Databricks for a major public energy player in Quebec. Montreal-based with... ...; deliverables in French. You will implement MLflow pipelines, model registries and deployment, and lead CI/CD, IaC, and security...PipelineDatabricks
- BDO Canada is seeking an experienced Senior Data Engineer focused on Databricks to lead the design and delivery of scalable data pipelines. The role blends technical leadership with hands-on data engineering across Azure Databricks, Delta Lake, and Spark, while guiding client...PipelineDatabricks
- ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with... ...best practices, and contribute hands-on with SQL, Python, and Azure-based technologies to build scalable, reliable data solutions supporting...Pipeline
- Technology|Analytics - Packages|Python - Big Data, Technology|Cloud Integration|Azure Data Factory (ADF)DomainDeliveryInterest GroupCompanyITL CanadaRequisition... ...is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based...PipelineDatabricksRelocation
- ...Compunnel, Inc. is seeking an Azure Cloud Data Engineer responsible for designing and maintaining scalable cloud-based data platforms. Your role includes developing high-performance ETL pipelines and optimizing large-scale data processing solutions within Azure environments...PipelineDatabricks
- Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust...PipelineDatabricksContract work
- A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,...PipelineFull time
- ...de BDO Digital, recherche un ingénieur(e) principal(e) de données spécialisé Databricks. Vous dirigerez des mandats clients et concevrez des pipelines de données évolutifs et sécurisés sur Azure et Databricks, en assurant l’alignement avec les objectifs d’affaires. Vous piloterez...PipelineDatabricks
- ...Hunter Bond in Montreal, Canada seeks a Data Engineer / Database Developer to design, build, and... ...scalable cloud-based data systems in Azure. You will work across data engineering and... ...workflows, developing Python-based data pipelines and supporting analytics initiatives....Pipeline
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in... ...This Engineer will focus on building data pipelines, ingesting and transforming data from multiple...PipelineDatabricksHourly payContract workManual labor
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract... ...Engineering and Migration Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads into Databricks....PipelineDatabricksContract workWork at office2 days per week
- Build production-grade data pipelines with Databricks and Azure at BDO Digital, using a blended office, client-site, and virtual model.As a Senior Data Engineer in Technology Advisory Services, you will lead hands-on engineering and client engagements. Apply Databricks, Delta...PipelineDatabricksWork at office
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within...PipelineDatabricks
- Lead Databricks and Azure data engineering at BDO Digital through a blended work model spanning offices, client sites, and virtual settings.As a Senior Data Engineer in Technology Advisory Services, you will build production-grade pipelines and lead client engagements. Your...PipelineDatabricks
- Lead Databricks data engineering at BDO with Azure and Apache Spark expertise. Work across offices, client sites, and virtually in a blended model.BDO Digital seeks an experienced Senior Data Engineer for its Technology Advisory Services practice. You will deliver scalable,...PipelineDatabricks
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...platform engineering role rather than a traditional data pipeline development position. The candidate will be responsible for...PipelineDatabricksContract workRemote work
$100k - $120k per year
...Responsibilities: Experience working as a Data Engineer with focus on big data processing and/or... ....Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database... ...and DevOpsExperienced in creating data pipelines & developing complex and optimized...PipelineDatabricksLong term contract- ...solutions company in Canada is seeking an experienced Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have strong expertise... ...implementing CI/CD pipelines, integrating data using APIs, and leading data engineering initiatives...PipelineDatabricks
- Role : Azure Data Engineer with Databricks ExpertiseJob Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optimize large-scale...PipelineDatabricks
- Lead Databricks data engineering at BDO with Azure and Apache Spark expertise in a blended office, client-site, and virtual model.BDO Digital seeks an experienced Senior Data Engineer for its Technology Advisory Services practice. You will build production-grade pipelines with...PipelineDatabricksWork at office
- Lead Azure Databricks platform engineering at Canada Life in a hybrid Toronto or London role, using cloud administration and operational support expertise.As a Senior Data Platform Engineer, you will design, adapt, and maintain cloud solutions supporting Canada Life business...Databricks
- Build scalable data pipelines and lakehouse systems at Spade Technologies, Inc., with Manitoba... ...locations considered. Work full time.As a Data Engineer reporting to the CTO, you will own... ...data engineering experienceExpertise with Databricks, Airflow, dbt, Spark, or...PipelineDatabricksFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer Databricks Pipelines. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

