Azure Cloud Data Engineer
Compunnel Inc.
The Azure Cloud Data Engineer is responsible for designing, developing, and maintaining scalable cloud-based data platforms and data pipelines within Azure environments. This role focuses on building high-performance ETL pipelines, developing Databricks and PySpark solutions, optimizing large-scale data processing, and implementing enterprise data warehouse architectures. The ideal candidate will have strong expertise in Python, SQL, Azure Databricks, cloud data engineering, and enterprise data platform modernization.
Key Responsibilities
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and loading from multiple data sources.
Build and deploy Spark applications using Azure Databricks and PySpark to process large-scale datasets.
Optimize Databricks jobs for performance, scalability, and reliability.
Monitor, troubleshoot, and resolve issues impacting data pipelines and Databricks workloads.
Design and implement enterprise data warehouse solutions and dimensional data models.
Develop solutions utilizing Delta Lake, cloud data integration, and modern data architecture principles.
Develop and maintain applications using Python and SQL.
Create and optimize complex SQL queries, stored procedures, and reverse engineer existing database processes.
Design and implement data models supporting OLTP, OLAP, dimensional modeling, facts, and dimensions.
Process structured, semi-structured, and unstructured data.
Develop event-driven and streaming data ingestion solutions.
Implement best practices for data governance, security, quality, and cloud data management.
Perform code reviews to ensure compliance with development standards and optimal execution patterns.
Support enterprise cloud data platform migrations and modernization initiatives.
Collaborate with cross-functional teams to design scalable cloud-based data architectures.
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or a related technical field.
9+ years of overall data engineering experience.
5+ years of hands-on Python development experience.
5+ years of SQL Server development experience working with large datasets.
5+ years of experience developing and deploying ETL pipelines using Databricks and PySpark.
Experience with Delta Lake, data integration, cloud architecture, and data modeling.
Experience with enterprise data warehouse design and dimensional modeling.
Experience processing structured, semi-structured, and unstructured data.
Experience with event-driven and streaming data processing technologies.Experience with cloud data warehouse platforms such as Azure Synapse, Snowflake, Amazon Redshift, or Google BigQuery.
Strong understanding of OLTP, OLAP, facts, dimensions, and enterprise data warehousing concepts.
Experience designing and implementing enterprise cloud data architectures.
Experience leading enterprise cloud data platform migration initiatives.
Experience working with banking or financial services clients.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent written and verbal communication skills.
Preferred Qualifications
Master's degree in Computer Science, Engineering, or a related technical field.
Experience with Apache Airflow.
Experience with cloud-based messaging and analytics platforms.
#J-18808-Ljbffr
Key Responsibilities
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and loading from multiple data sources.
Build and deploy Spark applications using Azure Databricks and PySpark to process large-scale datasets.
Optimize Databricks jobs for performance, scalability, and reliability.
Monitor, troubleshoot, and resolve issues impacting data pipelines and Databricks workloads.
Design and implement enterprise data warehouse solutions and dimensional data models.
Develop solutions utilizing Delta Lake, cloud data integration, and modern data architecture principles.
Develop and maintain applications using Python and SQL.
Create and optimize complex SQL queries, stored procedures, and reverse engineer existing database processes.
Design and implement data models supporting OLTP, OLAP, dimensional modeling, facts, and dimensions.
Process structured, semi-structured, and unstructured data.
Develop event-driven and streaming data ingestion solutions.
Implement best practices for data governance, security, quality, and cloud data management.
Perform code reviews to ensure compliance with development standards and optimal execution patterns.
Support enterprise cloud data platform migrations and modernization initiatives.
Collaborate with cross-functional teams to design scalable cloud-based data architectures.
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or a related technical field.
9+ years of overall data engineering experience.
5+ years of hands-on Python development experience.
5+ years of SQL Server development experience working with large datasets.
5+ years of experience developing and deploying ETL pipelines using Databricks and PySpark.
Experience with Delta Lake, data integration, cloud architecture, and data modeling.
Experience with enterprise data warehouse design and dimensional modeling.
Experience processing structured, semi-structured, and unstructured data.
Experience with event-driven and streaming data processing technologies.Experience with cloud data warehouse platforms such as Azure Synapse, Snowflake, Amazon Redshift, or Google BigQuery.
Strong understanding of OLTP, OLAP, facts, dimensions, and enterprise data warehousing concepts.
Experience designing and implementing enterprise cloud data architectures.
Experience leading enterprise cloud data platform migration initiatives.
Experience working with banking or financial services clients.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent written and verbal communication skills.
Preferred Qualifications
Master's degree in Computer Science, Engineering, or a related technical field.
Experience with Apache Airflow.
Experience with cloud-based messaging and analytics platforms.
#J-18808-Ljbffr
Vacancy posted 51 minutes ago
Similar jobs that could be interesting for youBased on the Azure Cloud Data Engineer in Winnipeg, MB vacancy
- Build secure, scalable data platforms as a Data Engineer at Aviso, working remotely or from Vancouver and Toronto offices. Use Azure, Python, and SQL.This twelve-month Data Engineer position... ...deployed on-premise and in the cloud.Key Responsibilities: Design and implement...SuggestedRemote work
- Build Snowflake and Azure data solutions at Reitmans (Canada) Limited through a hybrid Cloud Data Engineer role supporting enterprise analytics. Engineer scalable pipelines and platforms for Canadian fashion brands.As a Cloud Data Engineer, you will advance RCL’s data strategy...Suggested
- ...chance to be part of something exceptional.Job Description Azure Cloud Engineer General Job Summary The Azure Cloud Engineer provides high... ...Entra ID, Storage, SQL Databases, AppService, Key Vault, Data Factory, Virtual Machines, etc.).Implementation of security measures...SuggestedInternship
- Astra-North Infoteck Inc. is seeking a Cloud Data Platform Engineer with 6–10 years of experience to design and implement scalable data platforms on AWS and Azure. The role emphasizes serverless functions (Lambda/Azure Functions), API integrations, and containerized workloads...Suggested
- ...Position Overview: As an Azure Cloud Engineer at ECS LEAD, you will be instrumental in deploying, managing, and optimizing Azure services to empower... ...industry standards and regulations to safeguard our clients' data and operations in the cloud. Technical Leadership: Provide...SuggestedPermanent employmentFull time
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
- ...Canada Life in Toronto is seeking a Senior Data Platform Engineer focused on platform administration, operations, and support. You will lead in a cloud-based data platform environment, primarily using Azure Databricks, and collaborate with product owners, developers, QA, and...
- Manulife/John Hancock is seeking a Back-end Software Engineer in Toronto to develop scalable, secure backend solutions within Group Functions... ...initiatives. The role requires strong back-end experience with Azure, Databricks, PySpark, and CI/CD pipelines. Collaboration in an Agile...
- Technology|Analytics - Packages|Python - Big Data, Technology|Cloud Integration|Azure Data Factory (ADF)DomainDeliveryInterest GroupCompanyITL CanadaRequisition... ...is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based...Relocation
- ...Hunter Bond in Montreal, Canada seeks a Data Engineer / Database Developer to design, build, and optimize scalable cloud-based data systems in Azure. You will work across data engineering and ML workflows, developing Python-based data pipelines and supporting analytics initiatives...
- ...Operations Manager with a strong background in cloud data migration and software development. The... ...of analytics assets to Snowflake and Azure, develop frameworks, and maintain software... ...Qualifications include 5+ years in data engineering roles and expertise in Python, SQL, and cloud...Contract work
$100k - $120k per year
...Responsibilities: Experience working as a Data Engineer with focus on big data processing and/or... ....Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database... ...and developing data pipelines using Cloud Technologies based on business requirements...Long term contract- Design scalable Azure infrastructure with Terraform and troubleshoot complex cloud networks as a Cloud DevOps Engineer. Apply Kubernetes and Python across cloud environments.This Cloud... ...Snowflake, query federations, and fundamental data engineering concepts to support data...
- Role : Azure Data Engineer with Databricks ExpertiseJob Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optimize large-scale...
- ...years Job DescriptionWe are seeking an experienced L4 Engineer with stronghands-on expertise in modern data engineering, cloud platforms, and applicationdevelopment. The successful candidate will work across Azure data services,Databricks workflows, and Java/Python ‑ based...2 days per week3 days per week
- ...applications and next steps. Our partner is looking for a Senior Cloud Engineer – Azure based in Canada. We are looking for an experienced Senior... ...platform best practices. Immediate start available. Data Privacy Notice By submitting your application, you acknowledge...Long term contractFixed term contractInternshipImmediate startRemote workWorldwide
$87.84k - $131.75k per year
...Partner closely with software engineering teams to ensure stable releases... ...components running in cloud and containerized environments... ...logs, telemetry, and transaction data to identify performance bottlenecks... ...hosted in Microsoft Azure environments. Experience working...Long term contractTemporary workLocal areaShift work- Azure Cloud Migration Engineer (VMware to Azure) Position: Azure Cloud Migration Engineer (VMware to Azure)Location: 100% Remote – Ontario-based candidates preferred (Eastern Time Zone) – Toronto PreferredEmployment Type: ContractDuration: 6 months to startHours:...Remote workShift work
- ...We are seeking an Intermediate Azure DevOps Engineer to implement, automate, and support Microsoft Azure environments for our clients. This role combines hands-on cloud infrastructure work with infrastructure as code, deployment pipelines, monitoring, and security. You will...Manual labor
- Microsoft Azure cloud engineering meets Terraform automation in this hands-on role, supporting scalable, reliable, and secure infrastructure for Office Ally.The Cloud Engineer designs, implements, and manages Azure solutions across PaaS services, AKS, networking, and cloud...Work at office
- Design Azure serverless platforms with Python, TypeScript, or C# while building reusable enterprise cloud patterns. Work across engineering, security, and platform enablement.This experienced Azure Serverless Cloud Engineer designs, builds, and operationalizes APIM, Function...
- A technology services company is seeking a Cloud Architect in Ontario, Canada. The ideal candidate will have extensive experience in data engineering, specifically with Azure technologies. This hybrid role offers competitive compensation, focusing on building secure infrastructures...
- About The Role We are seeking an experienced Senior Azure Cloud Platform Engineer to join our team, focused on designing, deploying, and supporting enterprise-grade Azure data and analytics platforms, including Power BI.Toronto Min 3 days WFO Day 1 OnsiteAbout The Role...
- Snr. Integration Engineer – Interac e-Transfer Modernization Project Summary / Objective... ...integration components using .NET/C# and Azure services such as Azure Functions and API Management... ...architecture, including API contracts, data mappings, and orchestration flowsBuild...
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...
- Design Azure data architectures and optimize PySpark systems as a Senior Data Engineer with ARC’TERYX in North Vancouver or remotely.This senior position supports the Supply... ...DatabricksLead migrations from legacy systems to cloud-native platformsOptimize ETL/ELT workflows for...Remote work
$90k - $120k per year
...build a better working world. The opportunityWe are seeking an Azure Cloud Engineer to join EY Canada. In this role, you will be required to offer... ..., while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future...Weekend work- ...the bar of Canadian fashion with us.Job Description As a Cloud Data Engineer, you will play a key role in advancing RCL's data strategy by... ...solutions.Hands-on experience with Snowflake , Microsoft Azure, or Google Cloud Platform (GCP) .Strong understanding of...Full timeContract workPart timeWork at officeFlexible hours
- ...Months Role Overview We are seeking an experienced Cloud Data Engineer to design,build, optimize, and support enterprise-scale cloud... ...Medallion Architecture. Advancedexperience with Oracle databases, Azure SQL Server, and Azure DataFactory. Experiencewith cloud...
- Build scalable Java applications with Microsoft Azure, RESTful APIs, and cloud-native technologies as an Intermediate Java Engineer at Matrix.Matrix seeks an Intermediate Java... ...Kubernetes, Terraform, messaging platforms, and data integration solutions. The role includes...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Cloud Data Engineer. Be the first to apply!
Related searches
- cloud operations engineer Winnipeg, MB
- junior cloud engineer Winnipeg, MB
- cloud network engineer Winnipeg, MB
- cloud engineer Winnipeg, MB
- associate cloud engineer Winnipeg, MB
- entry level cloud engineer Winnipeg, MB
- cloud engineer remote Winnipeg, MB
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB

