Azure Cloud Data Engineer
Compunnel Inc.
The Azure Cloud Data Engineer is responsible for designing, developing, and maintaining scalable cloud-based data platforms and data pipelines within Azure environments. This role focuses on building high-performance ETL pipelines, developing Databricks and PySpark solutions, optimizing large-scale data processing, and implementing enterprise data warehouse architectures. The ideal candidate will have strong expertise in Python, SQL, Azure Databricks, cloud data engineering, and enterprise data platform modernization.
Key Responsibilities
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and loading from multiple data sources.
Build and deploy Spark applications using Azure Databricks and PySpark to process large-scale datasets.
Optimize Databricks jobs for performance, scalability, and reliability.
Monitor, troubleshoot, and resolve issues impacting data pipelines and Databricks workloads.
Design and implement enterprise data warehouse solutions and dimensional data models.
Develop solutions utilizing Delta Lake, cloud data integration, and modern data architecture principles.
Develop and maintain applications using Python and SQL.
Create and optimize complex SQL queries, stored procedures, and reverse engineer existing database processes.
Design and implement data models supporting OLTP, OLAP, dimensional modeling, facts, and dimensions.
Process structured, semi-structured, and unstructured data.
Develop event-driven and streaming data ingestion solutions.
Implement best practices for data governance, security, quality, and cloud data management.
Perform code reviews to ensure compliance with development standards and optimal execution patterns.
Support enterprise cloud data platform migrations and modernization initiatives.
Collaborate with cross-functional teams to design scalable cloud-based data architectures.
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or a related technical field.
9+ years of overall data engineering experience.
5+ years of hands-on Python development experience.
5+ years of SQL Server development experience working with large datasets.
5+ years of experience developing and deploying ETL pipelines using Databricks and PySpark.
Experience with Delta Lake, data integration, cloud architecture, and data modeling.
Experience with enterprise data warehouse design and dimensional modeling.
Experience processing structured, semi-structured, and unstructured data.
Experience with event-driven and streaming data processing technologies.Experience with cloud data warehouse platforms such as Azure Synapse, Snowflake, Amazon Redshift, or Google BigQuery.
Strong understanding of OLTP, OLAP, facts, dimensions, and enterprise data warehousing concepts.
Experience designing and implementing enterprise cloud data architectures.
Experience leading enterprise cloud data platform migration initiatives.
Experience working with banking or financial services clients.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent written and verbal communication skills.
Preferred Qualifications
Master's degree in Computer Science, Engineering, or a related technical field.
Experience with Apache Airflow.
Experience with cloud-based messaging and analytics platforms.
#J-18808-Ljbffr
Key Responsibilities
Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and loading from multiple data sources.
Build and deploy Spark applications using Azure Databricks and PySpark to process large-scale datasets.
Optimize Databricks jobs for performance, scalability, and reliability.
Monitor, troubleshoot, and resolve issues impacting data pipelines and Databricks workloads.
Design and implement enterprise data warehouse solutions and dimensional data models.
Develop solutions utilizing Delta Lake, cloud data integration, and modern data architecture principles.
Develop and maintain applications using Python and SQL.
Create and optimize complex SQL queries, stored procedures, and reverse engineer existing database processes.
Design and implement data models supporting OLTP, OLAP, dimensional modeling, facts, and dimensions.
Process structured, semi-structured, and unstructured data.
Develop event-driven and streaming data ingestion solutions.
Implement best practices for data governance, security, quality, and cloud data management.
Perform code reviews to ensure compliance with development standards and optimal execution patterns.
Support enterprise cloud data platform migrations and modernization initiatives.
Collaborate with cross-functional teams to design scalable cloud-based data architectures.
Required Qualifications
Bachelor's degree in Computer Science, Engineering, or a related technical field.
9+ years of overall data engineering experience.
5+ years of hands-on Python development experience.
5+ years of SQL Server development experience working with large datasets.
5+ years of experience developing and deploying ETL pipelines using Databricks and PySpark.
Experience with Delta Lake, data integration, cloud architecture, and data modeling.
Experience with enterprise data warehouse design and dimensional modeling.
Experience processing structured, semi-structured, and unstructured data.
Experience with event-driven and streaming data processing technologies.Experience with cloud data warehouse platforms such as Azure Synapse, Snowflake, Amazon Redshift, or Google BigQuery.
Strong understanding of OLTP, OLAP, facts, dimensions, and enterprise data warehousing concepts.
Experience designing and implementing enterprise cloud data architectures.
Experience leading enterprise cloud data platform migration initiatives.
Experience working with banking or financial services clients.
Strong analytical, troubleshooting, and problem-solving skills.
Excellent written and verbal communication skills.
Preferred Qualifications
Master's degree in Computer Science, Engineering, or a related technical field.
Experience with Apache Airflow.
Experience with cloud-based messaging and analytics platforms.
#J-18808-Ljbffr
L'offre d'emploi a été publiée il y a 56 minutes
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Azure Cloud Data Engineer à Winnipeg, MB
- Build secure, scalable data platforms as a Data Engineer at Aviso, working remotely or from Vancouver and Toronto offices. Use Azure, Python, and SQL.This twelve-month Data Engineer position... ...deployed on-premise and in the cloud.Key Responsibilities: Design and implement...SuggéréTravail à distance
- Build Snowflake and Azure data solutions at Reitmans (Canada) Limited through a hybrid Cloud Data Engineer role supporting enterprise analytics. Engineer scalable pipelines and platforms for Canadian fashion brands.As a Cloud Data Engineer, you will advance RCL’s data strategy...Suggéré
- ...Pathlion is seeking a skilled Data Engineer to join our cloud data platform team in Fredericton, NB. You will analyze requirements, design and implement lakehouse solutions and automated pipelines using Azure and Databricks. You will collaborate with IT and business partners...Suggéré
- ...Position Overview: As an Azure Cloud Engineer at ECS LEAD, you will be instrumental in deploying, managing, and optimizing Azure services to empower... ...industry standards and regulations to safeguard our clients' data and operations in the cloud. Technical Leadership: Provide...SuggéréEmploi permanentTemps plein
- Astra-North Infoteck Inc. is seeking a Cloud Data Platform Engineer with 6–10 years of experience to design and implement scalable data platforms on AWS and Azure. The role emphasizes serverless functions (Lambda/Azure Functions), API integrations, and containerized workloads...Suggéré
- A data solutions company in Toronto is seeking a Senior DataOps/Cloud Data Engineer. The candidate will be responsible for designing and optimizing CI/CD pipelines, managing databases in Azure, and ensuring effective data management and provisioning. Required skills include...
- Technology|Analytics - Packages|Python - Big Data, Technology|Cloud Integration|Azure Data Factory (ADF)DomainDeliveryInterest GroupCompanyITL CanadaRequisition... ...is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize scalable cloud-based...Relocation
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
- ...Operations Manager with a strong background in cloud data migration and software development. The... ...of analytics assets to Snowflake and Azure, develop frameworks, and maintain software... ...Qualifications include 5+ years in data engineering roles and expertise in Python, SQL, and cloud...Сontrat
- ...chance to be part of something exceptional.Job Description Azure Cloud Engineer General Job Summary The Azure Cloud Engineer provides high... ...Entra ID, Storage, SQL Databases, AppService, Key Vault, Data Factory, Virtual Machines, etc.).Implementation of security measures...Stage
$100k - $120k par année
...Responsibilities: Experience working as a Data Engineer with focus on big data processing and/or... ....Experience working with Microsoft Azure Data Platform, specifically Azure SQL Database... ...and developing data pipelines using Cloud Technologies based on business requirements...Contrat Longue Durée- ...years Job DescriptionWe are seeking an experienced L4 Engineer with strong hands‑on expertise in modern data engineering, cloud platforms, and application development. The successful candidate will work across Azure data services, Databricks workflows, and Java/Python‑...2 jours par semaine3 jours par semaine
- ...Hunter Bond in Montreal, Canada seeks a Data Engineer / Database Developer to design, build, and optimize scalable cloud-based data systems in Azure. You will work across data engineering and ML workflows, developing Python-based data pipelines and supporting analytics initiatives...
- Manulife/John Hancock is seeking a Back-end Software Engineer in Toronto to develop scalable, secure backend solutions within Group Functions... ...initiatives. The role requires strong back-end experience with Azure, Databricks, PySpark, and CI/CD pipelines. Collaboration in an Agile...
- ...applications and next steps. Our partner is looking for a Senior Cloud Engineer – Azure based in Canada. We are looking for an experienced Senior... ...platform best practices. Immediate start available. Data Privacy Notice By submitting your application, you acknowledge...Contrat Longue DuréeEmploi en cddStageRecrutement immédiatTravail à distanceLe monde entier
- Role : Azure Data Engineer with Databricks ExpertiseJob Summary: We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optimize large-scale...
$87.84k - $131.75k par année
...Partner closely with software engineering teams to ensure stable releases... ...components running in cloud and containerized environments... ...logs, telemetry, and transaction data to identify performance bottlenecks... ...hosted in Microsoft Azure environments.Experience working...Contrat Longue DuréeTravail temporaireZone localeTravail posté- Design Azure serverless platforms with Python, TypeScript, or C# while building reusable enterprise cloud patterns. Work across engineering, security, and platform enablement.This experienced Azure Serverless Cloud Engineer designs, builds, and operationalizes APIM, Function...
- Design scalable Azure infrastructure with Terraform and troubleshoot complex cloud networks as a Cloud DevOps Engineer. Apply Kubernetes and Python across cloud environments.This Cloud... ...Snowflake, query federations, and fundamental data engineering concepts to support data...
- Microsoft Azure cloud engineering meets Terraform automation in this hands-on role, supporting scalable, reliable, and secure infrastructure for Office Ally.The Cloud Engineer designs, implements, and manages Azure solutions across PaaS services, AKS, networking, and cloud...Travail au bureau
- Azure Cloud Migration Engineer (VMware to Azure) Position: Azure Cloud Migration Engineer (VMware to Azure)Location: 100% Remote – Ontario-based candidates preferred (Eastern Time Zone) – Toronto PreferredEmployment Type: ContractDuration: 6 months to startHours:...Travail à distanceTravail posté
- A technology services company is seeking a Cloud Architect in Ontario, Canada. The ideal candidate will have extensive experience in data engineering, specifically with Azure technologies. This hybrid role offers competitive compensation, focusing on building secure infrastructures...
- Design Azure data architectures and optimize PySpark systems as a Senior Data Engineer with ARC’TERYX in North Vancouver or remotely.This senior position supports the Supply... ...DatabricksLead migrations from legacy systems to cloud-native platformsOptimize ETL/ELT workflows for...Travail à distance
$92.19k - $171.21k par année
We are seeking a Senior Data Engineer - Azure to our team who will be able to bring their unique ideas, viewpoints, and technical experience.The... ...Deliver modernization of enterprise data solutions using Azure cloud data technologies, designing and building modern data...StageZone localeHoraires flexibles- About The Role We are seeking an experienced Senior Azure Cloud Platform Engineer to join our team, focused on designing, deploying, and supporting enterprise-grade Azure data and analytics platforms, including Power BI.Toronto Min 3 days WFO Day 1 OnsiteAbout The Role...
$140.6k - $190.6k par année
About the role You'll own the Azure platform that Thomson Reuters product engineering teams build on: the infrastructure... ...multiple global regions, which means data residency, regional compliance... ...in Key Vault, drive Defender for Cloud and Defender for Containers findings...Travail au bureauZone localeHoraires flexibles- Lead Azure data engineering in Toronto with Python expertise and AI automation skills at JLL’s on-site technology team. Shape enterprise-scale solutions... ...for enterprise-scale data processingArchitect Azure, AI, and cloud data solutionsLead root cause analysis and technical...
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance...
- ...We are seeking an Intermediate Azure DevOps Engineer to implement, automate, and support Microsoft Azure environments for our clients. This role combines hands-on cloud infrastructure work with infrastructure as code, deployment pipelines, monitoring, and security. You will...Travail manuel
- ...Months Role Overview We are seeking an experienced Cloud Data Engineer to design,build, optimize, and support enterprise-scale cloud... ...Medallion Architecture. Advancedexperience with Oracle databases, Azure SQL Server, and Azure DataFactory. Experiencewith cloud...
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à Azure Cloud Data Engineer. Soyez parmi les premiers à postuler !
Recherches connexes
- associate cloud engineer Winnipeg, MB
- cloud operations engineer Winnipeg, MB
- cloud engineer Winnipeg, MB
- entry level cloud engineer Winnipeg, MB
- cloud engineer remote Winnipeg, MB
- cloud network engineer Winnipeg, MB
- junior cloud engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB

