Azure Data Engineer (ADF, Databricks, Spark SQL)
Temporary
Astra North Infoteck Inc.
Scope of Work:
Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable data delivery.
Works on monitoring, troubleshooting, and resolving pipeline and cluster issues, and collaborates with DevOps teams using Azure DevOps, Git, CI/CD, and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.
Required Skills
Strong knowledge of Azure services:
Azure Data Factory (ADF)
Azure Databricks
Azure SQL
Spark SQL
Understanding of:
ETL / ELT concepts
Data ingestion patterns
Data warehousing
Experience in:
Troubleshooting pipeline failures
Cluster issues
Performance bottlenecks
Familiarity with:
Azure DevOps
Git version control
CI/CD pipelines
Knowledge of monitoring tools:
Azure Monitor
Log Analytics
Databricks logs
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer (ADF, Databricks, Spark SQL) in Toronto, ON vacancy
- ...Job Description Role: Sr. Data Engineer Work Model: Hybrid 2 days onsite (9:00 AM... ...Role Summary: Senior Data Engineer (Databricks-Focused) In-Person Interview is Mandatory... ...and streaming pipelines using Apache Spark (PySpark/Scala). Own end-to-end data...DatabricksSqlFull time
- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...DatabricksSqlContract work2 days per week
$86k - $125k per year
...solvers who thrive on complex data challenges. Guided by our values... ...a passionate and curious Data Engineer with strong DBT and Python skills... ...warehouses (e.g., Snowflake, Azure Synapse, Redshift). ~ Participate... ...tools). ~ Strong SQL skills and ability to work with...DatabricksSqlFull timeWork at office- ...Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure Job Description Location: Toronto Work Model: Onsite (4 days/week) Key Requirements • 12–18 years of overall Data Engineering experience. • 8+...DatabricksSqlPermanent employment
$58k - $102k per year
...Consultant – Microsoft Fabric / Databricks Solutions, you will support... ...design and delivery of modern data platform solutions for our clients... ..., data governance, AI/ML, engineering) to ensure integrated solution... ...technologies • Experience with SQL, PySpark, and data modeling...DatabricksSqlPermanent employmentFlexible hours- ...This is a full-time, high-impact position for a Senior Data Engineer with expertise in Databricks , dbt , and Apache Airflow to support a critical CRM... ...programming proficiency in Python / PySpark and Advanced SQL (complex joins, analytical window functions). ~ Hands...DatabricksSqlFull timeContract workRemote workWorldwideFlexible hoursShift work
$80k - $130k per year
Azure Application Developer (SQL) Position Description We are looking for an experienced Azure Application... ...-based application development and data solutions. The ideal candidate will have... ...Create and manage Azure Data Factory (ADF) pipelines and data workflows -...SqlWork at office2 days per week$95k - $145k per year
Azure Data Engineering Specialist Position Description CGI is looking for a skilled and collaborative Azure Data Engineering Specialist to... ...and implement ETL/ELT workflows using Azure Data Factory, Databricks, ADLS, Synapse, and Azure SQL. • Build batch and streaming...DatabricksSql- ...AWS Data Engineer – ETL, Python & SQL Toronto, ON Hybrid (2 days per week in-person at Toronto office preferred) Skills: Digital : Amazon Web Service (AWS) Cloud Computing~ Digital : Python for Data Science Digital : Google Data Engineering...SqlContract workWork at officeShift work2 days per week
- ...Job Title: Senior Big Data Developer – Snowflake, Spark & AWS Location: Toronto Work Model:... ...Big Data Developer to join the Data Engineering team. You will design, build, and optimize... ...and data modeling. • Strong SQL expertise and database design knowledge...SqlContract work
$84k - $175k per year
...agents, copilots, orchestration) o Azure OpenAI and Azure AI services • Design... ...solutions including: o Prompt engineering o Retrieval-Augmented Generation (... ...and deployment o Integration with data platforms (Fabric, Databricks, ADLS) • Define patterns for: o Model...DatabricksPermanent employmentFlexible hours- ...Role: Azure AI & Data Platform Engineer Key Skills: Azure virtual functions, OpenAI, Logic Apps, Azure DevOps, TFCDK Total Experience: 6–8 Years... ...# Design globally distributed Azure Cosmos DB solutions (SQL API, MongoDB API). # Configure Cosmos DB multi-regional replication...SqlContract work
- ...Required Skills & Experience · Strong knowledge of SQL and database concepts with hands-on data validation experience. · Good understanding of testing principles, SDLC, and STLC. · Able to independently manage end-to-end testing activities. · Work closely with...Sql
$84k - $175k per year
...to-end design and implementation of Microsoft Fabric-based data platforms (Lakehouse, Warehouse, OneLake). • Architect... ..., transformation, and integration pipelines using Fabric, Azure Data Factory, Spark, and SQL. • Drive data modeling and optimization across Bronze/Silver...DatabricksSqlPermanent employmentFlexible hours- ...Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description # JavaScript/NodeJS developers with AWS and Azure cloud services in-depth knowledge. Key role is development and automation. # Involve developing serverless functions...Contract work
$89.5k - $204.1k per year
...Responsibility: We are: Accenture Data & AI, the people who love using... ...AI can do almost anythingspark digital metamorphoses, widen the... ...Data & Analytics solutions on Azure/ AWS, with expertise in Azure/... ...services, ADLS, Synapse, Azure SQL, Databricks, ADF, Azure DevOps...DatabricksSqlFull timeWork at officeLocal areaWork from home- ...Job Title: Data Analyst – SQL Server & Data Modeling Location: Toronto, ON Work Model: Hybrid (4 Days WFO) Skills: Digital: NoSQL, Microsoft SQL Server 2019 Experience Required: 8–10 Years Role Description • Strong SQL experience in relational...SqlPermanent employment
$96k - $125k per year
...focused problem solvers who thrive on complex data challenges. Guided by our values of Care,... ...drive business solutions. ~ Feature engineering, selection and optimization models with ML... ...Scientist ~ Proficiency in Python and SQL, with experience in data wrangling,...DatabricksSqlFull time$57.46 - $67.04 per hour
We are seeking a highly accomplished and technical Senior Data Engineer for an enterprise-level contract opportunity based in Toronto... ...control across cutting-edge cloud architectures including Azure Synapse, Databricks, and Azure Data Factory. Lakehouse Architecture...DatabricksSqlLong term contractContract workWork at office2 days per week$85k - $135k per year
...integration platform that connects data, systems, and workflows across... ...seeking a highly skilled Data Engineer II to design, build, and scale... ...and infrastructure including Spark, Snowflake, Kafka, Airflow, and... ...Java. ~ Advanced proficiency in SQL and data modeling concepts. ~...SqlFull time- ...ShyftLabs, we live and breathe data. Since 2020, we’ve been... ...ShyftLabs is seeking a skilled Data Engineer to support in designing, developing... ...big data solutions using the Databricks Unified Analytics Platform.... ...strong expertise in Apache Spark, SQL, Python, and cloud platforms...DatabricksSqlFull time
$110k - $160k per year
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data... ...participants: Data and Technical Architects, engineering teams, product manager, project... ...Data Modelling skills Databricks - Required Azure Cloud Data Engineering Ideally...DatabricksLong term contractWeekend work$84k - $175k per year
...typical day look like? • Architect end to end data platforms on Azure and align designs to business outcomes. •... ..., and access controls. • Integrate Azure Databricks and / or MS Fabric to enhance batch/stream processing, Spark based transformations, and Delta Lake...DatabricksSqlPermanent employmentFlexible hours$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...scalable AI/ML capabilities using Databricks and other state-of-the-art tools across... ...production environments like Databricks and Azure Kubernetes Service (AKS). Optimize...DatabricksFull timeWorldwide- ...Azure Infrastructure Engineer (6–8 Years Experience) Experience Required 6–8 Years Primary Skill ~ Microsoft Azure (Digital) Role... ...Environments (ILB ASE) Azure Kubernetes Service (AKS) Azure SQL Azure Key Vault Azure Storage Accounts Networking...SqlContract work
- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI... ...with AI. Type: Remote Full-time Senior Data Engineer Are you an experienced Data... ...modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking for a...DatabricksSqlFull timeContract workLocal areaRemote work
- ...Drive cloud transformation for Canada's #1 retail brand through hands-on DevOps engineering and infrastructure automation. Join our Cloud Operations & Automation team to build enterprise-grade Azure and GCP platforms while delivering innovative solutions. At EPAM, you'll...
$118k - $152k per year
...Help shape modern data platforms and analytics solutions that enable... ...needs with innovative data engineering, delivering scalable solutions... ...analytics solutions using modern Azure data technologies. You'll collaborate... ...analysis skills. Advanced SQL expertise with hands-on...DatabricksSqlInternshipImmediate start- ...measure ourselves by customer outcomes. Our engineering team operates with high autonomy and... ...do the same. The Role We're hiring a Data Engineer to build and maintain the data products... ...and tasks, and resource monitors. SQL: Strong fundamentals, comfortable with CTEs...SqlFull timeImmediate startRemote workFlexible hours
- ...Data Modeler - SQL, ETL & DWH Location: Toronto Office Work Model: Hybrid – 2 days per week in office Experience Required: 6-8 Years Skills: • Data Concepts & Data Modelling • Data Warehouse • MySQL MUST HAVE...SqlContract workWork at office2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer (ADF, Databricks, Spark SQL). Be the first to apply!
Related searches
- azure cloud architect Toronto, ON
- data centre engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON
- data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data cabling engineer Toronto, ON