Azure Data Engineer (ADF, Databricks, Spark SQL)
Temporary
Astra North Infoteck Inc.
Scope of Work:
Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable data delivery.
Works on monitoring, troubleshooting, and resolving pipeline and cluster issues, and collaborates with DevOps teams using Azure DevOps, Git, CI/CD, and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.
Required Skills
Strong knowledge of Azure services:
Azure Data Factory (ADF)
Azure Databricks
Azure SQL
Spark SQL
Understanding of:
ETL / ELT concepts
Data ingestion patterns
Data warehousing
Experience in:
Troubleshooting pipeline failures
Cluster issues
Performance bottlenecks
Familiarity with:
Azure DevOps
Git version control
CI/CD pipelines
Knowledge of monitoring tools:
Azure Monitor
Log Analytics
Databricks logs
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer (ADF, Databricks, Spark SQL) in Toronto, ON vacancy
- ...Job Description Role: Sr. Data Engineer Work Model: Hybrid – 2 days onsite (9:00... ...Role Summary: Senior Data Engineer (Databricks-Focused) In-Person Interview is Mandatory... ...and streaming pipelines using Apache Spark (PySpark/Scala). Own end-to-end data...DatabricksSqlContract work
- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...DatabricksSqlContract work2 days per week
$86k - $125k per year
...solvers who thrive on complex data challenges. Guided by our values... ...a passionate and curious Data Engineer with strong DBT and Python skills... ...warehouses (e.g., Snowflake, Azure Synapse, Redshift). ~ Participate... ...tools). ~ Strong SQL skills and ability to work with...DatabricksSqlFull timeWork at office- ...Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure Job Description Location: Toronto Work Model: Onsite (4 days/week) Key Requirements • 12–18 years of overall Data Engineering experience. • 8+...DatabricksSqlPermanent employment
- ...This is a full-time, high-impact position for a Senior Data Engineer with expertise in Databricks , dbt , and Apache Airflow to support a critical CRM... ...programming proficiency in Python / PySpark and Advanced SQL (complex joins, analytical window functions). ~ Hands...DatabricksSqlFull timeContract workRemote workWorldwideFlexible hoursShift work
$58k - $102k per year
...Consultant – Microsoft Fabric / Databricks Solutions, you will support... ...design and delivery of modern data platform solutions for our clients... ..., data governance, AI/ML, engineering) to ensure integrated solution... ...technologies • Experience with SQL, PySpark, and data modeling...DatabricksSqlPermanent employmentFlexible hours$80k - $130k per year
Azure Application Developer (SQL) Position Description We are looking for an experienced Azure Application... ...-based application development and data solutions. The ideal candidate will have... ...Create and manage Azure Data Factory (ADF) pipelines and data workflows -...SqlWork at office2 days per week$95k - $145k per year
Azure Data Engineering Specialist Position Description CGI is looking for a skilled and collaborative Azure Data Engineering Specialist to... ...and implement ETL/ELT workflows using Azure Data Factory, Databricks, ADLS, Synapse, and Azure SQL. • Build batch and streaming...DatabricksSql- ...AWS Data Engineer – ETL, Python & SQL Toronto, ON Hybrid (2 days per week in-person at Toronto office preferred) Skills: Digital : Amazon Web Service (AWS) Cloud Computing~ Digital : Python for Data Science Digital : Google Data Engineering...SqlContract workWork at officeShift work2 days per week
- ...Job Title: Senior Big Data Developer – Snowflake, Spark & AWS Location: Toronto Work Model:... ...Big Data Developer to join the Data Engineering team. You will design, build, and optimize... ...and data modeling. • Strong SQL expertise and database design knowledge...SqlContract work
$90k - $125k per year
...people who are lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing, building, and maintaining... ...and pipelines. Your deep knowledge of data platforms such as Azure Fabric, Databricks, and Snowflake will be essential as you collaborate closely...DatabricksSqlFull timeWork from homeFlexible hours$84k - $175k per year
...to-end design and implementation of Microsoft Fabric-based data platforms (Lakehouse, Warehouse, OneLake). • Architect... ..., transformation, and integration pipelines using Fabric, Azure Data Factory, Spark, and SQL. • Drive data modeling and optimization across Bronze/Silver...DatabricksSqlPermanent employmentFlexible hours- ...Role: Azure AI & Data Platform Engineer Key Skills: Azure virtual functions, OpenAI, Logic Apps, Azure DevOps, TFCDK Total Experience: 6–8 Years... ...# Design globally distributed Azure Cosmos DB solutions (SQL API, MongoDB API). # Configure Cosmos DB multi-regional replication...SqlContract work
- ...Required Skills & Experience · Strong knowledge of SQL and database concepts with hands-on data validation experience. · Good understanding of testing principles, SDLC, and STLC. · Able to independently manage end-to-end testing activities. · Work closely with...Sql
$84k - $175k per year
...agents, copilots, orchestration) o Azure OpenAI and Azure AI services • Design... ...solutions including: o Prompt engineering o Retrieval-Augmented Generation (... ...and deployment o Integration with data platforms (Fabric, Databricks, ADLS) • Define patterns for: o Model...DatabricksPermanent employmentFlexible hours$55 - $60 per hour
...Job Responsibility: Job Title: Sr Big Data Developer With Java And Spark Location: Toronto, ON Duration:... ...in one of the cloud providers AWS/Azure and migrating large scale complex projects... ...data pipelines on AWS/Azure and/or Databricks Knowledge in Market Risk/Capital...DatabricksHourly payLong term contractFixed term contractMonday to fridayShift workDay shift- ...Website We need candidates with Data Bricks in AWS cloud only with... ...skills in Pyspark, SQL, etc, for both Sr Data Bricks and... ...requirements. Role: Senior Databricks developer Location: Canada (... ...experience in Data bricks, AWS, Py spark, SQL ~ Proficiency in programming...DatabricksSqlContract work
- ...We are looking for a mid-level DevOps Engineer who can design, implement, and maintain azure cloud solutions using Terraform and Azure... ...resources such as Defender for Cloud, Azure SQL, ADLS, Azure Backup, Azure Storage, Azure Data Factory, Azure Databricks, Azure Functions...DatabricksSqlFull timeRemote workWorldwide
- ...Job Responsibility: Azure Developer Toronto, ON Hybrid Long Term contract :... ...minimum of 5 years experience with large SQL data marts. Expert relational database experience... ...frameworks like Azure Data Factory or Synapse or Databricks; establishing the cloud connectivity...DatabricksSqlLong term contractFixed term contractFlexible hours
- ...Job Title: Data Analyst – SQL Server & Data Modeling Location: Toronto, ON Work Model: Hybrid (4 Days WFO) Skills: Digital: NoSQL, Microsoft SQL Server 2019 Experience Required: 8–10 Years Role Description • Strong SQL experience in relational...SqlPermanent employment
- ...ShyftLabs, we live and breathe data. Since 2020, we’ve been... ...ShyftLabs is seeking a skilled Data Engineer to support in designing, developing... ...big data solutions using the Databricks Unified Analytics Platform.... ...strong expertise in Apache Spark, SQL, Python, and cloud platforms...DatabricksSqlFull time
- ...Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description # JavaScript/NodeJS developers with AWS and Azure cloud services in-depth knowledge. Key role is development and automation. # Involve developing serverless functions...Contract work
$110k - $160k per year
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data... ...participants: Data and Technical Architects, engineering teams, product manager, project... ...Data Modelling skills Databricks - Required Azure Cloud Data Engineering Ideally...DatabricksLong term contractWeekend work$57.46 - $67.04 per hour
We are seeking a highly accomplished and technical Senior Data Engineer for an enterprise-level contract opportunity based in Toronto... ...control across cutting-edge cloud architectures including Azure Synapse, Databricks, and Azure Data Factory. Lakehouse Architecture...DatabricksSqlLong term contractContract workWork at office2 days per week$85k - $135k per year
...integration platform that connects data, systems, and workflows across... ...seeking a highly skilled Data Engineer II to design, build, and scale... ...and infrastructure including Spark, Snowflake, Kafka, Airflow, and... ...Java. ~ Advanced proficiency in SQL and data modeling concepts. ~...SqlFull time$96k - $125k per year
...focused problem solvers who thrive on complex data challenges. Guided by our values of Care,... ...drive business solutions. ~ Feature engineering, selection and optimization models with ML... ...Scientist ~ Proficiency in Python and SQL, with experience in data wrangling,...DatabricksSqlFull time$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...scalable AI/ML capabilities using Databricks and other state-of-the-art tools across... ...production environments like Databricks and Azure Kubernetes Service (AKS). Optimize...DatabricksFull timeWorldwide$84k - $175k per year
...typical day look like? • Architect end to end data platforms on Azure and align designs to business outcomes. •... ..., and access controls. • Integrate Azure Databricks and / or MS Fabric to enhance batch/stream processing, Spark based transformations, and Delta Lake...DatabricksSqlPermanent employmentFlexible hours- ...Azure Infrastructure Engineer (6–8 Years Experience) Experience Required 6–8 Years Primary Skill ~ Microsoft Azure (Digital) Role... ...Environments (ILB ASE) Azure Kubernetes Service (AKS) Azure SQL Azure Key Vault Azure Storage Accounts Networking...SqlContract work
$57.46 - $67.04 per hour
...are seeking a highly specialized Senior Data Engineer for a high-impact, 35-month assignment in... ...analytics-ready datasets using the latest Azure cloud technologies to support complex business... ...high-performance Azure Data Factory (ADF) and SSIS packages to integrate data from...DatabricksSqlLong term contractContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer (ADF, Databricks, Spark SQL). Be the first to apply!
Related searches
- azure cloud architect Toronto, ON
- data centre engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON
- data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data cabling engineer Toronto, ON