Azure Data Engineer (ADF, Databricks, Spark SQL)
Temporary
Astra North Infoteck Inc.
Scope of Work:
Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable data delivery.
Works on monitoring, troubleshooting, and resolving pipeline and cluster issues, and collaborates with DevOps teams using Azure DevOps, Git, CI/CD, and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.
Required Skills
Strong knowledge of Azure services:
Azure Data Factory (ADF)
Azure Databricks
Azure SQL
Spark SQL
Understanding of:
ETL / ELT concepts
Data ingestion patterns
Data warehousing
Experience in:
Troubleshooting pipeline failures
Cluster issues
Performance bottlenecks
Familiarity with:
Azure DevOps
Git version control
CI/CD pipelines
Knowledge of monitoring tools:
Azure Monitor
Log Analytics
Databricks logs
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer (ADF, Databricks, Spark SQL) in Toronto, ON vacancy
- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...DatabricksSqlContract work2 days per week
- ...Essential Skills: · Azure · Databricks Role Description: · Strong knowledge of Azure services: Data Factory, Databricks, ADLS, Azure SQL. · Hands-on experience with Databricks notebooks, PySpark, Spark SQL, and Delta Lake. · Understanding of ETL...DatabricksSqlContract work
$65 - $72 per hour
...Job Title: Senior Data Engineer - (Python/Spark/SQL) Job Location: Hybrid (3 days remote), Toronto, Canada Experience: 4 to 7 Years Rate: 65 to 72 CAD PH Role Summary: NearSource is looking for a Senior Data Engineer to design and scale enterprise-grade data platforms...SqlLong term contractFull timeManual laborRemote work$58k - $102k per year
...Consultant – Microsoft Fabric / Databricks Solutions, you will support... ...design and delivery of modern data platform solutions for our clients... ..., data governance, AI/ML, engineering) to ensure integrated solution... ...technologies • Experience with SQL, PySpark, and data modeling...DatabricksSqlPermanent employmentFlexible hours$60 - $70 per hour
...Job Title: Senior Data Engineer Location: Hybrid (2 days), Toronto, Canada Experience: 5+ Years Rate: 60 CAD to 70 CAD per... ...stakeholders Must-Have Skills Strong experience with Python, Spark (PySpark, Spark SQL), and SQL Hands-on experience with Snowflake and Hive...SqlHourly payLong term contractFor contractors$86k - $125k per year
...solvers who thrive on complex data challenges. Guided by our values... ...a passionate and curious Data Engineer with strong DBT and Python skills... ...warehouses (e.g., Snowflake, Azure Synapse, Redshift). ~ Participate... ...tools). ~ Strong SQL skills and ability to work with...DatabricksSqlFull timeWork at office$85k - $156k per year
...job coaching -- Deloitte Global is the engine of the Deloitte network. Our... ...typical day look like? Job Summary The Databricks Data Architect is a senior technical leader responsible... ...demands deep expertise in Databricks (Azure), hands-on experience with PySpark and Delta...$84.7k - $134.7k per year
...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...ll be part of As a Senior Associate, Azure Data Engineer, you will play a key role... ..., including Azure Data Factory (ADF), Azure Databricks, Synapse Analytics,...DatabricksSqlFull time$95k - $145k per year
Azure Data Engineering Specialist Position Description CGI is looking for a skilled and collaborative Azure Data Engineering Specialist to... ...and implement ETL/ELT workflows using Azure Data Factory, Databricks, ADLS, Synapse, and Azure SQL. • Build batch and streaming...DatabricksSql- ...Role: Azure AI & Data Platform Engineer Key Skills: Azure virtual functions, OpenAI, Logic Apps, Azure DevOps, TFCDK Total Experience: 6–8 Years... ...# Design globally distributed Azure Cosmos DB solutions (SQL API, MongoDB API). # Configure Cosmos DB multi-regional replication...SqlContract work
- ...Required Skills & Experience · Strong knowledge of SQL and database concepts with hands-on data validation experience. · Good understanding of testing principles, SDLC, and STLC. · Able to independently manage end-to-end testing activities. · Work closely with...Sql
$90k - $125k per year
...people who are lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing, building, and maintaining... ...and pipelines. Your deep knowledge of data platforms such as Azure Fabric, Databricks, and Snowflake will be essential as you collaborate closely...DatabricksSqlFull timeWork from homeFlexible hours- ...ShyftLabs, we live and breathe data. Since 2020, we’ve been... ...ShyftLabs is seeking a skilled Data Engineer to support in designing, developing... ...big data solutions using the Databricks Unified Analytics Platform.... ...strong expertise in Apache Spark, SQL, Python, and cloud platforms...DatabricksSqlFull time
$96k - $125k per year
...focused problem solvers who thrive on complex data challenges. Guided by our values of Care,... ...drive business solutions. ~ Feature engineering, selection and optimization models with ML... ...Scientist ~ Proficiency in Python and SQL, with experience in data wrangling,...DatabricksSqlFull time- ...Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description # JavaScript/NodeJS developers with AWS and Azure cloud services in-depth knowledge. Key role is development and automation. # Involve developing serverless functions...Contract work
- ...Role Description: Seeking a highly experienced Principal Databricks Data Engineer to lead modernization of large-scale Finance and Risk data platforms... ...·5+ years of hands-on experience with Databricks and Spark at scale Key Responsibilities · Cloudera to Databricks...DatabricksSqlContract work
- ...happen–fast. The Senior Data Enginee r is the technical... ...building role. The Senior Data Engineer sets the standards the rest of... ...definition Custom compute : Databricks for bespoke modeling work that... ...at scale ~ Expert-level SQL and Python; comfortable optimizing...DatabricksSqlInternshipRemote workWorldwide
$110k - $160k per year
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data... ...participants: Data and Technical Architects, engineering teams, product manager, project... ...Data Modelling skills Databricks - Required Azure Cloud Data Engineering Ideally...DatabricksLong term contractWeekend work- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI... ...with AI. Type: Remote Full-time Senior Data Engineer Are you an experienced Data... ...modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking for a...DatabricksSqlFull timeContract workLocal areaRemote work
- ...About the Role As a Senior DevOps Engineer you will design, create, and... ...Deployment solutions in our Azure environment. As a Senior DevOps... ...security policies for sensitive user data and our systems overall.... ...Azure Monitor Familiar with SQL, Azure SQL, Cosmos DB, Azure Cache...SqlFull timeContract workInternshipRemote work
- ...further than Zurich Canada. If you have experience in data engineering, and are looking for a new challenge, we would love to... ...• Develop and maintain scalable data pipelines using Databricks on Microsoft Azure, supporting batch and incremental data processing use cases...DatabricksSqlWork at officeLocal areaWorldwide3 days per week
- ...PM) Role Description: · Senior BSA · Leads cross-LOB initiatives, drives data standardization and stakeholder alignment and having experience with Azure Data Engineering · Owns complex integrations and enterprise Ref data onboarding and adoption ·...Contract work
- ...MUST HAVE skills/experience: · Strong knowledge PL SQL/T-SQL · Having experience in Data Modelling (Any designer tool), Gap analysis and MS Visio · Good understanding in Data warehousing concepts and ETL Process · Drive the requirement session/meetings with...SqlContract work
- ...The opportunity We are looking for a Data Engineer. Our AI & Data practice works... ...CS Degree or equivalent experience ~ Databricks ~ Data Platform ~ Data Engineering... ...distributed data systems and cloud platforms (AWS/Azure/GCP) ~ Experience with Java, Scala, Python...DatabricksSqlLong term contract
$65.6k - $98.4k per year
...specific details for this role. : Data Engineer (Business Systems Analyst) About the Team... ...focus on ETL/data curation on on-cloud Azure Platform. As a Data Engineer/BSA , you... ...following: ~ Data Flow Processes ~ SQL Development ~ Python, Pyspark, Spark...DatabricksSqlFull timeWork from home- ...Job Requirements: - 5–7+ years of experience in Data Engineering, Data Quality, Data Observability, or related disciplines.... ...platforms (e.g., Monte Carlo, Databand, Soda). - Proficiency with Azure SQL, Azure networking concepts, authentication patterns, and identity...SqlContract workWork at office
- ....com What You'll Be Doing As the Senior Manager, Data Engineer - CAM, you will be responsible for developing and maintaining... ...cloud-based data platforms, particularly AWS or Azure, and big data technologies like Hadoop or Spark. Advanced Analytics & Machine Learning -...SqlFull timeInternship3 days per week1 day per week
- ...Azure AI/ML Cloud Engineer – Azure AI, Azure ML, Python, Cosmos DB Location: Toronto, ON (Hybrid... ...Microsoft Azure while collaborating with data scientists, engineers, and business... ...Experience with REST APIs, microservices, SQL, and NoSQL (Azure SQL, Cosmos DB). Azure...Sql
$108k - $135k per year
...promotions, cost models, and more. As a Data Engineer on the Pricing team, you will help build... ...service data pipeline management (ETL) SQL and MapReduce job tuning to improve data... ...professional experience ~ Strong experience with Spark ~ Experience with Hadoop (or similar)...SqlHourly payWork at officeFlexible hours3 days per week- ...Data Engineer - Python, ETL Location: Toronto, ON (Hybrid – 2–3 days onsite) Duration: 7 Months Experience... ...applications and integrations Write and optimize SQL queries and scripts Work with Databricks / Snowflake and big data tools Build workflows...DatabricksSql
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer (ADF, Databricks, Spark SQL). Be the first to apply!
Related searches
- azure cloud architect Toronto, ON
- data centre engineer Toronto, ON
- data engineer Toronto, ON
- python data engineer Toronto, ON
- junior data engineer Toronto, ON
- data integration developer Toronto, ON
- information engineer Toronto, ON
- data cabling engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON