Azure Data Engineer (ADF, Databricks, Spark SQL)
Intérimaire
Astra North Infoteck Inc.
Scope of Work:
Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable data delivery.
Works on monitoring, troubleshooting, and resolving pipeline and cluster issues, and collaborates with DevOps teams using Azure DevOps, Git, CI/CD, and monitoring tools like Azure Monitor and Log Analytics to support stable and scalable data operations.
Required Skills
Strong knowledge of Azure services:
Azure Data Factory (ADF)
Azure Databricks
Azure SQL
Spark SQL
Understanding of:
ETL / ELT concepts
Data ingestion patterns
Data warehousing
Experience in:
Troubleshooting pipeline failures
Cluster issues
Performance bottlenecks
Familiarity with:
Azure DevOps
Git version control
CI/CD pipelines
Knowledge of monitoring tools:
Azure Monitor
Log Analytics
Databricks logs
L'offre d'emploi a été publiée il y a 2 jours
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Azure Data Engineer (ADF, Databricks, Spark SQL) à Toronto, ON
- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...DatabricksSqlСontrat2 jours par semaine
- ...Essential Skills: · Azure · Databricks Role Description: · Strong knowledge of Azure services: Data Factory, Databricks, ADLS, Azure SQL. · Hands-on experience with Databricks notebooks, PySpark, Spark SQL, and Delta Lake. · Understanding of ETL...DatabricksSqlСontrat
- ...Job Title: Data Engineer – Spark, Databricks & Snowflake Position Overview: We are seeking a Data Engineer with strong expertise in modern data platforms to build scalable data pipelines and cloud-based data solutions for banking, financial services, and insurance clients...DatabricksSql
$65 - $72 par heure
...Job Title: Senior Data Engineer - (Python/Spark/SQL) Job Location: Hybrid (3 days remote), Toronto, Canada Experience: 4 to 7 Years Rate: 65 to 72 CAD PH Role Summary: NearSource is looking for a Senior Data Engineer to design and scale enterprise-grade data platforms...SqlContrat Longue DuréeTravail manuelTravail à distance- Job Title: Data Engineer – Spark, Databricks & Snowflake (Energy) Industry Energy & Utilities Position Overview We are seeking an experienced Data Engineer to design, build, and optimize large-scale data platforms supporting operational, customer, asset, and energy...DatabricksSql
$86k - $125k par année
...solvers who thrive on complex data challenges. Guided by our values... ...a passionate and curious Data Engineer with strong DBT and Python skills... ...warehouses (e.g., Snowflake, Azure Synapse, Redshift). ~ Participate... ...tools). ~ Strong SQL skills and ability to work with...DatabricksSqlTemps pleinTravail au bureau$77k - $102k par année
...exceptional client service? Our team is looking for a Data Engineer with extensive hands-on expertise in Databricks and strong consulting capability. This role will... ...scalable batch and streaming pipelines using Spark and modern orchestration patterns. Apply CI/CD and...DatabricksSqlTemps pleinStage- ...Role: Data Engineers Developers Qty: 3 Location: Toronto Office Hybrid: 2 days a week in office Duration: 12 months... ...for Data Engineers Developers with hands-on experience in Azure Databricks and Data Fabric to build and maintain scalable data...DatabricksSqlСontratTravail au bureau2 jours par semaine
- ...We are looking for a Solution Architect with expertise in Azure Databricks and Azure Data Fabric to design scalable data platforms and lead data... ...Strong data architecture & design experience Cloud-based data engineering knowledge Top 3 Preferred Skills: BFSI domain...DatabricksСontratTravail au bureau2 jours par semaine
$95k - $145k par année
Azure Data Engineering Specialist Position Description CGI is looking for a skilled and collaborative Azure Data Engineering Specialist to... ...and implement ETL/ELT workflows using Azure Data Factory, Databricks, ADLS, Synapse, and Azure SQL. • Build batch and streaming...DatabricksSql- ...Role Description: Seeking a highly experienced Principal Databricks Data Engineer to lead modernization of large-scale Finance and Risk data platforms... ...·5+ years of hands-on experience with Databricks and Spark at scale Key Responsibilities · Cloudera to Databricks...DatabricksSqlСontrat
$96k - $125k par année
...focused problem solvers who thrive on complex data challenges. Guided by our values of Care,... ...drive business solutions. ~ Feature engineering, selection and optimization models with ML... ...Scientist ~ Proficiency in Python and SQL, with experience in data wrangling,...DatabricksSqlTemps plein$80k - $130k par année
Azure Application Developer (SQL) Position Description We are looking for an experienced Azure Application... ...-based application development and data solutions. The ideal candidate will have... ...Create and manage Azure Data Factory (ADF) pipelines and data workflows -...SqlTravail au bureau2 jours par semaine$90k - $125k par année
...people who are lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing, building, and maintaining... ...and pipelines. Your deep knowledge of data platforms such as Azure Fabric, Databricks, and Snowflake will be essential as you collaborate closely...DatabricksSqlTemps pleinTravail à domicileHoraires flexibles- ...The opportunity We are looking for a Data Engineer. Our AI & Data practice works... ...CS Degree or equivalent experience ~ Databricks ~ Data Platform ~ Data Engineering... ...distributed data systems and cloud platforms (AWS/Azure/GCP) ~ Experience with Java, Scala, Python...DatabricksSqlContrat Longue Durée
- ...Leveraging proprietary AI Studio and AI Engines, the company helps drive the clients’ AI... ...with AI. Type: Remote Full-time Senior Data Engineer Are you an experienced Data... ...modern technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are looking for a...DatabricksSqlTemps pleinСontratZone localeTravail à distance
- ...Job Title: Production Support Engineer - Wealth Management... ...Kafka Proficiency in Microsoft SQL Server, MongoDB, C#, ASP.NET... ...hosted applications (Microsoft Azure, OpenShift, S3) Knowledge of... ...Services Reporting: SSRS Data tools: ETL, DataStage, SSIS Nice...SqlContrat Longue DuréeTemps plein
- ...PM) Role Description: · Senior BSA · Leads cross-LOB initiatives, drives data standardization and stakeholder alignment and having experience with Azure Data Engineering · Owns complex integrations and enterprise Ref data onboarding and adoption ·...Сontrat
- ...MUST HAVE skills/experience: · Strong knowledge PL SQL/T-SQL · Having experience in Data Modelling (Any designer tool), Gap analysis and MS Visio · Good understanding in Data warehousing concepts and ETL Process · Drive the requirement session/meetings with...SqlСontrat
$80k - $130k par année
Azure Data Analyst Position Description This role is hybrid and requires you to be at... ...closely with business stakeholders, data engineers, and agile delivery teams to translate... ...conventions, and reference data. Azure & Databricks Development Support • Collaborate with...DatabricksSqlTravail au bureau2 jours par semaine$81.5k - $95k par année
...Aecon community! What is the Opportunity? As the Data Engineering Specialist, you will be versatile and driven to help... .... Support data engineering efforts on the Azure Data Platform (including Azure Databricks, Data Lake, and other services) Create workflows to...DatabricksSql$110k - $160k par année
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data... ...participants: Data and Technical Architects, engineering teams, product manager, project... ...Data Modelling skills Databricks - Required Azure Cloud Data Engineering Ideally...DatabricksContrat Longue DuréeTravail le week-end- ...making a meaningful impact through data and technology. This is an... ...Your new role As the Data Engineer, you will be responsible for designing... ...working with Microsoft Fabric, Azure Synapse, and Azure Data... ...solutions using Delta Lake and Apache Spark ~ Strong SQL and Spark...SqlСontratTravail manuel
$75.9k - $141.9k par année
...on experience with ETL/ELT development/testing and data warehousing concepts ~ Hands on experience with SQL, NoSQL, Python, Spark, Scala Experience with SSIS, Glue, cloud storage and computing services (e.g. AWS, Azure), Hadoop, Netezza Experience with structured,...SqlTemps pleinСontratTemps partiel$62.87k - $147.5k par année
...At Capgemini Engineering, the world leader in engineering services, we bring... .... Job Description Role: Data Engineer Location: Canada –... ...Experience in relational databases (SQL) and Programming (Python). ~... ...Big Data technologies (Hadoop, Spark, Trino). ~ Experience with...SqlEmploi permanentTemps pleinZone localeTravail à distance$57.46 - $67.04 par heure
...are seeking a highly specialized Senior Data Engineer for a high-impact, 35-month assignment in... ...analytics-ready datasets using the latest Azure cloud technologies to support complex business... ...high-performance Azure Data Factory (ADF) and SSIS packages to integrate data from...DatabricksSqlContrat Longue DuréeСontrat- ...Data & Reporting Analyst Location: Toronto Work Model: Hybrid (4 Days WFO... ...Months Top 3 Required Skills SQL Power BI Tableau Job Description... ...closely with business stakeholders, data engineers, and leadership teams to deliver actionable...SqlСontrat
$94.6k - $176k par année
...Toronto or 250 Yonge Street, Toronto About the team Data and AI Technology (DAT) Engineering supports BMO's Digital-First, risk, regulatory and... ...and cloud ~ Hands on experience in one or more of SQL, NoSQL, Python, Spark, Scala, code optimization, debugging ~ Experience...SqlTemps pleinСontratTemps partielTravail au bureau2 jours par semaine$86 - $92 par heure
...Position: Â Scala Spark Developer - Big Data & Liquidity Reporting Location:Â 4 days per week in office (Toronto, Downtown) Structure : Contract... ...including Apache Hadoop HDFS and Apache Cassandra Solid SQL skills for data querying, transformation, and aggregation at...SqlСontratTravail au bureau- We are seeking a hands-on Data Engineer to support the Total Fund Management Portfolio Management... ...Responsibilities Develop and optimize Spark-based workloads in cloud environments... ...Experience with Databricks Prior consulting...DatabricksSous-traitant
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à Azure Data Engineer (ADF, Databricks, Spark SQL). Soyez parmi les premiers à postuler !
Recherches connexes
- azure cloud architect Toronto, ON
- data centre engineer Toronto, ON
- junior data engineer Toronto, ON
- python data engineer Toronto, ON
- big data developer Toronto, ON
- remote data engineer Toronto, ON
- data integration developer Toronto, ON
- data engineering intern summer Toronto, ON
- information engineer Toronto, ON
- gcp data engineer Toronto, ON