Azure Data Engineer
Rivago Infotech Inc
Role : Azure Data Engineer with Databricks Expertise
Job Summary:
We are seeking highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, Cloud ETL tools to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.
Key Responsibilities:
- Build and maintain scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
- Work Closely with multiple teams to prepare data for dashboard and BI Tools.
- Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
Performance & Optimization:
- Optimize Databricks workloads for cost efficiency and performance.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
Governance & Security:
- Implement and manage data security, access controls and governance standards using Unity Catalog.
- Ensure compliance with organizational and regulatory data policies.
- Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
- Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
Technical Skills:
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid Understanding of Spark and PySpark for big data processing.
- Experience in relational databases.
- Knowledge on Databricks Asset Bundles and GitLab.
Preferred Experience:
- Familiarity with Databricks Runtimes and advanced configurations.
- Knowledge of streaming frameworks like Spark Streaming.
- Experience in developing real-time data solutions.
Certifications:
#J-18808-LjbffrVacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Azure Data Engineer in Toronto, ON vacancy
$95k - $145k per year
...Position Description: CGI is looking for a skilled and collaborative Azure Data Engineering Specialist to help design, build, and scale data solutions across cloud and hybrid environments. If you enjoy working in complex data ecosystems and transforming raw data into meaningful...SuggestedFull time$84k - $175k per year
...Studio (agents, copilots, orchestration) o Azure OpenAI and Azure AI services • Design... ...end GenAI solutions including: o Prompt engineering o Retrieval-Augmented Generation (RAG)... ...orchestration, and deployment o Integration with data platforms (Fabric, Databricks, ADLS) •...SuggestedPermanent employmentFlexible hours$84.7k - $134.7k per year
...Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to... ...work you'll be part of As a Senior Associate, Azure Data Engineer, you will play a key role in designing and building...SuggestedVisa sponsorshipWork visa- ...automated deployment processes and pipelines Work closely with engineering and operations teams to help in defining and promoting industry... ...change Technical Skills Strong hands-on experience with Azure, particularly AKS, Azure Networking, and Azure Security services...SuggestedFull time
$90k - $120k per year
...better working world. The opportunity We are seeking an Azure Cloud Engineer to join EY Canada. In this role, you will be required to offer... ..., while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future...SuggestedWeekend work$80 - $100 per hour
...has to offer at . The Opportunity: We’re looking for a Data Engineer to join our Data and Analytics Group within the Technology Services... ..., build, and maintain cloud-based applications and services on Azure Requirements Your experience and skills: ~ Degree in...Hourly payLong term contractTemporary workInternshipWork at officeRemote work$173k - $197.4k per year
...Staff Engineer - Data Engineering About Capital One Canada. For 30 years, we've been on a mission to change banking for good. We challenge the... ...AWS (highly preferred) or other cloud providers (Microsoft Azure, Google Cloud) Experience providing mentorship to Junior/Intermediate...Full timeWork at officeWork from home$138.3k - $172.8k per year
...we help shape a brighter way forward. Job Description Senior Data Engineer – JLL What this job involves: As a Senior Data Engineer at... ...analytics Architect comprehensive data solutions integrating multiple Azure services, AI capabilities, and cloud technologies aligned with...RemplacementFull time$97.34k - $162.22k per year
...Faculty/Division: Institutional Research and Data Governance Department: Institutional... ...Director, Business Intelligence & Data Engineering, the Data Engineering Lead will deliver and... ...technologies including Informatica, SQL Service, Azure Data Factory, Databricks, Azure Databricks...Full timeWork at office$91.2k - $136.8k per year
...specific details for this role. : Provide a broad range of data engineering functions including data modeling, data quality, data profiling... ...experience beneficial. ~ Expertise in data engineering on Azure, Databricks, orchestration, understanding of ETL frameworks, python...Full timeWork from home- ...Job Description Job Description Data Engineer (Snowflake / DBT) Location: Toronto, ON, Canada (Onsite) Duration: 12+ Months Interview: Face-to-Face – Toronto Description: We are looking for an experienced Data Engineer with strong hands-on expertise...Local area
Indotronix
Toronto, ON5 days ago usd108k per year
...comfortable while riding or driving with Lyft, transforming every support interaction into a moment of genuine connection. As a Data Engineer on the SCC team, you will have ownership over the data modeling and pipelines that power SCC’s Associate and AI Agent Platform ....Hourly payWork at officeFlexible hours3 days per week$113.9k - $211.8k per year
...REMOTE/TELETRAVAIL - ON - BMO XXXXX Ontario,X0X 0X0 The Head of HR Data Engineering is responsible for designing and implementing a scalable,... ...~ Proficiency in ETL tools, APIs, and cloud platforms (e.g., Azure, AWS, GCP, Snowflake). ~ Familiarity with data privacy regulations...Full timeContract workPart timeRemote work- ...Data Engineer (Azure) Job Type: Contract Contract Duration: 6 Months Location: Downtown Toronto, ON (Hybrid - 3 Days Onsite) What You'll Be Doing Design, develop, and maintain scalable data pipelines within Azure cloud environments. Build and optimize ETL/ELT processes...Long term contractContract work
$115.6k - $163.2k per year
...more specific details for this role. Job Description: The Data Platform Engineering Manager role is responsible for designing, building, and operating... ...preferred: ~ Databricks Data Engineer Professional ~ Azure Data Engineer Associate ~ AWS Data Analytics or Data...Full timeWork from home$150k - $180k per year
...Experience: 12–18 Years We are looking for a Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives... ..., security, and compliance controls. ~ Work with AWS or Azure cloud platforms. ~ Implement CI/CD using Git, Terraform, Jenkins...Temporary workWork at office$90k - $125k per year
...solutions trusted by 500 million people. About The Role As a Data Engineer you’ll be tasked with designing, building, and maintaining... ...platforms and pipelines. Your deep knowledge of data platforms such as Azure Fabric, Databricks, and Snowflake will be essential as you...Full timeWork from homeFlexible hours- We are looking for an experienced Senior Data Engineer to support the onboarding, integration, and operationalization of datasets used by Middle Office functions. The role focuses on building scalable, production-grade data pipelines and data products on AWS, enabling reliable...Long term contractFor subcontractorWork at office
$154k - $247k per year
...products and services that help people, businesses and governments realize their greatest potential. Title and Summary Director, Data Engineering Overview: Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk,...Full timeManual laborWorldwide$95k - $145k per year
...Employment Type: Full-Time CGI is seeking an experienced Senior Data Platform Engineering Specialist to join our growing Data Platform Engineering... ...secure data solutions across public cloud environments (AWS, Azure, GCP). Implement foundational data infrastructure using...Long term contractPermanent employmentFull time- ...high-value sales intelligence. Leading infrastructure vendors, engineering firms, and construction companies use the platform to identify and... .... The platform integrates seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly into sales workflows...Full timeWork at officeImmediate start3 days per week
$128k - $222.4k per year
...so, we invite you to join our team as a Cloud & AI Solution Engineer in Innovative Data Platform for commercial customers at Microsoft. Here, you'... ...Databases & Analytics is a growth opportunity for Microsoft Azure, as well as its partners and customers. It includes a rich portfolio...Ongoing contractFull timeInternshipWork at officeLocal areaFlexible hours- ...Responsibilities Design, develop, and own data pipelines, models, and products supporting Product, Data Science, and GTM functions... ...Scala, Spark, Airflow, Java, SQL, and Python across the team’s data engineering work. Use LLMs and agents at scale to produce high-quality...Full time
$49 - $54 per hour
...Senior Azure Cloud Platform Engineer Power BI & Informatica Bring your expertise to a dynamic technology environment where innovation collaboration... ...Design deploy and maintain Azure cloud infrastructure and data platform services. Build and manage CI/CD pipelines...Hourly payFull timeContract workWork at office3 days per week$140.6k - $190.6k per year
...About the role You’ll own the Azure platform that Thomson Reuters product engineering teams build on: the infrastructure itself — networking, identity, AKS, deployment... ...rollouts across multiple global regions, which means data residency, regional compliance obligations, and cross...Full timeWork at officeLocal areaFlexible hours$166k - $195k per year
...thrilled to be expanding this year as Robinhood is hiring world-class engineering talent in Toronto. Our Hoodies in Canada will enable Robinhood... ...finance for all. Robinhood is a metrics driven company and data is foundational to all key decisions from growth strategy to...Work at officeFlexible hoursShift workusd216k - usd297k per year
...fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of... ...believe in community, come join ours. About this role: Our Engineering organization owns the software that makes our marketplace work....Work at officeLocal areaRemote workWork from homeMonday to fridayFlexible hours3 days per week$85.5k - $114k per year
...Position Title: Master Data Management Engineer Position Type: Regular - Full-Time Grade: Grade 05 Requisition ID: 45119 In every role McCainers are ambitious curious and passionate about creating exceptional work experiences - together. With a customer...Full timeWork at officeRemote workWork from home2 days per weekusd275k per year
...value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.... ..., and most curious people to help us do it. As the head of the Data Foundation pillar of our Analytics and Data Insights team, you’ll...Full timeWork at officeLocal areaRemote workHome office$110.5k - $143k per year
...live, work and play. It’s an exciting time to join the team at Hydro One! Job Function: Develop and execute comprehensive data governance strategy to ensure effective data management across organizational domains. Collaborate with cross-functional teams to define...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer. Be the first to apply!
Related searches
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- data centre engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data engineering intern summer Toronto, ON
- data engineer Toronto, ON
- data cabling engineer Toronto, ON
- python data engineer Toronto, ON
- remote data engineer Toronto, ON