Sr. Data Engineer- Databricks, Apache Spark
Full-time
Astra North Infoteck Inc.
Job Description
Role: Sr. Data Engineer
Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM)
Role Summary:
Senior Data Engineer (Databricks-Focused)
In-Person Interview is Mandatory Please dont share Virtual Interview Profiles.
We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks. This role will lead the design of data architecture develop high-performance pipelines and own end-to-end data workflows while mentoring junior engineers.
Key Responsibilities
- Design and implement Lakehouse architectures using Delta Lake.
- Build and optimize batch and streaming pipelines using Apache Spark (PySpark/Scala).
- Own end-to-end data flows: ingestion transformation modeling serving.
- Implement data quality monitoring and CI/CD best practices.
- Optimize cluster performance and cost efficiency within Databricks.
- Provide technical leadership conduct code reviews and mentor junior engineers.
Required Experience
- 8 years in data engineering with strong hands-on experience in Databricks.
- Advanced SQL and data modeling expertise.
- Deep experience with Spark performance tuning and large-scale data processing.
- Strong understanding of cloud platforms (AWS Azure or GCP).
- Proven ability to design and deliver production-grade data platforms.
Vacancy posted 5 hours ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer- Databricks, Apache Spark in Toronto, ON vacancy
- ...Job Description Role: Sr. Data Engineer Work Model: Hybrid – 2 days onsite (9:00 AM – 5:00 PM) Role Summary: Senior Data Engineer (Databricks-Focused) In-Person Interview is Mandatory – Please dont share Virtual Interview Profiles. We are seeking...DatabricksSeniorContract work
- ...Type: Full-time, Remote About the role This is a full-time, high-impact position for a Senior Data Engineer with expertise in Databricks , dbt , and Apache Airflow to support a critical CRM data architecture migration for a key client in the Life Sciences industry...DatabricksSeniorFull timeContract workRemote workWorldwideFlexible hoursShift work
- ...Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure Job Description Location: Toronto Work Model: Onsite (4 days/week) Key Requirements • 12–18 years of overall Data Engineering experience. • 8+...DatabricksSeniorPermanent employment
- ...Scope of Work: Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable...DatabricksContract work
$58k - $102k per year
...like? As a Consultant – Microsoft Fabric / Databricks Solutions, you will support with design and delivery of modern data platform solutions for our clients. You’ll work... ...functional teams (cloud, data governance, AI/ML, engineering) to ensure integrated solution delivery...DatabricksPermanent employmentFlexible hours$140k - $170k per year
...Tripstack is moving its entire data stack from bare-metal VMs to Kubernetes... ...for a senior infrastructure engineer who has done stateful... ...the data applications — Druid, Spark, Redpanda, Airflow, PostgreSQL,... ...experience with at least one of Apache Druid, Apache Kafka or Redpanda...SeniorFull timeWork at officeFlexible hours2 days per week$86k - $125k per year
...of talented, client-focused problem solvers who thrive on complex data challenges. Guided by our values of Care, Bravery, Excellence,... ...Role Summary We’re looking for a passionate and curious Data Engineer with strong DBT and Python skills and solid experience working with...DatabricksFull timeWork at office- ...Job Title: Senior Big Data Developer – Snowflake, Spark & AWS Location: Toronto Work Model:... ...Big Data Developer to join the Data Engineering team. You will design, build, and optimize... ...with orchestration tools such as Apache Airflow. • Experience with ETL tools...SeniorContract work
$57.46 - $67.04 per hour
...highly accomplished and technical Senior Data Engineer for an enterprise-level contract... ...architectures including Azure Synapse, Databricks, and Azure Data Factory. Lakehouse Architecture... ...Power BI or comparable analytics engines. Frameworks & Architecture Capabilities...DatabricksSeniorLong term contractContract workWork at office2 days per week$139.7k - $192.05k per year
...record helping large enterprises become more data-driven. Working with the Enterprise Account Executive (AE), the Sr. Solutions Engineer defines and directs the technical strategy... ...build proofs of concept and demonstrate Databricks' products, you need to be technical and must...DatabricksSeniorWorldwide- ...Your new company Join a high-performing, data-first technology team building a best-in-class Retail Media platform. This team is focused... ...heart of every decision. Your new role As a Senior Data Engineer, you will play a key role in designing and building scalable data...SeniorContract work
$90k - $125k per year
...lifelong learners. About The Role As a Data Engineer you’ll be tasked with designing,... ...of data platforms such as Azure Fabric, Databricks, and Snowflake will be essential as you... ...with big data technologies and concepts (Spark, Hadoop, Kafka). Excellent analytical...DatabricksFull timeWork from homeFlexible hours$85k - $135k per year
...integration platform that connects data, systems, and workflows across... ...seeking a highly skilled Data Engineer II to design, build, and scale... ...and infrastructure including Spark, Snowflake, Kafka, Airflow, and... ...Hands-on experience with: ~ Apache Spark (distributed data processing...Full time$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...scalable AI/ML capabilities using Databricks and other state-of-the-art tools across... ...platforms and tools (e.g., Databricks, Apache Spark). Familiarity with the Modern AI...DatabricksSeniorFull timeWorldwide- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...DatabricksContract work2 days per week
- ...ShyftLabs, we live and breathe data. Since 2020, we’ve been... ...ShyftLabs is seeking a skilled Data Engineer to support in designing, developing... ...big data solutions using the Databricks Unified Analytics Platform.... ...requires strong expertise in Apache Spark, SQL, Python, and cloud...DatabricksFull time
$110k - $160k per year
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data practice... ...: Data and Technical Architects, engineering teams, product manager, project managers,... ...Platform experience Data Modelling skills Databricks - Required Azure Cloud Data Engineering...DatabricksSeniorLong term contractWeekend work$96k - $125k per year
...talented, client-focused problem solvers who thrive on complex data challenges. Guided by our values of Care, Bravery, Excellence, and... ...company data to drive business solutions. ~ Feature engineering, selection and optimization models with ML techniques. ~ Improve...DatabricksFull time$85.35 - $102.42 per hour
...RQ11099 - Sr. DataOps/Cloud Data Engineer 1-year 11-month contract (457 business days) - possible extension ONSITE 5 days - 5700 Yonge St.... ...pandas, pyspark) · Data lakehouse solutions such as Databricks (Delta Lake). · Working with XLSX, CSV, JSON files, relational...DatabricksSeniorContract work$108k - $135k per year
...promotions, cost models, and more. As a Data Engineer on the Pricing team, you will help build... ...technologies such as AWS, Kubernetes and Apache Airflow. You will work with incredibly... ...professional experience ~ Strong experience with Spark ~ Experience with Hadoop (or similar)...Hourly payWork at officeFlexible hours3 days per week$144k - $188k per year
...personalization for marketers through data-activated content generation... ...owns the core recommendations engine and ML platform that powers... ...Data Engineer, you will own the Spark-based data pipelines and data infrastructure... ...~ Deep expertise with Apache Spark, including the PySpark...Senior$84k - $175k per year
...implementation of Microsoft Fabric-based data platforms (Lakehouse,... ...Fabric, Azure Data Factory, Spark, and SQL. • Drive data modeling... ...and mentor a team of data engineers and senior consultants. • Support... ...(preferred) or Synapse / Databricks equivalents o PySpark / Spark...DatabricksSeniorPermanent employmentFlexible hours$130k - $170k per year
...Group is currently seeking a Lead/Principal Data Engineer based out of our Toronto office. As a... ...-based platforms, including Snowflake, Databricks, and AWS. Lead the design and... ...Kubernetes. Deep hands-on experience with Apache Airflow, Snowflake (data warehousing, modeling...DatabricksLong term contractTemporary workWork at officeImmediate startWorldwideShift work2 days per week- ...proprietary AI Studio and AI Engines, the company helps drive the clients... ...: Remote Full-time Senior Data Engineer Are you an... ...technologies such as AWS, GCP, Azure, Databricks, and Snowflake? We are... ...performance tuning), and PySpark/Apache Spark. Data Modeling:...DatabricksSeniorFull timeContract workLocal areaRemote work
$116k - $235.1k per year
...Role: We're hiring Senior and Staff Data Platform Engineers to join the Data Infrastructure teams in... ...processes billions of events per day: Spark-on-Kubernetes, Flink and Kinesis pipelines... ...a large-scale MemoryDB feature store, Databricks multi-environment operations, and the...DatabricksSeniorLong term contractRemplacementFull timeTemporary workWork at officeLocal areaFlexible hours2 days per week- ...seriously! In this role you will work within the Fabrication Process Engineering team to deliver Xanadus photonic quantum computing hardware.... ...by humans. If you would like more information about how your data is processed please contact us. Required Experience: Senior...SeniorFull time
$85.35 - $102.42 per hour
...RQ11222 - Sr. DataOps/Cloud Data Engineer 10-month contract (200 business days) ONSITE 5 days - 87 Sir William Hearst Ave., Toronto, Ontario M3M 0B4 Security Level: CRJMC Must haves: # Expert experience with Microsoft Azure technologies , including...SeniorContract workInternship- ...firmware, and software while collaborating with some of the brightest engineers in the industry. This role offers the opportunity to solve... ...can interpret schematics, datasheets, register states, telemetry data, and firmware behavior to uncover complex system issues and drive...SeniorPermanent employment
$106.5k - $156.5k per year
...Sustainable Development activities and assurances. This Sustainability Engineer position will report directly to the site Plant Manager and has... ...site, as directed by plant managers and regional leadership. Data & Reporting: Collect, validate, and analyse sustainability...SeniorLong term contractTemporary workFor contractorsLocal area- ...Spark Scala Developer – Apache Spark, Scala, Hadoop & Data Engineering Experience Required: 6–8 Years Required Skill Sets • Skilled Spark Scala Developer with experience developing data processing applications using Apache Spark and Scala • Design and...SeniorPermanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer- Databricks, Apache Spark. Be the first to apply!
Related searches
- data centre engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON
- data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data cabling engineer Toronto, ON
- data engineering intern summer Toronto, ON