Sr. Data Engineer- Databricks, Apache Spark
Temps plein
Astra North Infoteck Inc.
Job Description
Role: Sr. Data Engineer
Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM)
Role Summary:
Senior Data Engineer (Databricks-Focused)
In-Person Interview is Mandatory Please dont share Virtual Interview Profiles.
We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks. This role will lead the design of data architecture develop high-performance pipelines and own end-to-end data workflows while mentoring junior engineers.
Key Responsibilities
- Design and implement Lakehouse architectures using Delta Lake.
- Build and optimize batch and streaming pipelines using Apache Spark (PySpark/Scala).
- Own end-to-end data flows: ingestion transformation modeling serving.
- Implement data quality monitoring and CI/CD best practices.
- Optimize cluster performance and cost efficiency within Databricks.
- Provide technical leadership conduct code reviews and mentor junior engineers.
Required Experience
- 8 years in data engineering with strong hands-on experience in Databricks.
- Advanced SQL and data modeling expertise.
- Deep experience with Spark performance tuning and large-scale data processing.
- Strong understanding of cloud platforms (AWS Azure or GCP).
- Proven ability to design and deliver production-grade data platforms.
L'offre d'emploi a été publiée il y a 18 jours
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Sr. Data Engineer- Databricks, Apache Spark à Toronto, ON
- ...Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/Azure Job Description Location: Toronto Work Model: Onsite (4 days/week) Key Requirements • 12–18 years of overall Data Engineering experience. • 8+...DatabricksSenior
$95k - $145k par année
Data Engineering Specialist - Databricks Position Description Are you an experienced Data Engineering professional interested in working in a talented... ...'re looking for you. Mandatory Skills: Databricks and Spark/PySpark (hands-on experience required). Experience...DatabricksSenior$58k - $102k par année
...like? As a Consultant – Microsoft Fabric / Databricks Solutions, you will support with design and delivery of modern data platform solutions for our clients. You’ll work... ...functional teams (cloud, data governance, AI/ML, engineering) to ensure integrated solution delivery...DatabricksEmploi permanentHoraires flexibles$140k - $170k par année
...Tripstack is moving its entire data stack from bare-metal VMs to Kubernetes... ...for a senior infrastructure engineer who has done stateful... ...the data applications — Druid, Spark, Redpanda, Airflow, PostgreSQL,... ...experience with at least one of Apache Druid, Apache Kafka or Redpanda...SeniorTemps pleinTravail au bureauHoraires flexibles2 jours par semaine- ...consultants bring deep expertise in Data Science, Machine Learning and... ...team in the world. The Data Engineer will be responsible for... ...Deep experience with Snowflake/Databricks on AWS, dbt, and distributed computing frameworks like Apache Spark. ~ Understanding of Datawarehouse...DatabricksZone locale
- ...Job Description: Role: Data Engineer Work Arrangement: Hybrid (4 days/week onsite): Work... ...Azure Data Factory (ADF) Azure Databricks (ADB) PySpark SQL Architecting... ...: Azure Databricks Notebooks or Apache Spark for data transformations Datadog dashboard...DatabricksСontrat
$120k - $140k par année
Currently, our retail analytics platform relies on fragmented data sources. Your mission will be to help build a brand new... ...scalable, and generic data pipeline product from scratch. Data Engineering: Leverage Databricks, PySpark, and Python to ingest, transform, and centralize...DatabricksSeniorTemps pleinСontratPour les contractantsTravail à distance$72k - $138k par année
...Senior Consultant to join our team as a Data Scientist / Power Systems Analyst. This role... ...cross-functional teams including data engineers, consultants, power system specialists, and... ...platforms such as AWS, Azure, GCP, or Databricks. Total Rewards The salary range for...DatabricksSeniorEmploi permanentHoraires flexibles- ...ShyftLabs At ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune... ...an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery... ...combines deep hands-on expertise with Databricks, Apache Spark, Python, SQL, and modern cloud...DatabricksSeniorTemps plein
- ...Senior Data Engineer | AWS Cloud | Big Data | ETL | Netezza | Spark | Kafka | Data Platform Modernization Job Summary The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with...SeniorEmploi permanent
$75k - $95k par année
...stakeholders across a wide range of functions to implement and solve data engineering challenges? Are you equally skilled at delivering simple... ..., and scripting automation tasks ~ Experience with Apache Airflow - being comfortable building and debugging DAGs, managing...Temps pleinStageTravail au bureauHoraires flexibles$80 - $100 par heure
...Opportunity: We’re looking for a Senior Data Engineer to join our Data and Analytics Group... ...department for 12 months. Reporting to the Sr Director, Data Platform Delivery and... ...analytics practices using tools such as Databricks, Snowflake, Salesforce, Python, and SQL...DatabricksSeniorTaux horaireContrat Longue DuréeTravail temporaireStage- ...Fortune 100 companies, enabling them to generate business value from data. Our consultants bring deep expertise in Data Science, Machine... .... This role will sit at the intersection of business, data engineering, analytics, and technology, translating complex business needs into...SeniorTemps pleinZone locale
- ...commercial insurance organization, is seeking an experienced Senior Data Modeler to join their enterprise data team. In this role, you... ...structures. You will collaborate closely with Data Architects, Data Engineers, BI teams, and key business stakeholders across domains such as...SeniorRecrutement immédiat
$95k - $145k par année
Senior Data Platform Engineering Specialist Position Description Location: Toronto/Montreal Preferred... ..., including Lakehouses (e.g., Databricks), Cloud Data Warehouses (e.g., Snowflake... ...data pipeline orchestration (e.g., using Apache Airflow or dbt). Improve data...DatabricksSeniorContrat Longue DuréeEmploi permanentTemps plein$85k - $135k par année
...integration platform that connects data, systems, and workflows across... ...seeking a highly skilled Data Engineer II to design, build, and scale... ...and infrastructure including Spark, Snowflake, Kafka, Airflow, and... ...Hands-on experience with: ~ Apache Spark (distributed data processing...Temps plein$80k - $130k par année
Sr. Business Systems Analyst (Data Services) Position Description This role is hybrid and requires you... ...architects, developers, data engineers, and QA teams to design and deliver... ...technologies such as Azure Data Services, Databricks, Snowflake, and data governance tools...DatabricksSeniorTravail au bureau$135k - $210k par année
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...scalable AI/ML capabilities using Databricks and other state-of-the-art tools across... ...platforms and tools (e.g., Databricks, Apache Spark). Familiarity with the Modern AI...DatabricksSeniorTemps pleinLe monde entier- ...economic opportunity for all. Senior Staff Engineer – AI Research, Innovation eBay is... ...will partner closely with Product, Research, Data Engineering, Platform Engineering, and... ...Large-scale data technologies such as Hadoop, Spark, or similar systems ~ REST, GraphQL,...SeniorContrat Longue DuréeTemps pleinRecrutement immédiat
$84k - $175k par année
...implementation of Microsoft Fabric-based data platforms (Lakehouse,... ...Fabric, Azure Data Factory, Spark, and SQL. • Drive data modeling... ...and mentor a team of data engineers and senior consultants. • Support... ...(preferred) or Synapse / Databricks equivalents o PySpark / Spark...DatabricksSeniorEmploi permanentHoraires flexibles$130k - $150k par année
...About the Job We are seeking an experienced Senior Solutions Engineer to lead complex API integrations and high-impact technical engagements... ...range, including but not limited to external market benchmark data, geographic location, and years of experience sought/required....SeniorContrat Longue DuréeTravail temporaireTravail au bureauZone localeHoraires flexibles2 jours par semaine$130k - $155k par année
...Description The Senior Software Engineer is responsible for designing developing testing deploying and supporting production-grade software... ...build. Working in close partnership with Product leadership Data & AI Engineering Solution Engineering Platform Reliability...SeniorContrat Longue DuréeTemps pleinTravail temporaireTravail au bureauHoraires flexibles3 jours par semaine- ...Your Role 8+ years of experience in supporting and managing data engineering pipelines in production environments • Strong experience in... ...experience with GCP technologies including Pub/Sub, Dataflow (Apache Beam), and Datastream • Experience working with Cloud SQL (PostgreSQL...Emploi permanentTemps pleinStageZone locale
$69.7k - $98.4k par année
...Description: Provide a broad range of data engineering functions including data modeling data... ...platform operations. Troubleshooting Databricks jobs notebooks clusters and data processing... ...of relevant experience ~ Databricks / Spark ~ Azure Data Platform (ADLS ADF Azure...DatabricksTemps pleinTravail à domicile- ...for: Reporting to the Director, Marketing Technology & Digital Data Enablement, you will lead the strategy, governance, management... ...product delivery teams. Acting as a trusted partner to Product, Engineering, Data Insights, Marketing, and Media, you will embed strong data...SeniorTemps pleinСontratHoraires flexiblesTravail posté
- ...Must Have Technical/Functional Skills - Apache Kafka Administration - Kafka Cluster... ...other ecosystem components required for data integration. - Implement and maintain... ...- Collaborate with application data engineering infrastructure and DevOps teams to onboard...Temps plein
$142.4k - $190.1k par année
...all. ML Scientist / Machine Learning Engineer Company Overview eBay Inc. is a... ...to-end infrastructure that transforms raw data into production ML systems delivering measurable... ...Requirements Languages Python AWS Databricks Python AWS Databricks ML Skills...DatabricksTemps pleinPour les contractantsRecrutement immédiat- ...Terminal builds telematics data infrastructure for the commercial... ...Were looking for a software engineering intern whos excited about building... ...similar to Kafka Flink or Spark Technologies youll learn... ...Framework: Spring Boot Storage: Apache Iceberg Apache Doris AWS S3...SeniorStageTravail au bureau
$100k par année
...AI infrastructure continues to scale were looking for a Network Engineer to help design deploy and operate the networking backbone powering... ...role in ensuring the reliability performance and scalability of our data center networks while partnering closely with hardware systems...SeniorEmploi permanentTemps plein- ...individuals and organizations to thrive in the modern economy. Rockstar is supporting this client in their search for a talented Sr. Data Engineer to help evolve their core data platform and drive impactful business outcomes. A Sr. Data Engineer is sought to join the...Senior
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à Sr. Data Engineer- Databricks, Apache Spark. Soyez parmi les premiers à postuler !
Recherches connexes
- big data engineer Toronto, ON
- data engineer Toronto, ON
- python data engineer Toronto, ON
- information engineer Toronto, ON
- data integration developer Toronto, ON
- gcp data engineer Toronto, ON
- data engineering intern summer Toronto, ON
- junior data engineer Toronto, ON
- data centre engineer Toronto, ON
- data cabling engineer Toronto, ON