Sr. Data Engineer- Databricks, Apache Spark
Full-time
Astra North Infoteck Inc.
Job Description
Role: Sr. Data Engineer
Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM)
Role Summary:
Senior Data Engineer (Databricks-Focused)
In-Person Interview is Mandatory Please dont share Virtual Interview Profiles.
We are seeking a Senior Data Engineer with deep expertise in building scalable Lakehouse solutions using Databricks. This role will lead the design of data architecture develop high-performance pipelines and own end-to-end data workflows while mentoring junior engineers.
Key Responsibilities
- Design and implement Lakehouse architectures using Delta Lake.
- Build and optimize batch and streaming pipelines using Apache Spark (PySpark/Scala).
- Own end-to-end data flows: ingestion transformation modeling serving.
- Implement data quality monitoring and CI/CD best practices.
- Optimize cluster performance and cost efficiency within Databricks.
- Provide technical leadership conduct code reviews and mentor junior engineers.
Required Experience
- 8 years in data engineering with strong hands-on experience in Databricks.
- Advanced SQL and data modeling expertise.
- Deep experience with Spark performance tuning and large-scale data processing.
- Strong understanding of cloud platforms (AWS Azure or GCP).
- Proven ability to design and deliver production-grade data platforms.
Vacancy posted a month ago
Similar jobs that could be interesting for youBased on the Sr. Data Engineer- Databricks, Apache Spark in Toronto, ON vacancy
- ...across business applications, data, process, cloud, and AI. At Bits... ...We’re seeking a Senior Data Engineer to join our Delivery Team. In... ...emerging technologies such as Databricks, Snowflake, Azure Synapse, and... ...transformations and optimization within Spark ~ Solid understanding of...DatabricksSenior
- ...Summary \ \ We are seeking a highly skilled Databricks Engineer with AI/ML experience \ to design, build, and optimize scalable data and machine learning platforms on... ...implement scalable ETL pipelines using Databricks & Spark \ Build Lakehouse architecture using...DatabricksSeniorFull time
$80k - $90k per year
...relevancy in E-commerce for everyday shoppers. As a Data Engineer on Fluent's Data Engineering team, you will bring your Databricks development expertise to build the data... ...You are considered an expert in Python, SQL, and Spark. You will work closely with the Data...DatabricksRemote jobFull timeWork at office$71.4k - $115k per year
...we provide a great place to come to work each day to pursue your passions. The Challenge We are looking for a dynamic Data Engineer to join a team involved in designing, building, and maintaining reliable and scalable data solutions. The ideal candidate is a...SuggestedFull timeCasual work$150k - $180k per year
...Experience: 12–18 Years We are looking for a Principal Data Engineer – Databricks to lead enterprise-scale data modernization initiatives, with... .... ~5+ years of hands-on experience with Databricks and Spark at scale . ~ Lead modernization of legacy Cloudera platforms...DatabricksSeniorTemporary workWork at office- ...Position: \ Senior Data Engineer \ \ Location: Hybrid\/Toronto \ \ Job ID#: \ RQ00527\ \ Duration: 6 months \ \ Overview \ \... ...fieldLabel":"Zip\/Postal Code","uitype":1,"value":"M5H"}],"headerName":"Sr Data Engineer","widgetId":"431307000000072311","isJobBoard":"...SeniorContract work
$100k - $130k per year
...professional looking for a career, not a job. Reporting to the Director, Data Platform, you will be responsible for developing and... ...recovery, testing, and controlled access Partner with Finance, Data Engineering, Analytics, and application teams to resolve data issues,...SeniorFull timeInternship- ...We are building a fast-growing Databricks practice delivering enterprise data and AI solutions across APAC. As Lead Solution Architect – Data Engineering, you will be the technical anchor of the... ...whiteboard in front of a CTO and a Spark UI when a pipeline misbehaves. You will...DatabricksFull time
- ...infrastructure technologies, translating user requirements to process and data requirements and developing solutions for the business with far-... ..., Leading Project Teams, Microsoft Azure, Microsoft Azure Databricks, Project Management Technology, Solutions Development, Technical...DatabricksSeniorFull timeRemote work
$100k - $140k per year
...ShyftLabs, we live and breathe data. Since 2020, we’ve been... ...ShyftLabs is seeking a skilled Data Engineer to support in designing, developing... ...big data solutions using the Databricks Unified Analytics Platform.... ...requires strong expertise in Apache Spark, SQL, Python, and cloud...DatabricksFull timeWork at office3 days per week- ...As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This... ...representatives 'Must Have' Skills/Experience Snowflake, Databricks, or Apache Spark experience Design and implementation experience...DatabricksFull time
- ...Required Skills. • Strong hands-on experience with Data-bricks and Apache Spark (PySpark/Scala). • Experience in SQL and data transformation... ...catalogs to get data from external sources • Strong understanding of databricks partitioning , Liquid clustering...DatabricksFull timeManual labor
$95k - $145k per year
Data Engineering Specialist - Databricks Position Description Are you an experienced Data Engineering professional interested in working in a talented... ...'re looking for you. Mandatory Skills: Databricks and Spark/PySpark (hands-on experience required). Experience...DatabricksSenior- ...in Scala and Java programming. 2. Hands-on experience with Apache Spark (Core| SQL| DataFrames| Datasets). 3. Familiarity with Maven... ...| and SQL queries.The ideal candidate will have experience developing data processing applications using Apache Spark and Scala....Contract work
$140k - $180k per year
...our people are proud to Build. Better. As a Principal Data Engineering leader at RAVL, you will design, define, and elevate enterprise... ..., and security. Standardize and lead adoption of Databricks, Apache Spark, Delta Lake, and similar distributed data processing...DatabricksSeniorFull timeRemote work- ...consultants bring deep expertise in Data Science, Machine Learning and... ...team in the world. The Data Engineer will be responsible for... ...Deep experience with Snowflake/Databricks on AWS, dbt, and distributed computing frameworks like Apache Spark. ~ Understanding of Datawarehouse...DatabricksFull timeLocal area
$140k - $170k per year
...Tripstack is moving its entire data stack from bare-metal VMs to Kubernetes... ...for a senior infrastructure engineer who has done stateful... ...the data applications — Druid, Spark, Redpanda, Airflow, PostgreSQL,... ...experience with at least one of Apache Druid, Apache Kafka or Redpanda...SeniorFull timeWork at officeFlexible hours2 days per week- ...MS fabric Data Engineer Role # Overview of The Role The Data Engineer is responsible... ...user experience Optimize SQL, Spark, and DAX queries for performance and scalability... ...streaming) ~ Fabric Orchestration (Apache Airflow) ~ Data Engineering...Databricks
$110k - $160k per year
...Opportunity We are seeking a Manager/ Data Architect for o ur AI & Data practice... ...: Data and Technical Architects, engineering teams, product manager, project managers,... ...Platform experience Data Modelling skills Databricks - Required Azure Cloud Data Engineering...DatabricksSeniorLong term contractWeekend work- ...Company Description It all started when engineer Fred Luddy wrote code that automated a... ...ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of the... ...applications on containers such as Apache/Tomcat, JBoss, Web Logic, and Web Sphere in...SeniorFull timeWork at officeImmediate startRemote workFlexible hours
$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...scalable AI/ML capabilities using Databricks and other state-of-the-art tools across... ...platforms and tools (e.g., Databricks, Apache Spark). Familiarity with the Modern AI...DatabricksSeniorFull timeWorldwide$85k - $135k per year
...integration platform that connects data, systems, and workflows across... ...seeking a highly skilled Data Engineer II to design, build, and scale... ...and infrastructure including Spark, Snowflake, Kafka, Airflow, and... ...Hands-on experience with: ~ Apache Spark (distributed data processing...Full time- ...Company Description Are you a Data Engineer with experience building cloud-based data... ...maintain a centralized Azure ADLS Gen2/Databricks/Synapse (or Snowflake) data lake that serves... ...ETL/ELT flows (Azure Event Hubs, Kafka, Spark Streaming) to ingest EHR data and operational...DatabricksFull time
$100k - $150k per year
...people are proud to Build. Better. As a Data Engineer at RAVL, you’ll design, build, and... ...maintaining data pipelines using tools like Spark, Airflow, dbt, or similar roficiency... ...Warehousing: Snowflake, Redshift, BigQuery, Databricks, Delta Lake CI/CD & Automation:...DatabricksFull timeFlexible hours- ...computing and multithreading 5+ years of experience on core java and 2+ years on java 8.0 2+ experience on Spark, Scala, Data Torrent, HBase, Hive, HDFS, Sqoop, PIG, MapReduce 5+ years of experience with RDBMS and SQL; Strong SDLC...SeniorFull timeFlexible hours
$115k - $140k per year
...Come join our Data team! High velocity, high intensity, high trust, high bar, high impact, and a will to win. If those words... ...reproducible results. ~ Expert-level programming and software engineering skills and a track record of delivering re-usable and well-documented...SeniorFull timeWork at office- ...About The Role As a Senior Data Analyst, you will partner closely with Product, Marketing, Engineering, and Leadership to shape how the company measures success, identifies growth opportunities, and makes data-informed decisions. You will develop scalable data models, establish...SeniorRemote jobLong term contractFull timeInternship
- ...Strategy, Experience & Design, Engineering and Managed Services. We build... ...possibilities. As a Senior Data Engineer, AI & Agents, you... ...platform. You will operate across Databricks and Snowflake, converting... ...tables to open formats (e.g., Apache Iceberg) to enable agent-based...DatabricksSeniorFull timeContract work
- ...Experience with Credit \/ Capital Calculation Engines \/ QRM \/ Market risk technology... ...Translate capital management business rules and data into detailed technology requirements, mappings... ...","uitype":1,"value":"M4C"}],"headerName":"Sr Business\/Data Analyst","widgetId":"...SeniorContract workManual labor
- ...significant investment in its enterprise data and cloud capabilities. They are looking for an experienced GCP Data Engineer to support the design, development, and optimisation... ...-processing concepts. Experience with Apache Beam, Airflow, Spark, or comparable data-processing and...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr. Data Engineer- Databricks, Apache Spark. Be the first to apply!
Related searches
- junior data engineer Toronto, ON
- data centre engineer Toronto, ON
- data engineering intern summer Toronto, ON
- python data engineer Toronto, ON
- data engineer Toronto, ON
- big data engineer Toronto, ON
- gcp data engineer Toronto, ON
- remote data engineer Toronto, ON
- data cabling engineer Toronto, ON
- data integration developer Toronto, ON