Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Databricks Data Engineer

Raise - find a more meaningful working experience

Senior Databricks Data Engineer
Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office)
Contract Length: 2 Months
Key ResponsibilitiesDatabricks Engineering and Migration
Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads into Databricks.
Develop production-quality data pipelines using Python, PySpark and SQL.
Translate existing processing and business logic into scalable Databricks-native implementations.
Develop and maintain ingestion, transformation and metric-calculation logic across multiple enterprise data sources.
Modernize existing workflow and orchestration processes, including scheduled jobs and Airflow/DAG-based processing.
Implement reusable engineering patterns to accelerate migration of additional workloads.
Data Integration
Integrate data from enterprise applications, APIs, databases, files and other source systems.
Work with source-system SMEs to understand existing data structures, interfaces and processing logic.
Implement source-to-target mappings based on approved requirements and target data models.
Support integration with enterprise platforms such as ServiceNow and cybersecurity data sources.
Troubleshoot connectivity, ingestion, schema and data-quality issues.
Data Quality, Testing and Reconciliation
Develop automated developer tests and data-validation routines.
Validate source-to-target transformations and data movement through bronze, silver and gold processing layers where applicable.
Perform reconciliation between legacy processing outputs and Databricks-generated results.
Identify, document and resolve data defects, processing exceptions and reconciliation discrepancies.
Produce clear validation evidence to support business and technical acceptance.
Engineering Quality and DevOps
Develop maintainable, reusable and well-documented production code.
Follow enterprise coding, security, architecture and release-management standards.
Use Git-based repositories and established CI/CD and deployment processes.
Participate in peer reviews and contribute to improving engineering standards and reusable patterns.
Support code check-in, deployment readiness, defect remediation and production-transition activities.
Monitor and troubleshoot pipeline execution and processing failures.
Agile Delivery and Collaboration
Work within an Agile delivery team executing against two-week sprint commitments.
Participate in sprint planning, backlog refinement, technical design sessions, defect triage and sprint reviews.
Estimate engineering effort and identify technical dependencies, blockers and risks.
Work closely with architects and technical leads to ensure alignment with enterprise architecture and Databricks standards.
Collaborate directly with client engineering teams and transfer knowledge throughout the engagement.
Produce technical documentation, source-to-target mappings, implementation notes and handover materials.
Required Skills and Experience
7+ years of experience in data engineering, software engineering or data-platform development.
Strong hands-on experience building production workloads on Databricks.
Advanced development skills in:
Python
PySpark / Apache Spark
SQL
Experience designing and implementing ETL/ELT and large-scale data-processing pipelines.
Experience migrating legacy data pipelines or processing applications to modern cloud data platforms.
Strong understanding of data ingestion, transformation, modelling, source-to-target mapping, data quality and reconciliation.
Experience with workflow orchestration technologies such as Apache Airflow or equivalent.
Experience integrating data through APIs, databases, files and enterprise applications.
Experience with Git, CI/CD and enterprise software-development practices.
Strong troubleshooting skills across data, code, integration and environment issues.
Ability to understand existing code and processing logic and efficiently refactor it into a modern architecture.
Experience working within structured Agile/Scrum delivery environments.
Strong written and verbal communication skills with the ability to work directly with client technical teams.
Must be based in the Greater Toronto Area and available to work onsite in downtown Toronto a minimum of two days per week.
Preferred Qualifications
Databricks certification such as Databricks Certified Data Engineer Associate or Professional.
Experience delivering data solutions within financial services, banking or another highly regulated industry.
Experience with cybersecurity, IT controls, compliance or operational-risk datasets.
Experience integrating platforms such as ServiceNow, CrowdStrike, BeyondTrust, FireEye, CyberArk, Tenable or similar enterprise security platforms.
Experience with cloud platforms such as Azure or AWS.
Experience modernizing Airflow DAGs or other legacy orchestration frameworks.
Familiarity with enterprise data-governance, metadata, lineage and auditability requirements.
Experience working in environments with strict security, architecture and release-governance processes.
#J-18808-Ljbffr
Vacancy posted 28 minutes ago
Similar jobs that could be interesting for youBased on the Senior Databricks Data Engineer in Winnipeg, MB vacancy
  • $84k - $128k per year

    Senior Data Engineer (Databricks Focused)This site uses cookies to provide you with a more responsive and personalised service. By using this site you agree to our use of cookies. Please read our privacy statement for more information on the cookies we use and how to delete... 
    Databricks
    Senior
    Full time
    Manual labor
    Work at office
    Local area
    Flexible hours

    BDO

    Winnipeg, MB
    29 minutes ago
  • Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms.... 
    Databricks
    Senior

    Vanguard

    Winnipeg, MB
    34 minutes ago
  • Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL... 
    Databricks
    Senior
    Work at office

    ShyftLabs

    Winnipeg, MB
    35 minutes ago
  • Build advertising data infrastructure remotely across Canada with Databricks, Apache Spark, and AI-native engineering practices. Own pipelines powering campaign analytics.This Senior Data Engineer role focuses on advertising analytics, campaign performance, and business intelligence... 
    Databricks
    Senior
    Remote work

    Jobgether

    Winnipeg, MB
    35 minutes ago
  • Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto office. Shape cloud solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production deployment... 
    Databricks
    Senior
    Work at office

    Simfluent

    Winnipeg, MB
    28 minutes ago
  •  ...Hybrid – 3 days remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing, building and...  ...Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within the agile SCRUM work... 
    Databricks
    Long term contract

    Cpus Engineering Staffing Solutions Inc.

    Winnipeg, MB
    30 minutes ago
  • ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in Toronto, ON to support a large-scale data migration and centralization initiative into an enterprise... 
    Databricks
    Hourly pay
    Contract work
    Manual labor

    Apex Systems, LLC

    Winnipeg, MB
    31 minutes ago
  •  ...started out as a team of three engineers. Today, we have grown to...  ...Remote About The Role The Data Fabric team is a cross-functional...  ...-cloud data platform on Databricks (GCP & Azure) to connect,...  ...act on enterprise data. As a Senior AI Software Engineer on the... 
    Databricks
    Senior
    Long term contract
    Work at office
    Remote work
    Flexible hours

    Kinaxis Inc.

    Winnipeg, MB
    28 minutes ago
  • Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-scale...  ...strong Python, PySpark, and SQL skills, experience with Databricks and cloud platforms, and a solid background in data #J-18808... 
    Databricks
    Senior

    Ledcor Group

    Winnipeg, MB
    29 minutes ago
  • A leading data solutions company is seeking a Senior Data Engineer to join their fully remote team. In this role, you will design and build scalable ETL/ELT pipelines using Databricks on AWS, ensuring data quality and collaborating closely with cross-functional teams. The ideal... 
    Databricks
    Senior
    Remote work
    Flexible hours

    Lumenalta

    Winnipeg, MB
    38 minutes ago
  • A progressive financial services company in Canada is seeking a Senior Data Engineer. You will set standards for data platforms and act as a technical anchor for scalable systems. Ideal candidates have 5+ years of experience along with advanced skills in SQL and Python. You... 
    Databricks
    Senior

    CanCap Group Inc.

    Winnipeg, MB
    32 minutes ago
  •  ...solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in Python,... 
    Databricks
    Senior
    Remote work

    Compunnel, Inc.

    Winnipeg, MB
    33 minutes ago
  • NTT DATA seeks a Senior Data Engineer to join our Toronto, Ontario team. The role focuses on designing, building, and optimizing scalable data solutions...  ...workflows. Ideal candidates will have 8+ years with Databricks, PySpark, Python and SQL, plus strong Azure data services... 
    Databricks
    Senior

    NTT America, Inc.

    Winnipeg, MB
    38 minutes ago
  • Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building... 
    Databricks
    Senior
    Contract work
    Remote work

    Enterprise Solutions Inc.

    Winnipeg, MB
    37 minutes ago
  • ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data...  ...~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience...  ...architecture decisions Mentor senior engineers and establish engineering standards... 
    Databricks
    Senior

    Astra-North Infoteck Inc.

    Winnipeg, MB
    29 minutes ago
  • Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite...  ...and lead architecture decisions. Experience mentoring senior engineers and establishing engineering standards. Strong... 
    Databricks
    Senior

    Astra-North Infoteck Inc.

    Winnipeg, MB
    29 minutes ago
  • Senior AWS Data Engineer (Strong Databricks) We are looking for a Senior AWS Data Engineer to design and lead scalable, secure, and high-performance cloud data platforms across AWS/Azure. Mississauga, ON (Hybrid).Location: Mississauga, ON (Hybrid)Contract: Full Time/CTHExperience... 
    Databricks
    Senior
    Full time
    Contract work

    Ccube

    Winnipeg, MB
    34 minutes ago
  •  ...Ledcor is seeking a Senior Data Engineer to design, build, and maintain enterprise-scale data solutions across construction and infrastructure businesses. You’ll work on a Databricks-based platform with medallion architecture, partnering with analysts, developers, and stakeholders... 
    Databricks
    Senior

    Ledcor

    Winnipeg, MB
    38 minutes ago
  • Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions...  ...pipelines, and real business impact. We’re looking for a Senior Data Engineer to join our remote team and take ownership... 
    Databricks
    Senior
    Full time
    Remote work
    Monday to friday
    Flexible hours

    Lumenalta

    Winnipeg, MB
    35 minutes ago
  • Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level Estimated Duration: 1 year contract with possible extension Work authorization: Candidate must be authorized to work in... 
    Databricks
    Senior
    Contract work
    Remote work

    Mindtris

    Winnipeg, MB
    36 minutes ago
  • Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale... 
    Databricks
    Contract work

    BeachHead

    Winnipeg, MB
    28 minutes ago
  • Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications. This role is essential for creating, supporting, and optimizing data lake and warehouse... 
    Databricks

    Cpus Engineering Staffing Solutions Inc.

    Winnipeg, MB
    33 minutes ago
  • $110k - $120k per year

     ...we have helped organizations build the data foundations that power intelligent systems...  ...and analytics solutions, combining Databricks, data engineering, and business intelligence capabilities...  ...Full-time What You'll ArchitectAs a Senior Data Consultant, you'll support and enhance... 
    Databricks
    Senior
    Full time
    Contract work
    Work at office
    2 days per week

    Keyrus

    Winnipeg, MB
    37 minutes ago
  • Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance...  .... Build the platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns... 
    Databricks
    Work from home

    Homebase

    Winnipeg, MB
    29 minutes ago
  • Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks... 
    Databricks

    Parkland Corporation

    Winnipeg, MB
    37 minutes ago
  • Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within... 
    Databricks

    Compunnel Inc.

    Winnipeg, MB
    28 minutes ago
  • Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This hands-on role focuses on...  ...ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-Ljbffr
    Databricks
    Contract work

    BeachHead

    Winnipeg, MB
    34 minutes ago
  • Design enterprise data platforms with Databricks and Snowflake as a Senior Data Architect, working hybrid from Miratech's downtown Toronto office.Miratech seeks a hands-on Senior or Lead Data Architect for APEX. You will architect Medallion data flows, Kimball dimensional models... 
    Databricks
    Senior
    Work at office

    Miratech

    Winnipeg, MB
    31 minutes ago
  • Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing, and optimizing large-scale data pipelines for scalability, reliability, and performance... 
    Databricks

    Rivago Infotech Inc

    Winnipeg, MB
    38 minutes ago
  • Design Databricks data platforms with Snowflake and Delta Lake expertise in a hybrid Toronto role requiring two office days weekly. Own architecture for APEX reporting.Miratech seeks a hands-on Senior Data Architect to build an end-to-end platform for contact centre telephony... 
    Databricks
    Senior
    Work at office

    Miratech Group

    Winnipeg, MB
    35 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Databricks Data Engineer. Be the first to apply!