Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Databricks Engineer - Azure Data Pipelines & Lakehouse

Compunnel Inc.

The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.Key ResponsibilitiesBuild and maintain scalable ETL/ELT data pipelines using Databricks.Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.Work with teams across the organization to prepare data for BI dashboards and reporting tools.Partner with business stakeholders to understand requirements and deliver tailored data solutions.Performance & Optimization
Optimize Databricks workloads for performance, scalability, and cost efficiency.Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.Governance & Security
Implement data governance, access controls, and security frameworks using Unity Catalog.Ensure compliance with enterprise data policies and regulatory standards.Deployment
Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.Maintain version control for Databricks artifacts and collaborate with the team on development best practices.Required Qualifications
10+ years of overall experience in data engineering.Recent experience in financial services, banking, or capital markets.Strong expertise in Databricks, including:Unity CatalogLakehouse ArchitectureTable TriggersDatabricks RuntimeProficiency with Azure cloud services.Deep understanding of Spark and PySpark for big data processing.Strong programming skills in Python.Experience with relational databases.Knowledge of Databricks Asset Bundles and GitLab for version control.Preferred Qualifications
Familiarity with advanced Databricks Runtime configurations.Experience with streaming frameworks such as Spark Streaming.
#J-18808-Ljbffr
Vacancy posted 44 minutes ago
Similar jobs that could be interesting for youBased on the Databricks Engineer - Azure Data Pipelines & Lakehouse in Winnipeg, MB vacancy
  •  ...de données senior, niveau 2, pour concevoir et construire des pipelines sur Databricks et orchestrer des flux de données variés. Vous travaillerez...  ...continue des données, en collaboration avec les équipes produit et data. Rejoignez une équipe dynamique orientée résultats et impact.... 
    Suggested

    121 - GoTo Technologies Canada Ltd.

    Winnipeg, MB
    36 minutes ago
  •  ...HRbrain Inc. is seeking a Data Science Developer to deliver and sustain analytics pipelines, models, and data products. The role focuses on building scalable storage, automating pipelines, and crafting dashboards for insights. Responsibilities include knowledge transfer... 
    Pipeline
    Databricks
    Work at office

    HRBrain Inc.

    Winnipeg, MB
    43 minutes ago
  • Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks... 
    Pipeline
    Databricks

    Parkland Corporation

    Winnipeg, MB
    42 minutes ago
  • Astra-North Infoteck Inc. in Toronto, Canada, seeks an experienced L4 Engineer with hands-on data engineering, cloud platforms, and application development. You will work across Azure Databricks, Databricks ML, and Java/Python backend tasks to support complex data solutions.... 
    Pipeline
    Databricks

    Astra-North Infoteck Inc.

    Winnipeg, MB
    38 minutes ago
  • A progressive financial services company in Canada is seeking a Senior Data Engineer. You will set standards for data platforms and act as a technical anchor for scalable systems. Ideal candidates have 5+ years of experience along with advanced skills in SQL and Python. You... 
    Databricks

    CanCap Group Inc.

    Winnipeg, MB
    44 minutes ago
  • Databricks and Azure leadership define this hybrid Director, Data Engineering opportunity at Gore Mutual. Build trusted data products for enterprise analytics and AI.As Director, Data Engineering, you will lead teams across Data Products, Data Platforms, Data Engineering, and... 
    Databricks

    Gore Mutual Insurance Company

    Winnipeg, MB
    43 minutes ago
  •  ...Coconut Software is seeking a Senior Data Engineer for a 12-month contract in Canada. You will own data engineering on the Data Enablement team, building production pipelines in Databricks and migrating analytics to a lakehouse architecture. You will collaborate with analytics... 
    Pipeline
    Databricks
    Contract work
    Remote work

    Coconut Software

    Winnipeg, MB
    36 minutes ago
  • We are seeking an experienced Azure Databricks Data Architect to lead enterprise-scale data architecture, data engineering, analytics, AI, and cloud modernization initiatives.The ideal candidate will bring extensive experience designing and implementing enterprise data... 
    Pipeline
    Databricks

    N2P Systems

    Winnipeg, MB
    43 minutes ago
  • Build Azure data pipelines with Tata Consultancy Services using SQL, Python, and cloud data platforms. Apply big data expertise to structured and semi-structured datasets.As an Azure Data Engineer, you will design and develop cloud-based pipelines from business requirements... 
    Pipeline
    Databricks

    Tata Consultancy Services Limited

    Winnipeg, MB
    42 minutes ago
  • We are seeking an experienced Databricks Engineer to join our delivery team on a contract basis in Calgary to design, build, and optimize modern data platforms on Azure Databricks. In this strategic role, you will work directly with both Data Elephant and client data and... 
    Pipeline
    Databricks
    Contract work

    Data Elephant

    Winnipeg, MB
    36 minutes ago
  • NTT DATA seeks a Senior Data Engineer to join our Toronto, Ontario team. The role focuses on designing, building, and optimizing scalable data solutions, including lakehouse pipelines and data ingestion workflows. Ideal candidates will have 8+ years with Databricks, PySpark... 
    Pipeline
    Databricks

    NTT America, Inc.

    Winnipeg, MB
    38 minutes ago
  •  ...Pathlion is seeking a skilled Data Engineer to join our cloud data platform team in Fredericton, NB. You will analyze requirements, design and implement lakehouse solutions and automated pipelines using Azure and Databricks. You will collaborate with IT and business partners... 
    Pipeline
    Databricks

    Pathlion

    Winnipeg, MB
    39 minutes ago
  •  ...institutional investment organization as a Senior Data Engineer supporting a major Eagle platform...  ...across the organization Apply modern Azure data engineering practices while solving...  ...-testing solutions using Azure Databricks, Python/PySpark, Spark SQL, and Oracle SQL... 
    Databricks
    Contract work
    2 days per week
    3 days per week

    Altis

    Winnipeg, MB
    43 minutes ago
  •  ...and operate classic, generative and agentic AI solutions on Azure and Databricks for a major public energy player in Quebec. Montreal-based with...  ...; deliverables in French. You will implement MLflow pipelines, model registries and deployment, and lead CI/CD, IaC, and security... 
    Pipeline
    Databricks

    Abbeal

    Winnipeg, MB
    42 minutes ago
  • Shape Azure data architecture through advanced modeling, governance, and lakehouse design for complex public-sector healthcare environments. Work spans enterprise-scale...  ...on Azure Data Factory, Data Lake Storage, and Databricks experienceFive-plus years supporting public-sector... 
    Databricks

    Rubicon Path

    Winnipeg, MB
    44 minutes ago
  •  ...North Infoteck Inc. is seeking an accomplished Data Engineering/Architecture lead in Toronto to drive the Cloudera to Databricks transformation. You will shape finance and...  ...requires deep expertise in Databricks, Spark, data lakehouse architectures, and cloud platforms (AWS/Azure... 
    Databricks

    Astra-North Infoteck Inc.

    Winnipeg, MB
    38 minutes ago
  • $91.33k - $114k per year

     ...KF Aerospace in Kelowna, BC, is seeking a Data Engineer to design, develop, and modernize our enterprise data platform using Microsoft Fabric, Azure, SQL Server, and Power BI. You will build reliable data pipelines, Lakehouse architectures, and enterprise reporting to enable... 
    Pipeline
    Full time

    KF Aerospace

    Winnipeg, MB
    45 minutes ago
  • Ledcor Group is hiring a Senior Data Engineer to join the Data & Analytics Platform team. You will design, build, and maintain enterprise-...  ...requires strong Python, PySpark, and SQL skills, experience with Databricks and cloud platforms, and a solid background in data #J-18808... 
    Pipeline
    Databricks

    Ledcor Group

    Winnipeg, MB
    42 minutes ago
  • $92.58 per hour

     ...Hourly Rate: $92.58 Job OverviewAs a Staff Data Engineer/Data Architect, you will be responsible...  ..., design and delivery of scalable data pipelines and data products which enable...  ...leader and subject matter expert on the data lakehouse, data warehousing and modeling activities... 
    Pipeline
    Databricks
    Hourly pay
    Remote work

    Cpus Engineering Staffing Solutions Inc.

    Winnipeg, MB
    41 minutes ago
  • $115k - $160k per year

     ...customer experience with agile engineering and problem-solving creativity...  ...experience across technology, data sciences, consulting, and...  ...optimize batch and streaming data pipelines across modern cloud data platforms...  ...Web Services, Microsoft Azure, or Google Cloud Platform;... 
    Pipeline
    Databricks
    Contract work

    Publicis Groupe

    Winnipeg, MB
    40 minutes ago
  •  ...Ledcor is seeking a Senior Data Engineer to design, build, and maintain enterprise-scale data solutions across construction and infrastructure businesses. You’ll work on a Databricks-based platform with medallion architecture, partnering with analysts, developers, and stakeholders... 
    Databricks

    Ledcor

    Winnipeg, MB
    42 minutes ago
  • Lead Azure Databricks architecture for enterprise data platforms, combining Lakehouse design and cloud modernization expertise with client-facing consulting.This experienced architect defines data, analytics, and AI platform architectures across Microsoft Azure and Databricks... 
    Databricks

    N2P Systems

    Winnipeg, MB
    36 minutes ago
  • Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The... 
    Pipeline
    Databricks

    Apex Systems, LLC

    Winnipeg, MB
    44 minutes ago
  •  ...CIBC is seeking a Senior Data Engineer to lead the design and delivery of data products on modern cloud platforms. You will collaborate with...  ...best practices, and contribute hands-on with SQL, Python, and Azure-based technologies to build scalable, reliable data solutions supporting... 
    Pipeline

    Canadian Imperial Bank of Commerce (Canada)

    Winnipeg, MB
    42 minutes ago
  • A leading IT consulting firm is seeking a Senior Azure Data Engineer in Toronto, Ontario. The candidate will design and optimize scalable data pipelines within the Microsoft Fabric and SAP BW ecosystem. Qualifications include over 7 years of experience in data engineering,... 
    Pipeline
    Full time

    Astra-North Infoteck Inc.

    Winnipeg, MB
    38 minutes ago
  •  ...technology company in Ontario is seeking an experienced Data Architect to design and architect enterprise-scale data...  ...candidate will have over 8 years of experience in data engineering, strong proficiency with Databricks and Apache Spark, and a solid understanding of cloud... 
    Databricks

    TechDoQuest

    Winnipeg, MB
    38 minutes ago
  • Capgemini is seeking a data engineering lead to design, build, and scale data pipelines using Azure Data Factory and Azure Databricks in Brampton, Canada. You will guide a 10–15 person team and collaborate with executives, product, and analytics stakeholders to deliver robust... 
    Pipeline
    Databricks
    Contract work

    Capgemini

    Winnipeg, MB
    36 minutes ago
  • Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within... 
    Pipeline
    Databricks

    Compunnel Inc.

    Winnipeg, MB
    37 minutes ago
  • Design Novisto’s lakehouse and Python data pipelines while working remotely with flexible schedules as stated. Build the foundation for analytics, benchmarking, and AI products.As a Senior Data Engineer, you will own data architecture, ingestion, and curated datasets. The work... 
    Pipeline
    Databricks
    Remote work
    Flexible hours

    novisto78

    Winnipeg, MB
    40 minutes ago
  • Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level...  ..., and optimization of an enterprise Databricks Lakehouse platform. The ideal candidate should have strong hands‑on... 
    Pipeline
    Databricks
    Contract work
    Remote work

    Mindtris

    Winnipeg, MB
    37 minutes ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Databricks Engineer - Azure Data Pipelines & Lakehouse. Be the first to apply!