Etl Qa Engineer Databricks Pyspark
KUMARAN SYSTEMS
Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT concepts, and data warehousing. You will use GitHub, GitHub Copilot, and GitHub Actions/Runners for CI/CD pipelines. The position also includes prompt engineering, AI agents, and AI-powered knowledge bases.Key Responsibilities:
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Etl Qa Engineer Databricks Pyspark in Winnipeg, MB vacancy
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems has been helping enterprises... ...DescriptionRole OverviewWe are looking for an ETL QA Engineer with strong experience inDatabricks and PySpark, combined with hands‑on exposure to AI‑assisted...Databricks
KUMARAN SYSTEMS
Winnipeg, MB1 hour ago - The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks... ...requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance... ...Responsibilities Build and maintain scalable ETL/ELT data pipelines using Databricks. Use...Databricks
Compunnel Inc.
Winnipeg, MB1 hour ago - Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client... ...Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads... ...-quality data pipelines using Python, PySpark and SQL. Translate existing...DatabricksContract workWork at office2 days per week
Raise - find a more meaningful working experience
Winnipeg, MB1 hour ago - Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines... ...two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks. You will...DatabricksContract work
Raise - find a more meaningful working experience
Winnipeg, MB1 hour ago - Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and... ...Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure... ...Responsibilities: Design scalable ETL and ELT pipelines using Python and...DatabricksRemote work
Recruiting in Motion
Winnipeg, MB1 hour ago - We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...batch and real-time streaming ingestion pipelines using PySpark, Spark SQL, Delta Lake, Auto Loader, and Databricks Workflows...Databricks
KData AI
Winnipeg, MB1 hour ago - Build scalable cloud data pipelines with Python, SQL, and Databricks in a Cloud Data Engineer position focused on secure processing.This Cloud Data... ...Server large datasetsFive-plus years deploying Databricks PySpark ETL pipelinesExperience with cloud warehouses including...Databricks
Rivago Infotech Inc
Winnipeg, MB1 hour ago - ...BITS Recruiting in Toronto is seeking an experienced Senior Systems Testing / QA Specialist to support a data-focused project involving data validation, ETL testing, and Monitoring & Evaluation reporting. The successful candidate will have strong SQL scripting skills, hands...
BITS Recruiting
Winnipeg, MB1 hour ago - Lead enterprise Databricks platform engineering remotely from Canada, applying Unity Catalog, Terraform, automation, and cloud infrastructure expertise... ...and Terraform experienceStrong Python, SQL, and working PySpark knowledgeBring senior Databricks administration, Terraform...DatabricksContract workRemote work
Mindtris
Winnipeg, MB1 hour ago - Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...programming skills in Python and SQL, with working knowledge of PySpark. Experience with Azure, AWS, or GCP. Experience...DatabricksContract workRemote work
Mindtris
Winnipeg, MB1 hour ago - Lead Databricks and Azure data engineering at BDO Digital through a blended work model spanning offices, client sites, and virtual settings.As a Senior Data... ...Databricks, Delta Lake, and Apache SparkDevelop scalable ETL for structured and unstructured dataIntegrate cloud and on...Databricks
BDO Canada LLP
Winnipeg, MB1 hour ago - # Forward Deployed Engineer (Python/Pyspark Developer)Apptoza Inc. · Toronto, Ontario, CABack to resultsForward Deployed Engineer (Python/Pyspark Developer... ...search, and agentic AI patterns.• Strong knowledge of ETL/ELT, batch and streaming pipelines, data quality, metadata,...
Linuxassociation
Winnipeg, MB1 hour ago - Lead Databricks data engineering at BDO with Azure and Apache Spark expertise. Work across offices, client sites, and virtually in a blended model.BDO... ...Databricks, Delta Lake, and Spark pipelinesDevelop scalable ETL for structured and unstructured dataIntegrate cloud and on-...Databricks
BDO Canada
Winnipeg, MB1 hour ago - Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver... ...within financial institutions. You will design ETL/ELT pipelines and collaborate with various teams to drive analytic...Databricks
Compunnel Inc.
Winnipeg, MB1 hour ago - ...Developer — Experience with Python, Spark/PySpark, Databricks (including Unity Catalog), and AWS to... ...bar on MLOps. Team up with DevOps and QA on testing, model versioning (MLflow, Unity... ...across the tribe. Work alongside engineers at all levels, share feedback on code and...DatabricksLong term contractFlexible hours
Intact Financial Corporation
Winnipeg, MB1 hour ago - ...Duration: December 7, 2026 – April 13, 2027 We are seeking an experienced Senior Systems Testing / QA Specialist to support a data-focused project involving data validation, ETL testing, and Monitoring & Evaluation reporting. The successful candidate will have strong SQL...Contract work
BITS Recruiting
Winnipeg, MB1 hour ago - Certification: Databricks Certification preferredJob Summary We are... .../AWS cloud platforms, SQL, PySpark, Python, and Databricks Auto Loader... ...guidance to data engineering teams.Support production deployments... ...Apache Spark, Delta Lake, and ETL/ELT pipelines.Experience in data...Databricks
Celebal Technologies
Winnipeg, MB1 hour ago - Databricks, Delta Lake, and Apache Spark define this senior data engineering role with BDO Digital’s Technology Advisory Services practice. Build production-grade pipelines.... ...Databricks, Delta Lake, and Apache SparkDevelop scalable ETL for structured and unstructured dataIntegrate...Databricks
BDO Canada
Winnipeg, MB1 hour ago - ...as Azure technologies including Azure Databricks Azure DataLake Gen 2. Power BI... ...semantic modeling Azure DevOps CI/CD PySpark Microsoft Fabric Star Schema or Snowflake... ...Factory (ADF) v2 Data Architecture & Engineering: Competency in building Lakehouses...DatabricksWork at officeMonday to friday
Softline Technology Inc.
Winnipeg, MB1 hour ago - Lead LLMOps and MLOps engineering with Databricks, MLflow, Unity Catalog, and Azure across production AI solutions in financial services.This AI Engineer role focuses on operationalizing generative AI and machine learning use cases. You will establish evaluation pipelines,...Databricks
Fortiv Technical Inc.
Winnipeg, MB1 hour ago - Databricks and AWS experts can shape MLOps at Fluent Media from Canada, focusing on reliable... ...and infrastructure efficiency.This senior engineer co-owns MLOps practices across Fluent Media... ...production systems. Python, SQL, PySpark, MLflow, and Delta Live Tables feature prominently...Databricks
Fluent, LLC
Winnipeg, MB1 hour ago - ...seeking an experienced and technically proficient Senior Data Engineer (Databricks Focused) to join our Technology Advisory Services practice. This... ...Databricks, Delta Lake, and Apache Spark. Develop scalable ETL processes for structured and unstructured data, ensuring data...DatabricksManual laborWork at officeLocal areaFlexible hours
BDO
Winnipeg, MB1 hour ago - ...next phase of technical development and are seeking a talented QA Automation Engineer to contribute to our mission. About the role:As a QA... ...understanding of relational SQL and NoSQL databases.Experience with ETL technologies and data pipelines.Ability to develop APIs and integrate...Work at officeRemote workHome officeFlexible hours
Cascade Debt Corporation
Winnipeg, MB1 hour ago - Build reliable machine learning systems as a Senior MLOps Engineer in Canada, using Databricks, AWS, Python, and automated pipelines. Shape production... ...learning workflow experienceProficiency with Python, SQL, PySpark, and related toolsExperience with MLflow and Delta Live TablesArchitecture...Databricks
Fluent
Winnipeg, MB1 hour ago - Databricks expertise meets customer intelligence at Xplore Inc. in this hands-on technical lead role, focused on gold-layer data and AI-ready analytics foundations.As Senior Intelligence Analytics Engineer, you will design curated datasets, validate pipelines, and build production...Databricks
Xplore Inc.
Winnipeg, MB1 hour ago - ...zone salariale à postuler. À propos du posteNous cherchons un développeur principal en IA avec une expérience en Python, Spark/PySpark, Databricks (y compris Unity Catalog) et AWS pour notre équipe grandissante! Ce que vous accomplirez chez nous: Faciliter le passage...DatabricksApprenticeshipFlexible hours
Intact Financial Corporation
Winnipeg, MB1 hour ago - Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase, with required Toronto hub attendance Tuesdays... ...platform beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs through, and returns...DatabricksWork from home
Homebase
Winnipeg, MB1 hour ago - Build Databricks infrastructure and products using Python, Java, or C++ within collaborative engineering teams. Develop reliable, scalable, and secure platform solutions.As a Software Engineer, you will contribute across backend, infrastructure, databases, systems, tools, cloud...Databricks
Databricks Inc.
Winnipeg, MB1 hour ago - Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
Parkland Corporation
Winnipeg, MB1 hour ago $85k - $90k per year
...or Diploma in Computer Science, Data Engineering, Information Systems, or related field... ...role. · Proficiency in Python, PySpark, data modeling, ETL processes and data integration using... ...Azure data services (e.g., Data Factory, Databricks, Synapse, Fabric, Purview). · Experience...DatabricksPermanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Etl Qa Engineer Databricks Pyspark. Be the first to apply!
Related searches
- senior quality assurance engineer Winnipeg, MB
- software quality assurance engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- director quality assurance Winnipeg, MB
- entry level qa Winnipeg, MB
- quality assurance intern Winnipeg, MB
- responsable assurance qualité Winnipeg, MB
- remote qa Winnipeg, MB
- specialiste assurance qualité Winnipeg, MB