Etl Qa Engineer Databricks Pyspark
KUMARAN SYSTEMS
Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT concepts, and data warehousing. You will use GitHub, GitHub Copilot, and GitHub Actions/Runners for CI/CD pipelines. The position also includes prompt engineering, AI agents, and AI-powered knowledge bases.Key Responsibilities:
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Etl Qa Engineer Databricks Pyspark in Winnipeg, MB vacancy
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems has been helping enterprises... ...DescriptionRole OverviewWe are looking for an ETL QA Engineer with strong experience inDatabricks and PySpark, combined with hands‑on exposure to AI‑assisted...Databricks
KUMARAN SYSTEMS
Winnipeg, MB1 hour ago - A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills...DatabricksRemote work
Compunnel, Inc.
Winnipeg, MB1 hour ago - ...ID153517BRInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize... ...in Azure data services, Databricks, PySpark, and modern data engineering practices... ...Design and develop scalable ETL/ELT pipelines using Azure Databricks and...DatabricksRelocation
Infosys Limited
Winnipeg, MB1 hour ago - ...Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include... ...should possess strong skills in PySpark, SQL, and quality assurance processes...Databricks
Rubicon Path
Winnipeg, MB1 hour ago - A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python...DatabricksWork at office3 days per week
Rubicon Path
Winnipeg, MB1 hour ago - The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks... ...requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance... ...Responsibilities Build and maintain scalable ETL/ELT data pipelines using Databricks. Use...Databricks
Compunnel Inc.
Winnipeg, MB1 hour ago - A leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing GCP applications and collaborating with senior team members to ensure project success. Ideal candidates will have 8-10 years of experience ...Full time
Astra-North Infoteck Inc.
Winnipeg, MB1 hour ago - ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data... ...experience, including SQL, Python/PySpark, data migration and ETL development, with experience working...DatabricksHourly payContract workManual labor
Apex Systems, LLC
Winnipeg, MB1 hour ago - Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets... .... Apply deep SQL expertise to reliable engineering work.This Data Engineer role focuses on... ...Snowflake development. You will create ETL and ELT solutions, integrate data, and support...Internship
LanceSoft, Inc.
Winnipeg, MB1 hour ago - Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client... ...Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads... ...-quality data pipelines using Python, PySpark and SQL. Translate existing...DatabricksContract workWork at office2 days per week
Raise - find a more meaningful working experience
Winnipeg, MB1 hour ago - Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines... ...two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks. You will...DatabricksContract work
Raise - find a more meaningful working experience
Winnipeg, MB1 hour ago - Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing... .... You will transform datasets with PySpark and Spark, integrate Azure data sources, and...Databricks
Rivago Infotech Inc
Winnipeg, MB1 hour ago - Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products... ...’ll Do Design, build, and maintain scalable ETL / ELT pipelines using Databricks, PySpark, and AWS Work with large, complex datasets...DatabricksFull timeRemote workMonday to fridayFlexible hours
Lumenalta
Winnipeg, MB1 hour ago - We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...batch and real-time streaming ingestion pipelines using PySpark, Spark SQL, Delta Lake, Auto Loader, and Databricks Workflows...Databricks
KData AI
Winnipeg, MB1 hour ago - ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support...
Compunnel Inc.
Winnipeg, MB1 hour ago $34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from... ...optimization in Databricks environments Python / PySpark Spanish language proficiency The pay range that the employer...DatabricksContract workCapgemini
Winnipeg, MB1 hour ago- ...Global Banking and Markets Engineering (GBME) is the fast-moving, award... ...years’ experience with Python (PySpark, Pandas),4+ years’ experience with designing scalable ETL pipelines & data modeling4+ years... ...experience with data platforms: DataBricks or SnowflakeWorking experience...DatabricksFlexible hours
Scotiabank
Winnipeg, MB1 hour ago - # Forward Deployed Engineer (Python/Pyspark Developer)Apptoza Inc. · Toronto, Ontario, CABack to resultsForward Deployed Engineer (Python/Pyspark Developer... ...search, and agentic AI patterns.• Strong knowledge of ETL/ELT, batch and streaming pipelines, data quality, metadata,...
Linuxassociation
Winnipeg, MB1 hour ago - Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and... ...Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure... ...Responsibilities: Design scalable ETL and ELT pipelines using Python and...DatabricksRemote work
Recruiting in Motion
Winnipeg, MB1 hour ago - ...automated data and software quality testing as a Senior ETL Developer in a hybrid assignment requiring three onsite days weekly. Work with Azure, Databricks, and Power BI.This senior role combines data engineering, QA, and DevOps practices under the IT QA Lead. You will evaluate...Databricks
Rubicon Path
Winnipeg, MB1 hour ago - ...listener data into production intelligence with Databricks, Delta Lake, structured streaming, and feature engineering. Work fully remotely within Canada.As an MLOps /... ...jobsOptimize distributed processing using Spark, PySpark, and ScalaCollaborate with data scientists on model...DatabricksRemote work
Jobgether
Winnipeg, MB1 hour ago - ...We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data... ...strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and... ...applications using Python and PySpark. Implement ETL/ELT processes and integrate data pipelines...DatabricksFull time
Compunnel Inc.
Winnipeg, MB1 hour ago - ...Developer — Experience with Python, Spark/PySpark, Databricks (including Unity Catalog), and AWS to... ...bar on MLOps. Team up with DevOps and QA on testing, model versioning (MLflow, Unity... ...across the tribe. Work alongside engineers at all levels, share feedback on code and...DatabricksLong term contractFlexible hours
Intact Financial Corporation
Winnipeg, MB1 hour ago - Lead enterprise Databricks platform engineering remotely from Canada, applying Unity Catalog, Terraform, automation, and cloud infrastructure expertise... ...and Terraform experienceStrong Python, SQL, and working PySpark knowledgeBring senior Databricks administration, Terraform...DatabricksContract workRemote work
Mindtris
Winnipeg, MB1 hour ago - Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...programming skills in Python and SQL, with working knowledge of PySpark. Experience with Azure, AWS, or GCP. Experience...DatabricksContract workRemote work
Mindtris
Winnipeg, MB1 hour ago - Build enterprise-scale Lakehouse solutions as a Senior Databricks Developer using Python, PySpark, SQL, and Delta Lake expertise.This senior position focuses on developing scalable data engineering solutions with Databricks. You will create notebooks, workflows, jobs, pipelines...Databricks
Enterprise Solutions Inc.
Winnipeg, MB1 hour ago - Build production-grade data pipelines with Databricks and Azure at BDO Digital, using a blended... ...site, and virtual model.As a Senior Data Engineer in Technology Advisory Services, you will... ..., Delta Lake, and Apache SparkDevelop ETL processes for structured and unstructured...DatabricksWork at office
BDO Canada LLP
Winnipeg, MB1 hour ago - Lead Databricks data engineering at BDO with Azure and Apache Spark expertise in a blended office, client-site, and virtual model.BDO Digital seeks... ...Databricks, Delta Lake, and Apache Spark pipelinesDevelop reliable ETL for structured and unstructured dataIntegrate cloud and on-...DatabricksWork at office
BDO Canada
Winnipeg, MB1 hour ago - Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver... ...within financial institutions. You will design ETL/ELT pipelines and collaborate with various teams to drive analytic...Databricks
Compunnel Inc.
Winnipeg, MB1 hour ago - Lead Databricks and Azure data engineering at BDO Digital through a blended work model spanning offices, client sites, and virtual settings.As a Senior Data... ...Databricks, Delta Lake, and Apache SparkDevelop scalable ETL for structured and unstructured dataIntegrate cloud and on...Databricks
BDO Canada LLP
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Etl Qa Engineer Databricks Pyspark. Be the first to apply!
Related searches
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- remote quality assurance Winnipeg, MB
- qa software testing Winnipeg, MB
- quality assurance Winnipeg, MB
- stage assurance qualité Winnipeg, MB
- responsable assurance qualité Winnipeg, MB
- entry level qa Winnipeg, MB