Etl Qa Engineer Databricks Pyspark
KUMARAN SYSTEMS
Validate enterprise data pipelines with Databricks and PySpark as an ETL QA Engineer at Kumaran Systems. Apply AI-assisted testing expertise.This ETL QA Engineer validates large-scale data pipelines and ensures data quality. The work centers on Databricks, PySpark, ETL/ELT concepts, and data warehousing. You will use GitHub, GitHub Copilot, and GitHub Actions/Runners for CI/CD pipelines. The position also includes prompt engineering, AI agents, and AI-powered knowledge bases.Key Responsibilities:
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Validate large-scale data pipelines across enterprise data environmentsPerform data quality checks and reconciliation techniquesUse Databricks notebooks, jobs, clusters, Delta Lake, and SQLImprove testing efficiency and coverage with AI-assisted toolsBuild and validate AI-powered knowledge basesRequirements:
Strong hands-on Databricks experience across core platform capabilitiesExpert PySpark skills in transformations, actions, windows, and optimizationUnderstanding of ETL/ELT, warehousing, and dimensional data modelingExperience with GitHub, Copilot, and Actions/RunnersExperience crafting prompts for coding, testing, and documentationBring Databricks, PySpark, data validation, and AI-assisted QA skills to Kumaran Systems’ transformation engineering practice.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Etl Qa Engineer Databricks Pyspark in Winnipeg, MB vacancy
- Develop enterprise ETL pipelines with Databricks, Azure Data Factory, and PySpark in Toronto. Transform data from diverse systems into curated downstream feeds.Apex Systems seeks a Databricks Data Engineer for a large-scale data migration and centralization initiative. The assignment...Databricks
Apex Systems, LLC
Winnipeg, MB2 hours ago - Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems has been helping enterprises... ...DescriptionRole OverviewWe are looking for an ETL QA Engineer with strong experience inDatabricks and PySpark, combined with hands‑on exposure to AI‑assisted...Databricks
KUMARAN SYSTEMS
Winnipeg, MB2 hours ago - A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills...DatabricksRemote work
Compunnel, Inc.
Winnipeg, MB2 hours ago - Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building...DatabricksContract workRemote work
Enterprise Solutions Inc.
Winnipeg, MB2 hours ago - ...Software Developer specialized in ETL. This hybrid position requires 5+ years of experience in data engineering with expertise in Microsoft Azure, Databricks, and Power BI. Responsibilities include... ...should possess strong skills in PySpark, SQL, and quality assurance processes...Databricks
Rubicon Path
Winnipeg, MB2 hours ago - ...ID153517BRInfosys is seeking an experienced Azure Databricks Data Engineer to design, develop, and optimize... ...in Azure data services, Databricks, PySpark, and modern data engineering practices... ...Design and develop scalable ETL/ELT pipelines using Azure Databricks and...DatabricksRelocation
Infosys Limited
Winnipeg, MB2 hours ago - À Montréal, Avanquest recherche un ingénieur ETL maîtrisant Databricks, Python et SQL pour développer des pipelines de données fiables. Le poste s’exerce selon un mode hybride flexible, avec télétravail possible depuis l’étranger.Vous prendrez en charge l’ingestion, le nettoyage...DatabricksRemote workFlexible hours
Avanquest
Winnipeg, MB2 hours ago - A leading technology firm in Toronto seeks a Software Developer - ETL to design and implement ETL processes using Azure Databricks. This role involves optimizing data flow for analytics and data lakes. Candidates should have 7+ years of ETL experience, proficiency in Python...DatabricksWork at office3 days per week
Rubicon Path
Winnipeg, MB2 hours ago - A leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing GCP applications and collaborating with senior team members to ensure project success. Ideal candidates will have 8-10 years of experience ...Full time
Astra-North Infoteck Inc.
Winnipeg, MB2 hours ago - The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks... ...requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance... ...Responsibilities Build and maintain scalable ETL/ELT data pipelines using Databricks. Use...Databricks
Compunnel Inc.
Winnipeg, MB2 hours ago - ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data... ...experience, including SQL, Python/PySpark, data migration and ETL development, with experience working...DatabricksHourly payContract workManual labor
Apex Systems, LLC
Winnipeg, MB2 hours ago - Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets... .... Apply deep SQL expertise to reliable engineering work.This Data Engineer role focuses on... ...Snowflake development. You will create ETL and ELT solutions, integrate data, and support...Internship
Lancesoft
Winnipeg, MB2 hours ago - Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products... ...’ll Do Design, build, and maintain scalable ETL / ELT pipelines using Databricks, PySpark, and AWS Work with large, complex datasets...DatabricksFull timeRemote workMonday to fridayFlexible hours
Lumenalta
Winnipeg, MB2 hours ago - Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines... ...two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks. You will...DatabricksContract work
Raise - find a more meaningful working experience
Winnipeg, MB2 hours ago - ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support...
Compunnel Inc.
Winnipeg, MB2 hours ago - Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client... ...Migrate and refactor existing ETL/ELT pipelines, scripts and processing workloads... ...-quality data pipelines using Python, PySpark and SQL. Translate existing...DatabricksContract workWork at office2 days per week
Raise - find a more meaningful working experience
Winnipeg, MB2 hours ago - Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position focuses on designing, implementing... .... You will transform datasets with PySpark and Spark, integrate Azure data sources, and...Databricks
Rivago Infotech Inc
Winnipeg, MB2 hours ago - We are seeking an experienced Senior Databricks Engineer with a deep background in distributed data systems to architect, scale, and optimize... ...batch and real-time streaming ingestion pipelines using PySpark, Spark SQL, Delta Lake, Auto Loader, and Databricks Workflows...Databricks
KData AI
Winnipeg, MB2 hours ago $34.88 - $54.5 per hour
Data Engineer – Databricks (Mining Operations) We are seeking a Data Engineer to maintain and enhance existing data pipelines that ingest data from... ...optimization in Databricks environments Python / PySpark Spanish language proficiency The pay range that the employer...DatabricksContract workCapgemini
Winnipeg, MB2 hours ago- ...We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data... ...strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and... ...applications using Python and PySpark. Implement ETL/ELT processes and integrate data pipelines...DatabricksFull time
Compunnel Inc.
Winnipeg, MB2 hours ago - ...automated data and software quality testing as a Senior ETL Developer in a hybrid assignment requiring three onsite days weekly. Work with Azure, Databricks, and Power BI.This senior role combines data engineering, QA, and DevOps practices under the IT QA Lead. You will evaluate...Databricks
Rubicon Path
Winnipeg, MB2 hours ago - ...Global Banking and Markets Engineering (GBME) is the fast-moving, award... ...years’ experience with Python (PySpark, Pandas),4+ years’ experience with designing scalable ETL pipelines & data modeling4+ years... ...experience with data platforms: DataBricks or SnowflakeWorking experience...DatabricksFlexible hours
Scotiabank
Winnipeg, MB2 hours ago - # Forward Deployed Engineer (Python/Pyspark Developer)Apptoza Inc. · Toronto, Ontario, CABack to resultsForward Deployed Engineer (Python/Pyspark Developer... ...search, and agentic AI patterns.• Strong knowledge of ETL/ELT, batch and streaming pipelines, data quality, metadata,...
Linuxassociation
Winnipeg, MB2 hours ago - Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract... ...batch, Auto Loader, and streaming ETL pipelinesMaintain catalogs, schemas, tables... ...governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
BeachHead
Winnipeg, MB2 hours ago - Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses... ...computing environments. Build batch and streaming ETL with Auto Loader and Spark Structured Streaming....DatabricksContract work
BeachHead
Winnipeg, MB2 hours ago - ...listener data into production intelligence with Databricks, Delta Lake, structured streaming, and feature engineering. Work fully remotely within Canada.As an MLOps /... ...jobsOptimize distributed processing using Spark, PySpark, and ScalaCollaborate with data scientists on model...DatabricksRemote work
Jobgether
Winnipeg, MB2 hours ago - ...Developer — Experience with Python, Spark/PySpark, Databricks (including Unity Catalog), and AWS to... ...bar on MLOps. Team up with DevOps and QA on testing, model versioning (MLflow, Unity... ...across the tribe. Work alongside engineers at all levels, share feedback on code and...DatabricksLong term contractFlexible hours
Intact
Winnipeg, MB2 hours ago - ...as Azure technologies including Azure Databricks Azure DataLake Gen 2. Power BI... ...semantic modeling Azure DevOps CI/CD PySpark Microsoft Fabric Star Schema or Snowflake... ...Factory (ADF) v2 Data Architecture & Engineering: Competency in building Lakehouses...DatabricksWork at officeMonday to friday
SOFTLINE TECHNOLOGY
Winnipeg, MB2 hours ago - Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...programming skills in Python and SQL, with working knowledge of PySpark. Experience with Azure, AWS, or GCP. Experience...DatabricksContract workRemote work
Mindtris
Winnipeg, MB2 hours ago - Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver... ...within financial institutions. You will design ETL/ELT pipelines and collaborate with various teams to drive analytic...Databricks
Compunnel Inc.
Winnipeg, MB2 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Etl Qa Engineer Databricks Pyspark. Be the first to apply!
Related searches
- software quality assurance engineer Winnipeg, MB
- software test engineer Winnipeg, MB
- qa engineer Winnipeg, MB
- senior quality assurance engineer Winnipeg, MB
- remote quality assurance Winnipeg, MB
- qa software testing Winnipeg, MB
- quality assurance Winnipeg, MB
- stage assurance qualité Winnipeg, MB
- responsable assurance qualité Winnipeg, MB
- entry level qa Winnipeg, MB