Etl Test Automation Engineer - Azure Data Platform
Astra-North Infoteck Inc.
The QA & Automation Engineer will be responsible for validating ETL pipelines, data migration processes, and cloud data platform integrations across Azure services. This role involves hands‑on testing of large-scale data platforms, automation development, advanced SQL validation, and ensuring end‑to‑end data quality across enterprise data engineering initiatives.
Key Responsibilities
Perform end‑to‑end testing of ETL pipelines built using Azure Data Factory, Azure Databricks, Azure Synapse, and SSIS.
Validate data transformations, mappings, data quality rules, and data lineage.
Conduct source‑to‑target (S2T) reconciliation, data profiling, completeness, and accuracy checks.
Verify schema changes, incremental loads, delta loads, and historical load processes.
Data Migration Testing
Design and execute test strategies for large‑scale on‑prem to cloud or cross‑cloud data migration projects.
Validate ETL/ELT processes and post‑migration data accuracy.
Perform count checks, checksum validation, CDC validation, duplicate checks, and referential integrity validation.
Review and validate data mapping documents, business rules, and acceptance criteria.
Data Lake & Cloud Platform Testing
Test ingestion pipelines into Azure Data Lake Storage (ADLS Gen2) from multiple source systems.
Validate partitioning, folder structures, file formats (Parquet, CSV, JSON), and governance standards.
Conduct performance and scalability testing for large data workloads.
Validate integration flows across Data Lake, Synapse, ADF, and Power BI.
Automation Testing
Develop automated data validation and regression frameworks using Python, PySpark, and ADF automated validation frameworks.
Integrate automated tests within CI/CD pipelines using Azure DevOps.
Build reusable automation templates, accelerators, and validation utilities.
Create and maintain test plans, scenarios, and test cases in Azure DevOps or Jira.
Log, track, triage, and validate defects in collaboration with development and data engineering teams.
Publish daily/weekly QA health metrics, defect reports, coverage summaries, and quality dashboards.
Experience and Qualifications
4–10 years of experience in Data Warehouse / Data Engineering QA.
Strong hands‑on expertise with ETL tools such as ADF, SSIS, Informatica, and Databricks.
Expert‑level SQL for complex data validation and reconciliation.
Strong understanding of data warehousing concepts (SCDs, facts/dimensions, star schema).
Strong analytical, debugging, and problem‑solving skills.
Preferred Skills
Quality management and defect lifecycle management.
Integration of automated tests into CI/CD pipelines using Azure DevOps.
#J-18808-Ljbffr
Key Responsibilities
Perform end‑to‑end testing of ETL pipelines built using Azure Data Factory, Azure Databricks, Azure Synapse, and SSIS.
Validate data transformations, mappings, data quality rules, and data lineage.
Conduct source‑to‑target (S2T) reconciliation, data profiling, completeness, and accuracy checks.
Verify schema changes, incremental loads, delta loads, and historical load processes.
Data Migration Testing
Design and execute test strategies for large‑scale on‑prem to cloud or cross‑cloud data migration projects.
Validate ETL/ELT processes and post‑migration data accuracy.
Perform count checks, checksum validation, CDC validation, duplicate checks, and referential integrity validation.
Review and validate data mapping documents, business rules, and acceptance criteria.
Data Lake & Cloud Platform Testing
Test ingestion pipelines into Azure Data Lake Storage (ADLS Gen2) from multiple source systems.
Validate partitioning, folder structures, file formats (Parquet, CSV, JSON), and governance standards.
Conduct performance and scalability testing for large data workloads.
Validate integration flows across Data Lake, Synapse, ADF, and Power BI.
Automation Testing
Develop automated data validation and regression frameworks using Python, PySpark, and ADF automated validation frameworks.
Integrate automated tests within CI/CD pipelines using Azure DevOps.
Build reusable automation templates, accelerators, and validation utilities.
Create and maintain test plans, scenarios, and test cases in Azure DevOps or Jira.
Log, track, triage, and validate defects in collaboration with development and data engineering teams.
Publish daily/weekly QA health metrics, defect reports, coverage summaries, and quality dashboards.
Experience and Qualifications
4–10 years of experience in Data Warehouse / Data Engineering QA.
Strong hands‑on expertise with ETL tools such as ADF, SSIS, Informatica, and Databricks.
Expert‑level SQL for complex data validation and reconciliation.
Strong understanding of data warehousing concepts (SCDs, facts/dimensions, star schema).
Strong analytical, debugging, and problem‑solving skills.
Preferred Skills
Quality management and defect lifecycle management.
Integration of automated tests into CI/CD pipelines using Azure DevOps.
#J-18808-Ljbffr
Vacancy posted 34 minutes ago
Similar jobs that could be interesting for youBased on the Etl Test Automation Engineer - Azure Data Platform in Winnipeg, MB vacancy
- A leading data analytics firm located in London, Ontario is seeking a Mid-Senior Level Data Engineer to lead the rebuild of its data platform. This role involves ensuring data accuracy and automation processes while collaborating with internal and external partners. Key qualifications...SuggestedFull time
- Azure, SQL Server, and Power BI skills support KF Aerospace’s growing data environment from its aviation operations in Kelowna.As a Data Engineer, you will help modernize the enterprise data platform through cloud-based data solutions. The work includes integrating enterprise...Suggested
- A technology solutions provider is looking for a QA & Automation Engineer in Mississauga, Canada. This role involves validating ETL pipelines and automating testing processes across Azure data services. The ideal candidate should have 4-10 years of experience in Data Warehouse...Suggested
- ConeTec Group is seeking an Azure Data Developer to implement, monitor, and enhance our Azure data platform from Burnaby head office. You will build and maintain Azure Data Factory pipelines, optimize SQL code in Azure SQL Database, and ensure secure, timely data delivery for...SuggestedWork at office
- ...Infrastructure as Code (IaC) using CDKTF for Azure AI, data, and database workloads. Build... ...data infrastructure patterns. Implement automated CI/CD pipelines for IaC using Azure DevOps... .... Build and manage Azure Data Factory ETL/ELT pipelines, data flows, triggers, and...Suggested
- Build scalable data platforms with Databricks, Python, and SQL as a Senior Data Engineer working remotely from Canada. Shape reliable data products.This senior position focuses... ...on developing and operating a modern Microsoft Azure data platform. You will design scalable...Remote work
- ...organization undergoing a major data modernization and analytics transformation... ...an experienced Senior Data Engineer with strong expertise across Microsoft Fabric, Azure Data Services, enterprise data... ...modern cloud-based analytics platforms. This opportunity is ideal...Contract workFlexible hours2 days per week3 days per week
- Freshfields seeks a Senior Azure Data Platform Engineer with Databricks and lakehouse expertise to manage secure, scalable enterprise data platforms.This senior role provides day-to-day engineering and technical management across Microsoft Azure, Databricks, Unity Catalog, and...
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems... ...cloud transformation, and building automation-first, GenAI-enabled ecosystems across... ...in functional and automation testing Strong knowledge of ETL testing Experience in leading a team...
- ...Consulting (Canada) Ltd. is seeking a Senior Environmental Data Engineer to build and maintain data tools and workflows that integrate with EQuIS. You will design ETL pipelines, develop secure REST APIs, and deploy solutions on Azure, collaborating with clients to meet data needs and...
- ...of high-quality applications. Responsibilities include leading a QA team, developing test strategies, and working on automation frameworks. Candidates should have extensive experience in data warehouse testing and project management, along with a degree in Computer Science or...
- ...Price Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP •... ...• Guide the design of reusable test data, test environments, automated suites, and... ...'s degree in Computer Science, Software Engineering, Information Technology, Computer Engineering...
- Shape Azure data delivery through ETL, data modeling, and Power BI across a Wealth Management modernization project. Work within the delivery team alongside architects and developers.This senior data analyst supports the GPAP modernization project in Wealth Management. The...
- ...is seeking a Senior Software Developer to manage data migration projects, focusing on transferring high-sensitive data to Azure SQL Database. The ideal candidate will have over... ...of experience with database administration and ETL processes. Proficiency in Azure Data Factory and...
- Shape the future of data analytics with your expertise as a Data Product... ...-ready data products using Azure technologies. As a key... ...capabilities • Develop sophisticated ETL workflows using Azure Data... ...solutions • Familiarity with AI for automation in the data lifecycle...
- We are looking for a Snowflake Data Engineer with hands‑on experience in data engineering, ETL/ELT development, and cloud-based data platforms. The candidate will develop scalable data pipelines and support data integration, transformation, and analytics requirements. Key...
- ...Northland Power is seeking a seasoned Data Architect / Data Engineer to own and evolve our Azure-based data platform. You will design scalable data warehouse and lakehouse solutions, model enterprise data, and deliver trusted data marts to empower self-service analytics and...
- ...division of Amphenol Corporation, is seeking a Data Engineer in Markham to build, integrate, and operate the enterprise data platform. You will connect global applications and... ...The role emphasizes strong SQL and Python, automated testing, and disciplined software engineering...
- ...based in Mountain View, CA, is seeking a Staff/Sr. Staff Test Platform & Firmware Integration Engineer to own the firmware bring-up for SLT boards, build the... ...-speed interconnect products, with a strong focus on automation and reliability. The role emphasizes hands-on embedded...
$100k - $120k per year
Senior Test Automation EngineerPureFacts Financial Solutions Toronto, Ontario, Canada About this... ...management firms. The PureRevenue™ Platform helps organizations maximize revenue potential... ...self‑motivated Senior Test Automation Engineer to join our Quality Engineering team....- ...RBC is seeking a Lead Data Quality Engineer to create and execute comprehensive data testing strategies across platforms and ETL processes. You will mentor teams, validate data integrity, and drive governance-aligned test data solutions in a financial services setting. You...
- ...years Job DescriptionWe are seeking an experienced L4 Engineer with strong hands‑on expertise in modern data engineering, cloud platforms, and application development. The successful candidate will work across Azure data services, Databricks workflows, and Java/Python‑...2 days per week3 days per week
- ...Myticas Consulting Inc. is seeking two Senior Azure Data Platform Technical Consultants for a consulting engagement with a major banking client in Montreal. You will provide hands-on engineering support for assessment and remediation of an enterprise Azure data platform...
- CareRx Corporation is seeking a Data Engineer to operate and evolve our Azure and Microsoft Fabric data platforms. You will ensure data flows, connect new sources, and build pipelines to transform raw data into trusted structures for analytics, reporting, and AI/ML operations...Work at office
- Bridgenext in Canada is seeking a Senior Data Engineer to design, build, and scale our next-generation data platform. You will own data pipelines from ingestion to analytics, collaborating with tech leads, analysts, and product teams to turn raw data into strategic assets....Work at office
- A leading data solutions firm in Toronto is seeking a Senior ETL Developer to design and implement data integration solutions. Candidates should have over 7 years of experience, including extensive knowledge in Azure Data Factory and strong SQL skills. Responsibilities include...
- Snowflake Data Engineers with strong SQL and Python skills will build cloud-based pipelines supporting... ...to five years of data engineering or ETL development experience. You will develop... ...architecture and CDCFamiliarity with Git, Azure DevOps, and CI/CDBring Snowflake, SQL,...
- ...seeking a Senior Software Developer specializing in ETL solutions. Responsibilities include designing data pipelines, troubleshooting software issues, and collaborating... ...in software development with a strong focus on Azure Data Factory and PowerBI. This role offers...
$105k - $135k per year
...services, delivering innovative solutions to some of the world's largest institutional clients. We are seeking a Test Engineer specializing in Data and data platforms (Databricks) to ensure the quality and reliability of our data solutions. ResponsibilitiesAbout the RoleAs...Flexible hours- A leading consulting firm in Toronto is seeking a Cloud Platform Engineer to support its cloud strategy. The ideal candidate will have extensive experience with cloud technologies including Typescript, AWS CDK, and container orchestration tools such as Kubernetes. This role...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Etl Test Automation Engineer - Azure Data Platform. Be the first to apply!
Related searches
- test engineer Winnipeg, MB
- test automation developer Winnipeg, MB
- field test engineer Winnipeg, MB
- test automation engineer Winnipeg, MB
- drive test engineer Winnipeg, MB
- rf test engineer Winnipeg, MB
- automation engineer - process controls systems Winnipeg, MB
- control and automation engineer Winnipeg, MB
- automation specialist Winnipeg, MB
- electrical automation engineer Winnipeg, MB

