Etl Test Automation Engineer - Azure Data Platform
Astra-North Infoteck Inc.
The QA & Automation Engineer will be responsible for validating ETL pipelines, data migration processes, and cloud data platform integrations across Azure services. This role involves hands‑on testing of large-scale data platforms, automation development, advanced SQL validation, and ensuring end‑to‑end data quality across enterprise data engineering initiatives.
Key Responsibilities
Perform end‑to‑end testing of ETL pipelines built using Azure Data Factory, Azure Databricks, Azure Synapse, and SSIS.
Validate data transformations, mappings, data quality rules, and data lineage.
Conduct source‑to‑target (S2T) reconciliation, data profiling, completeness, and accuracy checks.
Verify schema changes, incremental loads, delta loads, and historical load processes.
Data Migration Testing
Design and execute test strategies for large‑scale on‑prem to cloud or cross‑cloud data migration projects.
Validate ETL/ELT processes and post‑migration data accuracy.
Perform count checks, checksum validation, CDC validation, duplicate checks, and referential integrity validation.
Review and validate data mapping documents, business rules, and acceptance criteria.
Data Lake & Cloud Platform Testing
Test ingestion pipelines into Azure Data Lake Storage (ADLS Gen2) from multiple source systems.
Validate partitioning, folder structures, file formats (Parquet, CSV, JSON), and governance standards.
Conduct performance and scalability testing for large data workloads.
Validate integration flows across Data Lake, Synapse, ADF, and Power BI.
Automation Testing
Develop automated data validation and regression frameworks using Python, PySpark, and ADF automated validation frameworks.
Integrate automated tests within CI/CD pipelines using Azure DevOps.
Build reusable automation templates, accelerators, and validation utilities.
Create and maintain test plans, scenarios, and test cases in Azure DevOps or Jira.
Log, track, triage, and validate defects in collaboration with development and data engineering teams.
Publish daily/weekly QA health metrics, defect reports, coverage summaries, and quality dashboards.
Experience and Qualifications
4–10 years of experience in Data Warehouse / Data Engineering QA.
Strong hands‑on expertise with ETL tools such as ADF, SSIS, Informatica, and Databricks.
Expert‑level SQL for complex data validation and reconciliation.
Strong understanding of data warehousing concepts (SCDs, facts/dimensions, star schema).
Strong analytical, debugging, and problem‑solving skills.
Preferred Skills
Quality management and defect lifecycle management.
Integration of automated tests into CI/CD pipelines using Azure DevOps.
#J-18808-Ljbffr
Key Responsibilities
Perform end‑to‑end testing of ETL pipelines built using Azure Data Factory, Azure Databricks, Azure Synapse, and SSIS.
Validate data transformations, mappings, data quality rules, and data lineage.
Conduct source‑to‑target (S2T) reconciliation, data profiling, completeness, and accuracy checks.
Verify schema changes, incremental loads, delta loads, and historical load processes.
Data Migration Testing
Design and execute test strategies for large‑scale on‑prem to cloud or cross‑cloud data migration projects.
Validate ETL/ELT processes and post‑migration data accuracy.
Perform count checks, checksum validation, CDC validation, duplicate checks, and referential integrity validation.
Review and validate data mapping documents, business rules, and acceptance criteria.
Data Lake & Cloud Platform Testing
Test ingestion pipelines into Azure Data Lake Storage (ADLS Gen2) from multiple source systems.
Validate partitioning, folder structures, file formats (Parquet, CSV, JSON), and governance standards.
Conduct performance and scalability testing for large data workloads.
Validate integration flows across Data Lake, Synapse, ADF, and Power BI.
Automation Testing
Develop automated data validation and regression frameworks using Python, PySpark, and ADF automated validation frameworks.
Integrate automated tests within CI/CD pipelines using Azure DevOps.
Build reusable automation templates, accelerators, and validation utilities.
Create and maintain test plans, scenarios, and test cases in Azure DevOps or Jira.
Log, track, triage, and validate defects in collaboration with development and data engineering teams.
Publish daily/weekly QA health metrics, defect reports, coverage summaries, and quality dashboards.
Experience and Qualifications
4–10 years of experience in Data Warehouse / Data Engineering QA.
Strong hands‑on expertise with ETL tools such as ADF, SSIS, Informatica, and Databricks.
Expert‑level SQL for complex data validation and reconciliation.
Strong understanding of data warehousing concepts (SCDs, facts/dimensions, star schema).
Strong analytical, debugging, and problem‑solving skills.
Preferred Skills
Quality management and defect lifecycle management.
Integration of automated tests into CI/CD pipelines using Azure DevOps.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Etl Test Automation Engineer - Azure Data Platform in Winnipeg, MB vacancy
- A leading data analytics firm located in London, Ontario is seeking a Mid-Senior Level Data Engineer to lead the rebuild of its data platform. This role involves ensuring data accuracy and automation processes while collaborating with internal and external partners. Key qualifications...SuggestedFull time
- A technology solutions provider is looking for a QA & Automation Engineer in Mississauga, Canada. This role involves validating ETL pipelines and automating testing processes across Azure data services. The ideal candidate should have 4-10 years of experience in Data Warehouse...Suggested
- Technology|Analytics - Packages|Python - Big Data, Technology|Cloud Integration|Azure Data Factory (ADF)... ...experienced Azure Databricks Data Engineer to design, develop, and optimize... ...Qualifications Design and develop scalable ETL/ELT pipelines using Azure Databricks...SuggestedRelocation
- Build secure Azure data platforms for BDO clients using Databricks, Delta Lake, and scalable pipeline engineering expertise.BDO Digital is hiring a Senior Data Engineer focused on Azure and Databricks within Technology Advisory Services. This position develops scalable ETL,...Suggested
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems... ...cloud transformation, and building automation-first, GenAI-enabled ecosystems across... ...in functional and automation testing Strong knowledge of ETL testing Experience in leading a team...Suggested
- Build scalable data platforms with Databricks, Python, and SQL as a Senior Data Engineer working remotely from Canada. Shape reliable data products.This senior position focuses... ...on developing and operating a modern Microsoft Azure data platform. You will design scalable...Remote work
- ...organization undergoing a major data modernization and analytics transformation... ...an experienced Senior Data Engineer with strong expertise across Microsoft Fabric, Azure Data Services, enterprise data... ...modern cloud-based analytics platforms. This opportunity is ideal...Contract workFlexible hours2 days per week3 days per week
- ...is seeking a Senior Software Developer to manage data migration projects, focusing on transferring high-sensitive data to Azure SQL Database. The ideal candidate will have over... ...of experience with database administration and ETL processes. Proficiency in Azure Data Factory and...
- ...Consulting (Canada) Ltd. is seeking a Senior Environmental Data Engineer to build and maintain data tools and workflows that integrate with EQuIS. You will design ETL pipelines, develop secure REST APIs, and deploy solutions on Azure, collaborating with clients to meet data needs and...
- ...Price Café offers free Tea and Coffee. Test Automation Lead Enterprise Systems • IFS ERP •... ...• Guide the design of reusable test data, test environments, automated suites, and... ...'s degree in Computer Science, Software Engineering, Information Technology, Computer Engineering...
- ...of high-quality applications. Responsibilities include leading a QA team, developing test strategies, and working on automation frameworks. Candidates should have extensive experience in data warehouse testing and project management, along with a degree in Computer Science or...
- ...Canada) is seeking a Senior Environmental Data Engineer to build and maintain data workflows... ...EarthSoft) and REST APIs. You will design ETL pipelines for lab, field, and logger data... ...data solutions. You will deploy and manage Azure-based services, strengthen engineering practices...
- Freshfields seeks a Senior Azure Data Platform Engineer with Databricks and lakehouse expertise to manage secure, scalable enterprise data platforms.This senior role provides day-to-day engineering and technical management across Microsoft Azure, Databricks, Unity Catalog, and...
- ...Northland Power is seeking a seasoned Data Architect / Data Engineer to own and evolve our Azure-based data platform. You will design scalable data warehouse and lakehouse solutions, model enterprise data, and deliver trusted data marts to empower self-service analytics and...
- Shape the future of data analytics with your expertise as a Data Product... ...-ready data products using Azure technologies. As a key... ...capabilities • Develop sophisticated ETL workflows using Azure Data... ...solutions • Familiarity with AI for automation in the data lifecycle...
$100k - $120k per year
Senior Test Automation EngineerPureFacts Financial Solutions Toronto, Ontario, Canada About this... ...management firms. The PureRevenue™ Platform helps organizations maximize revenue potential... ...self‑motivated Senior Test Automation Engineer to join our Quality Engineering team....- ...based in Mountain View, CA, is seeking a Staff/Sr. Staff Test Platform & Firmware Integration Engineer to own the firmware bring-up for SLT boards, build the... ...-speed interconnect products, with a strong focus on automation and reliability. The role emphasizes hands-on embedded...
- ...Myticas Consulting Inc. is seeking two Senior Azure Data Platform Technical Consultants for a consulting engagement with a major banking client in Montreal. You will provide hands-on engineering support for assessment and remediation of an enterprise Azure data platform...
- ...lead the development and maintenance of test automation frameworks and scripts for Guidewire and... ...test automation. Create and manage test data to support various testing scenarios and... .... Mentor and guide junior automation engineers. Conduct code reviews for automated...Full timeWork at office
- A leading data solutions firm in Toronto is seeking a Senior ETL Developer to design and implement data integration solutions. Candidates should have over 7 years of experience, including extensive knowledge in Azure Data Factory and strong SQL skills. Responsibilities include...
- ...RBC is seeking a Lead Data Quality Engineer to create and execute comprehensive data testing strategies across platforms and ETL processes. You will mentor teams, validate data integrity, and drive governance-aligned test data solutions in a financial services setting. You...
- ...seeking a Senior Software Developer specializing in ETL solutions. Responsibilities include designing data pipelines, troubleshooting software issues, and collaborating... ...in software development with a strong focus on Azure Data Factory and PowerBI. This role offers...
- ...years Job DescriptionWe are seeking an experienced L4 Engineer with strong hands‑on expertise in modern data engineering, cloud platforms, and application development. The successful candidate will work across Azure data services, Databricks workflows, and Java/Python‑...2 days per week3 days per week
- A leading consulting firm in Toronto is seeking a Cloud Platform Engineer to support its cloud strategy. The ideal candidate will have extensive experience with cloud technologies including Typescript, AWS CDK, and container orchestration tools such as Kubernetes. This role...Work at office
- ...Compunnel, Inc. is seeking an Azure Cloud Data Engineer responsible for designing and maintaining scalable cloud-based data platforms. Your role includes developing high-performance ETL pipelines and optimizing large-scale data processing solutions within Azure environments...
$105k - $135k per year
Job Title: Test Engineer – DataJob ID: 90661 Location: Toronto, Ontario Overview:Our client provides specialist... ...professional development. As a Test Engineer – Data, you will be responsible for developing and implementing automated testing frameworks for Databricks-based...Worldwide3 days per week$90k - $110k per year
...both direct to consumer and business to business revenues. Our platforms and services are trusted by over 1000 clients globally,... ...sizes all over the world. Two Circles is looking for a "Data Engineer in Test" to join our dynamic KORE Intelligence Platform team. In this...Work at office$105k - $135k per year
...services, delivering innovative solutions to some of the world's largest institutional clients. We are seeking a Test Engineer specializing in Data and data platforms (Databricks) to ensure the quality and reliability of our data solutions. ResponsibilitiesAbout the RoleAs...Flexible hours$92.19k - $171.21k per year
We are seeking a Senior Data Engineer - Azure to our team who will be able to bring their unique ideas, viewpoints, and technical experience.The... ...Power BI, Azure API apps, or other modern visualization platforms.Mentor other staff members and facilitate knowledge transfer...InternshipLocal areaFlexible hours- Elevate your career with Scotiabank as an Azure Platform Engineer. Contribute to cutting-edge data and AI platforms while collaborating with senior engineers to enhance operational efficiency. This position within the Enterprise Data & AI Technology organization calls for technical...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Etl Test Automation Engineer - Azure Data Platform. Be the first to apply!
Related searches
- test engineer Winnipeg, MB
- rf test engineer Winnipeg, MB
- test automation developer Winnipeg, MB
- test automation engineer Winnipeg, MB
- drive test engineer Winnipeg, MB
- field test engineer Winnipeg, MB
- test automation specialist Winnipeg, MB
- automation application engineer Winnipeg, MB
- control and automation engineer Winnipeg, MB
- electrical automation engineer Winnipeg, MB

