Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing)
Full-time
Astra North Infoteck Inc.
Senior Data Engineer | AWS Cloud | Big Data | ETL | Netezza | Spark | Kafka | Data Platform Modernization
Job Summary
The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing.
This role involves working on data platform modernization, cloud migrations, Data Warehousing, and ETL in a fast-paced enterprise environment.
Required Technical Skills
Cloud Technologies
• Strong experience in AWS Cloud services:
• EMR
• EC2
• S3
• VPC
• RDS
• Redshift
• AWS Glue
• IAM
• CloudWatch
• CloudFormation
• Experience with:
• Airflow (or AWS Managed Workflows)
Databases
• Experience working with:
• Netezza (Mandatory)
• SQL-based systems:
• SQL Server
• PostgreSQL
• Data warehouses:
• Teradata
• Redshift
• Netezza
ETL Tools
• Hands-on experience with:
• SSIS
• Pentaho or similar ETL tools
Programming & Scripting
• Strong proficiency in:
• SQL
• Shell scripting
• Good to have:
• Python
Operating Systems
• Strong experience in Unix/Linux environments.
Key Qualifications
• 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
Key Responsibilities
• Design, develop, maintain, and support scalable data pipelines using Big Data and AWS technologies.
• Lead and support data platform migration initiatives (On-Prem to AWS Cloud), ideally with Netezza background.
• Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar.
• Implement and manage AWS services such as:
• EMR
• S3
• EC2
• Redshift
• Glue
• Airflow
• Build and optimize data workflows and orchestration pipelines using Airflow.
• Work with real-time streaming technologies such as:
• Kafka
• Spark Streaming
• Perform data ingestion, transformation, and validation from multiple data sources.
• Optimize SQL queries for performance and scalability.
• Monitor system performance, troubleshoot issues, and ensure system reliability.
• Collaborate with cross-functional teams including:
• Developers
• Architects
• Infrastructure teams.
Vacancy posted 16 hours ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing) in Toronto, ON vacancy
- ...Job Title: Senior Platform Engineer (AWS, Big Data, Data Engineering, Netezza, Data Warehouse) Location: Toronto, ON Work Model: Hybrid (2 days per week in-person at Toronto office preferred) Skills Required: • Data Warehouse • Digital : Microsoft Power...Amazon Web ServiceSeniorBig dataContract workWork at office2 days per week
$70 - $80 per hour
...Role: Senior Data Engineer Rate : $60-70/hr T4; $70-80/hr INC Length : 6 months (strong potential for extension) Location : Downtown... ...and perform deep analysis ~ Solid understanding of data warehousing concepts ~ Experience working in cloud environments (GCP...Amazon Web ServiceSeniorFlexible hours$40 - $45 per hour
...Job Title: ETL QA Location: Toronto, ON Work Arrangement: Hybrid-2 Days onsite... ...testing, including validation of complex data transformation and migration processes.... ...and practical experience with Netezza, SQL, HBase, Kafka, and Hive for data validation and testing...SuggestedContract work- ...AWS Data Engineer – ETL, Python & SQL Toronto, ON Hybrid (2 days per week in-person at Toronto office preferred) Skills: Digital : Amazon Web Service (AWS) Cloud Computing~ Digital : Python for Data Science Digital : Google Data Engineering...Amazon Web ServiceContract workWork at officeShift work2 days per week
- ...About the role This is a full-time, high-impact position for a Senior Data Engineer with expertise in Databricks , dbt , and Apache Airflow... ...Salesforce Life Sciences Cloud, integrated with an underlying AWS S3 cloud environment and Databricks data warehouse. Your main...Amazon Web ServiceSeniorFull timeContract workRemote workWorldwideFlexible hoursShift work
$50 - $53 per hour
...Job Title: AWS DevOps Engineer with strong Coding skills Location: Toronto, ON Work Arrangement: Hybrid (2-3 Day/week) Employment Type: Contract Duration: 12 months Pay Rate: CAD 50-53/hour Incorporated Domain: BFSI Application Deadline: July 30th, 2026...Amazon Web ServiceContract work2 days per week3 days per week$50 - $52 per hour
...Job Title: ETL DataStage Developer Location: Toronto, ON Work Arrangement: Hybrid –... ...implementation, and production support of AML data solutions in the Enterprise Data Lake (EDL... ...& Experience • 6+ years of ETL/Data Engineering experience. • Strong hands-on experience...Contract work2 days per week3 days per week- ...Job Description Role: Sr. Data Engineer Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM) Role Summary: Senior Data Engineer (Databricks-Focused) In-Person Interview... ...and streaming pipelines using Apache Spark (PySpark/Scala). Own end-to-end data...Amazon Web ServiceSeniorFull time
- ...Overview We are seeking a highly analytical and business-focused Senior Data Analyst to support data-driven decision-making across our Life... ...analytics. Experience building automated reporting, dashboards, and ETL processes. Advanced Microsoft Excel skills. Core...SeniorWork at office
$50 - $55 per hour
...Job Responsibility: Role: Big Data Engineer Location: Toronto- Hybrid Hire Type: Contract JD: 6-8 years of experience??-Experience in... ...OpenShift containers), DevOps (Jenkins, UCD etc.) and Cloud (Azure, AWS etc.)-Undergraduate degree coupled with technology development...Amazon Web ServiceBig dataHourly payFull timeContract workFixed term contractRemote workMonday to friday- ...Job Title: Data Office Developer (SQL, Python, ETL, Data Warehousing) Role: Data Office Developer Key Responsibilities • Design, develop, and maintain... ...business analysts, data analysts, architects, quality engineering teams, and business stakeholders to understand data...Permanent employmentWork at office
- ...seeking a highly skilled Ab Initio Developer (Big Data & Hadoop) to join our Agile Scrum team... ...and support scalable data integration and ETL solutions using Ab Initio. Build and... ...standards. Collaborate with architects, data engineers, business analysts, and stakeholders to...Big dataPermanent employmentFull timeLocal area
- ...client in their search for a talented Sr. Data Engineer to help evolve their core data platform... ...including pipeline orchestration, data warehousing, and machine learning - Data solutions... ...- Machine learning and experimentation: AWS SageMaker - Visualization and reporting...Amazon Web ServiceSenior
- ...requirements analysis, aided by strong data and technical system analysis, to solutioning... ...-on experience with data analysis and ETL (SQL, Python, Kafka, Jupyter, Java, XML, and JSON) High... ...with internal customers, as well as senior management. A recognized degree in...SeniorPermanent employment
$48 - $50 per hour
...Job Title: Sr. Software Engineer (Python, AWS Lambda) Location: Toronto, ON Work Arrangement: Hybrid-1 Days onsite Employment Type: Contract Duration: 12 Months Domain: BFSI Pay Rate: CAD 48-50/hour Incorporated Application Deadline: Aug 30th, 2026 SKILLS...Amazon Web ServiceSeniorContract work$120k - $160k per year
...’s most trusted platforms for financial data access, enrichment, and money movement.... ...in. The Role We're hiring our Senior Data Engineer (Data / ML Platform) to stand up data engineering... ...Expertise: Strong experience with ETL/ELT development, data modeling, schema...SeniorFull timeContract workRemote workFlexible hours- ...doing As a member of CIBC's team, the Senior Application Developer is... ...exercising considerable latitude to conduct data source analysis and negotiate with... ...Azure and Databricks. Understanding of ETL processes. Experience with Hadoop and other big data platformsAbility to manage...SeniorBig dataFull timeRemote work
- ...Senior Kafka Developer | Apache Kafka | Kafka Streams | Java | REST APIs | AWS | Event-Driven Architecture Job Description Location: Toronto, ON Work Model:... ...maintain large-scale event-driven and real-time data streaming solutions using Apache Kafka. The...Amazon Web ServiceSeniorPermanent employmentWork at office2 days per week
- ...Business owners are tired of the big banks’ monopoly and are looking... ...You'll Be Doing Own Venn’s data infrastructure, including... ...leadership decisions. Build reliable ETL and ELT pipelines that ingest,... ...the company. Partner with engineering on event schemas, tracking...SeniorFull timeInternship
- ...Leading infrastructure vendors, engineering firms, and construction... ...seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights... ...the Dream Work as we tackle big challenges and celebrate wins... ...Strong understanding of data warehousing principles and experience working...Full timeWork at officeImmediate start3 days per week
- ...Job Description: ETL QA* Toronto, ON Hybrid (2 days per week in Toronto... ...scripts or procedures • Preparing data for testing • Test system modifications... ...knowledge and working experience in Netezza, Sql, Hbase, Kafka and hive. • Experience working with...Amazon Web ServiceContract workWork at office2 days per week
$58k - $102k per year
...mentoring and on the job coaching -- As a Data & AI Platform Engineer on the AI & Data Transformation team,... ...across cloud ecosystems such as Azure, AWS, Snowflake, and Databricks. •... ...frameworks, leveraging modern patterns such as ETL/ELT, streaming, and event-driven...Amazon Web ServiceSeniorPermanent employmentFlexible hours$95k - $145k per year
Data Engineering Specialist - Databricks Position Description Are you an experienced Data Engineering... ...and enabling data engineering or ETL in organizations, a genuine flair for solving... ...you. Mandatory Skills: Databricks and Spark/PySpark (hands-on experience required)....Amazon Web ServiceSeniorBig data- ...ShyftLabs At ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune... ...ShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and... ...-on expertise with Databricks, Apache Spark, Python, SQL, and modern cloud...SeniorFull time
- ...consultants bring deep expertise in Data Science, Machine Learning and... ...team in the world. The Data Engineer will be responsible for... ...engineering with a heavy focus on the AWS Cloud stack and AI. ~8+ years... ...frameworks like Apache Spark. ~ Understanding of Datawarehouse...Amazon Web ServiceLocal area
$135k - $210k per year
...Overview: Guidepoint seeks an experienced Data/AI Engineer as an integral member of the Toronto-... ...AI and best-in-class MLOps. The Senior AI/ML Engineer will be a primary contributor... ...a major cloud platform (Azure preferred, AWS/GCP acceptable) using containerization (Docker...Amazon Web ServiceSeniorFull timeWorldwide$95k - $145k per year
Senior Data Engineering Consultant Position Description This role is hybrid and time.requires you to be at our downtown Toronto and/or Client... .... The ideal candidate brings strong expertise in Spark 3, Scala, and Python, with experience building distributed data...SeniorBig dataWork at office- ...ETL QA Test Analyst Location: • Toronto, ON • Hybrid – 2 days per... ...scripts, and procedures. • Prepare data for testing. • Test system modifications... ...and working experience with: • Netezza • SQL • HBase • Kafka • Hive • Experience working...Amazon Web ServiceContract workWork at office2 days per week
- ...you will be doing: Builds out a new data engineering platform for Tangerine to enable business... ...strategy and platform advising senior leadership and executing on the vision... ...hands-on experience with data and data warehousing technologies ~ Experience shaping and...SeniorFull timeFlexible hours
$116k - $235.1k per year
...About the Role: We're hiring Senior and Staff Data Platform Engineers to join the Data Infrastructure teams in Toronto. Together these teams own the infrastructure that processes billions of events per day: Spark-on-Kubernetes, Flink and Kinesis pipelines, a multi-petabyte...Amazon Web ServiceSeniorLong term contractRemplacementFull timeTemporary workWork at officeLocal areaFlexible hours2 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing). Be the first to apply!
Related searches
- big data engineer Toronto, ON
- data integration developer Toronto, ON
- junior data engineer Toronto, ON
- data engineer Toronto, ON
- data cabling engineer Toronto, ON
- gcp data engineer Toronto, ON
- information engineer Toronto, ON
- remote data engineer Toronto, ON
- python data engineer Toronto, ON
- data centre engineer Toronto, ON