Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing)
Full-time
Astra North Infoteck Inc.
Senior Data Engineer | AWS Cloud | Big Data | ETL | Netezza | Spark | Kafka | Data Platform Modernization
Job Summary
The ideal candidate will have strong expertise in designing, developing, and supporting scalable data pipelines and distributed systems, along with hands-on experience in Big Data ecosystem tools, AWS services, and real-time data processing.
This role involves working on data platform modernization, cloud migrations, Data Warehousing, and ETL in a fast-paced enterprise environment.
Required Technical Skills
Cloud Technologies
• Strong experience in AWS Cloud services:
• EMR
• EC2
• S3
• VPC
• RDS
• Redshift
• AWS Glue
• IAM
• CloudWatch
• CloudFormation
• Experience with:
• Airflow (or AWS Managed Workflows)
Databases
• Experience working with:
• Netezza (Mandatory)
• SQL-based systems:
• SQL Server
• PostgreSQL
• Data warehouses:
• Teradata
• Redshift
• Netezza
ETL Tools
• Hands-on experience with:
• SSIS
• Pentaho or similar ETL tools
Programming & Scripting
• Strong proficiency in:
• SQL
• Shell scripting
• Good to have:
• Python
Operating Systems
• Strong experience in Unix/Linux environments.
Key Qualifications
• 10+ years of experience in Data Engineering / Big Data / Platform Engineering.
Key Responsibilities
• Design, develop, maintain, and support scalable data pipelines using Big Data and AWS technologies.
• Lead and support data platform migration initiatives (On-Prem to AWS Cloud), ideally with Netezza background.
• Develop and manage ETL/ELT processes using tools like SSIS, Pentaho, or similar.
• Implement and manage AWS services such as:
• EMR
• S3
• EC2
• Redshift
• Glue
• Airflow
• Build and optimize data workflows and orchestration pipelines using Airflow.
• Work with real-time streaming technologies such as:
• Kafka
• Spark Streaming
• Perform data ingestion, transformation, and validation from multiple data sources.
• Optimize SQL queries for performance and scalability.
• Monitor system performance, troubleshoot issues, and ensure system reliability.
• Collaborate with cross-functional teams including:
• Developers
• Architects
• Infrastructure teams.
Vacancy posted 29 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing) in Toronto, ON vacancy
- ...Role: AWS Big Data Platform Engineer (Netezza to AWS Migration) Hybrid: 2 days a week in office Job Summary: We are seeking a highly skilled Senior Platform Engineer with extensive experience in Big Data technologies, AWS Cloud, and data platform engineering. The...Amazon Web ServiceSeniorBig dataContract workWork at office2 days per week
- ...AWS Data Engineer – ETL, Python & SQL Toronto, ON Hybrid (2 days per week in-person at Toronto office preferred) Skills: Digital : Amazon Web Service (AWS) Cloud Computing~ Digital : Python for Data Science Digital : Google Data Engineering...Amazon Web ServiceContract workWork at officeShift work2 days per week
usd84.46k - usd100k per year
...Senior Data Engineer Join Livingston and grow your career in the constantly changing world of international trade. Livingston is a market... ...DUTIES & RESPONSIBILITIES Design, build, and maintain scalable ETL/ELT pipelines that ingest data from transportation management...Amazon Web ServiceSeniorLong term contractFull timeFlexible hours$120k - $145k per year
...working people who are lifelong learners. About The Role As a Senior Data Engineer you’ll be tasked with designing, building, and maintaining... ...data modelling, data extraction, transformation, and loading (ETL/ELT). Identify and recommend innovative solutions to...SeniorBig dataFull timeWork from homeFlexible hours- ...AWS Data Platform Engineering Lead – AWS Data Services Location: Toronto: Hybrid 2 days a week in office Role Overview We are seeking a Senior Data Engineer with strong AWS expertise to lead the design, development, and evolution of scalable, high-performance...Amazon Web ServiceSeniorLong term contractContract workWork at office2 days per week
$95k - $145k per year
Senior Data Platform Engineering Specialist Position Description Location: Toronto/Montreal Preferred Languages: Bilingual (English/French) Preferred... ...), Cloud Data Warehouses (e.g., Snowflake), and robust ETL/ELT pipelines. Develop reusable data platform...Amazon Web ServiceSeniorBig dataLong term contractPermanent employmentFull time- We are seeking a highly accomplished Senior Software Developer - ETL for an enterprise-level contract opportunity based in Toronto. In this role, you will take on a premier data engineering and integration capacity, specializing in designing, developing, migrating, and optimizing...Amazon Web ServiceSeniorContract workRemote workFlexible hours3 days per week
- ...Job Description Role: Sr. Data Engineer Work Model: Hybrid 2 days onsite (9:00 AM 5:00 PM) Role Summary: Senior Data Engineer (Databricks-Focused) In-Person Interview... ...and streaming pipelines using Apache Spark (PySpark/Scala). Own end-to-end data...Amazon Web ServiceSeniorFull time
- ...Job Title: Data Office Developer (SQL, Python, ETL, Data Warehousing) Role: Data Office Developer Key Responsibilities • Design, develop, and maintain... ...business analysts, data analysts, architects, quality engineering teams, and business stakeholders to understand data...Permanent employmentWork at office
- We are looking for a Software Engineer specializing in Python to design, develop, and potentially... ...scalable cloud-native applications and ETL data pipelines. The role includes API... ...Develop cloud-native applications (AWS preferred) Implement...Amazon Web ServiceSeniorFor subcontractor
- ...A highly skilled and experienced ETL Developer to design, develop, and maintain robust data integration solutions. The ideal... ...Management Cloud (IDMC), PL/SQL, and data warehousing, with a strong background in... ...technologies (Azure, Google, AWS) ~ Advanced skills and hands-on...Amazon Web ServiceSeniorContract workFlexible hours
- ...AWS Data Engineer - AWS Lake Formation, Terraform, DFPaaS, Experience: 10+ years Location: Toronto, ON Work Model: Hybrid... ...Formation Amazon S3, Glue Data Catalog, EMR/EC2, Athena Apache Spark AWS Lambda, API Gateway, EventBridge, SNS, SQS Amazon...Amazon Web ServiceSeniorContract work3 days per week
$57.46 - $67.04 per hour
We are seeking a highly accomplished Senior Data Engineer for an enterprise-level contract opportunity based in Toronto. In this role, you will... ...capacity within data platform development, enterprise data warehousing, and business intelligence streams, specializing in...SeniorContract workRemote work2 days per week$68.87k - $147.5k per year
...At Capgemini Engineering, the world leader in engineering services, we... ...We're looking for a hands-on Senior Network Platform Engineer to build... ...-native infrastructure on AWS. The ideal candidate will have... ...AI, generative AI, cloud and data, combined with its deep industry...Amazon Web ServiceSeniorPermanent employmentFull timeLocal areaRemote work- ...client in their search for a talented Sr. Data Engineer to help evolve their core data platform... ...including pipeline orchestration, data warehousing, and machine learning - Data solutions... ...- Machine learning and experimentation: AWS SageMaker - Visualization and reporting...Amazon Web ServiceSenior
- ...Are you a Data Engineer with experience building cloud-based data solutions and transforming... ...data models, and leverage enterprise-grade ETL tools such as Informatica to deliver secure... ...‑time ETL/ELT flows (Azure Event Hubs, Kafka, Spark Streaming) to ingest EHR data and...Full time
- ...landscape. We are part of the Global Engineering and Operations Functions team and... ...an energetic and results-oriented Senior BI developer with Azure exposure and deep data analysis background to join our... ...Support on current environment and ETL data pipeline Conduct source data...SeniorPermanent employmentFlexible hours
- ...ETL Data Tester – ETL Testing, Data Warehouse, SQL, UNIX/Linux, Informatica Key Responsibilities • Perform end-to-end testing of ETL processes, data pipelines, and Data Warehouse solutions • Validate source-to-target data mappings, data transformations, and business...Permanent employment
- We are seeking an experienced Senior Software Developer - ETL to lead the design, development, and optimization of enterprise-grade data pipelines and data warehousing solutions. In this role, you will extract, transform, and load complex datasets from diverse sources into...SeniorContract workWork at officeFlexible hours
- ...Reference no. R2867104 Position title: Lead Data and AI Engineer Department: US Commercial Data Engineering Location: Toronto,... ...distributed processing solutions using technologies such as Spark, Kafka, Snowflake, Hadoop, or similar Strong experience with cloud...Amazon Web ServiceLong term contractWork from home
- ...Leading infrastructure vendors, engineering firms, and construction... ...seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights... ...the Dream Work as we tackle big challenges and celebrate wins... ...Strong understanding of data warehousing principles and experience working...Full timeWork at officeImmediate start3 days per week
$80k - $90k per year
...commerce for everyday shoppers. As a Data Engineer on Fluent's Data Engineering team, you will... ...an expert in Python, SQL, and Spark. You will work closely with the Data... ...environment leveraging Data Engineering and Data Warehousing features such as Jobs & Workflows,...Full timeWork at officeRemote work$100 per hour
...Role: Senior Data Engineer Structure: Hybrid (2 days onsite / 3 days remote) - Toronto Duration: 6-Month Contract Pay Rate: up to $100... ...and deploy scalable data engineering pipelines using Snowflake, AWS and Matillion Develop high-quality, reusable and maintainable...Amazon Web ServiceSeniorContract workRemote work- ...We’re looking for a Machine Learning Data Engineer to enable data and ML capabilities that directly... ...using modern data and ML tooling (e.g., Spark, Airflow, feature stores, ML platforms)... ...infrastructure and public cloud platforms (i.e. AWS) A solid understanding of the ML data...Amazon Web ServiceFull timeLocal areaFlexible hours
- ...Terminal builds telematics data infrastructure for the commercial... ...Were looking for a software engineering intern whos excited about building... .... Youll work closely with our senior software engineers... ...Exposure to cloud platforms (AWS GCP or Azure) Experience working...Amazon Web ServiceSeniorInternshipWork at office
- ...Remote (US or Canada) Seeking a hands-on Senior Security Data Solution Architect with 7+ years of... ...understanding of Databricks alongside Snowflake on AWS. Must have proven experience in data... ...team. Guide and mentor data engineers and analysts on data modeling, pipeline...Amazon Web ServiceSeniorFull timeRemote work
$80 - $100 per hour
...has to offer at . The Opportunity: We’re looking for a Senior Data Engineer to join our Data and Analytics Group within the Technology Services... ..., and external clients ~ Experience or Certification with AWS or Databricks an asset ~ Experience in supporting wealth...Amazon Web ServiceSeniorHourly payLong term contractTemporary workInternship- ...We are looking for a skilled Senior Data Platform Engineer with a strong Python background to join our team. This role is ideal for a data engineering... ...in building and optimizing the data infrastructure on AWS for our customers, ensuring high performance, data integrity...Amazon Web ServiceSenior
- We are seeking a highly accomplished Senior DataOps/Cloud Data Engineer for an enterprise-level contract opportunity based in Toronto. In this role, you... ...fully onsite in Toronto, you will lead the migration of legacy ETL workflows to Azure Data Factory and Databricks ELT,...SeniorContract work
- ...Senior Java Developer Kafka Microservices Location: Toronto ON Hybrid (4 Days WFO) Duration: 12 months Role Descriptions Strong Java development experience using Spring and Spring Boot Framework Multi-Threading and REST API. Experience in Kafka Producer and Consumer...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer (AWS, Big Data, ETL, Netezza, Spark, Kafka, Data Warehousing). Be the first to apply!
Related searches
- remote data engineer Toronto, ON
- python data engineer Toronto, ON
- data integration developer Toronto, ON
- gcp data engineer Toronto, ON
- data centre engineer Toronto, ON
- information engineer Toronto, ON
- data engineer Toronto, ON
- data cabling engineer Toronto, ON
- data engineering intern summer Toronto, ON
- junior data engineer Toronto, ON