Big Data Developer - Snowflake, Spark & AWS

Temporary

Astra North Infoteck Inc.

Toronto, ON

Job Title: Senior Big Data Developer – Snowflake, Spark & AWS

Location: Toronto

Work Model: Hybrid (4 Days WFO)

Position Overview

We are seeking an experienced Senior Big Data Developer to join the Data Engineering team. You will design, build, and optimize scalable data pipelines and infrastructure to support enterprise data analytics and business intelligence initiatives.

Key Responsibilities

• Design and develop robust ETL/ELT pipelines using Spark, Hive, and Hadoop for large-scale data processing.

• Architect and maintain Snowflake data warehouse solutions, including schema design and optimization.

• Develop and manage infrastructure-as-code solutions using AWS services such as S3, Glue, EMR, and RDS.

• Build and deploy containerized applications using Docker, Kubernetes, and OpenShift (OCP4).

• Implement CI/CD pipelines and version control best practices using Git.

• Collaborate with data scientists and analytics teams to ensure data quality and accessibility.

• Mentor junior team members and contribute to technical documentation.

• Leverage Gen AI tools to enhance code quality and development efficiency.

Required Qualifications

• 5+ years of hands-on experience with Big Data technologies including Hadoop, Spark, and Hive.

• Advanced proficiency with the Snowflake platform and data modeling.

• Strong SQL expertise and database design knowledge.

• Proven experience with AWS Cloud services.

• Programming experience in Scala, Python, or Java.

• Knowledge of Source Code Management (SCM), Infrastructure-as-Code, and CI/CD pipeline implementation.

• Excellent problem-solving, communication, and self-directed work ethic.

Preferred Qualifications

• Experience with orchestration tools such as Apache Airflow.

• Experience with ETL tools such as Informatica or Talend.

• API development experience.

• Expertise in Docker, Kubernetes, and containerization.

• Scripting proficiency in Shell and Python.

• Understanding of Gen AI for code generation.

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Big Data Developer - Snowflake, Spark & AWS in Toronto, ON vacancy

Sr Big Data Developer with Java and Spark
$55 - $60 per hour
...Job Responsibility: Job Title: Sr Big Data Developer With Java And Spark Location: Toronto, ON Duration: Long Term Contract Job Detail: Hadoop, Spark, and Java/Scala Developer with Minimum 5 years of hands-on experience Must to Have: ~5+ years application...
Amazon Web Service
Big data
Hourly pay
Long term contract
Fixed term contract
Monday to friday
Shift work
Day shift
Epsilon Solutions
Toronto, ON
5 days ago
Big Data Developer
$50 - $55 per hour
...Job Responsibility: Role: Big Data Engineer Location: Toronto- Hybrid Hire Type: Contract JD: 6-8 years of experience??-Experience... ...containers), DevOps (Jenkins, UCD etc.) and Cloud (Azure, AWS etc.)-Undergraduate degree coupled with technology development experience...
Amazon Web Service
Big data
Hourly pay
Full time
Contract work
Fixed term contract
Remote work
Monday to friday
E-Solutionts
Toronto, ON
1 day ago
Java Big Data Developer
$80 per hour
...: ~5+ years application development experience in Java, Spark, Hadoop, Spark ~ and Scala. ~10+ years application development... ...in Java and Spring ~ Framework ~5+ years in developing and optimizing Big Data applications using Java/Scala ~ and Spark on Cloudera/HDP...
Big data
Hourly pay
Fixed term contract
Monday to friday
Flexible hours
Shift work
Day shift
FirstVibe Technologies
Toronto, ON
3 days ago
Big Data Developer
...more inclusive world. Job Description We are seeking a Big Data Developer to build and enhance realtime and batch fraud analytics AML platforms... ...monitoring Process streaming transaction data using Apache Spark and Kafka Develop ETLELT workflows supporting customer...
Amazon Web Service
Big data
Permanent employment
Full time
Local area
Capgemini
Toronto, ON
23 days ago
Senior Platform Engineer (AWS, Big Data, Data Warehouse, Netezza)
...Job Title: Senior Platform Engineer (AWS, Big Data, Data Warehouse, Netezza) Location: Toronto, ON (Hybrid – 2 Days Onsite) Experience... ...migration initiatives. Key Responsibilities Design, develop, and support scalable data pipelines. Lead On-Prem to AWS...
Amazon Web Service
Big data
Contract work
Astra North Infoteck Inc.
Toronto, ON
29 days ago
Sr. Data Engineer- Databricks, Apache Spark
...Job Description Role: Sr. Data Engineer Work Model:... ...the design of data architecture, develop high-performance pipelines, and... ...streaming pipelines using Apache Spark (PySpark/Scala). Own end-to-... ...understanding of cloud platforms (AWS, Azure, or GCP). ~ Proven...
Amazon Web Service
Contract work
Astra North Infoteck Inc.
Toronto, ON
20 hours ago
Big Data Developer (Java / Scala) - AML Tech
$95k - $145k per year
Big Data Developer (Java / Scala) - AML Tech Position Description We are Canada's largest independent information technology services firm... ...SQL queries, stored procedures, and views. • Integrate Snowflake with other data sources and BI tools. • Monitor and troubleshoot...
Amazon Web Service
Big data
Work at office
Toronto, ON
a month ago
Senior Data Engineer (Databricks/AWS)
...high-impact position for a Senior Data Engineer with expertise in... ...integrated with an underlying AWS S3 cloud environment and Databricks... ...: Hands-on experience developing integrations and data ingestion... ...Associate/Professional, Databricks Spark Developer, and major cloud certifications...
Amazon Web Service
Full time
Contract work
Remote work
Worldwide
Flexible hours
Shift work
Fusemachines
Toronto, ON
2 days ago
AI and Data - Data Architect (Snowflake)
$110k - $160k per year
...The Opportunity We are seeking Snowflake Data Architects for o ur AI & Data practice... ...rules, control totals, reconciliation) Develop cost monitoring/telemetry/governance (e.g... ...Demonstrated experience with cloud platforms (AWS, Azure, GCP) ~ Strong background in...
Amazon Web Service
Weekend work
Ernst & Young
Toronto, ON
14 days ago
Senior Spark Scala Developer - Java & Spring Boot
...Spark Scala Developer – Apache Spark, Scala, Hadoop & Data Engineering Experience Required: 6–8 Years Required Skill Sets • Skilled Spark Scala Developer with experience developing data processing applications using Apache Spark and Scala • Design and...
Permanent employment
Astra North Infoteck Inc.
Toronto, ON
10 days ago
Java Developer with AWS
$43.42 - $45 per hour
...Job Responsibility: Job Role: Java Developer with AWS Job Location: Toronto Canada Hybrid (3 days a week onsite) Duration: 12 months with possible extensions Job Requirements: ~6+ years in Java development (Core Java, J2EE) ~ Strong expertise in Spring Framework...
Amazon Web Service
Hourly pay
Full time
Shift work
3 days per week
iTech Solutions Pvt. Ltd.
Toronto, ON
1 day ago
Python Developer with AWS
$40.64 - $45 per hour
...of our clients. We would like to know if you are interested or can recommend someone interested in this job. Job Role: Python Developer with AWS Job Location: Toronto Canada Hybrid (3 days a week onsite) Duration: 12 months with possible extensions Rate: $45/hr on...
Amazon Web Service
Hourly pay
Full time
Shift work
3 days per week
iTech Solutions Pvt. Ltd.
Toronto, ON
1 day ago
Python Developer with AWS skills
...FX. Collaborate with team members to conceptualize, design and develop new software applications. Applications may be server-side... ...architecture and technology strategy using Amazon Web Services (AWS) for Cloud development. Maintain and improve existing applications...
Amazon Web Service
Long term contract
Full time
Luxoft
Toronto, ON
1 day ago
Full Stack Developer-TypeScript, PostgreSQL, AWS
...Job Description: Full Stack Developer (TypeScript PostgreSQL AWS) Toronto ON - Hybrid (4 Days WFO) 12 months Design develop and maintain scalable... ...applications. Develop robust backend services and data access layers leveraging PostgreSQL. Design secure reliable...
Amazon Web Service
Full time
Astra North Infoteck Inc.
Toronto, ON
16 hours ago
AWS Data Engineer - ETL, Python & SQL
...AWS Data Engineer – ETL, Python & SQL Toronto, ON Hybrid (2 days per week in-person at Toronto office preferred) Skills... ...data cleansing, data validation etc. 2. Hands on ETL developer who is good at python, SQL. AWS services like glue, glue crawlers...
Amazon Web Service
Contract work
Work at office
Shift work
2 days per week
Astra North Infoteck Inc.
Toronto, ON
4 days ago
AWS Data Engineer
...AWS Data Engineer Location: Toronto, ON Work Model: Hybrid (2 days per week in-person at Toronto office preferred) Skills: Digital : Python Data Concepts & Data Modelling MySQL Experience Required: ~8+ Years Job Summary: ~ Handle data...
Amazon Web Service
Work at office
2 days per week
Astra North Infoteck Inc.
Toronto, ON
a month ago
Sr. Software Developer - Java AWS
Sr. Software Developer – Java AWS Responsibilities ~Participate, as part of the development team, in solution development related activities including... ...with SQL and no-SQL databases Experience with Python, Spark, PySpark Experience with JSON, YAML, Parquet Extensive experience...
Amazon Web Service
Contract work
Ward Tech Talent
Toronto, ON
more than 2 months ago
senior data science developer.
We are seeking a highly accomplished Senior Data Science Developer to spearhead the technical design, architectural optimization, and migration of... ...Solidify your engineering footprint using premium cloud-native big data utilities, including Databricks Unity Catalog and advanced...
Big data
Contract work
Home office
Flexible hours
3 days per week
Randstad
Toronto, ON
16 days ago
Azure Data Engineer (ADF, Databricks, Spark SQL)
...Scope of Work: Responsible for designing, developing, and maintaining Azure-based data pipelines using ADF and Databricks, including ETL/ELT workflows, Spark SQL processing, and Azure SQL integration, while ensuring data quality, performance optimization, and reliable...
Contract work
Astra North Infoteck Inc.
Toronto, ON
a month ago
Principal Data Developer
$160k - $180k per year
...key aspect of this mission is our scalable data service, which supports the growth of BlueCat... ...-Level Design and Architecture • Design, develop, and operate highly reliable large-scale... ...and operating large-scale data platforms in AWS; experience with GCP and Azure is considered...
Amazon Web Service
Full time
bluecatnetworks
Toronto, ON
a month ago
Data Architect with AWS Data Lake & Redshift
...Data Architect with AWS Data Lake & Redshift – ContractResponsibilities (Services): The contractor... ...platform (BDM, BDQ, EDC, Axon); ~Develop data architectural standards, design patterns... ...optimize Data Pipeline based on AWS Big Data technologies. ~Support...
Amazon Web Service
Big data
Contract work
For contractors
Ward Tech Talent
Toronto, ON
more than 2 months ago
Senior AWS QuickSight BI Developer (Tableau)
...AWS Quick Sight dashboard specialist (Only 10+ yrs experienced candidates required) Toronto... ...needed : Experience with AWS Services and Data Portal experience is an added advantage.... ...skills required: • S trong Python, SQL, Spark/PySpark, and data pipeline engineering experience...
Amazon Web Service
Contract work
Astra North Infoteck Inc.
Toronto, ON
a month ago
Cloud Data Platform Engineer (AWS and Azure)
...Role: Cloud Data Platform Engineer (AWS and Azure) Total Experience: 6–10 Years Role Description # JavaScript/NodeJS developers with AWS and Azure cloud services in-depth knowledge. Key role is development and automation. # Involve developing serverless functions...
Amazon Web Service
Contract work
Astra North Infoteck Inc.
Toronto, ON
a month ago
Data Engineer
$90k - $125k per year
...learners. About The Role As a Data Engineer you’ll be tasked with designing... ...as Azure Fabric, Databricks, and Snowflake will be essential as you collaborate... ...languages. Experience with big data technologies and concepts (Spark, Hadoop, Kafka). Excellent analytical...
Big data
Full time
Work from home
Flexible hours
Konrad
Toronto, ON
14 hours ago
Senior Software Developer Data Platform Operation
...#TeamBell. At Bell, software developers like you are empowered and enabled to... ...We’re looking for a Software Developer to join our Data Platform Operations team and help shape... ...scale data processing frameworks such as Spark, Hadoop, Kafka, or cloud-native data processing...
Full time
Work at office
3 days per week
Bell
Toronto, ON
5 days ago
Python AI/ML Developer - Python, FastAPI, AWS & Generative AI (LLMs)
...Python AI/ML Developer – Python, FastAPI, AWS & Generative AI (LLMs) Required Skills & Experience: • 5+ years of professional experience in software development. • Strong proficiency in Python (FastAPI, Flask, asyncio, pandas, etc.). • Hands-on experience...
Amazon Web Service
Permanent employment
Astra North Infoteck Inc.
Toronto, ON
8 days ago
Senior AI Developer - Python, AWS Services, SQL, ML
...Senior AI Developer – Python, AWS Services, SQL, ML Role AI Developer – Corporate IT AI Team Required Skills • Strong Python coding... ...• Strong SQL skills and experience designing and building data pipelines in AI workflows. AWS Services (AI-Focused)...
Amazon Web Service
Permanent employment
Astra North Infoteck Inc.
Toronto, ON
15 days ago
Full Stack Developer (Angular and AWS)
$95k - $145k per year
Full Stack Developer (Angular and AWS) Position Description This role is hybrid and requires you to be at a Client office at a minimum 2 days per week - subject to change at any time. Your future duties and responsibilities • Decompose business requirements and translates...
Amazon Web Service
Work at office
2 days per week
Toronto, ON
23 days ago
Technical Project Manager - Data Platforms, AWS, AI Enablement
...Technical Project Manager – Data Platforms, AWS, AI Enablement Location: Hybrid Experience Required: 8+ Years (preferred) Role Overview We are looking for a Technical Project Manager to work directly with the engineering team supporting our Data Products...
Amazon Web Service
Contract work
Astra North Infoteck Inc.
Toronto, ON
11 days ago
Senior Databricks Developer
...Website We need candidates with Data Bricks in AWS cloud only with associated transformation... ...requirements. Role: Senior Databricks developer Location: Canada (Hybrid) Relevant... ...relevant experience in Data bricks, AWS, Py spark, SQL ~ Proficiency in programming...
Amazon Web Service
Big data
Contract work
spruceinfotech
Toronto, ON
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Developer - Snowflake, Spark & AWS. Be the first to apply!