Senior Data Engineer -GCP, Python, PySpark
Astra North Infoteck Inc.
Data Engineer – Google Cloud Platform (GCP), BigQuery, Python & Data Pipelines
Location: Hybrid – 3 Days per Week On-Site
Job Summary
• Skilled Data Engineer with hands-on Google Cloud Platform (GCP) experience to design, build, and maintain scalable data pipelines and cloud-based data solutions
• Expertise in data warehousing, ETL/ELT development, big data technologies, and GCP services to support enterprise analytics and business intelligence initiatives
Key Responsibilities
• Design, develop, and maintain scalable batch and real-time data pipelines on GCP
• Build and optimize data ingestion frameworks from multiple structured and unstructured data sources
• Develop ETL/ELT processes using GCP-native services and modern data engineering tools
• Design and implement data models for analytics, reporting, and machine learning use cases
• Manage and optimize data storage solutions using BigQuery and Cloud Storage
• Monitor data quality, performance, security, and governance standards
• Collaborate with business stakeholders, data analysts, architects, and data scientists to deliver enterprise data solutions
• Implement CI/CD, automation, and DevOps practices for data engineering workloads
• Troubleshoot data processing issues and optimize pipeline performance
• Ensure compliance with data security and privacy requirements
Required Skills
• Strong experience in Data Engineering and data pipeline development
• Hands-on experience with Google Cloud Platform (GCP) services including:
• BigQuery
• Cloud Storage
• Dataflow
• Pub/Sub
• Dataproc
• Cloud Composer (Airflow)
• Cloud Functions
• Cloud Run
• Strong programming skills in:
• Python
• SQL
• PySpark
• Experience with ETL/ELT frameworks and data integration tools
• Strong knowledge of data warehousing concepts and dimensional modeling
• Experience working with relational and NoSQL databases
• Knowledge of real-time and streaming data architectures
• Understanding of CI/CD pipelines, GitHub, and DevOps practices
• Experience with data quality, metadata management, and governance
Preferred Skills
• Experience with Apache Spark, Hadoop, Kafka, and Airflow
• Exposure to machine learning data pipelines and MLOps
• Experience with Terraform or Infrastructure as Code (IaC)
• Knowledge of containerization technologies such as Docker and Kubernetes
• Experience in Banking, Financial Services, Insurance, or large enterprise environments
Required Qualifications
• Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field
• Excellent analytical and problem-solving skills
• Strong communication and stakeholder management skills
• Experience working in Agile/Scrum environments
Essential Skills
• Google Cloud Platform (GCP)
• BigQuery
• Python
• SQL
• PySpark
• ETL/ELT
• Dataflow
• Cloud Composer (Airflow)
• Cloud Storage
• CI/CD
$60 - $70 per hour
...Job Title: Senior Data Engineer Job Location: Hybrid, Toronto, Ontario, Canada Job Type: T4 Contract Experience: 5+ Years Rate: 60... ...NearSource is looking for a Data Platform Engineer with expertise in Python, Spark, and Snowflake to join our engineering team in Toronto...SeniorLong term contractContract workManual labor- ...are created and answered, customer data is ingested, actions on external services... ...experience working as a Software Engineer 4+ years working with Node.js / Python 4+ years working with REST APIs... ...extremely efficient go-to-market engine Work with a talented team you'll...SeniorFull timeWork at officeWork from homeWorldwide2 days per week
- ...Job Title: Azure Data Engineer (ADF, Databricks, PySpark) Duration: 12 Months Work Model: Hybrid (2 days/week onsite) Experience: 4–6 Years Required Skills Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks (ADB), PySpark...SuggestedContract work2 days per week
$60 - $70 per hour
...Job Title: Senior Data Engineer Location: Hybrid (2 days remote), Toronto, Canada Experience: 5+ Years Rate: 60 CAD to 70 CAD per hour... ...technical stakeholders Must-Have Skills Strong experience with Python, Spark (PySpark, Spark SQL), and SQL Hands-on experience...SeniorHourly payLong term contractFull timeRemote work$130k - $180k per year
...Fitch Group delivers vital credit and risk insights, robust data, and dynamic tools to champion more efficient, transparent... ...data at Fitch? Visit: Fitch Group is currently seeking a Senior Software Engineer – Python based out of our Toronto office. How You’ll Make an...SeniorLong term contractTemporary workWork at officeImmediate start2 days per week3 days per week$100 per hour
...Role: Senior Data Engineer Structure: Hybrid (2 days onsite / 3 days remote) - Toronto Duration: 6-Month Contract Pay Rate: up to $100... ...GitHub workflows Build and optimize data pipelines using Python, SQL and modern cloud technologies Develop and maintain AWS...SeniorContract workRemote work$99.6k - $136.9k per year
...Toronto office & 2 days working from home Reporting to: Senior Manager, Data Engineering Think you have what it takes to join an elite team of... ...software engineering ~ Strong hands-on experience with Python , SQL. ~ Experience working with multiple cloud platforms...SeniorFull timeWork at officeFlexible hoursNight shift3 days per week$110k per year
...experience. About the Team: The Data & Analytics team is moving... ...standards, and creating engineering patterns that let analytics, product... .... About the Role: The Senior Data Engineer will design,... ...strong production experience in Python, SQL, and distributed compute...SeniorFull timeWork at officeRemote workFlexible hours$130k - $180k per year
...are looking to hire a Full Stack Python/React Developer for an applications team We're open on seniority from Upper Intermediate to... ...brands understand their retail data and run targeted media campaigns... ...Senior/Staff/Lead Full Stack Engineer who wants to play a key role on...SeniorLong term contractFull timeRemote workVisa sponsorshipWork visaFlexible hours$116k - $235.1k per year
...About the Role: We're hiring Senior and Staff Data Platform Engineers to join the Data Infrastructure teams in Toronto. Together these teams own the... ...Strong in at least one of: Rust, JVM (Java or Scala), or Python for data platform work #LI-BT1 #LI-Hybrid Pursuant...SeniorLong term contractRemplacementFull timeTemporary workWork at officeLocal areaFlexible hours2 days per week$85k - $105k per year
...Enablement Craft connects channels, data, and technology into unified... ...Description The Data Engineer supports analytics and... ...data engineering solutions using Python and SQL Design, build, and... ...implementing fixes Build scalable PySpark-based solutions for large-...Full time- ...Improving patient outcomes. As a market leader in AI-driven, data-powered, and privacy-compliant healthcare engagement, we connect... ...possess specialized skills critical to this role. As a Senior Data Engineer , you will own Nimble's data platform — the layer that every...SeniorFull timeLive outVisa sponsorship
- ...Senior Software Engineer, Python Programmer Fitch Ratings is currently seeking a Senior Software Engineer specializing in Python Programming or applications... .../EKS-based container orchestration). Knowledge of data science and machine learning concepts and tools....SeniorImmediate start
$115k - $130k per year
...something great, you’ll want to keep reading. About the Role: Senior Data Engineer We’re growing — and we’re hiring a Senior Data Engineer to... ...on Snowflake. The rest of our tech stack is built on PHP, Python, React, mySQL and our infrastructure is in AWS. Innovation...SeniorRemote work$95k - $145k per year
Senior Data Engineering Consultant Position Description This role is hybrid and time.requires you to be at our downtown Toronto and/or Client... ...candidate brings strong expertise in Spark 3, Scala, and Python, with experience building distributed data processing solutions...SeniorWork at office- ...Principal Databricks Data Engineer Experience Required: 12–18 Years Key Requirements... ...Refactor legacy Hive and Impala logic into PySpark and Spark SQL ELT pipelines • Ensure... ...architecture decisions • Mentor senior engineers and establish engineering standards...SeniorPermanent employment
$105k - $115k per year
...lifelong learners. About The Role As a Senior Data Analyst, you are an experienced analytics... ...You work closely with consultants, data engineers, developers, designers and clients across... ..., Redshift, BigQuery) Proficiency in Python, R, or similar language for data analysis...SeniorFull timeWork from homeFlexible hours$150k - $190k per year
...something big! About the Team Engineers on this team build our rules-... ...Reporting to the Manager of Data Platform, you will play an... ...scalable as Forma grows. As a Senior Engineer, Data Platform, you... ...production-grade language such as Python, Java, Scala, Kotlin, Go, C#,...Senior$110k - $140k per year
...automotive retail in Canada and beyond. As Senior Data Analyst you will join our Seller &... ...team. You will partner with Product, Engineering, Commercial, and Leadership teams to drive... ...Science. ~ Advanced SQL and strong Python skills. ~ Experience with data modeling...Senior$118k - $152k per year
...Help shape modern data platforms and analytics solutions that enable smarter business... ...business needs with innovative data engineering, delivering scalable solutions for leading... ...Strong programming experience using Python and PySpark, with practical knowledge of Azure-based...InternshipImmediate start- ...We are looking for a skilled Senior Data Platform Engineer with a strong Python background to join our team. This role is ideal for a data engineering professional experienced in delivering robust data platforms and implementing data fabric solutions. As a Senior Data Platform...Senior
- ...Reference no. R2860221 Position title: Data Platform Engineer Analyst Department: Platform... ...closely with subject matter experts and senior team members, has a foundational understanding... ..., and optimize performance. Use Python , Shell scripting, and Scala/Java for...SeniorLong term contractWork at officeImmediate startRemote workWork from home
$140k - $170k per year
...role Tripstack is moving its entire data stack from bare-metal VMs to... ...new data centre. We are looking for a senior infrastructure engineer who has done stateful migrations before... ...config for a production data system. Python that is production-grade, plus working...SeniorFull timeWork at officeFlexible hours2 days per week- ...excited about! Your role and responsibilities: As a Lead Data Engineer you will take Xanadus existing data pipelines and transform them... ...and orchestration (Airflow Dagster Prefect) ~ Strong SQL and Python skills ~ Knowledge of infrastructure-as-code and CI/CD for data...Full time
$58k - $102k per year
...support with design and delivery of modern data platform solutions for our clients. You’... ...teams (cloud, data governance, AI/ML, engineering) to ensure integrated solution delivery... ...similar technologies • Experience with SQL, PySpark, and data modeling best practices •...Permanent employmentFlexible hours$180k - $275k per year
...employees, and communities. The Role As Principal Software Engineer for a new product within Veeva, you will be a founding member of... ...of proven software development expertise (Production level Python development required) Enterprise SaaS Leader: Extensive experience...InternshipWork at officeLocal areaRemote workWork from homeFlexible hours$150k - $180k per year
Role: Senior FullStack (Python) Developer Location: Hybrid, Toronto Rates: $150k - $180k per year Structure: Full time -- We have a great... ...of the role. — We're looking for a modern Full Stack Engineer who can comfortably move between: Node.js / TypeScript...SeniorFull time$108k - $135k per year
...signals, promotions, cost models, and more. As a Data Engineer on the Pricing team, you will help build the data... ...Parquet ~ Strong skills in a scripting language (Python, Ruby, Bash) ~ Good understanding of SQL Engine and able to conduct advanced performance tuning ~...Hourly payWork at officeFlexible hours3 days per week- ...Toronto Summary As the Specialist, SCM Data, you will be joining a team that... ...Learning. 4. Familiar with ML Ops, Data Engineering and CI/CD Pipeline concepts. 5. Foundational... ...generation (RAG) is an asset. 6. Python, PySpark. 7. Power BI platforms. 8. Relational...SeniorInternshipWork at officeLocal areaRemote work
- ...groups within the Investment Reporting, Data Governance & Valuations. This will require... ...technologies like Qlikview/QlikSense, Python, Snowflake, Excel, Power BI, SAP Hana. Act... ...Languages English: C1 Advanced Seniority Senior Toronto, Canada Req. VR-108483 BigData...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer -GCP, Python, PySpark. Be the first to apply!
- python data engineer Toronto, ON
- junior data engineer Toronto, ON
- gcp data engineer Toronto, ON
- data integration developer Toronto, ON
- big data engineer Toronto, ON
- data engineer Toronto, ON
- data cabling engineer Toronto, ON
- remote data engineer Toronto, ON
- information engineer Toronto, ON
- data centre engineer Toronto, ON