Gcp Data Engineer
Astra-North Infoteck Inc.
Job DescriptionJob Description: Experience Required: 6–8 years
Job Description
We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native data architectures.
This role involves designing, building, optimizing, and maintaining scalable data pipelines and analytical platforms supporting enterprise‑grade workloads.
The ideal candidate brings strong hands‑on experience in BigQuery, Dataflow, DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to‑end ELT/ETL frameworks, along with robust knowledge of metadata, lineage, data quality, and CI/CD automation.
Key ResponsibilitiesData Engineering & Architecture: Design and implement end‑to‑end data architectures on GCP, including data lakes, data marts, and warehouse models. Build scalable batch and streaming pipelines using Dataflow, DataProc (Spark), Dataform, and Pub/Sub. Architect low‑latency, high‑throughput processing solutions supporting advanced analytics and ML workloads. Develop pre‑aggregated models, materialized views, and optimized analytical structures in BigQuery.
ETL/ELT Pipeline Development: Design, develop, test, and optimize ELT/ETL pipelines for structured and unstructured data. Use Dataform and Cloud Composer (Airflow) for orchestration, dependency management, and metadata logging. Implement best practices for ingestion, transformation, storage, and data access patterns.
Data Quality, Metadata & Governance: Implement enterprise‑grade data quality checks using Great Expectations or custom Python frameworks. Manage metadata, lineage tracking, data cataloging, and compliance with governance standards. Ensure data integrity, schema enforcement, and security‑by‑design principles across all data pipelines.
Cloud Infrastructure & DevOps: Build and automate cloud infrastructure using Terraform, Jenkins, GitLab CI, and IaC best practices. Develop CI/CD workflows for pipeline deployments, testing gates, and operational automation. Monitor pipelines using Cloud Monitoring & Logging, optimizing for performance and cost.
Cross‑Functional Collaboration: Work closely with data scientists, analysts, platform engineering, and product owners to translate complex business needs into scalable data solutions. Support legacy‑to‑GCP migration initiatives, including Hadoop and on‑premise workloads. Enable advanced analytics and ML workloads through ML‑ready data pipelines.
Advanced Analytics & ML Support: Support feature engineering and ML data preparation for Vertex AI, Gemini, HuggingFace, or other ML platforms. Enable vector database workflows and generative AI data pipelines.
Required Technical SkillsProgramming & Tools: Python, SQL, Java. Git, Bitbucket, Jenkins, GitLab CI. Terraform (IaC). REST APIs, FastAPI. Airflow DAG development.
Data Engineering Competencies: Data modeling (OLTP/OLAP). Data Warehousing. ELT/ETL pipelines. Streaming & real‑time processing. Data profiling and validation. Metadata, lineage, quality management.
#J-18808-Ljbffr
Job Description
We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native data architectures.
This role involves designing, building, optimizing, and maintaining scalable data pipelines and analytical platforms supporting enterprise‑grade workloads.
The ideal candidate brings strong hands‑on experience in BigQuery, Dataflow, DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to‑end ELT/ETL frameworks, along with robust knowledge of metadata, lineage, data quality, and CI/CD automation.
Key ResponsibilitiesData Engineering & Architecture: Design and implement end‑to‑end data architectures on GCP, including data lakes, data marts, and warehouse models. Build scalable batch and streaming pipelines using Dataflow, DataProc (Spark), Dataform, and Pub/Sub. Architect low‑latency, high‑throughput processing solutions supporting advanced analytics and ML workloads. Develop pre‑aggregated models, materialized views, and optimized analytical structures in BigQuery.
ETL/ELT Pipeline Development: Design, develop, test, and optimize ELT/ETL pipelines for structured and unstructured data. Use Dataform and Cloud Composer (Airflow) for orchestration, dependency management, and metadata logging. Implement best practices for ingestion, transformation, storage, and data access patterns.
Data Quality, Metadata & Governance: Implement enterprise‑grade data quality checks using Great Expectations or custom Python frameworks. Manage metadata, lineage tracking, data cataloging, and compliance with governance standards. Ensure data integrity, schema enforcement, and security‑by‑design principles across all data pipelines.
Cloud Infrastructure & DevOps: Build and automate cloud infrastructure using Terraform, Jenkins, GitLab CI, and IaC best practices. Develop CI/CD workflows for pipeline deployments, testing gates, and operational automation. Monitor pipelines using Cloud Monitoring & Logging, optimizing for performance and cost.
Cross‑Functional Collaboration: Work closely with data scientists, analysts, platform engineering, and product owners to translate complex business needs into scalable data solutions. Support legacy‑to‑GCP migration initiatives, including Hadoop and on‑premise workloads. Enable advanced analytics and ML workloads through ML‑ready data pipelines.
Advanced Analytics & ML Support: Support feature engineering and ML data preparation for Vertex AI, Gemini, HuggingFace, or other ML platforms. Enable vector database workflows and generative AI data pipelines.
Required Technical SkillsProgramming & Tools: Python, SQL, Java. Git, Bitbucket, Jenkins, GitLab CI. Terraform (IaC). REST APIs, FastAPI. Airflow DAG development.
Data Engineering Competencies: Data modeling (OLTP/OLAP). Data Warehousing. ELT/ETL pipelines. Streaming & real‑time processing. Data profiling and validation. Metadata, lineage, quality management.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Gcp Data Engineer in Winnipeg, MB vacancy
- ...This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a GCP Data Engineer based in Canada. This role offers the opportunity to design, develop, and optimize modern data solutions that support...SuggestedRemote workFlexible hours
- Strong experience architecting enterprise data platforms on Google Cloud (GCP). The architect will work as a strategic technical partner to design and... ...enterprise architects, security teams, and platform engineering teams on cross‑functional initiatives. Guide data engineers...SuggestedRemote work
- Azure and GCP data engineering define this Senior Data Analyst position at Investia, with cloud pipelines and machine learning at its core.As a Senior Data Analyst, you will design, develop, and maintain modern data solutions supporting platforms, operations, advisors, and business...Suggested
- Build scalable GCP data platforms with BigQuery and Dataflow as a Senior Data Engineer focused on distributed processing. Apply six to eight years of experience to enterprise workloads.This Senior Data Engineer designs, builds, optimizes, and maintains cloud-native data architectures...Suggested
- Explore a rewarding career as a Cloud Data Engineer with a GCP focus in Canada. Enjoy the benefits of a fully remote role while developing data solutions for healthcare technology. This position allows you to design, implement, and refine data engineering solutions that enhance...SuggestedRemote work
- Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce...
- GCP Data Migration Engineer – PySpark & Salesforce Data MigrationGCP Data Migration Engineer – PySpark & Salesforce Data Migration Required Skills & Experience:Must Have (4-5 years minimum): Strong hands-on experience with GCP Dataproc and Apache Spark (PySpark preferred...
- ...We are looking for a GCP DevOps Engineer with hands-on experience managing cloud infrastructure, automating deployments, and resolving security... ...Responsibilities - Manage GCP services, including Cloud Run, GKE, Compute Engine, Cloud SQL, IAM, and networking. - Investigate and fix...
- Design scalable GCP data platforms for BMO in Toronto, using BigQuery, Dataflow, and cloud-native services. This contract follows a hybrid, four-days-onsite model.As a GCP Cloud Architect/Engineer, you will create enterprise-scale data solutions for BMO through RedPico. The...Contract work
- Lead enterprise data products at Mondelēz International using roadmap ownership, governance, and GCP or BigQuery expertise in a hybrid schedule.This Data Product Manager leads lifecycle ownership across Mondelēz’s DBx-based enterprise data platform. The work bridges business...
- Build GCP machine learning infrastructure in Toronto with Python automation and two onsite... ...will develop CI/CD pipelines, automate data processing and model training, and maintain... ...model serving workflows. The position suits engineers comfortable across infrastructure,...2 days per week
- We are looking for a GCP Cloud Architect/Engineer to design and implement scalable data solutions on Google Cloud Platform for our client BMO. You will work closely with business stakeholders, data science teams and technical governance groups to define requirements, design...Contract work
- A leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing GCP applications and collaborating with senior team members to ensure project success. Ideal candidates will have 8-10 years of experience...Full time
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...Permanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...Long term contractPermanent employmentFull timeContract workWork at office
- A healthcare technology company is seeking an experienced Data Architect to design and build GCP-based data platforms. The ideal candidate will have over 10 years of experience in data architecture, strong technical skills in the GCP data stack, and a solid understanding of...
- ...on Google Cloud using Vertex AI, BigQuery, and strong software engineering practices for production delivery.This Senior LLM Solutions Engineer... ...APIs in PythonIntegrate MCP tools with systems, APIs, and data sourcesImplement monitoring, tracing, and observability with LangfuseImprove...
- Shape Stay22's Python and GCP engineering initiatives through technical leadership, code reviews, and architecture guidance. Support scalable services and automated pipelines across two squads.This Senior Technical Engineering Manager position combines people management, strategic...Long term contractImmediate start
- Senior Site Reliability Engineer supporting Canada Protected B, with Linux, Kubernetes, and cloud infrastructure expertise in a flexible or... ...senior reliability engineering expertise across Linux, Kubernetes, GCP, automation, and observability for ServiceNow’s protected...Remote workMonday to fridayFlexible hours
- Optimize AWS and GCP spending as a FinOps Engineer at ZoomInfo, using cloud governance and automation. This is a remote opportunity.Within Infrastructure... ...implement savings across compute, storage, networking, and data servicesBuild budget alerts, anomaly detection, and...Remote work
- OverviewDevOps Cloud Engineer – GCP and Kubernetes Contract Duration: 6 months with high possibility of extension Number of Positions: 2 Business group: Cloud Engineering – The client has embarked on the journey to modernize both development practices and tools...Contract work
- GCP Security Engineering and Integration SpecialistAmaris Consulting is supporting a strategic enterprise initiative to migrate business applications and infrastructure to Google Cloud Platform. We are looking for a GCP Security Engineering and Integration Specialist to...Permanent employmentContract workFreelance
- ...manage enterprise-scale cloud platforms on Google Cloud Platform (GCP). Design and implement GKE/Kubernetes-based container platforms. Develop... ...: Strong hands-on experience with GCP Services, GKE, Compute Engine, Networking, IAM. Expertise in Kubernetes, Terraform, GitHub...
- Build reliable cloud infrastructure remotely with GCP, Cloudflare, and automation at the core of this Site Reliability Engineer role. Own systems from day one while improving operational consistency.Minimal is growing its SRE team to create a secure, reproducible foundation...Remote work
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
- ...from another hyperscaler (Azure or AWS) to GCP, Deep working knowledge of core GCP... ...migrating between them. Experience designing data migration and dual-write/reconciliation strategies... ...implement — the infrastructure engineering team. Strong stakeholder communication skills...
- ...seeking an experienced Google Cloud Platform (GCP) Architect to design and implement secure,... ...meets strict healthcare compliance and data security standards (such as PIPEDA/HIPAA)... ...security best practices. Collaborate with engineering and data teams to design data lakes and data...
- ...to gather requirements and for review of test strategyTesting of GCP applicationsWork with other team members to ensure project deadlines... ...and progress8-10 years of overall experience with 3-4 years in Data testingKnowledge of GCP Big Query, Python and PysparkExperience in...
- Job SummaryWe are seeking an experienced Cloud Engineer with strong expertise in cloud platforms, cloud security, and business analysis. The... ...knowledge of Microsoft Azure, AWS, or Google Cloud Platform (GCP). Strong understanding of cybersecurity concepts, controls, frameworks...
- A forward-thinking technology company in Toronto is seeking a mid-senior level DevOps Cloud Engineer to build scalable, secure cloud platforms using GCP and Kubernetes. The ideal candidate will have extensive experience in DevOps practices, CI/CD pipelines, and Infrastructure...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gcp Data Engineer. Be the first to apply!
Related searches
- gcp data engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

