Gcp Pyspark Data Migration Engineer
Astra-North Infoteck Inc.
Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas.Key Responsibilities:
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Gcp Pyspark Data Migration Engineer in Winnipeg, MB vacancy
- GCP Data Migration Engineer – PySpark & Salesforce Data MigrationGCP Data Migration Engineer – PySpark & Salesforce Data Migration Required Skills & Experience:Must Have (4-5 years minimum): Strong hands-on experience with GCP Dataproc and Apache Spark (PySpark preferred...Suggested
- ...Description We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native... ..., DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to‑end ELT/ETL frameworks, along with robust...Suggested
- ...all applications and next steps. Our partner is looking for a GCP Data Engineer based in Canada. This role offers the opportunity to design... ...Experience with Python-based data processing frameworks and PySpark. Familiarity with modern big data storage technologies such...SuggestedRemote workFlexible hours
- A leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing GCP applications and collaborating with senior team members to ensure project success. Ideal candidates will have 8-10 years of experience...SuggestedFull time
- Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets through distributed... ...deep SQL expertise to reliable engineering work.This Data Engineer role focuses... ..., integrate data, and support migration and orchestration. The work also involves...SuggestedInternship
- Build scalable GCP data platforms with BigQuery and Dataflow as a Senior Data Engineer focused on distributed processing. Apply six to eight years of experience to enterprise... ..., Dataflow, DataProc, Dataform, Cloud Composer, PySpark, and ELT/ETL frameworks. You will support data...
- ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions... ...with cloud platforms (Azure, AWS, GCP). Understanding of data security, governance...
- ...and for review of test strategyTesting of GCP applicationsWork with other team members to... ...of overall experience with 3-4 years in Data testingKnowledge of GCP Big Query, Python... ...PysparkExperience in ETL and DB testing, Data migration, Report validationsExpert in writing...
- ...experience architecting enterprise data platforms on Google Cloud (GCP). The architect will work as a strategic... ...patterns. Manage on‑prem → cloud migration pipelines, hybrid cloud data... ...architects, security teams, and platform engineering teams on cross‑functional initiatives...Remote work
- Build Livingston’s GCP data infrastructure as a Senior Data Engineer, designing end-to-end pipelines for high-volume logistics operations. Work hands-on across cloud data engineering and architecture.Reporting to the Director, IT, this senior role supports Livingston’s Data...
- A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills...Remote work
- Explore a rewarding career as a Cloud Data Engineer with a GCP focus in Canada. Enjoy the benefits of a fully remote role while developing data solutions for healthcare technology. This position allows you to design, implement, and refine data engineering solutions that enhance...Remote work
- ...Week in Office Job Overview We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design,... ...platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi...Work at office3 days per week
- Azure and GCP data engineering define this Senior Data Analyst position at Investia, with cloud pipelines and machine learning at its core.As a Senior Data Analyst, you will design, develop, and maintain modern data solutions supporting platforms, operations, advisors, and business...
- Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building...Contract workRemote work
$108.8k - $220.4k per year
We Are: Accenture AI & Data, the people who love using data to... ...for.You Are: As a Data Migration/ Modernization Lead, you will... ...Advanced proficiency in Data Engineering and Pipeline Implementation is... ...Microsoft Fabric Data Factory, PySpark, Spark SQL, Delta Lake, Azure...Full timeWork at officeLocal area- Job Title: GCP Architect Location: Dearborn, MI (Onsite) Client: Tech Mahindra/ Ford... ...designs. Lead the development of cloud migration strategies and execution plans. Provide technical... ...as Python, Java, or Go. Experience with data management and analytics services in GCP....
- Design cloud data pipelines with PySpark and AWS Glue, supporting secure, high-performing ecosystems for analytics and operational efficiency.As a... ...requirements into technical designs with business analysts and data engineers.Key Responsibilities: Design end-to-end pipelines and...
- .../ Role Summary The Synapse Engineer (Remote) builds, optimizes, and... ...work closely with the onsite Data Modeler and Conversion Analyst... ...production-quality execution of migrated workloads.Key Responsibilities... ...exp in Synapse SQL, PySpark, or Data Flows.Synapse notebooks...Contract workRemote work
- Steer the migration of applications to GCP as a GCP Technical Lead. With hands-on experience in cloud architectures and project leadership, guide teams through transformative migrations to the cloud. This senior role involves end-to-end management of migration initiatives...
$90 - $100 per hour
...CertifiedNOTE: Hybrid work model, 3 days/week in Toronto, Ontario office. TYPE: 12-month contract SKILLS: 5+ Cloud Data Migration Engineer, Snowflake, Azure AKS, Python, Flask, FastAPI, Django, SQL, SSIS, Oracle, Airflow, SQL, SSIS, DBT ( Data Build Tool), Jenkins...Full timeContract workWork at office3 days per week- A leading data engineering firm is seeking a Data Engineer to design and maintain scalable data pipelines using Python and PySpark. This role requires managing data storage solutions, orchestrating ETL processes, and deploying containerized applications. The ideal candidate...
- ...gaiia is hiring a Forward Deployed Engineer - Migration to partner with customers and internal teams to plan and execute data migrations onto the gaiia platform. You will own the migration end‑to‑end, from discovery through validated production data, blending solutioning with...Remote work
- Astra-North Infoteck Inc. in Toronto seeks an experienced Data Engineer with deep Big Data expertise to design, develop, and support enterprise-scale data platforms. The role focuses on PySpark, Apache Spark, Kafka, Hadoop ecosystem, and NiFi, covering ingestion, transformation...
- Modernize insurance data with advanced SQL and ETL expertise at Manulife / John Hancock, supporting legacy platform migration and Data Lake delivery.As a Full-Stack Data Engineer, you will transform complex licensing and compensation data for future-state capabilities. The work...
- Build migration solutions with advanced SQL and ETL expertise as a Full Stack Data Engineer at Manulife in hybrid Toronto. Support complex modernization work.This Full Stack Data Engineer role supports Insurance Licensing & Compensation Engineering. You will analyze legacy...
- A forward-thinking tech company in Canada is seeking a Forward Deployed Engineer to manage the seamless data migration for new customers. In this pivotal role, you will not only facilitate data transfer but also develop automation tools and features to improve the product. Ideal...
- ...Luxoft in Toronto is seeking a senior data engineer to support the Analytical Work Bench integration, including AWS-based data pipelines and... ...quality with standard testing practices. Join a team that leverages PySpark, PyTest, and Pylint, while integrating with CI/CD tooling such...
- Lead data migration and modernization with advanced data engineering and pipeline implementation skills in Accenture’s hybrid environment. Build solutions for critical... ...implementationExperience with Microsoft Fabric, PySpark, Spark SQL, and Delta LakeBachelor’s degree or...
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...similar role. · Proficiency in Python, PySpark, data modeling, ETL processes and data integration...Permanent employment
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gcp Pyspark Data Migration Engineer. Be the first to apply!
Related searches
- gcp data engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

