Gcp Pyspark Data Migration Engineer
Astra-North Infoteck Inc.
Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas.Key Responsibilities:
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Vacancy posted 39 minutes ago
Similar jobs that could be interesting for youBased on the Gcp Pyspark Data Migration Engineer in Winnipeg, MB vacancy
- GCP Data Migration Engineer – PySpark & Salesforce Data MigrationGCP Data Migration Engineer – PySpark & Salesforce Data Migration Required Skills & Experience:Must Have (4-5 years minimum): Strong hands-on experience with GCP Dataproc and Apache Spark (PySpark preferred...Suggested
- ...Description We are seeking a highly skilled Senior Data Engineer with deep expertise in Google Cloud Platform (GCP), distributed data processing, and cloud-native... ..., DataProc, Dataform, Cloud Composer (Airflow), PySpark, and end‑to‑end ELT/ETL frameworks, along with robust...Suggested
- A leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing GCP applications and collaborating with senior team members to ensure project success. Ideal candidates will have 8-10 years of experience...SuggestedFull time
- ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions... ...with cloud platforms (Azure, AWS, GCP). Understanding of data security, governance...Suggested
- ...and for review of test strategyTesting of GCP applicationsWork with other team members to... ...of overall experience with 3-4 years in Data testingKnowledge of GCP Big Query, Python... ...PysparkExperience in ETL and DB testing, Data migration, Report validationsExpert in writing...Suggested
- ...experience architecting enterprise data platforms on Google Cloud (GCP). The architect will work as a strategic... ...patterns. Manage on‑prem → cloud migration pipelines, hybrid cloud data... ...architects, security teams, and platform engineering teams on cross‑functional initiatives...Remote work
- Build scalable GCP data platforms with BigQuery and Dataflow as a Senior Data Engineer focused on distributed processing. Apply six to eight years of experience to enterprise... ..., Dataflow, DataProc, Dataform, Cloud Composer, PySpark, and ELT/ETL frameworks. You will support data...
- Azure and GCP data engineering define this Senior Data Analyst position at Investia, with cloud pipelines and machine learning at its core.As a Senior Data Analyst, you will design, develop, and maintain modern data solutions supporting platforms, operations, advisors, and business...
- Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building...Contract workRemote work
- ...Week in Office Job Overview We are seeking an experienced Data Engineer with strong expertise in Big Data technologies to design,... ...platforms. The ideal candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi...Work at office3 days per week
$108.8k - $220.4k per year
We Are: Accenture AI & Data, the people who love using data to... ...for.You Are: As a Data Migration/ Modernization Lead, you will... ...Advanced proficiency in Data Engineering and Pipeline Implementation is... ...Microsoft Fabric Data Factory, PySpark, Spark SQL, Delta Lake, Azure...Full timeWork at officeLocal area- A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills...Remote work
- Job Title: GCP Architect Location: Dearborn, MI (Onsite) Client: Tech Mahindra/ Ford... ...designs. Lead the development of cloud migration strategies and execution plans. Provide technical... ...as Python, Java, or Go. Experience with data management and analytics services in GCP....
- Design cloud data pipelines with PySpark and AWS Glue, supporting secure, high-performing ecosystems for analytics and operational efficiency.As a... ...requirements into technical designs with business analysts and data engineers.Key Responsibilities: Design end-to-end pipelines and...
- Astra-North Infoteck Inc. in Toronto seeks an experienced Data Engineer with deep Big Data expertise to design, develop, and support enterprise-scale data platforms. The role focuses on PySpark, Apache Spark, Kafka, Hadoop ecosystem, and NiFi, covering ingestion, transformation...
- Build migration solutions with advanced SQL and ETL expertise as a Full Stack Data Engineer at Manulife in hybrid Toronto. Support complex modernization work.This Full Stack Data Engineer role supports Insurance Licensing & Compensation Engineering. You will analyze legacy...
$90 - $100 per hour
...CertifiedNOTE: Hybrid work model, 3 days/week in Toronto, Ontario office. TYPE: 12-month contract SKILLS: 5+ Cloud Data Migration Engineer, Snowflake, Azure AKS, Python, Flask, FastAPI, Django, SQL, SSIS, Oracle, Airflow, SQL, SSIS, DBT ( Data Build Tool), Jenkins...Full timeContract workWork at office3 days per week- Steer the migration of applications to GCP as a GCP Technical Lead. With hands-on experience in cloud architectures and project leadership, guide teams through transformative migrations to the cloud. This senior role involves end-to-end management of migration initiatives...
- Modernize insurance data with advanced SQL and ETL expertise at Manulife / John Hancock, supporting legacy platform migration and Data Lake delivery.As a Full-Stack Data Engineer, you will transform complex licensing and compensation data for future-state capabilities. The work...
- ...gaiia is hiring a Forward Deployed Engineer - Migration to partner with customers and internal teams to plan and execute data migrations onto the gaiia platform. You will own the migration end‑to‑end, from discovery through validated production data, blending solutioning with...Remote work
- Project descriptionThe project involves the data engineering organization’s Analytical Work Bench, which is an integrated development environment... ...utilizing AWS EMR.Advanced proficiency in Python Core and PySpark, with over 8 years of hands-on experience.Practical knowledge...
- A forward-thinking tech company in Canada is seeking a Forward Deployed Engineer to manage the seamless data migration for new customers. In this pivotal role, you will not only facilitate data transfer but also develop automation tools and features to improve the product. Ideal...
- Lead data migration and modernization with advanced data engineering and pipeline implementation skills in Accenture’s hybrid environment. Build solutions for critical... ...implementationExperience with Microsoft Fabric, PySpark, Spark SQL, and Delta LakeBachelor’s degree or...
- A leading data engineering firm is seeking a Data Engineer to design and maintain scalable data pipelines using Python and PySpark. This role requires managing data storage solutions, orchestrating ETL processes, and deploying containerized applications. The ideal candidate...
- ...EPAM Systems, Inc. is seeking data professionals with deep expertise in Fenergo's enterprise data structures to support extraction, mapping, and migration of client and KYC/AML data to a new platform. The role involves analyzing Fenergo schemas, building secure extraction...
- A leading cloud solutions provider located in Toronto, Canada is seeking a GCP Technical Lead to oversee migration projects to Google Cloud Platform. This role requires a strong technical leader experienced in designing cloud architectures and guiding teams through migrations...
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...similar role. · Proficiency in Python, PySpark, data modeling, ETL processes and data integration...Permanent employment- ...with technical and business stakeholders About the OpportunityWere hiring a PLM Data Migration Specialist to support a major enterprise technology transformation within a complex engineering environment. Youll play a hands-on role in migrating critical product and...
- ...Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division... ...Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site)... ...IT. What you’ll do • Lead our data migration. Extract, cleanse and map data from IFS to...Long term contractPermanent employmentFull timeContract workWork at office
- Design scalable GCP data platforms for BMO in Toronto, using BigQuery, Dataflow, and cloud-native services. This contract follows a hybrid, four-days-onsite model.As a GCP Cloud Architect/Engineer, you will create enterprise-scale data solutions for BMO through RedPico. The...Contract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gcp Pyspark Data Migration Engineer. Be the first to apply!
Related searches
- gcp data engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

