Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Gcp Pyspark Data Migration Engineer

Astra-North Infoteck Inc.

Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas.Key Responsibilities:
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Gcp Pyspark Data Migration Engineer. Be the first to apply!