Gcp Pyspark Data Migration Engineer
Astra-North Infoteck Inc.
Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas.Key Responsibilities:
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Gcp Pyspark Data Migration Engineer. Be the first to apply!
Related searches
- gcp data engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
