Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Pyspark Data Engineer

Lancesoft

Build scalable data solutions with Python 3.X, PySpark, and SQL while working across large-scale transformation workflows. Apply distributed computing and cloud platform experience to modern data engineering.This Python PySpark Data Engineer position focuses on reusable Python modules, Spark DataFrames, and Spark SQL. You will develop ETL and ELT pipelines, optimize queries, and work with relational databases. The role also involves data formats, CI/CD tools, and cloud platforms including AWS, Azure, or GCP.Key Responsibilities:
Develop reusable Python modules using object-oriented programmingBuild ETL and ELT pipelines for large-scale transformationsProcess data with PySpark, Apache Spark, and Spark SQLOptimize SQL queries across relational databasesWork with distributed computing and parallel processingRequirements:
Strong Python 3.X programming experienceHands-on PySpark, Spark DataFrames, and Apache Spark experienceStrong SQL and relational database expertiseExperience with AWS, Azure, or GCPKnowledge of Git, Jenkins, or CI/CD toolsApply Python, PySpark, SQL, and cloud expertise to deliver scalable data transformation and pipeline solutions.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Pyspark Data Engineer. Be the first to apply!