Python Pyspark Data Engineer
Lancesoft
Build scalable data solutions with Python 3.X, PySpark, and SQL while working across large-scale transformation workflows. Apply distributed computing and cloud platform experience to modern data engineering.This Python PySpark Data Engineer position focuses on reusable Python modules, Spark DataFrames, and Spark SQL. You will develop ETL and ELT pipelines, optimize queries, and work with relational databases. The role also involves data formats, CI/CD tools, and cloud platforms including AWS, Azure, or GCP.Key Responsibilities:
Develop reusable Python modules using object-oriented programmingBuild ETL and ELT pipelines for large-scale transformationsProcess data with PySpark, Apache Spark, and Spark SQLOptimize SQL queries across relational databasesWork with distributed computing and parallel processingRequirements:
Strong Python 3.X programming experienceHands-on PySpark, Spark DataFrames, and Apache Spark experienceStrong SQL and relational database expertiseExperience with AWS, Azure, or GCPKnowledge of Git, Jenkins, or CI/CD toolsApply Python, PySpark, SQL, and cloud expertise to deliver scalable data transformation and pipeline solutions.
#J-18808-Ljbffr
Develop reusable Python modules using object-oriented programmingBuild ETL and ELT pipelines for large-scale transformationsProcess data with PySpark, Apache Spark, and Spark SQLOptimize SQL queries across relational databasesWork with distributed computing and parallel processingRequirements:
Strong Python 3.X programming experienceHands-on PySpark, Spark DataFrames, and Apache Spark experienceStrong SQL and relational database expertiseExperience with AWS, Azure, or GCPKnowledge of Git, Jenkins, or CI/CD toolsApply Python, PySpark, SQL, and cloud expertise to deliver scalable data transformation and pipeline solutions.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Pyspark Data Engineer. Be the first to apply!
Related searches
- python developer no experience Winnipeg, MB
- junior python developer Winnipeg, MB
- python data engineer Winnipeg, MB
- python developer remote Winnipeg, MB
- python developer Winnipeg, MB
- développeur python Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
