Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Pyspark Developer

Lancesoft

Strong programming experience in
Python 3.X, including OOP, data structures, exception handling, and reusable modules.Hands-on experience with
PySpark, Apache Spark, Spark SQL, and Spark DataFrames .Strong expertise in SQL, query optimization, and relational databases.Experience developing ETL/ELT pipelines and large-scale data transformation workflows.Knowledge of distributed computing, parallel processing, and big data architecture.Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.Hands-on experience with cloud platforms (AWS/Azure/GCP).Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.Preferred / Nice-to-Have Skills
Experience with Databricks, Delta Lake, and Lakehouse architecture.Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.Experience with Apache Kafka and real-time streaming.Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.Experience with Docker and Kubernetes.Understanding of data modeling, dimensional modeling, and data warehousing concepts.Experience with Terraform and cloud infrastructure automation.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Pyspark Developer. Be the first to apply!