Python Pyspark Developer
Lancesoft
Strong programming experience in
Python 3.X, including OOP, data structures, exception handling, and reusable modules.Hands-on experience with
PySpark, Apache Spark, Spark SQL, and Spark DataFrames .Strong expertise in SQL, query optimization, and relational databases.Experience developing ETL/ELT pipelines and large-scale data transformation workflows.Knowledge of distributed computing, parallel processing, and big data architecture.Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.Hands-on experience with cloud platforms (AWS/Azure/GCP).Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.Preferred / Nice-to-Have Skills
Experience with Databricks, Delta Lake, and Lakehouse architecture.Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.Experience with Apache Kafka and real-time streaming.Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.Experience with Docker and Kubernetes.Understanding of data modeling, dimensional modeling, and data warehousing concepts.Experience with Terraform and cloud infrastructure automation.
#J-18808-Ljbffr
Python 3.X, including OOP, data structures, exception handling, and reusable modules.Hands-on experience with
PySpark, Apache Spark, Spark SQL, and Spark DataFrames .Strong expertise in SQL, query optimization, and relational databases.Experience developing ETL/ELT pipelines and large-scale data transformation workflows.Knowledge of distributed computing, parallel processing, and big data architecture.Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.Hands-on experience with cloud platforms (AWS/Azure/GCP).Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.Preferred / Nice-to-Have Skills
Experience with Databricks, Delta Lake, and Lakehouse architecture.Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.Experience with Apache Kafka and real-time streaming.Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.Experience with Docker and Kubernetes.Understanding of data modeling, dimensional modeling, and data warehousing concepts.Experience with Terraform and cloud infrastructure automation.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Pyspark Developer. Be the first to apply!
Related searches
- python developer no experience Winnipeg, MB
- junior python developer Winnipeg, MB
- python data engineer Winnipeg, MB
- python developer remote Winnipeg, MB
- python developer Winnipeg, MB
- développeur python Winnipeg, MB
- python Winnipeg, MB
- python developer no experience
- junior python developer
- python data engineer
