Python Pyspark Data Engineer
Lancesoft
Build data pipelines with Python, PySpark, and Snowflake while transforming large-scale datasets through distributed processing. Apply deep SQL expertise to reliable engineering work.This Data Engineer role focuses on Python programming, PySpark transformations, and Snowflake development. You will create ETL and ELT solutions, integrate data, and support migration and orchestration. The work also involves data warehousing, schema design, validation, and error handling.Key Responsibilities:
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr
Develop data processing solutions using Python librariesTransform large-scale datasets with PySparkBuild ETL and ELT data integration pipelinesDesign Snowflake tasks, streams, stages, and Snowpipe workflowsImplement incremental loads, validation, and error handlingRequirements:
Strong Python experience with Pandas and NumPyStrong PySpark experience for distributed data processingExtensive SQL knowledge, including joins and window functionsHands-on ETL, migration, and pipeline orchestration experienceExperience with Git, debugging, and code deploymentUse Python, PySpark, SQL, and Snowflake expertise to engineer scalable data processing and integration pipelines.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Python Pyspark Data Engineer in Winnipeg, MB vacancy
- ...The Data Engineer will design, develop, and maintain scalable data pipelines and workflows using Python, PySpark, and cloud technologies. This role involves managing data storage solutions, orchestrating ETL processes, and deploying containerized applications to support...Python
- A tech solutions company is looking for an experienced Python/PySpark Developer to design and optimize data-driven applications. This role involves developing applications, utilizing Databricks, and integrating data pipelines. The ideal candidate will possess strong skills in...PythonRemote work
- ...Luxoft in Toronto is seeking a senior data engineer to support the Analytical Work Bench integration, including AWS-based data pipelines and... ...quality with standard testing practices. Join a team that leverages PySpark, PyTest, and Pylint, while integrating with CI/CD tooling such...Python
- # Forward Deployed Engineer (Python/Pyspark Developer)Apptoza Inc. · Toronto, Ontario, CABack to resultsForward Deployed Engineer (Python/Pyspark Developer... ...Engineer who combines production-grade software engineering, data engineering, AI application development, and client-facing...Python
- ...We are seeking an experienced Python/PySpark Developer to design, develop, and optimize data-driven applications and solutions. The ideal candidate will have strong expertise in Python, PySpark, and Databricks, along with experience in Azure DevOps and enterprise data integration...PythonFull time
- Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce...Python
- Utilisez Python et PySpark pour transformer les données chez BMR, dans un rôle axé sur l’intégration, la modélisation et les solutions BI. Collaborez avec les analystes d’affaires.Comme Développeur de données, vous soutiendrez l’évolution de l’architecture et la transformation...Python
- ...Overview We are seeking an experienced Data Engineer with strong expertise in Big Data... ...candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components... ...Ecosystem (HDFS, Hive, YARN) SQL Python Preferred Skills Spark Streaming...PythonWork at office3 days per week
- Apply your advanced skills in a role as an Expert Python/PySpark Developer, dedicated to enhancing data-driven solutions. This position offers flexible modes of teamwork and application development. We are in search of an experienced Python/PySpark Developer, enriched with...PythonFlexible hours
- GCP Data Migration Engineer – PySpark & Salesforce Data MigrationGCP Data Migration Engineer – PySpark & Salesforce Data Migration Required Skills... ...with GCP Dataproc and Apache Spark (PySpark preferred) Python scripting for custom data transformations and business logic...Python
- Build analytical data solutions with Python, PySpark, and AWS in downtown Toronto, working onsite four days weekly on a hybrid contract.This senior development assignment supports a global IT services firm serving a leading investment and wealth management services firm. You...PythonContract workWork at office
- ...Project description The project involves the data engineering organization’s Analytical Work Bench , which is an integrated development... ...solutions utilizing AWS EMR. Advanced proficiency in Python Core and PySpark, with over 8 years of hands-on experience. Practical...Python
- Location: Montreal, QC (REMOTE) Type: Contract Role Overview As a Senior Databricks Data Platform Engineer you will own the engineering automation and day to day health of our enterprise Databricks Lakehouse platform This is a platform-first role rather than building...Contract workRemote work
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...or Diploma in Computer Science, Data Engineering, Information Systems, or related field.... ...Engineer or similar role. · Proficiency in Python, PySpark, data modeling, ETL processes and data...PythonPermanent employment- Python and PySpark specialists can build clinical data pipelines in Toronto, processing CCD and C-CDA documents at scale. Work centers on healthcare data engineering.This Data Engineer role requires 15 years of experience and hands-on Python development. You will parse clinical...PythonWork at office
- Design cloud data pipelines with PySpark and AWS Glue, supporting secure, high-performing ecosystems for analytics and operational efficiency.As a... ...requirements into technical designs with business analysts and data engineers.Key Responsibilities: Design end-to-end pipelines and...
- Build scalable data infrastructure at Nasdaq using Python, cloud platforms, and distributed pipelines. Support a global data marketplace serving hundreds of thousands of professionals.As a Data Engineering Specialist, reporting to the Senior Director of Data Engineering, you...Python
- Design enterprise AWS data platforms with Python, SQL, and ETL expertise as a Senior AWS Data Engineer on a twelve-month contract.This senior individual contributor role requires... ...-grade cloud solutions. Apply AWS Glue, PySpark, Lambda, S3, Redshift, and streaming technologies...PythonContract work
- ...professionals, and our annual growth rate exceeds 25%. Job Description Miratech is looking for a skilled Senior AI Engineer with Python, LangGraph and LangChain to join our US healthcare client. You will play a key role in developing and enhancing an enterprise AI...PythonFull timeInternshipRemote workRelocation
- Python data engineering leads this intermediate position in Toronto, with backend services, analytics, and hybrid work two days onsite weekly.Randstad Canada presents an intermediate Software Engineer opportunity with a leading SaaS company. The work centers on backend development...PythonWork at office
- Astra-North Infoteck Inc. in Toronto seeks an experienced Data Engineer with deep Big Data expertise to design, develop, and support enterprise-scale data platforms. The role focuses on PySpark, Apache Spark, Kafka, Hadoop ecosystem, and NiFi, covering ingestion, transformation...
- Software Engineer, Data Systems (Python)Remote - Canada About NorthbeamNorthbeam is building the world's most advanced marketing intelligence platform, providing top eCommerce brands a unified view of their business data through powerful attribution modeling and customizable...PythonRemote workWork from homeFlexible hours
- Build reliable data systems remotely at Intrinsic Development using Python, SQL, and modern ETL pipelines. Daily AI use shapes this engineering work.As a Data and AI Engineer, you will build and operate data platforms in a product-led environment. The work includes ETL and ELT...PythonRemote work
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...Python
- Build Python tooling and APIs as a Data Platform Engineer at BRP, improving platform efficiency through automation, CI/CD, and scalable operations.Working in BRP’s Data Solutions group, you will extend data platform capabilities and improve efficiency. You will develop custom...Python
- Apply advanced Python and SQL skills to large-scale data engineering at Ipsos. Build cloud pipelines and warehouses within the Ipsos DataHub ecosystem.This Senior Data Engineer role focuses on ingesting, processing, and storing complex datasets across cloud-based platforms....Python
- Shape Python data processing workflows and backend APIs for an AI-driven risk intelligence platform, working remotely or hybrid in Montreal.As a Senior Software Engineer, you will contribute to an evolving product that screens media for compliance and due diligence. You will...PythonRemote work
- Build scalable data pipelines with SQL and Python as an in-office Data and Software Engineer at General Bank of Canada in Edmonton. Develop reliable data solutions for enterprise banking operations.This permanent full-time role supports data integration, transformation, modeling...PythonPermanent employmentFull timeWork at office
- ...leading IT Services firm in Toronto is seeking a Mid-Senior Level Data Tester to join their team. You will be responsible for testing... ...years of experience in Data testing, proficient in GCP Big Query, Python, and SQL, and possess excellent communication skills. The position...PythonFull time
- Step into a senior Data Engineer role focusing on developing data pipelines with Python and SQL. This position is ideal for experts in cloud technologies. You'll be responsible... ...• Develop scalable data solutions using Python, PySpark, and SQL • Optimize Snowflake database for...Python
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Pyspark Data Engineer. Be the first to apply!
Related searches
- développeur python Winnipeg, MB
- python developer Winnipeg, MB
- python data engineer Winnipeg, MB
- python developer remote Winnipeg, MB
- python developer no experience Winnipeg, MB
- junior python developer Winnipeg, MB
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB

