Python Spark Data Pipeline Engineer
Croesus
Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval or Montréal.The Data Engineering Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence solutions. Responsibilities span migration, Medallion architecture, metadata management, orchestration, monitoring, and incident response. You will work with diverse technical teams to turn business requirements into reliable, well-documented models while maintaining data quality and traceability.Key Responsibilities:
Develop high-performing ELT/ETL pipelines using Python and SparkModernize data flows through Databricks migration initiativesManage governance and metadata standards across datasetsAutomate pipeline orchestration, monitoring, and production alertingResolve incidents affecting production data flow performanceRequirements:
At least five years in data engineering or analytical developmentHands-on production Databricks experience with large data volumesProficiency in Python and distributed Spark processingKnowledge of DataOps, DevOps, and Unity CatalogStrong analytical, autonomous, and collaborative working styleApply Python, Spark, Databricks, and observability expertise to dependable data engineering at Croesus.
#J-18808-Ljbffr
Develop high-performing ELT/ETL pipelines using Python and SparkModernize data flows through Databricks migration initiativesManage governance and metadata standards across datasetsAutomate pipeline orchestration, monitoring, and production alertingResolve incidents affecting production data flow performanceRequirements:
At least five years in data engineering or analytical developmentHands-on production Databricks experience with large data volumesProficiency in Python and distributed Spark processingKnowledge of DataOps, DevOps, and Unity CatalogStrong analytical, autonomous, and collaborative working styleApply Python, Spark, Databricks, and observability expertise to dependable data engineering at Croesus.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Python Spark Data Pipeline Engineer in Winnipeg, MB vacancy
$136k - $160k per year
...Unchain Data in Toronto is seeking a Software Developer on our Data Engineering team to build core datasets powering analytics, experimentation... .... You will design scalable pipelines and tooling, collaborating with... ...in end-to-end data pipelines, Python production code, Spark or Flink...Python- Build reliable data pipelines with SparkSQL and PySpark as a remote Data Engineer at Samsara, serving candidates across Canada. Transform IoT data into actionable models... ...large-volume ETL pipelinesExpertise in SQL, Python, REST APIs, and Spark platformsApply data modeling...PythonRemote work
- ...with 5 to 7 years of experience in Scala and Apache Spark to design, develop, and optimize scalable big data processing solutions within the Hadoop Spark SparkSQL... .... You will design, implement, and optimize data pipelines, collaborating with data scientists, analysts, and architects...Suggested
- ...Samsara is seeking a Data Engineer in Canada to join our Data team. You will design and maintain data pipelines in a central data lake, using SparkSQL and PySpark to ingest and transform IoT device data and software product data into our core data model for analytics and dashboards...SuggestedRemote work
- We are looking for a Data Engineer with significant experience (9+ years) in Python and Spark for a full-time onsite position, five days a week. This role is crucial for developing effective software solutions. As a Data Engineer, you will utilize your Python and Pyspark...PythonFull time
- Build complex data pipelines with Python and SQL Server while working onsite five days weekly alongside operational teams. Maintain extremely accurate reporting solutions and data systems.As a Data Engineer, you will develop, test, deploy, and maintain ELT pipelines from varied...Python
- ...Scotiabank is seeking a Software Engineer (Python) in Toronto to design, develop, and support enterprise applications and data platforms. The role emphasizes Python, SQL, APIs, and scalable data pipelines, collaborating with business and technology teams to deliver high-performance...Python
- ...Pozent is seeking a hands-on Data Engineer to support the Total Fund Management Portfolio Management Technology team. You will design and deliver... ...data solutions in a cloud-native environment, focusing on Spark workloads and large-scale datasets. This is a subcontractor...PythonFor subcontractor
- ...Databricks Architect to build and optimize ETL pipelines on AWS or Azure. The ideal candidate will have strong expertise in Databricks, Spark, SQL, and Python. Responsibilities include implementing CI/CD pipelines, integrating data using APIs, and leading data engineering...Python
- Develop Python ETL pipelines and CI/CD operations onsite five days weekly, supporting accurate data delivery and strong partnerships with operational teams. Maintain clean, modular, testable solutions.In this Data Engineer role, you will build and maintain multiple pipelines...Python
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...Contract work
- ...Capital in Montreal is seeking a talented software engineer to join the Core Data team. You will help model, transform, and deliver... ...and investment researchers to build robust data pipelines and reliable services using Python and kdb+/q. The role emphasizes production...Python
- ...experienced Technical Lead for backend tooling and data platform work at their Montreal studio. You will own ingestion pipelines, build reliable connectors, and guide the MCP... ...diverse internal teams. You will mentor engineers, define deployment automation, and establish...Python
- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a... ...on role focuses on enterprise-grade pipelines and large-scale datasets.The Databricks... ...expertise to enterprise data engineering for a financial client. #J-18808-...Contract work
- ...Hunter Bond in Montreal, Canada seeks a Data Engineer / Database Developer to design, build, and optimize scalable cloud-based data... ...work across data engineering and ML workflows, developing Python-based data pipelines and supporting analytics initiatives. The role...Python
- SparkSQL and PySpark power this remote Data Engineer role at Samsara for candidates residing in Canada. Build pipelines supporting analytics and machine learning.As a Data Engineer... ...high-volume ETL pipelinesExpertise in SQL, Python, REST APIs, and Spark platformsUse SparkSQL,...PythonRemote work
- Northbeam is hiring a Software Engineer, Data Systems (Python) to build reliable data pipelines that ingest and transform data from multiple sources. You will develop secure APIs for tenant‑aware integrations and work in event‑driven and batch architectures to keep data fresh...PythonRemote work
- Build scalable data infrastructure at Nasdaq using Python, cloud platforms, and distributed pipelines. Support a global data marketplace serving hundreds of thousands of professionals.As a Data Engineering Specialist, reporting to the Senior Director of Data Engineering, you...Python
- ...Overview We are seeking an experienced Data Engineer with strong expertise in Big Data... ...hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and... ...Design, develop, and optimize scalable data pipelines using PySpark, Spark, Hadoop, and Apache...PythonWork at office3 days per week
- ...seeking a highly motivated and experienced Software Engineer with strong expertise in Core Java, Apache Spark, Python, SQL, and Linux to design, develop, and support scalable server-side applications and analytical data processing systems. The ideal candidate will have hands...Python
- Wipro Limited in Mississauga, Canada is seeking an experienced data engineer to design and implement large-scale data pipelines using Python, PySpark and SQL. You will work with Spark, Hive and Hadoop in a Big Data ecosystem to optimize data quality, profiling and ETL/ELT processes...Python
- Build scalable data solutions with Python 3.X, PySpark, and SQL while working across large-scale transformation... ...platform experience to modern data engineering.This Python PySpark Data Engineer... ...position focuses on reusable Python modules, Spark DataFrames, and Spark SQL. You will...Python
- ...à la gestion fondamentale systématique de La Caisse grâce à Python, SQL, Spark et l’analyse quantitative. Le modèle hybride prévoit quatre jours... ....Responsabilités clés : Concevoir et maintenir des pipelines de données robustesDévelopper des modèles alimentant les processus...PythonWork at office
- Engineer reliable cloud data pipelines using BigQuery, REST APIs, and Python for Clever Digital Marketing’s fully remote Canadian team. Strengthen the infrastructure behind measurable advertising performance.As an Intermediate Data Engineer, you will build within an established...PythonRemote work
- Build trustworthy data pipelines at Foresight using Python, advanced SQL, and production-grade workflow orchestration. Preferred locations include New York, San Francisco, and Montreal.As a Senior Data Engineer, you will build Foresight's data foundation for predictions, AI...Python
- Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy... ...high quality and accuracy. As a Data Engineer, you will design and run large-scale... ..., emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness...PythonPart timeWork at office
- Engineer enterprise-scale data pipelines with Python, Apache Spark, and Apache Beam for modern cloud-based data platforms. Apply strong SQL and platform expertise.This Senior Data Engineer role at TechBlocks centers on building and expanding enterprise data capabilities. You...Python
- Build trusted measurement data pipelines with Python and SQL as a remote-first Data Engineer serving Canada or the United States. Turn messy site data into dependable systems.In this full-time core engineering role, you will build and run production pipelines for data from installed...PythonFull timeRemote work
- ...Triton Digital Canada Inc. is seeking an MLOps Data Engineer to bridge data science and production systems. You will design and automate CI/CD pipelines, optimize large-scale data processing with Apache Spark, and leverage Databricks to deliver reliable ML solutions. Your...Remote work
- Build scalable data pipelines with Python and SQL for Hirevantis LLC’s Canadian enterprise client, working hybrid in Toronto or remotely across Canada... ...and machine learning teams.As an experienced Data Engineer, you will create cloud data architectures that transform raw...PythonFull timeContract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Spark Data Pipeline Engineer. Be the first to apply!
Related searches
- python developer no experience Winnipeg, MB
- junior python developer Winnipeg, MB
- python data engineer Winnipeg, MB
- python developer remote Winnipeg, MB
- python developer Winnipeg, MB
- développeur python Winnipeg, MB
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB

