Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Python Spark Data Pipeline Engineer

Croesus

Engineer monitored, governed data flows with Python and Spark for Croesus's wealth management platforms. This hybrid position requires two weekly office days in Laval or Montréal.The Data Engineering Expert develops and operates modern Databricks Lakehouse pipelines supporting analytics and artificial intelligence solutions. Responsibilities span migration, Medallion architecture, metadata management, orchestration, monitoring, and incident response. You will work with diverse technical teams to turn business requirements into reliable, well-documented models while maintaining data quality and traceability.Key Responsibilities:
Develop high-performing ELT/ETL pipelines using Python and SparkModernize data flows through Databricks migration initiativesManage governance and metadata standards across datasetsAutomate pipeline orchestration, monitoring, and production alertingResolve incidents affecting production data flow performanceRequirements:
At least five years in data engineering or analytical developmentHands-on production Databricks experience with large data volumesProficiency in Python and distributed Spark processingKnowledge of DataOps, DevOps, and Unity CatalogStrong analytical, autonomous, and collaborative working styleApply Python, Spark, Databricks, and observability expertise to dependable data engineering at Croesus.
#J-18808-Ljbffr
Vacancy posted more than 2 months ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Python Spark Data Pipeline Engineer. Be the first to apply!