Python Data Engineer - High-Volume Pipelines (On-site)

Location: Montreal, Quebec

Our client is a global investment management firm. As a technology and data-driven firm, they design and build their own cutting-edge systems, from high performance trading platforms to large scale data analysis and compute farms.

We are seeking an experienced Python developer responsible for delivering a vast quantity of data served to users worldwide. You will be a cornerstone of a growing Data team, becoming a technical subject matter expert and developing strong working relationships with quant researchers, traders, and fellow colleagues across our Technology organisation.

The ingestion pipelines and data transformation jobs are resilient and highly maintainable, while the data models are carefully designed in close collaboration with our researchers for efficient query construction and alpha generation.

You will:
•Design, develop, and optimize scalable data pipelines for ingesting, transforming, and serving financial data.
•Collaborate closely with researchers, traders, and other engineering teams to onboard new datasets and improve data delivery.
•Maintain and enhance distributed systems and high-performance databases, ensuring efficiency and reliability.
•Develop, test, and deploy software solutions in a Linux-based environment with a strong focus on automation.
•Debug and troubleshoot data integrity, performance, and infrastructure issues related to data pipelines.
•Work with internal proprietary systems and open-source tools to manage large data sets and real-time data flows.
•Take ownership of the production environment and participate in support rotations during business hours.
•Potential to grow into a leadership role, mentoring junior engineers and driving technical initiatives.
•Regularly take the lead on production support operations - during normal working hours only.

PLEASE NOTE - This role requires 4 days/week on-site

Must Have Skills:

•Bachelor's degree in a STEM subject,
•4+ years of Python development experience (8+ years preferred).
•Strong grasp of object-oriented programming in Python.
•Experience developing scalable, maintainable software systems.
•SQL and RDBMS expertise (PostgreSQL preferred).
•Strong ability to write and optimize complex queries.
•Understanding of indexing, partitioning, and database performance tuning.
•ETL pipeline development experience.
•Knowledge of data ingestion, transformation, and storage best practices.
•Hands-on experience building and managing high-throughput data pipelines.
•Experience developing in Linux-based environments and troubleshooting performance issues.
•Experience working with large-scale data systems that process high volumes of structured and unstructured data.
#J-18808-Ljbffr