Team Lead, Data Engineering - Databricks
$135k - $175k per yearThe Citco Group Limited
About CitcoSince the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.
Job DescriptionAs a Team Lead, you will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability while working on Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks.
This role requires a deep, hands‑on understanding of Databricks internals and a track record of delivering large‑scale data platforms in a cloud environment.
You will be part of a team driving technical excellence and innovation within Citco's data engineering practice.
Responsibilities
Lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge‑sharing sessions across multiple locations.
Drive the Agile/Scrum SDLC process and collaborate with team members.
Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics.
Develop and optimize ETL/ELT pipelines.
Create and manage structured streaming pipelines for real‑time data processing.
Configure and optimize Databricks clusters and Spark jobs for optimal performance.
Utilize Delta Live Tables for data ingestion and transformations.
Apply Unity Catalog features and IAM best practices for security governance and access control.
Support infrastructure and resource management using Terraform.
Implement monitoring solutions for pipeline performance and data quality.
Contribute to code reviews and knowledge‑sharing sessions.
Required Qualifications
8+ years of experience in data engineering.
3+ years of hands‑on experience with Databricks platform.
Proven experience leading a team.
Strong expertise in Python and Spark programming.
Demonstrable experience using AI in development.
Proven experience with AWS or other similar cloud services.
Deep understanding of data modeling and SQL.
Experience with Delta Lake and Lakehouse architecture.
Strong knowledge of ETL/ELT principles and patterns.
Experience with version control systems (Git).
Demonstrated ability to optimize data pipelines.
Strong problem‑solving and analytical skills.
Excellent communication and collaboration abilities.
Nice to Have
Financial services industry experience.
Experience with multiple cloud providers.
Knowledge of AI/ML implementation patterns.
API development experience.
Experience with real‑time data processing.
Data governance framework experience.
What Sets You Apart
Active interest in emerging technologies and industry trends.
Experience implementing complex data solutions.
Track record of continuous learning and skill development.
Strong technical documentation abilities.
Experience using AI tools to enhance productivity.
Ability to mentor junior team members.
Technical Environment
Primary Platform: Databricks
Cloud Platform: AWS (S3, Glue, Lambda)
Languages: Python, SQL
Tools: Delta Lake, Unity Catalog, Git
Additional: Real‑time processing, API integrations.
Salary RangeCAD $135,000 - CAD $175,000
Our BenefitsYour well‑being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
Citco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection.
#J-18808-Ljbffr
Job DescriptionAs a Team Lead, you will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability while working on Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks.
This role requires a deep, hands‑on understanding of Databricks internals and a track record of delivering large‑scale data platforms in a cloud environment.
You will be part of a team driving technical excellence and innovation within Citco's data engineering practice.
Responsibilities
Lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge‑sharing sessions across multiple locations.
Drive the Agile/Scrum SDLC process and collaborate with team members.
Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics.
Develop and optimize ETL/ELT pipelines.
Create and manage structured streaming pipelines for real‑time data processing.
Configure and optimize Databricks clusters and Spark jobs for optimal performance.
Utilize Delta Live Tables for data ingestion and transformations.
Apply Unity Catalog features and IAM best practices for security governance and access control.
Support infrastructure and resource management using Terraform.
Implement monitoring solutions for pipeline performance and data quality.
Contribute to code reviews and knowledge‑sharing sessions.
Required Qualifications
8+ years of experience in data engineering.
3+ years of hands‑on experience with Databricks platform.
Proven experience leading a team.
Strong expertise in Python and Spark programming.
Demonstrable experience using AI in development.
Proven experience with AWS or other similar cloud services.
Deep understanding of data modeling and SQL.
Experience with Delta Lake and Lakehouse architecture.
Strong knowledge of ETL/ELT principles and patterns.
Experience with version control systems (Git).
Demonstrated ability to optimize data pipelines.
Strong problem‑solving and analytical skills.
Excellent communication and collaboration abilities.
Nice to Have
Financial services industry experience.
Experience with multiple cloud providers.
Knowledge of AI/ML implementation patterns.
API development experience.
Experience with real‑time data processing.
Data governance framework experience.
What Sets You Apart
Active interest in emerging technologies and industry trends.
Experience implementing complex data solutions.
Track record of continuous learning and skill development.
Strong technical documentation abilities.
Experience using AI tools to enhance productivity.
Ability to mentor junior team members.
Technical Environment
Primary Platform: Databricks
Cloud Platform: AWS (S3, Glue, Lambda)
Languages: Python, SQL
Tools: Delta Lake, Unity Catalog, Git
Additional: Real‑time processing, API integrations.
Salary RangeCAD $135,000 - CAD $175,000
Our BenefitsYour well‑being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
Citco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection.
#J-18808-Ljbffr
Vacancy posted 51 minutes ago
Similar jobs that could be interesting for youBased on the Team Lead, Data Engineering - Databricks in Winnipeg, MB vacancy
- ...Intact is seeking a Team Lead for the Claims Data Analytics Team (CDAT) in Canada. You will guide analytics projects that inform customer experience, operational excellence and financial performance, while coaching team members and coordinating with stakeholders. Role requires...Suggested
- Lead Azure Databricks engineering at Seaspan in a hands-on team leadership role focused on scalable data solutions and reliable delivery. Direct Data Engineers while shaping Lakehouse architecture, pipelines, and enterprise data products.As Team Lead, Data Engineering, you...Databricks
- Lead enterprise data platforms with Databricks and Apache Spark at ShyftLabs, working three days weekly from its downtown Toronto office. Shape cloud solutions for Fortune 500 clients.As a Senior / Lead Data Engineer, you will own delivery from discovery through production deployment...DatabricksWork at office
- Lead enterprise Data and AI engineering with Databricks and AWS in Vanguard’s hybrid working model, building scalable platforms for analytics.Vanguard seeks an experienced Senior Lead Data and AI Engineer with 9–12+ years in Data Engineering and modern cloud data platforms....Databricks
- ...Industries Limited, North America’s leading manufacturer and distributor... ..., and working in a friendly, team-driven environment, you should... ...Lead a team of manufacturing engineers, specialists, and technicians... ...abilities, with a focus on data-driven decisions. • Strong...SuggestedFor contractorsWork at office
$120k - $130k per year
...advanced vessels, combined with industry-leading ship management services. As owner and... ..., Hong Kong, and Mumbai. The Data Development team's mission is to support Seaspan's growth... ...driven applications. As Team Lead, Data Engineering, you will be a hands-on technical and...DatabricksLong term contract$75 - $80 per hour
...Are you a seasoned data engineering professional ready to lead cutting-edge projects? Working with one of our top financial clients, this role calls for aTechnical Lead – Databricks, Data Engineering & Data Modeling. The position isfocused on spearheading data engineering...Databricks- ...remoteHourly Range : $90 – $95Job Overview As a Data Engineer, you will be responsible for designing,... ...as part of a cross-discipline agile team who help each other solve problems... ...Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BIWork within...DatabricksLong term contract
- ## Job Description# Databricks Data EngineerApply**Job#: 3057559****Job Description:****Databricks Data Engineer****Overview:**Apex Systems is seeking a Databricks Data Engineer in... ...appropriate data access.* Partner with the team’s Data Architect, who will own the underlying...DatabricksHourly payContract workManual labor
- The Data Team Lead is responsible for coordinating and supporting the delivery of data engineering and reporting capabilities within the Connected Data program. This role provides day‑to‑day guidance to Data Engineers and Power BI Developers, ensuring work is aligned...DatabricksManual labor
- Senior Databricks Data Engineer Location: Toronto (Hybrid - minimum 2 days per week onsite at the client's downtown Toronto office) Contract Length... ...Delivery and Collaboration Work within an Agile delivery team executing against two-week sprint commitments. Participate...DatabricksContract workWork at office2 days per week
- Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Seniority on the skill/s required on this requirement: Senior Level... ...Databricks platform while enabling engineering and data science teams. Key Responsibilities Databricks Platform...DatabricksContract workRemote work
- Principal Data Engineer – Databricks | Spark | Delta Lake | PySpark | Data Lakehouse | AWS/AzureJob DescriptionLocation: Toronto Work Model: Onsite... ...is a plus. Ability to act as a technical authority and lead architecture decisions. Experience mentoring senior...Databricks
- ~12–18 years of overall Data Engineering experience ~8+ years of experience with enterprise Data... ...~5+ years of hands‑on experience with Databricks and Apache Spark at scale ~ Strong experience... ...Act as a technical authority and lead enterprise architecture decisions Mentor...Databricks
- ...Who are we looking for: We are looking for an exceptional Team Lead, Software Engineer to lead, architect, and elevate our engineering team. We need... ...development, database design, multi-cloud environments, and in-memory data technologies. You bring deep technical expertise in software...
- Elevate your data engineering career at CPUS Engineering as a Data Engineer focused on Databricks. Enjoy a hybrid work model while designing and implementing data-driven applications... ...products. Working closely within an agile team, you'll leverage your expertise in Python, SQL...Databricks
- Data Engineer - Databricks (Remote)We work with global enterprises to design and build data platforms that power digital products used by millions... ...looking for a Senior Data Engineer to join our remote team and take ownership of building and scaling data solutions using...DatabricksFull timeRemote workMonday to fridayFlexible hours
- Azure Data Engineers with Databricks expertise will build scalable pipelines using SQL, Python, and cloud ETL tools across Azure environments.This position... ...for dashboards and BI tools. Collaboration with teams and business stakeholders supports tailored data solutions....Databricks
- Become a key player as a Lead Manager of Data Engineering at a leading data cloud consulting company. Your expertise in cloud data technologies will shape... ...This critical leadership role requires you to manage a team of data engineers while delivering innovative data solutions...
- Own Databricks infrastructure, Terraform deployments, and streaming reliability at Homebase... ...beneath AI-powered products.As a Data and ML Platform Engineer, you will control how data enters, runs... ...deployments. The role also includes cross-team partnership and shared on-call...DatabricksWork from home
- Parkland Corporation is expanding its Enterprise BI team with a BI Developer focused on data engineering in an Azure Databricks environment. You will design, build, test, and support trusted data products and pipelines, leveraging Delta Lake, Unity Catalog, and related Databricks...Databricks
- Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.Design, develop, and optimise Databricks solutions across large-scale...DatabricksContract work
- Enhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver... ...design ETL/ELT pipelines and collaborate with various teams to drive analytic insights. Your work will prioritize...Databricks
$84k - $128k per year
Senior Data Engineer (Databricks Focused)This site uses cookies to provide you with a more responsive and personalised service. By using this site you... ...Azure and Databricks. The successful candidate will also lead client engagements, aligning data initiatives with business objectives...DatabricksFull timeManual laborWork at officeLocal areaFlexible hours$140k - $180k per year
...businesses and brands. We empower industry-leading brands to navigate change, strategize,... ...million people. About The RoleAs a Data Architect & Team Lead, you will combine hands‑on... ...and empowering a talented team of data engineers. Your deep knowledge of data platforms...DatabricksWork from homeFlexible hours- Databricks and Apache Spark specialists can build scalable data solutions for a six-month contract supporting a top financial client. This hands-on role focuses on... ...ETL, and governance expertise to enterprise data engineering for a financial client. #J-18808-LjbffrDatabricksContract work
- Myticas Consulting is seeking a Senior Azure Data Platform Engineer / Team Lead for a short-term consulting engagement with a major banking client. This role will lead the technical assessment and improvement of an enterprise Azure data platform built primarily on...DatabricksTemporary work
- Lead Databricks data platform architecture at ShyftLabs from our downtown Toronto office three days weekly, using Spark and Python.As a Senior / Lead Data Engineer, you will guide enterprise-scale platforms for Fortune 500 clients. Apply Databricks, Apache Spark, Python, SQL...DatabricksWork at office
- Principal Data Engineer work in Toronto centers on Databricks, Apache Spark, and Lakehouse modernization. This onsite role requires four days weekly.This principal-level position leads enterprise data engineering initiatives across Databricks, Spark, Delta Lake, PySpark, and...DatabricksWork at office
- Build advertising data infrastructure remotely across Canada with Databricks, Apache Spark, and AI-native engineering practices. Own pipelines powering campaign analytics.This Senior Data... ...analysts, advertising strategists, sales teams, and commercial stakeholders.Key...DatabricksRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Team Lead, Data Engineering - Databricks. Be the first to apply!
Related searches
- summer camp leader Winnipeg, MB
- team lead marketing Winnipeg, MB
- responsable équipe production Winnipeg, MB
- sports team manager Winnipeg, MB
- IT team manager Winnipeg, MB
- group home manager Winnipeg, MB
- gestionnaire d’équipe Winnipeg, MB
- group fitness manager Winnipeg, MB
- team manager td insurance Winnipeg, MB
- chef d'équipe service Winnipeg, MB

