Data Engineer
$120.8k - $170.8k per yearCitigroup Inc.
The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.This is a hands-on technology leadership role responsible for architecting, developing, optimizing, and operating large-scale batch and real-time data-processing platforms at an enterprise scale. The position requires a candidate who can combine deep technical expertise in distributed data processing with effective team leadership, stakeholder management, and end-to-end delivery accountability. The successful candidate will serve as a subject-matter expert in modern data engineering, guiding both technical strategy and execution.The Data Engineering Lead will drive the design and implementation of high-throughput data solutions capable of handling multi-terabyte to petabyte-scale datasets. This role balances advanced development and performance engineering with the leadership of a global team of data engineers, ensuring the delivery of robust, scalable, and maintainable data pipelines.Responsibilities:Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvementsResolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standardsProvide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprintUtilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementationDevelop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goalsProvide in-depth analysis with interpretive thinking to define issues and develop innovative solutionsServe as advisor or coach to mid-level developers and analysts, allocating work as necessaryLead the architecture, design, and development of high-throughput batch and real-time streaming data pipelines using Apache Spark, Databricks, and Kafka.Serve as the senior subject-matter expert for Spark architecture, job optimization, SQL query tuning, distributed processing, and Databricks performance engineering.Write, review, and approve clean, modular, and highly performant Scala and Python code, enforcing best practices across the team.Diagnose and resolve complex performance bottlenecks by analyzing Spark DAGs, execution plans, and executor metrics to address issues like data skew, shuffling, and memory management.Apply advanced optimization techniques for Spark and SQL, including broadcast joins, predicate pushdown, partition pruning, Z-Ordering, and adaptive query execution.Manage and optimize Databricks workspaces, including Unity Catalog, Delta Live Tables, job clusters, security, governance, and monitoring.Implement and manage Apache Iceberg or Delta Lake as an enterprise table format, applying knowledge of features such as hidden partitioning, schema evolution, and compaction strategies.Develop and enforce enterprise data-modelling standards and Lakehouse practices, including medallion architecture (Bronze, Silver, Gold layers).Lead, mentor, and develop a global team of data engineers, conducting code reviews, architecture reviews, and technical design sessions.Manage technical priorities, delivery milestones, dependencies, and risks, and collaborate effectively with business stakeholders, product owners, architects, and support teams.Define and enforce standards for coding, testing, deployment, monitoring, data quality, operational readiness, and production support.Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.Recommended Qualifications:6+ years of relevant experience in Apps Development or systems analysis roleExtensive experience system analysis and in programming of software applicationsExpert-level development skills in Scala and Python.Advanced SQL development and query-optimization skills, with a proven ability to tune slow-running queries and Spark jobs.Strong knowledge of data warehousing concepts, Lakehouse modelling, and medallion architecture.Hands-on experience with Apache Iceberg or Delta Lake is required.Extensive hands-on experience with Apache Spark, Spark Structured Streaming, Databricks, Delta Live Tables, and Kafka.Deep knowledge of Apache Spark internals, including the Catalyst Optimizer, Tungsten execution engine, memory management, execution plans, partitioning, and shuffle behavior.Expertise in reading Spark UI metrics to identify bottlenecks, resolve data skew, and optimize partitioning, caching, joins, and memory utilization.Proven experience architecting and operating multi-terabyte to petabyte-scale data platforms in a public-cloud environment (AWS or Google Cloud Platform).Subject Matter Expert (SME) in at least one area of Applications DevelopmentExperience in managing and implementing successful projectsExperience leading and mentoring global or distributed data-engineering teams.Demonstrated leadership and project management skillsExceptional communication, stakeholder-management, and problem-solving skills.Consistently demonstrates clear and concise written and verbal communicationAbility to adjust priorities quickly as circumstances dictateEducation:Bachelor’s degree/University degree or equivalent experienceMaster’s degree preferredThis job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.Job Family Group:
TechnologyJob Family:
Applications DevelopmentTime Type:
Full timePrimary Location Full Time Salary Range:
$120,800.00 - $170,800.00Most Relevant Skills
Please see the requirements listed above.Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.Automated Processing and AI
We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.This job opening is for an existing job vacancy.Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.
#J-18808-Ljbffr
TechnologyJob Family:
Applications DevelopmentTime Type:
Full timePrimary Location Full Time Salary Range:
$120,800.00 - $170,800.00Most Relevant Skills
Please see the requirements listed above.Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.Automated Processing and AI
We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.This job opening is for an existing job vacancy.Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in Winnipeg, MB vacancy
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...SuggestedPermanent employmentFull time
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Suggested
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...SuggestedFull time- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...Work at officeFlexible hours
- ...Strong hands-on experience in Python programming, including Pandas, NumPy, and data processing libraries. Strong experience with PySpark for distributed data processing and large-scale data transformation. Extensive knowledge of SQL , including complex queries,...Internship
- Data Engineer (Python, SQL, pipelines de données), lab IA et données, Montréal (télétravail) Poste permanent chez Abbeal : concevoir et faire tourner les pipelines de données de plusieurs projets clients au sein d'un lab IA. Python, SQL, ETL/ELT, cloud. Télétravail au Québec...Permanent employmentRemote work
$100k - $145k per year
Core engineering · Full-time · Remote-first · Canada or USData pipelines, data quality & measurement dataAbout the role Every installed Energy Router measures what happens at its site, all day. That data is how we show results to customers and utilities, and how we decide...Full timeRemote work$100k - $150k per year
...leave our clients better than we found them, and to create a place where our people are proud to Build. Better. Role OverviewAs a Data Engineer at RAVL, you’ll design, build, and operate the data pipelines and platforms that power decision-making for modern organizations....Flexible hours- Our client, an established, data-driven technology company in Quebec, is hiring a permanent, full-time Data Engineer. You’ll work in Python, SQL, and the cloud, with a strong focus on machine learning infrastructure. The role is hybrid. This is a chance to shape how a data...Permanent employmentFull time
- ...ingestion, dbt for transformation, and AWS-native services (S3, Glue, Athena, Bedrock) for storage, compute, and AI enablement. The Data Engineering Specialist works inside this stack, embedded in the Data Platform team.What we're looking for. A hands-on data engineer fluent...Casual work
- ...our journey is only achievable by having a great team who shares ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted,...Work at office
- Nous recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données robustes, performantes et évolutives. La personne travaillera en collaboration avec les équipes de données, d'architecture, ...
- Take your career to new heights with Loopio!Loopio’s Data Engineering Team works together on a mission to transform the RFP response process... ...understanding of relational databases (RDS/Aurora) and NoSQL engines (Redis/DynamoDB/Neptune/etc). Experience with ETL & Data warehousing...InternshipRemote workWork from homeHome officeFlexible hours
- The Data Engineer III is a core builder on the Strategic Partnerships team’s data platform. They design and ship ETL pipelines, semantic models, and the supporting infrastructure that powers cross-functional initiatives with Marketing, Finance, Sales, Legal, HR, and ProductBecause...Remote workFlexible hours
- Position Overview We are looking for an experienced and versatile Data Engineer to join our dynamic and fast-growing team. If you are passionate about data, solving complex problems, and working directly with enterprise stakeholders to translate business needs into...Long term contractWork at officeRemote workWork from home
$88k - $128.7k per year
Job Requisition ID # 26WD101542Position Overview Autodesk is looking for a skilled and innovative Senior Data Engineer to join our Compliance team, which builds data-driven systems to detect and address non-compliant usage of Autodesk software. This is a key strategic initiative...- ...Data Engineer (AWS / Snowflake / DBT / Airflow / Informatica IICS) About Act Digital Act Digital is an international IT consulting firm with 5,000+ experts worldwide , supporting leading organizations in their digital transformation. In Canada, we specialize in Data...Long term contractRemote workWorldwide
- ...We believe in working collaboratively with our clients and employees to achieve success. DS Technologies Inc is looking for Data Engineer role for one of our premier clients. Job Title: Data Engineer Location: Remote – Costa Rica, Canada, Colombia Work...Local areaRemote workShift work
- We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats. KEY RESPONSIBILITIES Develop and optimize...
- Iris's direct client, one of the Top 5 Bank in Canada, is looking to hire a Data Engineer for a long-term opportunity in Toronto, ON (Hybrid Position) .Our client is a Canadian multinational financial services company and the largest bank in Canada by market capitalization...Long term contractWorldwideFlexible hours3 days per week
- ...As a Data Scientist at Cogeco, you will develop predictive modeling and machine learning solutions to complex business problems creating... ..., integrating work into applications and tools with data engineers, business leads, analysts and developers. Create repeatable, interpretable...Long term contract
$100k - $140k per year
...prioritizing battery performance. The OpportunityReporting to the Director of Software Engineering, you will have the opportunity to work with a talented group of Software Engineers, Data Scientists and business stakeholders in a fast-paced and exciting environment. As a...InternshipFlexible hoursNight shiftWeekend work- ...media company specializing in creating high-quality content and data-driven solutions to support business growth. We leverage cutting-... ...outcomes. Position Overview: We are seeking a motivated Data Engineer to join our growing team at Ace1 Media. In this role, you will...
$85 - $89 per hour
Duration: 12 month contract + possible extensionsData Engineer to support a large enterprise transformation focused on building data pipelines, integrating data, and migrating data workloads from on-premises environments to AWS.This person should be technically strong in Python...Contract workManual labor- ...high-value sales intelligence. Leading infrastructure vendors, engineering firms, and construction companies use the platform to identify and... .... The platform integrates seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly into sales workflows...Work at officeImmediate start3 days per week
$100k - $130k per year
...by placing patients at the center of the record release process, data moves more ethically, easily and securely throughout the care journey... ...for millions more patients across North America.As a Data Engineer, you will help build and maintain the data infrastructure that powers...InternshipManual laborRemote work- ...history as Parquet and run their own queries. That only works if the data is actually right, which makes correctness, lineage and... ...GoReal familiarity with columnar formats, ideally Parquet, and query engines like DuckDB, Polars or SparkCare for data correctness: testing, validation...Work at officeWork from home
$108k - $135k per year
...comfortable while riding or driving with Lyft, transforming every support interaction into a moment of genuine connection. As a Data Engineer on the SCC team, you will have ownership over the data modeling and pipelines that power SCC's Associate and AI Agent Platform....Hourly payWork at officeFlexible hours3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

