Senior Data Engineer
E-IT
Must have : SQL+ Datawarehouse+ Banking domainJob DescriptionThis position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Vacancy posted 44 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Winnipeg, MB vacancy
$110k per year
...with experience. About the Team: The Data & Analytics team is moving from a legacy... ...data quality standards, and creating engineering patterns that let analytics, product, engineering... ...confidence. About the Role: The Senior Data Engineer will design, build, and...SeniorFull time- ...feel valued and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling...SeniorWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
$83.95k - $130k per year
...a more sustainable, more inclusive world.Data MigrationData ModelingData QualityETL/ELT... ...BI are nice to havesJob DescriptionData engineers are responsible for building reliable and... ...licenses, Relevant experience and skills, Seniority and performance, Market and business consideration...SeniorFull timeLocal areaCapgemini
Winnipeg, MB34 minutes ago- A career as a Senior Developer in Data Engineering on the Financial crime and regulatory projects team at National Bank means serving as a Data Analytics Specialist. This position allows you to have a positive impact on our organisation thanks to your expertise in engineering...SeniorFlexible hours
National Bank of Canada
Winnipeg, MB35 minutes ago $180k - $240k per year
...The AI buildout runs on physical things: data centers, power, and the supply chains... ...York. The role We're looking for a Senior Data Engineer to build the data foundation behind Foresight... ...and vector search (pgvector or a search engine) for AI features. ~ Event-driven...SeniorFor contractorsInternshipWork at officeForesight Works
Winnipeg, MB37 minutes ago- We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms. The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache...Senior
Techblocks
Winnipeg, MB37 minutes ago $100k per year
...iconic brand that prioritizes a member-centric experience. Data is not just a tool for us. it’s the engine powering our growth strategy and our journey to... ...the future with us. Who we need Reporting to the Senior Manager, Data Engineering and Data Governance, we are looking...SeniorLong term contractFull timeWork at office3 days per weekScene+
Winnipeg, MB38 minutes ago- Job Description Reporting to the Sr. Manager, Data Architecture, the Senior Data Engineer will play a key role in designing, building, and modernizing enterprise data integrations that support business transformation initiatives across Extendicare. This individual will develop...SeniorLong term contractInternshipWork at office
111000 Extendicare (Canada) Inc.
Winnipeg, MB38 minutes ago - ...and subscriptions at scale, combining the agility of a high-growth business with the backing of a global organization. As the Senior Data Engineer, you will help design, build, and evolve CloudBlue’s data and analytics platform, with a strong focus on AI-driven capabilities...SeniorInternshipRemote work
HostPapa, Inc.
Winnipeg, MB40 minutes ago $127k - $155k per year
The Opportunity Senior Data Engineers are the builders for the business. You are recruited early and help stand up the managed foundation alongside the architect, then build the data products that non-engineering teams need once the architecture is defined and the backlog...SeniorContract workWork at office3 days per weekEuna Solutions
Winnipeg, MB43 minutes ago- ...Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing, modeling, developing, and managing data warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica...Senior
Compunnel Inc.
Winnipeg, MB33 minutes ago $100k - $150k per year
...include Airbnb, Instacart, DoorDash, etc. ( We are looking for a Senior Data Engineer to join our growing team! What We're Looking ForTaiv runs... ...experience with at least one modern data warehouse or query engine (ClickHouse, Athena, Snowflake, BigQuery, Redshift, or...SeniorFull timeWork at officeRelocationMonday to fridayTaiv
Winnipeg, MB37 minutes ago$125k - $165k per year
...workforce management, turning customer interaction and operational data into actionable insights across multiple lines of business.... ...decision into a competitive advantage. We’re hiring a Senior Data Engineer on a 12-Month Contract to own data engineering on our Data Enablement...SeniorContract workInternshipRemote workFlexible hoursCoconut Software
Winnipeg, MB39 minutes ago- ...leader in security workforce management software. $100 - $130 a year Trackforce is seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the data infrastructure that...SeniorLong term contractWork at officeLocal areaRemote workWork from homeFlexible hours
TrackTik
Winnipeg, MB42 minutes ago - ...an important pillar of Sun Life Canada’s Data and Analytics growth and corporate strategy... ...and as such, is seeking experienced data engineering individual with a proven track record... ...meaningful insights from enterprise data. This Senior Business data engineer will play an...SeniorManual laborWork at officeWork from home
Sun Life
Winnipeg, MB42 minutes ago - .... Join us!Job Description:This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex data... ...Storage, Data Lakehouse architecture, distributed query engines, and streaming technologies to support real-time, near real-time...SeniorWork at officeFlexible hours
Bank of America Corporation
Winnipeg, MB43 minutes ago $140k - $180k per year
About ShyftLabsAt ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune 500 companies unlock growth with... .... The OpportunityShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery of enterprise...SeniorWork at office3 days per weekShyftLabs
Winnipeg, MB44 minutes ago- # Senior Data EngineerMontreal, QC (Hybrid)Full-timeAt Flex Travel Solutions, we foster an environment of passion, innovation and collaboration... ...first company, we're currently looking for a Senior Data Engineer to join our team.The Role: As a Senior Data Engineer at FTS, you...SeniorWork at officeRemote work
Flex Travel Solutions
Winnipeg, MB39 minutes ago $157.3k - $212.8k per year
...all by bettering the lives of legal professionals while increasing access to justice. Summary: We are currently seeking a Senior Data Engineer to join our rapidly growing engineering team. This role is for someone who is passionate about building innovative data...SeniorWork at officeLocal areaRemote workFlexible hoursClio
Winnipeg, MB42 minutes ago- ...and contribute to a global analytics initiative focused on strengthening the security of Client data. Sun Life’s Information Security organization is enhancing its data engineering, platform, analytics, and insights capabilities through new tools and, most importantly, new...SeniorWork at officeWork from homeFlexible hours
Sun Life of Canada - Corporate
Winnipeg, MB38 minutes ago - ...Labs Chainlink Labs is one of the primary contributing developers of Chainlink, the standard for onchain finance enabling high-quality data, secure cross-chain interoperability, and compliant connectivity across global markets. Chainlink powers leading tokenized assets,...SeniorRemote work
Chainlink Labs
Winnipeg, MB38 minutes ago - The Senior Data Engineer reports to the Director, Information Technology Operations and designs, builds, and scales the data systems that support analytics, AI-enabled experiences, and organizational decision-making. The role owns significant parts of the data platform, including...SeniorLong term contractContract work
Exchange Solutions
Winnipeg, MB40 minutes ago $100k - $110k per year
...consecutive years, we operate in 90 markets, offer more than 75 data-driven solutions, and serve over 5,000 clients worldwide. Our research... ...looking for someone with a deep interest and expertise in data engineering and the dedication to apply that passion. We need someone with...SeniorWorldwideFlexible hoursIpsos in Canada
Winnipeg, MB43 minutes ago$86k - $130k per year
...support the communities where we live and work.Don’t just work anywhere — come build tomorrow together with us.Role Summary The Senior Data Engineer will join the Software Engineering team that leads the delivery of data and application solutions that enable OMERS Global...SeniorLong term contractTemporary workInternshipWork at officeFlexible hoursOMERS
Winnipeg, MB43 minutes ago$180k - $220k per year
...onsite in our Toronto office to support collaborative team dynamics and innovative problem-solving.BitGo is seeking a skilled Senior Data Engineer to join our Data Engineering team and help build, scale, and optimize our data platform, reporting infrastructure, and data-driven...SeniorFull timeWork at officeWorldwideBitGo
Winnipeg, MB44 minutes ago$130k - $175k per year
...If you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...SeniorPenn Interactive Ventures
Winnipeg, MB36 minutes ago- ...creative professionals with diverse perspectives and backgrounds. Where you come in:We are seeking an experienced and adaptable Senior Data Engineer to join our data team in the finance and data warehousing domains. This role involves taking the lead in the ownership, design...SeniorRemote work
Beatport
Winnipeg, MB40 minutes ago $137k - $205k per year
...and you want to be part of the team that defines how the world eats, there is no better time to join us.About the Role As a Senior Data Engineer, you'll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs...SeniorLive InRemote workAfresh
Winnipeg, MB41 minutes ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB