Senior Data Engineer
E-IT
Must have : SQL+ Datawarehouse+ Banking domainJob DescriptionThis position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Winnipeg, MB vacancy
$110k per year
...with experience. About the Team: The Data & Analytics team is moving from a legacy... ...data quality standards, and creating engineering patterns that let analytics, product, engineering... ...confidence. About the Role: The Senior Data Engineer will design, build, and...SeniorFull time- ...feel valued and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling...SeniorWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
usd115k - usd120k per year
...SUMMARY Livingston moves goods across a complex, high-velocity supply chain, and data is at the heart of how we plan, route, and optimize that movement. We're looking for a Senior Data Engineer to design, build, and scale the data infrastructure that powers logistics...SeniorLong term contractFlexible hoursLivingston International
Winnipeg, MB1 hour ago$140k - $180k per year
About ShyftLabsAt ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune 500 companies unlock growth with... .... The OpportunityShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery of enterprise...SeniorWork at office3 days per weekShyftLabs
Winnipeg, MB1 hour ago- What you'll be doing As a Senior Data Engineer, you'll provide technical leadership for the design and delivery of data products on CIBC's modern data platforms. You'll work closely with business partners and engineering teams to clarify requirements, design how data moves...SeniorRemote work
Canadian Imperial Bank of Commerce (Canada)
Winnipeg, MB1 hour ago $180k - $240k per year
...The AI buildout runs on physical things: data centers, power, and the supply chains... ...York. The role We're looking for a Senior Data Engineer to build the data foundation behind Foresight... ...and vector search (pgvector or a search engine) for AI features. ~ Event-driven...SeniorFor contractorsInternshipWork at officeForesight Works
Winnipeg, MB1 hour ago$157.3k - $212.8k per year
...all by bettering the lives of legal professionals while increasing access to justice. Summary: We are currently seeking a Senior Data Engineer to join our rapidly growing engineering team. This role is for someone who is passionate about building innovative data...SeniorWork at officeLocal areaRemote workFlexible hoursClio
Winnipeg, MB1 hour ago- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting To: Paul TartarianDescription Location - Pittsburgh, Boston, Toronto or MontrealWhy Confluence?At Confluence, we’ve...SeniorPermanent employmentFlexible hours
Confluence Technologies, Inc.
Winnipeg, MB1 hour ago - ...internal disciplines, vendors, clients and stakeholders to define data requirements and the technology stack for projects.Audit source... ..., or a related field.At least 5 years of experience in data engineering or related fields.Expert-level SQL and strong experience in ELT/...Senior
Apply Digital
Winnipeg, MB1 hour ago - ...and subscriptions at scale, combining the agility of a high-growth business with the backing of a global organization. As the Senior Data Engineer, you will help design, build, and evolve CloudBlue’s data and analytics platform, with a strong focus on AI-driven capabilities...SeniorInternshipRemote work
HostPapa, Inc.
Winnipeg, MB1 hour ago $160k - $200k per year
...are built. Traditional handoffs between product, design, and engineering are giving way to smaller, faster teams where builders can take... ...from concept to production in days instead of months. As a Senior Data Engineer, you'll own the data platform that powers decision-making...SeniorLong term contractPermanent employmentFull timeInternship3 days per weekClutch Canada
Winnipeg, MB1 hour ago$138.3k - $172.8k per year
...experience to a new industry, join our team as we help shape a brighter way forward. Job DescriptionWhat this job involves:As a Senior Data Engineer at JLL, you will leverage advanced technical expertise and enterprise-focused thinking to drive AI-powered automation that...SeniorRemplacementCAN ASA-Jones Lang LaSalle Real Estate Services, Inc.
Winnipeg, MB1 hour ago- ...and contribute to a global analytics initiative focused on strengthening the security of Client data. Sun Life’s Information Security organization is enhancing its data engineering, platform, analytics, and insights capabilities through new tools and, most importantly, new...SeniorWork at officeWork from homeFlexible hours
Sun Life of Canada - Corporate
Winnipeg, MB1 hour ago $130k - $175k per year
...If you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...SeniorPenn Interactive Ventures
Winnipeg, MB1 hour ago$100k - $110k per year
...consecutive years, we operate in 90 markets, offer more than 75 data-driven solutions, and serve over 5,000 clients worldwide. Our research... ...looking for someone with a deep interest and expertise in data engineering and the dedication to apply that passion. We need someone with...SeniorWorldwideFlexible hoursIpsos in Canada
Winnipeg, MB1 hour ago- As Sensor Tower continues to grow as a global company, we are looking for a Senior Data Engineer to build amazing products together. We have a wonderful team of more than a hundred engineers globally and are preparing for much more growth in the coming yearsWe are looking for...SeniorWork at officeRemote workWork from home
Sensor Tower
Winnipeg, MB1 hour ago $83.95k - $135k per year
...DataBricks (preferred) Hands-on data pipeline development, ingest... ...Demonstrate deep knowledge of the data engineering domain to build and support... ...in a distributed query engine Perform root cause analysis to... ...Relevant experience and skills, Seniority and performance, Market and...SeniorPermanent employmentFull timeLocal areaCapgemini
Winnipeg, MB1 hour ago$180k - $220k per year
...onsite in our Toronto office to support collaborative team dynamics and innovative problem-solving.BitGo is seeking a skilled Senior Data Engineer to join our Data Engineering team and help build, scale, and optimize our data platform, reporting infrastructure, and data-driven...SeniorFull timeWork at officeWorldwideBitGo
Winnipeg, MB1 hour ago$140k - $170k per year
...understanding of insurance processes, systems, and data with serious technical capability and... ...policies. Work with software/AI/ML engineers, data scientists, product, and business units... .... Experience in communicating with senior leadership to collect requirements, describe...SeniorLong term contractShift workQuandri Technologies, Inc.
Winnipeg, MB1 hour ago- # Senior Data EngineerMontreal, QC (Hybrid)Full-timeAt Flex Travel Solutions, we foster an environment of passion, innovation and collaboration... ...first company, we're currently looking for a Senior Data Engineer to join our team.The Role: As a Senior Data Engineer at FTS, you...SeniorWork at officeRemote work
Flex Travel Solutions
Winnipeg, MB1 hour ago $100k - $150k per year
...include Airbnb, Instacart, DoorDash, etc. ( We are looking for a Senior Data Engineer to join our growing team! What We're Looking ForTaiv runs... ...experience with at least one modern data warehouse or query engine (ClickHouse, Athena, Snowflake, BigQuery, Redshift, or...SeniorFull timeWork at officeRelocationMonday to fridayTaiv
Winnipeg, MB1 hour ago- A career as a Senior Developer in Data Engineering on the Financial crime and regulatory projects team at National Bank means serving as a Data Analytics Specialist. This position allows you to have a positive impact on our organisation thanks to your expertise in engineering...SeniorFlexible hours
National Bank of Canada
Winnipeg, MB1 hour ago - ...leader in security workforce management software. $100 - $130 a year Trackforce is seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the data infrastructure that...SeniorLong term contractWork at officeLocal areaRemote workWork from homeFlexible hours
TrackTik
Winnipeg, MB1 hour ago - ...We are currently hiring for a Senior/Staff Data Engineer(Contract full-time) to join our newly formed Data & Analytics Engineeringteam. This team is dedicated toestablishing a robust data & analytics engineering foundation at scale,empowering fast data-driven decision-making...SeniorFull timeContract workWork at officeRemote work
Bay Street Staffing
Winnipeg, MB1 hour ago - The Senior Data Engineer reports to the Director, Information Technology Operations and designs, builds, and scales the data systems that support analytics, AI-enabled experiences, and organizational decision-making. The role owns significant parts of the data platform, including...SeniorLong term contractContract work
Exchange Solutions
Winnipeg, MB1 hour ago - ...Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing, modeling, developing, and managing data warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica...Senior
Compunnel Inc.
Winnipeg, MB1 hour ago $120k - $130k per year
...We are looking for a Senior Data Engineer who will be responsible for designing and developing database systems, data models and schemas, as well as building data pipelines assembling large, complex data sets for analytical purposes. In this role, you will… Work in an...SeniorFundserv Inc.
Winnipeg, MB1 hour ago$125k - $165k per year
...workforce management, turning customer interaction and operational data into actionable insights across multiple lines of business.... ...decision into a competitive advantage. We’re hiring a Senior Data Engineer on a 12-Month Contract to own data engineering on our Data Enablement...SeniorContract workInternshipRemote workFlexible hoursCoconut Software
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB