Senior Data Engineer
E-IT
Must have : SQL+ Datawarehouse+ Banking domainJob DescriptionThis position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Winnipeg, MB vacancy
$110k per year
...with experience. About the Team: The Data & Analytics team is moving from a legacy... ...data quality standards, and creating engineering patterns that let analytics, product, engineering... ...confidence. About the Role: The Senior Data Engineer will design, build, and...SeniorFull time- ...feel valued and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling...SeniorWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
$130k - $175k per year
...If you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...SeniorPenn Interactive Ventures
Winnipeg, MB1 hour ago$140k - $170k per year
...understanding of insurance processes, systems, and data with serious technical capability and... ...policies. Work with software/AI/ML engineers, data scientists, product, and business units... .... Experience in communicating with senior leadership to collect requirements, describe...SeniorLong term contractShift workQuandri Technologies, Inc.
Winnipeg, MB1 hour ago$160k - $200k per year
...are built. Traditional handoffs between product, design, and engineering are giving way to smaller, faster teams where builders can take... ...from concept to production in days instead of months. As a Senior Data Engineer, you'll own the data platform that powers decision-making...SeniorLong term contractPermanent employmentFull timeInternship3 days per weekClutch Canada
Winnipeg, MB1 hour ago- The Senior Data Engineer reports to the Director, Information Technology Operations and designs, builds, and scales the data systems that support analytics, AI-enabled experiences, and organizational decision-making. The role owns significant parts of the data platform, including...SeniorLong term contractContract work
Exchange Solutions
Winnipeg, MB1 hour ago $137k - $205k per year
...and you want to be part of the team that defines how the world eats, there is no better time to join us.About the Role As a Senior Data Engineer, you'll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs...SeniorLive InRemote workAfresh
Winnipeg, MB1 hour ago$157.3k - $212.8k per year
...all by bettering the lives of legal professionals while increasing access to justice. Summary: We are currently seeking a Senior Data Engineer to join our rapidly growing engineering team. This role is for someone who is passionate about building innovative data...SeniorWork at officeLocal areaRemote workFlexible hoursClio
Winnipeg, MB1 hour ago- ...leader in security workforce management software. $100 - $130 a year Trackforce is seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the data infrastructure that...SeniorLong term contractWork at officeLocal areaRemote workWork from homeFlexible hours
TrackTik
Winnipeg, MB1 hour ago $100k - $150k per year
...include Airbnb, Instacart, DoorDash, etc. ( We are looking for a Senior Data Engineer to join our growing team! What We're Looking ForTaiv runs... ...experience with at least one modern data warehouse or query engine (ClickHouse, Athena, Snowflake, BigQuery, Redshift, or...SeniorFull timeWork at officeRelocationMonday to fridayTaiv
Winnipeg, MB1 hour ago- # Senior Data EngineerMontreal, QC (Hybrid)Full-timeAt Flex Travel Solutions, we foster an environment of passion, innovation and collaboration... ...first company, we're currently looking for a Senior Data Engineer to join our team.The Role: As a Senior Data Engineer at FTS, you...SeniorWork at officeRemote work
Flex Travel Solutions
Winnipeg, MB1 hour ago - Project description We are looking for an experienced Senior Data Engineer to support the onboarding, integration, and operationalization of datasets used by Middle Office functions. The role focuses on building scalable, production-grade data pipelines and data products...SeniorLong term contractFor subcontractorWork at office
Luxoft
Winnipeg, MB1 hour ago - ...creative professionals with diverse perspectives and backgrounds. Where you come in:We are seeking an experienced and adaptable Senior Data Engineer to join our data team in the finance and data warehousing domains. This role involves taking the lead in the ownership, design...SeniorRemote work
Beatport
Winnipeg, MB1 hour ago - Job Description Reporting to the Sr. Manager, Data Architecture, the Senior Data Engineer will play a key role in designing, building, and modernizing enterprise data integrations that support business transformation initiatives across Extendicare. This individual will develop...SeniorLong term contractInternshipWork at office
111000 Extendicare (Canada) Inc.
Winnipeg, MB1 hour ago $127k - $155k per year
The Opportunity Senior Data Engineers are the builders for the business. You are recruited early and help stand up the managed foundation alongside the architect, then build the data products that non-engineering teams need once the architecture is defined and the backlog...SeniorContract workWork at office3 days per weekEuna Solutions
Winnipeg, MB1 hour ago- ...Client is seeking a Senior Data Engineer to support the modernization of tooling enablement functions. This role is responsible for designing, modeling, developing, and managing data warehouse objects in the Snowflake cloud data store, utilizing ETL pipelines (Talend, Informatica...Senior
Compunnel Inc.
Winnipeg, MB1 hour ago $180k - $240k per year
...The AI buildout runs on physical things: data centers, power, and the supply chains... ...York. The roleWe're looking for a Senior Data Engineer to build the data foundation behind Foresight... ...and vector search (pgvector or a search engine) for AI features. Event-driven data:...SeniorFor contractorsInternshipWork at officeForesight
Winnipeg, MB1 hour ago- ...and contribute to a global analytics initiative focused on strengthening the security of Client data. Sun Life's Information Security organization is enhancing its data engineering, platform, analytics, and insights capabilities through new tools and, most importantly, new...SeniorWork at officeWork from home
Sunlife
Winnipeg, MB1 hour ago - We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms. The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache...Senior
Techblocks
Winnipeg, MB1 hour ago - ...and subscriptions at scale, combining the agility of a high-growth business with the backing of a global organization. As the Senior Data Engineer, you will help design, build, and evolve CloudBlue’s data and analytics platform, with a strong focus on AI-driven capabilities...SeniorInternshipRemote work
HostPapa, Inc.
Winnipeg, MB1 hour ago $100k - $110k per year
...consecutive years, we operate in 90 markets, offer more than 75 data-driven solutions, and serve over 5,000 clients worldwide. Our research... ...looking for someone with a deep interest and expertise in data engineering and the dedication to apply that passion. We need someone with...SeniorWorldwideFlexible hoursIpsos in Canada
Winnipeg, MB1 hour ago$140k - $180k per year
About ShyftLabsAt ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune 500 companies unlock growth with... .... The OpportunityShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery of enterprise...SeniorWork at office3 days per weekShyftLabs
Winnipeg, MB1 hour ago$125k - $165k per year
...workforce management, turning customer interaction and operational data into actionable insights across multiple lines of business.... ...decision into a competitive advantage. We’re hiring a Senior Data Engineer on a 12-Month Contract to own data engineering on our Data Enablement...SeniorContract workInternshipRemote workFlexible hoursCoconut Software
Winnipeg, MB1 hour ago$86k - $130k per year
...support the communities where we live and work.Don’t just work anywhere — come build tomorrow together with us.Role Summary The Senior Data Engineer will join the Software Engineering team that leads the delivery of data and application solutions that enable OMERS Global...SeniorLong term contractTemporary workInternshipWork at officeFlexible hoursOMERS
Winnipeg, MB1 hour ago- As Sensor Tower continues to grow as a global company, we are looking for a Senior Data Engineer to build amazing products together. We have a wonderful team of more than a hundred engineers globally and are preparing for much more growth in the coming yearsWe are looking for...SeniorWork at officeRemote workWork from home
Sensor Tower
Winnipeg, MB1 hour ago - ...commitment to innovation, precision, and partnership in the investment data space. Our global footprint now spans multiple countries,... .... More about the role & teamWe’re looking for a Senior Data Engineer to help design and deliver scalable data solutions that power...SeniorPermanent employmentFull timeFlexible hours
Confluence
Winnipeg, MB1 hour ago - The Senior Data Engineer - Connected Care will provide technical leadership and hands-on delivery across the enterprise data platform and integration services. Key responsibilities include: Designing, building and maintaining scalable, secure and reliable data pipelines to...Senior
NHS Jobs
Winnipeg, MB1 hour ago - .... Join us!Job Description:This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex data... ...Storage, Data Lakehouse architecture, distributed query engines, and streaming technologies to support real-time, near real-time...SeniorWork at officeFlexible hours
Bank of America Corporation
Winnipeg, MB1 hour ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB