Senior Data Engineer
e-IT
Must have : SQL+ Datawarehouse+ Banking domainJob DescriptionThis position is for a Senior Data engineer with a background in Python, Pyspark, SQL and data warehousing for enterprise level systems. The position calls for someone that is comfortable working with business users along with business analyst expertise.
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Major Responsibilities
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Education
Minimally a BA degree within an engineering and/or computer science discipline
#J-18808-Ljbffr
Vacancy posted 45 minutes ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Winnipeg, MB vacancy
$110k per year
...with experience. About the Team: The Data & Analytics team is moving from a legacy... ...data quality standards, and creating engineering patterns that let analytics, product, engineering... ...confidence. About the Role: The Senior Data Engineer will design, build, and...SeniorFull time- ...feel valued and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling...SeniorWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
$125k - $165k per year
...workforce management, turning customer interaction and operational data into actionable insights across multiple lines of business.... ...decision into a competitive advantage. We’re hiring a Senior Data Engineer on a 12-Month Contract to own data engineering on our Data Enablement...SeniorContract workInternshipRemote workFlexible hoursCoconut Software
Winnipeg, MB45 minutes ago- Job Description Reporting to the Sr. Manager, Data Architecture, the Senior Data Engineer will play a key role in designing, building, and modernizing enterprise data integrations that support business transformation initiatives across Extendicare. This individual will develop...SeniorLong term contractInternshipWork at office
111000 Extendicare (Canada) Inc.
Winnipeg, MB45 minutes ago - The role asks for someone to take charge of how data is modeled, moved and reported across a company that runs on device, ad and computer... ...SQL and Python hands on, and can turn vague questions from engineers and business people into tables and dashboards they trust. Correctness...Senior
present of AI
Winnipeg, MB45 minutes ago $140k - $170k per year
...understanding of insurance processes, systems, and data with serious technical capability and... ...policies. Work with software/AI/ML engineers, data scientists, product, and business units... .... Experience in communicating with senior leadership to collect requirements, describe...SeniorLong term contractShift workQuandri Technologies, Inc.
Winnipeg, MB46 minutes ago$137k - $205k per year
...and you want to be part of the team that defines how the world eats, there is no better time to join us.About the Role As a Senior Data Engineer, you'll play a key role in scaling and improving how we integrate and process customer data. You will design and implement ETLs...SeniorLive InRemote workAfresh
Winnipeg, MB49 minutes ago$138.3k - $172.8k per year
## Senior Data EngineerApply: On-site: Toronto, ON: Full time: Posted Today: REQ541419**JLL empowers you to shape a brighter way**.Our people... ...help shape a brighter way forward.Job Description**Senior Data Engineer - JLL****What this job involves:**As a Senior Data Engineer at...SeniorRemplacementFull timeJones Lang LaSalle Incorporated
Winnipeg, MB49 minutes ago- ...internal disciplines, vendors, clients and stakeholders to define data requirements and the technology stack for projects.Audit source... ..., or a related field.At least 5 years of experience in data engineering or related fields.Expert-level SQL and strong experience in ELT/...Senior
Apply Digital
Winnipeg, MB51 minutes ago $130k - $175k per year
...If you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...SeniorPenn Interactive Ventures
Winnipeg, MB46 minutes ago- ...Apache NiFi | Python | SQL | Workday Ready to Build Something That Makes an Impact? Our client is seeking an experienced Senior Data Engineer to play a key role in delivering a major enterprise data migration project. This is an exciting opportunity to work on a...SeniorRemote work
Focus on WD
Winnipeg, MB49 minutes ago - Project description We are looking for an experienced Senior Data Engineer to support the onboarding, integration, and operationalization of datasets used by Middle Office functions. The role focuses on building scalable, production-grade data pipelines and data products...SeniorLong term contractFor subcontractorWork at office
Luxoft Holding
Winnipeg, MB44 minutes ago $127k - $155k per year
The Opportunity Senior Data Engineers are the builders for the business. You are recruited early and help stand up the managed foundation alongside the architect, then build the data products that non-engineering teams need once the architecture is defined and the backlog...SeniorContract workWork at office3 days per weekEuna Solutions
Winnipeg, MB44 minutes ago- Senior Data Engineer Department: Development - Software DevelopmentEmployment Type: Permanent - Full TimeLocation: Montreal, CanadaReporting To: Paul TartarianDescription Location - Pittsburgh, Boston, Toronto or MontrealWhy Confluence?At Confluence, we’ve...SeniorPermanent employmentFlexible hours
Confluence Technologies, Inc.
Winnipeg, MB45 minutes ago - The Senior Data Engineer - Connected Care will provide technical leadership and hands-on delivery across the enterprise data platform and integration services. Key responsibilities include: Designing, building and maintaining scalable, secure and reliable data pipelines to...Senior
NHS Jobs
Winnipeg, MB49 minutes ago - .... Join us!Job Description:This job is responsible for driving data engineering efforts to deliver enterprise-wide capabilities and complex data... ...Storage, Data Lakehouse architecture, distributed query engines, and streaming technologies to support real-time, near real-time...SeniorWork at officeFlexible hours
Bank of America Corporation
Winnipeg, MB49 minutes ago $100k - $110k per year
...consecutive years, we operate in 90 markets, offer more than 75 data-driven solutions, and serve over 5,000 clients worldwide. Our research... ...looking for someone with a deep interest and expertise in data engineering and the dedication to apply that passion. We need someone with...SeniorWorldwideFlexible hoursIpsos in Canada
Winnipeg, MB52 minutes ago- As Sensor Tower continues to grow as a global company, we are looking for a Senior Data Engineer to build amazing products together. We have a wonderful team of more than a hundred engineers globally and are preparing for much more growth in the coming yearsWe are looking for...SeniorWork at officeRemote workWork from home
Sensor Tower
Winnipeg, MB45 minutes ago $83.95k - $130k per year
...a more sustainable, more inclusive world.Data MigrationData ModelingData QualityETL/ELT... ...BI are nice to havesJob DescriptionData engineers are responsible for building reliable and... ...licenses, Relevant experience and skills, Seniority and performance, Market and business consideration...SeniorFull timeLocal areaCapgemini
Winnipeg, MB45 minutes ago- We are seeking a talented Data Engineer with hands-on experience in building scalable data pipelines and modern cloud-based data platforms. The ideal candidate will have experience working with Python and big data technologies such as Apache Airflow, Apache Spark, and Apache...Senior
Techblocks
Winnipeg, MB51 minutes ago $138.3k - $172.8k per year
...experience to a new industry, join our team as we help shape a brighter way forward. Job DescriptionWhat this job involves:As a Senior Data Engineer at JLL, you will leverage advanced technical expertise and enterprise-focused thinking to drive AI-powered automation that...SeniorRemplacementJones Lang LaSalle Incorporated
Winnipeg, MB45 minutes ago- ...Labs Chainlink Labs is one of the primary contributing developers of Chainlink, the standard for onchain finance enabling high-quality data, secure cross-chain interoperability, and compliant connectivity across global markets. Chainlink powers leading tokenized assets,...SeniorRemote work
Chainlink Labs
Winnipeg, MB46 minutes ago - ...an important pillar of Sun Life Canada’s Data and Analytics growth and corporate strategy... ...and as such, is seeking experienced data engineering individual with a proven track record... ...meaningful insights from enterprise data. This Senior Business data engineer will play an...SeniorManual laborWork at officeWork from home
Sun Life
Winnipeg, MB48 minutes ago - ...and contribute to a global analytics initiative focused on strengthening the security of Client data. Sun Life's Information Security organization is enhancing its data engineering, platform, analytics, and insights capabilities through new tools and, most importantly, new...SeniorWork at officeWork from home
Sunlife
Winnipeg, MB49 minutes ago - The Senior Data Engineer reports to the Director, Information Technology Operations and designs, builds, and scales the data systems that support analytics, AI-enabled experiences, and organizational decision-making. The role owns significant parts of the data platform, including...SeniorLong term contractContract work
Exchange Solutions
Winnipeg, MB49 minutes ago - # Senior Data EngineerMontreal, QC (Hybrid)Full-timeAt Flex Travel Solutions, we foster an environment of passion, innovation and collaboration... ...first company, we're currently looking for a Senior Data Engineer to join our team.The Role: As a Senior Data Engineer at FTS, you...SeniorWork at officeRemote work
Flex Travel Solutions
Winnipeg, MB50 minutes ago $140k - $180k per year
About ShyftLabsAt ShyftLabs, we live and breathe data. Since 2020, we've been helping Fortune 500 companies unlock growth with... .... The OpportunityShyftLabs is seeking an experienced Senior / Lead Data Engineer to lead the design, architecture, and delivery of enterprise...SeniorWork at office3 days per weekShyftLabs
Winnipeg, MB50 minutes ago$100k - $150k per year
...include Airbnb, Instacart, DoorDash, etc. ( We are looking for a Senior Data Engineer to join our growing team! What We're Looking ForTaiv runs... ...experience with at least one modern data warehouse or query engine (ClickHouse, Athena, Snowflake, BigQuery, Redshift, or...SeniorFull timeWork at officeRelocationMonday to fridayTaiv
Winnipeg, MB50 minutes ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB