Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Ingestion Engineer

Brainhunter Systems Ltd

Anticipated Start Date:
4 weeks from the official offer dayRole Title:
Data Ingestion EngineerReliability Clearance required:
Yes, please submit only candidates who either hold a valid Reliability Clearance or are eligible to obtain one. Candidates who do not meet the required five‑year residency requirement should not be submitted.Any specific tools/skillset:5+ years of prior experience in data operations or development role (e-g ETL, Data Warehouse) with 2+ years of recent development experience in IDMC, MS-Azure and Data bricksDemonstrated experience in designing and implementing data ingestion systems using MS-Azure /DatabricksExperience in Kafka, CI/CD and CDC tools preferredSolid programming experience with Python or SQLExperience in setting up monitoring and controls for MS Azure data pipelines (prior experience with Data warehousing/ other data technologies is accepted)Strong knowledge in service management including incident and change management procedures.Skills and Attributes
Problem-solving skills and the ability to trouble shoot complex issues.Contributing to positive team culture and promoting common goals, team success and business outcomesValuing and appreciating different views and bring in collaborative approach to achieving consensus.Encourages inclusivity and a sense of unity within all operational areas of Canada Data team.As a Data Ingestion Engineer, you will join a dynamic and high-performing Canada Life Data team dedicated to providing Data and AI solutions by ensuring the robustness, scalability, and reliability of data ingestion systems within our organization. Your key focus will be on designing, implementing, and maintaining the pipelines necessary for efficient and seamless data ingestion from various sources into our data platforms. You will partner with cross functional teams, enterprise, and portfolio architects to enhance operational performance, trouble shoot issues, and implement best practices for data reliability.Key Responsibilities
Design, develop, test, and support end-to-end ingestion pipelines using Informatica IDMC in MS Azure data platform that supports the consumption of structured and unstructured data from various sources with the use of Azure Data Factory and Data BricksCollaborate with cross functional teams to understand data requirements, design efficient data ingestion patterns and workflows.Implement and maintain controls and alerts to monitor data pipelines to proactively identify data related issues. Ensure data quality and integrity is maintained across the pipelines.Collaborate with support teams to triage incidents to quickly resolve major incidents, system outages or disruptions.Automate processes to support smooth operation of data pipelines to improve reliability, efficiency, scalability using the MS Azure tools.Conduct performance and capacity assessments, identify bottlenecks, and develop plans to improve performance, and reduce operational cost.Focused on implementing data governance and compliance controls, and security measure to protect sensitive data.Apply best practices for creation and maintenance of data pipelines including scalability, reusability, and reliability.Document system configurations, processes and troubleshooting procedures.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Ingestion Engineer in Winnipeg, MB vacancy
  • Brainhunter Systems Ltd is seeking a Data Ingestion Engineer for a contract opportunity with one of our valued clients. The role is hybrid with 3 days in the office and reliability clearance is required. You will design, implement, and maintain data ingestion pipelines using... 
    Suggested
    Contract work
    Work at office

    Brainhunter Systems Ltd

    Winnipeg, MB
    1 hour ago
  • Canada Life Data team seeks a Data Ingestion Engineer to design, implement, and maintain pipelines that ingest data from diverse sources into our data platforms using IDMC on Azure, aided by Data Factory and Databricks. You will work with cross-functional teams to ensure data... 
    Suggested

    Brainhunter Systems Ltd

    Winnipeg, MB
    1 hour ago
  •  ...ML arteka in Canada is seeking a seasoned Data Ingestion Engineer to build 30+ source connectors for a regulated financial platform on AWS. You will own the design from S3 landing to Silver records, including provenance, schema enforcement, and quarantine handling. You will... 
    Suggested

    ML arteka

    Winnipeg, MB
    1 hour ago
  •  ...team, balancing technical excellence with mentorship and delivery accountability. You will own end-to-end project delivery, shape engineering practices, and collaborate with product and UX to drive business outcomes. You will guide architecture, review designs, and promote... 
    Suggested

    Arctic Wolf Networks India

    Winnipeg, MB
    1 hour ago
  • $75k - $246k per year

     ...members, contribute to architectural decisions, and help shape engineering standards while working across cross-functional teams. This role...  ...Requirements At Arctic Wolf, protecting our people, customers, and data is fundamental to how we operate. All employees are expected to... 
    Suggested
    Long term contract
    Local area
    Remote work

    Arctic Wolf Networks Canada, Inc.

    Winnipeg, MB
    1 hour ago
  • $105k - $215k per year

     ...King Street West Job Family Group: Data Analytics & Reporting HYBRID ROLE. This...  ...and AI solutions. Our team combines engineering excellence with cutting-edge AI to deliver...  ...across the enterprise. The Applied AI Data Ingestion & Integration (DII) team provides end‑to‑... 
    Part time

    BMO

    Winnipeg, MB
    1 hour ago
  • Lead Elastic Streams product strategy with deep telemetry expertise, shaping a distributed team and self-service data ingestion for every customer.As Director of Product Management, you will own Streams end to end across Elastic’s Search AI Platform. You will guide data collection... 

    Elastic

    Winnipeg, MB
    1 hour ago
  • $85k - $90k per year

     ...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models...  ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience... 
    Permanent employment

    Michael Page

    Winnipeg, MB
    19 days ago
  •  ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the... 
    Long term contract
    Permanent employment
    Full time
    Contract work
    Work at office

    Price Industries Limited

    Winnipeg, MB
    8 days ago
  •  ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise... 
    Permanent employment
    Full time

    Canadian-Addiction-Treatment-Centres

    Winnipeg, MB
    8 days ago
  •  ...Overview We are looking for an experienced and versatile Data Engineer to join our dynamic and fast-growing team. If you are...  ...robust data infrastructure capable of handling high-volume data ingestion and processing . Develop and manage our central data warehouse... 
    Long term contract
    Work at office
    Remote work
    Work from home

    ShyftLabs

    Winnipeg, MB
    1 hour ago
  •  ...ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable,...  ...agents, analytics assistants and ML models. Build and maintain ingestion pipelines from third-party and partner APIs. Write clear... 
    Work at office

    Semios

    Winnipeg, MB
    1 hour ago
  • $108k - $135k per year

     ...Lyft is looking for experienced software engineers from a scope of disciplines. We are growing...  ...'ll collaborate with teams like product, data science, analytics, and operations on...  ...and maintain data pipelines that handle ingestion, transformation, and distribution of large... 
    Hourly pay
    Work at office
    Flexible hours
    3 days per week

    Lyft Inc

    Winnipeg, MB
    1 hour ago
  •  ...pipelines de données fiables et évolutifs. Développer et optimiser des requêtes SQL complexes. Construire des processus d'ingestion, de transformation et de traitement de données. Participer au développement et à l'évolution des architectures de données. Assurer... 

    Highspring

    Winnipeg, MB
    1 hour ago
  • $125k - $170k per year

     ...content personalization for marketers through data-activated content generation and AI...  ..., Europe, Australia, and Japan.As a Data Engineer, you will help drive the direction of our...  ...sense of the massive amount of data we’re ingesting!Responsibilities: Design, build, test,... 

    Movable Ink

    Winnipeg, MB
    1 hour ago
  • $100k - $130k per year

     ...the center of the record release process, data moves more ethically, easily and securely...  ...patients across North America.As a Data Engineer, you will help build and maintain the data...  ...the full data engineering lifecycle from ingestion and transformation to storage and... 
    Internship
    Manual labor
    Remote work

    Talantir

    Winnipeg, MB
    1 hour ago
  •  ...Gold layers on Apache Iceberg), with AWS DMS and Zero-ETL for ingestion, dbt for transformation, and AWS-native services (S3, Glue, Athena, Bedrock) for storage, compute, and AI enablement. The Data Engineering Specialist works inside this stack, embedded in the Data Platform... 
    Casual work

    SOVRA

    Winnipeg, MB
    1 hour ago
  • $100k - $150k per year

     ...where our people are proud to Build. Better. Role OverviewAs a Data Engineer at RAVL, you’ll design, build, and operate the data pipelines...  ...enable efficient analytics and reporting Implement data ingestion, transformation, and quality checks across multiple sources and... 
    Flexible hours

    RAVL

    Winnipeg, MB
    1 hour ago
  •  ...The Data Engineer will be responsible for developing and maintaining scalable data solutions, with a primary focus on Snowflake and SQL....  ...and transformations for large‑scale datasets. Support data ingestion, modeling, and processing activities across multiple data sources... 

    Compunnel Inc.

    Winnipeg, MB
    1 hour ago
  • $110.5k - $143k per year

     ...operations to harness Internet of Things (IoT) data to develop actionable insights and...  ...About the role:Samsara is seeking a Data Engineer to join our Data team, comprising both Data...  ...lake. These pipelines are crucial for ingesting and transforming source data from our IOT... 
    Long term contract
    Full time
    Internship
    Remote work
    Relocation package
    Flexible hours

    Samsara

    Winnipeg, MB
    1 hour ago
  • $95k - $120k per year

     ...product catalog. Accurate, well-structured data is the single biggest lever on our...  .... The Role We're looking for a Data Engineer to own the flow of product data from source...  ..., build, and maintain data pipelines that ingest data from a wide range of sources and transform... 
    Relocation

    Partsengine

    Winnipeg, MB
    1 hour ago
  • $120k - $135k per year

     ...Kindsight leverages real-time data and AI to help thousands of organizations...  ...are seeking a hands-on Data Engineer to build and maintain the data...  ...across the full pipeline: ingesting data from customer...  ...and maintain ELT pipelines that ingest data from customer Salesforce... 

    Kindsight

    Winnipeg, MB
    1 hour ago
  • $90k - $120k per year

    Data Engineer Department: Data & EngineeringEmployment Type: Full TimeLocation: CanadaCompensation...  ...across all of Canada, we are the growth engine behind some of North America's most...  ...and maintain production ELT pipelines ingesting data from Google Ads, Meta Ads, and... 
    Full time
    Internship
    Work at office
    Remote work
    Home office

    Clever Digital Marketing

    Winnipeg, MB
    1 hour ago
  •  ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour... 

    Synechron

    Winnipeg, MB
    8 days ago
  •  ...the news, the world, and themselves. The Opportunity: Senior Data Engineer As a senior Data Engineer, you'll build the analytical foundation...  ..., and you'll own the reliability of those models end to end: ingestion, data quality, accuracy, coverage gaps, and failures both... 
    Remote work

    Ground

    Winnipeg, MB
    1 hour ago
  • $84k - $115k per year

     ...Job Description As a Data Engineering Specialist reporting to the Senior Director of Data Engineering, you'll play a critical role in designing...  ...on data onboarding and automation. Build and optimize data ingestion pipelines that clean, transform, and load large volumes of... 
    Long term contract
    Temporary work

    Nasdaq Corporate Solutions

    Winnipeg, MB
    1 hour ago
  • $203.68k - $254.6k per year

     ...the RoleWe are looking for an Analytics Engineer who thrives in high-complexity environments...  ...the company to build reliable, trusted data models that support reporting, analysis,...  ...Work across the full data pipeline, from ingestion to transformation to visualization.- Take... 
    Long term contract
    Fixed term contract
    Internship
    Work at office
    Remote work
    Home office
    Flexible hours

    Devconnectplatform

    Winnipeg, MB
    1 hour ago
  • $120k - $197k per year

     ...operating. The Analytics team owns the data platform behind that software. That...  ...have a wide mandate and are hiring a senior engineer who wants to own meaningful parts of it....  ...about 70% of your time) Build and scale ingestion: Own CDC pipelines from our operational MySQL... 
    For contractors
    Internship
    Work at office
    Local area
    Work from home
    Flexible hours

    BuildOps

    Winnipeg, MB
    1 hour ago
  •  ...learning to turn fragmented operational data into grounded, auditable intelligence for...  ...Role We are looking for a Staff Data Engineer to build and own the major subsystems...  ...payable, payroll and HRISCDC and managed ingestion. Change-data-capture pipelines or tools like... 

    MeeruAI

    Winnipeg, MB
    1 hour ago
  • We are seeking a talented and proactive Data Engineer for an enterprise-level contract opportunity based in Montreal, Canada. In this role...  ...queues, SNS notifications, and Lambda functions—to support data ingestion and processing workflows.Model and transform complex... 
    Long term contract
    Full time
    Contract work
    Remote work
    2 days per week
    3 days per week

    Randstad

    Winnipeg, MB
    1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Ingestion Engineer. Be the first to apply!