“data Ingestion Engineer\&34;
Brainhunter Systems Ltd
Brainhunter is currently seeking the services of a “Data Ingestion Engineer” for a contract opportunity with one of our Valued Clients.Work Style: Hybrid ,3 days in officeReliability Clearance requiredAny specific tools/skillset:
5+ years of prior experience in data operations or development role (e-g ETL, Data Warehouse) with 2+ years of recent development experience in IDMC, MS-Azure and Data bricks
Demonstrated experience in designing and implementing data ingestion systems using MS-Azure /Databricks
Experience in Kafka, CI/CD and CDC tools preferred
Solid programming experience with Python or SQL
Experience in setting up monitoring and controls for MS Azure data pipelines (prior experience with Data warehousing/ other data technologies is accepted)
Strong knowledge in service management including incident and change management procedures.
Skills and Attributes:
Problem-solving skills and the ability to trouble shoot complex issues.
Contributing to positive team culture and promoting common goals, team success and business outcomes
Valuing and appreciating different views and bring in collaborative approach to achieving consensus.
Encourages inclusivity and a sense of unity within all operational areas of Canada Data team.
As a Data Ingestion Engineer, you will join a dynamic and high-performing Canada Life Data team dedicated to providing Data and AI solutions by ensuring the robustness, scalability, and reliability of data ingestion systems within our organization. Your key focus will be on designing, implementing, and maintaining the pipelines necessary for efficient and seamless data ingestion from various sources into our data platforms. You will partner with cross functional teams, enterprise, and portfolio architects to enhance operational performance, trouble shoot issues, and implement best practices for data reliability.
Key Responsibilities:
Design, develop, test, and support end-to-end ingestion pipelines using Informatica IDMC in MS Azure data platform that supports the consumption of structured and unstructured data from various sources with the use of Azure Data Factory and Data Bricks
Collaborate with cross functional teams to understand data requirements, design efficient data ingestion patterns and workflows.
Implement and maintain controls and alerts to monitor data pipelines to proactively identify data related issues. Ensure data quality and integrity is maintained across the pipelines.
Collaborate with support teams to triage incidents to quickly resolve major incidents, system outages or disruptions.
Automate processes to support smooth operation of data pipelines to improve reliability, efficiency, scalability using the MS Azure tools.
Conduct performance and capacity assessments, identify bottlenecks, and develop plans to improve performance, and reduce operational cost.
Focused on implementing data governance and compliance controls, and security measure to protect sensitive data.
Apply best practices for creation and maintenance of data pipelines including scalability, reusability, and reliability.
Document system configurations, processes and troubleshooting procedures.
Brainhunter is an equal opportunity employer and is committed to providing a workplace free from harassment and discrimination. Brainhunter encourages applications from women, Indigenous peoples, veterans, persons with disabilities, members of visible minorities and persons of all races, ethnic origins, religions, abilities, sexual orientations, and gender identities and expressions. We provide accommodation upon request during the recruitment process;
please let the job poster know.
We thank all applicants for their interest, however only those candidates selected for Interviews will be contacted.
#J-18808-Ljbffr
5+ years of prior experience in data operations or development role (e-g ETL, Data Warehouse) with 2+ years of recent development experience in IDMC, MS-Azure and Data bricks
Demonstrated experience in designing and implementing data ingestion systems using MS-Azure /Databricks
Experience in Kafka, CI/CD and CDC tools preferred
Solid programming experience with Python or SQL
Experience in setting up monitoring and controls for MS Azure data pipelines (prior experience with Data warehousing/ other data technologies is accepted)
Strong knowledge in service management including incident and change management procedures.
Skills and Attributes:
Problem-solving skills and the ability to trouble shoot complex issues.
Contributing to positive team culture and promoting common goals, team success and business outcomes
Valuing and appreciating different views and bring in collaborative approach to achieving consensus.
Encourages inclusivity and a sense of unity within all operational areas of Canada Data team.
As a Data Ingestion Engineer, you will join a dynamic and high-performing Canada Life Data team dedicated to providing Data and AI solutions by ensuring the robustness, scalability, and reliability of data ingestion systems within our organization. Your key focus will be on designing, implementing, and maintaining the pipelines necessary for efficient and seamless data ingestion from various sources into our data platforms. You will partner with cross functional teams, enterprise, and portfolio architects to enhance operational performance, trouble shoot issues, and implement best practices for data reliability.
Key Responsibilities:
Design, develop, test, and support end-to-end ingestion pipelines using Informatica IDMC in MS Azure data platform that supports the consumption of structured and unstructured data from various sources with the use of Azure Data Factory and Data Bricks
Collaborate with cross functional teams to understand data requirements, design efficient data ingestion patterns and workflows.
Implement and maintain controls and alerts to monitor data pipelines to proactively identify data related issues. Ensure data quality and integrity is maintained across the pipelines.
Collaborate with support teams to triage incidents to quickly resolve major incidents, system outages or disruptions.
Automate processes to support smooth operation of data pipelines to improve reliability, efficiency, scalability using the MS Azure tools.
Conduct performance and capacity assessments, identify bottlenecks, and develop plans to improve performance, and reduce operational cost.
Focused on implementing data governance and compliance controls, and security measure to protect sensitive data.
Apply best practices for creation and maintenance of data pipelines including scalability, reusability, and reliability.
Document system configurations, processes and troubleshooting procedures.
Brainhunter is an equal opportunity employer and is committed to providing a workplace free from harassment and discrimination. Brainhunter encourages applications from women, Indigenous peoples, veterans, persons with disabilities, members of visible minorities and persons of all races, ethnic origins, religions, abilities, sexual orientations, and gender identities and expressions. We provide accommodation upon request during the recruitment process;
please let the job poster know.
We thank all applicants for their interest, however only those candidates selected for Interviews will be contacted.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the “data Ingestion Engineer\&34; in Winnipeg, MB vacancy
- Canada Life Data team seeks a Data Ingestion Engineer to design, implement, and maintain pipelines that ingest data from diverse sources into our data platforms using IDMC on Azure, aided by Data Factory and Databricks. You will work with cross-functional teams to ensure data...Suggested
- ...Qualifications Bachelor’s degree in mathematics, Finance, Statistics, Engineering, Computer Science, or a related field. Master's degree completed... ...mathematics and complex problem-solving. Ability to analyze data and develop quantitative models. Excellent programming skills....SuggestedWork at officeFlexible hours
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...SuggestedPermanent employmentFull time
$108k - $135k per year
...Lyft is looking for experienced software engineers from a scope of disciplines. We are growing... ...'ll collaborate with teams like product, data science, analytics, and operations on... ...and maintain data pipelines that handle ingestion, transformation, and distribution of large...Hourly payWork at officeFlexible hours3 days per week- ## Responsable de produit (\ "Product Owner\")Postuler: Hybride: Montreal, Canada: Temps plein: Offre publiée aujourd'hui: JR103689**Description de l'entreprise**Wepoint est l’architecte des grandes transformations des entreprises et des acteurs publics.Nous accompagnons...Full timeApprenticeshipWork at officeRemote work
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...Full time- ...COLLABORATION We are seeking an experienced Data Solutions Lead to join our growing... ...to ensure a consistent approach to data ingestion and data propagation across disparate... ...prototypes by applying expertise in data engineering, advanced analytics, process modelling, and...
- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...Work at officeFlexible hours
- ...opportunity Who We're Looking For We’re looking for a hands-on Data Solution Architect to design and deliver scalable, secure, and... ...to project teams during implementation Work closely with engineering teams to ensure designs are delivered as intended Contribute...Internship
- Job Responsibility: POSITION GOAL: Creates, publishes, and monitors Engineering reports through PowerBi, ensuring that it is modeled by a common data structure that satisfies the functional requirements of the area, and supports overall business objectives. Supports...Full timeInternshipImmediate start
- ...Our convenient Price Café offers free Tea and Coffee. Sales Data Steward Position Summary The Sales Data Steward is the recommended... .... • Bachelor's degree in Business, Information Systems, Engineering, or related field preferred. • 3 to 7+ years in ERP Master...
- ...Paradigm has opportunities for Data Analyst to employ their knowledge, skills and techniques to deliver and implement initiatives and enable our customers to maximize their investments in their business processes and information technology . The role will be based onsite...Contract workRemote work
- ...You will support a critical operational reporting and data initiative within a university environment. This role focuses on modernizing... ...applications with embedded SQL to understand system logic Reverse engineer reports to identify data sources, dependencies, and requirements...Contract work
- ...spirit and status quo‑fighters. Job Summary The Director, Data Center Strategy & Market Development – North America will lead the... ...and influence with hyperscalers, colocation providers, engineering and design firms, developers, contractors, technology partners and...For contractorsWork at officeRemote work
$18 - $22 per hour
...area Relocation costs not covered by employer General office Responsibilities Tasks Receive and register documents for data entry Enter data according to specified format Transfer data between software Verify accuracy and completeness of data Store...Permanent employmentFull timeWork at officeRemote workRelocation$17 per hour
...Canada. In this dual-function role, you will be the operational engine behind daily donor engagement and database management—ensuring... ...typing skills with exceptional speed and accuracy in high-volume data entry. Excellent command of spoken and written English to interact...Weekly payLong term contractPermanent employmentFull timeContract workWork at officeImmediate startMonday to friday$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days a week onsite Job ID: 87597 Overview As... ...astronomical scale. Architecture & Scalability: Partner with Engineering and DevOps to design robust ML platforms. You will oversee the...3 days per week- ...Deloitte Technology Fast 500. Role Description We are looking for a detail-oriented and reliable individual to join our team as Field Data Collector(s). In this role, you will play a crucial role in shaping the future of grocery shopping by gathering accurate and valuable...Full timeLocal areaRemote workFlexible hours
- ...Intact is seeking a Team Lead for the Claims Data Analytics Team (CDAT) in Canada. You will guide analytics projects that inform customer experience, operational excellence and financial performance, while coaching team members and coordinating with stakeholders. Role requires...
- ...Requisition ID: 101798 Job Category: Engineering Location: Winnipeg, MB, Canada Join a company that is passionately committed... ...electrical equipment specification packages Check vendor drawings and data for compliance with specifications Prepares detailed design,...Long term contractWork at officeLocal areaFlexible hours
$55k - $70k per year
...About the Role Join our team as a Data Center Technician in Winnipeg, Canada . This is a full-time, on-site position where you'... ...Maintain accurate documentation and asset tracking Collaborate with engineering and operations teams Participate in capacity planning and...Permanent employmentFull timeShift workNight shiftWeekend work$55k - $70k per year
...About the Role Join our team as a Data Center Technician in Winnipeg, Canada . This is a full-time, on-site position where you'... ...Maintain accurate documentation and asset tracking Collaborate with engineering and operations teams Participate in capacity planning and...Permanent employmentFull timeFreelanceLocal areaFlexible hoursShift workNight shiftWeekend work- ...Lead commercial data operations in Mississauga with advanced SQL and Snowflake expertise. Support US Commercial decisions through reliable, governed data. As Associate Director, you will lead complex pharmaceutical commercial data initiatives across specialty pharmacy, patient...
- ...Pinterest is seeking a Senior Data Scientist to shape the future of people-facing and business-facing products. You will apply quantitative... ...modeling, experimentation and algorithms to solve complex engineering challenges at scale, collaborating with Product, Engineering, Design...
$75k - $90k per year
...Job Description Develop and execute data testing plans to ensure data integrity and quality. Identify, document, and track data issues, working closely with team members to resolve them. Collaborate with the technology team to optimize data workflows and system functionality...Permanent employmentFull time- ...currently seeking a talented and dedicated Transportation/Traffic Engineer to complement and grow our skilled Traffic Engineering and... ...and Road Safety Audits. Other technical assignments including data analysis, functional planning studies, transportation master plans...Work at officeLocal area
- ...Price Café offers free Tea and Coffee. Job Summary: A Process Engineer is a professional who serves as a bridge between business needs... ...◦ Document functional and non-functional requirements, basic data requirements, user stories, reports, and business rules. ◦ Conduct...Work at office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to “data Ingestion Engineer\&34;. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

