Data Engineer

Rivago Infotech Inc

The Cloud Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and Azuer cloud platforms. This role involves working with large datasets, optimizing data workflows, and ensuring secure, efficient data storage and processing in cloud environments.
Major Responsibilities:
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
5+ years Python coding experience.
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Experience with Cloud based data architectures, messaging, and analytics.
Cloud certification(s).
Any experience with Airflow is a Plus.
#J-18808-Ljbffr

Apply

Vacancy posted 1 hour ago

Similar jobs that could be interesting for youBased on the Data Engineer in Winnipeg, MB vacancy

Data Engineer
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...
Suggested
Permanent employment
Michael Page
Winnipeg, MB
11 days ago
Engineering Data Steward
...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...
Suggested
Long term contract
Permanent employment
Full time
Contract work
Work at office
Price Industries Limited
Winnipeg, MB
11 hours ago
Data Warehouse Engineering Manager CATC
...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...
Suggested
Permanent employment
Full time
Canadian-Addiction-Treatment-Centres
Winnipeg, MB
11 hours ago
Expert Cloud Data Engineer chez Synechron
...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...
Suggested
Synechron
Winnipeg, MB
11 hours ago
Senior Data Engineer
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...
Suggested
Full time
iQmetrix
Winnipeg, MB
a month ago
Senior Technical Analyst, Data Engineering and Business Intelligence
...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...
Work at office
Flexible hours
Fidelity International
Winnipeg, MB
11 hours ago
Data Engineer
...insights from structured and unstructured datasets, including sensor data, APIs, and databases. Develop and optimize end-to-end machine... ...workflows (MLOps), encompassing data preprocessing, feature engineering, model training, and deployment. Apply advanced statistical analysis...
ApoSys Technologies Inc.
Winnipeg, MB
1 hour ago
Data Engineer
$110k - $135k per year
...cable assemblies for diverse applications including server, storage, data center, mobile, RF, networking, industrial, business equipment,... ...remain a key enabler for all the major Tier 1 OEMs globally.Data Engineer Position Position: Data EngineerLocation: MarkhamReports To...
Long term contract
Temporary work
Internship
Amphenol ICC
Winnipeg, MB
1 hour ago
Data Engineer
...our journey is only achievable by having a great team who shares ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted,...
Work at office
Semios
Winnipeg, MB
1 hour ago
Data Engineer
$100k - $130k per year
...by placing patients at the center of the record release process, data moves more ethically, easily and securely throughout the care journey... ...for millions more patients across North America.As a Data Engineer, you will help build and maintain the data infrastructure that powers...
Internship
Manual labor
Remote work
Talantir
Winnipeg, MB
1 hour ago
Data Engineer
$110.5k - $143k per year
...depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At... ...build for the long term. About the role:Samsara is seeking a Data Engineer to join our Data team, comprising both Data Scientists, Data...
Long term contract
Full time
Internship
Remote work
Relocation package
Flexible hours
Samsara
Winnipeg, MB
1 hour ago
Director Of Data Engineering
...and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and executionThe Director, Data Engineering for Cyber Analytics will be a key contributor in helping Mastercard develop and deliver actionable insights...
Mastercard Inc.
Winnipeg, MB
1 hour ago
Senior Data Engineer
$130k - $175k per year
...you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...
Penn Interactive Ventures
Winnipeg, MB
1 hour ago
Lead Data Engineer
$150k - $200k per year
...collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is where you come in… The Lead Data Engineer owns Kabam's central data platform end to end, from the game telemetry standard through to the certified data layer that analytics...
Full time
Summer work
Work at office
Local area
Immediate start
Remote work
Flexible hours
Kabam
Winnipeg, MB
1 hour ago
Senior Data Engineer
$108.6k - $155.1k per year
About the Role: As a Senior Data Engineer at Tubi, you’ll be instrumental in developing and maintaining robust data processing pipelines that underpin our reporting, analytics, and performance insights. You’ll operate as an embedded data engineer within a specific data product...
Remplacement
Long term contract
Full time
Temporary work
Work at office
Local area
Flexible hours
Day shift
2 days per week
Tubi
Winnipeg, MB
1 hour ago
Lead Data Engineer
Data Engineering Lead Location: Toronto, ON - hybrid 3x week downtown TorontoIndustry: Healthcare / Research About the Opportunity Altis Recruitment is partnering with a leading healthcare and research organization in Toronto to recruit an experienced Data...
Altis Technology
Winnipeg, MB
1 hour ago
Director Of Data Engineering
Direct Alpaca’s data engineering organization on-site, combining Python, SQL, cloud infrastructure, and leadership across critical financial systems.This Director-level leader will own data strategy, execution, and roadmap for a department serving Finance, Sales, Product, Compliance...
Social Leverage LLC
Winnipeg, MB
1 hour ago
Data Engineer - Spade
$150k - $210k per year
...Salary Range: $150k-210k CAD About SpadeSpade is building the data infrastructure that powers the future of food. We connect and... ...faster. To accelerate our delivery timeline, we’re hiring a Data Engineer who thrives in ambiguity, moves quickly, and can build robust,...
Long term contract
Full time
Internship
Shift work
Sarsfield Group
Winnipeg, MB
1 hour ago
Staff Engineer - Data Engineering
$173k - $197.4k per year
161 Bay Street (93021), Canada, Toronto,Toronto, Ontario, Staff Engineer - Data Engineering About Capital One Canada. For 30 years, we've been on a mission to change banking for good. We challenge the traditional bank stereotype by integrating machine learning, conversational...
Work from home
Capital One
Winnipeg, MB
1 hour ago
Data Platform Engineer
All applicants must be legally entitled to work in Canada. The Position: Our Edmonton-based client is seeking an experienced Data Platform Engineer to build, operate, and support a modern enterprise data platform. This role works closely with architects, analytics...
10 Percent Recruiting Ltd.
Winnipeg, MB
1 hour ago
Principal Data Engineer
$250 per day
...as we continue to advance the future of sleep wellness.Description D'emploi Sleep Country/Dormez-vous? is seeking a Principal Data Engineer to provide senior technical leadership for our enterprise data strategy, platform architecture, and engineering capabilities. You...
Long term contract
Internship
Local area
Sleep Country Canada
Winnipeg, MB
1 hour ago
Staff Data Engineer
$169.2k per year
Does working with Data motivate and excite you? Do you want to make a difference cross functionally? Then Jobber might be the place for you! We’re looking for a new Staff Data Engineer to join our Data Platform Team. Jobber exists to help people in small businesses be successful...
Long term contract
Internship
Work at office
Local area
Weekend work
Avenue.io Inc.
Winnipeg, MB
1 hour ago
Senior Data Engineer
$127k - $155k per year
The Opportunity Senior Data Engineers are the builders for the business. You are recruited early and help stand up the managed foundation alongside the architect, then build the data products that non-engineering teams need once the architecture is defined and the backlog...
Contract work
Work at office
3 days per week
Euna Solutions
Winnipeg, MB
1 hour ago
Ai Data Engineer
$94.3k - $141.5k per year
We are seeking a highly motivated AI Data Engineer to design, develop, and deploy AI-powered applications and agentic solutions that enhance business processes and client delivery capabilities. This role is primarily hands-on and requires strong software engineering, data engineering...
Full time
Citigroup Inc.
Winnipeg, MB
1 hour ago
Senior Data Engineer
# Senior Data EngineerMontreal, QC (Hybrid)Full-timeAt Flex Travel Solutions, we foster an environment of passion, innovation and collaboration... ...first company, we're currently looking for a Senior Data Engineer to join our team.The Role: As a Senior Data Engineer at FTS, you...
Work at office
Remote work
Flex Travel Solutions
Winnipeg, MB
1 hour ago
Senior Data Engineer
$138.3k - $172.8k per year
...experience to a new industry, join our team as we help shape a brighter way forward. Job DescriptionWhat this job involves:As a Senior Data Engineer at JLL, you will leverage advanced technical expertise and enterprise-focused thinking to drive AI-powered automation that...
Remplacement
CAN ASA-Jones Lang LaSalle Real Estate Services, Inc.
Winnipeg, MB
1 hour ago
Manager, Data Engineering
Company Overview: Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses... ...Overview: We are seeking an exceptional Manager of Data Engineering to lead our talented team of data engineers in delivering innovative...
HRB
Winnipeg, MB
1 hour ago
Senior Data Engineer
...leader in security workforce management software. $100 - $130 a year Trackforce is seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the data infrastructure that...
Long term contract
Work at office
Local area
Remote work
Work from home
Flexible hours
TrackTik
Winnipeg, MB
1 hour ago
Associate Data Engineer
...toward a new category: the most advanced and engaging social gaming platform in the world. ROLE OVERVIEWWe are seeking an Associate Data Engineer to design, build, and maintain the core data pipelines and analytics models that power our platform. Working alongside senior...
Internship
Punt
Winnipeg, MB
1 hour ago
Engineering Manager, Data
$150k - $170k per year
...collaboration, and helping to build something great, you’ll want to keep reading. About the Role: Engineering Manager, DataWe’re growing — and we’re hiring an Engineering Manager, Data to join our Engineering team! In this role, you’ll help us build reliable data pipelines,...
Long term contract
Internship
Remote work
Commonsku-1
Winnipeg, MB
1 hour ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!