Data Engineer
Rivago Infotech Inc
The Cloud Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and Azuer cloud platforms. This role involves working with large datasets, optimizing data workflows, and ensuring secure, efficient data storage and processing in cloud environments.
Major Responsibilities:
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
5+ years Python coding experience.
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Experience with Cloud based data architectures, messaging, and analytics.
Cloud certification(s).
Any experience with Airflow is a Plus.
#J-18808-Ljbffr
Major Responsibilities:
Build and optimize data pipelines for efficient data ingestion, transformation and loading from various sources while ensuring data quality and integrity.
Design, develop, and deploy Spark program in databricks environment to process and analyze large volumes of data.
Experience of Delta Lake, DWH, Data Integration, Cloud, Design and Data Modelling.
Proficient in developing programs in Python and SQL
Experience with Data warehouse Dimensional data modeling.
Working with event based/streaming technologies to ingest and process data.
Working with structured, semi structured and unstructured data.
Optimize Databricks jobs for performance and scalability to handle big data workloads.
Monitor and troubleshoot Databricks jobs, identify and resolve issues or bottlenecks.
Implement best practices for data management, security, and governance within the Databricks environment. Experience designing and developing Enterprise Data Warehouse solutions.
Proficient writing SQL queries and programming including stored procedures and reverse engineering existing process.
Perform code reviews to ensure fit to requirements, optimal execution patterns and adherence to established standards.
Skills:
5+ years Python coding experience.
5+ years - SQL Server based development of large datasets
5+ years with Experience with developing and deploying ETL pipelines using Databricks Pyspark.
Experience in any cloud data warehouse like Synapse, Big Query, Redshift, Snowflake.
Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling.
Previous experience leading an enterprise-wide Cloud Data Platform migration with strong architectural and design skills.
Experience with Cloud based data architectures, messaging, and analytics.
Cloud certification(s).
Any experience with Airflow is a Plus.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Data Engineer in Winnipeg, MB vacancy
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...SuggestedPermanent employmentFull time
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Suggested
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...SuggestedFull time- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...Work at officeFlexible hours
$100k - $130k per year
...by placing patients at the center of the record release process, data moves more ethically, easily and securely throughout the care journey... ...for millions more patients across North America.As a Data Engineer, you will help build and maintain the data infrastructure that powers...InternshipManual laborRemote work$110.5k - $143k per year
...depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At... ...build for the long term. About the role:Samsara is seeking a Data Engineer to join our Data team, comprising both Data Scientists, Data...Long term contractFull timeInternshipRemote workRelocation packageFlexible hours- ...our journey is only achievable by having a great team who shares ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted,...Work at office
$110k - $135k per year
...cable assemblies for diverse applications including server, storage, data center, mobile, RF, networking, industrial, business equipment,... ...remain a key enabler for all the major Tier 1 OEMs globally.Data Engineer Position Position: Data EngineerLocation: MarkhamReports To...Long term contractTemporary workInternship- ...insights from structured and unstructured datasets, including sensor data, APIs, and databases. Develop and optimize end-to-end machine... ...workflows (MLOps), encompassing data preprocessing, feature engineering, model training, and deployment. Apply advanced statistical analysis...
- ...does: the finance close, the reporting our customers see, and the fraud signals that keep payouts safe. We're looking for a Lead Data Engineer to own that platform, lead our data team, and help us put data to work with AI.This is a player‑coach role. Most of your time is hands...Summer workInternshipRemote workShift work
$120k - $140k per year
Job Title: Senior Data Engineer Location: Greater Toronto Area, ON (Hybrid: 4 days onsite / 1 day remote) Salary Range: $120,000 – $140,000 base salary + quarterly discretionary bonusPosition Overview We are seeking a Senior Data Engineer to design, build, and maintain the...Work at officeRemote work- ...leader in security workforce management software. $100 - $130 a year Trackforce is seeking a highly skilled and motivated Senior Data Engineer to join our Data team. In this role, you will be responsible for designing, building, and maintaining the data infrastructure that...Long term contractWork at officeLocal areaRemote workWork from homeFlexible hours
- Shift4 is seeking a Data Platform Engineer to join our Data Platform team and build, maintain, and optimize the pipelines that move data from our production systems into our analytics warehouse.Today, our infrastructure uses Amazon ECS services and SQS queues to replicate data...InternshipWork at office
$172k - $258k per year
...the global economy within everyone's reach while doing the most important work of your career. About The TeamThe Data Foundations team drives Data Engineering and Data Apps and Tooling work across Stripe, enabling Stripe to leverage data to make informed decisions and...InternshipWork at officeLocal areaRemote workWork from homeRelocation$173k - $197.4k per year
161 Bay Street (93021), Canada, Toronto,Toronto, Ontario,Staff Engineer - Data EngineeringAbout Capital One Canada. For 30 years, we've been on a mission to change banking for good. We challenge the traditional bank stereotype by integrating machine learning, conversational...Work at officeWork from home- About the RoleOur client, a prominent data analytics firm, is seeking a Lead Data Engineer to drive the development and maintenance of their data infrastructure in Kimberley. This senior role involves architecting and building scalable data pipelines, managing data warehousing...Work at office
$169.2k per year
Does working with Data motivate and excite you? Do you want to make a difference cross functionally? Then Jobber might be the place for you! We’re looking for a new Staff Data Engineer to join our Data Platform Team. Jobber exists to help people in small businesses be successful...Long term contractInternshipWork at officeLocal areaWeekend work$180k - $240k per year
...The AI buildout runs on physical things: data centers, power, and the supply chains behind... ...roleWe're looking for a Senior Data Engineer to build the data foundation behind Foresight... ...and vector search (pgvector or a search engine) for AI features. Event-driven data:...For contractorsInternshipWork at office- Job Description Reporting to the Sr. Manager, Data Architecture, the Senior Data Engineer will play a key role in designing, building, and modernizing enterprise data integrations that support business transformation initiatives across Extendicare. This individual will develop...Long term contractInternshipWork at office
- About the roleAs the Head of Data Engineering at Ambyint, you will lead the vision, strategy, and execution of our enterprise data architecture and roadmap. You will manage and empower a high-performing team of data engineers and data analysts, setting technical standards to...Long term contract
- ...relationships and leverage broader Bank relationships, systems and knowledge.Leads the design and implementation of the Tangerine data engineering strategy and platform, advising senior leadership and executing on the vision with senior architects and the development team....Permanent employmentFlexible hours
- Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services. Expertise... ...Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks. Develop reusable Databricks notebooks, data...
- As a Data Platform Engineer working in the Data Solutions group, you will play a key role in extending the capabilities, and improving the efficiency of our data platform. You will collaborate on the design and development of tooling and custom applications, evaluate the suitability...Summer workFlexible hours
- ...experiences who are passionate about quality, teamwork, and making an impact. Security clearance- Secret Job Title: Streaming Data Engineer - Bronze, Silver, and Gold Duration: Nov 2026 - Aug 2027 Department: Information Technology Job Summary The...InternshipRemote work
- Direct Alpaca’s data engineering organization on-site, combining Python, SQL, cloud infrastructure, and leadership across critical financial systems.This Director-level leader will own data strategy, execution, and roadmap for a department serving Finance, Sales, Product, Compliance...
$158k - $218k per year
...cyberattacks. Opportunities to make an impact with bold thinking are real—and happening daily at Coalition. About The RoleAs a Staff Data Engineer on Coalition’s Data team, you will define the architecture and technical direction of the enterprise Data & Analytics platform....Fixed term contractWork at officeRemote workHome officeFlexible hours$250 per day
...as we continue to advance the future of sleep wellness. Description D'emploiSleep Country/Dormezvous? is seeking a Principal Data Engineer to provide senior technical leadership for our enterprise data strategy, platform architecture, and engineering capabilities....Long term contractInternshipLocal area$130k - $175k per year
...you want to challenge conventions in gaming, media and entertainment, we want to talk to you.About the Role & Team As a Senior Data Engineer, you’ll work hand-in-hand with the Data Services team to build, validate and deliver transformed data to meet stakeholder requirements...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- junior data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data integration developer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB

