Data Engineer
Talentola
Job Title:
Data Engineer/ Python Developer
Experience:
Minimum 9 years
Employment:
Fulltime, 5 days onsite
Mandatory Skills:
Python, Spark, Pyspark
Responsibilities
Design, develop, and maintain software solutions using Python.
Develop Python and pyspark programs for data analysis. Good working experience with Python to develop a custom framework for generating rules (similar to a rules engine).
Develop Python code to gather data from HBase and design a solution to implement using Pyspark. Apache Spark DataFrames/RDDs were used to apply business transformations and utilize Hive Context objects to perform read/write operations.
Develop back‑end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
#J-18808-Ljbffr
Data Engineer/ Python Developer
Experience:
Minimum 9 years
Employment:
Fulltime, 5 days onsite
Mandatory Skills:
Python, Spark, Pyspark
Responsibilities
Design, develop, and maintain software solutions using Python.
Develop Python and pyspark programs for data analysis. Good working experience with Python to develop a custom framework for generating rules (similar to a rules engine).
Develop Python code to gather data from HBase and design a solution to implement using Pyspark. Apache Spark DataFrames/RDDs were used to apply business transformations and utilize Hive Context objects to perform read/write operations.
Develop back‑end services, APIs, and integrate databases.
Optimize applications for performance, security, and maintainability.
Troubleshoot and resolve software defects and issues.
#J-18808-Ljbffr
Vacancy posted 4 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer in Winnipeg, MB vacancy
$85k - $90k per year
...Job Description Design and maintain scalable data pipelines that collect, transform and store business data. Build data models... ...Qualifications: · Degree or Diploma in Computer Science, Data Engineering, Information Systems, or related field. · 5+ years of experience...SuggestedPermanent employment- ...part of that. • Our convenient Price Café offers free Tea and Coffee. Data Steward Price Electronics, a division of Price Industries · Winnipeg, Manitoba DEPARTMENT Software Engineering LOCATION Winnipeg, MB (on-site) EMPLOYMENT Permanent, full-time About the...SuggestedLong term contractPermanent employmentFull timeContract workWork at office
- ...Shape CATC’s Azure SQL data warehouse using advanced SQL, relational modelling, and dbt. This permanent, full-time role connects critical business systems. The Data Engineering & Platforms Manager owns the technical operation and continuous improvement of CATC’s enterprise...SuggestedPermanent employmentFull time
- ...Devenez Expert Cloud Data Engineer chez Synechron, en concevant des solutions de données avancées sur AWS et GCP. Participez à l'automatisation et à l'optimisation des pipelines de données. Dans ce rôle, vous appliquerez vos compétences acquises durant plus de six ans pour...Suggested
$110k per year
...000 CAD, commensurate with experience. About the Team: The Data & Analytics team is moving from a legacy reporting model to a... ...pipelines, enforcing rigorous data quality standards, and creating engineering patterns that let analytics, product, engineering, and AI...SuggestedFull time- ...and supported to be your best - both personally and professionally. How You’ll Make an Impact As a Senior Technical Analyst, Data Engineering and Business Intelligence, at Fidelity Investments Canada, you will focus on building, automating and scaling internal data...Work at officeFlexible hours
- Must Have Skills 4+ years Ab Initio Metadata Hub (mHub) development NOW HIRING: DATA ENGINEER AB INITIOClient: CITI Location: Mississauga, Canada Employment: FULL-TIME Must Have Skills 4+ years Ab Initio Metadata Hub (mHub) development Data Lineage...Full time
$101.54k per year
...innovation and entrepreneurship, partnerships, policies and procedures, and institutional awards and honours Your opportunity: As a Data Engineer within the Office of the Vice President, Research & Innovation, you will play a crucial role in advancing the university's data...Permanent employmentWork at office$100k - $145k per year
Core engineering · Full-time · Remote-first · Canada or USData pipelines, data quality & measurement dataAbout the role Every installed Energy Router measures what happens at its site, all day. That data is how we show results to customers and utilities, and how we decide...Full timeRemote work$88k - $128.7k per year
Job Requisition ID # 26WD101542Position Overview Autodesk is looking for a skilled and innovative Senior Data Engineer to join our Compliance team, which builds data-driven systems to detect and address non-compliant usage of Autodesk software. This is a key strategic initiative...- Take your career to new heights with Loopio!Loopio’s Data Engineering Team works together on a mission to transform the RFP response process... ...understanding of relational databases (RDS/Aurora) and NoSQL engines (Redis/DynamoDB/Neptune/etc). Experience with ETL & Data warehousing...InternshipRemote workWork from homeHome officeFlexible hours
$125k - $170k per year
Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most... ...America, Central America, Europe, Australia, and Japan.As a Data Engineer, you will help drive the direction of our Enterprise Data Warehouse...$90k - $120k per year
We're looking for a modern Data Engineer who thrives at the intersection of data, cloud, and AI. You build the systems that power insight - scalable pipelines, cloud-native data platforms, and intelligent workflows that turn raw data into business value at speed. In this role...Full timeWork at office- ...high-value sales intelligence. Leading infrastructure vendors, engineering firms, and construction companies use the platform to identify and... .... The platform integrates seamlessly with CRMs, ERPs, and data lakes, embedding actionable insights directly into sales workflows...Work at officeImmediate start3 days per week
- ...our journey is only achievable by having a great team who shares ideas, tries new things, and learns as we go. Who you are:As a Data Engineer at Semios, you will design, build, and maintain scalable, reliable cloud-based data systems that transform raw data into trusted,...Work at office
- Previously hired for Teradata EDW optimization, migration, and large-scale telco analytics programs.Data Engineering Canada / APAC Hybrid Previously StaffedAbout the role Analytics Enablers has placed Teradata engineers who optimized batch windows, reduced storage costs,...
$120k - $135k per year
...leader in fundraising intelligence, Kindsight leverages real-time data and AI to help thousands of organizations around the world... ...fundraising. Position Summary: We are seeking a hands-on Data Engineer to build and maintain the data platform behind Kindsight's customer...- Nous recherchons un(e) Ingénieur(e) de données de niveau intermédiaire à senior pour concevoir, développer et maintenir des solutions de données robustes, performantes et évolutives. La personne travaillera en collaboration avec les équipes de données, d'architecture, ...
$108k - $135k per year
...comfortable while riding or driving with Lyft, transforming every support interaction into a moment of genuine connection. As a Data Engineer on the SCC team, you will have ownership over the data modeling and pipelines that power SCC's Associate and AI Agent Platform....Hourly payWork at officeFlexible hours3 days per week- ...history as Parquet and run their own queries. That only works if the data is actually right, which makes correctness, lineage and... ...GoReal familiarity with columnar formats, ideally Parquet, and query engines like DuckDB, Polars or SparkCare for data correctness: testing, validation...Work at officeWork from home
$110.5k - $143k per year
...depend on physical operations to harness Internet of Things (IoT) data to develop actionable insights and improve their operations. At... ...build for the long term. About the role:Samsara is seeking a Data Engineer to join our Data team, comprising both Data Scientists, Data...Long term contractFull timeRemote workRelocation packageFlexible hours- The Data Engineer III is a core builder on the Strategic Partnerships team’s data platform. They design and ship ETL pipelines, semantic models, and the supporting infrastructure that powers cross-functional initiatives with Marketing, Finance, Sales, Legal, HR, and ProductBecause...Remote workFlexible hours
- Kumaran Systems: Engineering Future-Ready Transformations Since 1992, Kumaran Systems has been helping enterprises bridge the past and the future... ...to help build and modernise enterprise reporting solutions on Data-bricks and Power BI. The role will support the development of...
- ...connect with freight opportunities through brokerages and other data partners. Our team works with real-time, big data across thousands... ...desktop, and embedded vehicles.This role is for a strong backend engineer who loves data: you'll ship and optimize production Python/...
$100k - $150k per year
...leave our clients better than we found them, and to create a place where our people are proud to Build. Better. Role OverviewAs a Data Engineer at RAVL, you’ll design, build, and operate the data pipelines and platforms that power decision-making for modern organizations....Flexible hours$120k - $130k per year
Data Engineer (Finance) About CareRx Corporation At CareRx, we are shaping the future of senior care through pharmacy services that make a real difference. As Canada's trusted leader in specialty pharmacy services for long-term care, retirement and congregate living communities...Long term contractWork at officeRelocationFlexible hours2 days per week3 days per week1 day per week- We're hiring a hands-on Data Engineer to join the Total Fund Management Portfolio Management Technology team. The role focuses on building and optimizing large-scale cloud data systems with Spark/PySpark and modern storage formats. KEY RESPONSIBILITIES Develop and optimize...
- Data Engineer (Python, SQL, pipelines de données), lab IA et données, Montréal (télétravail) Poste permanent chez Abbeal : concevoir et faire tourner les pipelines de données de plusieurs projets clients au sein d'un lab IA. Python, SQL, ETL/ELT, cloud. Télétravail au Québec...Permanent employmentRemote work
$108k - $135k per year
...the opportunity to thrive.Lyft is looking for experienced software engineers from a scope of disciplines. We are growing our team with people... ...an engineer at Lyft, you'll collaborate with teams like product, data science, analytics, and operations on code that empower us to...Hourly payWork at officeFlexible hours3 days per week$120.8k - $170.8k per year
...operating large-scale batch and real-time data-processing platforms at an enterprise... ...as a subject-matter expert in modern data engineering, guiding both technical strategy and execution... ...Catalyst Optimizer, Tungsten execution engine, memory management, execution plans,...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

