Distributed Data Processing Developer
Capgemini
Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.This Spark Developer role supports high-performance data solutions from development through production troubleshooting. Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.Key Responsibilities:
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Distributed Data Processing Developer in Winnipeg, MB vacancy
- ...Data Platform Developer Winnipeg, MB Manitoba Hydro is consistently recognized as one of Manitoba... ..., automation, and operational processes that embed enterprise data and analytics... ...integration patterns, data warehousing, distributed data ecosystems, and data platform architecture...SuggestedHourly payLong term contractInternshipWork at office
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline... ...multiple people for this role, and responsibilities may be distributed across the team based on individual experience, skills, and...SuggestedInternship
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...LLMs, Generative AI, Natural Language Processing (NLP), Speech Recognition (ASR). Environment... ..., with a history of improving team-wide processes and code standards. Advanced Technical...Suggested3 days per week- ...manufacturer and distributor of air distribution products ( The founding... ...Coffee. Job Summary: A Process Engineer is a professional... ...functional requirements, basic data requirements, user stories, reports... ...technical specifications for developers and IT teams. ◦ Ensure...SuggestedWork at office
- Accelerate your career as a Backend Java Developer skilled in microservices and RESTful services, working in a hybrid model. Utilize your Kafka and PL/SQL proficiency to transform data management processes. As part of this role, you will design and implement efficient microservices...Suggested
- ...manufacturer and distributor of air distribution products ( The founding... ...Tea and Coffee. Reporting & Process Analyst Campus: 638 Raleigh... ...and standardize processes, and develop practical solutions that... ...processes, system workflows, data structures, and reporting solutions...
- Shape distributed systems with Java, Apache Spark, and Elasticsearch knowledge within TMC’s strategic... ....TMC is seeking a Senior Java Back-End Developer for a multi-year program transforming a... ..., distributed systems, and Big Data expertise to TMC’s modernization work for...
- ...Summary: The Mail and Supply Distribution Clerk is responsible for... ...distributing incoming mail and processing of outgoing mail and... ...physical activities in order to distribute and deliver incoming and outgoing... ...Manitoba is committed to developing inclusive, barrier-free...Hourly payCasual workImmediate startShift work
- ...Shared Health Department / Unit: SH Distribution & Logistics Job Stream: Non-Clinical... ...regulations, legislative requirements, policy, processes, financial controls and directives... ...northern Canada ~5 years of experience developing and implementing annual operating plans...Work at officeRemote workFlexible hoursShift workDay shift
- ...About the roleWe are looking for a Senior Data Developer (Engineer) to help establish the data... ...insurance industry, especially broker distribution.#LI-HybridIl s'agit d'un nouveau rôle au... ...adjustment to make the recruitment process more accessible for you, please let us...Long term contractFlexible hours
- ...Reporting to the Director of MSAT, the Manager of Process Development / Technology Transfer will... ...of the Winnipeg site. The incumbent will develop a strong, results-driven team responsible... ...processing issues, or generate data to support a process improvement. • Lead...Long term contractFlexible hours
$90k - $110k per year
...equitable workplace policies and processes. TCS has been serving the... ...and maintain robust big data processing solutions using Apache Spark, Scala, and Java. Develop scalable applications to process... ...Java. Strong understanding of distributed computing principles and architecture...Long term contract- ...our planet and its people. The Data, AI & Advanced Analytics team... ...support critical business processes across finance, operations, projects... ...practices. Secondary/Developing Skills: Microsoft Fabric,... ...coordinating handoffs among globally distributed engineering, QA, analysis,...InternshipFlexible hours
- ...implemented through equitable workplace policies and processes. TCS has been serving the Canadian marketplace... ...and community empowerment. Job Description: -Role: Data DeveloperKey Responsibilities Design, develop, and maintain database objects, scripts, queries, and...Long term contract
- AI Platform & Data Engineering builds and operates the data platform... ...ingestion, transformation, distribution, monitoring, data quality, regression... ..., validate, transform, and distribute data from vendors, internal systems, APIs, and files.Develop and maintain dbt models and...Work at office
- Who is Litmus Litmus is building the data foundation that powers industrial AI.AI doesn... ...solve challenges at the intersection of distributed systems, real-time data, and industrial... ...you’ll do well here.Role SummaryOur Data Processing team turns raw telemetry from factory floors...InternshipWorldwideShift work
- Shape investment data processes as an Analyst with Connor, Clark & Lunn Financial Group, using process engineering and data analysis in a hybrid model. Improve how trusted data reaches investment teams across security master, pricing master, and ETL processes.Within the Investment...
- Overview Languages English Education Bachelor's degree Experience 2 years to less than 3 years Tasks Evaluate daily operations Plan and organize daily operations Plan for changes to schedules and policies Prepare reports for senior management ...
- ...attendance*Make your mark in a role where strong analytics engineering directly supports critical operations at scale.You’lltackle complex data challengesandhelp shape modern data practice.Joina focused, supportive team that cares about both outcomes and sustainability by...Full timeWork at officeLocal areaRemote work
- Employment Type: Permanent Job Description: Senior Data Developer- Montreal onlyOur data platform powers analytics and AI products for over 200... ...Leave Top UpAdventure PassLearning AllowanceOur Process We believe every candidate deserves a fair, transparent experience...Permanent employmentWorldwide
- ...problems, understanding the story behind the data and designing solutions that scale? You’... ...Your key responsibilities Designing, developing, and maintaining robust data pipelines... ...functional architectures, transformations, and processes in a clear and reusable manner;...Work at officeFlexible hours
- ...dans l'ensemble du maillage de données ( data mesh ) de SSENSE. Évoluant au sein du groupe... ...views. About the RoleAs a Senior Data Developer, Data & AI, you will be responsible for... ...interest in designing data-capturing processes that automatically generate high-quality...Long term contractPermanent employmentFull timeContract workTemporary workWork at office
- ..., Decision Intelligence and Emerging Technologies, the Senior Developer, Data provides technical leadership and hands‑on expertise in designing... ...data pipelines, ingestion frameworks, and transformation processes that enable trusted, accessible, and secure data across the organization...Work at office
- ...change.Make an impact with our Technology - Development team as a Data Developer. This diverse team of tech-savvy builders and problem solvers... ...effectively to non-technical audiences and contribute to process improvementsManage tasks independently while thriving in a collaborative...Remote workFlexible hours
- ...interest:Business intelligence and data Location(s):Montreal A career as a Senior Developer in Marketing Data Engineering... ...partner teams Optimize data processing to improve the performance,... ...knowledge of SQL and experience with distributed systems and cloud platforms (...Flexible hours
$94.62k - $128.02k per year
...How you'll make an impactWe're looking for an experienced data developer who can build, support and improve the data pipelines and infrastructure... ..., test and maintain data pipelines, integrations and data processing solutions that support FCC's enterprise data needs Support...Permanent employmentFlexible hours- ...delivery locations. - Fold and manual insertion of outgoing distribution jobs. - Process outgoing Registered Letter Mail. - Assist with daily... ...of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity,...Weekly payContract workMonday to friday
$170k per year
...to simplify and democratize data and AI — from making the next... ...challenges across the entire data processing pipeline, including ingestion... ...intersection of large scale distributed systems, data modeling,... ...real-world use cases.Experience developing large-scale distributed systems...Summer workWorldwide- ...About the Role We are seeking a Staff Data Developer to join our Data & Intelligence... ...solutions (data lakes, warehouses, real time processing systems) and supporting cloud... ...and adopt new tools, technologies, and processes. Partner with DevOps and engineering...Work at officeFlexible hours
- Data analytics, Lean Six Sigma, and process improvement define this Stoney Creek opportunity with Joseph Transportation Group. Build smarter operations.This Business Intelligence & Process Manager will drive meaningful business transformation beyond traditional reporting. You...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Data Processing Developer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

