Distributed Data Processing Developer
Capgemini
Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.This Spark Developer role supports high-performance data solutions from development through production troubleshooting. Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.Key Responsibilities:
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Distributed Data Processing Developer in Winnipeg, MB vacancy
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline... ...multiple people for this role, and responsibilities may be distributed across the team based on individual experience, skills, and...SuggestedInternship
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...LLMs, Generative AI, Natural Language Processing (NLP), Speech Recognition (ASR). Environment... ..., with a history of improving team-wide processes and code standards. Advanced Technical...Suggested3 days per week- ...manufacturer and distributor of air distribution products ( The founding... ...Coffee. Job Summary: A Process Engineer is a professional... ...functional requirements, basic data requirements, user stories, reports... ...technical specifications for developers and IT teams. ◦ Ensure...SuggestedWork at office
- Accelerate your career as a Backend Java Developer skilled in microservices and RESTful services, working in a hybrid model. Utilize your Kafka and PL/SQL proficiency to transform data management processes. As part of this role, you will design and implement efficient microservices...Suggested
- ...manufacturer and distributor of air distribution products ( The founding... ...Tea and Coffee. Reporting & Process Analyst Campus: 638 Raleigh... ...and standardize processes, and develop practical solutions that... ...processes, system workflows, data structures, and reporting solutions...Suggested
- Shape distributed systems with Java, Apache Spark, and Elasticsearch knowledge within TMC’s strategic... ....TMC is seeking a Senior Java Back-End Developer for a multi-year program transforming a... ..., distributed systems, and Big Data expertise to TMC’s modernization work for...
- ...Shared Health Department / Unit: SH Distribution & Logistics Job Stream: Non-Clinical... ...regulations, legislative requirements, policy, processes, financial controls and directives... ...northern Canada ~5 years of experience developing and implementing annual operating plans...Work at officeRemote workFlexible hoursShift workDay shift
- ...our planet and its people. The Data, AI & Advanced Analytics team... ...support critical business processes across finance, operations, projects... ...practices. Secondary/Developing Skills: Microsoft Fabric,... ...coordinating handoffs among globally distributed engineering, QA, analysis,...InternshipFlexible hours
- ...About The RoleWe are looking for a Senior Data Developer (Engineer) to help establish the data... ...insurance industry, especially broker distribution. Il s'agit d'un nouveau rôle au sein... ...specific adjustment to make the recruitment process more accessible for you, please let us...Long term contractFlexible hours
- ...Reporting to the Director of MSAT, the Manager of Process Development / Technology Transfer will... ...of the Winnipeg site. The incumbent will develop a strong, results-driven team responsible... ...processing issues, or generate data to support a process improvement. • Lead...Long term contractFlexible hours
$90k - $110k per year
...equitable workplace policies and processes. TCS has been serving the... ...and maintain robust big data processing solutions using Apache Spark, Scala, and Java. Develop scalable applications to process... ...Java. Strong understanding of distributed computing principles and architecture...Long term contract$112k per year
...are currently seeking a Specialist, Data Developer (Microsoft) to join our Data Platforms... ...enable the collection, storage, and processing of large volumes of data across the... ...pipelines for ingesting, transforming, and distributing data across multiple system.Build and...Work at office- ...Summary: The Mail and Supply Distribution Clerk is responsible for... ...distributing incoming mail and processing of outgoing mail and... ...physical activities in order to distribute and deliver incoming and outgoing... ...Manitoba is committed to developing inclusive, barrier-free...Hourly payCasual workImmediate startShift work
- ...implemented through equitable workplace policies and processes. TCS has been serving the Canadian marketplace... ...and community empowerment. Job Description: -Role: Data DeveloperKey Responsibilities Design, develop, and maintain database objects, scripts, queries, and...Long term contract
- A leading technology firm in Montreal is looking for a Data Distribution Infrastructure L3 Support Specialist. This role involves managing and supporting reporting and Managed File Transfer (MFT) applications, performing troubleshooting, and administering servers. The ideal...
- Who is Litmus Litmus is building the data foundation that powers industrial AI.AI doesn... ...solve challenges at the intersection of distributed systems, real-time data, and industrial... ...you’ll do well here.Role SummaryOur Data Processing team turns raw telemetry from factory floors...InternshipWorldwideShift work
- Shape investment data processes as an Analyst with Connor, Clark & Lunn Financial Group, using process engineering and data analysis in a hybrid model. Improve how trusted data reaches investment teams across security master, pricing master, and ETL processes.Within the Investment...
- AI Platform & Data Engineering builds and operates the data platform... ...ingestion, transformation, distribution, monitoring, data quality, regression... ..., validate, transform, and distribute data from vendors, internal systems, APIs, and files.Develop and maintain dbt models and...Work at office
- Overview Languages English Education Bachelor's degree Experience 2 years to less than 3 years Tasks Evaluate daily operations Plan and organize daily operations Plan for changes to schedules and policies Prepare reports for senior management ...
- ...attendance*Make your mark in a role where strong analytics engineering directly supports critical operations at scale.You’lltackle complex data challengesandhelp shape modern data practice.Joina focused, supportive team that cares about both outcomes and sustainability by...Full timeWork at officeLocal areaRemote work
- ...interest:Business intelligence and data Location(s):Montreal A career as a Senior Developer in Marketing Data Engineering... ...partner teams Optimize data processing to improve the performance,... ...knowledge of SQL and experience with distributed systems and cloud platforms (...Flexible hours
- ...dans l'ensemble du maillage de données ( data mesh ) de SSENSE. Évoluant au sein du groupe... ...views. About the RoleAs a Senior Data Developer, Data & AI, you will be responsible for... ...interest in designing data-capturing processes that automatically generate high-quality...Long term contractPermanent employmentFull timeContract workTemporary workWork at office
- ...change.Make an impact with our Technology - Development team as a Data Developer. This diverse team of tech-savvy builders and problem solvers... ...effectively to non-technical audiences and contribute to process improvementsManage tasks independently while thriving in a collaborative...Remote workFlexible hours
- Senior Data Developer- Montreal onlyEmployment Type: Permanent Job Description: Our data platform powers analytics and AI products for... ..., so regardless of outcome, everyone gets feedback. Our process: Recruiter call → Hiring Manager interview → Final interview....Permanent employmentWorldwideFlexible hours
$94.62k - $128.02k per year
...How you'll make an impactWe're looking for an experienced data developer who can build, support and improve the data pipelines and infrastructure... ..., test and maintain data pipelines, integrations and data processing solutions that support FCC's enterprise data needs Support...Permanent employmentFlexible hours- ...problems, understanding the story behind the data and designing solutions that scale? You’... ...Your key responsibilities Designing, developing, and maintaining robust data pipelines... ...functional architectures, transformations, and processes in a clear and reusable manner;...Work at officeFlexible hours
- ...About the Role We are seeking a Staff Data Developer to join our Data & Intelligence... ...solutions (data lakes, warehouses, real time processing systems) and supporting cloud... ...and adopt new tools, technologies, and processes. Partner with DevOps and engineering...Work at officeFlexible hours
- Data analytics, Lean Six Sigma, and process improvement define this Stoney Creek opportunity with Joseph Transportation Group. Build smarter operations.This Business Intelligence & Process Manager will drive meaningful business transformation beyond traditional reporting. You...
- Shape Python data processing workflows and backend APIs for an AI-driven risk intelligence platform, working remotely or hybrid in Montreal.As a Senior Software Engineer, you will contribute to an evolving product that screens media for compliance and due diligence. You will...Remote work
$105k - $135k per year
...#1 virtual care provider in Canada. By developing our Integrated Health Platform, we... ...****@*****.*** role asSenior Data Platform Developer We are looking for a Senior Data... ...to Have: Experience with stateful, distributed workflow orchestration engines like...InternshipWork at officeRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Data Processing Developer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB

