Distributed Data Processing Developer
Capgemini
Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.This Spark Developer role supports high-performance data solutions from development through production troubleshooting. Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.Key Responsibilities:
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Distributed Data Processing Developer in Winnipeg, MB vacancy
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...LLMs, Generative AI, Natural Language Processing (NLP), Speech Recognition (ASR). Environment... ..., with a history of improving team-wide processes and code standards. Advanced Technical...Suggested3 days per week- ...manufacturer and distributor of air distribution products ( The founding... ...Coffee. Job Summary: A Process Engineer is a professional... ...functional requirements, basic data requirements, user stories, reports... ...technical specifications for developers and IT teams. ◦ Ensure...SuggestedWork at office
- ...manufacturer and distributor of air distribution products ( The founding... ...Tea and Coffee. Reporting & Process Analyst Campus: 638 Raleigh... ...and standardize processes, and develop practical solutions that... ...processes, system workflows, data structures, and reporting solutions...Suggested
- ...Summary: The Mail and Supply Distribution Clerk is responsible for... ...distributing incoming mail and processing of outgoing mail and... ...physical activities in order to distribute and deliver incoming and outgoing... ...Manitoba is committed to developing inclusive, barrier-free...SuggestedHourly payCasual workImmediate startShift work
- ...Reporting to the Director of MSAT, the Manager of Process Development / Technology Transfer will... ...of the Winnipeg site. The incumbent will develop a strong, results-driven team responsible... ...processing issues, or generate data to support a process improvement. • Lead...SuggestedLong term contractFlexible hours
- ...Shared Health Department / Unit: SH Distribution & Logistics Job Stream: Non-Clinical... ...regulations, legislative requirements, policy, processes, financial controls and directives... ...northern Canada ~5 years of experience developing and implementing annual operating plans...Work at officeRemote workFlexible hoursShift workDay shift
- Overview Languages English Education Bachelor's degree Experience 2 years to less than 3 years Tasks Evaluate daily operations Plan and organize daily operations Plan for changes to schedules and policies Prepare reports for senior management ...
- ...its greatest asset: its employees LAPORTE is seeking a Food Process Engineer with 6 to 10 years of experience in process design for... ...codes and standards, defined scope, timelines, and budget; Develop conceptual, preliminary, and detailed designs, drawings, and specifications...For contractorsWork at officeLocal areaFlexible hours2 days per week
$17.5 per hour
...machines Manually pack goods into bags and boxes or other containers Feed and unload processing machines Check products and packaging for basic quality defects Assist process control and machine operators in performing their duties Clean machines and immediate...Permanent employmentFull timeImmediate startRemote work- ...Position: The intermediate Development and Operations (DevOps) Process Specialist is a key member of our satellite operations team.... ...and integrity. In addition, you will collaborate with software developers to integrate test automation into the CI/CD pipeline, ensuring smooth...Internship
- ...machines Manually pack goods into bags and boxes or other containers Feed and unload processing machines Check products and packaging for basic quality defects Assist process control and machine operators in performing their duties Clean machines and immediate...Full timeImmediate start
- ...manufacturer and distributor of air distribution products ( The founding... .... Lab Systems Software Developer We are looking for a Software... ...of PRCN’s internal Data and Lab Management System.... ...position is automating manual processes and translating engineering and...
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline... ...multiple people for this role, and responsibilities may be distributed across the team based on individual experience, skills, and...Internship
LawZero
Winnipeg, MB2 hours ago - ...are seeking an experienced Data Solutions Lead to join our... ...integration work, including developing data models, maintaining the... ...compliance policies for deployment processes. Create and maintain... ...and building traditional and distributed cloud-hosted data pipelines to...
$69.45k - $119.45k per year
...most complex challenges YOUR ROLE: Curam Developer WORK YOU WILL DO: We are seeking a... ...meet client specifications using Business Process Objects, User Interface Metadata (UIM), Universal... ...Gathering (IEG), Rulesets, Evidence, and Data Mapping Collaborate with business analysts...Full timeWork at officeLocal areaShift work- ...leading manufacturer and distributor of air distribution products ( The founding principles of... ...a passionate and experienced Software Developer with expertise in .NET to join our team.... ...continuous improvement of software development processes and tooling within the team....
- ...Enterprise Report Developer Winnipeg, MB Manitoba Hydro is consistently recognized as... ...Report Developer is responsible for enabling data-driven decision-making across Manitoba... ...and support continuous improvement of team processes, delivery methodologies, operational...Hourly payLong term contractFull timeInternshipWork at office
- ...manufacturer and distributor of air distribution products ( The founding... ...and Coffee. ERP Software Developer An ERP Software Developer... ...solutions that enhance our business processes and improve efficiency. The... ...management systems and data integration techniques. •...
- ...Paradigm has opportunities for Data Analyst to employ their knowledge, skills and techniques... ...their investments in their business processes and information technology . The role will... ...and recommending future-state solutions. Develop and maintain databases, data collection...Contract workRemote work
- ...leading manufacturer and distributor of air distribution products ( The founding principles of... ...Café offers free Tea and Coffee. Sales Data Steward Position Summary The Sales... ...change requests where Sales domain access and process controls permit. • Provide business...
- ...leading manufacturer and distributor of air distribution products ( The founding principles of... ...Tea and Coffee Job Title: Software Developer Location: Winnipeg Department: Business... ...accommodations throughout the selection process and while working at Price. If you...
$85k - $90k per year
...Description Design and maintain scalable data pipelines that collect, transform and... ...information and applying practical fixes. Develop and maintain data integrations between systems... ..., pipeline logic and operational processes to support clear and consistent use. Work...Permanent employment- ...for a Senior Routing Engine Developer to design and build the next... ...responsible for intelligent distribution of voice and digital interactions... ...backend services capable of processing large volumes of routing decisions... ...relational databases, data modeling, integration data flows...InternshipRemote workRelocation
- ...Looking For We’re looking for a hands-on Data Solution Architect to design and deliver... ...design through to production readiness Develop Data Architecture Contribute to data modeling... ...data models and support quality assurance processes to ensure performance and efficiency...Internship
- ..., ensuring that it is modeled by a common data structure that satisfies the functional requirements... ...affected, cross functionally through the process of continuous improvement. ESSENTIAL... ...Engineering PowerBi business reports. Develops, maintains and improves Engineering...Full timeInternshipImmediate start
$60 - $65 per hour
...Guidewire Cloud 10 Version and Ace Certification are mandatory. Strong understanding of the insurance industry and claims management processes. Proven experience in configuring and customizing Guidewire Claim Center to meet client requirements. Experience with...Hourly payFull timeFixed term contract$26.5 per hour
...refrigerated Clean Work setting ~ Bakery Responsibilities Tasks Minimize hazards at all stages of the food production process Train staff/workers in job duties, safety procedures and company policies Recommend personnel actions such as hiring and...Permanent employmentFull timeInternshipRemote work- ...fighters. Job Summary The Director, Data Center Strategy & Market Development – North... ...will define where IPEX should compete, develop the value proposition and portfolio roadmap... ...IPEX earlier in the design and specification process and increase the adoption of IPEX...For contractorsWork at officeRemote work
- ...Randstad Canada is seeking an Intermediate Software Developer - CRM to join a Toronto-based contract. You will design, develop, and integrate... ...with potential extension. You will build plugins, workflows, and data integrations, perform SDLC activities, and support enterprise CRM...Full timeContract work
$50k - $100k per year
...could be your next big move! We are hiring Developing Investment Advisors into our Developing... ...practice management support to help you develop and grow your practice. Accountabilities... ...succeed in your new role. Interview Process We’ll reach out to candidates of interest...Work from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Data Processing Developer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data centre engineer Winnipeg, MB
- data engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB
- junior data engineer Winnipeg, MB