Distributed Data Processing Developer
Capgemini
Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.This Spark Developer role supports high-performance data solutions from development through production troubleshooting. Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.Key Responsibilities:
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Vacancy posted 45 minutes ago
Similar jobs that could be interesting for youBased on the Distributed Data Processing Developer in Winnipeg, MB vacancy
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline... ...multiple people for this role, and responsibilities may be distributed across the team based on individual experience, skills, and...SuggestedInternship
- Enhance operations as a Process Coordinator for cement distribution at Amrize in Calgary, AB. Focus on documentation, efficiency, and supply chain improvements... ...clear operational timelines • Process ownership and data entry as necessary • Support the Distribution & Commercial...SuggestedFull time
$180k - $200k per year
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...LLMs, Generative AI, Natural Language Processing (NLP), Speech Recognition (ASR). Environment... ..., with a history of improving team-wide processes and code standards. Advanced Technical...Suggested3 days per week- A tech solutions firm located in Toronto is seeking a skilled Spark Scala Developer. The ideal candidate will design and develop data processing applications using Apache Spark and Scala. Responsibilities include collaborating with cross-functional teams and writing efficient...Suggested
- ...investment management firm. As a technology and data-driven firm, they design and build their... ....We are seeking an experienced Software Developer to join the backend system teams. The... ...scalable, tested, production-grade distributed systems.Foster close collaboration and communication...SuggestedFull timeInternship
- ...simulation systems at Vention using distributed architecture, cloud computing... ...or Munich.As Staff Software Developer, Simulation, you will shape a... ...-server design, real-time data streaming and cloud compute... ...many parts, robots, processes and parallel simulations. The...
$20 per hour
...delivery locations. Outgoing Processing: Handle folding, manual insertion for distribution jobs, and outgoing Registered Letter... ...a result, we are committed to developing and implementing strategies to... ...fully participate in the interview process. Employment type: Contractor...Hourly payWeekly payContract workFor contractorsManual laborImmediate startMonday to fridayFlexible hoursShift work- ...manufacturer and distributor of air distribution products ( The founding... ...Coffee. Job Summary: A Process Engineer is a professional... ...functional requirements, basic data requirements, user stories, reports... ...technical specifications for developers and IT teams. ◦ Ensure...Work at office
- Step into the role of Senior Developer for Distributed Cloud Systems, where you will craft scalable solutions using Python and C++. Join us in building... ..., you will design robust application blueprints and optimize data environments. This role involves hands-on work with AWS and...Manual labor
- Accelerate your career as a Backend Java Developer skilled in microservices and RESTful services, working in a hybrid model. Utilize your Kafka and PL/SQL proficiency to transform data management processes. As part of this role, you will design and implement efficient microservices...
- ...at Director level within Morgan Stanley's CVA Technology team. You will design, build, and maintain scalable distributed systems for trade capture and market data. The work requires collaboration with traders, quants, and technology teams while supporting platform performance...
- ...production-grade backend systems with Core Java and distributed systems expertise as a Senior Java Backend Developer. Apply Agentic AI development experience.This... ...large-scale, production-grade systems. You will apply data structures, algorithms, design patterns, Linux or Unix...
- Shape distributed systems with Java, Apache Spark, and Elasticsearch knowledge within TMC’s strategic... ....TMC is seeking a Senior Java Back-End Developer for a multi-year program transforming a... ..., distributed systems, and Big Data expertise to TMC’s modernization work for...
- ...manufacturer and distributor of air distribution products ( The founding... ...Tea and Coffee. Reporting & Process Analyst Campus: 638 Raleigh... ...and standardize processes, and develop practical solutions that... ...processes, system workflows, data structures, and reporting solutions...
- ...Enterprise Analytics Solutions Lead, the Data Platform Developer plays a pivotal role in implementing... ..., automation, and operational processes that embed enterprise data and analytics... ...integration patterns, data warehousing, distributed data ecosystems, and data platform architecture...Hourly payInternshipWork at office
- ...our planet and its people. The Data, AI & Advanced Analytics team... ...support critical business processes across finance, operations, projects... ...strong Staff Data Developer who can lead complex engineering... ...coordinating handoffs among globally distributed engineering, QA, analysis,...InternshipFlexible hours
- ...Summary: The Mail and Supply Distribution Clerk is responsible for... ...distributing incoming mail and processing of outgoing mail and... ...physical activities in order to distribute and deliver incoming and outgoing... ...Manitoba is committed to developing inclusive, barrier-free...Hourly payCasual workImmediate startShift work
- A leading technology firm in Montreal is looking for a Data Distribution Infrastructure L3 Support Specialist. This role involves managing and supporting reporting and Managed File Transfer (MFT) applications, performing troubleshooting, and administering servers. The ideal...
- ...using Go, with ownership across industrial data ingestion, transformation, and routing.As a Senior Golang Engineer, you will develop high-throughput, low-latency services for factory data. Your work spans stream processing, distributed systems, messaging, and production...
- ...About the roleWe are looking for a Senior Data Developer (Engineer) to help establish the data... ...insurance industry, especially broker distribution.#LI-HybridIl s'agit d'un nouveau rôle au... ...adjustment to make the recruitment process more accessible for you, please let us...Long term contractFlexible hours
$90k - $110k per year
...equitable workplace policies and processes. TCS has been serving the... ...and maintain robust big data processing solutions using Apache Spark, Scala, and Java. Develop scalable applications to process... ...Java. Strong understanding of distributed computing principles and architecture...Long term contract$122k - $150k per year
...OverviewReporting to the Lead, the Senior Data Developer is responsible for supporting the... ...standards. Develop and maintain data processing solutions using Python and SQL for data... ...Azure Event Hubs, PostgreSQL, MSSQL and distributed data processing frameworks. Build, optimize...Long term contractWork at office$112k per year
...are currently seeking a Specialist, Data Developer (Microsoft) to join our Data Platforms... ...enable the collection, storage, and processing of large volumes of data across the... ...pipelines for ingesting, transforming, and distributing data across multiple system.Build and...Work at office- ...Reporting to the Director of MSAT, the Manager of Process Development / Technology Transfer will... ...of the Winnipeg site. The incumbent will develop a strong, results-driven team responsible... ...processing issues, or generate data to support a process improvement. • Lead...Long term contractFlexible hours
- Connor, Clark & Lunn Financial Group Ltd. is seeking an Analyst, Business Process Engineering for its Investment Data Architecture (IDArch) team. The role focuses on end-to-end process design, data governance and improving data timeliness and quality across security, pricing...Work at officeRemote work
- AI Platform & Data Engineering builds and operates the data platform... ...ingestion, transformation, distribution, monitoring, data quality, regression... ..., validate, transform, and distribute data from vendors, internal systems, APIs, and files.Develop and maintain dbt models and...Work at office
- Who is Litmus Litmus is building the data foundation that powers industrial AI.AI doesn... ...solve challenges at the intersection of distributed systems, real-time data, and industrial... ...you’ll do well here.Role SummaryOur Data Processing team turns raw telemetry from factory floors...InternshipWorldwideShift work
- ## Senior Data Engineer (Supply Chain & Distribution)Apply: Canada - Remote: Full time: Posted 2 Days Ago: JR12525While technology is the heart... ...is a plus.* Background in Accounting/Finance business processes.* Excellent communication (written, verbal, and...Full timeWork at officeRemote workWorldwideFlexible hoursShift work
- A career as a Senior Developer in MarketingData Engineering in the Personal Data Management and Valorisation team atNational... ...partner teams Optimize data processing to improve the performance, reliabilityand... ...of SQL and experience with distributed systemsand cloud platforms (AWS,...Flexible hours
- Shape investment data processes as an Analyst with Connor, Clark & Lunn Financial Group, using process engineering and data analysis in a hybrid model. Improve how trusted data reaches investment teams across security master, pricing master, and ETL processes.Within the Investment...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Data Processing Developer. Be the first to apply!
Related searches
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

