Distributed Data Processing Developer
Capgemini
Design distributed data processing applications with Apache Spark and Java, combining scalable architecture, efficient code, and strong SQL skills.This Spark Developer role supports high-performance data solutions from development through production troubleshooting. Responsibilities include reusable Java coding, Spark optimization, data quality, and collaboration with technical and business teams. Required technologies include relational databases, REST APIs, microservices, Git, and CI/CD processes.Key Responsibilities:
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
Collaborate with teams to gather data solution requirementsDevelop applications using Apache Spark and JavaOptimize jobs for performance and memory managementTroubleshoot production issues and improve application performanceImplement scalable, reliable data processing solutionsRequirements:
At least four years of software development experienceAt least two years developing Spark and Java applicationsStrong SQL and relational database capabilitiesKnowledge of REST APIs and microservices architectureExperience with Git and CI/CD processesUse distributed computing, Spark optimization, Java development, and SQL expertise to deliver dependable large-scale data applications.
#J-18808-Ljbffr
L'offre d'emploi a été publiée il y a 2 heures
Des emplois similaires qui pourraient vous intéresserBasé sur l'offre Distributed Data Processing Developer à Winnipeg, MB
- We are seeking a Senior ML Data Processing Developer to participate in the development, curation, and scaling of our core data asset pipeline... ...multiple people for this role, and responsibilities may be distributed across the team based on individual experience, skills, and...SuggéréStage
- Enhance operations as a Process Coordinator for cement distribution at Amrize in Calgary, AB. Focus on documentation, efficiency, and supply chain improvements... ...clear operational timelines • Process ownership and data entry as necessary • Support the Distribution & Commercial...SuggéréTemps plein
$180k - $200k par année
...Job Title: Staff Data Scientist (AI & Machine Learning) Location: Vancouver, BC – 3 days... ...LLMs, Generative AI, Natural Language Processing (NLP), Speech Recognition (ASR). Environment... ..., with a history of improving team-wide processes and code standards. Advanced Technical...Suggéré3 jours par semaine- A tech solutions firm located in Toronto is seeking a skilled Spark Scala Developer. The ideal candidate will design and develop data processing applications using Apache Spark and Scala. Responsibilities include collaborating with cross-functional teams and writing efficient...Suggéré
- ...investment management firm. As a technology and data-driven firm, they design and build their... ....We are seeking an experienced Software Developer to join the backend system teams. The... ...scalable, tested, production-grade distributed systems.Foster close collaboration and communication...SuggéréTemps pleinStage
- ...at Director level within Morgan Stanley's CVA Technology team. You will design, build, and maintain scalable distributed systems for trade capture and market data. The work requires collaboration with traders, quants, and technology teams while supporting platform performance...
- Accelerate your career as a Backend Java Developer skilled in microservices and RESTful services, working in a hybrid model. Utilize your Kafka and PL/SQL proficiency to transform data management processes. As part of this role, you will design and implement efficient microservices...
- ...manufacturer and distributor of air distribution products ( The founding... ...Coffee. Job Summary: A Process Engineer is a professional... ...functional requirements, basic data requirements, user stories, reports... ...technical specifications for developers and IT teams. ◦ Ensure...Travail au bureau
- Shape distributed systems with Java, Apache Spark, and Elasticsearch knowledge within TMC’s strategic... ....TMC is seeking a Senior Java Back-End Developer for a multi-year program transforming a... ..., distributed systems, and Big Data expertise to TMC’s modernization work for...
- ...production-grade backend systems with Core Java and distributed systems expertise as a Senior Java Backend Developer. Apply Agentic AI development experience.This... ...large-scale, production-grade systems. You will apply data structures, algorithms, design patterns, Linux or Unix...
- ...manufacturer and distributor of air distribution products ( The founding... ...Tea and Coffee. Reporting & Process Analyst Campus: 638 Raleigh... ...and standardize processes, and develop practical solutions that... ...processes, system workflows, data structures, and reporting solutions...
- ...Enterprise Analytics Solutions Lead, the Data Platform Developer plays a pivotal role in implementing... ..., automation, and operational processes that embed enterprise data and analytics... ...integration patterns, data warehousing, distributed data ecosystems, and data platform architecture...Taux horaireStageTravail au bureau
$90k - $110k par année
...equitable workplace policies and processes. TCS has been serving the... ...and maintain robust big data processing solutions using Apache Spark, Scala, and Java. Develop scalable applications to process... ...Java. Strong understanding of distributed computing principles and architecture...Contrat Longue Durée- ...our planet and its people. The Data, AI & Advanced Analytics team... ...support critical business processes across finance, operations, projects... ...practices. Secondary/Developing Skills: Microsoft Fabric,... ...coordinating handoffs among globally distributed engineering, QA, analysis,...StageHoraires flexibles
$112k par année
...are currently seeking a Specialist, Data Developer (Microsoft) to join our Data Platforms... ...enable the collection, storage, and processing of large volumes of data across the... ...pipelines for ingesting, transforming, and distributing data across multiple system.Build and...Travail au bureau- ...Summary: The Mail and Supply Distribution Clerk is responsible for... ...distributing incoming mail and processing of outgoing mail and... ...physical activities in order to distribute and deliver incoming and outgoing... ...Manitoba is committed to developing inclusive, barrier-free...Taux horaireTravail occasionnelRecrutement immédiatTravail posté
$122k - $150k par année
...OverviewReporting to the Lead, the Senior Data Developer is responsible for supporting the... ...standards. Develop and maintain data processing solutions using Python and SQL for data... ...Azure Event Hubs, PostgreSQL, MSSQL and distributed data processing frameworks. Build, optimize...Contrat Longue DuréeTravail au bureau- ...using Go, with ownership across industrial data ingestion, transformation, and routing.As a Senior Golang Engineer, you will develop high-throughput, low-latency services for factory data. Your work spans stream processing, distributed systems, messaging, and production...
- A leading technology firm in Montreal is looking for a Data Distribution Infrastructure L3 Support Specialist. This role involves managing and supporting reporting and Managed File Transfer (MFT) applications, performing troubleshooting, and administering servers. The ideal...
- ## Senior Data Engineer (Supply Chain & Distribution)Apply: Canada - Remote: Full time: Posted 2 Days Ago: JR12525While technology is the heart... ...is a plus.* Background in Accounting/Finance business processes.* Excellent communication (written, verbal, and...Temps pleinTravail au bureauTravail à distanceLe monde entierHoraires flexiblesTravail posté
- AI Platform & Data Engineering builds and operates the data platform... ...ingestion, transformation, distribution, monitoring, data quality, regression... ..., validate, transform, and distribute data from vendors, internal systems, APIs, and files.Develop and maintain dbt models and...Travail au bureau
- Shape investment data processes as an Analyst with Connor, Clark & Lunn Financial Group, using process engineering and data analysis in a hybrid model. Improve how trusted data reaches investment teams across security master, pricing master, and ETL processes.Within the Investment...
- ...Reporting to the Director of MSAT, the Manager of Process Development / Technology Transfer will... ...of the Winnipeg site. The incumbent will develop a strong, results-driven team responsible... ...processing issues, or generate data to support a process improvement. • Lead...Contrat Longue DuréeHoraires flexibles
- Join to apply for the Principal Data System Developer role at VRIFY . Get AI-powered advice... ...Lead performance optimization across distributed datasets, including spatial indexing... ...(PostGIS, PgSTAC), and distributed processing frameworks (Spark, Dask, Pangeo). Establish...Temps pleinTravail à distanceTravail à domicileHoraires flexibles
- A career as a Senior Developer in MarketingData Engineering in the Personal Data Management and Valorisation team atNational... ...partner teams Optimize data processing to improve the performance, reliabilityand... ...of SQL and experience with distributed systemsand cloud platforms (AWS,...Horaires flexibles
- Who is Litmus Litmus is building the data foundation that powers industrial AI.AI doesn... ...solve challenges at the intersection of distributed systems, real-time data, and industrial... ...you’ll do well here.Role SummaryOur Data Processing team turns raw telemetry from factory floors...StageLe monde entierTravail posté
$105k - $135k par année
...care provider in Canada. By developing our Integrated Health Platform... ...an efficient and fair review process, we utilize artificial intelligence... ...official careers page.Senior Data Platform Developer We are... ...Experience with stateful, distributed workflow orchestration...StageTravail au bureauTravail à distance3 jours par semaine- Connor, Clark & Lunn Financial Group Ltd. is seeking an Analyst, Business Process Engineering for its Investment Data Architecture (IDArch) team. The role focuses on end-to-end process design, data governance and improving data timeliness and quality across security, pricing...Travail au bureauTravail à distance
- ...change.Make an impact with our Technology - Development team as a Data Developer. This diverse team of tech-savvy builders and problem solvers... ...effectively to non-technical audiences and contribute to process improvementsManage tasks independently while thriving in a collaborative...Travail à distanceHoraires flexibles
- Senior Data Developer- Montreal onlyEmployment Type: Permanent Job Description: Our data platform powers analytics and AI products for... ..., so regardless of outcome, everyone gets feedback. Our process: Recruiter call → Hiring Manager interview → Final interview....Emploi permanentLe monde entierHoraires flexibles
Voulez-vous recevoir plus d'offres d'emploi ?
S'abonner et recevoir des offres d'emploi similaires à Distributed Data Processing Developer. Soyez parmi les premiers à postuler !
Recherches connexes
- data integration developer Winnipeg, MB
- data cabling engineer Winnipeg, MB
- python data engineer Winnipeg, MB
- remote data engineer Winnipeg, MB
- junior data engineer Winnipeg, MB
- data centre engineer Winnipeg, MB
- gcp data engineer Winnipeg, MB
- data engineer Winnipeg, MB
- big data engineer Winnipeg, MB
- data engineering intern summer Winnipeg, MB

