Kafka Architect
HCL Technologies Limited
Lead/Architect level requirement to assist on building out Kafka platform and specifically with focus on
Flink ;
Should be able to contribute to design, propose, and evaluate solutions. Should also be hands‑on with development and lead the Kafka development team.Expert‑level architecture and implementation experience of Flink applications on Confluent Platform, specifically for high‑volume, low‑latency stream processing.Extensive experience architecting, implementing, and administering the Confluent Cloud Kafka and Flink platform in production environments.Advanced proficiency in core Flink concepts including state management (Keyed/Operator State, RocksDB), Exactly‑Once semantics, and configuring checkpointing and savepoints for fault tolerance.Deep knowledge of Event Time processing, Watermarks (Bounded Out‑of‑Orderness), and complex Windowing (Tumbling, Sliding, Session) for accurate stream analytics.Advanced knowledge of KSQL DB and KStreams for rapid development of real‑time stream processing/analytics alongside Flink.Proven proficiency in Kafka Connectors (including Change Data Capture/CDC) from configuration to end‑to‑end integration in cloud environments.Demonstrated experience applying Flink and Kafka in the Retail Industry for use cases such as real‑time inventory management, dynamic pricing, fraud detection, and personalized customer experience (e.G., clickstream analysis).Strong background in platform governance: schema registry, RBAC, audit logging, retention, and compliance.Deep expertise with Terraform and the Confluent Terraform provider;
adherence to Infrastructure‑as‑Code (IaC) methodology and automation.Practical experience designing and managing Harness CI/CD pipelines (or other similar tools) for automated deployment and configuration management of Flink jobs.Advanced knowledge of GCP networking, including Private Service Connect (PSC), DNS, Firewalls, and enterprise security.Track record in implementing cloud‑native monitoring and observability solutions;
troubleshooting, Flink performance tuning, and incident response.Thorough experience with Disaster Recovery (DR), High Availability (HA) strategies, backup/restore, and multi‑region design.Practical experience with cost optimization, resource monitoring, and right‑sizing specifically for Flink and Kafka resources in Confluent Cloud.Strong abilities in schema management, version compatibility, and data governance.Demonstrated capability in capacity planning, partitioning, and scaling high‑throughput streaming architectures.Experienced in Agile/DevOps methodologies.Experience providing hands‑on production support for mission‑critical streaming platforms.
#J-18808-Ljbffr
Flink ;
Should be able to contribute to design, propose, and evaluate solutions. Should also be hands‑on with development and lead the Kafka development team.Expert‑level architecture and implementation experience of Flink applications on Confluent Platform, specifically for high‑volume, low‑latency stream processing.Extensive experience architecting, implementing, and administering the Confluent Cloud Kafka and Flink platform in production environments.Advanced proficiency in core Flink concepts including state management (Keyed/Operator State, RocksDB), Exactly‑Once semantics, and configuring checkpointing and savepoints for fault tolerance.Deep knowledge of Event Time processing, Watermarks (Bounded Out‑of‑Orderness), and complex Windowing (Tumbling, Sliding, Session) for accurate stream analytics.Advanced knowledge of KSQL DB and KStreams for rapid development of real‑time stream processing/analytics alongside Flink.Proven proficiency in Kafka Connectors (including Change Data Capture/CDC) from configuration to end‑to‑end integration in cloud environments.Demonstrated experience applying Flink and Kafka in the Retail Industry for use cases such as real‑time inventory management, dynamic pricing, fraud detection, and personalized customer experience (e.G., clickstream analysis).Strong background in platform governance: schema registry, RBAC, audit logging, retention, and compliance.Deep expertise with Terraform and the Confluent Terraform provider;
adherence to Infrastructure‑as‑Code (IaC) methodology and automation.Practical experience designing and managing Harness CI/CD pipelines (or other similar tools) for automated deployment and configuration management of Flink jobs.Advanced knowledge of GCP networking, including Private Service Connect (PSC), DNS, Firewalls, and enterprise security.Track record in implementing cloud‑native monitoring and observability solutions;
troubleshooting, Flink performance tuning, and incident response.Thorough experience with Disaster Recovery (DR), High Availability (HA) strategies, backup/restore, and multi‑region design.Practical experience with cost optimization, resource monitoring, and right‑sizing specifically for Flink and Kafka resources in Confluent Cloud.Strong abilities in schema management, version compatibility, and data governance.Demonstrated capability in capacity planning, partitioning, and scaling high‑throughput streaming architectures.Experienced in Agile/DevOps methodologies.Experience providing hands‑on production support for mission‑critical streaming platforms.
#J-18808-Ljbffr
Vacancy posted 1 hour ago
Similar jobs that could be interesting for youBased on the Kafka Architect in Winnipeg, MB vacancy
- ...lead the design and implementation of scalable microservices architecture in Calgary, AB. The ideal candidate will have expertise in Kafka, Oracle, and PL/SQL for effective data management. Responsibilities include collaboration with cross-functional teams, providing mentorship...Suggested
- A leading tech company in Canada is seeking a skilled Architect to assist in building out their Kafka platform with a focus on Flink. This role requires significant experience in high-volume, low-latency stream processing, advanced proficiency in Flink and Kafka, and a strong...Suggested
- ...office 5 days a weekRole Summary:We are looking for an experienced Kafka Platform Administrator / Kafka Developer with strong expertise... ...Collaborate with application developers, infrastructure teams, architects, security teams, and business stakeholders to deliver secure and...SuggestedInternshipWork at office
- We are looking for a Kafka Engineer with strong experience in Apache Kafka, Python, Linux, and Grafana to support and enhance large-scale distributed systems within an Investment Banking environment. The ideal candidate will be passionate about troubleshooting complex...Suggested
- ~4-5 years of software development experience with strong hands-on Apache Kafka expertise. ~ Experience building and supporting Kafka producers, consumers, topics, and event-driven applications. ~ Strong AWS experience, particularly Amazon MSK and ECS. ~ Understanding...Suggested
$100k - $120k per year
...sustainability, and community empowerment.Design, develop, deploy, and maintain scalable messaging and streaming solutions using Apache Kafka.Configure, monitor, and optimize Kafka clusters and related ecosystem components.Develop automation solutions and support tools using...Long term contract- Develop backend services with Java 17+ and Spring Boot, with Kafka experience beneficial for enterprise application delivery.This engineering position spans the software development lifecycle, from analysis and implementation through testing, deployment, and production support...
- ...Excellent communication and stakeholder management skills.Experience working within Agile delivery teams.Experience with technologies such as Kafka, Elasticsearch, Angular (web development), microservices architectures, cloud-hosted environments, observability platforms (...
- Flexton Inc., Established in 2007, headquarter is in San Jose, CA with development centers in India at multiple locations. We are a leading professional services company offering a unique product mix that extends into Technology, Consulting, Digital and Operations. Flexton has...
- Design scalable Apache Kafka messaging solutions with Python automation and Grafana monitoring for Tata Consultancy Services in Canada. Support enterprise streaming platforms.As a Kafka Engineer, you will develop, deploy, and maintain messaging and streaming solutions across...
$156k - $184k per year
...own important technical problems, improve reliability and operability, and drive engineering decisions in partnership with the team. Kafka experience is desirable, but not required. Strong knowledge of distributed systems infrastructure, especially Kubernetes, networking,...Work at office- Build and maintain Kafka Connect integrations in Calgary, Alberta, onsite five days weekly, using source, sink, and connector lifecycle expertise. Support dependable data movement across enterprise systems.This Kafka Platform Administrator and Developer develops, deploys, validates...
- Apache Kafka and Python expertise define this Engineer role supporting distributed systems in an Investment Banking environment. Linux and Grafana skills are central.This Kafka Engineer designs, develops, and supports data streaming solutions across large-scale distributed...
- Shape Kafka-driven workflow infrastructure for Kaseya’s Intelligence Platform in Toronto, building durable services with Go or Rust.As a Platform Backend Engineer, you will turn PSA webhooks, RMM alerts, and platform events into reliable execution. You will build platform capabilities...
- ...We're Looking For We’re looking for a hands-on Data Solution Architect to design and deliver scalable, secure, and reusable data solutions... ...-structured data Experience with streaming platforms such as Kafka Cloud architecture certifications (e.g. AWS or Azure)...Internship
- Kafka, asynchronous communication, and Java development shape this Vancouver-based opening at Reveille Technologies, Inc. for a full stack microservices engineer.The Java Full Stack Microservice Developer will design, develop, and deploy solutions using Spring Boot and microservices...
- Lead Kafka event-driven integration delivery with modern Java at ML arteka, supporting distributed developers through technical execution and people management.This Technical Lead owns the integration layer’s delivery while remaining hands-on with Java 17/21, concurrency, and...
- ...candidate should have hands-on experience in PySpark, Apache Spark, Kafka, Hadoop ecosystem components, and Apache NiFi, along with a... ...performance of Spark jobs and data pipelines. Collaborate with architects, business analysts, and development teams to deliver high-...Work at office3 days per week
- Build high-throughput Java platforms at Citi using Apache Kafka, Oracle Database, Spring Boot, and secure enterprise integration practices.This senior Applications Development Technology Lead Analyst combines platform architecture with hands-on development and technical team...
- Introduction At IBM Software, we transform client challenges into solutions. Building the world's leading AI-powered, cloud-native products that shape the future of business and society. Our legacy of innovation creates endless opportunities for IBMers to learn, grow, and...Internship
- ...backend services with Java and Spring Boot, and collaborate with QA and product teams to deliver reliable solutions. You'll work on Kafka-based messaging, relational databases, RESTful APIs, and participate in code reviews in an Agile environment, with opportunities to...
- Citi is seeking a Senior Java Backend Engineer to design high-performance, event-driven systems at global scale. You will architect reactive microservices, integrate real-time data streams, and ensure engineering quality across a modern Java stack. You will mentor engineers...Full timeWorldwide
- Salesforce Partner Canada is seeking a senior backend engineer to build and operate distributed systems, including Kafka-based services, across multiple data centers. The role emphasizes architectural design, production reliability, and open source collaboration. You will own...
- A technology solutions company is seeking a Kafka Administrator for a contract position in Mississauga, Canada. The ideal candidate will have 6+ years of relevant experience and expertise in the Confluent Platform, including Kafka administration. Responsibilities include collaborating...Contract work
- ...a Senior Event Streaming Engineer / Lead to design and implement event-driven integration solutions using Azure Event Hubs and Apache Kafka. Responsibilities Design event-driven integrations, including Kafka connectivity, topic mapping, partitioning, and schema management...
- ...HCL Technologies Limited in Canada seeks a skilled Apache Kafka specialist to design, build, and support event-driven applications using Kafka producers, consumers, and topics. The role emphasizes strong AWS MSK/ECS experience and hands-on troubleshooting, monitoring, and...
- SENIOR JAVA DEVELOPER – SPRING BOOT, MICROSERVICES, KAFKA & MONGODB Experience Range: 9–12 Years MUST-HAVE TECHNICAL/FUNCTIONAL... ...monitoring, and resiliency patterns.Collaborate with Business Analysts, Architects, QA, and DevOps teams.Participate in code reviews, unit testing,...
- ...with deep Big Data expertise to design, develop, and support enterprise-scale data platforms. The role focuses on PySpark, Apache Spark, Kafka, Hadoop ecosystem, and NiFi, covering ingestion, transformation, and real-time processing. You will build scalable pipelines,...
- Java Backend Developer - MQ, Kafka Messaging Systems4 days ago Be among the first 25 applicants Responsibilities Design, implement, and optimize backend services handling high-volume data flows with strict performance and reliability requirements. Develop Java‑based...Full time
$90k - $140k per year
...Description: Location: Winnipeg, Manitoba Security Clearance: Eligible for Reliability or Secret Clearance The Cybersecurity Solution Architect is responsible for designing secure, scalable, and resilient technology solutions that align with organizational security standards,...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Kafka Architect. Be the first to apply!
Related searches
- junior architect Winnipeg, MB
- summer intern architect Winnipeg, MB
- junior architectural designer Winnipeg, MB
- intern architect Winnipeg, MB
- architecte architecture Winnipeg, MB
- design architect Winnipeg, MB
- architectural designer work from home Winnipeg, MB
- collaborateur d architecte Winnipeg, MB
- architectural designer Winnipeg, MB
- architect assistant Winnipeg, MB

