Distributed Ai Infrastructure Engineer
Delos Data
Optimize distributed AI workloads in Montreal through C++, Python, Linux, and rigorous performance benchmarking on multi-node clusters.As a System Software Engineer, you will help redefine the infrastructure layer of AI. Your focus includes communication primitives, execution primitives, and software-hardware analysis. The work supports efficient execution of large-scale models across thousands of GPUs.Key Responsibilities:
Identify performance bottlenecks in distributed training workloadsInvestigate inference performance through software-hardware interface analysisConduct rigorous multi-node cluster benchmarkingCharacterize performance across large-scale AI workloadsCollaborate across the stack on foundational technology designRequirements:
Strong proficiency with C++ and PythonDeep systems programming fundamentalsKnowledge of memory management and concurrencyUnderstanding of operating system internalsProficiency in Linux development environmentsBring distributed systems analysis, benchmarking, and software-hardware expertise to efficient AI model execution across GPU clusters.
#J-18808-Ljbffr
Identify performance bottlenecks in distributed training workloadsInvestigate inference performance through software-hardware interface analysisConduct rigorous multi-node cluster benchmarkingCharacterize performance across large-scale AI workloadsCollaborate across the stack on foundational technology designRequirements:
Strong proficiency with C++ and PythonDeep systems programming fundamentalsKnowledge of memory management and concurrencyUnderstanding of operating system internalsProficiency in Linux development environmentsBring distributed systems analysis, benchmarking, and software-hardware expertise to efficient AI model execution across GPU clusters.
#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Distributed Ai Infrastructure Engineer in Winnipeg, MB vacancy
- Design distributed execution infrastructure for LayerZero, focusing on runtime architecture, scalable systems, and strict correctness under demanding workloads.This Systems Engineer role centers on foundational systems supporting LayerZero’s execution and infrastructure layers...Suggested
- Scale fault-tolerant distributed systems for Affirm’s AI workloads as a remote Senior Software Engineer serving approved models and agents.As part of the AI Platform team,... ...observability services. You will partner with security, infrastructure, and product engineering while establishing...SuggestedRemote work
usd276k per year
...Equinix is the world’s digital infrastructure company®, shortening the path... ...building a new generation of AI infrastructure products, and... ...them. As a Distinguished Engineer on the AI Infrastructure Products... ..., resilient connectivity for distributed inference Technical...SuggestedFull timeWork at officeShift work- Secure and operate AI infrastructure at Terawatt Infrastructure, combining DevOps leadership with cloud reliability, observability, and agentic systems expertise.As a Staff DevOps Engineer, you will own infrastructure supporting Terawatt’s internal tools and AI platform. You...Suggested
- ...applications and next steps. Our partner is looking for a Software Engineer – AI Tooling Infrastructure based in Canada. We are looking for an experienced... ...systems running in production. You will join a globally distributed, asynchronous engineering environment that values...SuggestedLong term contractWork at officeRemote workFlexible hours
- ...remotely from eligible Canadian provinces on AI infrastructure using LLM gateways, agent runtimes, and... ...team is hiring a Senior Software Engineer to help move AI workloads from pilots into... ...backend, AI infrastructure, and distributed systems experience to Affirm’s remote-first...Remote work
- Build production AI infrastructure in Canada using agent orchestration, retrieval-augmented generation, and evaluation frameworks. Focus on reliable, secure, scalable systems.As an Applied AI Engineer, you will build and operate AI runtime infrastructure for production agent...
- Build production-grade AI infrastructure with Python and FastAPI at EPAM Systems, supporting enterprise knowledge systems and reliable retrieval... ...Work across backend services and observability.As a Python AI Engineer, you will evolve a Confluence-focused RAG chatbot into a...
- Build agentic AI infrastructure at Cohere using distributed systems expertise and machine learning intuition. This remote-friendly role supports offices worldwide.As a Senior Staff Software Engineer, you will create the platform powering autonomous AI agents at scale. Your work...Remote workWorldwide
- ...operating at the forefront of AI & Emerging Technologies, is... ...an exceptional Principal AI Engineer to spearhead the development... ...optimization of their cloud infrastructure. This senior role is critical... ...collaborate with a globally distributed team of top-tier AI professionals...Remote workWork from homeHome officeFlexible hours
- Lead multi-team AI engineering for Westlaw’s KeyCite, modernizing distributed platforms while delivering reliable generative AI capabilities in a hybrid environment.Thomson Reuters seeks a Senior Manager, AI Engineering to stay close to technology while leading a high-performing...
$170k per year
...simplify and democratize data and AI — from making the next mode... ...the world's best data and AI infrastructure platform so our customers can... ...their business. Founded by engineers — and customer obsessed — we... ...intersection of large scale distributed systems, data modeling, governance...Summer workWorldwide$123.3k - $159.5k per year
# Software Engineer, AI/ML InfrastructureThumbtack123k-160k CADFull-timeremote· seniorCanadagopythonpostgresListed via Jobicy · posted... ...Imagine what we’ll build together.About the Machine Learning Infrastructure TeamAt Thumbtack, our challenges span a wide range of areas,...Seasonal workLocal area- ...America’s leading manufacturer and distributor of air distribution products ( The founding principles of Price have never... ...offers free Tea and Coffee. Position Summary Join our AI team as an Intermediate AI Engineer, where you'll build and deploy AI applications, agents,...
$180k - $210k per year
...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Staff Network Engineer (AI Infrastructure) based in Canada. The Staff Network Engineer will design and build the networking automation that powers next-generation...Local areaRemote workFlexible hours- Cohere is seeking a Software Engineer to build and maintain high-performance data infrastructure essential for AI training workloads. The role involves working on petabyte-scale storage and addressing complex performance challenges. Candidates should have over 4 years of experience...Remote workFlexible hours
- Network automation specialists can design AI cloud infrastructure from Canada as Staff Network Engineers focused on InfiniBand and Ethernet fabrics.This highly technical Staff Network Engineer role develops software-driven networking for large-scale AI workloads. You will automate...
- About the RoleWe’re seeking a skilled Platform Engineer to deploy and manage AI/ML infrastructure and applications on Kubernetes. You’ll be responsible for building reliable, scalable, and secure deployment pipelines using modern GitOps practices. What You’ll Do Deploy...
- Drive impactful AI solutions with Astera Labs as a Principal Product Applications Engineer. Engage with industry leaders in hyperscalers and AI systems, delivering cutting-edge switching technology. As a crucial member of the Scorpio team, you will guide clients through evaluation...
- ...what powers the next generation of AI? We’re looking for a Staff LLMOps Engineer to lead the design,... ...large language model (LLM) infrastructure on the cloud.You’ll be the driving... ...decoding, KV-cache management, and distributed scheduling. Collaborate with...Work at office
- Elevate your career with Huawei Canada as a Senior Engineer focusing on cloud AI infrastructure. This permanent role blends systems engineering, research... ...innovation in a dynamic environment. As part of the Distributed Scheduling and Data Engine Lab, you will contribute to...Permanent employment
- Take a leading role in AI at Cerebras Systems as a Senior Software Development Engineer in Test, specializing in advanced testing for AI infrastructure. Your work will directly influence the reliability... ...C/C++ • Ability to debug large distributed systems • Familiarity with cloud...
- ...a leading research institution, is seeking an experienced AI Infrastructure Engineer to manage and optimize their High-Performance Computing (HPC... ...groundbreaking AI research and development, requiring deep expertise in distributed systems, networking, and hardware acceleration. Key...Remote work
- ...is hiring for a role in a security-first enterprise AI setting, focusing on scalable ML infrastructure and agentic systems. You will help build the platform... ...candidates who thrive in hard, forward-looking problems and distributed environments. The team values systems depth, ML...Remote work
$125k - $165k per year
Job Description The Senior Distribution Engineer plays a key role in delivering electrical utility infrastructure projects within a fast-growing engineering consulting group. This... ...records. Use of Artificial Intelligence (AI) We may use Artificial Intelligence (AI) to...RemplacementLong term contractPermanent employmentFull timeFor subcontractor- ...Lead IT infrastructure projects at CBC/Radio-Canada using detailed engineering design, cloud technologies, and hands-on deployment expertise in a hybrid work model. This full-time permanent Engineering Project Lead position is based in Toronto, with projects focused on technology...Permanent employmentFull time
- ...Own cloud infrastructure and CI/CD automation as a Senior DevOps Engineer with Bounteous, supporting secure, scalable, reliable platforms remotely across Canada or Mexico. This contract position requires six-plus years in DevOps, Cloud Engineering, SRE, or Infrastructure...Contract workInternshipRemote work
- ...challenges, and growth without boundaries. Engineers at ATCO are deeply valued because we... ...’s 25kV operational planning of the distribution grid. This area of responsibility will... ...logistics and operations management), Energy Infrastructure (electricity generation, transmission...Long term contract
- Job Title: Senior Engineer, DistributionIconic Power Systems is a Canadian power infrastructure company providing engineering, construction, and maintenance services across transmission, distribution, substations, and renewable energy. Driven by our values of Safety, Integrity...Work at office
- Relay is hiring a Senior Software Engineer (Voyager) in Toronto to help build AI-enabled infrastructure and accelerate product experiences for small businesses. You will shape AI foundations, prototype emerging technologies, and partner with product teams to deliver impactful...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Distributed Ai Infrastructure Engineer. Be the first to apply!

