Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Research Engineer, Large Language Models

Immiland Canada Inc.

About the Role
We are hiring a Research Engineer to help train our next generation of large language models. You will design, run, and scale training experiments on thousands of GPUs, and turn research ideas into production-grade models.You will join a small team of researchers and engineers who own the full model lifecycle: data, pre-training, post-training, and evaluation. Research and engineering are not separate here: you will write the code, run the experiments, and shape the conclusions.
Key Responsibilities – What You'll Do
Design and run large-scale pre-training and fine-tuning experiments, from small ablations to full training runs.
Study scaling laws to choose model size, data mix, and hyperparameters under a fixed compute budget.
Improve training efficiency through parallelism strategies (data, tensor, pipeline, FSDP), mixed precision, and custom CUDA or Triton kernels.
Diagnose and fix training instabilities such as loss spikes, divergence, and hardware failures.
Build and improve data pipelines, including filtering, deduplication, quality scoring, and dataset mixing.
Implement ideas from recent research papers and test whether they hold at scale.
Build evaluations that measure real model capabilities and track results rigorously.
Work closely with the alignment, infrastructure, and product teams, and share findings through clear write-ups.
Required Qualifications – What We're Looking For
3+ years of hands-on experience training deep learning models, or a PhD in a related field (computer science, mathematics, or physics).
Strong Python skills and deep expertise in PyTorch or JAX.
Practical experience with Transformer architectures, including attention, tokenization, embeddings, and positional encodings.
Experience with distributed training on multi-node GPU clusters (FSDP, DeepSpeed, Megatron-LM, or similar).
Solid foundations in linear algebra, probability, statistics, and optimization.
Ability to read a research paper, implement it from scratch, and judge whether it works.
Rigorous experimental habits, including clean baselines, ablations, reproducible results, and experiment tracking.
Clear written and verbal communication skills, and comfort working in a fast-moving, ambiguous environment.
Preferred Qualifications – Nice to Have
Publications at top venues (NeurIPS, ICML, ICLR, ACL) or well-known open-source contributions.
Experience pre-training an LLM from scratch, at any scale.
Post-training experience, including supervised fine-tuning, RLHF, DPO, or other preference-optimization methods.
GPU performance work involving CUDA, Triton, FlashAttention-style kernels, and profiling.
Experience with efficient inference, including quantization, distillation, and optimized model serving.
Cluster and infrastructure experience with Slurm, Kubernetes, or cloud GPU platforms.
Large-scale data engineering experience (Spark, Ray, dataset curation for multilingual or domain-specific corpora).
Thank you for your interest!
#J-18808-Ljbffr
Vacancy posted 2 hours ago
Similar jobs that could be interesting for youBased on the Research Engineer, Large Language Models in Winnipeg, MB vacancy
  • Advance large language model research at Capital One Canada with NLP expertise, open-source tools, and scalable AI engineering.As a Manager and Applied Researcher, you will pursue impactful research while helping deliver AI-powered products. The role supports foundation model... 
    Language

    Capital One Canada

    Winnipeg, MB
    2 hours ago
  • Optimize large language model systems at Capital One Canada with PyTorch, similarity search, and responsible AI engineering in a hybrid model.As Manager AI Engineer, you will develop production capabilities that help reimagine banking through emerging AI technologies. You will... 
    Language

    Capital One - CA

    Winnipeg, MB
    2 hours ago
  • About the Role Our client is seeking a highly experienced Senior AI Engineer with a strong background in Natural Language Processing (NLP) and Large Language Models (LLMs) to join their innovative team in Kimberley. This hybrid role offers a balance of remote work flexibility... 
    Language
    Work at office
    Remote work
    Home office

    Placements24

    Winnipeg, MB
    2 hours ago
  • About the roleWe’re seeking an experienced Machine Learning Engineer to contribute to development of software and specifically LLM...  ...in designing, implementing, improving, and deploying large language modeling systems at significant scale. In addition, we value proficiency... 
    Language

    Valence Labs

    Winnipeg, MB
    2 hours ago
  •  ...on data generation and machine learning to craft responsible large language models in a remote-friendly environment. In this critical role,...  ...systems. You'll utilize strong statistical skills and software engineering expertise to design experiments that enhance data collection... 
    Language
    Remote work

    Cohere

    Winnipeg, MB
    2 hours ago
  •  ...position We are seeking an experienced research scientist to conduct bold, high-...  ..., exceptional problem-solving and engineering skills, and experience in...  ...projects at the intersection of natural language processing, generative AI, large language models and drug discovery,... 
    Language
    Long term contract

    Valence Labs

    Winnipeg, MB
    2 hours ago
  • Develop advanced language models from Canada in a remote-first environment, using Python, PyTorch, and Hugging Face Transformers across production systems.As an NLP Engineer, you will train, fine-tune, evaluate, deploy, and monitor models for conversational assistants and AI... 
    Language
    Remote work

    Jobgether

    Winnipeg, MB
    2 hours ago
  • Lead the AI Language Models team at Motorola Solutions, focusing on large language machine learning to enhance public safety applications. Drive the ML lifecycle, ensuring...  ...experience, you will bridge the gap between AI research and production engineering. Your leadership will... 
    Language
    Internship

    Motorola Solutions

    Winnipeg, MB
    2 hours ago
  •  ..., scalable, controllable, and efficient simulation. As a Research Engineer in the World Models team, you will develop algorithms and productionize the next...  ...complex, dynamic 4D environments.This role focuses on large-scale world models for temporal reasoning and generation,... 

    Waabi

    Winnipeg, MB
    2 hours ago
  • $250k per year

     ...company. We build cutting-edge foundation AI models and end-to-end products that are...  ...for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate...  ...and Seoul. Join us!Role Overview Large Language Models (LLMs) continue to push... 
    Language
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere

    Winnipeg, MB
    2 hours ago
  • $180k - $200k per year

     ...compte et aidez-nous à bâtir un avenir plus sûr.Department Overview You will join the Language & Audio group where you will be leading machine learning engineering of our Large Language Models and their harnesses. Your work will impact all aspects of the machine learning cycle... 
    Language
    Internship
    Immediate start
    Remote work

    Motorola Solutions

    Winnipeg, MB
    2 hours ago
  • Member of Technical Staff, Small Language ModelsFull-time Onix is...  ...onix is a small language model trained exclusively on a single...  ...clinical notes, unpublished research, proprietary methods that have...  ...care about. Privacy is an engineering surface, not a compliance line... 
    Language
    Live In
    Relocation

    E+E Consulting

    Winnipeg, MB
    2 hours ago
  •  ...’inclusion et en l’authenticité. C’est pourquoi nous offrons des modèles exclusifs de lunettes de soleil mode et de performance de haute qualité...  ..., and ECPs’ business Conducts effective account seminars for large and small audiences Manage customer needs and issues... 
    Language
    Minimum wage
    Long term contract
    Full time
    Work at office
    Immediate start
    Night shift

    EssilorLuxottica Group

    Winnipeg, MB
    9 days ago
  • Bridge AI research and production through model post-training at Cohere, using Python, JAX, and supercompute infrastructure...  ...improve model performance, train large models at scale, and collaborate...  ...: Extremely strong software engineering skillsProficiency in Python, JAX,... 
    Remote work

    Cohere

    Winnipeg, MB
    2 hours ago
  •  ...We are looking for an Operations Research Engineer to join the Workforce Management (WFM) product...  ...scheduling, and resource allocation for a large-scale contact center environment. The...  ...business requirements into optimization models and production-grade optimization... 
    Internship
    Remote work
    Relocation

    Miratech

    Winnipeg, MB
    10 days ago
  •  ...have yet: an Enterprise World Model. While the rest of the field...  ...where it became Microsoft’s AI research center in Canada. We've built companies...  ...team of expert researchers and engineers who are trying to understand at a deep level, how modern large language models and world... 
    Language
    Internship
    Work at office

    Skyfall.ai

    Winnipeg, MB
    2 hours ago
  • Research Scientist, develop predictive world models from video using Python and PyTorch within Meta’s Fundamental AI Research...  .... The work spans data curation, large-scale model training, and robust...  ...with scientists and engineers across teamsExigences: Bachelor... 

    Meta

    Winnipeg, MB
    2 hours ago
  •  ...IT staffing, cloud computing, engineering, mobility, testing, and more....  ...global company!Feature Modeling Engineer Required Skills:...  ...with UML and SysML modeling languages, as well as common MBSE structures...  ...developing use cases, business models, state machines, and other SysML... 
    Language
    Local area
    Worldwide

    V2Soft

    Winnipeg, MB
    2 hours ago
  • Shape multimodal AI at Nexxa by developing vision-language models, visual reasoning systems, and production computer vision solutions for heavy industry.This AI Vision Engineer works with artificial intelligence and engineering teams on intelligent visual systems. The role emphasizes... 
    Language

    Nexxa

    Winnipeg, MB
    2 hours ago
  •  ...Mission, Values and policies of St.Amant, the Coordinator, French Language Services (FLS) is a critical role in ensuring the success of St....  ...support, as well as staff, families, volunteers, and the community at large. The Coordinator actively initiates, develops, and nurtures... 
    Language
    Long term contract
    Full time
    Work at office

    St.Amant

    Winnipeg, MB
    19 days ago
  • Bartech Staffing is a leading engineering, technical and professional...  ...hiring a contract Requirements Modeling Engineer (Windsor, Ontario)....  .../ Sub-systems / Components models. Tests reports for...  ...with UML and SysML modeling languages, as well as common MBSE structures... 
    Language
    Contract work

    Bartech Staffing

    Winnipeg, MB
    2 hours ago
  • $110k - $170k per year

    Overview Carollo Engineers is a leading engineering firm dedicated...  ...agencies, municipalities, utilities, research organizations, and private...  ...and application of hydraulic models for water, wastewater, and...  ...planningDemonstrated experience leading large, complex hydraulic modelling... 
    Flexible hours

    Carollo Engineers, Inc.

    Winnipeg, MB
    2 hours ago
  •  ...developments into investment insights as an Equity Research Associate at AGF, with offices in Toronto...  ...will maintain forecasts and valuation models, summarize findings, and participate in...  ..., accounting, economics, mathematics, engineering, or related disciplineUse financial... 

    AGF Investments

    Winnipeg, MB
    2 hours ago
  • $110k - $135k per year

     ...ACS has an expansive global presence in research and development, manufacturing, and sales...  ...Summary We are seeking a Data and Modeling Engineer to join our IT Applications team. This role...  ...requirements into reliable data models, consistent KPI definitions, reusable semantic... 
    Long term contract
    Temporary work

    Amphenol Communications Solutions

    Winnipeg, MB
    2 hours ago
  • A leading AI research company in Montreal seeks a Member of Technical Staff to develop and scale machine learning algorithms. The role requires strong software engineering skills and proficiency in Python and ML frameworks. The ideal candidate will collaborate with engineering... 
    Remote work

    Cohere

    Winnipeg, MB
    2 hours ago
  •  ...company. We build cutting-edge foundation AI models and end-to-end products that are...  ...for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate...  ..., repeatable evaluations. Conduct research to advance the state-of-the-art in LLM... 
    Full time
    Work at office
    Local area
    Remote work
    Home office

    Cohere Inc.

    Winnipeg, MB
    2 hours ago
  • $165k - $330k per year

     ...Writer. By uniting applied AI research, flexible infrastructure, and...  ...frontier of AI to bring cutting-edge models into production. We’re growing...  ...and help build the platform engineers turn to ship AI products....  ...performance computing (HPC) and Large Language Model (LLM)... 
    Language
    Flexible hours

    Baseten

    Winnipeg, MB
    2 hours ago
  • Drive research innovation at Grammarly as a Strategic Research Scientist focusing on natural language processing. Collaborate with top researchers and make a tangible difference in AI writing tools. You will be part of a dedicated team that tackles advanced research problems... 
    Language

    Grammarly

    Winnipeg, MB
    2 hours ago
  •  ...the Role Our client, a world-renowned research institution and technology leader, is seeking...  ...with deep expertise in Generative Models . This fully remote role is for a visionary...  ...as GANs, VAEs, diffusion models, and large language models (LLMs). You will lead research projects... 
    Language
    Long term contract
    Remote work

    Placements24

    Winnipeg, MB
    2 hours ago
  • Large loss forensic investigations, client advisory, and field work shape this Ontario Professional Engineer position with J.S. Held.Within the Forensic Architecture & Engineering department, you will oversee complex assignments and advise clients facing consequential matters... 

    J.S. Held

    Winnipeg, MB
    2 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Research Engineer, Large Language Models. Be the first to apply!