Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Postdoctoral Fellow - Uncertainty Quantification And Calibration For Large Language Models

$83.99k per year

NRC

Priority may be given to the following designated employment equity groups: women, Indigenous Peoples* (First Nations, Inuit and Métis), persons with disabilities and racialized persons*.

* The Employment Equity Act, which is under review, uses the terminology Aboriginal peoples and visible minorities.

Candidates are asked to self-declare when applying to this hiring process.

City: Ottawa

OrganizationalUnit: Digital Technologies

Classification: RO

Tenure: Term

Duration: 2 years

Language Requirements: English

Work arrangements:

  • Due to the nature of the work and operational requirements, this position may be eligible for a limited hybrid work arrangement (combination of working onsite and telework).

At the NRC, we recognize that Indigenous candidates may have important connections to their communities and you may be eligible for an exception to this work arrangement. Alternative work arrangements may also be considered to accommodate candidates as required. To learn more about these options, please contact the NRC Hiring team using the contact information below.

The program

The NRC’s Postdoctoral Fellowship program offers PDFs access to unique world-class facilities and the opportunity to work alongside multi-disciplinary teams of expert researchers and technicians on projects of critical importance to Canada. PDFs will carry out research on innovative research projects, with opportunities for career development (publications and/or industry interaction).

PDFs will be offered appointments to the staff of the National Research Council on a term basis and will be offered salaries and benefits currently available to Research Officers. Salaries commensurate with experience are taxable and subject to other deductions. As a guide, the current annual PhD recruiting rate is $83,985. In addition PDFs will be allocated a travel fund to support their work.

Project title

Uncertainty Quantification and Calibration for Large Language Models

The role

Are you looking for an opportunity to conduct cutting-edge research with real-life impacts? Do you want to grow in a team environment that provides guidance and autonomy? Do you want ownership over outcomes allowing you to present your work at competitive international venues? Look no further we have a rewarding opportunity for you!

Current human-AI interaction is plagued by over-reliance on AI predictions, an inability todistinguish AI-generated content, and the risks of AI-generated falsehoods and deceptions. Quantifying the uncertainty in AI generations is a pathway to mitigating all of these risks.

Traditionally in AI research, a well-designed certainty measure assigns a probability of correctness to each generated output. Combining AI outputs with these interpretable confidence scores is immensely valuable for informed human-AI interaction. In the new era of generative large language models (LLMs), uncertainty quantification becomes less well-defined due to the open-ended nature of LLM outputs (i.E., it is necessary to simultaneously estimate the uncertainty in what is being said, and how it is being said, while dealing with an infinite output space). However, LLMs are now the backbone of most human-facing AI systems. How to meaningfully capture these uncertainties to provide useful context on LLM generations is an active research question.

Separately, recent work suggests that LLMs represent human-interpretable concepts (e.G., emotions, truthfulness, harmfulness, etc.) at intermediate points in their computation. This opens up a new opportunity to inspect uncertainty in the LLMs’ encoding of these concepts, which would enable new insights and intervention mechanisms. To date, we are not aware of any work that applies certainty calibration methods to intermediate model representations.

This project develops methods for uncertainty quantification that can be applied to both output generations, and intermediate features. Foundational work on this subject is both technically challenging and highly applicable to a wide range of open problems. The anticipated research outcomes are appropriate for publication in top-tier international venues for Computational Linguistics and Machine Learning research, such as ACL* conferences, ICLR, or ICML.

The Research Problem

Large language models produce text by iteratively generating a probability distribution over possible next-word choices, then sampling from that distribution. The problem of uncertainty quantification aims to consolidate that probability distribution into a few meaningful and interpretable certainty metrics. Certainty metrics can answer questions about reproducibility (i.E., if asked the same thing again, how likely is the LLM to respond in the same way?), or embedded knowledge (i.E., if asked a factual query, how certain is the LLM about its prediction?). Such measures can help contextualize LLM outputs for users or developers, and are a critical ingredient for trustworthy AI systems.

The proposed research agenda develops new methods for uncertainty quantification that can apply to features, determines whether such signals can be used to improve uncertainty metrics for text generation, and enables a host of impactful research applications:

  • Hallucination detection
  • Deception detection
  • Synthetic content detection
  • Mitigation of safety failure modes
  • Improved evaluation
  • Trustworthy decision support systems

In the long-term, the new knowledge that is created can support Canada’s commitment to safe and responsible use of generative AI, support strategic defence applications, and open new research opportunities.

In addition to the proposed research program, you will benefit from proximity to related work that is ongoing in the team. We currently work on distinct, but related, work in LLM interpretability and evaluation. There is potential for you to contribute to those works as well, if desired. We have ongoing collaborations with Mila (one of Canada’s leading AI research institutes) and Cohere (Canada’s largest LLM provider), which creates good networking or collaboration opportunities. It is expected that you will work autonomously, with guidance from the project lead, such that you have ownership over the outcomes, obtain first-author publications, and present the work at these competitive international venues.

Education

A Ph.D. in Computer Science, Mathematics, Statistics, Physics, or related discipline is required.

For information oncertificates and diplomas issued abroad, please see Degree equivalency

Experience
  • Experience with the design and implementation of novel and speculative research projects in AI-related fields.
  • Experience with deep learning tools and libraries, such as those specialized for data collection and analysis, or data simulation.
  • Experienced publication record with evidence of significant contribution in experimental design and implementation, scientific writing and presentation at high-calibre venues.
  • Experience with leading reading groups, mentoring students, or organizing workshops is an asset .
  • Experience understanding uncertainty quantification methods or mechanistic interpretability methods is an asset .
Language requirements

English

Information on language requirements and self-assessment tests

Condition of employment

Reliability Status

For a Reliability Status, verification of background information over a period of 5 years is required.

Who is eligible?
  • Fellowships will be for two years contingent on satisfactory progress achieved during the first year.
  • Candidates should have obtained a PhD (or equivalent) within the past three years (PhD received on or after July 1, 2024*) or expect to complete their PhD within 6 months of appointment.
  • Fellows will work in a lab under the direct supervision of an NRC researcher.

*Exceptions may be considered to recognize personal or family related leave. Please connect with us using the contact information below to discuss in more detail.

Application requirements

To be considered for the program please include the following in your application, please note that you will need to attach the required documents as per the list below when submitting your application. Failure to do so will result in your application being excluded.

  • Resume
  • Statement of Interest in the project (maximum one page in length)
  • PhD Transcript - an electronic copy is sufficient, it does not have to be an official version.
  • List of Publications

When submitting your application you can include the required documents in any attachment field such as «Second language evaluation results» or «Other attachments»

In addition, applicants who best meet the requirements of the position will be asked to provide three letters of recommendation at a later stage of the competition process.

Compensation

The intent of this hiring action is to staff the position at the AsRO level, which is an early-career level position with a salary range of $83,985 to $116,641. This wide range accounts for varying degrees of expertise and impact, and growth within the role.

Salary determination will be based on a thorough evaluation of the successful candidate's prior experience. This evaluation will consider specific achievements, skills, and contributions that demonstrate the candidate's impact and expertise. As a guide, the average starting rate for new PhD graduates entering this role is $83,985.

The NRC is committed to supporting career progression within the organization, providing access to the opportunities and resources needed for a pathway to a fulfilling career. NRC employees also enjoy a wide-range of competitive benefits including a robust pension plan, comprehensive health and dental coverage, disability and life insurance, office closure at the end of December, and additional supports to enhance your well-being throughout your career and beyond.

Discover the possible

Anything is possible at the NRC, named in 2026 one of Canada’s Top Employers for Young People, Top Employer in the National Capital Region and Forbes Canada’s Best Employers!

As Canada’s largest research and innovation organization, our world-renowned research pushes the boundaries of science and engineering to make the impossible, possible. Every day we explore new ideas through innovative research and help companies discover possibilities that impact Canada’s future and the world.

At the NRC, you’ll also discover new possibilities. Our supportive workplace fosters a culture of creativity, welcoming fresh perspectives and innovation at all levels. We value teamwork. You’ll collaborate across multiple fields and with the brightest minds to find creative solutions. Most importantly, you’ll discover what’s possible within you as you grow, make valuable contributions and progress in your professional journey. From ground-breaking discoveries to a life-changing career, discover your possible at the NRC.

Notes
  • In 2026, the NRC was chosen as one of Canada’s Top Employers for Young People, a National Capital Region Top Employer and Forbes Canada’s Best Employer.
  • Relocation assistance will be determined in accordance with the NRC's directives.
  • Fellowships are open to nationals of all countries, although preference will be given to Canadian citizens and permanent residents of Canada. Please include citizenship information in your application.
  • The incumbent must adhere to safe workplace practices at all times.
  • We thank all those who apply, however only those selected for further consideration will be contacted.

Please direct your questions, with therequisition number (26282) to:

E-mail: View email address on ca.hrm.tc

Telephone:View phone number on ca.hrm.tc

Closing Date: 7 January 2027 - 23:59 Eastern Time

For more information on career tools and other resources, check out Career tools and resources

*If you are currently a term or continuing employee at NRC, please apply through the SuccessFactors Careersmodule from your NRC computer.

#J-18808-Ljbffr
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Postdoctoral Fellow - Uncertainty Quantification And Calibration For Large Language Models in Ottawa, ON vacancy
  • $74.23k - $103.09k per year

     ...Detection  Next-Generation Battery Management System for Electrified Transportation and Energy Storage  Uncertainty Quantification and Calibration for Large Language Models  High-Yield Printable Polymers for Extreme Refractory Materials (HYPER Materials)  Tesla-Valve-Based... 
    Language
    For postdoc
    Full time
    Apprenticeship
    Internship
    Remote work

    The National Research Council of Canada

    Ottawa, ON
    13 days ago
  •  ...Research trustworthy AI in Ottawa through uncertainty quantification for large language models. Work with LLM interpretability and evaluation methods. The National Research Council offers a two-year Postdoctoral Fellowship in Digital Technologies. You will work autonomously... 
    Language
    For postdoc

    NRC

    Ottawa, ON
    3 hours ago
  • $30 per hour

     ...intelligence to serve humanity. We’re training and deploying frontier models for developers and enterprises who are building AI systems to...  .... Data quality is foundational to this process. Machines (or Large Language Models to be exact) learn in similar ways to humans - by way of... 
    Language
    Hourly pay
    Full time
    Contract work
    Part time
    For contractors
    Work at office
    Remote work
    Flexible hours

    cohere

    Ottawa, ON
    2 days ago
  • $175k - $195k per year

     ...,000 CAD THE OPPORTUNITY:   At TechInsights, we decode technology to reveal the innovations shaping our world. As the Technical Fellow, Advanced Packaging Integration, you’ll be a central figure in that mission, a recognized technical authority who bridges advanced packaging... 
    Suggested
    Permanent employment
    Full time
    Internship
    Work at office
    Worldwide
    Flexible hours

    TechInsights

    Ottawa, ON
    10 days ago
  • $190k - $240k per year

     ...Principal Engineer (Physical AI - System Modeling) to join the Pathfinding Studio...  ...and lead research in foundation model training and fine-tuning, vision-language-action models, reinforcement...  ...will solve critical problems under uncertainty, guide long-term technology and intellectual... 
    Language
    Long term contract
    Permanent employment
    Full time
    Work at office

    Renesas Electronics

    Ottawa, ON
    2 days ago
  • $29.5 - $32.5 per hour

    Overview Languages English or French Education Bachelor's degree or equivalent experience Experience 2 years to less than 3 years On site Work must be completed at the physical location. There is no option to work remotely. Work setting... 
    Language
    Remote work

    L'Académie du français langue seconde de l'Atlantique Inc

    Ottawa, ON
    6 days ago
  • $112.01k - $149.34k per year

     ...need to explore new markets, reduce risks, all towards the goal of making Canada and the world better through trade. Position: Manager, Model Risk ManagementEmployment Type: Permanent Compensation Details:Mgr Quantitative Analysis 19: Salaries typically range from $112,006 to... 
    Permanent employment
    Full time

    Export Development Canada (EDC)

    Ottawa, ON
    25 days ago
  •  ...engineer a better world! We are looking for Senior Traffic Engineer/Modeller to support our expanding transportation sector in Ontario and...  ...(Word, Excel, PowerPoint)  Working knowledge of a programming language (Python, R, etc.) is essential Integrity, team spirit, and a... 
    Language
    Permanent employment
    Full time
    Work at office
    Work from home
    Flexible hours

    CIMA+

    Ottawa, ON
    12 days ago
  • About the opportunity Title: Junior Research Fellowship-Internship Organization: European Institute of Policy Research and Human Rights, AISBL Location: Remote Type: Internship Duration: 8 weeks About The European Institute of Policy Research...
    Internship
    Remote work

    European Institute of Policy Research and Human Rights AISBL

    Ottawa, ON
    5 days ago
  • $67.33 - $105 per hour

     ...Speech Language Pathologist Independent Contractor Apply here   to complete a short video-based interview & upload your resume:  Our Purpose At Spark, we're on a mission to make a difference in the way community healthcare is done. As a leading healthcare organization... 
    Language
    Hourly pay
    For contractors
    Internship
    Flexible hours

    Spark Lifecare

    Ottawa, ON
    more than 2 months ago
  • $239.47 per day

     ...Practice Posting limited to: Professeur à temps partiel postdoctoral / Postdoctoral Part-Time Professor Date Posted (YYYY/MM/DD):...  ...Course type: n/a Posting type: Régulier / Regular Language of instruction: Anglais | English, Français | French Competence... 
    Language
    For postdoc
    Hourly pay
    Long term contract
    Permanent employment
    Part time
    For contractors

    University of Ottawa

    Ottawa, ON
    12 days ago
  • $23 - $24 per hour

    Overview Languages Bilingual Education ~ Bachelor's degree Experience 1 year to less than 2 years Remote Work must be done remotely. There’s no office space provided. Experience and specialization Target audience ~ Adults
    Language
    Full time
    Contract work
    Part time
    Work at office
    Remote work

    Centre de formation Caron

    Ottawa, ON
    5 days ago
  • $23 - $24 per hour

    Overview Languages Bilingual Education ~ Bachelor's degree Experience 1 year to less than 2 years Hybrid Work must be completed both in person and remotely.
    Language
    Full time
    Contract work
    Part time
    Remote work

    Centre de formation Caron

    Ottawa, ON
    5 days ago
  • $106k - $156k per year

     ...You will bridge the gap between theoretical modeling and hands-on experimental validation to...  ...Develop and maintain accurate numerical models of optical transmission systems, accounting...  ...communication and sensing applications. Analyze large datasets from experimental setups and... 
    Contract work
    Internship
    Immediate start

    Huawei Technologies Canada Co., Ltd.

    Ottawa, ON
    4 days ago
  •  ...around hydraulic and hydrologic modelling and is motivated by...  ...actively involved in developing, calibrating, validating, troubleshooting,...  ...Interpret model results, identify uncertainty and limitations, and...  ...analyzing, and interpreting large datasets, including flow, level... 
    Work at office

    Stantec

    Ottawa, ON
    12 days ago
  •  ...around hydraulic and hydrologic modelling and wants to continue...  ...someone who enjoys developing, calibrating, troubleshooting, and applying...  ...results, identify limitations and uncertainties, and translate technical...  ...analyzing, and interpreting large datasets, including flow, level... 
    Work at office

    Stantec

    Ottawa, ON
    12 days ago
  • $150k - $200k per year

     ...decode Nature's foundational model — to build instruments precise...  ...to ask questions that are larger than a grant cycle. The focus...  ...programs, manage scientific uncertainty honestly, and build and develop...  ...group, mentoring PhD students or postdoctoral researchers, or developing a... 
    For postdoc
    Long term contract
    Full time
    Internship
    Immediate start

    Q-Block Computing

    Ottawa, ON
    21 days ago
  • $99.38k per year

     ...staff, graduate students and post-doctoral fellows prior to interviewing. INDIGENOUS...  ...primarily teach in the Faculty’s English-language programs.   Terms: New tenure-track...  ...Yaya Koné, Vice-Dean, Graduate and Postdoctoral Studies, Faculty of Education, University... 
    Language
    For postdoc
    Long term contract
    Permanent employment
    Full time
    Work at office
    Relocation

    University of Ottawa

    Ottawa, ON
    7 days ago
  • $99.38k per year

     ...affiliation: APUO Faculty/Department: Department of Modern Languages and Literatures_FT Campus: Main Campus Date Posted (...  ...to support research activities of graduate students and postdoctoral fellows. The Fellowship is intended to support an exceptional scholar... 
    Language
    For postdoc
    Permanent employment
    Full time
    For contractors
    Work at office
    Shift work

    University of Ottawa

    Ottawa, ON
    12 days ago
  • $65k - $125k per year

     ...mission to decode Nature's foundational model — to build instruments precise enough to...  ...in an environment that embraces genuine uncertainty, values experimental rigor over performative...  ...experimental program. Collaborate closely with fellow scientists, engineers, and technical... 
    Full time
    Internship

    Q-Block Computing

    Ottawa, ON
    21 days ago
  • $200k per year

     ...legal systems. Working in French as well as in other languages, our researchers and jurists lead both large- and small-scale research projects and teams,...  ...Internal candidates, including faculty members, postdoctoral fellows, and students, are not eligible. Candidates who are... 
    Language
    For postdoc
    Long term contract
    Permanent employment
    Full time
    Live In
    Work at office
    Local area
    Immediate start
    Relocation

    University of Ottawa

    Ottawa, ON
    7 days ago
  • $85.04k - $107.42k per year

     ...Positions: 1 Faculty/Service - Department: Graduate and Postdoctoral Studies Academic Services Campus: Roger Guindon Hall Union...  ...and reading comprehension in their second official language. The rating is determined by a proficiency test designed by the... 
    Language
    For postdoc
    Remplacement
    Permanent employment
    Full time
    Temporary work
    For contractors
    Work at office

    University of Ottawa

    Ottawa, ON
    13 hours ago
  • $239.47 per day

     ...Description: Posting limited to: Professeur à temps partiel postdoctoral / Postdoctoral Part-Time Professor Date Posted (YYYY/MM/DD):...  ...Course type: B Posting type: Régulier / Regular Language of instruction: Anglais | English Competence in second language... 
    Language
    For postdoc
    Hourly pay
    Permanent employment
    Part time
    For contractors

    University of Ottawa

    Ottawa, ON
    12 days ago
  • $95k - $115k per year

     ...coding assistants to accelerate feature delivery, manage system uncertainties, and maintain high standards of code quality. You will...  ...Proficiency: Demonstrated experience in one or more backend languages such as Go, Java, JavaScript, or Python. AI Mastery: Proven... 
    Language
    Long term contract
    Temporary work
    Internship
    Manual labor
    Work at office
    3 days per week

    TrendAI

    Ottawa, ON
    1 day ago
  •  ...virtual selling techniques. ~ English proficiency (or local language proficiency per market). Schedule:  Ability to work a...  ...finish things before moving on; can comfortably handle risk and uncertainty. Drive for Results : Can be counted on to exceed goals successfully... 
    Minimum wage
    Seasonal work
    Local area
    Flexible hours
    Shift work
    Night shift

    Tapestry

    Ottawa, ON
    4 days ago
  • $118.68k - $148.34k per year

     ...development and use of appropriate animal models, review of animal use protocols, and participation...  ...excellent team player. Experience with large and small animal models desirable...  ...reading comprehension in their second official language. The rating is determined by a proficiency... 
    Language
    Remplacement
    Permanent employment
    Full time
    Temporary work
    For contractors
    Internship
    Rotating shift
    Weekend work
    Afternoon shift

    University of Ottawa

    Ottawa, ON
    12 days ago
  • $100k per year

     ...process online. Internal candidates, including faculty members, postdoctoral fellows, and students, are not eligible. Candidates who are also...  ...French. Passive (or active) knowledge of one’s second official language (French or English) is a requirement for tenure. English-French... 
    Language
    For postdoc
    Long term contract
    Permanent employment
    Work at office
    Immediate start
    Relocation

    University of Ottawa

    Ottawa, ON
    12 days ago
  • $131.8k per year

     ...not affiliated to uOttawa unless they are the candidate’s PhD or postdoctoral supervisor). Commitment to Equity, Diversity and Inclusion...  ...than 175-year tradition of bilingualism. Through its Official Languages and Bilingualism Institute, the University provides second-language... 
    Language
    For postdoc
    Long term contract
    Permanent employment
    Full time
    Fixed term contract
    Work at office

    University of Ottawa

    Ottawa, ON
    2 days ago
  • $45k - $60k per year

     ...be open to learning and being coached. Our model is VERY PROVEN… So just trust in our...  ...is key for our agency to accommodate our large client base daily.. HOWEVER… Once you reach...  ...A LOT of time off   ~ MORE THAN ONE LANGUAGE…. We hire based on Sales Drive and Passion... 
    Language
    Full time
    Work at office
    Work from home

    Kevin Carruthers - Desjardins Insurance Agent

    Ottawa, ON
    12 days ago
  •  ...designated opening and closing procedures and provide support to fellow Team Members as needed. Support the team with additional...  ...evenings, weekends, and holidays. Fluency in English; French language skills considered an asset. What we bring to the table. At... 
    Part time
    Work at office
    Local area
    Afternoon shift

    Farm Boy Inc.

    Ottawa, ON
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Postdoctoral Fellow - Uncertainty Quantification And Calibration For Large Language Models. Be the first to apply!