NISS Virtual Short Course Series: Prediction-Based Inference: Methods & Applications

Friday, August 28, 2026 - 12:00pm to 2:00pm ET

Overview 

Artificial intelligence and machine learning (AI/ML) have become essential tools in biomedical research, enabling large-scale analyses across diverse domains such as genomics, structural biology, and electronic health records-based research. Increasingly, researchers rely on model-generated predictions, rather than directly measured variables, as inputs for downstream statistical analyses. For example, predicted gene expression values or polygenic risk scores are often used in place of experimental assays, allowing researchers to expand cohort sizes and explore hypotheses when traditional data collection is infeasible, costly, or time-consuming.

While this practice of “using predictions as data” holds promise for accelerating scientific discovery, it presents significant challenges for statistical inference. When predicted values are used in place of true variables, the resulting estimates of association can be biased and misleading if uncertainty in the prediction step is not properly accounted for.


Instructors 

  • Jesse Gronsbell, PhD, University of Toronto
  • Jianhu Gao, MS, University of Toronto
  • Stephen Salerno, PhD, Fred Hutchinson Cancer Center

Workshop Goals and Objectives 

Learning Goals:

  • Understand limitations in using predicted data for inference.
  • Learn about methods that correct for bias and recover valid uncertainty estimates.
  • Gain practical skills using the ipd R package.

Learning Objectives:

  • Explore data with AI/ML-predicted outcomes and diagnose bias/variance in predictions.
  • Apply ipd::ipd() to continuous and binary outcomes.
  • Interpret prediction-based (PB) inference outputs and visualize model results.


About the Instructors 

Jesse Gronsbell, PhD, University of Toronto

Jianhu Gao, MS, University of Toronto

Stephen Salerno, PhD, Fred Hutchinson Cancer Center



 
Setup & Prerequisistes


Getting Started with the Workshop Materials

This page is a quick checklist to help you get set up before the session. If you’d like to follow along interactively during the workshop, these steps will make sure everything runs smoothly.


Quick Checklist (10-15 minutes) 

Complete these before the tutorial:

  • Confirm you have a stable internet connection and a laptop.
  • Choose your environment:
    • Recommended: Docker + browser-based RStudio
    • Alternative: local R/RStudio install
  • Verify ipd and core R packages install successfully (Option B only).


Prerequisites

You should be comfortable with:

  • Base R and tidyverse syntax (dplyrggplot2, basic pipes).
  • Basic regression modeling (lmglm).
  • Basic predictive modeling concepts (train/test split, predictions, model error).

Helpful but optional (for the supplemental modules):

  • Bioconductor familiarity (ExpressionSetAnnotationDbiMLInterfaces).


Software Requirements


Option B: Local R + RStudio

You need R 4.4.1 or newer.

Install:

 

 

 

 

Event Type

Host

NISS New Researchers Network

Cost

$35 Earlybird Admission
$50 General Admission
$15 NISS Affiliate Earlybird Admission
$25 Regular NISS Affiliate Admission
$25 Student Admission

Location

Virtual Short Course on Zoom
United States