Overview
Artificial intelligence and machine learning (AI/ML) have become essential tools in biomedical research, enabling large-scale analyses across diverse domains such as genomics, structural biology, and electronic health records-based research. Increasingly, researchers rely on model-generated predictions, rather than directly measured variables, as inputs for downstream statistical analyses. For example, predicted gene expression values or polygenic risk scores are often used in place of experimental assays, allowing researchers to expand cohort sizes and explore hypotheses when traditional data collection is infeasible, costly, or time-consuming.
While this practice of “using predictions as data” holds promise for accelerating scientific discovery, it presents significant challenges for statistical inference. When predicted values are used in place of true variables, the resulting estimates of association can be biased and misleading if uncertainty in the prediction step is not properly accounted for.
Instructors
- Jesse Gronsbell, PhD, University of Toronto
- Jianhu Gao, MS, University of Toronto
- Stephen Salerno, PhD, Fred Hutchinson Cancer Center
Workshop Goals and Objectives
Learning Goals:
- Understand limitations in using predicted data for inference.
- Learn about methods that correct for bias and recover valid uncertainty estimates.
- Gain practical skills using the
ipdR package.
Learning Objectives:
- Explore data with AI/ML-predicted outcomes and diagnose bias/variance in predictions.
- Apply
ipd::ipd()to continuous and binary outcomes. - Interpret prediction-based (PB) inference outputs and visualize model results.
About the Instructors
Jesse Gronsbell, PhD, University of Toronto
Jianhu Gao, MS, University of Toronto
Stephen Salerno, PhD, Fred Hutchinson Cancer Center
Getting Started with the Workshop Materials
This page is a quick checklist to help you get set up before the session. If you’d like to follow along interactively during the workshop, these steps will make sure everything runs smoothly.
Quick Checklist (10-15 minutes)
Complete these before the tutorial:
- Confirm you have a stable internet connection and a laptop.
- Choose your environment:
- Recommended: Docker + browser-based RStudio
- Alternative: local R/RStudio install
- Verify
ipdand core R packages install successfully (Option B only).
Prerequisites
You should be comfortable with:
- Base
Randtidyversesyntax (dplyr,ggplot2, basic pipes). - Basic regression modeling (
lm,glm). - Basic predictive modeling concepts (train/test split, predictions, model error).
Helpful but optional (for the supplemental modules):
- Bioconductor familiarity (
ExpressionSet,AnnotationDbi,MLInterfaces).
Software Requirements
Install Docker Desktop: Then run: Open: You need Install:
Option A (Recommended): Docker Workshop Environment
docker run -e PASSWORD=<your_chosen_password> -p 8787:8787 ghcr.io/salernos/ipd-workshop:latest
http://localhost:8787/rstudio, password = <your_chosen_password>
Option B: Local R + RStudio
R 4.4.1 or newer.
Event Type
- NISS Hosted
