7448 AI · Methodology and sources
Where all of this comes from.
Every number traces to a public dataset or a published paper. Nothing is proprietary, and nothing was scraped from a source that did not intend to be read programmatically.
Data sources
Five public sources, nothing proprietary.
- Borenstein Lab curated microbiome-metabolome collectionTraining data: 14 cohorts where the same stool samples were both sequenced and run through mass spectrometry. 2,900 paired samples from 1,759 people, harmonised by the original curators.
- DisbiomeLiterature associations: curated records of which microbes published studies report elevated or reduced in which condition. 10,866 experimental observations across 375 conditions and 1,179 publications, with methodological-quality flags per study.
- KEGGMetabolite annotation: pathway membership and chemical classification. Reached through the documented REST API for the 967 target metabolites carrying a KEGG compound identifier.
- HMDBMetabolite identifiers: the naming scheme every target in this project is keyed on. Identifiers arrive via the Borenstein annotation files. HMDB's own site refuses scripted requests, so it is not queried directly; KEGG supplies the enrichment instead.
- PubMed / NCBI E-utilitiesCitations: resolving the publications behind each association. Queried through the official E-utilities API within NCBI's documented rate limits.
Evaluation
How the model is evaluated.
Split by person, not by sample. Six of the fourteen cohorts sampled the same individual repeatedly. Splitting at the sample level would put one person's Monday and Thursday samples on opposite sides of the train/test boundary, and the model would score well by recognising the person. Every split here assigns whole individuals.
Missing is not zero. Different cohorts ran different metabolomics panels, so a blank is usually "this lab did not measure that compound," not "the level was zero." Each metabolite is therefore trained only on the samples where it was genuinely measured, tracked by an explicit mask.
Accuracy travels with every prediction. Each metabolite carries the correlation it achieved on held-out patients, shown next to the value, always, because 185 of 1098 metabolites are predicted poorly, and rendering those identically to the good ones would be the single most misleading thing this interface could do.
Known limitations
Specific, so they can be acted on.
Batch confounding is severe. Each cohort studied one disease on one platform, so disease status and laboratory are nearly inseparable. The consequence is quantified on Inside the model: a classifier using only cohort identity nearly matches one using the actual biology.
Association is not causation, and group is not individual. A microbe reported reduced in a condition across a population says nothing about why, and nothing about any one person. Both directions of causality are plausible for most of these findings, and many are likely downstream of diet or medication.
Composition only, no function. The model sees which bacteria are present, not which genes they are expressing. Two communities with identical membership can behave differently. Functional profiling would likely improve accuracy and is the clearest next step.
Genus-level resolution. Only six cohorts have species-level data, so the common feature space stops at genus. Meaningful differences exist below that level; E. coli strains range from harmless to dangerous.
Cohorts are not representative. The source studies skew toward particular geographies, ages and diets. A profile from an under-represented population will be compared against a reference that does not describe it well.
Privacy
Nothing you enter leaves your browser.
On this site the model runs entirely in your browser. The simulator and outlook download a fixed model snapshot once, and every prediction is computed on your device. Nothing you enter is sent to a server, stored, or logged, and no cookies or accounts are involved.
The model is also fixed: it does not learn from anything visitors do. That is what makes the transparency page meaningful: the model you can inspect is exactly the model that answered you.
Review
See a flaw in the method?
Corrections, critiques and replication attempts are welcome. Tell us what you found and we will reply with what we changed, or why we did not.