RetroCast: A Unified Framework for Multistep Retrosynthesis¶
RetroCast is a comprehensive toolkit for standardizing, scoring, and analyzing multistep retrosynthesis models. It decouples prediction from evaluation, enabling rigorous, apples-to-apples comparison of disparate algorithms on a unified playing field.
The Problem¶
The field of retrosynthesis evaluation is fragmented:
- Incompatible Outputs: AiZynthFinder outputs bipartite graphs; Retro* outputs precursor maps; DirectMultiStep outputs recursive dictionaries. Comparing them requires bespoke parsers for every paper.
- Ad-Hoc Metrics: "Solvability" is calculated differently across publications, with varying stock definitions (e.g., made-to-order libraries vs. actual off-the-shelf compounds).
- Flawed Benchmarks: Standard datasets are heavily skewed (74% of PaRoutes routes are length 3-4), masking performance failures on complex targets.
RetroCast solves this. It provides a canonical schema, adapters for 10+ models, and a rigorous statistical pipeline to turn retrosynthesis from a qualitative art into a quantitative science.
Key Features¶
- Universal Adapters: Translation layers for AiZynthFinder, Retro*, DirectMultiStep, SynPlanner, Syntheseus, ASKCOS, RetroChimera, DreamRetro, MultiStepTTL, SynLlama, and PaRoutes.
- Canonical Schema: All routes cast into a strict, recursive
Molecule/ReactionStepPydantic model. - Curated Benchmarks: Reference Series (algorithm comparison) and Market Series (practical utility), stratified by route length and topology.
- Rigorous Statistics: Built-in bootstrapping (95% CI), pairwise tournaments, and probabilistic ranking.
- Reproducibility: Every artifact tracked via cryptographic manifests (
SHA256).
Installation¶
We recommend using uv for fast, reliable dependency management:
If you don't have uv, install it in one minute:
Getting Started¶
New to RetroCast? Start here:
- Quick Start - Get from raw model output to a statistical report in 5 minutes
- Concepts - Understand the architecture and philosophy
- CLI Reference - Full command documentation
- Python Library - Integrate RetroCast into your research pipelines
Benchmarks¶
RetroCast introduces two benchmark series derived from PaRoutes:
Reference Series (ref-)¶
For algorithm developers
| Benchmark | Targets | Description |
|---|---|---|
| ref-lin-600 | 600 | Linear routes stratified by length (100 each for lengths 2–7) |
| ref-cnv-400 | 400 | Convergent routes stratified by length (100 each for lengths 2–5) |
| ref-lng-84 | 84 | All available routes of extreme length (8–10 steps) |
Market Series (mkt-)¶
For practical utility
| Benchmark | Targets | Description |
|---|---|---|
| mkt-lin-500 | 500 | Linear routes solvable with commercial buyables (stratified) |
| mkt-cnv-160 | 160 | Convergent routes solvable with commercial buyables (stratified) |
See Benchmarks Guide for details.
Get Publication Data¶
Reproducible Artifacts
The complete data/ folder with benchmarks, stocks, raw predictions, processed routes, scores, and results is available at files.ischemist.com/retrocast/publication-data.
Download all benchmark definitions:
Verify integrity against manifests:
Visualization: SynthArena¶
RetroCast powers SynthArena, an open-source platform for visualizing and comparing retrosynthetic routes.
- Compare predictions from any two models side-by-side
- Visualize ground truth vs. predicted routes with diff overlays
- Inspect stratified performance metrics interactively
Citation¶
If you use RetroCast in your research, please cite: arXiv:2512.07079
@misc{retrocast,
title = {Procrustean Bed for AI-Driven Retrosynthesis: A Unified Framework for Reproducible Evaluation},
author = {Anton Morgunov and Victor S. Batista},
year = {2025},
eprint = {2512.07079},
archiveprefix = {arXiv},
primaryclass = {cs.LG},
url = {https://arxiv.org/abs/2512.07079}
}
Vision: Structural AI for Chemistry¶
We distinguish between two fundamental classes of problems in scientific machine learning: quantitative (predicting scalar targets like toxicity or binding affinity) and structural (generating complex objects governed by an underlying grammar). Quantitative problems, analogous to early NLP challenges like sentiment analysis, are often constrained by data scarcity. In contrast, the most transformative AI breakthroughs—from large language models to AlphaFold—have occurred in structural domains.
Mastery of structure is a prerequisite for solving downstream quantitative tasks. Foundation models trained on the structure of language, for instance, now excel at sentiment analysis with little to no task-specific fine-tuning. In organic chemistry, the paramount structural challenge is retrosynthesis: designing a valid synthetic pathway to a molecule of interest. This capability is the key to unlocking critical quantitative problems like predicting synthetic accessibility, a significant bottleneck in drug discovery. Current accessibility heuristics, however, bypass the core structural challenge, relying on learned patterns that correlate with accessibility without ever generating the pathway itself.
A model cannot judge the difficulty of a journey it cannot first articulate.
Achieving structural mastery in retrosynthesis is a long journey—one that requires moving beyond fragmented data formats, inconsistent evaluation methods, and unreliable metrics. Progress demands unified, rigorous infrastructure to standardize outputs, track provenance, and measure improvements with statistical rigor.
RetroCast is that infrastructure.
License¶
MIT License. See LICENSE for details.