Fidelity
Does the system reproduce a defensible human reference distribution or qualitative pattern?
Open registry · benchmark · methods
Synthetic research is moving faster than its evidence.
The Synthetic Research Index records what tools claim, what independent tests reproduce, and where human validation still changes the answer.
Evaluation frame / v0.2
Three measurements before any ranking.
Leaderboards compress uncertainty. We publish the component evidence first.
Reliability
Do repeated runs remain stable enough for the decision the research is meant to support?
Traceability
Can a reviewer inspect sources, assumptions, model configuration, and known limitations?
Registry / source review
Current records
aarusource review
Core buyer overlap
Aaru describes a multi-agent simulation and behavioural modelling platform that generates populations for prediction and decision support.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsnot established
askreplicassource review
Broader category
AskReplicas presents a platform for interviewing and surveying synthetic replicas built from demographic definitions or uploaded organizational data.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsconfirmed
buyertwinsource review
Core buyer overlap
BuyerTwin describes AI-powered buyer clones for buyer-alignment analysis and simulated feedback on messaging, sales, product, and market decisions.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsnot established
ORDERING: ALPHABETICAL · NO FEATURED OR SPONSORED PLACEMENT
Benchmark protocol
A result without a reference frame is a demonstration, not validation.
The benchmark will compare system outputs with held-out human data, repeated runs, and decision-specific error tolerances. Every published score must remain traceable to its task, reference set, and protocol version.
Explore the benchmarkerror ↓
evidence depth →
AclaimBreviewedChuman ref.
Open call
Submit a tool, study, correction, or benchmark result.
Inclusion is free. Claims require sources. Commercial relationships are disclosed. Vendors receive correction rights, not editorial control.
Submit evidence