Fidelity
Does the system reproduce a defensible human reference distribution or qualitative pattern?
Open registry · benchmark · methods
Synthetic research is moving faster than its evidence.
The Synthetic Research Index records what tools claim, what independent tests reproduce, and where human validation still changes the answer.
Evaluation frame / v0.2
Three measurements before any ranking.
Leaderboards compress uncertainty. We publish the component evidence first.
Reliability
Do repeated runs remain stable enough for the decision the research is meant to support?
Traceability
Can a reviewer inspect sources, assumptions, model configuration, and known limitations?
Registry / source review
Current records
aarusource review
Core buyer overlap
Aaru describes a multi-agent simulation and behavioural modelling platform that generates populations for prediction and decision support.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsnot established
askreplicassource review
Broader category
AskReplicas presents a platform for interviewing and surveying synthetic replicas built from demographic definitions or uploaded organizational data.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsconfirmed
beehive-synthetic-personassource review
Core buyer overlap
Beehive AI describes a workflow that turns customer data into generative-AI personas that teams can question and use to explore product, marketing, and customer-experience hypotheses.
Claimconfirmed
Artifactnot established
Methodnot established
Reproducednot established
Human ref.not established
Limitsnot established
ORDERING: ALPHABETICAL · NO FEATURED OR SPONSORED PLACEMENT
Benchmark protocol
A result without a reference frame is a demonstration, not validation.
The benchmark will compare system outputs with held-out human data, repeated runs, and decision-specific error tolerances. Every published score must remain traceable to its task, reference set, and protocol version.
Explore the benchmarkerror ↓
evidence depth →
AclaimBreviewedChuman ref.
Evidence library / open methods
Audit the field, the protocol, and us.
Evaluation guide
A claim-specific scientific framework with a downloadable validation record.
Index methodology
Evidence checks, review pipeline, uncertainty, non-comparability, and corrections.
Open benchmark
A public candidate protocol for held-out human reference testing; no result is claimed.
Minds registry record
The founder’s record is subject to a published recusal and unresolved evidence gaps.
Open call
Submit a tool, study, correction, or benchmark result.
Inclusion is free. Claims require sources. Commercial relationships are disclosed. Vendors receive correction rights, not editorial control.
Submit evidence