| Need | Use |
|---|---|
| Live state right now | The real-time data API at data.simplefunctions.dev/v1. |
| Historical state, offline, batch | The public HuggingFace datasets below. |
Public HuggingFace datasets
All five datasets live under the SimpleFunctions organization. They are public —git clone and huggingface-cli download work without auth.
| Dataset | Contents | Cadence | Files |
|---|---|---|---|
SimpleFunctions/sf-index-history | SimpleFunctions Index time series across themes. | Daily | sf-index-history.jsonl |
SimpleFunctions/world-state-daily | Compact daily world snapshot — top markets, regime distribution, tail-risk roll-up. | Daily | YYYY-MM-DD.json |
SimpleFunctions/world-awareness-bench | Question / answer pairs measuring whether a model “knows the world”. | Periodic | benchmark_YYYY-MM-DD.json |
SimpleFunctions/settled-markets | Resolved markets with terminal state — for calibration and backtesting. | Monthly | YYYY-MM.jsonl |
SimpleFunctions/calibration-scorecards | Scoring of public theses and forecasts against settled outcomes. | Monthly | YYYY-MM.json |
Pull a file
Clone the whole dataset
Use from datasets
Live snapshots
For current state, hit the realtime data API:Provenance
Public exports include enough timestamp and source metadata to reconstruct the state that produced a public chart, answer, or backtest. Where a row carries a trace id, treat it as a support / audit handle, not as a public database schema. See Provenance.What is not exported
Internal storage, raw cron output, observability tables, and unsettled in-flight intents are not part of any public export. If you need a slice that is not on HuggingFace, open an issue or emailpatrick@simplefunctions.dev rather than assuming an internal path.
Next steps
Real-time data
REST and WebSocket for current market state.
Calibration
SimpleFunctions Index, regime, and calibration HTTP endpoints.