Replication package

The full Python pipeline that reproduces every number, on GitHub.

Replication package

Every number FAND publishes can be reproduced from public source data using the bundled Python pipeline. The package contains 128 builder scripts, organized as a 12-stage DAG, with SHA-256 checksums on every intermediate artifact and a MANIFEST file pinning the exact source-data snapshot used for each release.

Source code

The replication package is published on GitHub:

Repository: github.com/oconeco/fand-replication (URL provisional — to be confirmed before Phase 1 launch)

Tagged releases correspond to FAND publication snapshots. The latest tagged release is the canonical reference for any number cited on this site; the main branch tracks ongoing pipeline work.

What the package contains

How to run it

git clone https://github.com/oconeco/fand-replication.git
cd fand-replication
pip install -r requirements.txt
python run_all.py

Useful flags:

python run_all.py --national   # TL1 builders only (skip US subnational)
python run_all.py --list       # show stages without running
python run_all.py --stage 7    # run a single stage

Every script is idempotent. A full run on a modern laptop completes in tens of minutes; subsequent runs against the cached intermediate artifacts complete in seconds. The final stage prints a PASS/FAIL validation summary that an institutional reviewer can spot-check against the published numbers.

License

The replication package is released under the MIT License. The license applies to the pipeline code; the upstream source data remains governed by each agency’s own terms of use.

Where it sits in the architecture

The replication package is what gets handed to institutional reviewers. The public-facing summary lives here; the full source-code repository is the link above. For repository-level context on how the pipeline maps to the FAND data API, see the State of FAND briefing in context/raw/.