b173ac82a9
- adapt meta-/code-/obs- rules to the local Python benchmark pipeline - replace db-sql-ddl, code-config-env-scope, test-e2e-pytest with pipeline equivalents - add code-python-style, data-determinism, data-naming-units, bench-methodology, build-pipeline-tasks - normalize specs and README typography to ASCII per code-data-formatting - rewrite root CLAUDE.md trigger table; add .cursorrules and .gitignore - specs: pipeline plan and task specs 00-11 - rules: 19 binding rule files adapted for this project - docs: CLAUDE.md rule-trigger table - config: .cursorrules commit convention, .gitignore excluding out/ and .venv/ - docs: rewrite README.md with pipeline diagrams, setup guide, result placeholders - config: requirements.txt for the closed dependency list - datagen: make_lab_config.py writes out/config/lab_config.yaml and .done marker
904 B
904 B
Task 11 — Export: JSON
Goal
Two JSON products from the frozen canonical snapshot.
Input
canonical/snapshot,schema/(Tasks 09–10).
Actions
- Write
scripts/export_json.py(streaming writer; never build the whole document in memory). - Mega-file
exports/json/dataset.json: full hierarchydata_note → batches → coupons(die) → samples → measurements → points, plus embeddeddata_dictionaryandinstruments. - Split set
exports/json/split/: directory mirrors the hierarchy; one file per measurement (points inline), plusindex.jsonper level. - Each measurement object carries its lineage block
{source_file, mapping_version, schema_version}.
Intermediate Result (done when)
- Both products written; spot-validation: point counts per measurement match canonical.
exports/json/EXPORT_MANIFEST.jsonwritten (snapshot id, versions, counts).