Files
LabDataStorageEvaluation/docs/specs_old/02_fs_inventory.md
administrator b173ac82a9 fix(docs): fix formatting issues in README.md
- adapt meta-/code-/obs- rules to the local Python benchmark pipeline
- replace db-sql-ddl, code-config-env-scope, test-e2e-pytest with pipeline equivalents
- add code-python-style, data-determinism, data-naming-units, bench-methodology, build-pipeline-tasks
- normalize specs and README typography to ASCII per code-data-formatting
- rewrite root CLAUDE.md trigger table; add .cursorrules and .gitignore
- specs: pipeline plan and task specs 00-11
- rules: 19 binding rule files adapted for this project
- docs: CLAUDE.md rule-trigger table
- config: .cursorrules commit convention, .gitignore excluding out/ and .venv/
- docs: rewrite README.md with pipeline diagrams, setup guide, result placeholders
- config: requirements.txt for the closed dependency list
- datagen: make_lab_config.py writes out/config/lab_config.yaml and .done marker
2026-07-11 13:39:13 -04:00

828 B

Task 02 — Filesystem Inventory

Goal

Non-destructive inventory of every file under SOURCE_ROOT.

Input

  • work/config/pipeline.json (Task 01).

Actions

  1. Write scripts/fs_inventory.py (streaming walk, constant memory).
  2. For each file capture: relative path, path components (folder tokens), filename, extension, size bytes, mtime (ISO), sha-free quick id (path hash).
  3. Emit manifest/inventory.jsonl (one JSON object per file) and load an index copy into manifest/manifest.sqlite table inventory.
  4. Emit manifest/inventory_summary.md: file count, total size, count by extension, count and size by top-level folder, depth histogram.

Intermediate Result (done when)

  • inventory.jsonl row count == filesystem file count.
  • inventory_summary.md produced; non-CSV extensions listed explicitly.