Skip to content

data: BAFU:2026 v1 full inventory (11,947 processes, 420,063 exchanges, 11 sectors) - #2

Merged
lbougan merged 4 commits into
mainfrom
import/bafu-2026
Aug 8, 2026
Merged

lbougan merged 4 commits into
mainfrom
import/bafu-2026

Conversation

@lbougan

@lbougan lbougan commented Aug 7, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds the complete BAFU:2026 v1 LCI database as sector-partitioned parquet, generated by the bafu source family in sentier-importers (spec: sentier-importers/docs/specs/2026-08-01-bafu-2026-import.md):

  • Fills the three existing sectors (01-agriculture, 02-electricity, 03-chemicals) and adds 04-transport … 10-building-services plus 99-obsolete (wholly-obsolete BAFU categories quarantined but kept — live processes link into them)
  • processes.parquet / exchanges.parquet per sector conform to schema/process.yaml / schema/exchange.yaml unchanged
  • exchanges.flow: technosphere links resolve to process UUIDs (0 unresolved of 114,369); elementary flows use the published deterministic uuid5 recipe, identical to the BAFU flow terms in sentier-vocab — vocabulary and inventory are joinable by construction
  • metadata.json per sector regenerated (row_counts, provenance, ToU §2.3 citation)

These payloads were regenerated locally and held back from public git until BAFU's written §2.2 redistribution consent; they now ship as a normal data PR. Companion vocab PR: sentier-dev/sentier-vocab#31.

Citation: Life Cycle Inventory database of the Swiss Federal Administration, BAFU:2026.

Test plan

  • Totals match the import spec's measured profile: 11,947 processes; 420,063 exchanges (11,947 production + 114,369 technosphere + 293,747 biosphere)
  • Every sector's metadata.json row_counts match actual parquet row counts
  • All metadata.json validate against schema/metadata.schema.json
  • Largest file 1.5 MB — far under the 50 MB per-file guard, no sharding needed

lbougan added 4 commits August 7, 2026 15:32
…s, 11 sectors)

Adds the complete BAFU:2026 v1 LCI database as sector-partitioned
processes/exchanges parquet, generated by the sentier-importers bafu
source family:

- fills the existing 01-agriculture, 02-electricity, 03-chemicals
  sectors and adds 04-transport through 10-building-services plus the
  99-obsolete quarantine sector (wholly-obsolete categories kept as
  technosphere link targets)
- exchanges.flow uses process UUIDs for technosphere links (0
  unresolved) and the published uuid5 recipe for elementary flows,
  matching the BAFU terms delivered to sentier-vocab
- metadata.json per sector regenerated with row_counts and the ToU
  §2.3 citation

Source: Life Cycle Inventory database of the Swiss Federal
Administration, BAFU:2026.
Mirrors the sentier-mappings pattern: a self-contained scripts/validate.py
run by a single CI job. Per data/<NN>-<sector>/ folder it checks
metadata.json (JSON Schema + row_counts vs actual), parquet columns
against schema/process.yaml + schema/exchange.yaml (unknown columns,
required non-null, types, enum values), process_id uniqueness, and the
exchanges -> processes foreign key. All-null optional columns pass the
type check; optional columns may be omitted.
Drops the 'BAFU:2026 v1 datasets, regenerated locally' phrasing — which
source supplied which rows is not recorded in this repo (see README);
only the ToU §2.3 citation stays.
@lbougan

lbougan commented Aug 7, 2026

Copy link
Copy Markdown
Contributor Author

Format review applied (2026-08-07): this repo already follows the platform delivery rule — payloads split per sector folder, size-limited files, no source-named data files. Only change needed was trimming the sector metadata descriptions to the bare ToU §2.3 citation (d47c427). The companion vocab delivery was restructured to the same rule (per-sector process files, per-compartment flow files) and amended into the merged sentier-vocab commit bbe6ee4.

@lbougan lbougan self-assigned this Aug 8, 2026
@lbougan
lbougan merged commit e0a2d3f into main Aug 8, 2026
2 checks passed
@lbougan
lbougan deleted the import/bafu-2026 branch August 8, 2026 15:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant