Repository navigation
feat: default confidence 0.15 for Just-Bird - #30
Merged
Merged
Conversation
0.18 was set for the Streamlit slider in December 2025 for an older model and copied into the ONNX export, the docs demo and the Java example; the CLIs used 0.2. For the current Just-Bird the best IoU 0.5 micro F1 is at 0.13 to 0.14 on Hawaii val and 0.16 on Western-US val, and 0.15 is within 0.005 of the best on those and on the Southern Sierra Nevada hold-out. resolve_conf gives 0.15 for Just-Bird and keeps 0.2 for the other models in detect_birds.py, filter_and_merge_detections.py (from model_config), the Streamlit slider and onnx_export.py. The demo slider, the Java example and the default_conf metadata of docs/models/Just-Bird_fp16.onnx (graph unchanged) say 0.15. Pipeline step 3 uses the model default. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Why
The repo had three different confidence defaults, none of them tuned for the current Just-Bird:
onnx_export.py, the ONNX demo, the Java example and thedefault_confmetadata ofdocs/models/Just-Bird_fp16.onnx.detect_birds.py --conf,filter_and_merge_detections.py --conf, pipeline step 3.Micro F1 at IoU 0.5 from the phrase-gap study (BirdBox-Train
runs/Just-Bird/phrase_gap/):0.15 is within 0.005 of the best on every set. The threshold is chosen on the val sets; the SSN hold-out is the unseen-site test and is not used for tuning.
What
detect_birds.resolve_conf: 0.15 for Just-Bird, 0.2 (unchanged) for the other models, which were not part of this study.detect_birds.py --conf,filter_and_merge_detections.py --conf(frommodel_config.species_mapping), the Streamlit slider andonnx_export.py --conf. An explicit--confstill wins.docs/models/Just-Bird_fp16.onnx:default_confandinput_confmetadata 0.18 → 0.15, graph bytes unchanged..sh,.ps1,.bat) drops--conf 0.2and uses the model default. The old comment said 0.25.--confrows in detect-birds and filter-and-merge, the API page, the Just-Bird model page.Checks
detect_birds.pyontests/test.wav: Just-Bird default givesconf: 0.15inargs.yamland 131 boxes, the same as--conf 0.15. Hawaii gives 0.2.filter_and_merge_detections.pywithout--conf: 0.15 on a Just-Bird dump, 0.2 on a Western-US model dump;--conf 0.3is kept;--conf 1.5is rejected.AppTest: slider 0.15 for Just-Bird, 0.2 for Hawaii and Western-US, no exceptions.default_conf0.15 (Just-Bird), 0.2 (Hawaii).tests/onnx_graph_parity.pyon the updatedJust-Bird_fp16.onnx: conf 0.15 from the metadata, PASS (130 of 131 boxes, mean IoU 0.993).mkdocs build --strictpasses; the demo slider renders at 0.15..ps1and.bat(no PowerShell/CMD).🤖 Generated with Claude Code