Skip to content

Spatial grounding评测和论文不对齐 #20

Description

@william-ljz

hi作者好,我本地测了一下onethinker-8B在refcoco的testA的结果, 和论文严重对不齐,我这边测出来和论文差了六个点, 不知道是不是因为你拼出个代码传错了呢:
"metrics": {
"overall/acc": 0.8578746369447338,
"spatial grounding/acc": 0.8578746369447338,
"spatial grounding/iou/mean": 0.8578746369447338,
"spatial grounding/iou/R@0.3": 0.9598727240586884,
"spatial grounding/iou/R@0.5": 0.9372458900477285,
"spatial grounding/iou/R@0.7": 0.8845677921159625

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions