Skip to content

docs(leaderboard): Design the leaderboard for showcasing benchmark data #45

Description

@christian-pinto

Description

The design of the leaderboard must answer the below questions, providing details for driving the actual implementation

  • How to visually present the data to users.
  • Can model owners modify their leaderboard view?
  • How do we decide which data goes in the leaderboard? How often (e.g., every release) and which data
  • Where do we host the leaderboard and how does it access the benchmarking data.
  • Do we have a leaderboard per Model? Comparing the same across releases or do we also compare models over common metrics?

Outcome

A design document clearly describing the details of how to implement the leaderboard. To be committed to the repository.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions