Skip to content

Release PhotoFlow agent and VPhotoBench dataset on Hugging Face#1

Description

@NielsRogge

Hi @Zuica96 馃

Niels here from the open-source team at Hugging Face. I discovered your work through Hugging Face's daily papers as yours got featured: https://huggingface.co/papers/2605.23771.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models, datasets or demo for instance), you can also claim
the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

I saw from your GitHub repository (https://github.com/Visionary-Laboratory/PhotoFlow) that you're planning to release the PhotoFlow agent code and the VPhotoBench dataset. That's fantastic news!

It'd be great to make these artifacts available on the 馃 hub, to improve their discoverability/visibility once they are released.
We can add tags so that people find them when filtering https://huggingface.co/models and https://huggingface.co/datasets.

Uploading models (PhotoFlow agent)

See here for a guide: https://huggingface.co/docs/hub/models-uploading.

In this case, the PhotoFlow agent, which involves an AI controlling camera parameters in a 3D scene based on language, could leverage the PyTorchModelHubMixin class which adds from_pretrained and push_to_hub to any custom nn.Module. Alternatively, one can leverages the hf_hub_download one-liner to download a checkpoint from the hub. A fitting pipeline tag for such an agent would be robotics.

We encourage researchers to push each model checkpoint to a separate model repository, so that things like download stats also work. We can then also link the checkpoints to the paper page.

Uploading dataset (VPhotoBench)

Would be awesome to make the VPhotoBench dataset available on 馃 , so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/loading. This dataset, comprising Blender scenes and language-conditioned photography missions for agent evaluation, would fit well under the robotics task category.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

Let me know if you're interested/need any help regarding this, once your release is ready!

Cheers,

Niels
ML Engineer @ HF 馃

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions