Skip to content

The inference of the initial frame relies too heavily on reference images. #68

Description

@Zhenghao97

Hello, author, thank you for your outstanding work.

I would like to raise a question: during local deployment, I noticed that in the inference phase, the world model is excessively dependent on the initial reference image. Without this image, the reconstruction results are considerably poor. Doesn't this limitation restrict the applicability of the algorithm itself?

Additionally, given that reference images are finite while layouts are infinite, there may inevitably be cases where the reference images cannot align perfectly with the layouts—such as in road structures, for example. Could this potentially introduce spatial inconsistency issues?

Looking forward to your response!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions