Check params like use_greedy and repetition_penalty for NemoQueryLLMPyTorch class #434

Open

Assignees

Labels

opened

Describe the bug

The params below don't work;

use_greedy=True,
repetition_penalty=1.0

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

oyilmaz-nvidia

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests