Skip to content

Fix missing valid_sequence_lengths tensor from generation_config#322

Merged
wszczurekhabana merged 1 commit intoHabanaAI:habana-mainfrom
wszczurekhabana:vsl_fix
Jul 31, 2024
Merged

Fix missing valid_sequence_lengths tensor from generation_config#322
wszczurekhabana merged 1 commit intoHabanaAI:habana-mainfrom
wszczurekhabana:vsl_fix

Conversation

@wszczurekhabana
Copy link
Copy Markdown

This adds valid_sequence_lengths tensor to generation_config when the config is initialized as opposed to doing so after the initialization which could cause issues in some flows.

@wszczurekhabana wszczurekhabana merged commit 90426fb into HabanaAI:habana-main Jul 31, 2024
gplutop7 pushed a commit that referenced this pull request Oct 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants