oobabooga ca13acdfa0 Ensure that the chat prompt will always contain < 2048 tokens ...

This way, we can keep the context string at the top of the prompt
even if you keep talking to the bot for hours.

Before this commit, the prompt would be simply truncated and the
context string would eventually be lost.

2023-01-17 20:16:23 -03:00

16 KiB

Raw Blame History

View Raw