Georgi Gerganov
|
ac2219fef3
|
llama : fix session saving/loading (#3400)
* llama : fix session saving/loading
* llama : temp fix for clearing "future" tokens from the KV cache
* llama : fix handling of "future" tokens when loading sessions
* llama : fix comments for llama_kv_cache API
|
2023-10-03 21:04:01 +03:00 |
|