llama.cpp/common
Georgi Gerganov 921772104b
speculative : add grammar support (#2991)
* speculative : add grammar support

* grammars : add json_arr.gbnf

* grammar : add comments to new grammar file

* grammar : remove one nested level

* common : warm-up with 2 tokens - seems to work better

* speculative : print draft token pieces

* speculative : reuse grammar parser + better logs and comments

* speculative : avoid grammar_mem

* make : fix speculative build
2023-09-05 08:46:17 +03:00
..
CMakeLists.txt gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
common.cpp speculative : add grammar support (#2991) 2023-09-05 08:46:17 +03:00
common.h build : on Mac OS enable Metal by default (#2901) 2023-09-04 22:26:24 +03:00
console.cpp build : fix most gcc and clang warnings (#2861) 2023-09-01 16:34:50 +03:00
console.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
grammar-parser.cpp gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
grammar-parser.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
log.h logging: Fix creating empty file even when disabled (#2966) 2023-09-02 11:53:55 -06:00