llama.cpp/common
LeonEricsson 7082d24cec
lookup : add prompt lookup decoding example (#4484)
* initial commit, going through initializations

* main loop finished, starting to debug

* BUG: generates gibberish/repeating tokens after a while

* kv_cache management

* Added colors to distinguish drafted tokens (--color). Updated README

* lookup : fix token positions in the draft batch

* lookup : use n_draft from CLI params

* lookup : final touches

---------

Co-authored-by: Leon Ericsson <leon.ericsson@icloud.com>
Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-12-22 18:05:56 +02:00
..
base64.hpp llava : expose as a shared library for downstream projects (#3613) 2023-11-07 00:36:23 +03:00
build-info.cpp.in build : link against build info instead of compiling against it (#3879) 2023-11-02 08:50:16 +02:00
CMakeLists.txt build : fix build info generation and cleanup Makefile (#3920) 2023-12-01 00:23:08 +02:00
common.cpp common : remove incorrect --model-draft default (#4568) 2023-12-21 19:55:34 +02:00
common.h lookup : add prompt lookup decoding example (#4484) 2023-12-22 18:05:56 +02:00
console.cpp check C++ code with -Wmissing-declarations (#3184) 2023-09-15 15:38:27 -04:00
console.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
grammar-parser.cpp grammar-parser : fix typo (#4318) 2023-12-04 09:57:35 +02:00
grammar-parser.h gguf : new file format with flexible meta data (beta) (#2398) 2023-08-21 23:07:43 +03:00
log.h english : use typos to fix comments and logs (#4354) 2023-12-12 11:53:36 +02:00
sampling.cpp common : fix compile warning 2023-12-06 10:41:03 +02:00
sampling.h sampling : custom samplers order (#4285) 2023-12-05 12:05:51 +02:00
stb_image.h examples: support LLaVA v1.5 (multimodal model) (#3436) 2023-10-12 18:23:18 +03:00
train.cpp ggml : remove n_dims from ggml_tensor (#4469) 2023-12-14 16:52:08 +01:00
train.h sync : ggml (backend v2) (#3912) 2023-11-13 14:16:23 +02:00