* Support special tokens and not adding BOS to prompt in speculative * Adapt to new should_add_bos function * Ensure tgt and dft have same add_bos setting |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
speculative.cpp |
* Support special tokens and not adding BOS to prompt in speculative * Adapt to new should_add_bos function * Ensure tgt and dft have same add_bos setting |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
speculative.cpp |