2 commits

Author	SHA1	Message	Date
Georgi Gerganov	d155f0f865	scripts : add script for measuring the time per token	2023-05-08 22:06:54 +03:00
Georgi Gerganov	f9a6364912	llama : require first token to be BOS (#1303) ... * llama : require first token to be BOS * scripts : add ppl-run-all.sh * perplexity : add BOS for each chunk * readme : update perplexity values after BOS fix * perplexity : add clarifying comments	2023-05-08 17:41:54 +03:00