haraldwolff/llama.cpp
1
0
Fork 0
Code Issues Pull requests Packages Projects Releases Wiki Activity
llama.cpp/examples/batched.swift
History
eastriver 2568a4bf54
main.swift : fix eos checking (#4197) 
llama_token_eos(const struct llama_model *) is currently getting struct llama_context type variable context as a parameter.
2023-11-24 11:25:10 +02:00
..
Sources main.swift : fix eos checking (#4197) 2023-11-24 11:25:10 +02:00
.gitignore examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Makefile examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Package.swift examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
README.md examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00

README.md

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]