llama.cpp/examples/batched.swift/README.md

98 B

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]