llama.cpp/examples/batched.swift/README.md

106 B

This is a swift clone of examples/batched.

$ make $ ./batched_swift MODEL_PATH [PROMPT] [PARALLEL]