replica
/
llama.cpp
mirror of https://github.com/ggml-org/llama.cpp.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
868 Commits 472 Branches 4,051 Tags 562 MiB
Commit Graph

1 Commits

Author SHA1 Message Date
jwj7140 f257fd2550
Add an API example using server.cpp similar to OAI. (#2009) 
* add api_like_OAI.py
* add evaluated token count to server
* add /v1/ endpoints binding
 2023-07-04 21:06:12 +03:00