On 1/5/24 12:32, Sam Hartman wrote:
Also, I thought that there were several open-source implementations of this API, including from llama.cpp and ctransformers among others. My impression was the OpenAI API had become kind of a standard for gluing something like text-generation-webui to a hosted model not running locally. Or is that some *different* OpenAI API?
You are correct. The OpenAI API spec is already a de-facto standard in this area. Every alternative will try to provide the same set of API.