Service that offers ONLY OpenAI completion endpoint. Note that this trait is usable
also for OpenAI-API-compatible services such as FastChat, Ollama, or OctoML.
Creates a completion for the provided prompt and parameters.
Creates a completion for the provided prompt and parameters.
Attributes
prompt
The prompt(s) to generate completions for, encoded as a string, array of strings, array
of tokens, or array of token arrays. Note that <|endoftext|> is the document separator
that the model sees during training, so if a prompt is not specified the model will
generate as if from the beginning of a new document.