OllamaClient

A client class for interacting with the Ollama REST API.

This class provides methods for text generation, chat interactions, and model management using std.net.curl for HTTP requests and std.json for JSON handling. Streaming is not fully supported in this version due to limitations in std.net.curl.

@safe

class OllamaClient {

this(string host);

void setTimeOut(Duration timeout);

JSONValue generate(string model, string prompt, JSONValue options, bool stream);

JSONValue chat(string model, Message[] messages, JSONValue options, bool stream);

string listModels();

string showModel(string model);

JSONValue createModel(string name, string modelfile);

JSONValue copy(string source, string destination);

JSONValue deleteModel(string name);

JSONValue pull(string name, bool stream);

JSONValue push(string name, bool stream);

string getVersion();

JSONValue chatCompletions(string model, Message[] messages, int maxTokens, float temperature, bool stream);

JSONValue completions(string model, string prompt, int maxTokens, float temperature, bool stream);

string getModels();

}

Constructors

this this(string host): Constructs a new Ollama client instance.

Members

Functions

chat JSONValue chat(string model, Message[] messages, JSONValue options, bool stream): Engages in a chat interaction using the specified model and message history.
chatCompletions JSONValue chatCompletions(string model, Message[] messages, int maxTokens, float temperature, bool stream): Performs an OpenAI-style chat completion.
completions JSONValue completions(string model, string prompt, int maxTokens, float temperature, bool stream): Performs an OpenAI-style text completion.
copy JSONValue copy(string source, string destination): Copies an existing model to a new name on the Ollama server.
createModel JSONValue createModel(string name, string modelfile): Creates a new model on the Ollama server using a modelfile.
deleteModel JSONValue deleteModel(string name): Deletes a model from the Ollama server.
generate JSONValue generate(string model, string prompt, JSONValue options, bool stream): Generates text based on a prompt using the specified model.
getModels string getModels(): Lists models in an OpenAI-compatible format.
getVersion string getVersion(): Retrieves the version of the Ollama server.
listModels string listModels(): Retrieves a list of available models from the Ollama server in a formatted JSON string.
pull JSONValue pull(string name, bool stream): Pulls a model from the Ollama server registry.
push JSONValue push(string name, bool stream): Pushes a model to the Ollama server registry.
setTimeOut void setTimeOut(Duration timeout): Sets the timeout duration for HTTP requests.
showModel string showModel(string model): Retrieves detailed information about a specific model in a formatted JSON string.

Examples

auto client = new OllamaClient();
auto chatResponse = client.chat("llama3", [Message("user", "Hi there!")]);
writeln(chatResponse["message"]["content"].str);

OllamaClient

Constructors

Members

Functions

Examples

Meta

Source