Lists (1)
Stars
A high-throughput and memory-efficient inference and serving engine for LLMs
Model Context Protocol Servers
Minimal C# bindings for llama.cpp + .NET core library with API host/client.
{{ message }}
A high-throughput and memory-efficient inference and serving engine for LLMs
Model Context Protocol Servers
Minimal C# bindings for llama.cpp + .NET core library with API host/client.