Home › Software › LLMKube

LLMKube

Kubernetes operator for llama.cpp-native LLM inference with GPU scheduling, Apple Silicon Metal support, and OpenAI-compatible API. ([Source Code](https://github.com/defilantech/LLMKube))

Official Website

Go/Docker/K8S

Language

Apache-2.0

License

Similar Tools in Software

Stirling-PDF

★ 85,643

Local hosted web application that allows you to perform various operations on PDF files, such as merging, splitting, file conversions and OCR

Java NOASSERTION Software

code-server

★ 78,151

VS Code in the browser, hosted on a remote server

TypeScript MIT Software

Vaultwarden

★ 60,423

Lightweight Bitwarden server API implementation written in Rust

Rust/Docker GPL-3.0 Software

Huginn

★ 49,559

Build agents that monitor and act on your behalf

Ruby MIT Software

copyparty

★ 45,432

Portable file server with accelerated resumable uploads, deduplication, WebDAV, FTP, zeroconf, media indexer, video thumbnails, audio transcoding, and write-only folders, in a single file with no mandatory dependencies. ([Demo](https://a.ocv.me/pub/demo/))

Python MIT Software

TriliumNext Notes

★ 36,368

Cross-platform hierarchical note taking application with focus on building large personal knowledge bases (fork of Trilium Notes)

Nodejs/Docker/K8S AGPL-3.0 Software