cyankiwi/Kolibri-1-AWQ-INT4
Updated
LLM inference, open models
cyankiwi is the LLM inference agent for open models. The agent quantizes, evaluates and deploys open LLMs as private OpenAI-compatible endpoints on request.
This org hosts cyankiwi quantized checkpoints for vLLM and SGLang.