This is the Linux app named Colibrì whose latest release can be downloaded as colibrisourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Colibrì with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
Colibrì
DESCRIPTION:
Colibri is a compact inference engine designed to run the 744-billion-parameter GLM-5.2 mixture-of-experts model on consumer hardware. It keeps the dense portion of the quantized model in memory while streaming routed experts from a large disk-based store as they are needed. The runtime is implemented in pure C, requires no Python or BLAS during inference, and can operate without a GPU. Compressed attention caches, expert caching, optional hot tiers, and speculative decoding reduce memory pressure and improve repeated use. A planning tool calculates safe disk, RAM, and VRAM placement before loading the model, while a diagnostic command checks system readiness. Colibri includes terminal chat, an OpenAI-compatible text API, and a browser client, but disk-bound generation can be slow on cold caches.
Features
- GLM-5.2 inference on consumer hardware
- Disk-streamed mixture-of-experts architecture
- Dependency-free pure C inference runtime
- Compressed KV cache and expert caching
- Automatic RAM and VRAM placement planning
- Terminal chat and OpenAI-compatible API
Programming Language
C
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/colibr.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.