This is the Linux app named TurboFieldfare whose latest release can be downloaded as TurboFieldfare0.3--Apple10Long-ContextPrefillsourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named TurboFieldfare with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
TurboFieldfare
DESCRIPTION
TurboFieldfare is a custom Swift and Metal runtime for running the instruction-tuned Gemma 4 26B-A4B model on Apple Silicon Macs with limited memory. Instead of loading the entire model, it keeps the shared core and KV cache in RAM while streaming only the routed experts required for each token from SSD. This approach reduces active memory use to roughly 2 GB while the installed model occupies about 14.3 GB of storage. The project includes a native Mac application, command-line tools, a streaming installer, a Swift library, and an experimental OpenAI-compatible local server. Quantized weights, custom Metal kernels, chunked prefill, and a bounded expert cache improve efficiency. The installer downloads and repacks model ranges without staging a second full checkpoint. Its current scope is text-only Gemma inference on macOS 26 and Apple Silicon hardware.
Features
- SSD-backed mixture-of-experts streaming
- Approximately 2 GB active memory use
- Custom Swift and Metal inference runtime
- Native Mac app and command-line interface
- OpenAI-compatible local chat server
- Streaming model installation and verification
Programming Language
Swift
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/turbofieldfare.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
