This is the Linux app named qvac-fabric-llm.cpp whose latest release can be downloaded as llama-b7336-bin-macos-arm64.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named qvac-fabric-llm.cpp with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
qvac-fabric-llm.cpp
DESCRIPTION
qvac-fabric-llm.cpp is a cross-platform large language model inference and fine-tuning engine built as an advanced fork of llama.cpp, designed to run efficiently across desktops, mobile devices, and heterogeneous GPU environments. The project focuses on removing hardware limitations traditionally associated with LLM deployment by enabling support for a wide range of backends, including Vulkan, Metal, CUDA, and CPU, making it accessible on devices ranging from smartphones to enterprise servers. It introduces native LoRA fine-tuning capabilities that can be executed directly on consumer hardware, allowing developers to train and adapt models locally without relying on cloud infrastructure. A key innovation is its support for BitNet ternary quantized models, enabling highly efficient inference and training even on resource-constrained systems.
Features
- Cross-platform LLM inference and fine-tuning across CPU, Vulkan, Metal, and CUDA
- Native LoRA fine-tuning on consumer hardware including mobile devices
- Support for BitNet ternary quantized models for efficient inference
- Memory-based model loading for streaming and embedded deployments
- Optimizations for mobile GPUs such as Adreno with improved throughput
- Compatibility with GGUF models and llama.cpp ecosystem
Programming Language
C++
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/qvac-fabric-llm-cpp.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
