This is the Linux app named LiteRT-LM whose latest release can be downloaded as CLiteRTLM.xcframework.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named LiteRT-LM with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
LiteRT-LM
DESCRIPTION
LiteRT-LM is Google’s open-source inference framework for deploying large language models on edge devices. It is built for production-oriented local LLM execution across Android, iOS, desktop, web, embedded, and IoT environments. The framework focuses on performance, hardware acceleration, and efficient model serving close to the user instead of relying only on remote cloud inference. It supports CPU execution across major platforms and adds GPU or NPU acceleration where available. LiteRT-LM is especially relevant for developers building private, low-latency AI features on phones, laptops, Raspberry Pi-style devices, and other edge hardware. Its goal is to make modern language models usable in local applications with a consistent deployment stack.
Features
- Edge LLM inference
- Android, iOS, desktop, web, and IoT support
- CPU, GPU, and NPU acceleration
- Prebuilt binaries and mobile demos
- Production-ready deployment focus
- Local low-latency AI execution
Programming Language
C++
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/litert-lm.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
