This is the Linux app named whichllm whose latest release can be downloaded as v0.5.15sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named whichllm with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
whichllm
DESCRIPTION
whichllm is a command-line tool for finding local large language models that can realistically run on a user’s hardware. It detects the machine’s available resources, including GPU, CPU, memory, and storage, then recommends models based on practical fit rather than parameter count alone. The project is useful for users who are unsure which local LLM will perform well on their system. It focuses on real, recency-aware benchmarks so recommendations better reflect current model performance. whichllm is especially helpful for developers, AI hobbyists, and researchers comparing local inference options across NVIDIA, AMD, Apple Silicon, and CPU-only environments. Its main value is reducing guesswork when choosing a local model to download and run.
Features
- Local LLM recommendation CLI
- Hardware detection workflow
- GPU, CPU, RAM, and disk awareness
- Recency-aware benchmark ranking
- NVIDIA, AMD, and Apple Silicon support
- Python 3.11 or higher requirement
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/whichllm.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
