This is the Linux app named GPUStack whose latest release can be downloaded as v2.0.3sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named GPUStack with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
GPUStack
DESCRIPTION:
GPUStack is an open-source GPU cluster management platform designed to simplify the deployment and operation of artificial intelligence models across heterogeneous hardware environments. The system aggregates GPU resources from multiple machines into a unified cluster so developers and administrators can run large language models and other AI workloads efficiently across distributed infrastructure. Instead of requiring complex orchestration systems such as Kubernetes, GPUStack provides a lightweight environment that automatically selects appropriate inference engines, configures deployment parameters, and schedules workloads across available GPUs. The platform supports GPUs from a wide range of vendors and can run on laptops, workstations, and servers across operating systems such as macOS, Windows, and Linux. It also enables developers to deploy models from common repositories like Hugging Face and access them through APIs similar to cloud-based AI services.
Features
- GPU cluster aggregation across heterogeneous hardware environments
- Distributed inference across single-node and multi-node GPU systems
- Support for multiple inference backends such as llama.cpp and vLLM
- OpenAI-compatible API endpoints for model serving
- Real-time monitoring of GPU utilization and token usage
- Model deployment workflows integrated with popular repositories
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/gpustack.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.