This is the Linux app named OpenVINO Model Server whose latest release can be downloaded as ovms_ubuntu24_python_off.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named OpenVINO Model Server with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
OpenVINO Model Server
DESCRIPTION
OpenVINO™ Model Server is a high-performance inference serving system designed to host and serve machine learning models that have been optimized with the OpenVINO toolkit. It’s implemented in C++ for scalability and efficiency, making it suitable for both edge and cloud deployments where inference workloads must be reliable and high throughput. The server exposes model inference via standard network protocols like REST and gRPC, allowing any client that speaks those protocols to request predictions remotely, abstracting away the complexity of where and how the model runs. It supports model deployment in diverse environments including Docker, bare-metal machines, and Kubernetes clusters, and is especially useful in microservices architectures where AI services need to scale independently. The system supports a wide range of model sources, letting you host models from local storage, remote object storage, or even pull from model hubs.
Features
- Serve optimized OpenVINO models over REST and gRPC
- Scales horizontally and vertically for production workloads
- Deploy across Docker, bare metal, and Kubernetes environments
- Support for models stored locally or in remote object storage
- Compatible with standard serving APIs (TensorFlow/KServe)
- Tools and demos for embeddings, genAI, and real-time use cases
Programming Language
C++
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/openvino-model-server.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
