This is the Linux app named MobileLLM whose latest release can be downloaded as MobileLLMsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named MobileLLM with OnWorks for free.
Дотримуйтесь цих інструкцій, щоб запустити цю програму:
- 1. Завантажив цю програму на свій ПК.
- 2. Введіть у наш файловий менеджер https://www.onworks.net/myfiles.php?username=XXXXX із потрібним ім'ям користувача.
- 3. Завантажте цю програму в такий файловий менеджер.
- 4. Запустіть онлайн-емулятор OnWorks Linux або Windows або онлайн-емулятор MACOS з цього веб-сайту.
- 5. З ОС OnWorks Linux, яку ви щойно запустили, перейдіть до нашого файлового менеджера https://www.onworks.net/myfiles.php?username=XXXXX з потрібним іменем користувача.
- 6. Завантажте програму, встановіть її та запустіть.
ЕКРАНИ
Ad
MobileLLM
ОПИС
MobileLLM is a lightweight large language model (LLM) framework developed by Facebook Research, optimized for on-device deployment where computational and memory efficiency are critical. Introduced in the ICML 2024 paper “MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases”, it focuses on delivering strong reasoning and generalization capabilities in models under one billion parameters. The framework integrates several architectural innovations—SwiGLU activation, deep and thin network design, embedding sharing, and grouped-query attention (GQA)—to achieve a superior trade-off between model size, inference speed, and accuracy. MobileLLM demonstrates remarkable performance, with the 125M and 350M variants outperforming previous state-of-the-art models of the same scale by up to 4.3% on zero-shot commonsense reasoning tasks.
Функції
- Optimized transformer architecture for sub-billion parameter LLMs
- Combines SwiGLU activation, embedding sharing, and grouped-query attention
- Supports distributed multi-node pretraining with PyTorch ≥ 2.0
- Delivers state-of-the-art zero-shot reasoning results across multiple tasks
- Includes reproducible training and evaluation pipelines for multiple model sizes
- Scalable design philosophy extending from 125M to 1.5B parameters
Мова програмування
Python, оболонка Unix
Категорії
This is an application that can also be fetched from https://sourceforge.net/projects/mobilellm.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
