This is the Linux app named HRM-Text whose latest release can be downloaded as HRM-Textsourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named HRM-Text with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
HRM-Text
DESCRIPTION
HRM-Text is a one-billion-parameter text generation model and pretraining framework based on the Hierarchical Reasoning Model architecture. It is designed to make foundation model pretraining more accessible by reducing compute and data requirements compared with traditional scaling-heavy approaches. The system combines hierarchical recurrent design, task-completion strengthening, and latent-space reasoning. Its training stack includes PrefixLM sequence packing, FlashAttention 3 kernels, PyTorch FSDP2, evaluation scripts, and checkpoint conversion tools. The repository supports reference pretraining runs for smaller and larger configurations, with Hopper-class GPUs expected for the attention path. It is useful for researchers and engineers exploring efficient language model pretraining, reasoning-focused architectures, and reproducible foundation model experiments.
Features
- Hierarchical recurrent model architecture
- One-billion-parameter text generation model
- Efficient pretraining framework
- PrefixLM sequence packing
- FlashAttention 3 training path
- Evaluation and checkpoint conversion tools
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/hrm-text.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
