This is the Linux app named Mistral Finetune whose latest release can be downloaded as mistral-finetunev1.1.0sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Mistral Finetune with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
Mistral Finetune
DESCRIPTION:
mistral-finetune is an official lightweight codebase designed for memory-efficient and performant finetuning of Mistral’s open models (e.g. 7B, instruct variants). It builds on techniques like LoRA (Low-Rank Adaptation) to allow customizing models without full parameter updates, which reduces GPU memory footprint and training cost. The repo includes utilities for data preprocessing (e.g. reformat_data.py), validation scripts, and example YAML configs for training variants like 7B base or instruct models. It supports function-calling style datasets (via "messages" keys) as well as plain text formats, with guidelines on formatting, tokenization, and vocabulary extension (e.g. extending vocab to 32768 for some models) before finetuning. The project also provides tutorial notebooks (e.g. mistral_finetune_7b.ipynb) to walk through the steps.
Features
- LoRA-based finetuning to reduce memory usage and enable efficient adaptation
- Support for both plain text (“pretrain”) and “instruct” / conversational datasets
- Utilities to reformat and validate data (including reformat_data.py)
- Example YAML configs for Mistral 7B training variants
- Tutorials / notebooks to guide new users (e.g. 7B finetuning example)
- Guidance on vocabulary extension, tokenization, and model compatibility
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/mistral-finetune.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.