This is the Linux app named Mistral Finetune whose latest release can be downloaded as mistral-finetunev1.1.0sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Mistral Finetune with OnWorks for free.
Segui queste istruzioni per eseguire questa app:
- 1. Scaricata questa applicazione sul tuo PC.
- 2. Entra nel nostro file manager https://www.onworks.net/myfiles.php?username=XXXXX con il nome utente che desideri.
- 3. Carica questa applicazione in tale file manager.
- 4. Avviare l'emulatore online OnWorks Linux o Windows online o l'emulatore online MACOS da questo sito Web.
- 5. Dal sistema operativo OnWorks Linux che hai appena avviato, vai al nostro file manager https://www.onworks.net/myfiles.php?username=XXXXX con il nome utente che desideri.
- 6. Scarica l'applicazione, installala ed eseguila.
IMMAGINI
Ad
Mistral Finetune
DESCRIZIONE
mistral-finetune is an official lightweight codebase designed for memory-efficient and performant finetuning of Mistral’s open models (e.g. 7B, instruct variants). It builds on techniques like LoRA (Low-Rank Adaptation) to allow customizing models without full parameter updates, which reduces GPU memory footprint and training cost. The repo includes utilities for data preprocessing (e.g. reformat_data.py), validation scripts, and example YAML configs for training variants like 7B base or instruct models. It supports function-calling style datasets (via "messages" keys) as well as plain text formats, with guidelines on formatting, tokenization, and vocabulary extension (e.g. extending vocab to 32768 for some models) before finetuning. The project also provides tutorial notebooks (e.g. mistral_finetune_7b.ipynb) to walk through the steps.
Caratteristiche
- LoRA-based finetuning to reduce memory usage and enable efficient adaptation
- Support for both plain text (“pretrain”) and “instruct” / conversational datasets
- Utilities to reformat and validate data (including reformat_data.py)
- Example YAML configs for Mistral 7B training variants
- Tutorials / notebooks to guide new users (e.g. 7B finetuning example)
- Guidance on vocabulary extension, tokenization, and model compatibility
Linguaggio di programmazione
Python
Categorie
This is an application that can also be fetched from https://sourceforge.net/projects/mistral-finetune.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
