This is the Linux app named Metaseq whose latest release can be downloaded as metaseqsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named Metaseq with OnWorks for free.
このアプリを実行するには、次の手順に従ってください。
-1。このアプリケーションをPCにダウンロードしました。
--2。ファイルマネージャーhttps://www.onworks.net/myfiles.php?username=XXXXXに必要なユーザー名を入力します。
-3。このアプリケーションをそのようなファイルマネージャにアップロードします。
-4。このWebサイトからOnWorksLinuxオンラインまたはWindowsオンラインエミュレーターまたはMACOSオンラインエミュレーターを起動します。
-5。起動したばかりのOnWorksLinux OSから、必要なユーザー名でファイルマネージャーhttps://www.onworks.net/myfiles.php?username=XXXXXにアクセスします。
-6。アプリケーションをダウンロードし、インストールして実行します。
スクリーンショットは
Ad
メタセック
DESCRIPTION
Metaseq is a flexible, high-performance framework for training and serving large-scale sequence models, such as language models, translation systems, and instruction-tuned LLMs. Built on top of PyTorch, it provides distributed training, model sharding, mixed-precision computation, and memory-efficient checkpointing to support models with hundreds of billions of parameters. The framework was used internally at Meta to train models like OPT (Open Pre-trained Transformer) and serves as a reference implementation for scaling transformer architectures efficiently across GPUs and nodes. It supports both pretraining and fine-tuning workflows with data pipelines for text, multilingual corpora, and custom tokenization schemes. Metaseq also includes APIs for evaluation, generation, and model serving, enabling seamless transitions from training to inference.
オプション
- Distributed training and inference for large-scale transformer models
- Support for model, data, and pipeline parallelism across multiple GPUs and nodes
- Mixed-precision training and memory-efficient checkpointing
- Pretraining and fine-tuning workflows for text and multilingual data
- APIs for text generation, evaluation, and serving large models
- Reference implementation for Meta’s OPT and other large language models
プログラミング言語
Python
カテゴリー
This is an application that can also be fetched from https://sourceforge.net/projects/metaseq.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
