This is the Linux app named LLMs-from-scratch whose latest release can be downloaded as LLMs-from-scratchsourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named LLMs-from-scratch with OnWorks for free.
Следуйте этим инструкциям, чтобы запустить это приложение:
- 1. Загрузил это приложение на свой компьютер.
- 2. Введите в нашем файловом менеджере https://www.onworks.net/myfiles.php?username=XXXXX с желаемым именем пользователя.
- 3. Загрузите это приложение в такой файловый менеджер.
- 4. Запустите онлайн-эмулятор OnWorks Linux или Windows или онлайн-эмулятор MACOS с этого веб-сайта.
- 5. В только что запущенной ОС OnWorks Linux перейдите в наш файловый менеджер https://www.onworks.net/myfiles.php?username=XXXXX с желаемым именем пользователя.
- 6. Скачайте приложение, установите его и запустите.
СКРИНШОТЫ
Ad
LLM с нуля
ОПИСАНИЕ
LLMs-from-scratch is an educational codebase that walks through implementing modern large-language-model components step by step. It emphasizes building blocks—tokenization, embeddings, attention, feed-forward layers, normalization, and training loops—so learners understand not just how to use a model but how it works internally. The repository favors clear Python and NumPy or PyTorch implementations that can be run and modified without heavyweight frameworks obscuring the logic. Chapters and notebooks progress from tiny toy models to more capable transformer stacks, including sampling strategies and evaluation hooks. The focus is on readability, correctness, and experimentation, making it ideal for students and practitioners transitioning from theory to working systems. By the end, you have a grounded sense of how data pipelines, optimization, and inference interact to produce fluent text.
Особенности
- Stepwise implementations of tokenizer, attention, and transformer blocks
- Clear Python notebooks and scripts designed for learning and tinkering
- Training and sampling loops that expose the full data and compute flow
- Explorations of scaling choices, regularization, and evaluation metrics
- Minimal dependencies to keep the math and code transparent
- Serves as a foundation for extending to larger models and custom datasets
Язык программирования
Питон
Категории
This is an application that can also be fetched from https://sourceforge.net/projects/llms-from-scratch.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
