This is the Linux app named FlashKDA whose latest release can be downloaded as FlashKDAsourcecode.zip. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named FlashKDA with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS:
FlashKDA
DESCRIPTION:
FlashKDA is an open-source library of high-performance CUDA kernels for Kimi Delta Attention, implemented on NVIDIA CUTLASS. It is intended to accelerate the forward pass used by KDA-based language models on modern NVIDIA GPUs. The package integrates with flash-linear-attention and can be selected automatically as the backend for chunk_kda during inference. It supports recurrent state input and output, variable-length batches, internal gating, query-key normalization, and beta activation. Builds can target the detected GPU architecture or multiple supported architectures for wheels and CI pipelines. The repository also provides correctness tests, benchmark material, a direct Python kernel API, and development helpers for CUDA and C++ tooling.
Features
- High-performance Kimi Delta Attention CUDA kernels
- NVIDIA CUTLASS-based implementation
- Automatic flash-linear-attention backend integration
- Stateful and variable-length sequence processing
- Configurable GPU architecture compilation
- Correctness tests and hardware benchmarks
Programming Language
Python
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/flashkda.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.