This is the Linux app named DeepGEMM whose latest release can be downloaded as Stablereleasev2.1.0sourcecode.tar.gz. It can be run online in the free hosting provider OnWorks for workstations.
Download and run online this app named DeepGEMM with OnWorks for free.
Follow these instructions in order to run this app:
- 1. Downloaded this application in your PC.
- 2. Enter in our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 3. Upload this application in such filemanager.
- 4. Start the OnWorks Linux online or Windows online emulator or MACOS online emulator from this website.
- 5. From the OnWorks Linux OS you have just started, goto our file manager https://www.onworks.net/myfiles.php?username=XXXXX with the username that you want.
- 6. Download the application, install it and run it.
SCREENSHOTS
Ad
DeepGEMM
DESCRIPTION
DeepGEMM is a specialized CUDA library for efficient, high-performance general matrix multiplication (GEMM) operations, with particular focus on low-precision formats such as FP8 (and experimental support for BF16). The library is designed to work cleanly and simply, avoiding overly templated or heavily abstracted code, while still delivering performance that rivals expert-tuned libraries. It supports both standard and “grouped” GEMMs, which is useful for architectures like Mixture of Experts (MoE) that require segmented matrix multiplications. One distinguishing aspect is that DeepGEMM compiles its kernels at runtime (via a lightweight Just-In-Time (JIT) module), so users don’t need to precompile CUDA kernels before installation. Despite its lean design, it includes scaling strategies (fine-grained scaling) and optimizations inspired by cutting edge systems (drawing from ideas in CUTLASS, CuTe) but in a more streamlined form.
Features
- High-performance GEMM kernels focused on FP8 precision, with optional BF16 support
- Support for grouped GEMM (segmented matrix operations) useful for MoE scenarios
- Runtime JIT compilation of kernels (no heavy ahead-of-time kernel compilation needed)
- Clean, modular code structure (less dependence on heavy template programming)
- Fine-grained scaling strategies (to adapt precision dynamically)
- Benchmark and test suite (e.g. test_fp8.py), performance monitoring, and ongoing issue tracking
Programming Language
C++
Categories
This is an application that can also be fetched from https://sourceforge.net/projects/deepgemm.mirror/. It has been hosted in OnWorks in order to be run online in an easiest way from one of our free Operative Systems.
