Linux kernel ===== There are several guides for kernel developers and users. These guides can be rendered in a number of formats, like HTML and PDF. Please read ...
Liger Kernel is a collection of Triton kernels designed specifically for LLM training. It can effectively increase multi-GPU training throughput by 20% and reduces memory usage by 60%. We have ...
Abstract: We revisit large kernel design in modern convolutional neural networks (CNNs). Inspired by recent advances in vision transformers (ViTs), in this paper, we demonstrate that using a few large ...