gpu materials

gpu lectures

• Optimizing Applications for NVIDIA Ampere GPU Architecture

• Inside the NVIDIA Ampere Architecture

• Accelerating Sparsity in the NVIDIA Ampere Architecture​

• CUTLASS: CUDA TEMPLATE LIBRARY FOR DENSE LINEAR ALGEBRA AT ALL LEVELS AND SCALES cutlass-gtc2018

• PROGRAMMING TENSOR CORES: NATIVE VOLTA TENSOR CORES WITH CUTLASS gtc-2019

• Tensor Core Performance on NVIDIA GPUs: The Ultimate Guide

• Developing CUDA Kernels to Push Tensor Cores to the Absolute Limit on NVIDIA A100 cutlass-gtc2020

• Accelerating Backward Data Gradient by Increasing Tensor Core Utilization in CUTLASS cutlass-gtc2022

• Use CUTLASS to Fuse Multiple GEMMs to Extreme Performance cutlass-gtc2022 中文

• Auto48: A General Framework for Automatic Model Compression and Acceleration using Int4/Int8 Mixed Precision cutlass-gtc2022

• Large Models are not Always Expensive: Large Scale Mixture of Expert Models with Efficient Inference Empowers Microsoft Translator with Best Models cutlass-gtc2022

https://developer.nvidia.com/blog/cutlass-linear-algebra-cuda/

gpu materials

https://github.com/brucefan1983/CUDA-Programming

• CUDA by Example
• CUDA_Freshman
• cuda handbook
• Learn-CUDA-Programming