CODA: Rewriting Transformer Blocks as GEMM-Epilogue Programs

In three linesCODA rewrites transformer blocks as GEMM-Epilogue programs to optimize inference. The technique fuses matrix operations and post-processing into a single GPU primitive, reducing latency and memory bandwidth.

Summary generated by Claude — human-verified