A Critical Review of GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning

May 2026

CSCI E-222 Foundations of Large Language Models, Harvard Extension School

A critical review of Jung et al.'s GraLoRA, which addresses LoRA's rank ceiling by partitioning weight matrices into block-wise low-rank adapters. The review covers the outlier-channel diagnosis, the block-diagonal method, results across five evaluation domains, and limitations of the experimental evidence.

PDF cannot be displayed in this browser. Download the review