A Critical Review of GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
May 2026
CSCI E-222 Foundations of Large Language Models, Harvard Extension School
A critical review of Jung et al.'s GraLoRA, which addresses LoRA's rank ceiling by partitioning weight matrices into block-wise low-rank adapters. The review covers the outlier-channel diagnosis, the block-diagonal method, results across five evaluation domains, and limitations of the experimental evidence.