Towards LoRA science

Attribution: Nesiacel planned and executed all experiments. Analysis of the experiments was shared between the authors. Thanks to Clement Dumas for his input while we did this research. TLDR; 1)We have developed a framework for reverse engineering LoRAs trained on MLP downprojection. We posit that it's extendable to all LoRAs and welcome further research. 2) We reverse engineered a simple case of backdoored Weird Generalization 3) In this post, we discuss the four experiments that developed this framework 4) The Weird Generalization LoRAs that we studied work by connecting neurons which activa

• #science