ProceedingsShort paper
Low-Rank Adapters for On-Device Personalisation
Priya Venkataraman, Anders Holm
Personalising a model on a user's device requires small, fast-to-train updates. We study rank, placement and quantisation of low-rank adapters on a phone-class model and find that rank 4 on attention projections gives most of the gain at under 2 MB per user.