OFTv2

This repository contains the official implementation for the paper:

Orthogonal Finetuning Made Scalable (paper).

Status

🚧 Work in Progress 🚧

This codebase is currently under development. The implementation will be made available soon.

Citation

If you find this work useful in your research, please cite our paper:

  @article{qiu2025orthogonal,
    title={Orthogonal Finetuning Made Scalable},
    author={Qiu, Zeju and Liu, Weiyang and Weller, Adrian and Sch{\"o}lkopf, Bernhard},
    journal={arXiv preprint arXiv:2506.19847},
    year={2025}
  }