A PyTorch-based optimizer wrapper for continual learning via selective fine-tuning, guided by the condition number κ (kappa) of model tensors. KappaTune identifies and updates only the least anisotropic parameters to preserve pre-trained knowledge and mitigate catastrophic forgetting.
machine-learning singular-values svd lifelong-learning continual-learning catastrophic-forgetting llm
-
Updated
Mar 13, 2026 - Python