DynaMiCS: Fine-Tuning LLMs with Performance Constraints Using Dynamic Mixtures

«Multi-domain fine-tuning of large language models requires improving performance on target domains while preserving performance on constrained domains, such as general knowledge, instruction following, or safety evaluati...»