GitHub - nemanjaudovic/student-model: Training student DNA LLM model

Name		Name	Last commit message	Last commit date
Latest commit History 2 Commits
configs		configs
scripts		scripts
src		src
tools		tools
.gitignore		.gitignore
README.md		README.md
environment.yaml		environment.yaml
kd_finetune.py		kd_finetune.py
kd_pretrain.py		kd_pretrain.py
kd_pretrain_v2,2.py		kd_pretrain_v2,2.py
kd_pretrain_v3.py		kd_pretrain_v3.py
moe_ppo_pretrain.py		moe_ppo_pretrain.py
self_distillation.py		self_distillation.py