SOURCE RECORD · github
doremi
Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets
SOURCE RECORD · github
Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets