Pre-Trianing Data Packing Collection [ACL'24] Analysing the Impact of Sequence Composition on Language Model Pre-Training. https://github.com/yuzhaouoe/pretraining-data-packing โข 10 items โข Updated Mar 3, 2025