hiyouga e49f7f1afe fix bug in packed sft dataset ...

Former-commit-id: 51d26b2af6612e65a91c576da5270028da27b322

2023-09-28 01:16:46 +08:00

..

__init__.py

simplify code

2023-07-20 15:08:57 +08:00

loader.py

fix streaming in pt stage #548 #549

2023-08-17 17:59:26 +08:00

preprocess.py

fix bug in packed sft dataset

2023-09-28 01:16:46 +08:00

utils.py

fix streaming in pt stage #548 #549

2023-08-17 17:59:26 +08:00