9 Commits

Author	SHA1	Message	Date
hiyouga	6e64e02f71	fix #2164 ... Former-commit-id: abe23bb4aca4fa571ebafc329ec9a9d457e37d41	2024-01-12 00:27:57 +08:00
hiyouga	d358d955e5	fix dpo trainer ... Former-commit-id: c160dd7cd86e296e32775ace2e4258a473449c41	2023-12-23 01:51:55 +08:00
hiyouga	6faf9c35a9	support unsloth ... Former-commit-id: b857f00234b90b785d82ca7cdb29af3d948b1a7b	2023-12-23 00:14:33 +08:00
hiyouga	d81ad2d4bc	support dpo-ftx ... Former-commit-id: 86dfa04f9821556019fa777106787f73eb70b452	2023-12-16 19:21:41 +08:00
hiyouga	29545d0e5e	implement rm server #1543 ... Former-commit-id: 2e5bb6888c86079493456c2ddd525f8c52b9963e	2023-12-03 20:52:54 +08:00
hiyouga	6889f044fb	fix #1558 ... Former-commit-id: 263b2b24c8a649b51fa5ae768a24e67def8e0e96	2023-11-19 14:15:47 +08:00
hiyouga	f81a8a5e5c	fix import bug ... Former-commit-id: 2356029cdd120d5f7bf630b80681ce8c53bff90d	2023-11-16 02:27:03 +08:00
hiyouga	7a3a0144a5	support full-parameter PPO ... Former-commit-id: 4af967d69475e1c9fdf1a7983cd6b83bd431abff	2023-11-16 02:08:04 +08:00
hiyouga	09a4474e7f	disentangle model from tuner and rename modules ... Former-commit-id: 02cbf91e7e424f8379c1fed01b82a5f7a83b6947	2023-11-15 16:29:09 +08:00