louis_lifu
/
AReaL
mirror of https://github.com/inclusionAI/AReaL
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
882 Commits 12 Branches 4 Tags 21 MiB
Commit Graph

882 Commits

Author SHA1 Message Date
lichangye.lcy c3c986ae76 0731_4 2025-07-31 18:36:31 +08:00
antoinegg1 2e0af5dd87 0731_3 2025-07-31 16:53:06 +08:00
lichangye.lcy 78d0367ff2 0731_2 2025-07-31 16:35:13 +08:00
antoinegg1 c5cd21d5db 0731_2 2025-07-31 15:57:07 +08:00
朱晗 d6a6240655 0731_1 2025-07-31 14:37:55 +08:00
朱晗 1ae006caf4 Merge branch 'lcy/refactor' of https://code.alipay.com/inclusionAI/AReaL into lcy/refactor 2025-07-31 13:19:48 +08:00
lichangye.lcy 68b4b0266d 0731 2025-07-31 13:18:50 +08:00
朱晗 4ff813ae9f 0725_format 2025-07-25 19:17:26 +08:00
lichangye.lcy 6b8bfcf9a4 0725_12 2025-07-25 19:13:33 +08:00
lichangye.lcy a4ad671d3b 0725 2025-07-25 19:12:25 +08:00
lichangye.lcy fb1796d941 0725_11 2025-07-25 18:52:29 +08:00
朱晗 60ac19ad04 0725_10padded_image 2025-07-25 15:52:33 +08:00
朱晗 cc3c6bbe5d 0725_9padded_image 2025-07-25 15:50:37 +08:00
朱晗 4f8b17feb9 0725_4padded_image 2025-07-25 15:48:54 +08:00
朱晗 8eaced4036 0725_7 2025-07-25 14:10:28 +08:00
朱晗 3c272ff5b4 0725_6 2025-07-25 14:04:10 +08:00
lichangye.lcy 4198cd695c 0725_1 2025-07-25 13:42:42 +08:00
朱晗 b8549ac48a 0724_merge8 2025-07-24 19:54:15 +08:00
朱晗 6255ad5aa7 0724-merge8 2025-07-24 19:36:10 +08:00
朱晗 84be9c9baf Merge remote-tracking branch 'backup/lite' into lcy/refactor 2025-07-24 19:34:26 +08:00
朱晗 f5924b1851 0724_merge7 2025-07-24 19:34:22 +08:00
朱晗 6aeeabf7b9 0724_4 2025-07-24 19:29:46 +08:00
Wei Fu aa6c28ed24
Merge branch 'main' into lite 2025-07-24 19:24:38 +08:00
Wei Fu f299740b1c
[lite] [doc] Add AReaLite design doc as README (#198) 
* PullRequest: 353 [Lite] Add gradient checkpointing to FSDPEngine

Merge branch mzy/add-gradient-ckpt of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/353

Reviewed-by: 博惟 <bowei.fw@antgroup.com>


* add gradient checkpointing

* PullRequest: 354 [lite] GRPO pre-commit: minor changes in FSDP  engine

Merge branch fw/lite-fix1 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/354

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .

* PullRequest: 355 [Lite] GRPO pre-commit 2: Refactor RemoteSGLangEngine thread and SGLang configuration

Merge branch fw/lite-fix1 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/355?tab=commit

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* .
* .
* fix
* .

* PullRequest: 357 [lite] GRPO pre-commit 3: Fix typos and experiment utilities

Merge branch fw/lite-fix2 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/357?tab=comment

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* .
* fix destroy process group

* PullRequest: 358 [lite] Support GRPO training locally with the GSM8k dataset

Merge branch fw/lite-fix3 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/358

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* fix loss mask
* fix
* .

* PullRequest: 368 [lite] Refactor train engine after merging contributions from GitHub

Merge branch fw/lite-train-engine of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/368

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .

* PullRequest: 371 [lite] [fix] fix misc bugs in GRPO implementation

Merge branch fw/lite-fix0716 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/371

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .

* PullRequest: 370 [lite] Add Slurm Launcher and Ray Launcher

Merge branch mzy/lite/launcher of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/370

Reviewed-by: 博惟 <bowei.fw@antgroup.com>


* .
* .
* .
* fix

* PullRequest: 392 [lite] Fix several bugs regarding RL learning and add an example to reproduce boba-math results.

Merge branch fw/lite-boba of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/392

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* support fsdp engine and sglang remote engine
* minor fix
* .
* refactor trainer
* add close
* rm mb_spec
* .
* fix
* .
* qwen2 grpo works
* fix
* fix
* async works
* fix
* slurm launcher not tested
* fix arg parse
* .
* sglang server wrapper
* .
* .
* slurm run
* ready for boba
* debug
* 32k run
* .
* .
* fix
* .
* .
* .
* .
* .
* fix
* .
* fix
* .
* .
* .
* .
* fix
* .
* .
* .
* .
* .
* .
* .
* refactor train engine
* refactor train engine
* .
* fix update weight error
* .
* .
* match train
* format
* .
* fix
* seems to work
* .
* .
* .
* .

* .

* PullRequest: 408 [Feature] Bump SGLang version to v0.4.9.post2

Merge branch fw/sgl049 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/408

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* bump arealite to sglang 0.4.9.post2
* .
* PullRequest: 412 [lite] Minor refactor on `UpdateWeightMeta`

* PullRequest: 422 [lite] Fix tests and scripts after updating sgl to 0.4.9

Merge branch fw/sgl049 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/422

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* bump arealite to sglang 0.4.9.post2
* .
* PullRequest: 412 [lite] Minor refactor on `UpdateWeightMeta`
* .

* PullRequest: 423 [lite] Remove the boba example for github release.

Merge branch fw/remove-boba of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/423

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .

* update readme

* .

---------

Co-authored-by: 晓雷 <meizhiyu.mzy@antgroup.com>
 2025-07-24 19:24:14 +08:00
nuzant e26a43a252
[Docs] [lite] Add example code walkthrough documentation. (#197) 
* .

* .

* fix grammar and minor revise
 2025-07-24 19:21:13 +08:00
朱晗 e705db12f4 0724_merge8 2025-07-24 15:57:36 +08:00
朱晗 27fd51aa15 0724_merge7 2025-07-24 15:46:15 +08:00
朱晗 13fc236c99 0724_merge6 2025-07-24 15:45:09 +08:00
朱晗 1bc9310252 0724_merge5 2025-07-24 15:38:24 +08:00
朱晗 84e2d75a0d Merge remote-tracking branch 'backup/lite' into lcy/refactor 2025-07-24 15:37:37 +08:00
Wei Fu 311bcd7697
[lite] [feature] Bump to SGLang v0.4.9.post2 and use NCCL to update weights (#196) 
* PullRequest: 353 [Lite] Add gradient checkpointing to FSDPEngine

Merge branch mzy/add-gradient-ckpt of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/353

Reviewed-by: 博惟 <bowei.fw@antgroup.com>


* add gradient checkpointing

* PullRequest: 354 [lite] GRPO pre-commit: minor changes in FSDP  engine

Merge branch fw/lite-fix1 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/354

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .

* PullRequest: 355 [Lite] GRPO pre-commit 2: Refactor RemoteSGLangEngine thread and SGLang configuration

Merge branch fw/lite-fix1 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/355?tab=commit

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* .
* .
* fix
* .

* PullRequest: 357 [lite] GRPO pre-commit 3: Fix typos and experiment utilities

Merge branch fw/lite-fix2 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/357?tab=comment

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* .
* fix destroy process group

* PullRequest: 358 [lite] Support GRPO training locally with the GSM8k dataset

Merge branch fw/lite-fix3 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/358

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .
* .
* .
* fix loss mask
* fix
* .

* PullRequest: 368 [lite] Refactor train engine after merging contributions from GitHub

Merge branch fw/lite-train-engine of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/368

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .

* PullRequest: 371 [lite] [fix] fix misc bugs in GRPO implementation

Merge branch fw/lite-fix0716 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/371

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .

* PullRequest: 370 [lite] Add Slurm Launcher and Ray Launcher

Merge branch mzy/lite/launcher of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/370

Reviewed-by: 博惟 <bowei.fw@antgroup.com>


* .
* .
* .
* fix

* PullRequest: 392 [lite] Fix several bugs regarding RL learning and add an example to reproduce boba-math results.

Merge branch fw/lite-boba of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/392

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* support fsdp engine and sglang remote engine
* minor fix
* .
* refactor trainer
* add close
* rm mb_spec
* .
* fix
* .
* qwen2 grpo works
* fix
* fix
* async works
* fix
* slurm launcher not tested
* fix arg parse
* .
* sglang server wrapper
* .
* .
* slurm run
* ready for boba
* debug
* 32k run
* .
* .
* fix
* .
* .
* .
* .
* .
* fix
* .
* fix
* .
* .
* .
* .
* fix
* .
* .
* .
* .
* .
* .
* .
* refactor train engine
* refactor train engine
* .
* fix update weight error
* .
* .
* match train
* format
* .
* fix
* seems to work
* .
* .
* .
* .

* .

* PullRequest: 408 [Feature] Bump SGLang version to v0.4.9.post2

Merge branch fw/sgl049 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/408

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* bump arealite to sglang 0.4.9.post2
* .
* PullRequest: 412 [lite] Minor refactor on `UpdateWeightMeta`

* PullRequest: 422 [lite] Fix tests and scripts after updating sgl to 0.4.9

Merge branch fw/sgl049 of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/422

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* bump arealite to sglang 0.4.9.post2
* .
* PullRequest: 412 [lite] Minor refactor on `UpdateWeightMeta`
* .

* PullRequest: 423 [lite] Remove the boba example for github release.

Merge branch fw/remove-boba of git@code.alipay.com:inclusionAI/AReaL.git into lite
https://code.alipay.com/inclusionAI/AReaL/pull_requests/423

Reviewed-by: 晓雷 <meizhiyu.mzy@antgroup.com>


* .
* .

---------

Co-authored-by: 晓雷 <meizhiyu.mzy@antgroup.com>
 2025-07-24 15:34:52 +08:00
lichangye.lcy 5690b52d42 0724_merge4 2025-07-24 15:33:53 +08:00
朱晗 5118cfaea2 0724_merge3 2025-07-24 15:22:12 +08:00
朱晗 176ec4bb23 0724_merge3 2025-07-24 14:29:29 +08:00
朱晗 e97e33fca8 0724_merge2 2025-07-24 14:24:54 +08:00
朱晗 c816a3ce44 0724_merge1 2025-07-24 14:18:42 +08:00
lichangye.lcy 6c28d52387 0724_1 2025-07-24 13:30:20 +08:00
朱晗 9a166053ee 0724_1 2025-07-24 11:15:54 +08:00
朱晗 00b5d878b3 0723_reformatted_5 2025-07-23 17:13:49 +08:00
朱晗 82442b86fd Merge branch 'lcy/refactor' of https://code.alipay.com/inclusionAI/AReaL into lcy/refactor 2025-07-23 17:12:51 +08:00
lichangye.lcy d12dec22c9 0723_4 2025-07-23 17:12:32 +08:00
朱晗 8e82c59faa 0723_merge3 2025-07-23 17:06:47 +08:00
朱晗 2a2e2fe360 Merge branch 'lcy/refactor' of https://code.alipay.com/inclusionAI/AReaL into lcy/refactor 2025-07-23 16:56:04 +08:00
lichangye.lcy 4041afb97d 0723_1 2025-07-23 16:55:20 +08:00
lichangye.lcy 9ec2c3f640 0723_1 2025-07-23 16:54:17 +08:00
朱晗 dd14838c6d 0723_1 2025-07-23 14:54:35 +08:00
lichangye.lcy 391bd85e44 Merge branch 'lcy/refactor' of https://code.alipay.com/inclusionAI/AReaL into lcy/refactor 2025-07-23 14:44:36 +08:00
朱晗 25884f5d89 clang-reformatted2 2025-07-23 14:12:41 +08:00
朱晗 52c9447b6e clang-reformatted 2025-07-23 14:06:06 +08:00
朱晗 6bde86a934 reformatted 2025-07-23 13:58:25 +08:00