louis_lifu
/
AReaL
mirror of https://github.com/inclusionAI/AReaL
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

[Doc] Add verl benchmark scripts (#71) 

* update benchmark script

* .

* add benchmark docs

* .
This commit is contained in:
Wei Fu 2025-06-03 18:10:32 +08:00 committed by GitHub
parent 326dfe3462
commit ad6e5bd3fa
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
4 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
benchmark/verl_v0_3_0_post1_312a8cb/README.md → benchmark/verl_v0_3_0_post1_76084d3/README.md
View File

@ -8,10 +8,16 @@ We compare against the latest release of verl (v0.3.0.post1) as of May 7, 2025.
## How to Reproduce ## How to Reproduce
### verl
We provide code and instructions [in this repo](https://github.com/garrett4wade/verl-benchmark/blob/main/readme_benchmark.md).
### AReaL
Run `build_cmd.py` to generate the CLI command to run AReaL: Run `build_cmd.py` to generate the CLI command to run AReaL:
```bash ```bash
python3 benchmark/verl_v0_3_1_312a8cb/build_cmd.py --model-size 1 --ctx 32768 --n-nodes 4 python3 benchmark/verl_v0_3_1_76084d3/build_cmd.py --model-size 1 --ctx 32768 --n-nodes 4
``` ```
The above command generates the command to run AReaL with `DeepSeek-R1-Distill-Qwen-1.5B` using 32k context length (31k generation length) on 4 nodes (32 GPUs). You can choose `model_size` from [1, 7, 32] and `n_nodes` from [4, 8, 16, 32, 64]. The above command generates the command to run AReaL with `DeepSeek-R1-Distill-Qwen-1.5B` using 32k context length (31k generation length) on 4 nodes (32 GPUs). You can choose `model_size` from [1, 7, 32] and `n_nodes` from [4, 8, 16, 32, 64].

0
benchmark/verl_v0_3_0_post1_312a8cb/areal_config.yaml → benchmark/verl_v0_3_0_post1_76084d3/areal_config.yaml
View File

0
benchmark/verl_v0_3_0_post1_312a8cb/build_cmd.py → benchmark/verl_v0_3_0_post1_76084d3/build_cmd.py
View File

0
benchmark/verl_v0_3_0_post1_312a8cb/scaling_trend_vs_verl.png → benchmark/verl_v0_3_0_post1_76084d3/scaling_trend_vs_verl.png
View File

Side by Side Swipe Overlay

Before

Width:  |  Height:  |  Size: 271 KiB

After

Width:  |  Height:  |  Size: 271 KiB