Ligeng Zhu
de134b4a7a
[Feature] Switch dataset path / model path to HF location to ease community usage ( #82 )
...
* Update .gitignore and modify dataset paths in scripts for improved file management and compatibility with Hugging Face datasets. Additionally, refactor dataset loading functions to utilize load_hf_or_local_file for better flexibility.
* Remove sglang subproject and update dataset path format in load_hf_or_local_file function for compatibility with Hugging Face datasets.
* Refactor imports in grader.py and parser.py to include sympy for improved functionality.
2025-06-06 21:38:06 +08:00
nuzant
ffc52a1520
Merge updates from ant repository. ( #34 )
...
* Cherry-pick commit 90dfd575
"PullRequest: 84 [ADD..." 到当前分支
* Cherry-pick commit 15e787b7
"PullRequest: 44 eval..." 到当前分支
* Cherry-pick commit f255ef60
"PullRequest: 85 add ..." 到当前分支
* Cherry-pick commit c2b4006a
"PullRequest: 86 Supp..." 到当前分支
* Cherry-pick commit fa6c0f3d
"PullRequest: 87 upda..." 到当前分支
* Cherry-pick commit a9ff4af0
"PullRequest: 88 Bump..." 到当前分支
* Cherry-pick commit 763839aa
"PullRequest: 89 Add ..." 到当前分支
* Cherry-pick commit 21e8064a
"PullRequest: 90 Merg..." 到当前分支
* Cherry-pick commit 94e97670
"PullRequest: 92 Supp..." 到当前分支
* Cherry-pick commit 92710522
"PullRequest: 91 Supp..." 到当前分支
* Cherry-pick commit 95aa3f28
"PullRequest: 93 Supp..." 到当前分支
* Cherry-pick commit 62191f8f
"PullRequest: 94 Add ..." 到当前分支
* Cherry-pick commit baa0249a
"PullRequest: 95 Form..." 到当前分支
* Cherry-pick commit e32945f2
"PullRequest: 96 Chan..." 到当前分支
* Cherry-pick commit b59286e3
"PullRequest: 98 fix ..." 到当前分支
* Cherry-pick commit ca2ba43e
"PullRequest: 97 Move..." 到当前分支
* Cherry-pick commit f941700b
"PullRequest: 99 Refa..." 到当前分支
* Cherry-pick commit 95439e70
"PullRequest: 100 Add..." 到当前分支
* Cherry-pick commit f3ebd941
"PullRequest: 101 Add..." 到当前分支
* Cherry-pick commit ee4779ea
"PullRequest: 103 [Fe..." 到当前分支
* Cherry-pick commit ce5e24ec
"PullRequest: 104 [Fi..." 到当前分支
* Cherry-pick commit b385761f
"PullRequest: 105 [Bu..." 到当前分支
* Cherry-pick commit 4c21fbb5
"PullRequest: 106 [Bu..." 到当前分支
* Cherry-pick commit 7f3f14e0
"PullRequest: 108 [Fi..." 到当前分支
* Cherry-pick commit 8de62701
"PullRequest: 107 [Fe..." 到当前分支
* Cherry-pick commit ea864b21
"PullRequest: 24 [Fea..." 到当前分支
* Cherry-pick commit 4a658db3
"PullRequest: 109 [Bu..." 到当前分支
* Cherry-pick commit aaa12bf1
"PullRequest: 110 [Bu..." 到当前分支
* Cherry-pick commit 6adb6d9f
"PullRequest: 112 [Fi..." 到当前分支
* Cherry-pick commit 55556bc5
"PullRequest: 111 [Fe..." 到当前分支
* Cherry-pick commit bfe5ec94
"PullRequest: 114 pri..." 到当前分支
* Cherry-pick commit 44529c9b
"PullRequest: 113 spl..." 到当前分支
* Cherry-pick commit b1cc73df
"PullRequest: 116 [FI..." 到当前分支
* Cherry-pick commit eff598ce
"PullRequest: 115 [Fi..." 到当前分支
* Cherry-pick commit f7149475
"PullRequest: 119 [Fi..." 到当前分支
* Cherry-pick commit f1017bfe
"PullRequest: 121 add..." 到当前分支
* Cherry-pick commit 56f6de8d
"PullRequest: 120 set..." 到当前分支
---------
Co-authored-by: 冰临 <shenxujie.sxj@antgroup.com>
Co-authored-by: 温差 <xushusheng.xss@antgroup.com>
Co-authored-by: 郭唯 <kira.gw@antgroup.com>
Co-authored-by: 博惟 <bowei.fw@antgroup.com>
Co-authored-by: 君末 <meijun.mei@antgroup.com>
2025-04-27 11:09:25 +08:00
bowei.fw
25c45c7e83
.
2025-03-22 12:22:34 +08:00
bowei.fw
9dcdb7a684
.
2025-03-21 22:38:21 +08:00
bowei.fw
d1554585a4
Merge branch 'main' of code.alipay.com:inclusionAI/AReaL into async-ref-rew
2025-03-21 21:25:35 +08:00
bowei.fw
de8243cc78
.
2025-03-21 21:22:50 +08:00
博惟
f90fe19e00
PullRequest: 53 Fix a potential reward hacking issue related to "emptyset"
...
Merge branch fw/fix-rwd-hacking of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/53
Signed-off-by: 温差 <xushusheng.xss@antgroup.com>
* .
* .
2025-03-21 16:42:24 +08:00
晓雷
4ac9595295
PullRequest: 43 Reduce GPU memory used by data transfer.
...
Merge branch mzy/fix-data-transfer-oom of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/43
Signed-off-by: 博惟 <bowei.fw@antgroup.com>
* add oom observe logs
* tested
* format and clear code
* .
* format
* remove logging
* .
* add comments
2025-03-18 15:20:57 +08:00
Jun Mo
8310d7beb7
code format
2025-03-18 09:00:13 +08:00
meijun.mei
92e0777178
optimize code/math functioncall param
2025-03-17 15:45:52 +08:00
博惟
fb23009e99
PullRequest: 27 support bf16 training
...
Merge branch fw/bf16 of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/27
Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>
* support bf16 training
2025-03-12 13:04:30 +08:00
meijun.mei
6fd0db01c7
add functioncall switch
2025-03-11 18:41:46 +08:00
博惟
ca42e43638
PullRequest: 9 Refactoring data transfer for v2 workers.
...
Merge branch fw/datatransfer-v2 of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/9
Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>
* .
* fw/fix-dataloading-not-shuffle
* .
* .
* .
* .
* .
* add v2 master worker
* cpu test pass
* ppo run
* .
* pass sft test
* pass ppo dp test
* format
* fix
* run
* .
* cleanup
* .
* format
* run
* merge and format
* refactor
* sft pass
* .
* format
* format
* format
* .
* .
2025-03-08 18:26:24 +08:00
君末
b3bedd7b9d
PullRequest: 17 Support functioncall for math and code verify
...
Merge branch functioncall-code of git@code.alipay.com:inclusionAI/AReaL.git into main
https://code.alipay.com/inclusionAI/AReaL/pull_requests/17
Signed-off-by: 晓雷 <meizhiyu.mzy@antgroup.com>
* test code evaluation with faas
* support functioncall for code
* fix code crash bug
* format
* .
2025-03-07 11:26:57 +08:00