mirror of https://github.com/inclusionAI/AReaL
Add
This commit is contained in:
parent
070a1216ce
commit
919b2872a2
|
@ -0,0 +1,35 @@
|
|||
---
|
||||
name: Refactor
|
||||
about: Propose an API change
|
||||
title: "[Refactor]"
|
||||
labels: ''
|
||||
assignees: ''
|
||||
|
||||
---
|
||||
|
||||
## Checklist
|
||||
|
||||
- [ ] I’ve verified this refactor maintains backward compatibility with all user-facing APIs.
|
||||
- [ ] For large-scale refactors, I’ve prepared a phased implementation plan.
|
||||
|
||||
## Current Limitations
|
||||
|
||||
Describe existing design flaws or technical debt:
|
||||
|
||||
**Example:**
|
||||
"`realhf/base/topology.py` currently only supports 3D parallelism for dense models, which limits extensibility for context parallelism or expert parallelism."
|
||||
|
||||
## Proposed Refactor
|
||||
|
||||
Explain the improvement and its benefits:
|
||||
|
||||
**Example:**
|
||||
"Adopt Megatron-Core’s parallel state management instead of thecustom topology implementation. This would reduce maintenance overhead and improve support for emerging parallelism techniques"
|
||||
|
||||
## Alternatives Considered
|
||||
|
||||
Briefly summarize and compare other potential approaches (if applicable).
|
||||
|
||||
## Additional Context
|
||||
|
||||
Add references, screenshots, or related discussions.
|
Loading…
Reference in New Issue