Skip to content
New pull request New
48 Open 893 Closed
48 Open 893 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀
01 adam optimizer
#1790 opened Feb 24, 2022 by EugeneLYC • Review required
Optimizer state for only trainable parameters
#1780 opened Feb 17, 2022 by tjruwase • Review required
Add checkpoint_comm_enabled flag
#1778 opened Feb 16, 2022 by jeffra • Review required
Modify unit test to cover more cases
#1775 opened Feb 15, 2022 by RezaYazdaniAminabadi • Approved
DataLoader Length Fix
#1718 opened Jan 23, 2022 by Sanger2000 • Draft
Add RTS and token masking to top-2 gating + configurable jitter epsilon
#1700 opened Jan 17, 2022 by ykim362 • Draft
1
remove force-multi and fix None val check in base tuner in autotuning
#1657 opened Dec 22, 2021 by cli99 • Review required
5
[zero-3] add support for new params added during fwd pass
#1606 opened Dec 1, 2021 by jeffra • Approved
8
support batch size dimension in 2D sparse attention mask
#1597 opened Nov 29, 2021 by jglaser • Review required
1
Tweaks for lm-eval-harness
#1592 opened Nov 26, 2021 by zphang
1
Optimizer state loading fix for bitsandbytes 8-bit optimizers.
#1582 opened Nov 22, 2021 by TimDettmers • Review required
7
Add shared libs
#1567 opened Nov 16, 2021 by RezaYazdaniAminabadi • Draft
Add inference comm
#1552 opened Nov 12, 2021 by RezaYazdaniAminabadi • Draft
1
Refine quantizer for supporting larger hidden-dim and group size
#1544 opened Nov 9, 2021 by RezaYazdaniAminabadi • Review required
Add some improvements for pipeline module, engine and assertion into ds engine
#1529 opened Nov 6, 2021 by hyunwoongko • Review required
modify the quantize.py file for efficiency
#1519 opened Nov 4, 2021 by yaozhewei • Review required
1
AMD support
#1430 opened Oct 5, 2021 by jeffra • Approved
3
parallelize writing of layer checkpoint files across data parallel instances
#1419 opened Sep 30, 2021 by adammoody • Review required
1
Transformer/fix layer norm
#1404 opened Sep 27, 2021 by RezaYazdaniAminabadi • Review required
1
fix dataloder len
#1391 opened Sep 23, 2021 by roywei • Review required
1
9
Fix the file-paths for the auto-generated hip files through JIT
#1352 opened Sep 9, 2021 by RezaYazdaniAminabadi
Added both CPU support for lamb optimizer!!
#1330 opened Aug 27, 2021 by harishsg99 • Review required
1
Elasticity updates (squash) (#997)
#1290 opened Aug 9, 2021 by Kaiming-Qu • Draft
add pod level retry relaunch with worker number unchanged
#1287 opened Aug 7, 2021 by shadowtudark
FP16 fused and unfused grad norm query.
#1286 opened Aug 7, 2021 by ShadenSmith • Draft
2
ProTip! Follow long discussions with comments:>50.