Skip to content

[PyTorch] Type the grouped wgrad from main_grad for distributed weights - #3397

Open
fanshiqing wants to merge 1 commit into
NVIDIA:mainfrom
fanshiqing:shiqingf/fix_gtp_grad_reduce_in_fp32
Open

[PyTorch] Type the grouped wgrad from main_grad for distributed weights#3397
fanshiqing wants to merge 1 commit into
NVIDIA:mainfrom
fanshiqing:shiqingf/fix_gtp_grad_reduce_in_fp32

Commits

Commits on Aug 18, 2026