[zero] compute the grad norm over all gradient stores at once - #6469

[zero] compute the grad norm over all gradient stores at once#6469

yuxuan-lou merged 1 commit into

mainhpcaitech/ColossalAI:mainfrom

fix/zero-ep-grad-normhpcaitech/ColossalAI:fix/zero-ep-grad-normCopy head branch name to clipboard