40h ago · DeepSpeed releases →
Sum GPTBigCode's shared key/value gradient across tensor-parallel ranks by @Achyuthan-S in #8928 …