Search results

[REQUEST] Switch to and unify DeviceMesh management for DP/TP/PP/EP/SP

enhancementNew feature or requestNew feature or request

Status: Open.

#7680 In deepspeedai/DeepSpeed;

· eternalNight opened on Nov 7, 2025

[BUG] nebula checkpoint engine AttributeError: 'str' object has no attribute 'tag'

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7678 In deepspeedai/DeepSpeed;

· unavailableun opened on Nov 7, 2025

Z1/2 should flatten tensors on gpu

enhancementNew feature or requestNew feature or request

Status: Open.

#7677 In deepspeedai/DeepSpeed;

· stas00 opened on Nov 6, 2025

[BUG] Can not use deepspeed.layer.moe

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7673 In deepspeedai/DeepSpeed;

· LckyLke opened on Nov 5, 2025

[BUG] Rank index out of range during BWD when sp_size < world_size

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7672 In deepspeedai/DeepSpeed;

· NiuMa-1234 opened on Nov 5, 2025

[BUG] ZeRO-3 with HuggingFace Transformers: Gathered Parameters in Forward Pass Not Released Promptly

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7670 In deepspeedai/DeepSpeed;

· CACACAZ opened on Nov 5, 2025

[REQUEST]Support for modules_to_save with LoRA under DeepSpeed ZeRO-3

enhancementNew feature or requestNew feature or request

Status: Open.

#7669 In deepspeedai/DeepSpeed;

· XiangZhang-zx opened on Nov 4, 2025

[BUG]how to use zero_to_fp32 when my model list is like below

bugSomething isn't workingSomething isn't working

deepspeed-chatRelated to DeepSpeed-ChatRelated to DeepSpeed-Chat

Status: Open.

#7663 In deepspeedai/DeepSpeed;

· Cyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy opened on Nov 3, 2025

[BUG] apex has deleted amp

bugSomething isn't workingSomething isn't working

compression

Status: Open.

#7662 In deepspeedai/DeepSpeed;

· Ask-sola opened on Nov 2, 2025

[REQUEST] Muon Optimizer - Different LR for Different Groups

enhancementNew feature or requestNew feature or request

Status: Open.

#7657 In deepspeedai/DeepSpeed;

· DongmingShenDS opened on Oct 29, 2025

Question about Deepspeed-Domino

Status: Open.

#7654 In deepspeedai/DeepSpeed;

· GoldenStain opened on Oct 28, 2025

[REQUEST] Fast access to whole model gradient during training

enhancementNew feature or requestNew feature or request

Status: Open.

#7644 In deepspeedai/DeepSpeed;

· JohannesAck opened on Oct 23, 2025