Skip to content

Commit 2c0edb7

Browse files
Merge pull request #2710 from AI-Hypercomputer:parambole/qwen3-opt
PiperOrigin-RevId: 833901498
2 parents fa7bdcc + b3fe5f8 commit 2c0edb7

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

src/MaxText/configs/models/qwen3-235b-a22b.yml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,7 @@
1717
# Core Architectural Parameters
1818
decoder_block: "qwen3_moe"
1919
base_emb_dim: 4096
20+
base_mlp_dim: 1536
2021
base_num_query_heads: 64
2122
base_num_kv_heads: 4
2223
base_num_decoder_layers: 94

0 commit comments

Comments
 (0)