How many parameters does Grok 3 have?
6
1.2kṀ6482026
57%
Active params >300B
38%
Active params >500B
28%
Active params >700B
78%
Total params > 1T
61%
Total params > 2T
45%
Total params >3T
31%
Total params >4T
What will be true of Grok 3's parameter counts?
xAI recently open-weighted Grok 2, revealing that it has 115B active parameters and 270B total parameters (per internet claims in various places that I have not vetted closely). xAI also plans to open-weight Grok 3 in about six months.
Grok 3 was trained in a data center containing 100k+ H100 GPUs; xAI claims that Grok 3 was pre-trained on more than 10x as much FLOP as Grok 2 (training FLOP scales in proportion to active parameters, as well as the size of the training data).
N/A if Grok 3 is not opened in one year, and we never get confirmation or a credible report of Grok 3's params by that date.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
Related questions
Related questions
When will Grok 3 weights become publicly available?
-
What is Grok 4 Heavy's performance on METR's task length evaluation?
How many parameters does the new possibly-SOTA large language model, Claude 3 Opus, have?
How many parameters does GPT4o have?
How many active parameters will the largest Llama 3 have?
77% chance
How many (total) parameters does the Claude3 Haiku (the smallest variant) have? (resolve to log_10(N))