I did not see it on the model card. Congratulations on your progress and the results!
It should be around 48.48B parameters activated per token
· Sign up or log in to comment