Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
mistralai 's Collections
Devstral 2
Mistral Large 3
Ministral 3
Ministral 3 - Additional Checkpoints
Speech Evals

Speech Evals

updated 13 days ago

Synthesized speech evals generated by MistralAI from popular text evaluation datasets to evaluate spoken-language reasoning capabilities of Audio LLMs

Upvote
11

  • mistralai/mmlu_speech

    Viewer • Updated Jul 15 • 14.3k • 542 • 13

  • mistralai/triviaqa_speech

    Viewer • Updated Jul 15 • 17.9k • 181 • 6

  • mistralai/gsm8k_speech

    Viewer • Updated Jul 15 • 1.32k • 155 • 5
Upvote
11
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs