Latest / Kana & Mari's SoundRepos (English)

OpenBMB/UltraEval-Audio
UltraEval-Audio is an open-source unified evaluation framework for audio foundation models, covering both speech understanding and speech generation. It aggregates many benchmarks across speech, sound, medicine, and music, and provides benchmark management, built-in metrics, replication docs for popular models, and support for custom datasets and isolated runtime inference.
The skinny
The skinny isn't ready yet — notes appear once the transcript is processed.