---
title: README
emoji: ⚡
colorFrom: green
colorTo: gray
sdk: static
pinned: false
---

# Audio, Music, and AI Lab (AMAAI)

The Audio, Music, and AI lab at Singapore University of Technology and Design focuses on cutting-edge innovations in multimodal AI, more specifically: Audio and Music AI. 

[More info and publications here.](https://dorienherremans.com/biblio) 

Popular software: 
- SonicMaster: all-in-one music restoration and mastering: [code](https://github.com/AMAAI-Lab/SonicMaster) - [examples](https://amaai-lab.github.io/SonicMaster/) - [live demo](https://huggingface.co/spaces/amaai-lab/SonicMaster)
- Jam 0.5: text-to-song: [code](https://huggingface.co/declare-lab/JAM-0.5) - [examples](https://declare-lab.github.io/jamify)- [Dataset](https://huggingface.co/datasets/declare-lab/JAME) in collaboration with Declare lab
- SonicVerse: time-aware music captioning: [code](https://github.com/AMAAI-Lab/sonicverse) - [live demo](https://huggingface.co/spaces/amaai-lab/SonicVerse)
- Music2Emo: emotion detection from music: [code](https://github.com/AMAAI-Lab/Music2Emotion) - [live demo](https://huggingface.co/spaces/amaai-lab/music2emo/discussions/1)
- Mustango: text-to-music generation: [code](https://github.com/AMAAI-Lab/mustango) - [live demo](https://replicate.com/declare-lab/mustango)
- Video2Music: video-to-music generation: [code](https://github.com/AMAAI-Lab/Video2Music)
- Text2midi: text-to-midi generation: [code](https://github.com/AMAAI-Lab/text2midi) 
- nnAudio: on-the-fly spectrogram extraction: [code](https://github.com/AMAAI-Lab/nnAudio)


Popular Datasets: 
- [JamendoMaxCaps](https://huggingface.co/datasets/amaai-lab/JamendoMaxCaps): text captions with instrumental music audio
- [MusicBench](https://huggingface.co/datasets/amaai-lab/MusicBench): text captions with music audio
- [MidiCaps](https://huggingface.co/datasets/amaai-lab/MidiCaps): text captions with music midi (large-scale)
- [SonicMaster](https://huggingface.co/datasets/amaai-lab/SonicMasterDataset): music with mastered / enhanced version and enhancement caption