Find files in a folder that are not music, using bash

Find files in a folder that are not music, using bash

How can I find files that are not mp3, m4a, mp4, ogg or wma in a folder
(and delete them) using bash? I found a script that does just the opposite
here.