After not being woken up by my phone this morning I questioned this and only after changing this back did I get any noise out of my test alarm. So maybe this setting works despite not showing in the Audio Output app? Or maybe my phone is just more broken/temperamental than I thought...