The older version of this (Android 9) was much better, allowed me to quickly change audio output source from Galaxy Buds to phone without leaving the notifications panel. With this it's much more complicated and less evident/intuitive series of steps. Maybe keep the old functionality and add a button within it for more options (to display the whole grid of devices and media)?
