Meta-Display and Android Auto

Have the meta-display glasses and wore them while driving. Noticed music coming through Android auto and car speakers kept stopping and starting. Double tapping the fingers to wake the glasses helped a little. 

Is there a way, without having to turn the glasses off to allow my phone music to play through Android auto and car vs glasses. I'm sure I could turn off music/audio in Bluetooth settings but there are times when I listen to music through glasses outside of the car.