Revert "Fix audio switch of speaker -> BT LE or speaker -> HA issue."

This reverts commit 6e171ef44faf7153be1889a9d66b74aa8d1fb391.

Reason for revert: test

Test: BluetoothDeviceManagerTest
Change-Id: Ia416daeed288c3cfac74423651106f7544432960
3 files changed