[hotword] fix race condition in destroy()

Fixes: 296228269
Test: atest CtsVoiceInteractionTestCases

Change-Id: I2a4c5ec6856f524e93aa730da6c82e22316919f5
1 file changed