Controls UI - Do not clear callbacks on user change

Listeners would get into an invalid state when changing users.

Fixes: 155990179
Test: atest ControlsListingControllerImplTest
Change-Id: I9c48c767a7da47eca029a27f9c223e92c2359412
2 files changed