Don't load wallpaper colors if no listener set

Currently, we always load wallpaper color, then check if listener exist.

Test: Manually
Bug: 159195012
Change-Id: Ice8505927fead23a53b15448f192689c02cb3e5c
1 file changed