Revert "Apply colors a bit earlier when switching users"

This reverts commit e02895a32fce38713acf0160b9d0f6a1604cb26c.

Reason for revert: Regression in multiuser performance metrics

Change-Id: I46b16d21841e33f2203319407c595553081d18fe
Bug: 190830245
2 files changed