Cleanup RecyclerViewCacheTest GapWorker access

Bug: 32018855
Test: Passes now with timeout

Works around issue in timeout threading.

Change-Id: I1df1b48de21d5ada3c8cbd3094216e2ca37443ce
1 file changed