Revert^2 "Frozen-aware RemoteCallbackList"

This is a clean revert. The revert^1 did not fix the
perf regression so now reverting the revert.

This reverts commit 41c9c1795be05a55a51d1622c2d63f241dcc1a8e.

Reason for revert: b/361157077

Change-Id: Iba5b9c9e52f4b4d892bd3d553dcf504bf7498597
API-Coverage-Bug: 372923111
2 files changed