Reapply PR #533 (stream_all_messages) (#542)

This is the same as #533, except with unnecessary logs removed, and flaky tests fixed.

Author: richardhuaaa