Listen to only for join/leave subscriptions

This is to avoid the performance hit while still being able to see
the 'workflow time'.