sourcestream: Allocate the buffer outside together with the pods

They are part of the buffer and we need to make sure the buffer has a
larger lifespan than the pods.