The temporal interpolator did not cache its input, causing it
to request the input repeatedly when streaming over time. Fixed.

Change-Id: Iacb8219f8ec95bc04f69ab301eb4ccb606a6873e