Plug leaks in time varying animation

Fixes paraview/paraview#16920 (closed)

With a PV batch script that opens can.ex2 and plays through N times, run through valgrind --tool=massif

GL:

master with OSPRay before fix (ZOINKS!):

with OSPRay after the fix:

Backport: paraview/release