The vtkImageResliceMapper was needlessly recomputing.
The ResliceNeedUpdate flag was not being reset after each update. It looks like the developer (myself) was playing with this flag during a debugging session, and forgot to set it to the correct value before committing the code.