Skip to content

Adjust VTK_AXIS_EPSILON for GetOrientation

David Gobbi requested to merge dgobbi/vtk:transform-axis-epsilon into master

The accuracy of GetOrientation check decreases when the ratio between the largest and smallest scale of the transform (i.e. the condition number) is large. For the sake of stability when using single-precision floats, orientation angles were forced to zero when the ratio was greater than 1000. But VTK switched to double-precision floats a long time ago, and ratios of up to 500000000000 can be tolerated.

In the code, we can change VTK_AXIS_EPSILON from 1e-3 to 2e-12.

Edited by David Gobbi

Merge request reports