Refactored how pieces and extents are handled.
Refactoring the way VTK goes between piece and structured extents. Before, extent translators were used when the pipeline moved from structured to unstructured data converting piece request to extent request. This caused many problems with filters that altered extents, mainly a lot of redundant IO due to repartitioning of different extents. This became extremely cumbersome to manage when running distributed. The new behavior pushes the extent translation all to way to the readers and only when readers are able to read a subset. This works much better. The only downside is that filters need to be able to handle data extents different than update extents. Most filters can do this but many imaging filters cannot. Those that are needed in parallel will have to be updated. As part of this work, I also removed MAXIMUM_NUMBER_OF_PIECES and added CAN_HANDLE_PIECE_REQUEST. MAXIMUM_NUMBER_OF_PIECES had reduced to being a boolean. 1 for serial sources, -1 for parallel sources. I removed it and added a CAN_HANDLE_PIECE_REQUEST instead. This key, produced by a source, tells the executive that a source is able to handle piece request. It is a source only key produced in RequestInformation and is not propagated downstream. If this key is not present, the executive will only execute the source for piece 0 to produce the entire data. It is then up to the user to add a filter that splits the data for other piece requests. The only exception to this is when CAN_PRODUCE_SUB_EXTENT is present, in which case the executive will split using an extent translator AT THE source - not downstream. Conflicts: Filters/FlowPaths/vtkParticleTracerBase.cxx Change-Id: I8db4040289ff87331adeecded4a738313d9b52df
Showing
- Common/DataModel/vtkDataObject.cxx 2 additions, 0 deletionsCommon/DataModel/vtkDataObject.cxx
- Common/DataModel/vtkDataObject.h 1 addition, 0 deletionsCommon/DataModel/vtkDataObject.h
- Common/DataModel/vtkDataSet.cxx 8 additions, 9 deletionsCommon/DataModel/vtkDataSet.cxx
- Common/DataModel/vtkDataSet.h 3 additions, 6 deletionsCommon/DataModel/vtkDataSet.h
- Common/DataModel/vtkExtentTranslator.h 4 additions, 5 deletionsCommon/DataModel/vtkExtentTranslator.h
- Common/ExecutionModel/vtkAlgorithm.cxx 1 addition, 0 deletionsCommon/ExecutionModel/vtkAlgorithm.cxx
- Common/ExecutionModel/vtkAlgorithm.h 7 additions, 0 deletionsCommon/ExecutionModel/vtkAlgorithm.h
- Common/ExecutionModel/vtkCastToConcrete.cxx 1 addition, 4 deletionsCommon/ExecutionModel/vtkCastToConcrete.cxx
- Common/ExecutionModel/vtkCompositeDataPipeline.cxx 17 additions, 54 deletionsCommon/ExecutionModel/vtkCompositeDataPipeline.cxx
- Common/ExecutionModel/vtkCompositeDataPipeline.h 0 additions, 2 deletionsCommon/ExecutionModel/vtkCompositeDataPipeline.h
- Common/ExecutionModel/vtkCompositeDataSetAlgorithm.cxx 0 additions, 23 deletionsCommon/ExecutionModel/vtkCompositeDataSetAlgorithm.cxx
- Common/ExecutionModel/vtkHierarchicalBoxDataSetAlgorithm.cxx 0 additions, 23 deletionsCommon/ExecutionModel/vtkHierarchicalBoxDataSetAlgorithm.cxx
- Common/ExecutionModel/vtkMultiBlockDataSetAlgorithm.cxx 0 additions, 23 deletionsCommon/ExecutionModel/vtkMultiBlockDataSetAlgorithm.cxx
- Common/ExecutionModel/vtkMultiTimeStepAlgorithm.cxx 0 additions, 10 deletionsCommon/ExecutionModel/vtkMultiTimeStepAlgorithm.cxx
- Common/ExecutionModel/vtkStreamingDemandDrivenPipeline.cxx 189 additions, 305 deletionsCommon/ExecutionModel/vtkStreamingDemandDrivenPipeline.cxx
- Common/ExecutionModel/vtkStreamingDemandDrivenPipeline.h 13 additions, 36 deletionsCommon/ExecutionModel/vtkStreamingDemandDrivenPipeline.h
- Common/ExecutionModel/vtkTrivialProducer.cxx 63 additions, 46 deletionsCommon/ExecutionModel/vtkTrivialProducer.cxx
- Common/ExecutionModel/vtkTrivialProducer.h 17 additions, 0 deletionsCommon/ExecutionModel/vtkTrivialProducer.h
- Common/ExecutionModel/vtkUniformGridAMRAlgorithm.cxx 0 additions, 23 deletionsCommon/ExecutionModel/vtkUniformGridAMRAlgorithm.cxx
- Filters/Core/vtkCleanPolyData.cxx 0 additions, 23 deletionsFilters/Core/vtkCleanPolyData.cxx
Loading
Please register or sign in to comment