Skip to content

GitLab

  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • ParaView ParaView
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 1,842
    • Issues 1,842
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 88
    • Merge requests 88
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • ParaView
  • ParaViewParaView
  • Issues
  • #17406

Closed
Open
Created May 02, 2017 by W. Alan Scott@wascottMaintainer

Speed up file open for Exodus and CTH

Please speed up file opens for Exodus and CTH. Specifically, please speed up the display of file names when you get to a directory that has data in it. We sometimes have directories that have hundreds of thousands to millions of files. Other times we have a few hundred or thousand files, but they may be up to tens of gigabytes each. This can lock up the opening of these directories for minutes or tens of minutes in ParaView.

Reference for this work: http://blog.schmorp.de/2015-07-12-how-to-scan-directories-fast-the-tricks-of-aio_scandir.html

After a quick read, the trick is to stop doing a stat of all files in the data directory. Data directories often have no subdirectories, and you can find this out by using a 'stat .'. If you have only two links (i.e., one for . and one for ..), don't look for subdirectories! Then, one idea to get all of the file names would be to use 'find .' Do a man on find, and read the noleaf option.

Give the option in settings to turn this feature on or off (since we may find it causes bugs on some systems).

To upload designs, you'll need to enable LFS and have an admin enable hashed storage. More information
Assignee
Assign to
Time tracking