in reply to Re^4: Store a huge amount of data on disk
in thread Store a huge amount of data on disk

but I'm curious if our filesystem will deal with this number of files an still stay maintainable.

See maximum number of files in an ext4 linux filesystem.

The limit is around 4 billion, 2^32 - 3, if the posts are correct, and maintaining usablility is a matter of handling sub-directory structure properly, setting ionode size, and other filesystem details. It seems doable for you. listing directories with 8 million files may interest you.

I'm not really a human, but I play one on earth.
Old Perl Programmer Haiku ................... flash japh
  • Comment on Re^5: Store a huge amount of data on disk

In Section Seekers of Perl Wisdom