I'm seeking the answer to the question: Is MogileFS appropriate choice for storing and serving large files? Extra questions: If not, than what is the recommendable maximum file sizes stored? The application is web file/photo storing and sharing site. Users accesses the web front-end, which serves the files.
I mean, is it effective solution for that? I have read, that it's devised to small files, like thumbs, images and so.
Is there really a ~ 33% base64 overhead and it cannot be avoided?
The file sizes mostly are 100MB to 2000MB. In the soon future, there will be occasional need for larger files, I guess up to 8 - 16GB.
But the most traffic is on medium-sized files. And there is typical situation, when some files, for some time period (weeks) is very popular.
I'm also looking at Hadoop HDFS and GlusterFS. If any comments on that very appreciated. I guess, each of the 2U servers might have around 300Mbit traffic per sec.
