3
votes
1answer
169 views

How can i handle huge log files?

I am running SSD servers because I have great experiences with performance. However I have webservers which serve lots of requests and the uncompresssed logfiles of one day tend to grow out the ...
0
votes
1answer
319 views

How can I compress large log files on Windows 2008 Server?

Some of our log files are > 4GB, and the build-in windows zip will not compress them. I need to get them off the box, and really don't want to download them uncompressed. I can't install any ...
6
votes
1answer
257 views

Ultra-efficient compression

I store a very large (TBytes) amount of logs. These logs will rarely be extracted, and when they will - only a single file will be required. Could you recommend an ultra-efficient and extremely ...
1
vote
3answers
1k views

Is it a Bad Idea to Use Compressed Folders for Log File Archiving?

We have a custom Windows Service in our production environment that for auditing and diagnostic reasons generates log files in the file system. The log files are quite verbose (by necessity) and ...
10
votes
5answers
975 views

Tips on efficiently storing 25TB+ worth million files in filesystem

Say you are confronted with 25 TB worth uncompressed log files and you have at your disposal an array of 20 commodity boxes with collective free storage capacity of 25 TB. How would you store these ...
2
votes
2answers
234 views

Tell if IIS is being asked to serve compressed pages?

I'm trying to find out if our IIS server is being asked to serve pages compressed. I'm a noob regarding a lot of this so am working my way through the issues. We're using IIS 6.0 and have correctly ...
1
vote
4answers
1k views

Concatenating gziped Apache logs

We rotate and compress our Apache logs each day but it's become apparent that this isn't frequently enough. An uncompressed log is about 6G, which is getting close to filling our log partition (yep, ...