Reputation
412
Top tag
Next privilege 500 Rep.
Access review queues
Badges
4 11
Newest
 Announcer
Impact
~36k people reached

  • 0 posts edited
  • 0 helpful flags
  • 52 votes cast
Apr
10
comment store log files in the cloud, when servers are not in the cloud
That also sounds like a doable thing, thank you. I'm concerned about price. It's up to 2.5TB of compressed logs (for a 5 year interval). Just storing the zipped files in S3 is cheap - but then of course it's hard to search. I really need to figure out how much more expensive is it to keep data in large S3 volumes.
Apr
10
comment store log files in the cloud, when servers are not in the cloud
Thank you! We've talked about using Splunk before, so this combination might be acceptable (since it's sort-of in the same ballpark). Additionally, it sounds like it might also work and be useful after we've migrated the whole thing into the cloud. Question from someone not familiar with ES: in addition to indexes, I'd have to also store the actual data in S3, right? And that might introduce some overhead? Also, is the data stored in compressed form?
Apr
10
asked store log files in the cloud, when servers are not in the cloud
Feb
13
awarded  Yearling
Feb
12
comment How to keep: daily backups for a week, weekly for a month, monthly for a year, and yearly after that
I actually don't have separate directories. It was written to dump files into an S3 bucket. Once everything is in one place, the total amount of logic that you need to implement is about the same, no matter how you go about it.
Feb
12
awarded  Editor
Feb
12
revised How to keep: daily backups for a week, weekly for a month, monthly for a year, and yearly after that
moved solution out of main post
Feb
12
comment daily, weekly, yearly backup script
Take a look at my script: serverfault.com/questions/575163/…
Feb
12
comment How to logrotate daily backups?
Take a look at my script: serverfault.com/questions/575163/…
Feb
12
asked How to keep: daily backups for a week, weekly for a month, monthly for a year, and yearly after that
Sep
3
asked How to configure Postfix to use multiple IP aliases for sending out email?
Aug
29
comment Nagios: parent host is not supressing recovery messages from child host services
@Keith - that's interesting and makes sense. Something else is messing with the logic then. I'll have to look into it. Thanks.
Aug
26
asked Nagios: parent host is not supressing recovery messages from child host services
Jun
28
accepted Please recommend a book re: Amazon AWS and EC2
Jun
27
asked Please recommend a book re: Amazon AWS and EC2
Oct
30
awarded  Yearling
Jun
13
awarded  Popular Question
Mar
26
answered Ubuntu 9.10: how do I troubleshoot a startup script that doesn't appear to run?
Mar
26
answered Why is this file hidden when you run ls?
Dec
19
answered Does a file system lose performance as it fills up?