Questions tagged [log-files]
A log file is a file, often in clear text, which is generated by a software process to record some specific details about the workings of this process.
64
questions
76
votes
16answers
61k views
Alternatives to Splunk?
I'm pretty impressed with Splunk, especially version 4. Pretty graphs, alerting (Enterprise only), and fast, accurate, searching. It's a great product.
However, the cost just way too high to consider ...
31
votes
6answers
4k views
Linux server out of space
I have been asked this question in two consecutive interviews, but after some research and checking with various systems administrators I haven't received a good answer. I am wondering if somebody can ...
12
votes
5answers
14k views
Fast extraction of a time range from syslog logfile?
I've got a logfile in the standard syslog format. It looks like this, except with hundreds of lines per second:
Jan 11 07:48:46 blahblahblah...
Jan 11 07:49:00 blahblahblah...
Jan 11 07:50:13 ...
27
votes
2answers
89k views
How to forward specific log file outside of /var/log with rsyslog to remote server?
How can I forward message from a specific log file like /www/myapp/log/test.log with rsyslog client to remote rsyslog server? This log file is outside of the directory /var/log.
8
votes
4answers
5k views
Rotate logs of a dumb non-interactive application
Ubuntu 10.4 Server.
I have a dumb non-interactive legacy service which is running constantly on my server.
It is writing its log to a file with fixed name (/var/log/something.log).
It does not ...
18
votes
11answers
28k views
Any freeware IIS log analyzer? [closed]
It would be nice to use ASP.NET, but PHP is ok too, and should be hosted in IIS6.
EDIT: the logs are from our intranet site.
11
votes
2answers
4k views
Strange Bittorrent Log On My Server
I don't know if the following log has something to do with my site being down sometime. I have lot of websites on my server and they don't have any logs like the following:
117.169.1.85 - - [03/Jan/...
7
votes
3answers
7k views
Avoid logging of certain missing files into the Apache2 error log
I'd like to avoid logging some missing files (that gives a 404) into the Apache2 error log.
I want to do this on an Eclipse update site for my plugin. Problem is that the Eclipse P2 code tries to ...
30
votes
6answers
75k views
How can I display and log PHP errors on IIS7?
We're running PHP 5.2.5 on an IIS 7 Server and we're having problems making PHP errors visible... At the moment whenever we have a PHP error the server sends back a 500 error with the message "The ...
30
votes
10answers
46k views
Convenient Windows equivalent to tail -f logfile?
Is there some convenient alternative to this on Windows? I always miss this away from Linux. And no I don't consider Cygwin or some other bash port to be "convenient". :)
Either a small app that'll ...
38
votes
2answers
38k views
Understanding a Postfix log file entry
We have a Postfix hub and I'm trying to better understand the information in the mail.log file. I use tools like qshape, pflogsumm.pl and amavis-logwatch to summarize the log files, but I have still ...
6
votes
6answers
20k views
Send email alert on log file entry?
Under Linux, what's a simple way to automatically watch a logfile, and email me if a certain string appears? I have an application that will log certain failures to a logfile, but has no built-in way ...
26
votes
1answer
30k views
How to set up fail2ban to read multi log in a jail?
How can I configure multiple logpaths for the same rule?
I'm trying to write a syntax like this:
[apache-w00tw00t]
enabled = true
filter = apache-w00tw00t
action = iptables-allports
logpath = /...
11
votes
4answers
24k views
In unix, what's the best way to reduce the size of a massive log file that is actively being written to?
On a linux server, I want to reduce the size of a log file which is several GB big. Cutting off the top half, or maybe the first million lines would work.
13
votes
4answers
17k views
Logrotate Successful, original file goes back to original size
Has anyone had any issues with logrotate before that causes a log file to get rotated and then go back to the same size it originally was? Here's my findings:
Logrotate Script:
/var/log/mylogfile....
5
votes
4answers
2k views
Strange stuff in apache log
I'm building some kind of webapp, and currently the whole thing runs on my machine. I was combing down my logs, and found several "strange" log entries that made me a bit paranoid. Here goes:
***.***....
149
votes
6answers
588k views
How can I read pcap files in a friendly format?
a simple cat on the pcap file looks terrible:
$cat tcp_dump.pcap
?ò????YVJ?
JJ
?@@.?E<??@@
?CA??qe?U????иh?
.Ceh?YVJ??
JJ
?@@.?E<??@@
CA??qe?U????еz?...
78
votes
8answers
113k views
Where is my mysql log on OS X?
I checked /var/log and /usr/local/mysql and i can't seem to find the log. I am trying to troubleshoot an error establishing a database connection with a php function.
67
votes
4answers
132k views
What is the difference between syslog, rsyslog and syslog-ng? [closed]
I am a bit confused in syslog, rsyslog and syslog-ng.
From where can I get the source code for syslog()?
Is there any difference between rsyslog and rsyslogd?
108
votes
1answer
148k views
InnoDB: Error: log file ./ib_logfile0 is of different size
I just added the following lines in /etc/mysql/my.cnf after I converted one database to use InnoDB engine.
innodb_buffer_pool_size = 2560M
innodb_log_file_size = 256M
innodb_log_buffer_size = 8M
...
33
votes
8answers
25k views
Colorize Monitoring of Logs
I sometimes monitor apache and php error logs using tail under FreeBSD. Is there any way to get colorized output, either using tail or some other command line app?
Alternatively, what is your ...
25
votes
3answers
28k views
what is sensible-mda and do i need it?
I'm running Ubuntu Intrepid, and have been seeing the following my logs:
Aug 23 16:01:03 wp1 sm-mta[13700]: n7NFJIad013566: Warning: program /usr/sbin/sensible-mda unsafe: No such file or directory
...
6
votes
5answers
5k views
Is there a good alternative to analog for web server log analysis?
I have been using Analog to analyze the logs of our Apache web server. While analog is quite powerful, I find it quite tedious to set it up correctly to get the information that you want.
My question ...
1
vote
2answers
3k views
Fast script to cut section of logfile based on timestamp
I am looking for a fast script that will parse a large mail.log, and return the portion between two specified timestamps. I would like to run it on all of my mailservers, and have them copy the ...
13
votes
8answers
30k views
Linux monitor logs and email alerts?
I have a server with a faulty power button that likes to reboot itself. Usually there are warning signs, like the acpid log file in /var/log starts spamming garbage for about 10hrs or so.
Is there an ...
12
votes
4answers
28k views
Is there a way to remove “Last message repeated x times” from logs?
I have a script that updates me on any changes to the kernel log on my (Debian) servers.
The problem is that occasionally the log contains lines like:
last message repeated 4 times
I realize that ...
12
votes
6answers
6k views
Is anybody using Splunk in a large-scale production environment? [closed]
I've been watching the videos at splunk.com and really it's hard to believe that one can get all those features for free, there's still that "where's the catch?" in the back of my head.
So it'd be ...
7
votes
7answers
21k views
Get list of user-agents from nginx log
I have nginx log file, and I want to find out market share for each major version of browsers. I am not interested in minor versions and operating systems. I would like to get something like this:
...
7
votes
1answer
20k views
nginx not logging errors to log files
I recently moved my CentOS 7 machine from Apache to nginx, and I am still working out the differences. One issue I have noticed for only one of my server blocks is that access and error log files are ...
0
votes
5answers
2k views
Windows Server Event Log Collection and Analysis
Does anybody know of a good tool to collect and analyse the application logs from a number of different Windows servers running on VMWare? All servers are on the same domain.
Ideally the tool would ...
12
votes
6answers
18k views
Open source tomcat log viewer
I'm managing several tomcat instances (aprox 30-35) and looking for some console to centralize the logs.
I tried php-syslog-ng before (no with tomcat), and found it useful. I would like that these ...
6
votes
4answers
3k views
Is there any alternate to logrotate for apache logs?
I need an alternate for rotating logs on my server, everytime logrotate runs apache goes down for like 10-20 minutes, i'm not sure if this is right, but don't seem right for me.
Is there any ...
4
votes
1answer
3k views
I need to monitor a log file with monit if the file does not change monit will alert
I need help. I was looking in to Monit documentation and I need help. I could not find my answer there. I need to monitor a log file of a service, if that log file stops to increase in size or even ...
2
votes
4answers
3k views
A script to geo-locate ip addresses in auth.log
Is there a way to automatically geo-locate an ip-address on Ubuntu linux? I'm looking to do this for errors in my auth.log.
10
votes
1answer
3k views
iis 7 log file directory
under my log directory I have a list of subdirectories: W3SVC1, W3SVC2, W3SVC3, etc, etc. How do I match those folders with each website on IIS?
5
votes
5answers
13k views
Is Apache stalled? /server-status shows over 240 requests like “OPTIONS * HTTP/1.0” 200 - “-” “Apache (internal dummy connection)”
Some details:
Webserver: Apache/2.2.13 (FreeBSD) mod_ssl/2.2.13 OpenSSL/0.9.8e
OS: FreeBSD 7.2-RELEASE
This is a FreeBSD Jail.
I believe I use the Apache 'prefork' MPM (I run the default for FreeBSD)...
5
votes
2answers
19k views
init script that logs output of the script
How can this be done? I know it's pretty simple and includes appending something like & or &> to the actual command that starts the init script.
But, what is the best approach and how can ...
4
votes
2answers
4k views
Can I delete access log files in nginx. Will it cause an issue
My access log file takeing more than 100 Go can i delete safely the access log file
Could i delete it as root ?
Can other users access to this file after recreating it ?
3
votes
0answers
838 views
Windows 10 KVM guests cause Ubuntu 20.04 host to crash (revised)
I got extremely confused and decided to re-write the question from scratch, so if some of the comments do not make sense, that is why. Apoplogies to anyone whose time I wasted.
I am having a problem ...
2
votes
1answer
5k views
Extending the Windows Task Scheduler log file
The windows task scheduler logs the results of each task run in a file named Schedlgu.txt in the windows directory.
This file is automatically rotated when it reaches a certain size. Is there any ...
2
votes
3answers
4k views
What is a good sendmail log analyzer?
We had a recent event where one of two servers running sendmail stopped sending mail, and built up a 7000 message queue before we noticed / fixed it. It's fixed now, but we don't know why it failed, ...
9
votes
1answer
3k views
Newsyslog wildcards - rotate all logs in a directory
I am running FreeBSD 8.1. I am trying to make newsyslog rotate logs defined by a dynamic path:
# logfilename [owner:group] mode count size when flags [/pid_file] [sig_num]
/path/logs/*....
6
votes
3answers
10k views
how to make `atop` create less log files?
Currently I have like 3.5GB of atop log files at
/var/log/atop/
I do not need that much log data.
Files there are as old as 28 days ago.
I cannot find a way to configure atop log limit/quota/age.
...
4
votes
1answer
404 views
What do repeating '^@' symbols in a logfile mean?
A few times I have come across this in a log file:
Sep 17 09:35:57 00187d378926 ovpn-00187d378926[1701]: /sbin/ifconfig tun0 0.0.0.0
Sep 17 09:35:57 00187d378926 kernel: Kernel logging (proc) stopped....
4
votes
2answers
15k views
How to grep httpd error_log within a time range?
How can I grep only lines from a huge (120GB) httpd error_log based on a time range, say:
from 2011-11-15 11:30 pm
to 2011-11-16 01:30 am
Thanks!
3
votes
2answers
6k views
How to make apache log files readable by apache
I would like to make apache access log file readable by www-data (the user running the webserver) so I can serve it over HTTPS, to save me the trouble of SSHing to the server every time I want to ...
2
votes
2answers
937 views
Analyse IIS Log Files
I've got an IIS6 server with a boat load of log files.
What good tools are there that I can't use to get a decent amount of detail from the logs?
2
votes
3answers
2k views
Getting correct linefeeds in emails generated from linux
I have a script that emails certain linux log entries to me, and I read the email in MS Outlook.
The problem is that all the lines run together with no linefeeds between the lines.
To address this I ...
2
votes
1answer
2k views
Rotate other logs with rotatelogs.exe
On my machine there is some process which is writing a log in C:\Application.log. Now I want to rotate the logs file without stopping that application. On the same machine I have apache 2.2. As I know ...
2
votes
1answer
3k views
Apache Accessing System Environment Variables (for Log File Location)
Is there a way to let Apache access the system environment variables? I know it has its own environment and can pass them to spawned processes like PHP, but is there a way to let the server itself ...
