A log file is a file, often in clear text, which is generated by a software process to record some specific details about the workings of this process.

learn more… | top users | synonyms

43
votes
1answer
41k views

InnoDB: Error: log file ./ib_logfile0 is of different size

I just added the following lines in /etc/mysql/my.cnf after I converted one database to use InnoDB engine. innodb_buffer_pool_size = 2560M innodb_log_file_size = 256M innodb_log_buffer_size = 8M ...
37
votes
8answers
130k views

How can I read pcap files in a friendly format?

a simple cat on the pcap file looks terrible: $cat tcp_dump.pcap ?ò????YVJ? JJ ?@@.?E<??@@ ?CA??qe?U????иh? .Ceh?YVJ?? JJ ?@@.?E<??@@ ...
31
votes
14answers
26k views

How to monitor a windows log file in real time? [closed]

There is a already question that asks about opening a large log files. But my intention is different. Is there any application that monitors a log file and updates as it is updated in real time? ...
29
votes
10answers
18k views

Convenient Windows equivalent to tail -f logfile?

Is there some convenient alternative to this on Windows? I always miss this away from Linux. And no I don't consider Cygwin or some other bash port to be "convenient". :) Either a small app that'll ...
25
votes
5answers
2k views

Linux server out of space

I have been asked this question in two consecutive interviews, but after some research and checking with various systems administrators I haven't received a good answer. I am wondering if somebody can ...
19
votes
6answers
6k views

Colorize Monitoring of Logs

I sometimes monitor apache and php error logs using tail under FreeBSD. Is there any way to get colorized output, either using tail or some other command line app? Alternatively, what is your ...
19
votes
6answers
27k views

Where is my mysql log on OS X?

I checked /var/log and /usr/local/mysql and i can't seem to find the log. I am trying to troubleshoot an error establishing a database connection with a php function.
18
votes
11answers
20k views

Any freeware IIS log analyzer? [closed]

It would be nice to use ASP.NET, but PHP is ok too, and should be hosted in IIS6. EDIT: the logs are from our intranet site.
18
votes
2answers
10k views

Understanding a Postfix log file entry

We have a Postfix hub and I'm trying to better understand the information in the mail.log file. I use tools like qshape, pflogsumm.pl and amavis-logwatch to summarize the log files, but I have still ...
16
votes
7answers
16k views

Can cron write job output to a log *by default* (instead of mail)?

We all know the right way to handle output from cron jobs is to redirect it to a file: 0 * * * * /bin/date >> /var/log/date.log 2>&1 However, sometimes admins are lazy, forgetful, or ...
14
votes
4answers
9k views

Shell Scripting: Using find to delete files matching a pattern

I'm trying to write a bash command that will delete all files matching a specific pattern - in this case, it's all of the old vmware log files that have built up. I've tried this command: find . ...
14
votes
11answers
7k views

Viewing logs on a remote linux server

Are there any nice tools for doing a 'tail -f' on a remote (linux) server? It would be nice to be able to do something like "taillog server_host /var/log/syslog" to view logs on various servers ...
13
votes
2answers
31k views

How can I display and log PHP errors on IIS7?

We're running PHP 5.2.5 on an IIS 7 Server and we're having problems making PHP errors visible... At the moment whenever we have a PHP error the server sends back a 500 error with the message "The ...
13
votes
7answers
28k views

What is a good SQUID Logs Analyzer?

Can anyone recommend me a good tool for analyzing squid logs ? I'm currently using SARG. Is there something better? I need to easily see what sites were visited/denied, when and by whom. There is ...
12
votes
8answers
3k views

Continuosly monitor logs with tail that are occasionally rotated

We're using tail to continuously monitor several logs, but when a log is rotated the tail for that file will cease. As far as I understand, the problem is that when the log is rotated, there is a new ...
12
votes
3answers
11k views

My /var/log/btmp file is huge! What should I do?

My /var/log/btmp file is 1.3 GB in size. I've read that the file is "Used to store information about failed login". What does this mean for my server? And can i delete this file?
12
votes
6answers
5k views

Is anybody using Splunk in a large-scale production environment?

I've been watching the videos at splunk.com and really it's hard to believe that one can get all those features for free, there's still that "where's the catch?" in the back of my head. So it'd be ...
12
votes
3answers
10k views

what is sensible-mda and do i need it?

I'm running Ubuntu Intrepid, and have been seeing the following my logs: Aug 23 16:01:03 wp1 sm-mta[13700]: n7NFJIad013566: Warning: program /usr/sbin/sensible-mda unsafe: No such file or directory ...
11
votes
4answers
776 views

Which logs to track regularly

I run my own server at home for my personal website running Ubuntu Server with Apache, Bind9 and Django. What logs would you suggest are best to keep track of on a regular basis? (rather than on a ...
11
votes
7answers
3k views

How did you implement log management on your servers?

I'm trying to figure out how other people implement their log management systems. I have 20-30 Linux servers and a few Windows boxes (most of them virtualized). We utilize a lot of Perl and Bash ...
10
votes
3answers
4k views

How do I shrink the size of a SQL Server log file

I can't figure out how to shrink the size of the databases ldf file. The DBA says I should use backup log dbname with truncate_only And while that looks like it executed correctly in SQL Query ...
10
votes
7answers
8k views

“Catch-All” access log with Apache Virtual Hosts?

I have many virtual hosts set up on a web server, each one having its own error and access log. The relevant lines of httpd.conf are something like this: ErrorLog /var/log/httpd-error.log LogFormat ...
10
votes
5answers
1k views

Tips on efficiently storing 25TB+ worth million files in filesystem

Say you are confronted with 25 TB worth uncompressed log files and you have at your disposal an array of 20 commodity boxes with collective free storage capacity of 25 TB. How would you store these ...
10
votes
2answers
19k views

How to enable error log in lighttpd properly?

I have a Centos 5 system with Lighttpd and fastcgi enabled. It does log access but does not log errors. I have Internal Server Error 500 and no info in log and when I try to open not -existing file ...
10
votes
6answers
8k views

Open source tomcat log viewer

I'm managing several tomcat instances (aprox 30-35) and looking for some console to centralize the logs. I tried php-syslog-ng before (no with tomcat), and found it useful. I would like that these ...
9
votes
3answers
12k views

How can I move /var/log directory

on our production server, there is a small drive for the main mount point "/" /var/log is taking much space and I have to manually delete some files. How can I move /var/log/ to let's say /home/log ...
8
votes
1answer
9k views

How to forward specific log file outside of /var/log with rsyslog to remote server?

How can I forward message from a specific log file like /www/myapp/log/test.log with rsyslog client to remote rsyslog server? This log file is outside of the directory /var/log.
8
votes
2answers
12k views

Where is ASP.NET Server Log File is Located?

My ASP.NET MVC application on my development box is running wild; I can't even connected to localhost. In order to know what is the problem, I want to find the log file and examine it. Where is the ...
8
votes
7answers
6k views

Command line tools to analyze Apache log files [closed]

I have a bunch of Apache log files that I would like to analyze. I'm looking for a tool that doesn't require much setup; something that I can run a log through the command line, without messing around ...
8
votes
5answers
7k views

Proper way to rotate Nginx logs

I would like to achieve rotation of nginx logs that: would work without any extra software (i.e. - best if without "logrotate") would create rotated files with names based on date Best approach is ...
8
votes
3answers
9k views

Good Free Tomcat Log Analyser? [closed]

Could someone recommend a good and free program for analysing Apache Tomcat logs. I don't need real-time analysis or anything like that. I have a log and I just want a quick and easy way to get some ...
7
votes
4answers
236 views

get text between keywords in log file

If I have a log file and want to dump only the text between 1234 and 9876 in to another file, how can i do this easily? If I have a text file like this: idsfsvcvs sdf sdf e e sd vs d s g sg s vc ...
7
votes
1answer
3k views

iis 7 log file directory

under my log directory I have a list of subdirectories: W3SVC1, W3SVC2, W3SVC3, etc, etc. How do I mix and match those folders with each website on IIS?
7
votes
4answers
6k views

Fast extraction of a time range from syslog logfile?

I've got a logfile in the standard syslog format. It looks like this, except with hundreds of lines per second: Jan 11 07:48:46 blahblahblah... Jan 11 07:49:00 blahblahblah... Jan 11 07:50:13 ...
7
votes
1answer
2k views

How can I rotate many log files into a different subdirectory per rotation?

I have a directory with many log files, all of which I would like to rotate daily. For organizational purposes I would like to be able to move the rotated logs into a different directory (or ...
7
votes
3answers
689 views

What is the best tool to aggregate traffic stats from multiple nginx servers?

The setup: 2 or more nginx machines each machine has the same virtual hosts traffic is load balanced via DNS to each machine I need to figure out what are the best tools to use to get some traffic ...
6
votes
1answer
268 views

Ultra-efficient compression

I store a very large (TBytes) amount of logs. These logs will rarely be extracted, and when they will - only a single file will be required. Could you recommend an ultra-efficient and extremely ...
6
votes
2answers
13k views

A nice tool to look up make/model via MAC address?

The first several digits of a MAC address (Ethernet ID) are specific to its manufacturer/model. I won't ask what's the best way to look these up since it's subjective... but I'd love to know if any ...
6
votes
5answers
2k views

Is there a good alternative to analog for web server log analysis?

I have been using Analog to analyze the logs of our Apache web server. While analog is quite powerful, I find it quite tedious to set it up correctly to get the information that you want. My question ...
6
votes
4answers
2k views

Rotate logs of a dumb non-interactive application

Ubuntu 10.4 Server. I have a dumb non-interactive legacy service which is running constantly on my server. It is writing its log to a file with fixed name (/var/log/something.log). It does not ...
6
votes
3answers
3k views

Logrotate: Rotating non-log files?

I have a backup script that compresses various files and directories and creates .tgz archives. Files are named, e.g. ... backup_2010-10-28.tar.gz backup_2010-10-29.tar.gz backup_2010-10-30.tar.gz ...
6
votes
3answers
3k views

Logrotate Successful, original file goes back to original size

Has anyone had any issues with logrotate before that causes a log file to get rotated and then go back to the same size it originally was? Here's my findings: Logrotate Script: ...
6
votes
4answers
127 views

How to measure rate of new lines in file (log file)

I'm trying to get a measure of log file line writes over time, ideally a current rate and 1-, 5-, and 15-minute averages. I could do something like this: watch wc -l /var/log/<my_file> .. ...
6
votes
4answers
14k views

logrotate does not compress /var/log/messages

Over time I noticed some logs in /var/log such as auth, kern and messages were getting huge. I made logrotate entries for them: $ cat /etc/logrotate.d/auth.log /var/log/kern.log { rotate 5 ...
6
votes
2answers
1k views

How can I view log files in Linux and apply custom filers while viewing?

(I asked this question on stackoverflow but it might be better off here...) I need to read through some gigantic log files on a Linux system. There's a lot of clutter in the logs. At the moment I'm ...
6
votes
0answers
2k views

Log file rotation and “tail -f”

I use log4j to create rolling log files from my program. It writes to a log file until it reaches 256mb, and then it renames all the log files and creates a new log file and continues logging. It is ...
5
votes
8answers
9k views

Linux monitor logs and email alerts?

I have a server with a faulty power button that likes to reboot itself. Usually there are warning signs, like the acpid log file in /var/log starts spamming garbage for about 10hrs or so. Is there an ...
5
votes
4answers
20k views

How can i fully log all bash scripts actions?

I want to capture ALL the logs data, both with error messages, from my script output, and redirect them all to log file. I have script like below: #!/bin/bash ( echo " `date` : part 1 - start " ssh ...
5
votes
6answers
4k views

Why would anacron not be running?

I have a Ubuntu system that has anacron installed. However I'm pretty sure it's not running. It's not running the commands in /etc/cron.daily to rotate the syslog files (I'm using sysklog, which has ...
5
votes
3answers
4k views

Apache2: how to avoid logging certain missing files into error.log

I'd like to avoid logging some missing files (that gives 404) into error.log. I'm using Apache2. I want to do this on Eclipse update site for my plugin. Problem is that Eclipse P2 code tries to ...