Questions tagged [journald]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
1answer
84 views

Is there a way to make samba (smb,nmb) to not log start/stop events as error?

smbd and nmbd services log a lot of things as errors which clutters my journald logs when I filter it with journalctl -p 3. Is there a way to tell samba to not log start/stop/daemon_ready messages as ...
1
vote
0answers
36 views

Delete old SSH session recordings

Recently I've been testing SSH Session recording in Fedora + Cockpit as a method of auditing. This has been working pretty well, but it records too much information, and more importantly, picked up a ...
0
votes
0answers
76 views

Make journalctl keep all logs forever (SystemMaxUse = unlimited)

How do I configure journald so that it never, ever, ever deletes my logs. Yes, what I want to do is tell journald to keep writing until the disk (read: /var partition's filesystem) is full. No, I don'...
0
votes
0answers
10 views

Configure journald to not store debug priority logs but permit see them with journalctl

I would like to configure journald to do the following: Do not store debug logs on disk Display them if looking at them with journalctl -f I have the following /etc/systemd/journald.conf content: [...
1
vote
0answers
34 views

Connecting to systemd service's standard output/error

I have a simple systemd service that runs for some time and then exits. It usually gets triggered by a systemd timer but sometimes I want to run it manually (well, from a script). The problem is - I ...
0
votes
0answers
76 views

journalctl --list-boots is not listing all boots

I have a Raspberry Pi running a custom Yocto image and it's using systemd-journald for logging. I'm wondering why there is a difference between: root@raspberrypi4:~# journalctl -o verbose | grep -e '...
0
votes
1answer
132 views

Best way to archive journald logs in a space-efficient way?

It has been established that journald logs are huge. On this specific system, the logs grow about 3GB per week. For audit purposes I would like to preserve system logs for a longer time than what can ...
1
vote
0answers
773 views

How do I specify a fail2ban filter/jail where the log is sourced from systemd/journald?

I've got nginx running and logging to systemd / journald. How do I specify the source of the log to be from a systemd unit? In man jail.conf I see for the backends listed as : systemd ...
0
votes
0answers
21 views

journal rate-limiting during shutdown is causing about 2 mins delay

On Ubuntu 18.04, shutdown is slow because of journal doing rate-limiting systemd-journald[291]: Suppressed 775617 messages from init.scope Is there any way to workaround this - either don't perform ...
0
votes
1answer
418 views

Podman rootless journald logging

I'm trying to log to the host's systemd-journald from a rootless podman-container. When i run the container as root with the --privileged flag, i can read the logs from the container on the host with ...
1
vote
0answers
27 views

Journal out of order

Trying to figure out what caused one of our servers (Ubuntu 18.04) to become unresponsive, I was looking through the journal ( journalctl -r) and saw strangely out of order timestamps Apr 17 09:20:...
1
vote
0answers
677 views

Disable “Failed password” ssh logs

Bots are tirelessly trying to log into my server using ssh. That does not bother me, because my passwords are good, but I don't like the fact that ssh spam fills journald logs. I'd like to filter out ...
3
votes
0answers
2k views

journald memory usage on CentOS 7

I have an AWS EC2 instance running a CentOS 7.7.1908 (systemd 219) with a server application. The server logs quite a lot of information to the system logs (using syslog). I have recently enabled ...
1
vote
1answer
847 views

Linux journalctl not synced with systemctl status / Journalctl not updating

I am running my custom service, let's call it "foo.service". It's a gunicorn python process which logs a few things. I used to be able to get a real-time log overview using journalctl -u <service&...
0
votes
1answer
360 views

RateLimitIntervalSec and RateLimitBurst in journald.conf are not working at all

I am trying to see how log drop count in the journald works. In the /etc/systemd/journald.conf file, I modified RateLimitIntervalSec to 1 second and the RateLimitBurst to 2 so that I can see some logs ...
5
votes
2answers
5k views

Is rsyslog redundant on when using journald?

I have noticed log messages are duplicated in journald and /var/log/messages on my CentOS 7 system. At first I thought it was the journald option ForwardToSyslog (which defaults to 'yes' in the ...
2
votes
1answer
1k views

rcu_sched self-detected stall on CPU + watchdog: BUG: soft lockup - CPU#3 stuck for 22s

Being unable to ssh into a machine I connected it to a monitor and found the following: The machine is running Ubuntu Server 18.04 LTS and is a first generation 8 core Ryzen 1700. I've restarted the ...
0
votes
0answers
931 views

systemd-journal Rate Limit

I have a service set up on CentOS 7 which outputs a lot of log messages, which results in this in the system log / journal: systemd-journal[xxxx]: Suppressed 864 messages from /system.slice/example....
1
vote
0answers
401 views

journald forwarding to syslog seems to be lagged

I'm seeing an issue on a Ubuntu 16.04 box where the copying/forwarding of journal messages to /var/log/syslog seems to be delayed: theuser@host:/etc/systemd$ sudo journalctl -n 1 && sudo tail ...
2
votes
0answers
79 views

sudo log entries don't show username on Debian Stretch

For some reason, the username of the user calling a command with sudo is not shown in the system log: $ journalctl -ef sudo[30160]: pam_unix(sudo:session): session opened for user root by (uid=0) ...
1
vote
1answer
125 views

`journalctl -f -m` does not interleave remote and local

I currently have a 2-server setup (3 servers in total, one still to be configured for this) with one server using systemd-journal-remote (.socket & .service) to collect all log entries from the ...
1
vote
2answers
3k views

Clearing “/var/log/journal”

I want to clear my "/var/log/journal" directory. I'm using debian 8 root@nyc3-x8:/var/log# uname -a Linux nyc3-x8 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux And my ...
3
votes
3answers
8k views

System logs are empty (/var/log/messages; /var/log/secure; etc)

I found that rsyslog stopped writing on logs (messages; secure; cron;etc) System information: NAME="Red Hat Enterprise Linux Server" VERSION="7.4 (Maipo)" ID="rhel" ID_LIKE="fedora" VARIANT="Server" ...
1
vote
0answers
214 views

system freeze after systemd-tmpfiles-clean executed

recently i got a problem, i run mysql on docker with k8s , the system load getting high in 2 days from 1->500+, the /var/log/messages infomation: Aug 17 19:50:07 SVR5798HW1288 dockerd[1890]: time="...
5
votes
1answer
7k views

How to filter journalctl output by process name?

When a process logs to systemd, its process name is recorded and displayed as identifier in the journalctl output. $ systemd-cat echo "test" $ journalctl -f -- Logs begin at Sat 2018-02-24 12:13:24 ...
1
vote
1answer
747 views

journalctl --follow isn't advancing

I have a program that continually reads the output of: journalctl -o json --follow And sends it to another process. And while it outputs journal entries initially from the tail, new ones don't ...
1
vote
1answer
2k views

Systemd python service buffers journalctl output even with -u

I have a simple user systemd service configured like so: [Unit] Description=Bot AssertPathExists=/home/mikel/discord-bot/ [Service] WorkingDirectory=/home/mikel/discord-bot/ ExecStart=/home/mikel/...
1
vote
0answers
301 views

redundant systemd-journal-remote for systemd-journal-upload instances

I'm using systemd-journal-upload on serveral nodes to forward their journals to a single systemd-journal-remote sink, loghost01: /var/log/journal ├── <foo-bar> │   ├── system.journal │   └── ...
3
votes
1answer
1k views

systemd-journald system logs are not persistent across boots despite Storage=persistent

I recently got a problem with systemd not preserving logs from previous boots. I checked several answers here and elsewhere but haven't found a solution. the problem is that the user log gets ...
7
votes
3answers
3k views

Why are journald logfiles so huge?

When I do a journalctl --disk-usage it says something about 300MB size of the journal files but when I look at the actual text with journalctl | wc -c it's something about 28MB. Well, journald has ...
1
vote
0answers
381 views

Journald allow a user to read one unit's logs

tl;dr How can I allow a normal user to read one systemd service's logs? Long question Environment: CentOS 7 A user needs access to his service's logs, which are by default consumed by journald. I can ...
1
vote
1answer
183 views

Journald does not log error messages before failing exit of program

I'm invoking a python3 module using systemd (version: systemd 232) on debian stretch. The problem is, if the python module raises an exception, the exception message (stderr) and some prior prints (...
5
votes
5answers
11k views

reliable export of journalctl logs

I search a way for a reliable export of journalctl logs. I could use the --since=... option, but this is a bit fuzzy. In my case a script would call journalctl --output=json every ten minutes. I ...
1
vote
0answers
583 views

Unable to turn logging down on isc-dhcp-server on ubuntu xenial

I edited /etc/dhcp/dhcpd.conf and set log-facility local4; I've also edited /etc/systemd/system.conf and set LogLevel=notice I've verified that the log level is set to notice with the command. ...
1
vote
1answer
465 views

Remove nginx log prefix

I configured nginx to log in this format log_format lalala '$remote_addr - $remote_user '; access_log syslog:server=unix:/dev/log lalala; However, every line starts with: testserver nginx: ...
1
vote
1answer
473 views

journald: extract part of a system journal into the journald format (i.e. for use with journalctl)

I have a situation where it would be really useful to attach the relevant bits of the system logs to a bug ticket. The system in question uses journald and I rather like using journalctl to inspect ...
0
votes
1answer
455 views

Using journald without systemd?

I would like to use journald within a container without systemd. Is this possible? If so, how to do this? What are the issues to take care?
2
votes
2answers
2k views

Turn off buffering in systemd unit-file?

When I write my unit-file I want all output from Exec*-options (ExecStartPre=, ExecStartPost=, ExecStart=, and ExecStopPost=) to be sent to the journal. But apparently the output is buffered in some ...
2
votes
1answer
951 views

How to write multiline log entry to journald?

My NodeJS-based service writes multiline logs using console.log to journald. However, logs get broken down on each new line (\n). How can I have a multiline message in a single log entry? Thank you!
0
votes
1answer
585 views

Q: journalctl to prefix message with own meta data?

How would one prefix journald log entries with metadata within the log message? I'm thinking I may have to view one of the verbose outputs, filter out line breaks and all extra info, find just the ...
1
vote
1answer
2k views

httpd.service is reloaded or killed

On a new CentOS7 server, I got the issue, that every night the httpd.service is getting reloaded. And sometimes, around same time, it is getting just killed. systemctl status httpd: ● httpd.service -...
0
votes
1answer
6k views

High CPU usage with systemd-journal 219 on CentOS

systemd-journal seems to have hig CPU usage, compare to HAProxy that is the actual service on the node: 385 root 20 0 69948 26152 25776 S 3.0 0.2 0:04.05 systemd-journal 22509 ...
2
votes
1answer
1k views

Systemd journal files smaller than SystemMaxFileSize

I have a system running CentOS 7, with more than 1T free disk space. The systemd version is 219. I have configured journald with the following settings: Storage=persistent SplitMode=none SystemMaxUse=...
1
vote
0answers
327 views

CoreOS logs flooded with “Unknown permission status for class system”

I am trying to debug an issue, and I was wondering if this rings a bell to anyone: My logs get flooded with audit: type=1107 audit(1479418315.344:1053): pid=1 uid=0 auid=4294967295 ses=4294967295 ...
1
vote
1answer
227 views

How to combat journal spam: unit-specific MaxLevel* settings?

I know about MaxLevelStore, MaxLevelSyslog, MaxLevelKMsg, MaxLevelConsole, MaxLevelWall but the problem with them is, they affect all units. Trouble is, not all developers *cough* kde *cough* gtk *...
40
votes
2answers
32k views

How do view older journalctl logs (after a rotation maybe?)

I am running docker on ubuntu 16.04 and would like to view the logs. However, I am unable to view logs after what I am guessing is some sort of rotation or the logs grow to a certain size. I have not ...
3
votes
1answer
1k views

Not seeing logs for program managed by systemd

I'm using systemd to manage a program on Ubuntu 16. I can't seem to get the logs from the program to output to journalctl or /var/log/syslog. The journald configuration is the default, which should ...
2
votes
2answers
5k views

Systemd: Default log output format

I am wondering if the default output for journalctl can be adjusted. Such that a custom pattern can be supplied. For example I would like to: display the log level (e.g. priority) configure fixed ...
0
votes
1answer
861 views

Journalling stdout with systemd when running as specific user

Consider the following test-echo.service: [Unit] Description=Testing journalling of stdout [Service] ExecStart=/bin/echo hello world [Install] WantedBy=multi-user.target Its stdout ends up in the ...
7
votes
3answers
9k views

systemd-journald Doesn't start at all

After deleting my /var/log/journal by accident, I am unable to recover from the consequences. systemd-journald keeps failing over and over again every time I try to start it. when I run: $ journalctl ...