Questions tagged [journald]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
48 views

Podman rootless journald logging

I'm trying to log to the host's systemd-journald from a rootless podman-container. When i run the container as root with the --privileged flag, i can read the logs from the container on the host with ...
0
votes
0answers
12 views

Journal out of order

Trying to figure out what caused one of our servers (Ubuntu 18.04) to become unresponsive, I was looking through the journal ( journalctl -r) and saw strangely out of order timestamps Apr 17 09:20:...
0
votes
0answers
24 views

Disable “Failed password” ssh logs

Bots are tirelessly trying to log into my server using ssh. That does not bother me, because my passwords are good, but I don't like the fact that ssh spam fills journald logs. I'd like to filter out ...
1
vote
0answers
364 views

journald memory usage on CentOS 7

I have an AWS EC2 instance running a CentOS 7.7.1908 (systemd 219) with a server application. The server logs quite a lot of information to the system logs (using syslog). I have recently enabled ...
0
votes
1answer
169 views

Linux journalctl not synced with systemctl status / Journalctl not updating

I am running my custom service, let's call it "foo.service". It's a gunicorn python process which logs a few things. I used to be able to get a real-time log overview using journalctl -u <service&...
0
votes
0answers
78 views

Sending a multi-line log to journal using logger (1) or systemd-cat (1)

I often use logger (1) to output random logs. Like: ExecStart=/bin/bash -c "curl -vs http://... >/var/run/mycurl/status 2>&1" ExecStopPost=-/bin/bash -c "[[ $SERVICE_RESULT == success ]] || ...
0
votes
0answers
29 views

Redirected program output goes to journald instead of log file when started from cronjob

I have several (Linux) programs, started using bash scripts. In such a simple bash script the output of the program is redirected to a log file. #!/bin/bash /path/myprogram 1>> /path/logs/...
0
votes
0answers
64 views

Docker time-based log rotation

Currently docker supports file sized base log rotation if using a json-driver. What I need is time based log rotation (lets say hourly). Using *nix logrotate is not an option, since it's losing logs ...
0
votes
1answer
130 views

RateLimitIntervalSec and RateLimitBurst in journald.conf are not working at all

I am trying to see how log drop count in the journald works. In the /etc/systemd/journald.conf file, I modified RateLimitIntervalSec to 1 second and the RateLimitBurst to 2 so that I can see some logs ...
0
votes
0answers
64 views

Configure Log Rotation for Remote Logs

After setting up remote systemd log shipping according to this question Ubuntu doesn't appear to be rotating the remote logs in /var/log/journal/remote. How can I setup log rotation on the node ...
3
votes
1answer
2k views

Is rsyslog redundant on when using journald?

I have noticed log messages are duplicated in journald and /var/log/messages on my CentOS 7 system. At first I thought it was the journald option ForwardToSyslog (which defaults to 'yes' in the ...
2
votes
0answers
881 views

rcu_sched self-detected stall on CPU + watchdog: BUG: soft lockup - CPU#3 stuck for 22s

Being unable to ssh into a machine I connected it to a monitor and found the following: The machine is running Ubuntu Server 18.04 LTS and is a first generation 8 core Ryzen 1700. I've restarted the ...
0
votes
0answers
534 views

systemd-journal Rate Limit

I have a service set up on CentOS 7 which outputs a lot of log messages, which results in this in the system log / journal: systemd-journal[xxxx]: Suppressed 864 messages from /system.slice/example....
1
vote
0answers
299 views

journald forwarding to syslog seems to be lagged

I'm seeing an issue on a Ubuntu 16.04 box where the copying/forwarding of journal messages to /var/log/syslog seems to be delayed: theuser@host:/etc/systemd$ sudo journalctl -n 1 && sudo tail ...
2
votes
0answers
66 views

sudo log entries don't show username on Debian Stretch

For some reason, the username of the user calling a command with sudo is not shown in the system log: $ journalctl -ef sudo[30160]: pam_unix(sudo:session): session opened for user root by (uid=0) ...
0
votes
1answer
75 views

`journalctl -f -m` does not interleave remote and local

I currently have a 2-server setup (3 servers in total, one still to be configured for this) with one server using systemd-journal-remote (.socket & .service) to collect all log entries from the ...
1
vote
2answers
2k views

Clearing “/var/log/journal”

I want to clear my "/var/log/journal" directory. I'm using debian 8 root@nyc3-x8:/var/log# uname -a Linux nyc3-x8 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux And my ...
3
votes
2answers
4k views

System logs are empty (/var/log/messages; /var/log/secure; etc)

I found that rsyslog stopped writing on logs (messages; secure; cron;etc) System information: NAME="Red Hat Enterprise Linux Server" VERSION="7.4 (Maipo)" ID="rhel" ID_LIKE="fedora" VARIANT="Server" ...
1
vote
0answers
145 views

system freeze after systemd-tmpfiles-clean executed

recently i got a problem, i run mysql on docker with k8s , the system load getting high in 2 days from 1->500+, the /var/log/messages infomation: Aug 17 19:50:07 SVR5798HW1288 dockerd[1890]: time="...
4
votes
1answer
4k views

How to filter journalctl output by process name?

When a process logs to systemd, its process name is recorded and displayed as identifier in the journalctl output. $ systemd-cat echo "test" $ journalctl -f -- Logs begin at Sat 2018-02-24 12:13:24 ...
1
vote
1answer
383 views

journalctl --follow isn't advancing

I have a program that continually reads the output of: journalctl -o json --follow And sends it to another process. And while it outputs journal entries initially from the tail, new ones don't ...
1
vote
1answer
686 views

Systemd python service buffers journalctl output even with -u

I have a simple user systemd service configured like so: [Unit] Description=Bot AssertPathExists=/home/mikel/discord-bot/ [Service] WorkingDirectory=/home/mikel/discord-bot/ ExecStart=/home/mikel/...
1
vote
0answers
257 views

redundant systemd-journal-remote for systemd-journal-upload instances

I'm using systemd-journal-upload on serveral nodes to forward their journals to a single systemd-journal-remote sink, loghost01: /var/log/journal ├── <foo-bar> │   ├── system.journal │   └── ...
3
votes
1answer
636 views

systemd-journald system logs are not persistent across boots despite Storage=persistent

I recently got a problem with systemd not preserving logs from previous boots. I checked several answers here and elsewhere but haven't found a solution. the problem is that the user log gets ...
5
votes
3answers
2k views

Why are journald logfiles so huge?

When I do a journalctl --disk-usage it says something about 300MB size of the journal files but when I look at the actual text with journalctl | wc -c it's something about 28MB. Well, journald has ...
1
vote
0answers
246 views

Journald allow a user to read one unit's logs

tl;dr How can I allow a normal user to read one systemd service's logs? Long question Environment: CentOS 7 A user needs access to his service's logs, which are by default consumed by journald. I ...
1
vote
1answer
101 views

Journald does not log error messages before failing exit of program

I'm invoking a python3 module using systemd (version: systemd 232) on debian stretch. The problem is, if the python module raises an exception, the exception message (stderr) and some prior prints (...
4
votes
5answers
8k views

reliable export of journalctl logs

I search a way for a reliable export of journalctl logs. I could use the --since=... option, but this is a bit fuzzy. In my case a script would call journalctl --output=json every ten minutes. I ...
1
vote
0answers
425 views

Unable to turn logging down on isc-dhcp-server on ubuntu xenial

I edited /etc/dhcp/dhcpd.conf and set log-facility local4; I've also edited /etc/systemd/system.conf and set LogLevel=notice I've verified that the log level is set to notice with the command. ...
1
vote
1answer
416 views

Remove nginx log prefix

I configured nginx to log in this format log_format lalala '$remote_addr - $remote_user '; access_log syslog:server=unix:/dev/log lalala; However, every line starts with: testserver nginx: ...
1
vote
1answer
320 views

journald: extract part of a system journal into the journald format (i.e. for use with journalctl)

I have a situation where it would be really useful to attach the relevant bits of the system logs to a bug ticket. The system in question uses journald and I rather like using journalctl to inspect ...
0
votes
1answer
320 views

Using journald without systemd?

I would like to use journald within a container without systemd. Is this possible? If so, how to do this? What are the issues to take care?
1
vote
2answers
1k views

Turn off buffering in systemd unit-file?

When I write my unit-file I want all output from Exec*-options (ExecStartPre=, ExecStartPost=, ExecStart=, and ExecStopPost=) to be sent to the journal. But apparently the output is buffered in some ...
2
votes
1answer
671 views

How to write multiline log entry to journald?

My NodeJS-based service writes multiline logs using console.log to journald. However, logs get broken down on each new line (\n). How can I have a multiline message in a single log entry? Thank you!
0
votes
1answer
421 views

Q: journalctl to prefix message with own meta data?

How would one prefix journald log entries with metadata within the log message? I'm thinking I may have to view one of the verbose outputs, filter out line breaks and all extra info, find just the ...
1
vote
1answer
1k views

httpd.service is reloaded or killed

On a new CentOS7 server, I got the issue, that every night the httpd.service is getting reloaded. And sometimes, around same time, it is getting just killed. systemctl status httpd: ● httpd.service -...
0
votes
1answer
5k views

High CPU usage with systemd-journal 219 on CentOS

systemd-journal seems to have hig CPU usage, compare to HAProxy that is the actual service on the node: 385 root 20 0 69948 26152 25776 S 3.0 0.2 0:04.05 systemd-journal 22509 ...
2
votes
1answer
704 views

Systemd journal files smaller than SystemMaxFileSize

I have a system running CentOS 7, with more than 1T free disk space. The systemd version is 219. I have configured journald with the following settings: Storage=persistent SplitMode=none SystemMaxUse=...
1
vote
0answers
289 views

CoreOS logs flooded with “Unknown permission status for class system”

I am trying to debug an issue, and I was wondering if this rings a bell to anyone: My logs get flooded with audit: type=1107 audit(1479418315.344:1053): pid=1 uid=0 auid=4294967295 ses=4294967295 ...
1
vote
1answer
189 views

How to combat journal spam: unit-specific MaxLevel* settings?

I know about MaxLevelStore, MaxLevelSyslog, MaxLevelKMsg, MaxLevelConsole, MaxLevelWall but the problem with them is, they affect all units. Trouble is, not all developers *cough* kde *cough* gtk *...
28
votes
2answers
21k views

How do view older journalctl logs (after a rotation maybe?)

I am running docker on ubuntu 16.04 and would like to view the logs. However, I am unable to view logs after what I am guessing is some sort of rotation or the logs grow to a certain size. I have not ...
2
votes
1answer
570 views

Not seeing logs for program managed by systemd

I'm using systemd to manage a program on Ubuntu 16. I can't seem to get the logs from the program to output to journalctl or /var/log/syslog. The journald configuration is the default, which should ...
2
votes
2answers
4k views

Systemd: Default log output format

I am wondering if the default output for journalctl can be adjusted. Such that a custom pattern can be supplied. For example I would like to: display the log level (e.g. priority) configure fixed ...
0
votes
1answer
715 views

Journalling stdout with systemd when running as specific user

Consider the following test-echo.service: [Unit] Description=Testing journalling of stdout [Service] ExecStart=/bin/echo hello world [Install] WantedBy=multi-user.target Its stdout ends up in the ...
6
votes
3answers
7k views

systemd-journald Doesn't start at all

After deleting my /var/log/journal by accident, I am unable to recover from the consequences. systemd-journald keeps failing over and over again every time I try to start it. when I run: $ journalctl ...
0
votes
1answer
1k views

Citadel outputting 'Broadcase message from systemd-journald@hostname' continuously

I installed citadel-suite using apt-get on Ubuntu 15.10. I then uninstalled it using 'sudo apt-get remove citadel-suite; sudo apt-get purge citadel-suite', manually deleted the directory '/etc/...
0
votes
1answer
494 views

Is there a way to configure journald.conf through cloud config on CoreOS?

Try to find a way to automatically set SystemMaxUse for systemd-journald.service. I knew I can set it in /etc/systemd/journald.conf manually. But it will restore to default after CoreOS updates in my ...
1
vote
0answers
749 views

Multiple Nginx Error Log Locations

I'm trying to get Nginx to log both in a log file and to stderr. The reasoning behind this is that I want Nginx to log to a log file as well as to journald. From the research and tests I've done I ...
2
votes
1answer
1k views

Truncated/missing logs with systemd on Ubuntu 16.04

I am using Ubuntu 16.04 server, have created a basic nodejs script and packaged it in a simple systemd service. Content of api.service at /lib/systemd/system/api.service: [Unit] Description=api ...
0
votes
2answers
807 views

Don't write “no free leases” messages from ISC DHCP server to systemd log

I have a DHCP server that provides TFTP server IP, NBP (Network Bootstrp Program) and IP addresses to PXE clients. When a machine boots normally (not PXE boot) it gets an IP address from another DHCP ...