Stack Exchange Network

Stack Exchange network consists of 174 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [journald]

The tag has no usage guidance.

0
votes
0answers
18 views

rcu_sched self-detected stall on CPU + watchdog: BUG: soft lockup - CPU#3 stuck for 22s

Being unable to ssh into a machine I connected it to a monitor and found the following: The machine is running Ubuntu Server 18.04 LTS and is a first generation 8 core Ryzen 1700. I've restarted the ...
0
votes
0answers
27 views

systemd-journal Rate Limit

I have a service set up on CentOS 7 which outputs a lot of log messages, which results in this in the system log / journal: systemd-journal[xxxx]: Suppressed 864 messages from /system.slice/example....
1
vote
0answers
51 views

journald forwarding to syslog seems to be lagged

I'm seeing an issue on a Ubuntu 16.04 box where the copying/forwarding of journal messages to /var/log/syslog seems to be delayed: theuser@host:/etc/systemd$ sudo journalctl -n 1 && sudo tail ...
0
votes
0answers
47 views

Changing logging level for segfault of service managed by systemd

We have a Python daemon managed by systemd that occasionally hits a segfault calling out to a C library. While we're fixing this segfault issue, we want the logs to clearly indicate to us when the ...
2
votes
0answers
55 views

sudo log entries don't show username on Debian Stretch

For some reason, the username of the user calling a command with sudo is not shown in the system log: $ journalctl -ef sudo[30160]: pam_unix(sudo:session): session opened for user root by (uid=0) ...
0
votes
1answer
18 views

`journalctl -f -m` does not interleave remote and local

I currently have a 2-server setup (3 servers in total, one still to be configured for this) with one server using systemd-journal-remote (.socket & .service) to collect all log entries from the ...
0
votes
2answers
83 views

Clearing “/var/log/journal”

I want to clear my "/var/log/journal" directory. I'm using debian 8 root@nyc3-x8:/var/log# uname -a Linux nyc3-x8 3.16.0-4-amd64 #1 SMP Debian 3.16.36-1+deb8u2 (2016-10-19) x86_64 GNU/Linux And my ...
0
votes
0answers
16 views

Journal metadata not taken as Rsyslog structured-data

I would like to use rsyslog with the imjournal module. I was expecting the same metadata I see when I read verbose journal entries to be taken as the STRUCTURED_DATA field in rsyslog (RFC5424), but it ...
1
vote
1answer
569 views

System logs are empty (/var/log/messages; /var/log/secure; etc)

I found that rsyslog stopped writing on logs (messages; secure; cron;etc) System information: NAME="Red Hat Enterprise Linux Server" VERSION="7.4 (Maipo)" ID="rhel" ID_LIKE="fedora" VARIANT="Server" ...
1
vote
0answers
38 views

system freeze after systemd-tmpfiles-clean executed

recently i got a problem, i run mysql on docker with k8s , the system load getting high in 2 days from 1->500+, the /var/log/messages infomation: Aug 17 19:50:07 SVR5798HW1288 dockerd[1890]: time="...
2
votes
1answer
447 views

How to filter journalctl output by process name?

When a process logs to systemd, its process name is recorded and displayed as identifier in the journalctl output. $ systemd-cat echo "test" $ journalctl -f -- Logs begin at Sat 2018-02-24 12:13:24 ...
1
vote
1answer
62 views

journalctl --follow isn't advancing

I have a program that continually reads the output of: journalctl -o json --follow And sends it to another process. And while it outputs journal entries initially from the tail, new ones don't ...
1
vote
1answer
207 views

Systemd python service buffers journalctl output even with -u

I have a simple user systemd service configured like so: [Unit] Description=Bot AssertPathExists=/home/mikel/discord-bot/ [Service] WorkingDirectory=/home/mikel/discord-bot/ ExecStart=/home/mikel/...
1
vote
0answers
122 views

redundant systemd-journal-remote for systemd-journal-upload instances

I'm using systemd-journal-upload on serveral nodes to forward their journals to a single systemd-journal-remote sink, loghost01: /var/log/journal ├── <foo-bar> │   ├── system.journal │   └── ...
0
votes
0answers
15 views

Journald stops with SIGBREAK

I have poor knowledge of how journald works. I have several questions alongside with the main issue. I use following journald configuration on Ubuntu 16.04 servers [Journal] Storage=persistent ...
0
votes
0answers
58 views

Custom directory to store `journald` logs

I want my journald service to store logs in a specific folder, but I can't find a configuration option for this on the man page. Any idea how to go about this?
2
votes
1answer
187 views

systemd-journald system logs are not persistent across boots despite Storage=persistent

I recently got a problem with systemd not preserving logs from previous boots. I checked several answers here and elsewhere but haven't found a solution. the problem is that the user log gets ...
2
votes
3answers
423 views

Why are journald logfiles so huge?

When I do a journalctl --disk-usage it says something about 300MB size of the journal files but when I look at the actual text with journalctl | wc -c it's something about 28MB. Well, journald has ...
0
votes
0answers
129 views

journald never decrease size of /run tmpfs partition

I have a problem with /run partition, its size NEVER decrease so when it's full, I have to reboot. [root@centos]# df -H Filesystem Size Used Avail Use% Mounted on ... tmpfs 6.4G 6.3G ...
1
vote
0answers
146 views

Journald allow a user to read one unit's logs

tl;dr How can I allow a normal user to read one systemd service's logs? Long question Environment: CentOS 7 A user needs access to his service's logs, which are by default consumed by journald. I ...
1
vote
1answer
43 views

Journald does not log error messages before failing exit of program

I'm invoking a python3 module using systemd (version: systemd 232) on debian stretch. The problem is, if the python module raises an exception, the exception message (stderr) and some prior prints (...
1
vote
5answers
2k views

reliable export of journalctl logs

I search a way for a reliable export of journalctl logs. I could use the --since=... option, but this is a bit fuzzy. In my case a script would call journalctl --output=json every ten minutes. I ...
1
vote
0answers
235 views

Unable to turn logging down on isc-dhcp-server on ubuntu xenial

I edited /etc/dhcp/dhcpd.conf and set log-facility local4; I've also edited /etc/systemd/system.conf and set LogLevel=notice I've verified that the log level is set to notice with the command. ...
1
vote
1answer
239 views

Remove nginx log prefix

I configured nginx to log in this format log_format lalala '$remote_addr - $remote_user '; access_log syslog:server=unix:/dev/log lalala; However, every line starts with: testserver nginx: ...
1
vote
1answer
99 views

journald: extract part of a system journal into the journald format (i.e. for use with journalctl)

I have a situation where it would be really useful to attach the relevant bits of the system logs to a bug ticket. The system in question uses journald and I rather like using journalctl to inspect ...
-1
votes
1answer
152 views

Using journald without systemd?

I would like to use journald within a container without systemd. Is this possible? If so, how to do this? What are the issues to take care?
1
vote
2answers
530 views

Turn off buffering in systemd unit-file?

When I write my unit-file I want all output from Exec*-options (ExecStartPre=, ExecStartPost=, ExecStart=, and ExecStopPost=) to be sent to the journal. But apparently the output is buffered in some ...
2
votes
1answer
353 views

How to write multiline log entry to journald?

My NodeJS-based service writes multiline logs using console.log to journald. However, logs get broken down on each new line (\n). How can I have a multiline message in a single log entry? Thank you!
0
votes
1answer
233 views

Q: journalctl to prefix message with own meta data?

How would one prefix journald log entries with metadata within the log message? I'm thinking I may have to view one of the verbose outputs, filter out line breaks and all extra info, find just the ...
0
votes
1answer
564 views

httpd.service is reloaded or killed

On a new CentOS7 server, I got the issue, that every night the httpd.service is getting reloaded. And sometimes, around same time, it is getting just killed. systemctl status httpd: ● httpd.service -...
0
votes
1answer
3k views

High CPU usage with systemd-journal 219 on CentOS

systemd-journal seems to have hig CPU usage, compare to HAProxy that is the actual service on the node: 385 root 20 0 69948 26152 25776 S 3.0 0.2 0:04.05 systemd-journal 22509 ...
2
votes
1answer
353 views

Systemd journal files smaller than SystemMaxFileSize

I have a system running CentOS 7, with more than 1T free disk space. The systemd version is 219. I have configured journald with the following settings: Storage=persistent SplitMode=none SystemMaxUse=...
1
vote
0answers
224 views

CoreOS logs flooded with “Unknown permission status for class system”

I am trying to debug an issue, and I was wondering if this rings a bell to anyone: My logs get flooded with audit: type=1107 audit(1479418315.344:1053): pid=1 uid=0 auid=4294967295 ses=4294967295 ...
0
votes
1answer
108 views

How to combat journal spam: unit-specific MaxLevel* settings?

I know about MaxLevelStore, MaxLevelSyslog, MaxLevelKMsg, MaxLevelConsole, MaxLevelWall but the problem with them is, they affect all units. Trouble is, not all developers *cough* kde *cough* gtk *...
16
votes
2answers
9k views

How do view older journalctl logs (after a rotation maybe?)

I am running docker on ubuntu 16.04 and would like to view the logs. However, I am unable to view logs after what I am guessing is some sort of rotation or the logs grow to a certain size. I have not ...
2
votes
1answer
337 views

Not seeing logs for program managed by systemd

I'm using systemd to manage a program on Ubuntu 16. I can't seem to get the logs from the program to output to journalctl or /var/log/syslog. The journald configuration is the default, which should ...
1
vote
1answer
2k views

Systemd: Default log output format

I am wondering if the default output for journalctl can be adjusted. Such that a custom pattern can be supplied. For example I would like to: display the log level (e.g. priority) configure fixed ...
0
votes
1answer
490 views

Journalling stdout with systemd when running as specific user

Consider the following test-echo.service: [Unit] Description=Testing journalling of stdout [Service] ExecStart=/bin/echo hello world [Install] WantedBy=multi-user.target Its stdout ends up in the ...
6
votes
3answers
3k views

systemd-journald Doesn't start at all

After deleting my /var/log/journal by accident, I am unable to recover from the consequences. systemd-journald keeps failing over and over again every time I try to start it. when I run: $ journalctl ...
0
votes
1answer
1k views

Citadel outputting 'Broadcase message from systemd-journald@hostname' continuously

I installed citadel-suite using apt-get on Ubuntu 15.10. I then uninstalled it using 'sudo apt-get remove citadel-suite; sudo apt-get purge citadel-suite', manually deleted the directory '/etc/...
0
votes
1answer
398 views

Is there a way to configure journald.conf through cloud config on CoreOS?

Try to find a way to automatically set SystemMaxUse for systemd-journald.service. I knew I can set it in /etc/systemd/journald.conf manually. But it will restore to default after CoreOS updates in my ...
1
vote
0answers
407 views

Multiple Nginx Error Log Locations

I'm trying to get Nginx to log both in a log file and to stderr. The reasoning behind this is that I want Nginx to log to a log file as well as to journald. From the research and tests I've done I ...
2
votes
1answer
888 views

Truncated/missing logs with systemd on Ubuntu 16.04

I am using Ubuntu 16.04 server, have created a basic nodejs script and packaged it in a simple systemd service. Content of api.service at /lib/systemd/system/api.service: [Unit] Description=api ...
0
votes
2answers
505 views

Don't write “no free leases” messages from ISC DHCP server to systemd log

I have a DHCP server that provides TFTP server IP, NBP (Network Bootstrp Program) and IP addresses to PXE clients. When a machine boots normally (not PXE boot) it gets an IP address from another DHCP ...
1
vote
2answers
996 views

combined local and remote journald logs

I am using journald forwarding using systemd-journal-remote (local site) and systemd-journal-upload (remote site) on centos7 with systemd-219 on both machines. Local journals are stored in /var/log/...
2
votes
1answer
465 views

systemd journal and docker

I am using CoreOS which uses systemd and docker. One of the big issues with systemd and CoreOS is that it doesn't play 100% nice with docker. Or maybe docker doesn't play 100% nice either. Another ...
1
vote
0answers
305 views

How can I pull data from journald and outputing it to logz via rsyslog

I have a number of servers that use CoreOS. CoreOS natively uses journald for all it's log files. The latest stable release incorporates docker 1.9 so it doesn't yet support docker log drivers. ...
1
vote
1answer
605 views

Sending docker logs to logstash

I have a number of CoreOS servers on Amazon AWS and would like to collect events or logs from them and forward them onto my ELK stack provider logz.io. Being a little new to the ELK stack, I'm a ...
2
votes
1answer
2k views

How can I start systemd unit files (someservice.service) with logging set to /dev/null?

Is there a way to start a service using systemd and direct it's logging to /dev/null WITHOUT including the proper lines in the unit file. For example, A file that has the StandardOutput and ...
2
votes
1answer
1k views

How to enable syscall auditing in CoreOs?

Since CoreOs 766, the auditing subsystem is partially integrated: The audit subsystem has been enabled in the kernel and auditctl added to the image. Most audit events are ignored by default. The ...