15

How about count({__name__=~".+"})? It does return number of time series in the database. I compared with amount of metrics currently exposed by each target by manual scrapping, and it matches it +/- 10%. I guess the difference is due to some targets that I had in the past and now they are offline.


10

Event Log Consolidator View, consolidate, and dismiss event logs and correlate issues across multiple systems Tired of having to open Event Viewer and connect to each Windows system to see its event logs? Don’t have a centralized way to view events from multiple servers? Download SolarWinds Event Log Consolidator to organize event logs from several Windows ...


9

The role of the Agent Monitoring is umbrella term for many functions. The function of an "agent" is essentially to make data available to the rest of the system. To put it in context, you might try to fit it into the model proposed by Dickson from his "Working theory of Monitoring" talk. So agents generally fit into "Sensing/...


8

Funny, I just happened to reboot a CentOS 7 system last night, and so I have a nice log of just this to look at. In the case of a crash, obviously nothing is logged between the time of the crash and the system restart. In the case of a reboot, it is pretty obvious, as you get a log of (nearly) everything systemd is doing to shut down the system. One such ...


7

kipmi0 is the kernel process used for interfacing with the IPMI controller on your server. In my experience, if it's stuck using 100% CPU like this, it's because the interface between the server and the IPMI controller stack has locked up, and if you reset the IPMI stack it'll come right. Reasons for it locking up are pretty varied, but a common one I've ...


6

Check this script. it's checking against a list of websites and sends email (to list of emails) whenever something wrong (http response different from 200). The script creates a .temp file to "remember" which website(s) failed at last check so you won't get multiple emails. the .temp file is deleted when the website is working again. #!/bin/bash # list of ...


6

Monit will implicitly alert upon process restart. You don't need to specify "then alert".


6

Go to GCP console > Monitoring > alerting policy. Click on "+ Create Policy" button on the top and "Add Condition" 0 you will see a panel that looks something like this below. Set everything as fallows: Target: Resource type: GCE VM Instance Metric: Disk Utilization Filters: name: name of your disk (a list of all your disks will pop up - select one) ...


5

You need to install the SNMP Tools feature to get those tab pages, e.g. using the Powershell command Install-WindowsFeature RSAT-SNMP. Remember to restart the service manager before opening the properties page again.


5

SvW is not wrong in what (s)he writes, but you should also investigate the variable max_check_attempts, which defines how many checks a service has to fail before going HARD error and notifying. For some of my hair-trigger services, I have max_check_attempts 2 check_interval 2 retry_interval 1 which means ...


5

In linux this worked perfectly for me in current versions of CentOS and Debian ipmitool sdr type "Power Supply"


5

I don't particularly like the answer, but it's an answer we got from RH. I'm posting it here in case it helps someone else. One possible way is to grep for rsyslogd in /var/log/messages. A graceful shutdown would have exiting on signal 15. A crash would not. tac /var/log/messages | grep 'rsyslogd.*start\|rsyslogd.*exit' Two consecutive start lines may ...


5

There's more than one way to do this, but I'll cover the 4 best ones I can think of. (EDIT: I published a cleaned-up version of this as a public article on redhat.com. See: How to distinguish between a crash and a graceful reboot in RHEL 7.) (1) auditd logs auditd is amazing. You can see all the different events that it logs by checking ausearch -m. ...


4

You don't use Nginx for this. Rather, you use some sort of log processing package to watch the nginx error log for 504s and notify you when it sees one. Logstash is a very popular and very capable log processing package - it can be easily configured to consume messages out of your error log (using the file input), look for a certain error string (using the ...


4

You can see this information on the Reports -> Analytics page. Your Monit config needs to have disk checks for the filesystems you require: check device root with path / if SPACE usage > 80% then alert check device var with path /var if SPACE usage > 80% then alert check device usr with path /usr if SPACE usage > 80% then alert ...


4

There are two possible solutions I've found. Both are not optimal but work in my scenario: For every subservice, only check if the PID file exists and assume the service is online if the file exists. As before, the main service sympa depends on the subservices: check process sympa with pidfile /var/run/sympa/sympa.pid start program = "/etc/init.d/sympa ...


4

As I am a long time Munin user, I can give you few quick thoughts on using it: using a SSH tunnel (is that illegal as well?) to get behind the firewall. The obvious port forward, you mentioned. If you have SSH of the monitored machines already exposed, you can use Munin's SSH support to get to those. You can use one very light-weight node behind firewall, ...


4

There should be a defined command for "check_ssh" Like so, e.g. on a Debian/Ubuntu system /etc/nagios-plugins/config/ssh.cfg define command{ command_name check_ssh command_line /usr/lib/nagios/plugins/check_ssh '$HOSTADDRESS$' } So by default the hostaddress is passed to the command, without you doing anything other than use check_ssh. I guess your ...


4

Looks to me like a perfect opportunity to have cron schedule a custom service notification, which is basically a gratuitous notification describing the current state of affairs. You can do this through the external command interface, with eg echo "[1495974284] SEND_CUSTOM_SVC_NOTIFICATION;hostname;service name;0;username;Comment eg morning notification" &...


4

No. Technical aspects aside, this would be a catastrophe security-wise.


3

You need to open the services.msc from an elevated command line window (run as admin). Then you'll get the security tab!


3

You can define detailed configurations to tell Nagios every detail about the check for a service. Look up the check_interval and retry_interval config options, and while you are at it, learn about time periods in general.


3

Don't know how much servers/logs you have to monitor but there are many solutions out there small environment Use rsyslog and a frontend you like (ex. LogAnalyzer http://loganalyzer.adiscon.com/) bigger environment We monitor our serverlogs from (+300 system) with beaver as logshipper, logstash as indexer and elasticsearch as backend. This solution ...


3

I ended up using atop (which is available in FreeBSD ports as sysutils/atop), and it's awesome. I would very much consider using it in preference of sar on systems where sar is available. It comes with a curses-based UI that is easy to navigate and shows a lot of data at once. It's incredibly handy.


3

After some more research and thanks to the comments of David.B i found a solution that 'works for me' ™ To find the number of time series stored by Prometheus i use this command in the storage.local.path folder : ls -l {{0..9},{a..f}}{{0..9},{a..f}} | grep -E "*.db$" | wc -l In addition in found some metrics in the prometheus documentation that ...


3

https://prometheusui.com:9090/status ---> Head Stats --> this will give you the entire status.


3

edit replace SELinux with AppArmor for Ubuntu Here are a few suggestion that should be easy to set up in a VM (and I ran into over the years): set invalid POSIX permissions for content the web server should deliver. set invalid SELinux labels for content. break the connection between web server and a backend server (e.g. with IPTables or SELinux) as @anx ...


2

After a lot of search, I found the solution, just use this command: sudo fs_usage | grep [path_to_file]


2

collectd is available for FreeBSD. From the collectd website: collectd gathers statistics about the system it is running on and stores this information. Those statistics can then be used to find current performance bottlenecks (i.e. performance analysis) and predict future system load (i.e. capacity planning). Or if you just want pretty graphs of ...


2

As you may have seen, there are examples of almost every possible combination in the time period definitions and on call rotation docs, except what you want. While you can do "nth Monday of the month" (Tuesday, Wednesday, etc.) and "nth day of the month", you can't just do "first weekday of the month", unfortunately. I initially thought this would be ...


Only top voted, non community-wiki answers of a minimum length are eligible