I need to gather statistics on how long it takes to retrieve a web page once every couple of seconds.
I can do a
time wget --spider http://www.google.com/index.html
(spider will not download the page, just check that they are there)
with this command I can see how long it took to run the command and the status of the page (200 OK, 404 NOT FOUND, etc)
The issue I'm having is that I need to keep track of the statistics. So if I hit a web page every couple of seconds and every so often I get a 404 I need to see those stats.