I have an internal web application that has recently gone through a major version upgrade. I would like to monitor this application over the weekend and look for 'soft' errors. I will still need to spot check things by hand, but there are some common failure patterns that I think I can automate.
Examples include data with bad formatting, blank rows in tables (indicates missing non-critical data), patterns for identifiers ("TEST" means one of my devs left a testing feed on), etc.
I think there are applications out there that can be scripted to do things like: 1. log in 2. Go to $URL 3. select 3rd link in $LIST or $PATTERN 4. Check HTML from that link for $PATTERNS 5. Email report
Are these goals sane? What applications/tools can help with this?
This particular application is receiving data feeds from external sources. We have done our best to do integration testing against a representative sample of this data. Despite that we know we will not be able to catch every quirky format or wonky ID scheme with our preprocessors.