We have a lot of scheduled jobs that do a variety of things-- moving logs around, ingesting and cooking them, fetching data from external sources, building reports, etc. Some of it happens hourly, some of it daily, and there are lots of dependencies between various tasks. We manage it all with an operations workflow tool that is nearly adequate in theory, but often falls short or falls on its face in practice. Everything is linux-based.
It seems like this should be a fairly well solved problem. Are there any good open source or inexpensive commercial systems that can handle this well?