I realize Hudson was not designed as a queue service per se - and that there are other projects like RabbitMQ, ZeroMQ, etc.

We were recently in a situation where we needed to set up a windows executable as a web service with queuing. Because of the platform, time constraints, and my familiarity with Hudson I said : "Hudson can do that" - we trigger a little perl script that runs the executable, and then hits a callback URL. It's been great. We get a nice record of jobs processed. If we needed to scale up we could add slave machines, and the queuing works perfectly.

I have not seen any discussions on using Hudson as a queue service, so I'm looking for reason not to do it for future projects.

| improve this question | | | | |
  • This is a stab in the dark because I'm not familar with Hudson or exactly what you're trying to do, but you mention Windows - MSMQ is Microsoft's queing service. If you do need an alternative, could that be viable? It's included in every version of Windows (inc. desktops I believe) except Web Server. – Mark Henderson Aug 20 '10 at 22:26

Depends on your needs. The happy scenario works fine. What happens if you have 10 items in the Hudson queue and Hudson shuts down. The queue will be lost. Is this acceptable for you? If not, you have to implement a persistence layer. Are you now still better off with Hudson or should you use a product designed for queueing?

These are just some questions that you need to answer yourself.

| improve this answer | | | | |
  • Good point. The other two features that have come to mind are rate limiting and retries... any others? – EMiller Aug 25 '10 at 16:27
  • Not really, I am mainly working with Hudson. If I were you, I would create a list of requirements and nice to have and determine if you can easily implement this with Hudson. Since you seem to struggle with the features you might need, get some feature lists of queue service products and decide which features you need. – Peter Schuetze Aug 27 '10 at 12:44

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.