Celery is a distributed task queue written in Python.

learn more… | top users | synonyms

0
votes
0answers
3 views

More than one celery server sharing the same message queue?

I have a number of servers all running the same celery app to process tasks. I am using SQS as the message queue. Right now, each app appears to be automatically creating its own queue when it ...
0
votes
0answers
26 views

VPN-tunnel renegotiation problems

I have an application running on top of Celery with redis as a broker. Redis is hosted at our datacenter but the workers are hosted on a separate line. We have setup two-way communcation between the ...
-1
votes
1answer
64 views

Running multiple workers using Celery

I need to read from Rabbitmq and execute task in parallel using Celery in a single system. [2014-12-30 15:54:22,374: INFO/Worker-1] ... [2014-12-30 15:54:23,401: INFO/Worker-1] ... [2014-12-30 ...
1
vote
1answer
209 views

Supervisord as Windows Service on Cygwin

I am attempting to run Celery as a Windows Service using Supervisord. I followed the configuration laid out on the Celery site and here. I have set up a virtual environment to run supervisord through ...
0
votes
0answers
33 views

Communication between different servers

I have a dynamic site which has a database and a static file generator. I now want to detach the static file generator from the dynamic site and host it on a different server. The issue is I still ...
1
vote
2answers
1k views

Celery with Upstart - processes are dying unexpectedly

When I'm running Celery with Upstart, after a while, the child processes or the main processes die without any trace. The Upstart script I'm using (/etc/init/celery): description "celery" start on ...
0
votes
1answer
135 views

celery tasks from one domain appear on another domain's django admin hosted on the same box

I have a rather funny problem that I didn't manage to find it elsewhere. I have 2 django-celery projects running with redis on 2 different domains, but apparently hosted on the same box. I don't have ...
0
votes
1answer
596 views

Celery and RabbitMQ - Tools for monitoring and callout alarms

I think we've reached the limit of usability of celery events and celery fllower. Is there a good tool for monitoring status of Celery running under RabbitMQ? In particular, I would like something ...
0
votes
1answer
634 views

Approach to auto scale celery servers based on broker(redis) queue size

I am working on a project which requires rolling out new celery servers if the broker(redis) queue is consistently higher than a predetermined threshold size and killing the new boxes when the queue ...
1
vote
2answers
851 views

kill -HUP is not working with celery daemon

So I have a shell script that daemonizes celery, and creates a bunch of workers running as a daemon. I would like to have a way to restart the celery task when the underlying source gets changed since ...
5
votes
1answer
1k views

Celery Daemon receives unregistered tasks

I installed Celery for my Django project following what the official tutorial / doc says. And it's working fine when I launch celery at the command line, I can see it receiving the tasks and execute ...