Questions tagged [celery]
Celery is a distributed task queue written in Python.
13
questions with no upvoted or accepted answers
8
votes
0
answers
1k
views
How many celery and gunicorn workers on the same server?
I have one server that runs a Django application served by gunicorn and a Celery task queue.
Gunicorn docs suggest (2 x $num_cores) + 1 as the default number of workers.
Celery docs show that the ...
- 175
3
votes
0
answers
200
views
Preventing Ubuntu EC2 server locking up with high CPU
I have a server that runs celery tasks. It runs a couple of worker threads with celery multi start 2, configured using systemd. Sometimes, it gets overworked and hits 100% CPU. When this happens, ...
- 311
2
votes
0
answers
20
views
Celery: Finding the settings that we use
I have a Celery server that someone else set up, with a byzantine system to manage the configuration. I'd like to know the Cerely settings that our server uses, without looking at the code. I have an ...
- 5,301
1
vote
0
answers
147
views
Issue with DNS Resolution in Celery/Redis on Debian 12 - VPS Provider Specific
I'm facing a peculiar issue with DNS resolution in a Celery/Redis setup on some Debian 12 installations. It seems that the problem might also relate to the VPS network settings. I'm at a loss and ...
- 1,675
1
vote
0
answers
411
views
Worker processes in Celery
I have a CPU intensive Celery task and within one of the task it can be further parallelized using joblib. By default, starting a worker with celery, will create a pool with number of max concurrency ...
- 69
1
vote
0
answers
516
views
Rabbitmq running out of memory due to "Processes / other"
I am running rabbitmq within kubernetes using the rabbitmq:3.6.11-management docker image (https://hub.docker.com/_/rabbitmq/). Looking at the management dashboard, there seems to be a lot of memory ...
- 11
1
vote
0
answers
1k
views
How to view pending messages in RabbitMQ admin?
How do you view pending/queued messages in RabbitMQ admin?
I have the RabbitMQ admin tool running, and the overview page is showing that there are over 4000 messages ready. It's also showing that ...
- 3,650
1
vote
0
answers
5k
views
Supervisor start/stop/restart not behaving as expected
I am using supervisor to manage celery and due to occasional project requirements am required to add environment variables. I set these in the supervisor [environment] section of the .conf file but ...
- 111
1
vote
1
answer
2k
views
Supervisord as Windows Service on Cygwin
I am attempting to run Celery as a Windows Service using Supervisord. I followed the configuration laid out on the Celery site and here. I have set up a virtual environment to run supervisord through ...
- 111
1
vote
0
answers
2k
views
OSError : [Errno 38] Function not implemented - Django Celery implementation
I installed django-celery and I tried to start up the worker server but I get an OSError that a function isn't implemented. I'm running CentOS release 5.4 (Final) on a VPS:
. broker -> amqp://...
- 111
0
votes
1
answer
2k
views
Remove consumer before start deployment from RabbitMQ queue
We have setup of Celery worker with 8 node setup. It create 8 queues in RabbitMQ.
When we start deploying new changes, last step in ansible playbook is Celery restart.
Celery restart has to down ...
- 255
0
votes
0
answers
3k
views
Run shell script as Supervisord subprocess?
I have a Django 1.6.2 application that uses Celery 3.1.7 for asynchronous tasks. I'm starting my Celery workers using Supervisor. So far everything is working well except when I reboot my Debian 7.8 ...
- 340
0
votes
0
answers
270
views
VPN-tunnel renegotiation problems
I have an application running on top of Celery with redis as a broker. Redis is hosted at our datacenter but the workers are hosted on a separate line. We have setup two-way communcation between the ...
- 1,031