django - Problems stopping celeryd -
i'm running celeryd daemon, have trouble stopping gracefully. when send term signal , there items in queue (in case service celeryd stop
) celeryd stop taking new jobs, , shut down worker processes. parent process, however, won't shut down.
i've ran scenario had celeryd running on 2 separate worker machines: , b. 1000 messages on rabbitmq server, shut down a, , experienced situation i've explained above. b continued work, stalled 40 messages left on server. however, able stop b correctly.
i restarted b, see if take 40 items off queue, not. next, hard killed a, after b grabbed , completed tasks.
my conclusions parent process has reserved 40 items our rabbitmq server children. reap children correctly, not release items rabbitmq unless manually kill it.
has experienced similar?
i'm running celery 2.2.2
i believe related to:
https://github.com/celery/celery/issues/264
setting
celery_disable_rate_limits = false
in settings.py file should work.
Comments
Post a Comment