Run Multiple Django Apps With Celery On One Server With Rabbitmq VHosts29 Apr · by Tim Kamanin · 1 min read
Very often we can have multiple Django apps each running celery and all this is installed on a single server. How do we isolate these separate app's celery workers? The answer is: Simple, if you use Rabbitmq as your broker. Rabbitmq lets us to add multiple virtualhosts, so we can easily separate celery queues and the use different broker_url per our app, let's start: 1) Create rabbitmq server vhost at first:
sudo rabbitmqctl add_vhost our_app_vhost
2) Add user / password pair
sudo rabbitmqctl add_user username password
3) Grant permissions to our user on our vhost:
sudo rabbitmqctl set_permissions -p our_app_vhost username ".*" ".*" ".*"
4) If you want to give our user access to management backend execute this command:
sudo rabbitmqctl set_user_tags username management
5) Now you can add BROKER_URL to your Django app settings:
BROKER_URL = 'amqp://username:password@localhost:5672/our_app_vhost'
Now we use a separate vhost for our Django app. Create as many vhosts as many Django apps you have, so every app could have a "separate" broker to send / receive tasks to / from.