RabbitMQ

On the use of messaging services (i.e. RabbitMQ)

• Authors: Federico Stagni, Zoltan Mathe, Wojciech Ian Kremzien, ...

Messaging systems like RabbitMQ can be useful for performing several tasks in DIRAC. This RFC is created for discussing use cases, and for integration within the DIRAC framework.

Use cases

Transformation system

RFC 21 on the Evolution of Transformation System already gives an example of a possible use case. The idea is to achieve data driven through usage of MQ like RabbitMQ. Details are in the RFC.

Monitoring

RabbitMQ is the market's leader when coming to interactions with monitoring tools.

Pilots logging

DIRAC does not provide, at the moment, a pilots logging system. Authors think that such system could be provided using a message queuing system. RabbitMQ appears to be the most suitable candidate.

Executors

Executors work in a similar fashion to MQ systems. It should be studied if MQs can do the same job, but better.

Integration with DIRAC

From now on, we use RabbitMQ's jargon, and we consider specifically the case of integration of RabbitMQ within the DIRAC framework.

RabbitMQ