RabbitMQ - Log aggregation by timestamp

[soujanyanaganuri]

I've explored a considerable measure about RabbitMQ and information collection yet I think now I require some assistance.

I've manufacture a rabbitmq pipeline which cointains a preprocess line, a procedure line and a spare line.

My preprocess line get's in lines of logdata. Presently I need to put these lines in interim receptacles (f.e. 30 min. containers).

Is there an answer where I can do this parallel, Python https://goo.gl/u4XXSX so I can scale my preprocess shoppers? When I keep the log lines in only one preprocess buyer the memory will increment.

I know there are arrangements like Apache Spark, yet I truly wanna know whether I can tackle this issue with RabbitMQ.