FairMQ/examples/MQ/2-sampler-processor-sink
Alexey Rybalchenko bbadf09aad FairMQ: Extend Multipart and messaging API
- Extend the multipart API to allow sending vectors of messages or helper
   thin wrapper FairMQParts. See example in examples/MQ/8-multipart.
 - NewMessage() can be used in devices instead of
   fTransportFactory->CreateMessage().
   Possible arguments remain unchanged (no args, size or data+size).
 - Send()/Receive() methods can be used in devices instead of
   fChannels.at("chan").at(i).Send()/Receive():
   Send(msg, "chan", i = 0), Receive(msg, "chan", i = 0).
 - Use the new methods in MQ examples and tests.
 - No breaking changes, but FAIRMQ_INTERFACE_VERSION is incremented to 3
   to allow to check for new methods.
2018-05-02 16:12:57 +02:00
..
CMakeLists.txt Add FlatBuffers & MessagePack examples 2018-05-02 16:12:57 +02:00
ex2-sampler-processor-sink.json FairMQ: Extend Multipart and messaging API 2018-05-02 16:12:57 +02:00
FairMQExample2Processor.cxx FairMQ: Extend Multipart and messaging API 2018-05-02 16:12:57 +02:00
FairMQExample2Processor.h Rename /example to /examples and move MQ examples in it 2018-05-02 16:12:57 +02:00
FairMQExample2Sampler.cxx FairMQ: Extend Multipart and messaging API 2018-05-02 16:12:57 +02:00
FairMQExample2Sampler.h Rename /example to /examples and move MQ examples in it 2018-05-02 16:12:57 +02:00
FairMQExample2Sink.cxx FairMQ: Extend Multipart and messaging API 2018-05-02 16:12:57 +02:00
FairMQExample2Sink.h Rename /example to /examples and move MQ examples in it 2018-05-02 16:12:57 +02:00
README.md Rename /example to /examples and move MQ examples in it 2018-05-02 16:12:57 +02:00
runExample2Processor.cxx Remove compile time transport interface switch 2018-05-02 16:12:57 +02:00
runExample2Sampler.cxx Remove compile time transport interface switch 2018-05-02 16:12:57 +02:00
runExample2Sink.cxx Remove compile time transport interface switch 2018-05-02 16:12:57 +02:00

Example 2: Sampler -> Processor -> Sink

A simple topology of three devices - Sampler, Processor and Sink. Sampler sends data to one or more Processors, who modify the data and send it to one Sink. Transport with the PUSH-PULL pattern.

In this example the Sampler is configured to bind its output and the Sink is configured to also bind its input. This allows us run any number of processors with the same configuration, because they all connect to same Sampler and Sink addresses. Furthermore, it allows adding of processors dynamically during run-time. The PUSH and PULL sockets will handle the data distribution to/from the new devices according to their distribution strategies (Round-robin output for PUSH and Fair-queued input for PULL).

The Sampler sends out a simple text string (its content configurable with --text command line parameter, defaul is "Hello"). Each Processor modifies the string by appending its ID to it and send it to the Sink.

The provided configuration file contains two Processors. To add more Processors, you can either extend the configuration file, or create a separate file only for new processors.