Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Table of Contents

Overview

 
There are two main patterns which can be used when processing incoming messages in FIX Antenna HFT:

...

 
The first one is used when message processing or routing does not take significant amount of time. In this case messages could be routed directly from the process() callback method. This assures the lowest latency possible.
If the number of incoming sessions is big, it is advised to set TCPDispatcher.NumberOfWorkers = 3, which means 3 dedicated threads for running epoll_wait calls. Also, it is recommended to either set TCPDispatcher.IncomingConnectionOnloadStackAffinity = false or specify several listen ports - this will assure even load distribution from all acceptors.
 
The second one (called a thread pool) is used when message processing or routing takes significant amount of time. In this scenario, the client code should create a thread pool (using Utils::ThreadsPool class ) inside the application and pass the messages pointer to the internal queue in the process() callback method in order the thread pool to start processing messages.
The above considerations are illustrated on the diagram below:

Image Added

Actually, there are many sessions in the 'With user thread pool' diagram, each of them works as the shown one.

Test scenario

The test scenario is the following:

...

    • Round-trip time (RTT);
    • Socket to the process() callback latency on the simple router;
    • The put() callback to socket latency on the simple router.

Image RemovedImage Added

The test configuration schema (70 Sender (Initiator) sessions - 20 Receiver (Acceptor) sessions) is the following:

  Image RemovedImage Added

Environment

Machine 1:

...

The histograms below show the distribution of the RTT/2 for 1,000; 5,000 and 10,000 msg/s message rates for configuration with 70 senders and 20 receivers without thread pool and with thread pool.

Image RemovedImage RemovedImage Added

Image Added

The following histogram compares the distribution of RTT/2 for 10,000 msg/s message rate for configuration with 70 senders and 20 receivers without thread pool and with thread pool.

...

Image Added