JP2010039840A - Data distribution system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a data distribution system which achieves sufficient load balancing by not concentrating load on a specific editing server 3 even if a total amount and frequency of reception telegrams received by editing servers 3 are intensively varied in a specific point of transaction, brand, or category of business. <P>SOLUTION: The data distribution system includes: a serial number giving server 2 which gives processing serial numbers to received pieces of data in the reception order; a plurality of editing servers 3 which perform editing processing of data with serial numbers sent from the serial number giving server 2; and a distribution server 4 which distributes a plurality of pieces of edited data, which are sent from a plurality of the editing servers 3, in accordance with processing serial numbers. A plurality of the editing servers 3 have the same editing processing function, and a plurality of the pieces of data with processing serial numbers, which are sent from the serial number giving server 2, are processed in parallel. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an information distribution system for distributing data such as securities and finance, and more particularly to a data distribution system that distributes the load of an editing server that edits received data.

The editing server receives trading / contract data such as securities / finance transmitted from a host computer installed on a stock exchange, etc., and the editing server edits the data. There is a data distribution system that distributes to a plurality of client terminals.
A conventional data distribution system will be described with reference to FIG. FIG. 6 is an overall configuration diagram of a conventional data distribution system.
The conventional data distribution system, as shown in FIG. 6, edits after receiving a message from the information providing source device 1 ′ of the host computer that transmits data such as securities / financial data and the information providing source device 1 ′. The editing server 2 ′ is distributed to the client terminal 3 ′, and a plurality of client terminals 3 ′ that receive and display the display data distributed from the editing server 2 ′.

  As a related prior art, there is Japanese Patent Application No. 2007-168982 (Patent Document 1).

Patent Document 1 discloses that information distributed from a host server (host computer) is received by a plurality of editing servers, edited, and then displayed data is distributed to client terminals via the distribution server.
As described above, when the amount of information data to be distributed is large, conventionally, in order to distribute the load on the server, a plurality of editing servers are installed as in Patent Document 1, and information such as transaction place (buying and selling / contract data is generated) The processing area of each editing server is divided according to the type of stock exchange, etc.

Japanese Patent Application No. 2007-168982

  However, the total amount and frequency of received messages received by each editing server described above (the amount of received messages per unit time) fluctuates depending on the time of year, month and day, and the time of day. It does not fluctuate on average across brands, but often fluctuates with a particular trading location, brand, or industry. In such a case, the load is concentrated on a specific editing server, which is sufficient. It was difficult to achieve dispersion.

  The present invention has been made in view of the above circumstances, and even when received messages related to the same brand are continuously received, processing averaged by a plurality of editing servers is performed without concentrating the load on a specific editing server. An object of the present invention is to provide a securities / financial data distribution system in which load distribution efficiency is improved.

  A first invention for solving the above-mentioned problem is a distribution system for securities / financial trading / contract data, in which serial number giving means for giving processing serial numbers to received data in the order received, and the serial numbers A plurality of editing means for editing the processing sequence numbered data sent from the assigning means, and a delivery means for delivering the plurality of edited data sent from the plurality of editing means in the order of the processing sequence numbers, The editing means is a data distribution system that has the same editing processing function and that processes a plurality of processing serial number data sent from the serial number assigning means in parallel.

  According to a second invention for solving the above-mentioned problem, in the data distribution system according to the first invention, each of the plurality of editing means is edited data processed by another editing means, and the editing It is characterized by having edited data / serial number duplicating means for duplicating the processed serial number of the completed data.

According to a third invention for solving the above-mentioned problem, in the data distribution system according to the first or second invention, each of the plurality of editing means is different from the serial number assigning means and the distribution means. It is comprised from the server of this. That is, a serial number assigning unit that assigns processing sequence numbers to received messages in the order received, a plurality of editing servers that edit the processing sequence numbered messages sent from the serial number assigning units, and a plurality of editing servers Distribution means for delivering the plurality of edited electronic messages in the order of the processing sequence numbers, wherein the plurality of editing servers each have the same editing processing function, and the plurality of processing sequence numbers sent from the sequence number giving means In this case where the electronic messages are processed in parallel, the serial number assigning means and the delivery means may be accommodated in different servers or in the same server.

  A fourth invention for solving the above-mentioned problem is a distribution system for securities / financial trading / contract data, wherein serial number giving means for giving processing serial numbers to received data in the order received, and the serial numbers A plurality of editing means for editing the process serial number data sent from the assigning means, the plurality of editing means each having the same editing processing function, and a plurality of processes sent from the serial number giving means The data distribution system is characterized in that serial numbered data is processed in parallel.

  According to the first invention, serial number assigning means for assigning process serial numbers to the received data in the order received, a plurality of editing means for editing the process serial number data sent from the serial number assigning means, Distribution means for distributing a plurality of edited data sent from a plurality of editing means in the order of the processing sequence numbers, each of the plurality of editing means having the same editing processing function, and sent from the sequence number giving means In addition, since multiple processing sequence numbered data are processed in parallel, even if received data of the same brand is concentrated in a short time, the load of the editing means is distributed and the order of the received data is reversed. There is an effect that it is possible to distribute in the order received.

According to a second invention, in the first invention, each of the plurality of editing means replicates the edited data edited by the other editing means and the processing sequence number of the edited data. Since the edited data / serial number duplicating means is provided, the order of the data sent from the plurality of editing means to the delivery means can be almost the order of the data sent from the host computer. There is an effect that it is possible to reduce the load on the distribution means for distributing the edited data in the order of the processing sequence numbers.
It should be noted that the data sent from the serial number assigning means to the editing means has a certain time interval and the data sending order sent from the editing means is not reversed or sent from the editing means to the distribution means. When strictness is not required for the order of data to be transmitted, that is, when the reverse of the data transmission order within a short period of time can be allowed, the distribution means can be omitted. In such a case, it can be set as the structure of 4th invention.

  According to a third invention, in the first invention or the second invention, each of the plurality of editing means is constituted by a server different from the serial number assigning means and the delivery means. Therefore, for example, when the number of received messages of a specific brand increases and the load on the editing server increases, there is an effect that it is possible to easily cope with the problem by adding the editing server.

[Outline of the embodiment]
A data distribution system according to an embodiment of the present invention is a distribution system for securities / financial trading / contract data, a serial number assigning server that assigns a processing serial number to a received message in the order received, and the serial number Check whether multiple editing servers that edit the processing sequence numbered messages sent from the grant server and the plurality of edited messages sent from the plurality of editing servers are scheduled to be distributed in the order of processing sequence numbers. A plurality of editing servers each having the same editing processing function, and performing parallel processing on a plurality of processing sequence numbered messages sent from the sequence number assigning server, Each of the plurality of editing servers edits the edited data edited by the other editing servers and the edited data for duplicating the processing sequence number of the edited data. And it has a data-communication number replication unit.

[Overall configuration of this system: Fig. 1]
A data distribution system according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is an overall configuration diagram of a data distribution system according to an embodiment of the present invention.
As shown in FIG. 1, the data distribution system (this system) according to the embodiment of the present invention includes securities-related and financial-related trading data received from a host computer 1 such as each stock exchange via a network 10, One serial number assigning server 2 that assigns a processing serial number to a message including contract data, and a plurality of units that edit the message received from the serial number assigning server 2 for the terminal 5 and distribute it via a network 11 such as a LAN. The editing server 3, the distribution server 4 that receives messages sent from the plurality of editing servers 3 via the network 12, controls and distributes the messages in the order of processing sequence numbers, and the messages sent from the distribution server 4 through the network 14. Via a terminal 5 for receiving and displaying via the terminal.

Each server of this system will be specifically described.
[Serial number assignment server]
The serial number assigning server 2 includes a receiving unit 21, a transmitting unit 24, a serial number assigning unit 22, and a storage unit 23 as functions, and includes at least a CPU and a memory as hardware. The serial number assigning server 2 receives a message including securities-related and financial-related trading data and contract data received from each transaction place by the receiving unit 21 and stores it in the storage unit 23, and assigns a processing serial number by the serial number giving unit 22. Then, the message to which the processing sequence number is assigned is distributed to the editing server 3 that is a lower server via the network 11 such as a LAN by the transmission unit 24. As the function of the serial number assigning server 2, in order to increase the ability to cope with the load increase due to the increase in the amount of received telegrams, there is no telegram editing function or the like other than the transmission / reception function, and only the function of assigning the processing serial number It is desirable to have.

FIG. 2 is an example of a message including securities data received from a stock exchange. The message size indicates a message length such as how many bytes the message is. The information type indicates the information type such as stock, exchange rate, news, and the like. In the present embodiment, the information type indicates stock. The brand ID is a code that identifies a unique brand. The trading place is a code indicating a stock exchange such as the Tokyo Stock Exchange or the Osaka Stock Exchange where the information indicated by the message was traded. The industry type is a code indicating the industry type of the brand specified by the brand ID. The opening price, the high price, the low price, and the current price are data indicating the opening price, the high price, the low price, and the current price of the stock specified by the brand ID, and are display target data that is displayed on the terminal.

FIG. 3 is a configuration example of a message that is given a serial number (serial number) in the serial number assigning server 2 and is transmitted to the editing server 3. Processing sequence number data is assigned to the message of FIG. 2, and the message size is updated accordingly.

[Edit Server]
The editing server 3 includes a reception unit 31, a transmission unit 37, an editing unit 32, an edited data / serial number replication unit 36, and a storage unit 33 as functions, and includes at least a CPU and a memory as hardware. The storage unit 33 of the editing server 3 includes a received data storage table 34 that stores the latest data of each brand, a processed serial number storage unit 35, and a distribution editing area 38.
The editing server has the functions shown in the processing steps described below, and these will be described with reference to the flowcharts of FIGS. 4a and 4b.

[Receive message check step (S1)]
The editing server receiving unit 31 receives a message sent from the serial number assignment server 2 and stores it in the storage unit 33, and refers to the information type to determine whether the received message is a processing target of the editing server 3. The received message is checked such as whether there is a missing data item in the received message and whether the serial number is inappropriate (for example, not in ascending order). If there is no problem as a result of the received message check, the process proceeds to the received data editing step (S2). If there is a problem, the received message is discarded.

[Received data editing step (S2)]
If there is no problem as a result of the received message check, the editing unit 32 updates each received message stored in the storage unit 33 in order to update the received data storage table 34 storing the latest data of each brand. Edit processing such as extracting necessary data from the data item and converting it into a predetermined format is performed.

[Process serial number confirmation step (S3)]
The message data transmitted from the host computer 1 of the stock exchange is configured as shown in FIG. 2, for example, but the item whose data has changed (for example, the current value) has been transmitted but the data has not changed. (For example, the opening price) is omitted and may not be transmitted.
Moreover, although the message | telegram data transmitted to the client terminal 5 from the edit server 3 via the delivery server 4 is a structure like FIG. 3, for example, it is necessary to transmit without omitting the item in which data has not changed.
Therefore, in order to process a plurality of message data related to the same brand by the plurality of editing servers 3, each editing server 3 obtains data edited by the other editing servers 3 for the brand, and the same brand for the same brand. Need to keep edited data.

Therefore, the editing server 3 transmits the edited and updated data to the other editing server 3, and the received editing server 3 updates the received data storage table 34 and the processed serial number storage unit 35 in its own server. To. Thereby, each editing server 3 can hold the same received and edited data. At this time, in order to shorten the processing time, the data to be transmitted to the other editing server 3 is in the same format as the format stored in the received data storage table 34, and all items or differences (differingly) Item). The transmission path may be through the network 11 that connects the editing server 3 and the serial number assigning server 2, or is a network that is not connected to the serial number assigning server 2 and connects the editing servers 3 to each other. A separate network 13 may be provided and passed through. In addition, when the received data storage table 34 and the processed serial number storage unit 35 included in each editing server 3 are memory storage type databases and a replication function (replication function) is prepared, the replication function is used. Also good.

Further, when the message data continuously transmitted from the host computer 1 for the same brand is processed almost simultaneously by the plurality of editing servers 3, the received data storage table 34 and the processed serial number storage unit 35 of each editing server 3 are processed. Since updates occur at the same time, conflicts and reversal of the update order may occur.

In order to avoid this, the processing sequence number assigned by the sequence number assigning server 2 is used. In each editing server 3, before updating the received data storage table 34, the serial number of the message immediately before the currently processed message is stored in the processed serial number storage unit 35 with reference to the processed serial number storage unit 35. Make sure that That is, it is confirmed whether or not the serial number-1 of the currently processed message is stored.
If the serial number of the message immediately before the message currently being processed (the serial number of the message currently being processed-the serial number of 1) is not stored, it is possible that another editing server 3 is currently editing. The received serial number storage unit 35 waits for an update process of the received data storage table 34 until the serial number-1 of the message currently being processed is reached.

[Step of Updating Received Data Storage Table 34 (S4)]
When the processed serial number storage unit 35 stores the serial number of the message immediately before the currently processed message (the serial number of the currently processed message-the serial number of 1), the editing server 3 or other editing In the server 3, since the processing of the previous message has been completed, the received data storage table 34 is updated with the data of the message currently being processed.

[Update Step of Processed Serial Number Storage Unit 35 (S5)]
When the received data storage table 34 is updated in step S4, the processed serial number storage unit 35 is updated based on the serial number of the message currently being processed.

[Replication data replication step (S6)]
The edited data / serial number replicating unit 36 transmits the data in the received data storage table 34 and the processed serial number storage unit 35 updated in steps S4 and S5 to all the other editing servers 3. The edited data / serial number replicating unit 36 of the other editing server 3 that has received the transmitted data updates its own received data storage table 34 and processed serial number storage unit 35 according to the processing flow of FIG. 4b. When the received data is updated in one editing server 3 in this way, the updated data is copied in another editing server 3.

[Distribution Data Editing Step (S7)]
The received processing sequence number data is added to the distribution data transmitted from the editing server 3 to the distribution server 4 and edited. In editing the distribution data, there may be a case where the items of the distribution data are insufficient only with the reception data edited in the step S2, so that the update data of the corresponding brand is stored when the reception data storage table 34 is updated in the step S4. The data is temporarily stored in the distribution editing area 38 constituting a part of the unit 33.

[Distribution data distribution step (S8)]
The distribution data edited in step S7 is transmitted to the distribution server 4.

[Distribution server]
The distribution server 4 includes a reception unit 41, a transmission unit 44, a message transmission order control unit 43, and a storage unit 42 as functions, and includes at least a CPU and a memory as hardware.
Since the sequence control of the messages is performed in the update processing of the editing server 3, even if a plurality of received messages of the same brand are processed at the same time in the plurality of editing servers 3, the message transmission from each editing server 3 There should be a slight difference in timing according to the process serial number. However, the message sequence control processing in the editing server 3 is until the distribution data is set in the transmission buffer of the OS (operating system), and the distribution data is actually set in the order set in the transmission buffer. 3 is not guaranteed. Since the difference in timing when the distribution data is set in the transmission buffer of the OS of each editing server 3 is small, depending on the state of the OS of the network 12 and each editing server 3, the order of the messages actually sent from the editing server is reversed. It can also be done.

In order to avoid such an order reversal of transmitted messages, the distribution server 4 temporarily receives distribution message data from each editing server 3 and stores it in the storage unit 42, and the message transmission order control unit 43 Then, an appropriate order is determined based on the processing sequence number data in the received distribution message, and distribution is made to the terminal 5 based on the order of the processing sequence numbers.
In order to perform the above processing, for example, in the distribution server 3, one reception queue (FIFO) 45 prepared for each editing server 3 is provided as a part of the storage unit 42, and the queues 45 are arranged in the order in which the messages are received. You may make it store in.
The message transmission order control unit 43 stores the processed sequence number of the distributed message in the distributed sequence number storage unit 46, and extracts and distributes the message of the next processing sequence number from one of the queues 45. Control.

At the time of distribution, the processing sequence number is additional data for distributed processing in the editing server 3 and may be omitted. In addition, it is desirable that the distribution server 4 does not perform editing processing such as data format conversion, shortens processing time only for processing relating to processing sequence numbers, and enables processing of messages from a plurality of editing servers 3. .

[Effect of the embodiment]
The data distribution system according to the embodiment of the present invention is a distribution system for securities / financial trading / contract data. The serial number assigning server 2 assigns a processing serial number to the received message in the order received, and A plurality of editing servers 3 for editing the processing sequence numbered messages sent from the sequence number assigning server 2 and a plurality of edited messages sent from the plurality of editing servers are checked to be distributed in the order of processing sequence numbers; A distribution server 4 that controls and distributes the processing numbers in order, and each of the plurality of editing servers 3 has the same editing processing function, and processes a plurality of processing numbered messages sent from the numbering server 2 in parallel. In addition, each of the plurality of editing servers 3 can edit the edited data edited by the other editing servers 3 and the processing serial number of the received edited data. Since the data distribution system has the edited data / serial number duplication unit 36 for receiving, even if received data of the same brand is concentrated in a short time, the load of the editing server 3 is distributed and the received data The order of the data sent from the plurality of editing servers 3 to the delivery server 4 is almost the order of the data sent from the host computer 1. And the load on the distribution server 4 can be reduced. Further, for example, when the number of received messages of a specific brand increases and the load on the editing server 3 increases, by adding the editing server 3 There is an effect that can be easily handled.

In the above embodiment, the serial number assigning means, the editing means, and the distribution means are configured as separate servers such as a serial number assigning server, an editing server, and a distribution server. However, as shown in FIG. The functions of the means and the distribution means can be accommodated in one server 100. In this case, it is desirable from the viewpoint of processing speed that a CPU is used to control the entire server and that a plurality of serial number assigning processes, editing processes, and distribution processes are controlled by different CPUs.
In addition, by using a shared resource such as a shared memory among a plurality of editing processes as a received data storage table or a processed serial number storage unit, the received data storage table 34 or The synchronization processing (processing for checking whether the serial number of the currently processed message-1 serial number is stored) in the update of the processed serial number storage unit 35 becomes unnecessary.

  The present invention is suitable for a data distribution system that distributes the load of the editing server 3 that edits received data.

1 is an overall configuration diagram of a data distribution system according to an embodiment of the present invention. It is explanatory drawing which shows the content of the message | telegram which a serial number provision server receives. It is explanatory drawing which shows the content of the message | telegram transmitted from a serial number assignment | providing server. It is a flowchart which shows the edit process of an edit server. It is a processing process block diagram by the server with multiple CPU. It is a whole data distribution system block diagram.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Host computer (information provision source device), 2 ... Serial number assigning server, 3 ... Editing server, 4 ... Distribution server, 5 ... Client terminal, 22 ... Serial number assigning unit, 32 ... Editing unit, 34 ... Received data storage table, 35 ... Processed serial number storage unit, 36 ... Edited data / serial number replication unit, 43 ... Message transmission order control unit

Claims (4)

It is a distribution system for securities / financial trading / contract data,
Serial number assigning means for assigning process serial numbers to the received data in the order received;
A plurality of editing means for editing the processing serial number data sent from the serial number assigning means;
A delivery means for delivering a plurality of edited data sent from the plurality of editing means in the order of the processing sequence numbers;
A data distribution system in which each of the plurality of editing units has the same editing processing function and processes a plurality of processing sequence numbered data sent from the sequence number assigning unit in parallel. 2. Each of the plurality of editing means has edited data / serial number duplicating means for duplicating edited data edited by other editing means and a processing sequence number of the edited data. Data distribution system.   The data distribution system according to claim 1, wherein the serial number assigning unit, the editing unit, and the distribution unit are configured from separate servers. It is a distribution system for securities / financial trading / contract data,
Serial number assigning means for assigning process serial numbers to the received data in the order received;
A plurality of editing means for editing the process serial number data sent from the serial number assigning means,
A data distribution system in which each of the plurality of editing units has the same editing processing function and processes a plurality of processing sequence numbered data sent from the sequence number assigning unit in parallel.

Images