JP2009141665A - Packet analysis bridge apparatus, system for transmitting packet, and packet transmission method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a packet analysis bridge apparatus which provides services having gone through various processes and links existing applications with no change, without paying no attention to the process on a terminal side. <P>SOLUTION: Data analysis servers 101-1 and 101-2 are connected to packet analysis bridges 102-1 and 102-2 by fixed port numbers. The packet analysis bridges 102-1 and 102-2 convert packet port numbers satisfying a particular condition into appropriate port numbers that are connected, and transmit them to the data analysis servers 101-1 and 101-2. Settings of the packet analysis bridges 102-1 and 102-2 are opened on all Web services, and the port numbers can be set to be connected to any of data analysis servers 101-1 and 101-2. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a packet analysis bridge device, a packet transmission system, and a packet transmission method for relaying streaming data packets, for example.

  As a method for setting network devices such as routers via a network, a method for describing setting information in an XML (Extensible Markup Language) format is known (see, for example, Non-Patent Document 1). This eliminates the need for humans to log in to the router using ssh (Secure SHell), rlogin (remote login), etc. to rewrite the settings when a network failure occurs, and it is possible to quickly restore many network devices using scripts. become.

In the broadcasting business, a similar transmission technology called FMTP (Synchronous Transmission Protocol), which is an extension of RTP (Real-time Transport Protocol), has been proposed as a module class that handles the protocol. Is incorporated into an editing application at a program level to construct a processing node and share editing equipment in a remote place (see, for example, Non-Patent Document 2).
R. Enns, Ed. “NETCONF Configuration Protocol”, RFC 4741-4744, IETF. Yutaka Kaneko, “Network content creation and creation system”, Journal of the Institute of Image Information and Television Engineers, Vol. 60, no. 5, pp. 697-701.

  However, the above-described prior art (Non-Patent Document 1) basically has the advantage of being able to handle various devices in a unified manner because it is about the setting change that can be performed by the router. There is a problem that various services cannot be realized by changing.

  In the above-described prior art (Non-Patent Document 2), the only stream format that can be processed is FMTP, and all the servers and terminals that send data at the end have instances of the transmission / reception module class that handles FMTP. Therefore, there is a problem that it cannot be easily applied to a stream transmitted by an existing application.

  Further, since all the processing nodes do not process anything other than the stream transmitted to themselves, there is a problem that it is necessary to send out the stream in consideration of the processing node to be performed first on the terminal side.

  The present invention has been made in consideration of such circumstances, the purpose of which can provide a service through a plurality of various processing, without being conscious of processing on the terminal side, It is an object of the present invention to provide a packet analysis bridge device, a packet transmission system, and a packet transmission method that can link existing applications without any change.

  In order to solve the above-described problem, the present invention is connected to a data analysis server device that performs predetermined processing on a received packet, and transmits the packet by referring to header information included in the received packet. A packet analysis bridge device, a storage unit for storing input conditions including predetermined header information and relay destination setting information including information destined for the predetermined data analysis server device, and receiving a packet A receiving unit; an input condition determining unit that determines whether or not header information of a packet received by the receiving unit matches header information included in an input condition stored in the storage unit; and the input condition If the determination unit determines that they match, the header information of the packet is read and temporarily stored, and the information included in the relay destination setting information is set as the destination. Receiving the packet transmitted from the data analysis server device, the relay transmission unit that rewrites the header information of the packet and transmits it to the data analysis server device according to the header information, with the header information that is transmitted from the own device, The relay receiving unit that rewrites and outputs the header information of the received packet with the original header information temporarily stored by the relay transmitting unit, and the destination of the header information included in the packet by the packet output by the relay receiving unit A packet analysis bridge device comprising: a transmission unit that transmits the information according to information indicating

  In the invention described above, the storage unit further stores an output setting list including header information destined for another predetermined packet analysis bridge device, and the transmission unit includes the relay The packet output by the receiving unit is encapsulated with header information included in the output setting list stored in the storage unit, and transmitted to the other packet analysis bridge device according to the encapsulated header information. When the received packet is encapsulated by another packet analysis bridge device, decapsulation is performed.

  Further, the present invention is the above described invention, wherein the storage unit has a flag indicating that the packet is duplicated, and the input condition determination unit determines that both header information matches, When the flag stored in the storage unit indicates duplication, the packet is duplicated, one packet is output to the relay transmission unit, the other packet is output to the transmission unit, and the transmission unit The packet output from the input condition determination unit is transmitted according to information indicating a destination of header information included in the packet.

  In the present invention described above, when the storage unit has a flag indicating transparency for transmitting a packet as it is, and the input condition determination unit determines that both header information matches When the flag stored in the storage unit indicates transparency, the packet is output to the transmission unit as it is, and the transmission unit outputs the packet output from the input condition determination unit to the header information included in the packet. It transmits according to the information which shows a destination.

  In the invention described above, the relay destination setting information stored in the storage unit may be the IP address of the data analysis server device as information destined for the predetermined data analysis server device. And an input port number that receives the packet and an output port number that performs the predetermined processing on the packet received at the port number and transmits the packet, and the relay transmission unit includes header information of the packet Is stored and temporarily stored, the header information read in association with the IP address and output port number of the data analysis server device set in the relay destination setting information is stored, and the relay receiving unit When the packet transmitted from the data analysis server device is received, the source IP address of the received packet and the source port The original header information the temporarily stored corresponding to No., characterized in that rewriting the header information of the packet.

  In addition, the present invention provides a packet analysis bridge device, a data analysis server device connected to the packet analysis bridge device, for performing predetermined processing on a packet received from the packet analysis bridge device, and the packet analysis bridge device. A packet transmission system including a connected integrated command server device, wherein the packet analysis bridge device receives input conditions including predetermined header information and information destined for the predetermined data analysis server device. A storage unit that stores relay destination setting information, a reception unit that receives a packet, header information of a packet received by the reception unit, and header information included in an input condition stored in the storage unit When it is determined that the input condition determination unit that determines whether or not the input condition determination unit matches, Read out the header information of the packet, temporarily store it, rewrite the header information of the packet according to the header information by rewriting the header information with the information included in the relay destination setting information as the destination and the source device as the transmission source The relay transmission unit that transmits to the data analysis server device, the packet transmitted from the data analysis server device is received, and the header information of the received packet is the original header information temporarily stored by the relay transmission unit. A relay receiving unit that rewrites and outputs; and a transmission unit that transmits a packet output from the relay receiving unit according to information indicating a destination of header information included in the packet, wherein the integrated command server device is input A processing content receiving unit that receives processing content information indicating processing requested to the packet analysis bridge device, and the processing content receiving unit receive the processing content information. A data analysis server device to be connected to each packet analysis bridge device according to the processed content information, an input condition to be set in a storage unit of each packet analysis bridge device, a setting unit that generates relay destination setting information, and the setting unit And a recording control unit for storing the input condition set in the storage unit of each packet analysis bridge device generated by the storage unit and the storage unit of the corresponding packet analysis bridge device. is there.

  Further, the present invention provides the packet analysis bridge device according to the above-described invention, wherein the storage unit further stores an output setting list including header information destined for another predetermined packet analysis bridge device. The transmission unit encapsulates the packet output from the relay reception unit with header information included in the output setting list stored in the storage unit, and sends the packet to the other packet analysis bridge device according to the encapsulated header information. The reception unit performs decapsulation when the received packet is encapsulated by another packet analysis bridge device, and the integrated command server device includes a plurality of packet analysis bridges in the setting unit. When packets are transmitted and received between devices, each packet analysis bridge device To generate the input conditions, relay destination setting information, output setting list to be set in the storage unit of each packet analysis bridge device based on the detected encapsulation and decapsulation settings, The recording control unit stores the input condition, relay destination information, and output setting list set in the storage unit of each packet analysis bridge device generated by the setting unit in the storage unit of the corresponding packet analysis bridge device. And

  Further, the present invention provides a packet transmission by a packet analysis bridge device that is connected to a data analysis server device that performs predetermined processing on a received packet and that transmits the packet with reference to header information included in the received packet. In the method, the packet analysis bridge device includes a storage unit that stores input conditions including predetermined header information and relay destination setting information including information destined for the predetermined data analysis server device. The packet receiving step, the header information of the received packet and the step of determining whether or not the header information included in the input condition stored in the storage unit match, The packet header information is read out, temporarily stored, and the information included in the relay destination setting information is sent to the destination Then, with header information originating from its own device, rewriting the header information of the packet and transmitting to the data analysis server device according to the header information, receiving the packet transmitted from the data analysis server device, Rewriting and outputting the header information of the received packet with the original header information temporarily stored by the relay transmission unit, and transmitting the output packet according to information indicating the destination of the header information included in the packet And a packet transmission method characterized by comprising:

  According to this invention, the packet analysis bridge device includes a storage unit that stores input conditions including predetermined header information, and relay destination setting information including information destined for a predetermined data analysis server device, , An input condition determination unit that determines whether the header information of the packet received by the reception unit matches the header information included in the input condition stored in the storage unit, and the input condition When it is determined that the determination unit matches, the header information of the packet is read out, temporarily stored, the information included in the relay destination setting information is the destination, and the header of the packet is the header information with the own device as the transmission source. Receiving a packet transmitted from the data analysis server device, and a relay transmission unit that rewrites the information and transmits it to the data analysis server device according to the header information, Information indicating the destination of the header information included in the packet, the relay receiving unit that rewrites and outputs the header information of the received packet with the original header information temporarily stored by the relay transmitting unit, and the packet output by the relay receiving unit And a transmission unit for transmitting according to the above. Therefore, it is possible to provide a service through a plurality of various processes by using a packet analysis bridge device that performs a predetermined process, and the packet transmission / reception process at the terminal side, that is, the existing application is not changed at all. The advantage of being able to be linked to is obtained.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a stream type Web service cooperation system which is a packet transmission system according to an embodiment of the present invention. In the figure, a plurality of processing nodes 104-1 to 104-3 and an integrated command server 100 are connected on a network 105. The processing nodes 104-1 to 104-3 process the stream data packets transmitted from the terminals 103-1 and 103-2. The terminals 103-1 and 103-2 transmit and receive stream data, while accessing the integrated command server 100 to obtain internal information of the packet analysis bridges 102-1 to 102-3 included in the processing nodes 104-1 to 104-3. Send information to set or change. The integrated command server 100 sets the internal information of the packet analysis bridges 102-1 to 102-3 included in the processing nodes 104-1 to 104-3 according to the information received from the accessed terminals 103-1 and 103-2. Or change.

  The processing nodes 104-i (i = 1, 2, 3) respectively include a packet analysis bridge 102-i (i = 1, 2, 3) and a data analysis server 101-i (i = 1, 2, 3). It consists of and. The packet analysis bridge 102-i performs transfer, mirroring (duplication), encapsulation, etc. according to the contents of the packet that has reached itself. The data analysis server 101-i has two types, a conversion type and a termination type, which will be described later. The data analysis server 101-i receives a packet transmitted from the packet analysis bridge 102-i, and performs processing corresponding to each type on the packet. Do.

  Although not shown in FIG. 1, the setting of the data analysis server 101-i may be directly performed from the terminals 103-1 and 103-2 by the Web published by the integrated command server 100.

 Further, in FIG. 1, the packet analysis bridges 102-1 to 102-3 are shown to be connected to the data analysis servers 101-1 to 101-3 on a one-to-one basis, but other processing nodes 104-i. The data analysis server 101-i (i = 1, 2, 3) may be connected to cause the data analysis server 101-i to perform processing. When the packet analysis bridge 102-i is connected to two or more data analysis servers 101-i, there are two processing nodes 104-i for one packet analysis bridge 102-i.

  Next, FIG. 2 is a block diagram showing an internal configuration of the integrated command server 100 according to the present embodiment. In the figure, the integrated command server 100 includes a processing content receiving unit 1001, a recording control unit 1002, a setting unit 1003, and a processing content storage unit 1004. The processing content receiving unit 1001 receives processing content information constituting the format of the processing graph described later from the terminals 103-1 and 103-2, and stores the received processing content information in the processing content storage unit 1004. . The processing content storage unit 1004 stores information on the processing content received by the processing content receiving unit 1001, information previously set in the data analysis server 101-i, and packet analysis bridge 102-i. And the transmission / reception IP address and port number of the data analysis server 101-i are stored.

  When the processing content is stored in the processing content storage unit 1004, the setting unit 1003 stores information on the processing content, information set in advance in the data analysis server 101-i, packet analysis bridge 102-i, and data With reference to the transmission / reception IP address and port number of the analysis server 101-i, an input condition, relay destination setting information, and output setting list set for each packet analysis bridge 102-i are generated.

  For example, when converting the codec of a packet, the input conditions of the packet analysis bridge 102-i include the IP address and port number of the transmission / reception destination of the packet to be processed, the protocol used for transmission / reception, and the transfer mode As relay destination setting information, for example, information for selecting a conversion-type data analysis server 101-i that performs codec conversion as described later is generated.

  In addition, when only storing a packet for analysis, the input conditions of the packet analysis bridge 102-i include the IP address and port number of the transmission / reception destination of the packet to be processed, the protocol used for transmission / reception, and the copy Information for setting a mode is generated, and as relay destination setting information, information for selecting a terminal-type data analysis server 101-i that only stores packets as described later is generated.

  Further, when a packet is transferred between the packet analysis bridges 102-i, an encapsulation setting is made in the output setting list of the packet analysis bridge 102-i of the transmission source, and the packet analysis bridge 102- For the input condition of i, information for setting to decapsulate is generated.

  The recording control unit 1002 receives information to be set for each packet analysis bridge 102-i generated by the setting unit 1003 from the setting unit 1003, and analyzes each packet through an API (Application Interface) of “setBridgeProperty” described later. The information generated by the setting unit 1003 is stored in the storage unit of the bridge 102-i.

  Next, FIG. 3 is a block diagram showing an internal configuration of the packet analysis bridge 102-i according to the present embodiment. In the figure, the packet analysis bridge 102-i includes a packet receiving unit 1021, a storage unit 1022, an input condition determining unit 1023, a relay transmitting unit 1024, a relay receiving unit 1025, and a packet transmitting unit 1026. The packet receiver 1021 receives a packet from the other packet analysis bridge 102-i via the terminal 103-1 or the network 105. The storage unit 1022 designates input conditions including predetermined header information, relay destination setting information including header information whose destination is a predetermined data analysis server 101-i, and an output destination. The output setting list is stored. The input condition determination unit 1023 determines whether or not the header information of the packet received by the packet reception unit 1021 matches the header information included in the input condition stored in the storage unit 1022. Further, the input condition determination unit 1023 duplicates a packet, outputs one to the packet transmission unit 1026, and outputs the other to the relay transmission unit 1024 in a replication mode described later. Further, the input condition determination unit 1023 outputs the packet to the packet transmission unit 1026 in the case of a transparent mode to be described later.

  The relay transmission unit 1024 reads the header information of the packet when the input condition determination unit 1023 determines that both header information, that is, the header information of the received packet matches the header information included in the input condition, The header information of the packet is written in the internal storage area, temporarily stored, the header information of the packet is rewritten with the header information included in the relay destination setting information, and transmitted to the data analysis server 101-i according to the header information. .

  The relay receiving unit 1025 receives the packet transmitted from the data analysis server 101-i, and rewrites the header information of the received packet with the original header information of the packet stored in the internal storage area. The packet transmission unit 1026 applies the setting of the output setting list stored in the storage unit 1022 to the packet rewritten by the relay reception unit 1025, and transmits the packet according to the information indicating the destination of the header information included in the packet To do. Further, in the case of the duplication mode described above, the packet transmission unit 1026 applies the setting of the output setting list stored in the storage unit 1022 and transmits it according to the information indicating the destination of the header information included in the packet. Further, in the case of the transparent mode described above, when the packet is output from the input condition determination unit 1023, the packet transmission unit 1026 transmits the packet as it is according to the header information.

  In the packet analysis bridge 102-i, in the above-described example, the packet reception unit 1021 and the packet transmission unit 1026 are connected to the network 105, and the relay transmission unit 1024 and the relay reception unit 1025 are connected to the data analysis server 101-i. In other words, the network to which the packet receiving unit 1021 and the packet transmitting unit 1026 are connected is different from the network to which the relay transmitting unit 1024 and the relay receiving unit 1025 are connected, and the configuration includes two NICs. That is, a configuration is shown in which the packet receiving unit 1021 and the packet transmitting unit 1026 are allocated to one NIC (Network Interface Card), and the relay transmitting unit 1024 and the relay receiving unit 1025 are allocated to the other NIC.

  However, the present invention is not limited to this embodiment. For example, the data analysis server 101-i is connected to the network 105, and the packet reception unit 1021, the packet transmission unit 1026, the relay transmission unit 1024, and the relay reception unit 1025 are connected. However, communication may be performed using one or a plurality of NICs. In the case of using a plurality of NICs, for example, in FIG. 1, the data analysis server 101-1 is connected to the network 105 side of the packet analysis bridge 102-1, and different networks are connected to the terminal 103-1 side and the network 105 side. This is the case. In such a case, the packet receiving unit 1021 is configured to output a packet from the data analysis server 101-i among the received packets to the relay transmitting unit 1024, and the packet transmitting unit 1026 is configured to output data among the packets to be transmitted. A packet to be transmitted to the analysis server 101-i is configured to be output to the relay transmission unit 1024.

  Next, FIG. 4 is a block diagram showing an internal configuration of the data analysis server 101-i according to the present embodiment. In the figure, the data analysis server 101-i includes a processing content storage unit 1011, a packet transmission / reception unit 1012, and a processing unit 1014. The processing content storage unit 1011 stores information indicating predetermined processing (for example, effect and codec conversion described later, voice recognition and video recognition analysis processing, etc.) set in advance by the integrated command server 100. The packet transmitting / receiving unit 1012 receives a packet from the packet analysis bridge 102-i and transmits the packet processed by the processing unit 1014 to the packet analysis bridge 102-i that is a transmission source. The processing unit 1014 performs predetermined processing on the received packet based on the information stored in the processing content storage unit 1011. The predetermined processing types stored in the processing content storage unit 1011 are roughly divided into two processing types, a conversion type and a termination type.

  In the case of the conversion type, for example, for the packet transmitted from the packet analysis bridge 102-i, the data is converted and transferred without converting the type, such as effect or codec conversion.

  In the case of the termination type, for example, a packet transmitted from the packet analysis bridge 102-i is terminated and stored in an internal database for analysis or the like. In the case of the terminal type, there are cases where processing such as voice recognition and video recognition is performed based on a packet stored in a database, and the processing result is transmitted to the packet analysis bridge 102-i. Also, the internal setting of the data analysis servers 101-1 to 101-3, that is, the conversion type, termination type, and the data conversion method in the conversion type, the analysis processing in the termination type, and the like are performed by, for example, an integration command It is assumed that information indicating the processing content is stored in advance in the processing content storage unit 1011 through the server 100.

Next, details of the packet analysis bridge 102-i (i = 1, 2, 3) will be described.
For example, the condition of the packet to be processed by the packet analysis bridge 102-i and the mode setting for cooperation with the data analysis servers 101-1 to 101-3 are set for the users of the terminals 103-1 and 103-2. The API specification of “setBridgeProperty” as shown in FIG. The API specification is disclosed in the form of a processing graph described later as a Web service in the integrated command server 100. FIG. 5 is a table showing return values and arguments of the API, and there are “in_c”, “server”, and “o_c” as argument names. The return value type is “int”, and the argument types are “p_cond *”, “D_set”, and “p_cond *”. As a return value, “setting number (negative value is error code)” is output, and the input contents of each argument are “packet input condition”, “relay destination setting list”, and “packet output setting list”. Note that “p_cond” is a structure in which five tuples (source IP address, source port number, destination IP address, destination port number, protocol) and an encapsulation flag are collected as shown in FIG.

  When the API is executed by the recording control unit 1002 of the integrated command server 100, one setting is added to the storage unit 1022 of the packet analysis bridges 102-1 to 102-3. The operation of the packet analysis bridge 102-i (i = 1, 2, 3) is roughly divided as shown in the sixth field “int mode; // 0: transparent, 1: transfer, 2: duplication” shown in FIG. There are three modes as shown in FIGS.

(A1) Transfer mode: a packet matching the input condition of the first argument is a relay destination indicated by the relay destination setting information specified by the second argument (data analysis server 101-i: i = 1, 2, 3) , And the packet returned after being processed at the relay destination is transmitted according to the output setting list of the third argument (FIG. 7A).
(A2) Duplicate mode: When a packet matching the input conditions is transferred to the relay destination, it is duplicated and sent to the original destination terminal or other packet analysis bridge 102-i according to the output setting list of the third argument (FIG. 7B).
(A3) Transparent mode: In the default mode, the packet is transferred from the input to the output as it is (FIG. 7C).

  The first argument is a list of input conditions indicated by the argument name “inc_c” shown in FIG. 5, and p_cond instances are stored in the order of input of the data analysis server 101-i. Therefore, the number of elements is the same as the number of inputs of the data analysis server 101-i. The second argument “server” is a list of D_set structures to be described later, and sets a candidate list of information of the data analysis server 101-i that can be used as a relay destination. The number of elements may be one or more. The third argument “o_c” is an output setting list, and p_cond instances are stored in the order of output of the data analysis server 101-i. Therefore, the number of elements is the same as the number of outputs of the data analysis server.

  The last field of the p_cond structure is an encapsulation flag. When the encapsulation flag in the input condition is true, decapsulation is performed and the packet is transferred to the relay destination. If the encapsulation flag in the output setting list is true, the packet is encapsulated and transmitted. At this time, if the original packet size is large, it is fragmented again.

  Next, FIG. 8 is a conceptual diagram showing how the packet analysis bridge 102-i and the data analysis server 101-i cooperate in each processing node 104-i according to the present embodiment. The data analysis server 101-i basically receives input data using a socket, performs predetermined processing according to information stored in the processing content storage unit 1011 in advance, and uses the socket to transmit result data to other terminals. Is a server having a mechanism for outputting. The input / output of the data analysis server 101-i is classified as follows, and the mode of the associated packet analysis bridge 102-i is different.

(B1) Conversion type: This is a case where data is altered and transferred without converting the type, such as effect or codec conversion, and is linked in the transfer mode of the packet analysis bridge 102-i.
(B2) Termination type: When used for the purpose of analysis, such as voice recognition and video recognition, when the analysis result is stored in an internal database or the like without being transferred elsewhere, the packet analysis bridge 102-i Link in replication mode. Further, the analysis result may be transferred to the packet analysis bridge 102-i. In this case, since the original packet needs to be transmitted, the packet analysis bridge 102-i cooperates in the duplication mode.

  A “D_set” structure shown in FIG. 9 is defined to cooperate with the packet analysis bridge 102-i so that each input / output can be associated in the above case. In FIG. 9, the first field indicates the IP address of the data analysis server 101-i that is the destination. In the list of the second argument “server” of “setBridgeProperty” described above, D_set instances with different IP addresses are displayed. It is also possible to mix them. In this case, one packet analysis bridge 102-i and a plurality of data analysis servers 101-i cooperate. The second field is a list of port numbers used for input on the data analysis server 101-i side, and is stored in the list in the order of input numbers. The third field is a list of port numbers used for output in the data analysis server 101-i. The data analysis server 101-i performs predetermined processing on the packet received with the input port number described above. , The output from the port number is stored in the list in the order of the output number of the processing result.

  Here, cooperation between the packet analysis bridge 102-i and the data analysis server 101-i will be described. FIG. 10 is a sequence diagram for explaining cooperation between the packet analysis bridge 102-i and the data analysis server 102-i according to the present embodiment. Here, for the sake of explanation, two processing nodes 104-A and 104-B are arranged on the network 105, the processing node 104-A has two inputs and two outputs, and the processing node 104-B has one input and one output. It is said. In the following description, “−i, (−A, −B)” corresponding to each code is assigned as a code indicating each functional unit of the packet analysis bridge 102-i illustrated in FIG. As a code indicating each functional unit of the data analysis server 101-i shown in FIG. 4, “-i, (−A, −B)” corresponding to each code is given and described.

  As a first pattern, a data analysis server 101-A appropriately prepares an input reception port and an output transmission / reception port, makes it a D_set structure, and uses it as a Web API argument to link a packet analysis bridge Web API is executed. That is, the data analysis server 101-A executes WebAPI by using the SOAP (Simple Object Access Protocol) for the packet analysis bridge 102-A by the internal information registration function unit (SS1). As a result, the information is recorded in the storage unit 1022-A on the packet analysis bridge 102-A side.

  Further, as a second pattern, when the terminal A knows the input condition, relay destination setting information, and output setting list stored in the storage unit 1022-A of the packet analysis bridge 102-A, the terminal A The Web API of the packet analysis bridge 102-A to be linked is executed. That is, the terminal A executes Web API by the SOAPP (Simple Object Access Protocol) on the packet analysis bridge 102-A by the information registration function unit provided therein (SS2). Thus, the information is recorded in the storage unit 1022-A on the packet analysis bridge 102-A side.

  As described above, when executing the Web API, it is not always necessary to perform the operation from the data analysis server 101-A that cooperates, and the input conditions, relay destination setting information, and output setting list stored in the storage unit 1022-A are known. If it is, it may be performed from the terminal A side. The packet analysis bridge 102-A stores the input / output information of the data analysis server 101-A, but the data analysis server 101-A itself does not necessarily need to store the information of the packet analysis bridge 102-A. Absent.

  Further, as a third pattern, using the GUI (Graphical User Interface) of the integrated command server 100, input / output information of the data analysis servers 101-A and 101-B and packet analysis bridges 102-A and 102-B are used. It is also possible to register the information. That is, the data analysis server 101-A, the packet analysis bridge 102-A, the data analysis server 101-B, and the packet analysis bridge 102-B each have the GUI of the integrated command server 100 by the information registration function unit provided therein. The information is transmitted to the integrated command server 100 using HTTP (Hyper Text Transfer Protocol) (SS3, SS4).

  In this case, the integrated command server 100 selects the information to be registered in one of the data analysis servers 101-A and 101-B and the information in one of the packet analysis bridges 102-A and 102-B as an information selection function. To generate an input condition, relay destination setting information, and output setting list, and by using the information registration function unit provided in the inside using SOAP, the above-described Web API is executed. It memorize | stores in the memory | storage part 1022, and builds cooperation relation of both (SS5, SS6).

  When the cooperative relationship is established by the integrated command server 100, which of the data analysis servers 101-A and 101-B and which of the packet analysis bridges 102-A and 102-B are linked is determined in the integrated command server 100. Depends on the control application's policy settings. For example, there are policy settings such as automatically selecting a packet analysis bridge where data is easily acquired, or automatically selecting a packet analysis bridge with a low load.

  Actually, when the stream data reaches the packet analysis bridge 102-i, the packet analysis bridge 102-i selects one D_set instance of the data analysis server 101-i, and transmits the packet. The destination IP address and the destination port number are changed in association with. At this time, the packet analysis bridge 102-i temporarily stores the original header information of the packet in the internal storage area. Since the packet is output from the output port number of the selected D_set instance after predetermined processing is performed by the data analysis server 101-i, the packet analysis is performed when the packet having the port number as the transmission source is received. The bridge 102-i rewrites the header information of the packet to the original header information temporarily stored in the internal storage area.

  A D_set instance that is not already used for stream processing is selected. That is, for a packet having the same transmission / reception IP address and port number, one D_set instance is allocated, and the header information to be temporarily stored is the IP address of the data analysis server of the D_set instance and If stored in association with the output port number, the original header information can be rewritten without mixing. If all D_set instances are in use, transfer in the transparent mode. That is, the packet analysis bridge 102-i processes a plurality of stream data simultaneously for the set port number pairs.

  In FIG. 8, a processing notation example 311 schematically represents the processing node 301 or the processing node 302 shown in FIG. 8, and the internal structure of the processing nodes 301 and 302 is different, but is viewed as a processing component. The same notation is used because the number of inputs and the number of outputs are the same. In the processing node 301, the number of inputs in the data analysis server 101-i is 3, the number of outputs is 2, and all inputs are set in the transfer mode. On the other hand, in the processing node 302, the number of inputs of the data analysis server 101-i is 3, and the number of outputs is 1. However, since one of the inputs is set in the replication mode, the apparent number of outputs of the entire processing node is 2. It becomes.

  Further, the process graph 421 is obtained by connecting the input and output of each process notation (= process component) in a graph by the GUI of the integrated command server 100. The graph created on this GUI constructs a connection relationship by executing “setBridgeProperty” of each packet analysis bridge 102-i by the integrated command server 100. In the connection between the packet analysis bridges 102-i, the above-described encapsulation flag is used. When the output X of one packet analysis bridge is connected to the input Y of another packet analysis bridge, the output X and the input Y Is set to ON, and the condition port number of input Y is set as the destination port number of output X.

  In the processing component indicated by the symbol D, the external input condition is specified from the transmission / reception IP header of the packet to be processed, that is, the transmission / reception IP address / port number and the protocol. Further, in the processing components indicated by reference numerals D and C, reference signs D and A, reference signs A and C, reference signs B and C, the input and output of the packet analysis bridge 102-i are connected by encapsulation. . Further, in the processing component indicated by the symbol C, the external output condition is specified from the transmission / reception IP header or protocol of the target packet, or is specified particularly when transmission is performed according to the packet header information. Absent.

  Next, FIG. 11 is a sequence diagram for explaining a specific operation when the composite component and the recognition component of the processing graph 422 shown in FIG. 8 are used. Here, for the sake of explanation, an example in which an RTP stream is transmitted from terminal A to terminal C and an RTP stream is simultaneously transmitted from terminal B to terminal D is taken as an example. Similarly to FIG. 10 described above, two processing nodes 104-A and 104-B are arranged on the network 105, the processing node 104-A has two inputs and two outputs, and the processing node 104-B has one input. 1 output. In the following description, “−i, (−A, −B)” corresponding to each code is assigned as a code indicating each functional unit of the packet analysis bridge 102-i illustrated in FIG. As a code indicating each functional unit of the data analysis server 101-i shown in FIG. 4, “-i, (−A, −B)” corresponding to each code is given and described.

  In the storage unit 1022-A of the packet analysis bridge 102-A, the following setting is made by the above-described “setBridgeProperty”.

(C1) Input conditions: [input 1 .... RTP, transfer, no encapsulation], [input 2 .... RTP, transfer, no encapsulation]
(C2) Relay destination setting: [IP address of data analysis server 101-A, input port numbers 7510 and 7520, output port numbers 7530 and 7540]
(C3) Output setting list: [Output 1 .... Not specified], [Output 2 .... Destination: IP address and input condition port number of packet analysis bridge 102-B, with encapsulation]

  Further, it is assumed that the following setting is made in the storage unit 1022-B of the packet analysis bridge 102-B.

(D1) Input condition: [input 1 .... source IP address / port number of packet analysis bridge 102-A, destination port number (7500), duplicated, encapsulated]
(D2) Relay destination setting: [IP address of data analysis server 101-B, input port number 7710]
(D3) Output setting list: [Output 1 .... Not specified]

  The data analysis server 101-A is the conversion type data analysis server described above, and performs predetermined processing for converting the packet data. The data analysis server 101-B is the terminal type described above. In the data analysis server, a predetermined process for storing the received packet in an internal database is performed.

  First, when the packet receiving unit 1021-A of the packet analysis bridge 102-A receives the RTP stream transmitted from the terminal A and the terminal B (Sa1, Sa3), the input condition determining unit 1023 is stored in the storage unit 1022. It is determined whether or not the source IP address / port number, destination IP address / port number, and protocol of the input condition match with the header information of the received RTP packet. Here, since the source IP address / port number and the destination IP address / port number are not specified and “RTP” is set as the protocol, it is determined that they match. Since both of the packets received from terminal A and terminal B are determined to match by the input condition determination unit 1023-A, the relay transmission unit 1024-A temporarily stores the header information of the packet in the internal storage area. The header information is rewritten in accordance with the relay destination setting information stored and stored in the storage unit 1022-A.

  For the packet received from the terminal A, the source IP address and source port number of the header information are the IP address (192.168.1.4) and port number (7410) of the own packet analysis bridge 102-A, and the destination IP address and port The number is rewritten as the IP address (192.168.1.5) and the port number (7510) of the data analysis server 101-A. For the packet received from the terminal B, the source IP address and source port number of the header information are the IP address (192.168.1.4) and port number (7420) of the own packet analysis bridge 102-A, and the destination IP address And the port number as the IP address (192.168.1.5) and port number (7520) of the data analysis server 101-A.

  The relay transmission unit 1024-A transmits the packet whose header information has been rewritten in accordance with the header information, that is, to the data analysis server 101-A (Sa2, Sa4). Next, the relay destination data analysis server 101-A performs a predetermined process on each received packet, and receives the processed data from the corresponding port number, that is, the port number (7510). The received packet is output from the port number (7530), and the packet received from the port number (7520) is output from the port number 7540. Thereby, in the packet analysis bridge 102-A, the information from each port number set in the relay destination setting information is changed to the port number corresponding to the packet analysis bridge, that is, the port number (7530). (7430), and the port number (7540) is received at the port number (7440), so that it is distinguished from the packet received from the terminal A or the packet received from the terminal B (Sa5, Sa6). ).

  Subsequently, for each received packet, the relay receiving unit 1025 -A of the packet analysis bridge 102 -A writes back the header information of the packet to the source / destination IP address: port number of the original packet. The packet transmitting unit 1026-A transmits the packet from the terminal A to the terminal C through the network as it is because there is no designation in the output setting list (Sa7). On the other hand, the relay receiving unit 1025-A of the packet analysis bridge 102-A sets the output to the packet analysis bridge 102-B in the output setting list for the packet from the terminal B, and specifies the encapsulation. Therefore, it is encapsulated with a destination IP address: port number destined for the packet analysis bridge 102-B and transmitted to the packet analysis bridge 102-B (Sa8).

  Next, when the packet reception unit 1021-B of the packet analysis bridge 102-B receives the packet encapsulated from the packet analysis bridge 102-A, the input condition determination unit 1023-B of the packet analysis bridge 102-B According to the input condition, “the source is the packet analysis bridge 102-A” and “destination port number match” are analyzed, and decapsulation is performed based on the setting of the encapsulation flag set in the input condition. Then, the input condition determination unit 1023-B duplicates the packet according to the input condition, and one packet is directly transmitted to the terminal D through the network by the packet transmission unit 1026-B (Sa9). The other packet has its header information rewritten by the relay transmission unit 1024-B, transferred to the data analysis server 101-B, and stored in the internal database by the data analysis server 101-B (Sa10). ).

  In the above-mentioned example, RTP is taken up. However, this method can be handled in the same manner as long as it is basically data transmitted by UDP.

Next, a specific example of this embodiment will be described.
FIG. 12 is a conceptual diagram showing an operation when a service for synthesizing audio data as subtitles into a video stream such as a TV phone or news using the stream type web service cooperation system according to the present embodiment. The processing graph 501 is configured by combining a voice recognition component and a video composition component. In this example, it is assumed that the packet analysis bridge is arranged just outside the HGW (Home Gateway) or the like, and packets that pass from the HGW to the network (Internet) can be captured by this packet analysis bridge. ing.

  The terminal 103-1 accesses the integrated command server 100 and sets the processing content using a GUI. Next, the terminal 103-1 sends a video stream such as a TV phone or news to the packet analysis bridge 102-1. The packet analysis bridge 102-1 causes the data analysis server 101-1 to perform voice recognition of the video stream according to information set from the integrated command server 100, receives the voice-recognized character string data, and performs packet analysis Transmit to bridge 102-2. Further, the packet analysis bridge 102-1 transmits the video stream as it is to the packet analysis bridge 102-2. The packet analysis bridge 102-2 causes the data analysis server 101-2 to perform a synthesis process for synthesizing the character string data with the video stream in accordance with the information set from the integrated command server 100. The synthesized video stream is received and transmitted to the terminal 103-2.

  According to the above example, since the audio is supplemented with subtitles, it is possible to view news etc. in subtitles even in a quiet place, or even if it is difficult to hear the audio of the phone, the audio is recognized as text. The advantage that it can be obtained. The data analysis server 101-1 in the above-described example is a type that transmits the analysis result to the packet analysis bridge among the termination types described above, and the data analysis server 101-1 synthesizes two data. Therefore, the conversion type and the termination type are mixed.

  Next, FIG. 13 shows an operation for realizing a service capable of making a phone call so that the user can be in a space captured by a live camera anywhere using the stream type web service cooperation system according to the present embodiment. FIG. The application developer server 300 is operated by a service provider that provides the service in the example, and instructs the integrated command server 100 to configure the components indicated by the processing graph 601. The processing graph 601 includes three components: a depth acquisition component that measures the depth (depth) of a live camera image, a person extraction component that extracts a person, and a composition processing component that performs CG composition.

  The terminal 103-1 includes a live camera that distributes video obtained by photographing a predetermined place for a long time. The terminal 103-2 is composed of a user's mobile terminal and the like, and photographs the user's video. The terminal 103-3 is composed of a mobile terminal of another user. The packet analysis bridge 102-1 receives video from the live camera of the terminal 103-1. The packet analysis bridge 102-2 is installed in the vicinity (hot spot) of the terminal 103-1, and receives video data from the terminal 103-1. The packet analysis bridge 102-3 is installed in the vicinity (hot spot) of the terminal 103-3. In this example, it is assumed that the packet analysis bridges 102-2 and 102-3 are arranged near the hot spot, and all data accessed wirelessly can be captured.

  The application developer server 300 accesses the integrated command server 100 and sets the processing content using a GUI. In addition, the terminal 103-1 transmits the video data of the live camera to the packet analysis bridge 102-1. The packet analysis bridge 102-1 causes the data analysis server 101-1 to measure the depth (depth) of the video data according to the information set from the integrated command server 100, and the depth (depth) of the video data is added. Video data is received and transmitted to the packet analysis bridge 102-3.

In addition, the terminal 103-2 sends video data obtained by photographing the user to the packet analysis bridge 102-2. The packet analysis bridge 102-2 cuts out the person part from the video data by the data analysis server 101-2 according to the information set from the integrated command server 100, receives the video data of the person part, 102-3.
According to the information set from the integrated command server 100, the packet analysis bridge 102-3 is the data analysis server 101-3 and the background live camera video data received from the packet analysis bridge 102-1, and the depth In consideration of the information, the video data of the human part received from the packet analysis bridge 102-2 is synthesized, the synthesized video data is received, and this is transmitted to the terminal 103-2.

  According to the above-described example, it is possible to provide a service with a high-load process such as a CG (Computer Graphics) process even for a video shot by a mobile terminal. The data analysis server 101-1 in the above-described example is a type that adds information to received video data among the terminal types described above, and the data analysis server 101-2 is a conversion type that is described above. Since the server 101-3 synthesizes and outputs two pieces of data, it becomes a mixed type of conversion type and terminal type.

According to the embodiment described above, the following effects can be obtained.
(1) Since the information of the original packet is stored inside the encapsulation, it is possible to transmit to the original destination without having to synchronize only by transferring the result data as it is at the last processing node. . For this reason, there is no need to change the setting such as setting the destination as the first processing node at the terminal that sends the stream, so the stream that has undergone the desired processing arrives at the destination just by sending the stream to a free destination To come. As a result, it is possible to link existing applications without changing them at all.

(2) As described above, having all processing functions on the network eliminates the need for expensive applications and equipment that have a large processing load on the terminal side, thereby reducing the cost on the end user side. it can. In addition, even if the terminal changes, as long as data is transmitted, the process can be continued, so that an effect of improving ubiquity can be expected.

(3) A server with a general socket can be easily linked to a packet analysis bridge without incorporating a module for handling a dedicated protocol, so various processing nodes can be easily added. Is possible. Further, since the packet analysis bridge is separated from the network, it can be eliminated as well as easily added by operating the setting Web service. Such a flexible additional mechanism can provide an effect that it is easy to provide a service through a plurality of various processes.

  Thus, according to the present invention, since it has a function of processing and recognizing stream data that is continuously transmitted at high speed and continuously on the network in real time, in the technical field of media processing such as video and audio, Since it can be used not only for real-time editing but also for editing mixed static content, it can also be applied to editing technology in the broadcasting business, and to data transmitted to a large number of unspecified terminals using sensors. By applying recognition to this in the technical field of sensor networks, a very useful advantage can be obtained in the field of surveillance technology such as crime and abnormality detection.

  The packet analysis bridge 102-i, the data analysis server 101-i, and the integrated command server 100 described above have a computer system therein. The above-described processing steps are stored in a computer-readable recording medium in the form of a program, and the above-described processing is performed by the computer reading and executing this program. Here, the computer-readable recording medium means a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to the computer via a communication line, and the computer that has received the distribution may execute the program.

It is a block diagram which shows the structure of the stream type | mold web service cooperation system by embodiment of this invention. It is a block diagram which shows the schematic structure of the integrated command server 100 by this embodiment. It is a block diagram which shows the schematic structure of the packet analysis bridge | bridging 102-i by this embodiment. It is a block diagram which shows the schematic structure of the data analysis server 101-i by this embodiment. It is a conceptual diagram which shows an example of API specification currently published by Web service. It is a conceptual diagram which shows the example of structure p_cond for condition setting. It is a conceptual diagram for demonstrating the operation mode of packet analysis bridge | bridging 102-i. It is a conceptual diagram which shows a mode that each processing node 104-i cooperates with the data analysis server 101-i by this embodiment. It is a conceptual diagram which shows the example of structure D_set. It is a sequence diagram for demonstrating cooperation with the packet analysis bridge | bridging 102-i and data analysis server 101-i by this embodiment. It is a sequence diagram for demonstrating operation | movement of the process graph 422 which consists of a synthetic | combination component and a recognition component by this embodiment. It is a conceptual diagram which shows the operation | movement at the time of implement | achieving the service which synthesize | combines audio | voice data as a video stream, such as a TV telephone and news, as a subtitle using the stream type web service cooperation system by this embodiment. It is a conceptual diagram which shows the operation | movement at the time of implement | achieving the service which can be telephoned so that it may exist in the space imaged with the live camera wherever using the stream type web service cooperation system by this embodiment.

Explanation of symbols

100 Integrated Command Server 101-1 to 101-3 Data Analysis Server (Data Analysis Server Device)
102-1 to 102-3 Packet analysis bridge (packet analysis bridge device)
103-1 and 103-2 Terminals 104-1 to 104-3 Processing node 1001 Processing content receiving unit 1002 Recording control unit 1003 Setting unit 1004 Processing content storage unit 1021 Packet receiving unit 1022 Storage unit 1023 Input condition determination unit 1024 Relay transmission unit 1025 Relay reception unit 1026 Packet transmission unit 1011 Processing content storage unit 1012 Packet transmission / reception unit 1014 Processing unit

Claims (8)

A packet analysis bridge device that is connected to a data analysis server device that performs predetermined processing on a received packet and that transmits the packet with reference to header information included in the received packet,
A storage unit for storing input conditions including predetermined header information and relay destination setting information including information destined for the predetermined data analysis server device;
A receiver for receiving the packet;
An input condition determination unit that determines whether or not the header information of the packet received by the reception unit matches the header information included in the input condition stored in the storage unit;
When the input condition determination unit determines that they match, the header information of the packet is read and temporarily stored, the information included in the relay destination setting information is the destination, and the own device is the source header information. A relay transmission unit that rewrites the header information of the packet and transmits it to the data analysis server device according to the header information;
A relay receiving unit that receives a packet transmitted from the data analysis server device and rewrites and outputs the header information of the received packet with the original header information temporarily stored by the relay transmitting unit;
A transmission unit that transmits a packet output by the relay reception unit according to information indicating a destination of header information included in the packet;
A packet analysis bridge device comprising: The storage unit
Further storing an output setting list including header information destined for another packet analysis bridge device determined in advance;
The transmitter is
The packet output by the relay receiving unit is encapsulated with header information included in the output setting list stored in the storage unit and transmitted to the other packet analysis bridge device according to the encapsulated header information,
The receiver is
The packet analysis bridge device according to claim 1, wherein when the received packet is encapsulated by another packet analysis bridge device, decapsulation is performed. The storage unit
Has a flag indicating that the packet is duplicated,
The input condition determination unit
When it is determined that both header information matches, when the flag stored in the storage unit indicates duplication, the packet is duplicated, one packet is output to the relay transmission unit, and the other packet is transmitted. Output to
The transmitter is
The packet analysis bridge device according to claim 1 or 2, wherein the packet output by the input condition determination unit is transmitted according to information indicating a destination of header information included in the packet. The storage unit
It has a flag indicating transparency to send the packet as it is,
The input condition determination unit
When it is determined that both header information matches, when the flag stored in the storage unit indicates transparency, the packet is output as it is to the transmission unit,
The transmitter is
The packet analysis bridge device according to any one of claims 1 to 3, wherein the packet output by the input condition determination unit is transmitted according to information indicating a destination of header information included in the packet. The relay destination setting information stored in the storage unit is
As the information destined for the data analysis server device determined in advance, the predetermined processing is performed on the IP address of the data analysis server device, the input port number for receiving the packet, and the packet received at the port number. Output port number to send
The relay transmission unit
When the header information of the packet is read and temporarily stored, the header information read in association with the IP address and the output port number of the data analysis server device set in the relay destination setting information is stored,
The relay receiving unit is
When a packet transmitted from the data analysis server device is received, the packet header includes the IP address of the transmission source of the received packet and the temporarily stored original header information corresponding to the port number of the transmission source. The packet analysis bridge device according to any one of claims 1 to 4, wherein information is rewritten. A packet analysis bridge device, a data analysis server device connected to the packet analysis bridge device and performing predetermined processing on packets received from the packet analysis bridge device, and an integrated command server connected to the packet analysis bridge device A packet transmission system comprising a device,
The packet analysis bridge device
A storage unit for storing input conditions including predetermined header information and relay destination setting information including information destined for the predetermined data analysis server device;
A receiver for receiving the packet;
An input condition determination unit that determines whether or not the header information of the packet received by the reception unit matches the header information included in the input condition stored in the storage unit;
When the input condition determination unit determines that they match, the header information of the packet is read and temporarily stored, the information included in the relay destination setting information is the destination, and the own device is the source header information. A relay transmission unit that rewrites the header information of the packet and transmits it to the data analysis server device according to the header information;
A relay receiving unit that receives a packet transmitted from the data analysis server device and rewrites and outputs the header information of the received packet with the original header information temporarily stored by the relay transmitting unit;
A transmission unit that transmits a packet output by the relay reception unit according to information indicating a destination of header information included in the packet, and
The integrated command server device
A processing content receiving unit for receiving processing content information indicating processing to be requested to the packet analysis bridge device to be input;
According to the processing content information received by the processing content receiving unit, a data analysis server device to be connected to each packet analysis bridge device is selected, and input conditions and relay destination setting information to be set in the storage unit of each packet analysis bridge device are generated. A setting section;
An input condition set in the storage unit of each packet analysis bridge device generated by the setting unit, a recording control unit that stores the relay destination information in the storage unit of the corresponding packet analysis bridge device,
A packet transmission system comprising: In the packet analysis bridge device,
The storage unit
Further storing an output setting list including header information destined for another packet analysis bridge device determined in advance;
The transmitter is
The packet output by the relay receiving unit is encapsulated with header information included in the output setting list stored in the storage unit and transmitted to the other packet analysis bridge device according to the encapsulated header information,
The receiver is
If the received packet is encapsulated by another packet analysis bridge device, perform decapsulation,
The integrated command server device
When the packet is transmitted / received between a plurality of packet analysis bridge devices in the setting unit, the corresponding encapsulation and decapsulation settings are detected for each packet analysis bridge device, and the detected encapsulation is detected. And the input conditions, relay destination setting information, and output setting list to be set in the storage unit of each packet analysis bridge device based on the setting of decapsulation,
In the recording control unit,
The input condition set in the storage unit of each packet analysis bridge device generated by the setting unit, the relay destination information, and the output setting list are stored in the storage unit of the corresponding packet analysis bridge device. Packet transmission system. A packet transmission method by a packet analysis bridge device that is connected to a data analysis server device that performs predetermined processing on a received packet and that transmits the packet with reference to header information included in the received packet,
The packet analysis bridge device includes a storage unit for storing input conditions including predetermined header information and relay destination setting information including information destined for the predetermined data analysis server device,
Receiving a packet;
Determining whether or not the header information of the received packet matches the header information included in the input condition stored in the storage unit;
When it is determined that they match, the header information of the packet is read out, temporarily stored, the information included in the relay destination setting information is the destination, and the header information of the packet is the header information with the own device as the transmission source. Rewriting and transmitting to the data analysis server device according to the header information,
Receiving a packet transmitted from the data analysis server device, rewriting and outputting the header information of the received packet with the original header information temporarily stored by the relay transmission unit;
Transmitting the output packet according to information indicating a destination of header information included in the packet;
A packet transmission method comprising:

Images