JP2007235356A - Apparatus, method, and computer program for separating data by allocating session identification code to data - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for identifying respective data when data from a plurality of transmission sources are multiplexed to be transmitted from a protocol using packet sender information or the like to another protocol having no such information in its header. <P>SOLUTION: A method includes the steps of: multiplexing a data packet of a second form on a data packet of a first form; dividing data of a payload part in the data packet of the second form into a data group within a data capacity of the payload part in the data packet of the first form; sequentially storing the data group to the payload part of each data packet of the first form; storing session identification data associated with each session to a first field of the header in the data packet of the first form; attaching a packet serial number to a second field of the data packet; and sequentially multiplexing the packets of the first form by each session in the order of packet production. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an apparatus, a method, and a computer program that can perform separation between data by assigning a session identification code to the data, and more particularly, to an Ethernet packet of MPEG2-TS. The present invention relates to an apparatus, a method, and a computer program for multiplexing data packets and demultiplexing multiplexed data.

  FIG. 1 shows an MPEG2-TS packet group (1001, 1003, 1005...) (Packet length is 188 bytes) transmitted from the video signal source 100, a signal source 1 (101), and a signal source 2 (102). A conventional method in the case of multiplexing a packet group (1011, 1021, 1031, etc.) (packet length is 1024 bytes) of an Ethernet signal transmitted from the signal source 3 (103) will be described.

  As shown in a protocol hierarchy diagram 1007, the protocol of data transmitted from the video signal source 100 is, for example, IEEE 1394, the upper layer is, for example, MPEG2-TS, and the protocol of data transmitted from the signal sources 1 to 3 is used. As shown in the protocol hierarchy diagram 104, the physical layer is, for example, IEEE 802.3, and the upper layer is, for example, UDP, TFTP, FTP, or the like. Further, as shown in the protocol layer diagram 1009, the multiplexed signal protocol is, for example, Ethernet 2.0 for the physical layer and MPEG2-TS for the upper layer, for example.

  MPEG2-TS packets (1001, 1003, 1005...) Sent from the video signal source 100, and sent from the signal source 1 (101), signal source 2 (102), and signal source 3 (103). When an Ethernet signal packet group (1011, 1021, 1031, etc.) is multiplexed by the multiplexer 105, its output is represented by a packet group as indicated by 1051. That is, following the packet groups 1001, 1003, and 1005 from the video signal source, the Ethernet signal 1011 sent from the signal source 1 (101) is a part of the divided data “(i) 1-1” ( 1054), “(i) 1-2” (1056), “(i) 1-3” (1058), “(ii) 2-1” (1060),. Multiplexed in the payload part and transmitted.

  As an invention that uses header information in a data packet, information in the ancillary (auxiliary) data area in the transmission packet of the serial digital transfer interface is used to set the transfer mode and timing mode of the transmission packet. Patent document 1 to extract is mentioned.

  However, the invention of Patent Document 1 is different from the present invention because it does not disclose the idea of multiplexing packet groups of different formats such as Ethernet signals into packet groups such as MPEG2-TS.

JP 2000-307647 A

  In the communication route of the background art as described above, from a protocol that uses information such as transmission source information of a packet and transmission start code and end code of each file in a stream, a type that does not write (use) them in the header. If you want to multiplex and send data from multiple senders to the protocol, and if you want to send multiple pieces of data from one sender, you can identify each data as follows: There were various challenges.

[Problem 1] (Necessity to store duplicate header information in the payload part of the packet)
For example, in the case of FTP, for each file, an EOF (End Of File) code is added to the end of the file, and if the packet has an EOF, the data packet of the file ends at that packet, and the sequence number at the next packet Is identified as the next file if it starts with "1" (see FTP standard RFC959).
In this case, information is described in a portion corresponding to the header of the packet, and data to be sent is identified. Therefore, in the case of conversion to a protocol having no source information (for example, MPEG2-TS) in the middle of the communication path, the header information is described in the portion (payload portion) where the data of the MPEG2-TS packet is entered. This is necessary, and the actual amount of data that can be transmitted per unit time is reduced.

[Problem 2] (If you try to solve Problem 1, the number of PIDs required is huge)
In order to solve this problem 1, when the packet ID (PID) is changed for each file instead of inserting the header information as described above into the payload portion of the protocol (MPEG2-TS) having no transmission source information, this change is made. When a new PID is added each time a new file comes, a huge number of PIDs are required.

  On the other hand, in the case of non-standard communication in which data source information and information such as transmission start code and end code of each file in a stream are added as they are for each packet, such as MPEG2-TS packets, PID is fixedly allocated and identified for the transmission source (for example, PID = 1 is assigned to the transmission source 1, PID = 2 is assigned to the transmission source 2,..., PID = n is assigned to the transmission source n. Assign, and so on). Further, when a plurality of files are sent from one transmission source, it is necessary to include the header information in the payload portion as described in Problem 1 above.

  In such a case, since a PID is allocated for each transmission source, a PID for each transmission source is required in addition to a PID for file identification. As the number of transmission sources increases, the PID may be insufficient ( In the case of MPEG2-TS, a maximum of 8175 PIDs can be used, but if, for example, 100 PCs send 82 files each, it will be insufficient. Eventually it will run out over time).

[Problem 3] (Even if a huge number of PIDs are used, it is difficult to determine whether all the data has been transmitted and ended)

  Further, in the case of communication without a standard in which information such as data transmission source information and transmission start code and end code of each file in a stream is added as it is for each packet, such as MPEG2-TS packet, file transmission, etc. Since there is no end code, it is impossible to identify whether all the data has been transmitted and has been stopped or stopped midway when there is no data to be transmitted.

The above description will be specifically described with reference to the drawings.
For example, since the Ethernet signal 1011 supplied from the signal source 1 (101) in FIG. 1 has a data length of 1024 bytes, it is obediently used for multiplexing on an MPEG2-TS having a data length of 188 bytes. In order to multiplex the Ethernet signal 1011 into the MPEG2-TS (1051), it is necessary to divide the Ethernet signal 1011 into a size that can be stored in the MPEG2-TS and store it in each packet of the MPEG2-TS. . In the example of FIG. 1, the Ethernet signal 1011 is divided into 1-1, 1-2, 1-3, and these are divided into packet groups 1054, 1056, 1058 in MPEG2-TS (1051) and multiplexed. Will be.

  Further, the transmission sources 101, 102, and 103 of the divided Ethernet signals 1054, 1056, and 1058, and the divided Ethernet signals are transmitted in a certain session (communication between the communication parties only between the communication persons. In order to identify which of a series of communications from the start of (connection-oriented communication) to the end of the session) and other sessions, the divided Ethernet signals 10543, 10563, and 1058 The header information 10541, 10561, and 10581 of the same Ethernet signal (these represent exactly the same information (i)) are copied into the MPEG2-TS packets 1054, 1056, and 1058 that are stored together. Need to be stored. This information i is information stored in the header 10111 of the packet 1011 from the Ethernet signal source 1 (101). Further, in this “i”, information indicating which source 101, 102, 103 the Ethernet signal is from and which session is the signal is included. The reason why these pieces of information are added is to indicate to which source 101, 102, 103 each MPEG2 packet 1054, 1056, 1058 that has been divided belongs and which signal is in which session. Because.

  As described above, since the header information (such as “i”) of the Ethernet signal needs to be stored in an overlapping manner, the data transmission efficiency becomes extremely inefficient.

  In FIG. 2 for explaining the main part of FIG. 1, the source 1 (201) originates from a packet group (including 20111) in a session α in the second format, the next session δ (20131). Packet group) is transmitted. Similarly, a packet group of the second format is transmitted from source 2 (202) and source 3 (203).

  These are multiplexed into the first type packet group 205 having a unit length shorter than that of the second type packet. The packet 206, the packet 207, and the packet 217 in the packet group 205 in the first format after multiplexing all originate from the source 1 (201). However, the packet 206 and the packet 207 are packets in the same session α, but the packet 217 is a packet in another session δ.

  In this case, the packet group of the first format multiplexed in the payload part (2063 and 2065 for 206, 2073 and 2075 for 207, 2173 and 2175 for 217) in the received packets 206, 207 and 217. The header information “i” (2011 and 20133) indicates that the source of the received data is source 1 (201), but does not present any information about which session belongs.

  Therefore, in FIG. 2, the packet 217 received at the time point Y2 is also categorized as a packet in the same session as the packet 206 received at the time point X2. That is, the received data cannot be classified for each transmission session.

  Therefore, in a communication route, a protocol that uses information such as packet transmission source information and transmission start code and end code of each file in a stream is changed to a protocol that does not describe (use) them in a header. One of the objects of the present invention is to stream data from a transmission source in a multiplexed manner and when flowing a plurality of data from one transmission source so that each data can be identified.

<Multiplexing>
Normally, all data transmissions from a plurality of transmission sources do not overlap at the same time, and when divided by a certain period of time, only a certain percentage of the whole actually communicates in the same time zone. Considering only this state (time zone), it is not necessary to prepare all the expected PIDs (the number of connected sources and the number of files to be transmitted), and prepare some PIDs. It will be good. However, in reality, the necessary number of PIDs increases as time elapses, and all the numbers of PIDs are required. Therefore, it makes no sense to prepare several percent of PIDs.

  Therefore, in the present invention, only the necessary number of PIDs are used when divided by a certain time, and instead of the new PIDs that are necessary as time elapses, the original PIDs (PIDs set as necessary numbers in a certain time zone) are used. The problems 1 and 2 have been solved by adopting a method of dynamically assigning temporally and logically different inputs (transmission sources).

  Specifically, a session is set by using a time when a certain file transmission starts or a logical connection as a trigger. (Here, “session” means the time (period) during which one piece of data is entered and processed. The point in time when data entry is started is called session start, and data entry ends. (The time is called session end.)

  Then, PID is dynamically allocated for each session. When the maximum number of sessions that can be processed simultaneously (the above-mentioned “number of PIDs set as a necessary number in a certain time zone”) is 3, 4 PIDs When the first session is PID = 1, the next session is PID = 2, the next session is PID = 3, and any of PID = 1 to 3 sessions (for example, PID = 2 ends) For example, if PID = 4 is assigned to the next session and PID = 2 which is free when another session is completed, each session can be identified and Problem 2 can be solved.

で表すと、各セッション毎に、図３のようなシーケンスが得られる。
この結果、多重化後に出力されるパケットのＰＩＤを時間順（受信順）で並べると以下のようになる。
１，２，３，１，２，３，４，１，２，３，２，３，２，３．．．
この並びだけから見ると、ＰＩＤ４のデータが届くことでＰＩＤ１，２，３のどれかが終了した事は検出でるが、どれが終了したかは検出できない。
従って、この方法だけでは前記課題３を解決出来ない。 The following example 1 illustrates this problem solving method.

Example 1) (See Figure 3)
(A) Assume that PID = 1, 2, 3, 4 can be used.
(B) Assume that the data links of sessions A, B, and C are established.
(C) Assume that session A (PID1) has ended.
(D) Assume that session D (PID4) has started after the data of sessions B and C are output.
(E) Assume that session D has ended.
(F) Assume that session E has started (PID1).
(G) Assume that the data of sessions B and C are output.
Based on the above assumption, the packet PID is represented by n and the packet is

3, a sequence as shown in FIG. 3 is obtained for each session.
As a result, the PIDs of packets output after multiplexing are arranged in time order (reception order) as follows.
1, 2, 3, 1, 2, 3, 4, 1, 2, 3, 2, 3, 2, 3. . .
From this arrangement alone, it can be detected that one of PIDs 1, 2 and 3 has ended when the data of PID4 arrives, but which cannot be detected.
Therefore, the problem 3 cannot be solved by this method alone.

Therefore, in the present invention,
(A) The maximum number of simultaneous sessions x2 can be set.
(B) Use a new (unused) PID for each data session.
(C) Two PIDs are always used in one set (for example, PIDs are treated as a pair such as 1a and 1b, 2a and 2b, 3a and 3b), and are used alternately at the end of each data session.
The problem 3 can be solved as in Example 2 below.

Example 2) (See Figure 4)
Applying to the above example,
When three sets of PID = (1a, 1b), (2a, 2b), (3a, 3b) and six PIDs are used, a sequence as shown in FIG. 4 is obtained.

When the PIDs of packets output after multiplexing are arranged in time order (reception order), 1a, 2a, 3a, 1a, 2a, 3a, “1b”, 1a, 2a, 3a. . . Since “1b” is detected, it can be detected that the session of the first 1a has ended.
In addition, when the next session is not started and the file transmission is completed, it is impossible to determine the end in the packet reception status as described above, so a timeout value of several seconds (change in arrival timing of the packet in the network environment) Set a value sufficiently larger than the value) to determine the end of reception.

<Demultiplexing>
In the present invention, in order to restore these multiplexed data, the PID = 1a packet is extracted from the received packet for each PID (if the PID = 1a file is extracted, the PID = 1a packet until the appearance of the PID = 1b packet appears. The data area is extracted from these packets and combined. As a result, the file and data stream transmitted from each session can be restored (in Example 2, the file transmitted from session A can be restored by taking out the first PID = 1a).

  Aspects of the invention described in the claims of the present application corresponding to the above problem solving methods are listed, and explanations are added as necessary.

(Invention A-1) (A is an invention group using a flag indicating a session identified by a source)
In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a larger amount of data than the first type of data packet, including a header part and a payload part, supplied from a plurality of sources, consisting of a plurality of sessions included in A method of multiplexing and sending data and demultiplexing the received multiplexed data,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
(5) sequentially transmitting the data packets multiplexed in step (4);
(6) receiving the data packet transmitted in step (5) for each packet;
(7) demultiplexing each data packet received in step (6) using the session identification data of each data packet received in step (6);
(8) Based on the session identification data of each data packet demultiplexed in step (7), each data packet group demultiplexed in step (7) and the session to which the data packet group belongs Associating steps;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (7) according to the packet serial number;
(10) Based on the session associated in step (8), associating the data combined in step (9) with a plurality of sources and the predetermined time period;
Including methods.
By doing so, the source information and session information of the data packet group of the second format to be multiplexed are stored in the unused area of the header portion of the data packet group of the first format. Therefore, it is not necessary to store the source information and session information (header information) of the data packet in the second format in the payload portion of the data packet in the first format. For this reason, only the information of the payload portion of the data packet in the second format can be stored in the payload portion of the data packet in the first format, and the data transmission efficiency can be improved.
Further, information (for example, image information) other than the data packet group of the second format and information of the data packet group of the second format, which can be multiplexed in the data packet group of the first format, Since they are received at the same time, both information sent at almost the same transmission time is almost synchronized (for example, the data transmission rate is 20 Mbps) without having to store time stamp information etc. on the transmission side. In this case, transmission is performed with a deviation of 1/10000 second or less, and the deviation is less than the range that can be perceived by a person even if display processing for a person is performed, and can be received at substantially the same time. For this reason, it is possible to synchronize both pieces of information (for example, video information and environmental information display of the video) without performing processing for synchronization, and the processing load for synchronization can be reduced.
Furthermore, even when time stamp information or the like is stored, it is not necessary to perform a process of reading the time stamp information in order to synchronize both pieces of information, so that the processing load can be reduced.
In addition, “(1) For each session, the data of the header part and the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is changed to the first format. Dividing into data groups within the data capacity of the payload portion in the data packet of "in the data packet", "dividing into data groups within the data capacity of the payload portion in the data packet of the first format" May be divided evenly and may be divided unevenly.
Note that “in the first area of the header in the data packet of the first format, the session corresponds to identify the plurality of sessions corresponding to each data stored in the payload portion in step (2). In the “store the attached session identification data”, it is necessary to use an area that does not affect the transmission and reception of MPEG2-TS as the “first area of the header”.

(Invention A-2)
A method according to invention A-1,
For the session identification data in step (3), prepare twice as many types of data as the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
Method.
In this way, the source and session of the data can be identified, and at the same time, it can be detected that the past session has ended without transmitting / receiving a session end notification or the like.

(Invention A-2-1)
A method according to invention A-2,
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
Method.

(Invention A-2-2)
The method according to Invention A-2-1,
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
Method.
By configuring in this way, it is possible to easily recognize the source and the origin of the session using a general-purpose data description such as 1A and 1B (hexadecimal). In the present invention, the present invention is not limited to 1A and 1B. In that case, for example, a pair of 1D and 1F (hexadecimal) may be used to identify source and session switching.

(Invention A-3)
A method according to any one of the above inventions,
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
A method in which the data of the second type of data packet group is Ethernet data.
By doing so, it is possible to widely use currently used data packets such as MPEG2-TS (Transport Stream) and ethernet data for data transmission without worrying about the packet size.

(Invention B-1) (B is an invention group using a flag indicating a session identified by a connection time zone)
In the bit stream including the data packet group of the first format including the header part and the payload part, the first data packet is distinguished for each connection time zone, and each is within a predetermined time zone. Data of the second type data packet group having a larger amount of data than the first type of data packet, including the header part and the payload part, which are supplied from a plurality of sources and include a plurality of included sessions. Are multiplexed and transmitted, and the received multiplexed data is demultiplexed, and each transmitted data packet is sequentially received while maintaining their temporal and temporal relationship, In each session of data of the second type of data packet group that originates from the same source, the time from the start of transmission of the data to the completion is the predetermined transmission time. The data in the second format data packet group transmitted within the specified transmission time is within a predetermined reception time range as a stream of data packets in the first format. If the transmission of the data packet of the second format in a session is completed within the predetermined transmission time, the next session is transmitted after the predetermined transmission time has elapsed. And
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) Sessions and connections distinguished for each of the plurality of sources corresponding to each data stored in the payload part in step (2) in the first area of the header in the data packet of the first format Session identification data associated with a session is stored in order to identify a session distinguished for each time period, and a packet serial number indicating the order of packets for each identification data is added to the second area of the header of the data packet. And steps to
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
(5) sequentially transmitting the data packets multiplexed in step (4);
(6) receiving the data packet transmitted in step (5) for each packet;
(7) demultiplexing each data packet received in step (6) using the session identification data of each data packet received in step (6);
(7-1) In step (7), when it is identified as the first data packet received from a certain source, the time point is set to time zero, and the subsequent data received from the same source The data packet group is monitored, and only the data packet received from the source that is received when the time is within the predetermined reception time is used as the data packet of the same session sent from the source. Identifying a data packet received from the source whose time was received after the predetermined reception time as a data packet of a subsequent session sent from the source; and
(8) Based on the session identification data of each data packet demultiplexed in step (7), from the identification in step (7-1), each data packet group demultiplexed in step (7) Associating the session to which the data packet group belongs;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (7) according to the packet serial number;
(10) Based on the session associated in step (8), associating the data combined in step (9) with a plurality of sources and the predetermined time period;
Including methods.
By configuring in this way, it is possible to identify the source and the session only by using, for example, “1” that is a quarter of the 4-byte information “1A, 1B”.

(Invention C-1) (C is an invention group in which, for example, MPEG2-TS is multiplexed with packet data smaller than MPEG2-TS)
In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a smaller amount of data than the first type of data packet, comprising a header part and a payload part, supplied from a plurality of sources, comprising a plurality of sessions included in A method of multiplexing and sending data and demultiplexing the received multiplexed data,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Sequentially multiplexing in the payload part;
(2) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data multiplexed in the payload part in step (1) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(3) sequentially multiplexing the packets in the first format for each session created in step (2) in the order of packet generation;
(4) sequentially transmitting the data packets multiplexed in step (3);
(5) receiving the data packet transmitted in step (4) for each packet;
(6) demultiplexing each data packet received in step (5) using the session identification data of each data packet received in step (5);
(7) Based on the session identification data of each data packet demultiplexed in step (6), each data packet group demultiplexed in step (6) and the session to which the data packet group belongs Associating steps;
(8) combining the data in the payload portion of the data packet group demultiplexed in step (6) according to the packet serial number;
(9) Based on the session associated in step (7), associating the data combined in step (8) with a plurality of sources and the predetermined time period;
Including methods.
In this way, even when “multiplexing data of the second type data packet group having a data amount smaller than that of the first type data packet”, the header information of the second type data packet group is used. Therefore, it is not necessary to copy to the payload portion of the “first format data packet”, and the efficiency of data storage can be improved.

(Invention CB-1) (CB is, for example, a case where packet data smaller than MPEG2-TS is multiplexed on MPEG2-TS, and further, for example, only a flag representing a source such as “1” is used. group)
In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a smaller amount of data than the first type of data packet, comprising a header part and a payload part, supplied from a plurality of sources, comprising a plurality of sessions included in A method in which data is multiplexed and transmitted, and the received multiplexed data is demultiplexed, and each transmitted data packet is sequentially received while maintaining their temporal and temporal relationship. In each session of the data packet group of the second format that originates from the same source, the time from the start of transmission of the data to the completion is predetermined. The data of the second format data packet group that is within the range of the transmission time and is transmitted within the specified transmission time is a predetermined reception time as a stream of data packets of the first format. If the transmission of the data packet of the second format in a session is completed within the predetermined transmission time, the transmission of the next session is the predetermined transmission. It is done after the passage of time,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Sequentially storing in the payload portion;
(2) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (1) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(3) sequentially multiplexing the packets in the first format for each session created in step (2) in the order of packet generation;
(4) sequentially transmitting the data packets multiplexed in step (3);
(5) receiving the data packet transmitted in step (4) for each packet;
(6) demultiplexing each data packet received in step (5) using the session identification data of each data packet received in step (5);
(7) In step (6), when it is identified that the packet data is the first packet data received from a certain source, the time point is set to zero, and the subsequent packet received from the same source The data group is monitored, and only packet data received from the source received when the time is within the predetermined reception time is identified as packet data of the same session sent from the source. Identifying packet data received from the source whose time was received after the predetermined reception time as packet data of a subsequent session sent from the source;
(8) Using the information of the source of each received data packet identified in step (6) and the session information of each received data packet identified in step (7), Associating the data in the payload portion of each data packet received in 5) with the source and session of each data packet;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (6) according to the packet serial number;
Including methods.
By doing so, even when “multiplexing data of the second type data packet group having a data amount smaller than that of the first type data packet”, the second type data packet group It is not necessary to copy the header information to the payload portion of the “first format data packet”, and the efficiency of data multiplexing can be improved. Further, for example, the source and the session can be identified only by using 1 byte of “1” which is 1/4 of 4 bytes of information “1A, 1B”.

(Invention D-1) (D is an invention group that uses a flag such as “1A + 1B”, and describes up to multiplexing before transmission)
In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a larger amount of data than the first type of data packet, including a header part and a payload part, supplied from a plurality of sources, consisting of a plurality of sessions included in A method for multiplexing data comprising:
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
Including methods.
By doing so, the source information and session information of the data packet group of the second format to be multiplexed are multiplexed in the unused area of the header portion of the data packet group of the first format. Therefore, it is not necessary to store the source information and session information (header information) of the data packet in the second format in the payload portion of the data packet in the first format. For this reason, only the information of the payload portion of the data packet in the second format can be stored in the payload portion of the data packet in the first format, and the data transmission efficiency can be improved.
Further, when receiving data multiplexed by the method according to the present invention, information other than the data packet group of the second format that can be multiplexed to the data packet group of the first format (for example, image information) Since the data packet group information in the second format is received at almost the same time, it is sent out at almost the same transmission time without having to store time stamp information or the like on the transmission side. , Information of both is almost synchronized (for example, if the data transmission rate is 20 Mbps, it is transmitted with a deviation of 1/10000 second or less, and the deviation is less than the range that can be perceived by a person even if display processing for people) Thus, reception is possible at substantially the same time. For this reason, it is possible to synchronize both pieces of information (for example, video information and environmental information display of the video) without performing processing for synchronization, and the processing load for synchronization can be reduced.
Furthermore, even when time stamp information or the like is stored, it is not necessary to perform a process of reading the time stamp information in order to synchronize both pieces of information, so that the processing load can be reduced.
“(1) For each session, the data of the payload part in each data packet in the second type data packet group supplied from the plurality of sources is included in the first type data packet. Divide into data groups within the data capacity of the payload part of "the data part within the data capacity of the payload part in the data packet of the first format" In some cases, it may be divided unevenly.
In addition, “corresponding to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) in the first area of the header in the data packet of the first format” In the “store the attached session identification data”, the “unused area in the header area” needs to use an area that does not affect the transmission and reception of MPEG2-TS.

(Invention D-2)
A method according to invention D-1,
For the session identification data in step (3), prepare twice as many types of data as the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
Method.
In this way, the source and session of the data can be identified, and at the same time, it can be detected that the past session has ended without transmitting / receiving a session end notification or the like.

(Invention D-2-1)
A method according to invention D-2,
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
Method.

(Invention D-2-2)
The method according to Invention D-2-1,
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
Method.
By configuring in this way, it is possible to easily recognize the source and the origin of the session using a general-purpose data description such as 1A and 1B (hexadecimal). In the present invention, the present invention is not limited to 1A and 1B. In that case, for example, a pair of 1D and 1F (hexadecimal) may be used to identify source and session switching.

(Invention D-3)
The method according to any one of Invention D-1, Invention D-2, Invention D-2-1, or Invention D-2-2,
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
A method in which the data of the second type of data packet group is Ethernet data.
By doing so, it is possible to widely use currently used data packets such as MPEG2-TS (Transport Stream) and ethernet data for data transmission without worrying about the packet size.

(Invention E-1) (Only the receiving side is described)
A method for demultiplexing data multiplexed by the method according to invention D-1,
(1) demultiplexing each received data packet using the session identification data of each received data packet in the data multiplexed by the method described in Invention D-1.
(2) Based on the session identification data of each data packet demultiplexed in step (1), each data packet group demultiplexed in step (1) and the session to which the data packet group belongs Associating steps;
(3) combining the data in the payload portion of the data packet group demultiplexed in step (1) according to the packet serial number;
(4) Based on the session associated in step (2), associating the data combined in step (3) with a plurality of sources and the predetermined time period;
Including methods.
By doing so, information (for example, image information) other than the data packet group of the second format that can be multiplexed in the data packet group of the first format, and the data packet group of the second format Since the information is received at approximately the same time, both information sent at approximately the same transmission time is substantially synchronized (for example, data) without having to store time stamp information or the like on the transmitting side. When the transmission rate is 20 Mbps, transmission is done with a deviation of 1/10000 second or less, and even if display processing for people is done, the deviation is below the range that can be perceived by humans) and can be received at almost the same time is there. For this reason, it is possible to synchronize both pieces of information (for example, video information and environmental information display of the video) without performing processing for synchronization, and the processing load for synchronization can be reduced.
Furthermore, even when time stamp information or the like is stored, it is not necessary to perform a process of reading the time stamp information in order to synchronize both pieces of information, so that the processing load can be reduced.

(Invention SOFT-1)
A program for causing a computer to execute the method according to any one of the above inventions.

(Invention F-1) (Device Invention of Invention D Group) (D is an invention group that uses a flag such as “1A + 1B”, and describes only up to multiplexing before transmission)
In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each of them is in a predetermined time zone. Data of the second type data packet group having a larger amount of data than the first type of data packet, including the header part and the payload part, which are supplied from a plurality of sources and include a plurality of included sessions. A device for multiplexing
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. A dividing means for dividing the payload portion into data groups within the data capacity;
(2) Data group storage means for sequentially storing the data group divided in step (1) for each session in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storage / addition means for storing the attached session identification data and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) Multiplexing means for sequentially multiplexing the packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
Including the device.
By doing so, the source information and session information of the data packet group of the second format to be multiplexed are multiplexed in the unused area of the header portion of the data packet group of the first format. Therefore, it is not necessary to store the source information and session information (header information) of the data packet in the second format in the payload portion of the data packet in the first format. For this reason, only the information of the payload portion of the data packet in the second format can be stored in the payload portion of the data packet in the first format, and the data transmission efficiency can be improved.
Further, when receiving data multiplexed by the method according to the present invention, information other than the data packet group of the second format that can be multiplexed to the data packet group of the first format (for example, image information) Since the data packet group information in the second format is received at almost the same time, it is sent out at almost the same transmission time without having to store time stamp information or the like on the transmission side. , Information of both is almost synchronized (for example, if the data transmission rate is 20 Mbps, it is transmitted with a deviation of 1/10000 second or less, and the deviation is less than the range that can be perceived by a person even if display processing for people) Thus, reception is possible at substantially the same time. For this reason, it is possible to synchronize both pieces of information (for example, video information and environmental information display of the video) without performing processing for synchronization, and the processing load for synchronization can be reduced.
Furthermore, even when time stamp information or the like is stored, it is not necessary to perform a process of reading the time stamp information in order to synchronize both pieces of information, so that the processing load can be reduced.
"(1) For each session, the data in the header part and the payload part in each data packet in the data packet group of the second form supplied from the plurality of sources is changed to the first form. "Division means for dividing the data packet into a data group within the data capacity of the payload part in the data packet of" in "The data is divided into data groups within the data capacity of the payload part in the data packet of the first format" Includes a case of dividing equally and a case of dividing unevenly.
Further, “(3) In order to identify the plurality of sessions corresponding to each data stored in the payload portion in step (2) in the first area of the header in the data packet of the first format” In “store session identification data associated with a session”, it is necessary to use an area that does not affect the transmission and reception of MPEG2-TS as the “first area of the header”.

(Invention F-2)
An apparatus according to invention F-1,
For the session identification data in the storage / addition means, prepare data of twice the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
apparatus.
In this way, the source and session of the data can be identified, and at the same time, it can be detected that the past session has ended without transmitting / receiving a session end notification or the like.

(Invention F-2-1)
An apparatus according to invention F-2,
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
apparatus.

(Invention F-2-2)
The apparatus according to Invention F-2-1,
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
apparatus.
By configuring in this way, it is possible to easily recognize the source and the origin of the session using a general-purpose data description such as 1A and 1B (hexadecimal). In the present invention, the present invention is not limited to 1A and 1B. In that case, for example, a pair of 1D and 1F (hexadecimal) may be used to identify source and session switching.

(Invention F-3)
The device according to any one of Invention F-1, Invention F-2, Invention F-2-1 or Invention F-2-2,
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
The apparatus in which the data packet group data in the second format is Ethernet data.
By doing so, it is possible to widely use currently used data packets such as MPEG2-TS (Transport Stream) and ethernet data for data transmission without worrying about the packet size.

(Invention G-1) (Apparatus for demultiplexing data multiplexed by the apparatus of Invention F)
An apparatus for demultiplexing data multiplexed by the apparatus according to invention F-1,
(1) Demultiplexing means for demultiplexing each received data packet using the session identification data of each received data packet in the data multiplexed by the apparatus according to the invention F-1. ,
(2) Based on identification data for identifying a plurality of sessions distinguished for each of the plurality of sources stored in a first area of a header portion of each data packet demultiplexed by the demultiplexing means. Session associating means for associating a session of each demultiplexed data packet group;
(3) combining means for combining data in the payload portion of the data packet group demultiplexed by the demultiplexing means according to the packet serial number;
(4) Source / connection time zone association means for associating a plurality of sources and the predetermined time zone with the data combined by the connection unit based on the session associated with the session association unit;
Including methods.
In this way, information (for example, image information) other than the data packet group in the second format that can be multiplexed in the data packet group in the first format, information on the data packet group in the second format, Are received at almost the same time, so the sending side does not bother to store time stamp information etc., and the information sent at almost the same transmission time is almost synchronized (for example, data transmission). When the rate is set to 20 Mbps, transmission is performed with a deviation of 1/10000 second or less, and even if display processing for a person is performed, the deviation is within a range that can be perceived by a person, and can be received at substantially the same time. For this reason, it is possible to synchronize both pieces of information (for example, video information and environmental information display of the video) without performing processing for synchronization, and the processing load for synchronization can be reduced.
Furthermore, even when time stamp information or the like is stored, it is not necessary to perform a process of reading the time stamp information in order to synchronize both pieces of information, so that the processing load can be reduced.

(Invention SOFT-2)
A program for causing a computer to function as the device according to any one of inventions F-1 to G-2.

Finally, the meanings of the terms used in the claims and the specification of the present application are shown in tabular form below.

Table 1 Significance of terms used in this specification

  According to the present invention, in a communication route, from a protocol that uses information such as transmission source information of a packet and transmission start code and end code of each file in a stream, to a protocol that does not write (use) them in a header. When data from a plurality of transmission sources is multiplexed and flowed, and when a plurality of data from one transmission source is flowed, it is possible to flow the data so that each data can be identified.

  Various embodiments of the present invention will be described below with reference to the drawings. However, the following description is merely an example of the present invention, and the technical scope of the present invention is not limited by the following description.

Refer to FIG. 7A.
In this figure, with source 1 (701) as the origin, a packet group of a certain session α (including 70111) and a packet group of the next session δ (including 70131) of the second format are transmitted. . Similarly, a packet group of the second format is transmitted from source 2 (702) and source 3 (703).

The data of the second type packet group is multiplexed in the first type packet group 705 having a unit length shorter than that of the second type packet.
Each packet (706, 707, 709, 711, 717, etc.) in the packet group 705 of the first format, in which data of the packet group of the second format is multiplexed, has a header part 7061, 7071, 7091, 7111, 7171.

  The header portion (for example, 7061) includes a source information identification data portion 70611 and a number storage data portion 70613 that indicates the order of packets for each source information identification data.

  In the first embodiment, for example, 1A (hexadecimal) is multiplexed in the origin information identification data portion 70611. Here, “1” of 1A means that it originates from the source 1 (701), and “A” means that it originates from “a certain session”.

  On the other hand, 1B (hexadecimal) is multiplexed in the origin information identification data portion 71711 in the header portion 7171 of the packet 717. Again, “1” in 1B means that it originates from source 1 (701), but “B” means “another session after” “A”.

  Such information is stored in the header information 7061, 7071, 7091, 7111, 7171 in each packet (706, 707, 709, 711, 717, etc.) in the packet group 705 in the first format. By multiplexing to 70611, 70711, 70911, 71111, and 71711, the source of the packet and the session to which the packet belongs can be identified.

  For example, from the data (“1A”) of the origin information identification data portions 70611 and 70711 of the packet 706 and the packet 707, it is understood that these are packets in “a session” originating from the source 1. From the data “2A” of the origin information identification data portion 70911 of the packet 709, it is understood that this is a packet in “a session” originating from the source 2. Further, from the data “3A” of the origin information identification data portion 71111 of the packet 711, it is understood that this is a packet in “a session” originating from the source 3. From the data (“1B”) in the source information identification data portion 71711 of the subsequent packet 717, it is understood that this originates from the same source 1 as the packets 705 and 707 but is in the “next session”. Is done.

  Next, numbers indicating the order of packets for each identification data (such as 1 and 2 shown in 70613, 70713, 70913, 71113, and 71713) are added in the order in which packets are generally used in packet communication. This value is used to restore the original transmission order on the receiving side when the transmission order of the transmitted packets is disturbed.

For example, in the case of MPEG2-TS, a 4-bit counter value called “continuity_counter” is incremented by one for each generated packet, one for each source information identification data. To be added. The counter value starts from “0”, and is added from “0” when the upper limit (1111) ₂ is reached. (In a normal system, even if the context of a packet breaks at several levels, the context does not break in units of 10 or more, so this method (4 bits = 0 to 15 counter value) It is enough).

  This “number indicating the order of packets for each identification data” (hereinafter referred to as “counter value”) is 70613, 70713, 70913, 71113 of each packet in the packet group 705 as described above in FIG. 7A. , 71713, and so on. For example, it is used to hold the transmission order of packets (eg, 706 and 707) having the same origin information identification data indicating the source of 1A. In FIG. 7A, the “counter value” of the packet 706 is 1, but the “counter value” of the packet 707 is 2. Thereby, even if the packet 707 is received earlier than the packet 706 on the receiving side, it can be understood that the packet 706 is earlier in the sending order.

  Therefore, once the origin information identification data “1A” indicating the source appears, and “1A” appears again in a packet transmitted after that, if the counter value of the packet is a serial number with the immediately preceding packet, It is understood that the packet is a packet in “a session (first“ 1A ”)” that originates from the same source 1 as the previous packet, and the packet value of the previous packet is “1A”. If it is not a serial number, the packet originates from the same source 1 as that of the previous packet, but the “next session (first“ 1B]) ”of“ some session (first “1A”) ”further It is understood that the packet is in the “next session (next“ 1A ”)”.

  In addition, when the first packet of “1B” comes after “1A” and “1A” appears again thereafter, the remainder of the first “1A” is overtaken by “1B” during the communication. , “1B” is completed and a new “1A” is sent as the next session, and two ways are conceivable. In this case, if it is determined by the counter value as described above, it is possible to determine which case.

  In this way, by multiplexing the two-digit symbols 1A, 1B, 2A, 2B, etc. in the source information identification data section (70611, 70711, 70911, 71111, 71711, etc.), the origin of each packet is determined. And the session to which each packet belongs can be distinguished.

  The origin information identification data part (70611 and the like) and the “number indicating the order of the packets for each identification data” (such as “1” such as 70613) are in the payload part (eg, 7065) of the first format packet. However, the source information identification data is not multiplexed in the payload portion as shown by 2063 in FIG. 2, and the data multiplexing efficiency is improved.

  This is because the length of the multiplexed data 7065 in the payload portion of the packet 706 in FIG. 7A is “N”, while the length of the data 2065 in the payload portion of the packet 206 in FIG. It is clear from N> n). As described above, the amount of normal data other than the origin information identification data that can be stored in the payload portion is increased in each payload portion (7065 etc.) in the header information of the packet in the second format (FIG. 2). This is because it is not necessary to copy and multiplex all of the packets into each packet.

  Further, in the packet group 705 of FIG. 7A, for example, other packets of the first format in which video information or the like is multiplexed may be mixed. In such a case, even if the time information (time stamp or the like) is not multiplexed in any of the video information packet and the packet group 705 shown in FIG. It is understood that each packet information is transmitted at an approximate time. Therefore, if the packet group 705 in FIG. 7A is data associated with video information (for example, temperature at the time of video shooting), the temperature information at the time of video shooting is displayed overlapping on the video on the receiving side. Etc. are easily possible. That is, synchronization between the data can be easily achieved.

A method for receiving the transmission packet group in FIG. 7A is shown in FIG. 7B.
In FIG. 7B, it is identified from the origin information section (70611 and 70711) of the packets 706 and 707 that they originate from “a certain session” of the source 1 (“A” 731 and “I” 733). Further, by referring to “number indicating the order of packets for each identification data” (70613 and 70713) in these packets, it is recognized that “A” 731 was transmitted before “I” 733. Even if the order of “A” 731 and “I” 733 is disturbed in the transmission process, the receiving side can receive the signals in the correct transmission order. (Note that (1) in the upper right of “A731” etc. is a packet serial number indicating the order of the packets.)

  Next, it is identified from “2A” of the origin information section 70911 of the packet 709 that it originates from “a certain session” of the source 2 (“U” 751), and “3A” of the origin information section 71111 of the packet 711 is identified. ”Is identified as having originated from“ a certain session ”of source 3 (“ e ”771), and“ 1B ”of the source information portion 71711 of the packet 717 It is identified that it originates from the next session ("O" 791).

When the packet group of the first format is MPEG2-TS, the identification data (1A, 1B, etc.) in the source information part (70611 etc.) in the header part (7061 etc.) of the packet is shown in FIG. It is possible to multiplex in the unused area in the PID in the MPEG2-TS header format of 8 (the same applies to other embodiments below).
The PID uses bytes other than the used bytes because the used bytes are defined according to the use of MPEG2-TS.

(Only 1 is used: FIGS. 9A and 9B)
FIGS. 9A and 9B show the source information of 1 byte such as 1 or 2 instead of the source information (1A, 1B, etc.) of 2 bytes each multiplexed to the source information part (70611 etc.) of the first embodiment. This is an example in which multiple processes are completed.

In this embodiment, the maximum transmission time length T _SMAX for each session (session α (9011), δ (9013)) of the second bit stream to be transmitted (90111, 90117, 90119, 90131, etc.) is It has been established. That is, the maximum time T _SMAX 920 is defined between the time when the first packet 90111 of the session α (9011) is transmitted and the time when the final packet 90119 of the packet of the same session α (9011) is transmitted.

Furthermore, in the case of a session that has been transmitted within T _SMAX , it is specified that the next session always starts after T _SMAX . Then, a packet transmitted from the same source 901 after the T _SMAX is determined as a packet related to another session (session δ (9013)).

In the transmission stage, the bit stream of the second format transmitted within T _SMAX is received within T _RMAX on the receiving side.

Assuming such condition setting, in FIG. 9A, the second type packet (such as 90111) in the session α (9011) of the source 1 (901) is transmitted within T _SMAX and multiplexed. The first type of packet (such as 906) is received within _TRMAX . A packet related to the next session δ (9013) of the source 1 (901) is transmitted after T _SMAX and received after T _RMAX .

For this reason, as shown in FIG. 9B, a timer is prepared on the receiving side, the time when the first packet 906 of the source information “1 (90611)” is received is set to zero, the packet 906 and the following packet (907, etc.) at time T _RMAX those previously received ( "a" 931, "have" 933) a session identified as "one session", the time T _RMAX same source information received since " The session of the packet 917 (“O” 991) having “1 (91711)” can be identified as the next session of “a certain session” different from the first packet 906.

  In this way, as the origin information data, the origin can be identified by 1-byte information “1” that is 1/4 of the 4-byte information “1A, 1B” as in the first embodiment. .

(When the packet length of the first format is longer: FIGS. 10A and 10B)
10A and 10B show the case where the packet length of the first format is longer than the packet length of the second format.

In this embodiment, the length of the first format packet (1005, etc.) is longer than the length of the second format packet (100111, etc.), contrary to the above embodiment.
In this case, packets of the second format (eg, 100111 and 100117) of the same session (eg, session α (10011)) of the same source (eg, 1001) are changed to packets of the first format (eg, 1005). Is multiplexed.

The origin information such as 1A and 1B is multiplexed in the origin information part 10000511 of the header part (10051 etc.) of the first format packet (for example, 1005).
FIG. 10B shows the reception method of this embodiment.

“A”, “I”, etc. with the same source information are categorized as having origins from the same source.
Details are the same as in the above-described embodiment.
Similarly, by setting several temporal conditions, “1” or the like can be used as the source identification information instead of “1A, 1B” or the like.

  As shown in FIG. 11, on the transmission side 1102, the multiplexer 1107 multiplexes the Ethernet signal 1121 from the personal computer 1103 that receives the USB signal 1117 from the medical device 1105 or the like to the MPEG2-TS signal from the HDTV camera 1101. Then, the network 1109 is transmitted as the MPEG2-TS signal 1123, and the Ethernet data is demultiplexed by the demultiplexer 1111 on the receiving side 1110, and the video captured by the HDTV camera 1101 is displayed on the video monitor 1113, and the personal computer 1115 In addition, a wide use such as displaying medical data obtained from the medical device 1105 obtained at the same time as the video can be obtained.

The conceptual diagram which shows the multiplexing method by a prior art. The packet detailed drawing which shows the multiplexing method by a prior art. FIG. 7 is a sequence diagram of sending packets under a predetermined condition. FIG. 4 is a sequence diagram for sending packets under conditions different from those in FIG. 3. The figure explaining an Ethernet signal. Drawing explaining the significance of multiplexing, storing, adding. BRIEF DESCRIPTION OF THE DRAWINGS The delivery method general | schematic figure of Example 1 of this invention. FIG. 3 is a schematic diagram of a receiving method according to the first embodiment of the present invention. MPEG2-TS header format. The delivery method schematic diagram of Example 2 of this invention. FIG. 5 is a schematic diagram of a receiving method according to the second embodiment of the present invention. The delivery method schematic diagram of Example 3 of this invention. FIG. 6 is a schematic diagram of a receiving method according to a third embodiment of the present invention. 1 is a system example using the present invention.

Explanation of symbols

100 Video signal source
101 Signal source 1
102 Signal source 2
103 Signal source 3
105 Multiplexer
1001, 1003, 1005 MPEG2-TS packet group
1007, 104, 1009 Protocol hierarchy diagram
1011 Ethernet signal
1011 Packet from Ethernet signal source 1 (101)
1011 Ethernet signal supplied from signal source 1 (101)
1011, 1021, 1031 Ethernet signal packets
1051 MPEG2-TS
1054, 1056, 1058 Packet group in MPEG2-TS (1051)
10111 Header (10111) of packet (1011) from Ethernet signal source 1 (101)
10541, 10561, 10581 Ethernet signal header information
10543, 10563, 10583 Split Ethernet signal
201 Source 1
202 Source 2
203 Source 3
205 Packets of the first format
206, 207, 217 Packets in first type packet group (205) after multiplexing
2063 Header information of the second type packet in the payload part in the received packet 206
2065 Payload data of packet 206 in FIG.
2071 Header information in received packet 207
2173, 2175 Payload portion in received packet 217
20111 Second format packet in a session α
20113, 20133 First format packet group header information "i"
20131 Packets in the next session δ of a session α
611 Material data
613 Material split and header added
615 PES (Packetized Elementary Stream) divided and header added
615a TSP-1 (1)
615b TSP-1 (2)
615c TSP-1 (3)
621 Encoded digital signal flow
623 PES data (divided ES, eg 1 frame of video)
625 divided PES
631 ES-3
633 PES-3
635 TSP-3
640 TS (Transport Stream)
6401 (2) TSP-1 (2)
6401 (3) TSP-1 (3)
6402 (2) TSP-2 (2)
6403 (2) TSP-3 (2)
701 Source 1
702 Source 2
703 source 3
705 First type packet group whose unit length is shorter than that of the second type packet
706,707,709,711,717 Each packet in the first format packet group (705)
731 “Ah”
733 “I”
751 “U”
771 “E”
791 “O”
7061 packet header
7061, 7071, 7091, 7111, 7171 Header
7065 Multiplex data of payload part of packet 706
7171 Header of packet 717
70111 Packets in a packet group of a session α in the second format
70131 Packets in packet group of next session δ
70611, 70711 Source information section of packet 706 and packet 707
"Number indicating the packet order for each identification data" in 70613, 70713 packets
70611, 70711, 70911, 71111, 71711 Source information identification data part
70713, 70913, 71113, 71713 Numbers indicating the order of packets for each identification data added to the header portion of each packet in the packet group 705
70613 Number storage data part indicating the order of packets for each source information identification data
70911 Source information section of packet 709
71111 Source information section of packet 711
71711 Source information section of packet 717
901 source
906 First packet of the first format
917 T _R max packets received since
920 T _SMAX
931 “Ah”
933 “I”
991 “O”
9011 Session α
9011 Session α of the second bit stream to be transmitted (90111, 90117, 90119, etc.)
9013 Session δ
9013 Session δ
90111 The first packet of session α (9011)
90117, 90119, 90131 Second bit stream to be sent
90119 Last packet of session α (9011) packet
90611 Source information “1”
91711 Source information "1"
1005 First type packet group
10011 Session α
10051 Header portion of first format packet (1005)
1001 source
100111, 100117 Second format packet
100511 Source information part of header part (10051) of packet (1005) of the first format
1101 HDTV Camera
1102 Sender
1103 PC
1105 Medical equipment
1107 Multiplexer
1109 Network
1110 Receiver
1111 Demultiplexer
1113 video monitor
1115 PC
1117 USB signal
1121 Ethernet signal
1123 MPEG2-TS signal

Claims (22)

In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a larger amount of data than the first type of data packet, including a header part and a payload part, supplied from a plurality of sources, consisting of a plurality of sessions included in A method of multiplexing and sending data and demultiplexing the received multiplexed data,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
(5) sequentially transmitting the data packets multiplexed in step (4);
(6) receiving the data packet transmitted in step (5) for each packet;
(7) demultiplexing each data packet received in step (6) using the session identification data of each data packet received in step (6);
(8) Based on the session identification data of each data packet demultiplexed in step (7), each data packet group demultiplexed in step (7) and the session to which the data packet group belongs Associating steps;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (7) according to the packet serial number;
(10) Based on the session associated in step (8), associating the data combined in step (9) with a plurality of sources and the predetermined time period;
Including methods. The method of claim 1, comprising:
For the session identification data in step (3), prepare twice as many types of data as the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
Method. The method of claim 2, comprising:
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
Method. The method of claim 3, comprising:
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
Method. A method according to any of the above claims,
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
A method in which the data of the second type of data packet group is Ethernet data. In the bit stream including the data packet group of the first format including the header part and the payload part, the first data packet is distinguished for each connection time zone, and each is within a predetermined time zone. Data of the second type data packet group having a larger amount of data than the first type of data packet, including the header part and the payload part, which are supplied from a plurality of sources and include a plurality of included sessions. Are multiplexed and transmitted, and the received multiplexed data is demultiplexed, and each transmitted data packet is sequentially received while maintaining their temporal and temporal relationship, In each session of data of the second type of data packet group that originates from the same source, the time from the start of transmission of the data to the completion is the predetermined transmission time The data in the second format data packet group transmitted within the specified transmission time is within a predetermined reception time range as a stream of data packets in the first format. If the transmission of the data packet of the second format in a session is completed within the predetermined transmission time, the next session is transmitted after the predetermined transmission time has elapsed. And
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) Sessions and connections distinguished for each of the plurality of sources corresponding to each data stored in the payload part in step (2) in the first area of the header in the data packet of the first format Session identification data associated with a session is stored in order to identify a session distinguished for each time period, and a packet serial number indicating the order of packets for each identification data is added to the second area of the header of the data packet. And steps to
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
(5) sequentially transmitting the data packets multiplexed in step (4);
(6) receiving the data packet transmitted in step (5) for each packet;
(7) demultiplexing each data packet received in step (6) using the session identification data of each data packet received in step (6);
(7-1) In step (7), when it is identified as the first data packet received from a certain source, the time point is set to time zero, and the subsequent data received from the same source The data packet group is monitored, and only the data packet received from the source that is received when the time is within the predetermined reception time is used as the data packet of the same session sent from the source. Identifying a data packet received from the source whose time was received after the predetermined reception time as a data packet of a subsequent session sent from the source; and
(8) Based on the session identification data of each data packet demultiplexed in step (7), from the identification in step (7-1), each data packet group demultiplexed in step (7) Associating the session to which the data packet group belongs;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (7) according to the packet serial number;
(10) Based on the session associated in step (8), associating the data combined in step (9) with a plurality of sources and the predetermined time period;
Including methods. In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a smaller amount of data than the first type of data packet, comprising a header part and a payload part, supplied from a plurality of sources, comprising a plurality of sessions included in A method of multiplexing and sending data and demultiplexing the received multiplexed data,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Sequentially multiplexing in the payload part;
(2) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data multiplexed in the payload part in step (1) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(3) sequentially multiplexing the packets in the first format for each session created in step (2) in the order of packet generation;
(4) sequentially transmitting the data packets multiplexed in step (3);
(5) receiving the data packet transmitted in step (4) for each packet;
(6) demultiplexing each data packet received in step (5) using the session identification data of each data packet received in step (5);
(7) Based on the session identification data of each data packet demultiplexed in step (6), each data packet group demultiplexed in step (6) and the session to which the data packet group belongs Associating steps;
(8) combining the data in the payload portion of the data packet group demultiplexed in step (6) according to the packet serial number;
(9) Based on the session associated in step (7), associating the data combined in step (8) with a plurality of sources and the predetermined time period;
Including methods. In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a smaller amount of data than the first type of data packet, comprising a header part and a payload part, supplied from a plurality of sources, comprising a plurality of sessions included in A method in which data is multiplexed and transmitted, and the received multiplexed data is demultiplexed, and each transmitted data packet is sequentially received while maintaining their temporal and temporal relationship. In each session of the data packet group of the second format originating from the same source, the time from the start of transmission of the data to the completion is predetermined The data of the second format data packet group that is within the range of the transmission time and is transmitted within the specified transmission time is a predetermined reception time as a stream of data packets of the first format. If the transmission of the data packet of the second format in a session is completed within the predetermined transmission time, the transmission of the next session is the predetermined transmission. It is done after the passage of time,
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Sequentially storing in the payload portion;
(2) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (1) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(3) sequentially multiplexing the packets in the first format for each session created in step (2) in the order of packet generation;
(4) sequentially transmitting the data packets multiplexed in step (3);
(5) receiving the data packet transmitted in step (4) for each packet;
(6) demultiplexing each data packet received in step (5) using the session identification data of each data packet received in step (5);
(7) In step (6), when it is identified as the first packet data received from a certain source, the time point is set to time zero, and the subsequent packet received from the same source The data group is monitored, and only packet data received from the source received when the time is within the predetermined reception time is identified as packet data of the same session sent from the source. Identifying packet data received from the source whose time was received after the predetermined reception time as packet data of a subsequent session sent from the source;
(8) Using the information of the source of each received data packet identified in step (6) and the session information of each received data packet identified in step (7), Associating the data in the payload portion of each data packet received in 5) with the source and session of each data packet;
(9) combining the data in the payload portion of the data packet group demultiplexed in step (6) according to the packet serial number;
Including methods. In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each is within a predetermined time zone. A second type of data packet group having a larger amount of data than the first type of data packet, including a header part and a payload part, supplied from a plurality of sources, consisting of a plurality of sessions included in A method for multiplexing data comprising:
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. Dividing into data groups within the data capacity of the payload portion; and
(2) For each session, sequentially storing the data group divided in step (1) in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storing the attached session identification data, and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) sequentially multiplexing packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
Including methods. The method of claim 9, comprising:
For the session identification data in step (3), prepare twice as many types of data as the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
Method. The method of claim 10, comprising:
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
Method. The method of claim 11, comprising:
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
Method. A method according to any of claims 9 to 12, comprising
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
A method in which the data of the second type of data packet group is Ethernet data. A method for demultiplexing data multiplexed by the method of claim 9, comprising:
(1) demultiplexing each received data packet using session identification data of each received data packet in the data multiplexed by the method of claim D-1;
(2) Based on the session identification data of each data packet demultiplexed in step (1), each data packet group demultiplexed in step (1) and the session to which the data packet group belongs Associating steps;
(3) combining the data in the payload portion of the data packet group demultiplexed in step (1) according to the packet serial number;
(4) Based on the session associated in step (2), associating the data combined in step (3) with a plurality of sources and the predetermined time period;
Including methods.   A program for causing a computer to execute the method according to any one of the above claims. In the first data packet in the bit stream including the data packet group of the first format including the header part and the payload part, each of the first data packets is distinguished for each of a plurality of sources, and each of them is in a predetermined time zone. Data of the second type data packet group having a larger amount of data than the first type of data packet, including the header part and the payload part, which are supplied from a plurality of sources and include a plurality of included sessions. A device for multiplexing
(1) For each session, the data of the payload part in each data packet in the data packet group of the second format supplied from the plurality of sources is stored in the data packet of the first format. A dividing means for dividing the payload portion into data groups within the data capacity;
(2) Data group storage means for sequentially storing the data group divided in step (1) for each session in the payload portion in each data packet of the first format;
(3) In the first area of the header in the data packet of the first format, correspond to the session to identify the plurality of sessions corresponding to each data stored in the payload part in step (2) Storage / addition means for storing the attached session identification data and adding a packet serial number indicating the order of the packets for each identification data to the second area of the header of the data packet;
(4) Multiplexing means for sequentially multiplexing the packets of the first format for each session created in steps (2) and (3) in the order of packet generation;
Including the device. The apparatus of claim 16, comprising:
For the session identification data in the storage / addition means, prepare data of twice the maximum number of simultaneous sessions,
The session identification data of twice the maximum number of simultaneous sessions forms a pair every two,
Use one of a predefined pair of session identification data for the first session,
For a new session to be a simultaneous session, use one of a predetermined pair of session identification data that has not been used before,
By using the other session identification data different from one of the predetermined pair of session identification data used in the past for a new session that does not become a simultaneous session,
It is possible to detect that a past session corresponding to one of the predetermined pair of session identification data pairs used in the past has already ended.
apparatus. The apparatus of claim 17, comprising:
When the maximum number of simultaneous sessions (i) is n (1 ≦ n; n is an integer),
The pair of session identification data pairs is represented by (x _i y, X _i Y)
(Here, the x _i = X _i is hexadecimal 1 integer to n, predetermined integer constants y hexadecimal, Y is another integer constant that is different from the y) 1 hex like A pair of n data groups is used.
apparatus. The apparatus of claim 18, comprising:
N is 0 <n ≦ 9 (n is an integer);
x _i = X _i is an integer from 1 to n in hexadecimal,
y is a predetermined hexadecimal alphabet, Y is another alphabet different from y,
apparatus. An apparatus according to any of claims 16 to 19, comprising
The bit stream including the data packet group of the first format is MPEG2-TS (Transport Stream), and the first area in the header area in the data packet of the first format is the PID area. In
The apparatus in which the data packet group data in the second format is Ethernet data. An apparatus for demultiplexing data multiplexed by an apparatus according to claim 16, comprising:
(1) Demultiplexing means for demultiplexing each received data packet using the session identification data of each received data packet in the data multiplexed by the apparatus according to claim F-1. When,
(2) Based on identification data for identifying a plurality of sessions distinguished for each of the plurality of sources stored in a first area of a header portion of each data packet demultiplexed by the demultiplexing means. Session associating means for associating a session of each demultiplexed data packet group;
(3) combining means for combining data in the payload portion of the data packet group demultiplexed by the demultiplexing means according to the packet serial number;
(4) Source / connection time zone association means for associating a plurality of sources and the predetermined time zone with the data combined by the connection unit based on the session associated with the session association unit;
Including methods.   A program causing a computer to function as the device according to any one of claims 16 to 21.

Images