JP2004282584A - Moving image data communication system via network - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To make unnecessary to cope with all division methods and consequently to make it possible to constitute a moving image data communication system with a minimum scale of software and circuit by negotiating on division methods of a moving image between a transmitter and a receiver in advance. <P>SOLUTION: The moving image data communication system is characterised in that the transmitter 100 and the receiver 200 are respectively provided with a transmitter division control part 102 and a receiver division control part 202, and before transmitting moving image data, the transmitter division control part 102 and the receiver division control part 202 previously negotiate the moving image division methods to determine the division methods of the moving image data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a moving image data communication system that transmits moving image data via a network such as a wireless network or the Internet.
[0002]
[Prior art]
With the spread of wireless networks and the Internet, demand for communication of moving image data via these networks has been increasing. In order to perform communication of moving image data via these networks, the moving image data is transmitted over packet communication performed on the network. At this time, the upper limit of the packet size is determined by the network, and data with a large amount of information, such as moving image data, cannot be transmitted with one packet of moving image data in one packet. Must be divided into a plurality of packets and transmitted to the network. The method of packetization is specified in, for example, Internet standard RFC (Request for Comments). ITU-T Recommendation H. The packetization method of H.263 moving image encoded data is defined in RFC2190 and RFC2429, and the packetizing method of MPEG (Motion Picture Expert Group) -4 moving image encoded data issued by ISO is defined in RFC3016. I have. These are packetized by using a streaming data transmission protocol RTP (Real-time Transport Protocol) defined in the Internet, and RFC2190, RFC2429, and RFC3016 each have a packetization method using RTP. It is shown. In order to improve the Ehler resistance, a method of determining the size of a block of moving image data called a slice has been devised (for example, see Patent Document 1).
[0003]
[Patent Document 1]
JP 2000-224584 A
[Problems to be solved by the invention]
In the conventional moving image transmission system, both the moving image data transmitter and the receiver have to support all division methods described in RFC. For this reason, there has been a problem that the software and the circuit scale of the transmitter and the receiver become large.
[0005]
An object of the present invention is to negotiate a moving image division method in advance by a transmitter and a receiver, so that it is not necessary to support all division methods, and as a result, the scale of software and circuits can be minimized. Configuration.
[0006]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the invention according to claim 1 of the present invention is characterized in that a transmitter for generating and transmitting moving image data and a receiver for receiving, reproducing and storing moving image data are connected via a network. Video data transmission and reception system
The transmitter is
A transmitter video data processing unit for generating and transmitting a video data stream;
A transmitter division controller for negotiating a division method with the receiver,
According to the division information received from the transmitter division control unit, a dividing unit that divides the moving image data stream received from the transmitter moving image data processing unit, and transmits packetized moving image data,
A transmitter moving image data transmitting unit that transmits the moving image packet received from the dividing unit to the receiver,
A transmitter control data communication unit that transmits and receives control information transmitted and received from the transmitter division control unit to and from the receiver,
The transmitter receives video data from the video data transmission unit, receives control information from the transmitter control data communication unit, transmits them to a network, and transmits the control data received from the network to the transmitter control data communication unit. Characterized by comprising a transmitter network communication unit for transmitting to
The receiver, a receiver video data processing unit for receiving a video data stream,
A receiver division control unit that negotiates a division method with the transmitter division control unit;
A reconfiguration unit that receives a video packet, reconstructs a video packet according to the division information received from the receiver division control unit, and transmits a video data stream to the receiver video data processing unit;
A receiver moving image data receiving unit that receives a moving image packet and transmits the moving image packet to the reconstructing unit;
A receiver control data communication unit for transmitting and receiving the transmitter and control information,
The data received from the network is identified as moving image data or control data.In the case of moving image data, the data is transmitted to the receiver moving image data receiving unit, and in the case of control data, the data is received. A receiver network communication unit for transmitting the control information from the receiver control data communication unit to the receiver control data communication unit and transmitting the control information to the network.
[0007]
According to a second aspect of the present invention, in the moving image data communication system according to the first aspect,
Further, the transmitter is provided with a transmitter quality monitoring unit for monitoring the communication state of the network, and the receiver is also provided with a receiver quality monitoring unit, and the division information is renegotiated adaptively according to the communication quality of the network. And
[0008]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to FIGS.
[0009]
(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of a moving image communication system according to Embodiment 1 of the moving image data communication system via a network according to the present embodiment.
[0010]
In FIG. 1, reference numeral 100 denotes a transmitter for transmitting moving image data via a network; 101, a transmitter for generating moving image data or input from another internal block; and 102, a transmitter for generating division method information. A split control unit 103 splits the moving image data according to the splitting method information transmitted from the transmitter split control unit 102. A transmitter 104 transmits the split moving image data to the transmitter network communication unit 106. A video data transmission unit 105 is a transmitter control data communication unit provided for transmitting / receiving control information or other control information transmitted by the transmitter division control unit 102 to / from the receiver 200, and 106 is a transmitter video data transmission unit Each of the data transmitted from the transmitter control data communication unit 105 and the data transmitted from the transmitter control data communication unit 105 has a moving image data logical channel identification ID. Is a transmitter that transmits a control data logical channel identification ID to the network and transmits data received from the network to the transmitter control data communication unit 105 in the case of control data based on the added logical channel identification ID. Network communication unit.
[0011]
Also, 200 is a receiver for receiving moving image data via a network, 201 is a receiver moving image data processing unit for reproducing or storing received moving image data, and 202 is negotiating with a transmitter in advance on a method of dividing moving image data. A receiver division control unit 203 for reconstructing the divided received moving image data according to the division information; 204, a receiver moving image data receiving unit for receiving moving image data; 205, a transmitter 100 And a receiver control data communication unit 206 for transmitting and receiving division information and other control information. In the case of control data based on the logical channel identification ID to which the data received from the network is added, the receiver control data communication unit 205 In the case of moving image data, the data is transmitted to the receiver moving image data receiving unit 204 and received from the receiver control data communication unit 205. A receiver network communication unit for transmitting to the network by adding control data identification ID to the control data.
[0012]
The operation of the moving image data communication system via the network configured as described above will be described below. Now, the transmitter network communication unit 106 and the receiver network communication unit 206 are in a communicable state via the network, and the communication between the transmitter control data communication unit 105 and the receiver control data communication unit 205 and the transmitter It is assumed that a logical channel has been established between the moving image data transmitting unit 104 and the receiver moving image data receiving unit 204. Each logical channel has a logical channel identification ID. A logical channel identification ID is added to data flowing through the network, and it can be used to identify which logical channel the data flows through. It is the transmitter network communication unit 106 on the transmitter side and the receiver network communication unit 206 on the receiver side that adds and separates this logical channel identification ID.
[0013]
Now, from the transmitter 100 to the receiver 200, the H.264 is transmitted. It is assumed that moving image data conforming to the H.263 standard is converted into an RTP packet and transmitted. As a method of RTP packetization, a method described in RFC2429 of the Internet standard is used. Before actually transmitting the moving image data, the transmitter division control unit 102 negotiates a division method with the receiver division control unit 202. The division information is transmitted as control data using a logical channel established by the transmitter control data communication unit 105 and the receiver control data communication unit 205. In this case, there are four division methods shown in FIG.
[0014]
A specific dividing method of this dividing method is shown in FIGS. FIG. 1 shows a division method corresponding to 1, where data is divided in units of pictures, and one packet constitutes one packet. FIG. 2 shows a division method corresponding to 2, wherein data is divided in GOB (Group Of Picture) units, and one GOB constitutes one packet. FIG. 3 shows a division method corresponding to 3, wherein data is divided into macroblock (MB) units, and one packet is constituted by one macroblock. FIG. 4 shows a division method corresponding to FIG. 4, in which data is divided in the middle of a macroblock, and each divided data forms one packet.
[0015]
Transmitter division control section 102 transmits, to receiver division control section 202, division information indicating which of the four division methods corresponds to which division method. This is shown in FIG. As shown in FIG. 8, in this case, the transmitter division control unit 102 determines that the transmitter 100 3, no. Division information indicating that the division method 4 is supported is transmitted. Receiving the division information, the receiver division control unit 202 returns the division information corresponding to itself among the division methods supported by the transmitter 100 to the transmitter division control unit 102. This is shown in FIG. In this case, as shown in FIG. 3, no. No. 4 among the dividing methods No. 4 Division information indicating that data is transmitted and received by the division method 4 is returned. Transmitter division control section 102 instructs division section 103 on the division method based on the division information received from receiver 200. Using this division information, the division section 103 of the transmitter 100 can use the division method supported by the receiver 200.
[0016]
Receiver division control section 202 instructs reconstruction section 203 on the division method transmitted to transmitter 100. As a result, the receiver 200 can perform the reconstruction using only the desired division method. When the pre-negotiation of the division method ends, the transmitter moving image data processing unit 101 starts transmitting moving image data to the dividing unit 103. The division unit 103 divides the moving image data using the division method instructed by the transmitter division control unit 102. Further, the dividing unit 103 adds an RTP payload header described in RFC2429 to the divided moving image data, and transmits the data to the transmitter moving image data transmitting unit 104. The transmitter moving image data transmitting unit 104 adds an RTP header to the transmitted moving image data and converts the moving image data into an RTP packet. Thereafter, the transmitter moving image data transmitting unit 104 transmits the RTP packet to the receiver 200 through the logical channel established with the receiver moving image data receiving unit 204.
[0017]
On the receiver 200 side, the receiver moving image data receiving unit 204 receives the moving image data converted into the RTP packet. The receiver moving image data receiving unit 204 decodes the RTP header and transmits a moving image packet having an RTP payload header or less to the reconstructing unit 203. The reconstructing unit 203 releases the segmentation of the moving picture packet below the RTP payload header based on the dividing method instructed by the receiver dividing control unit 202, reconstructs the moving picture data into picture units, The moving image data is transmitted to the processing unit 201. The receiver moving image data processing unit 201 can process the received moving image data for each picture, and can reproduce the moving image data.
[0018]
As described above, in the moving image data communication system via the network according to the first embodiment, before the moving image communication, a method of dividing the moving image data is negotiated between the transmitter and the receiver, so that the transmitter and the receiver Can communicate only by a specific division method. This makes it possible to reduce the size of the software and the circuit.
[0019]
(Embodiment 2)
FIG. 2 is a block diagram showing a configuration of a moving image data communication system via a network according to the present embodiment.
[0020]
In FIG. 2, components that function similarly to the moving image data communication system according to the first embodiment are denoted by the same reference numerals, and description thereof will be omitted. In FIG. 2, reference numeral 107 denotes a transmitter quality monitoring unit that monitors network communication quality information transmitted from the transmitter network communication unit 106, and 207 monitors network communication quality information transmitted from the receiver network communication unit. Receiver quality monitoring unit.
[0021]
The operation of the moving image data communication system via the network configured as described above will be described below. In the first embodiment, the split information is negotiated before the transmitter 100 transmits the moving image data. However, in the present embodiment, the split information may be negotiated even during the transmission of the moving image data.
[0022]
During transmission of a moving image packet, for example, when the network is congested or the transmission quality changes due to the network being a wireless network, the transmitter quality monitoring unit 107 transmits to the transmitter 100 on the transmitter 100 side. The division control unit 102 is instructed to change the division method, and the transmitter division control unit 102 negotiates the division method again with the receiver 200. Similarly, on the receiver 200 side, the receiver quality monitoring unit 207 instructs the receiver division control unit 202 to change the division method, and as a result, the receiver division control unit 202 can negotiate the division method. . In this case, the receiver division control unit 202 selects an appropriate division method from the division information transmitted from the transmitter 100 in advance. For example, if the division method on the transmitter side is No. 3 and No. 4, the receiver division control unit 202 sets the division method to No. 4 in order to reduce the size of a packet that is lost at one time. No. 3 with a small division unit from No. 3 Negotiation to change to 4 is performed with the transmitter 100. By doing so, the transmission efficiency of the moving image data can be improved.
[0023]
As described above, in the video data communication system via the network according to the second embodiment, the transmitter and the receiver negotiate a video data division method by detecting communication quality and congestion even during video communication. Thus, the transmitter and the receiver can select a division method suitable for a communication state. As a result, even when the communication state is poor or congestion occurs, the moving image communication can be performed efficiently.
[0024]
In the first and second embodiments of the present invention, the case where the network is the Internet has been described. However, the present invention is not limited to this, and Bluetooth or the like may be used.
[0025]
In the first and second embodiments of the present invention, four division methods have been described as division methods, but the present invention is not limited to these division methods.
[0026]
In addition, H.264 is used as moving image data. Although the description has been made by taking moving image data conforming to the H.263 standard as an example, the present invention is not limited to this. For example, moving image data conforming to MPEG may be used.
[0027]
(Embodiment 3)
FIG. 10 is a block diagram showing a configuration of a moving image data communication system via a network according to the present embodiment.
[0028]
In FIG. 10, components that function similarly to the moving image data communication system according to the first embodiment are denoted by the same reference numerals, and description thereof will be omitted. 10, reference numeral 110 denotes a transmitter control unit; Reference numerals 112 and 212 denote an AVDTP signaling entity, and a logical channel is established by the AVDTP signaling entity 112 and the AVDTP signaling entity 212. Reference numerals 113 and 213 denote L2CAP (Logical Link Control and Adaptation Protocol) units, which perform packet distribution and the like for each logical channel.
[0029]
The operation of the moving image data communication system via the network configured as described above will be described below. In this embodiment, the network is Bluetooth (Bluetooth) of the short-range wireless communication standard. FIGS. 11 and 12 show the processing flow of the transmitter controller 110 and the receiver controller 210 at this time, respectively.
[0030]
First, both the transmitter 100 and the receiver 200 initialize a moving image data dividing method before communication (step 1101 in FIG. 11 and step 1201 in FIG. 12). Next, communication is started with Bluetooth. First, a physical connection, that is, an ACL (Asynchronous Connectionless Link) link is established between the transmitter 100 and the receiver 200 (step 1102 in FIG. 11 and step 1202 in FIG. 12). The physically connected (ACL-connected) transmitter 100 and receiver 200 then logically connect the AVDTP Signaling entities as defined in the Bluetooth GAVDP (Generic Audio Video Distribution Profile) standard. (Step 1103 in FIG. 11 and Step 1203 in FIG. 12). With this logical connection, the transmitter control unit 110 and the receiver control unit 210 can communicate with each other via the AVD Signaling unit. In this state, the transmitter control unit 110 and the receiver control unit 210 transmit and receive control information and prepare for transmission and reception of moving image data (step 1104 in FIG. 11 and step 1204 in FIG. 12). Next, the AVDTP stream managers are logically connected to each other as defined in the GAVDP standard (step 1105 in FIG. 11 and step 1205 in FIG. 12). Using this logical connection, the transmitter 100 and the receiver 200 can transmit and receive moving image data. At the time of this logical connection, since the maximum size of one packet has been negotiated, negotiation of division information is performed based on this maximum size. That is, the transmitter 100 transmits a Set Fragment Configuration command, which is a command that is an extension of AVDTP, and includes therein the corresponding division information (1106 in FIG. 11). The receiver 200 receives the Set Fragment Configuration command, and knows the division method supported by the transmitter 100 (Step 1206 in FIG. 12). Thereafter, the receiver 200 transmits a Set Fragment Configuration response (Step 1207 in FIG. 12). In the Set Fragment Configuration response transmitted by the receiver 200, of the division information that the transmitter 100 supports, the division method that the receiver 200 also supports at the same time is entered as the division information. After that, the transmitter 100 receives the Set Fragment Configuration response, and can know the division method to be used by the division unit 103 of the transmitter 100 (step 1107 in FIG. 11). Thereafter, the transmitter 100 starts transmitting the moving image data (1108 in FIG. 11). The dividing unit 103 of the transmitter 100 divides the moving image data according to the division information received from the receiver 200. The receiver 200 starts receiving the moving image data (Step 1208 in FIG. 12), and the reconstructing unit 203 reconstructs the moving image data according to the method of dividing the negotiation result, and converts the data into data for each picture.
[0031]
In the present embodiment, the Set Fragment Configuration command is used as a method for negotiating the division information. However, the present invention is not limited to this, and the division information may be superimposed on the Bluetooth AVDTP standard Set Configuration command.
[0032]
【The invention's effect】
According to the present invention, it is possible to easily transmit and receive moving image data using only a specific division method, suppress expansion of software or a circuit scale of a transmitter or a receiver, and expect cost reduction. .
[0033]
Further, according to the present invention, even when the communication state of the network is poor or congestion occurs, the moving image data can be efficiently communicated by appropriately changing the method of dividing the moving image data.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of a moving image data communication system via a communication network according to Embodiment 1 of the present invention. FIG. 2 is a configuration of a moving image data communication system via a communication network according to Embodiment 2 of the present invention. FIG. 3 is a block diagram showing a list of division methods; FIG. 4 is a block diagram showing a list of division methods; FIG. 5 is a view for explaining a dividing method of No. 1; FIG. 6 is a view for explaining a dividing method of No. 2; FIG. 7 is a view for explaining a dividing method of No. 3; FIG. 8 is a diagram illustrating a division method in FIG. 8 FIG. 8 is a diagram illustrating transmission of division information from a transmitter to a receiver FIG. 9 is a diagram illustrating transmission of division information from a receiver to a transmitter FIG. FIG. 11 is a block diagram illustrating a configuration of a moving image data communication system via a communication network according to Embodiment 3 of the present invention. FIG. 11 is a diagram illustrating a processing flow in the transmitter control unit. FIG. [Explanation of symbols]
REFERENCE SIGNS LIST 100 transmitter 101 transmitter video data processing unit 102 transmitter division control unit 103 division unit 104 transmitter video data transmission unit 105 transmitter control data communication unit 106 transmitter network communication unit 107 transmitter quality monitoring unit 110 transmitter control unit 111 AVDTP Stream Manager
112 AVDTP Signaling entity 113 L2CAP unit 200 Receiver 201 Receiver video data processing unit 202 Receiver division control unit 203 Reconstruction unit 204 Receiver video data reception unit 205 Receiver control data communication unit 206 Receiver network communication unit 207 Reception Device quality monitoring unit 210 Receiver control unit 211 AVDTP Stream Manager
212 AVDTP Signaling Entity 213 L2CAP section

Claims (4)

In a video data transmission and reception system via a network, a transmitter that generates and transmits video data, and a receiver that receives, reproduces, and stores video data are connected via a network.
The transmitter, a transmitter video data processing means for generating a video data stream,
A transmitter that generates division method information indicating a division method of the video data stream that can be supported by the transmitter, and transmits the division method information to the receiver to negotiate the division method with the receiver. Division control means;
According to a division method negotiated by the transmitter division control unit, the dividing unit divides the moving image data stream generated by the transmitter moving image data processing unit, and generates a moving image packet.
Transmitter moving image data transmitting means for transmitting the moving image packet generated by the dividing means to the receiver,
Transmitter control data communication means for controlling transmission and reception of the division method information between the transmitter division control means and the receiver,
The video data packet transmitted by the transmitter video data transmitting means and the division method information transmitted by the transmitter control data communication means are transmitted to the network, and the division control information received from the network is transmitted by the transmitter control. Transmitter network communication means for transmitting to the data communication means,
The receiver generates division method information indicating a division method of the video data stream that the receiver can support, and a receiver division control unit that negotiates a division method with the transmitter division control unit.
A receiver video data processing means for reproducing or storing the video data stream;
A reconfiguration unit that receives the video packet, performs reconfiguration of the video packet according to the division information received from the receiver division control unit, and transmits a video data stream to the receiver video data processing unit;
A receiver moving image data receiving unit that receives a moving image packet and transmits the moving image packet to the reconstructing unit;
A receiver control data communication unit for transmitting and receiving the transmitter and control information,
The data received from the network is identified as moving image data or control data.In the case of moving image data, the data is transmitted to the receiver moving image data receiving unit, and in the case of control data, the data is received. Video data communication via a network, comprising: a receiver network communication unit for transmitting to the receiver control data communication unit, receiving control information from the receiver control data communication unit, and transmitting the control information to the network. system. Transmitter quality monitoring means for monitoring network communication quality information transmitted from the transmitter network communication means to the transmitter, and receiver for monitoring network communication quality information transmitted from the receiver network communication means to the receiver Quality monitoring means, wherein the transmitter quality monitoring means and the receiver quality monitoring means cause the transmitter division control means and the receiver division control means to renegotiate the division information in accordance with the communication quality of the network. The moving image data communication system according to claim 1, wherein: The moving image data communication system according to claim 1 or 2, wherein the network is a short-range wireless communication standard, Bluetooth (Bluetooth). The moving image data communication system according to claim 1 or 2, wherein the network is the Internet.

Images