JP2001069123A - Equpment and method for multimedia data communication - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide equipment and a method for multimedia data communication with which degradation of communication efficiency can be suppressed. SOLUTION: In an error code encoding control part 105, the error rate of a communication line is analyzed from error occurrence rate information reported from a received data analytic part 117 in a receiving part 110, a divided bit length for error encoding of each of encoded data is controlled so as to shorten the divided bit length when the error occurrence rate is great or to extend the divided bit length when the error occurrence rate is small, and packet data to opposite equipment 150 are prepared.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia data communication apparatus and a communication method thereof, and more particularly to a multimedia data communication apparatus and a communication method thereof for preventing communication efficiency from deteriorating due to retransmission of erroneous information. It is.

[0002]

2. Description of the Related Art In a conventional multimedia data communication apparatus and its communication method, error correction coding is performed according to the degree of occurrence of an error in a communication line. This error correction coding has been performed by adding redundant information to information to be communicated. For this reason, when there is an error in the data received by the game device and a request for retransmission is issued from the game device, the local station terminal retransmits information to which redundant information for error correction has been added. Was.

[0003]

However, in a communication path having a poor communication condition such as wireless communication, there is a high possibility that an error exceeding the error correction capability will occur, and the possibility that retransmission will be performed frequently increases. As a result of frequent retransmissions, there has been a problem that the communication efficiency of information that should be transmitted is reduced.

In general, when the error correction capability is enhanced, the redundancy increases. Therefore, if the error correction capability is enhanced in accordance with a communication path having a poor communication state, the amount of retransmission information increases, and the transmission amount is increased. There is a problem that the communication efficiency of information to be degraded is deteriorated.

[0005] It is also conceivable to reduce the frequency of retransmission by changing the error correction capability in accordance with the degree of occurrence of errors in the communication line. It is necessary to have several types of error correction encoding / decoding processing devices, and the communication device becomes complicated.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and has as its object to provide a multimedia data communication apparatus and a method thereof capable of suppressing deterioration of communication efficiency.

[0007]

A multimedia data communication apparatus according to the present invention encodes image information, audio information, and data to generate encoded data, and divides the encoded data. Generates divided data divided into bit lengths, performs error detection coding on each divided data to generate an error detection code, packetizes the error detection code and the corresponding divided data, and packetizes the data. Error code encoding means for generating, and an error code code for calculating a division bit length for generating the divided data, and controlling the division bit length of the error code encoding means based on the calculated division bit length. Conversion control means;
A transmitting unit having means for multiplexing each of the packet data and transmitting the multiplexed data to the game device via the communication line, and multiplexing the multiplexed data transmitted from the game device via the communication line into image information, audio information, and data Means for separating each packet data corresponding to the packet data, means for outputting a detection decoding result obtained by performing error detection decoding on each of the separated packet data, and analyzing the error detection decoding result to obtain each packet data. Received data analysis for obtaining an error occurrence rate for data, outputting this as error occurrence rate information, analyzing the above error detection result, and outputting retransmission request information for requesting retransmission of an error-detected packet data. Means, and for each of the error-detected and decoded packet data for which no error was detected by the analysis by the received data analyzing means, And a receiving unit having retransmission control means for controlling retransmission of packet data in which an error has been detected using the retransmission request information, wherein the error code encoding control means The error occurrence rate information output from the analysis means is input, and the division bit length is calculated based on the error occurrence rate information.

[0008] Further, the receiving section includes means for analyzing the importance of decoding each of the packet data subjected to the error detection decoding and for notifying the analysis result to the retransmission control means. Is designed to control retransmission of packet data in which an error has been detected, based on the notified importance analysis result.

[0009] Further, the transmission unit includes importance analysis means for analyzing the importance of each coded data for decoding, and notifying the analysis result to the error code coding control means. The conversion control means calculates the division bit length based on the notified analysis result of the importance.

Further, in the multimedia data communication method according to the present invention, encoded data in which image information, audio information, and data are respectively encoded is generated, and each encoded data is divided into a predetermined division bit length. Generates divided data, obtains an error detection code for each of the divided data, generates packet data obtained by packetizing each of the divided data and the error detection code, multiplexes the packet data, and plays a game through a communication line. The multiplexed data transmitted to the device and received from the opposite device via the communication line is separated into image information, audio information, and packet data respectively corresponding to the data, and error detection decoding is performed on each of the separated packet data. If an error is detected, a multimedia requesting the terminal device to retransmit the packet data in which the error is detected is performed. A Adeta communication method, in accordance with the error rate of the communication line, but which is adapted to control said split bit length.

[0011] In addition, a request for retransmission of the packet data in which the error has been detected is made to the terminal device in accordance with the importance of decoding the packet data in which the error has been detected. Further, the division bit length is controlled in accordance with the importance of the encoded data with respect to decoding on the player device side.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a block diagram showing a configuration of a multimedia data communication apparatus according to Embodiment 1 of the present invention.
Reference numeral 31 denotes a device for inputting image information such as a video camera or a VTR, an audio input unit 132 denotes a device for inputting audio information such as a microphone or a handset, and a data input unit 133 denotes a device for inputting text data or still image data such as a hard disk or digital camera. This is a device for inputting data other than image information and audio information.

The transmitting section 1 of the multimedia data communication apparatus
In the image encoding unit 101, the image input unit 1
The image information input from 31 is encoded. Similarly, the audio encoding unit 102 encodes audio information input from the audio input unit 132, and the data encoding unit 103 encodes data input from the data input unit 133.

The error code encoding unit 104 receives each of the encoding units 101 and 102 according to the division bit length information on the encoded data to be subjected to error detection encoding, which is notified from the error code encoding control unit 105. , 103 are respectively divided, and error detection encoding is performed on the divided data and the own-station retransmission request information and the opposite-station retransmission request rejection information input from the retransmission control unit 115 of the reception unit 110. Then, packet data is created by packetizing the above-mentioned divided data, the own station retransmission request information, the above-mentioned replay rejection information, and the error detection code created therefor for each data.

The error code encoding control unit 105 analyzes the error rate of the communication line from the error occurrence rate information notified from the reception data analysis unit 117 of the reception unit 110, and
The divided bit length of each encoded data to be transmitted to 50 is calculated, and the above-mentioned divided bit length information is created.

In the multiplexing section 106, the error code encoding section 1
The multiplexing unit multiplexes each of the packet data input from the unit 04 to create multiplexed data. Further, the multiplexing unit 106 stores each packet data by a certain number in case of a retransmission request from the game apparatus 150, and according to the game retransmission information notified from the retransmission control unit 115, stores the packet data. The packet data requested to be retransmitted is transmitted to the communication line interface 120.

The communication line interface 120 transmits the multiplexed data created by the transmission unit 100 to the game device 150, receives the multiplexed data transmitted from the game device 150, and sends it to the reception unit 110.

Receiver 1 of multimedia data communication device
In 10, the separation unit 116 separates the received multiplexed data into packet data corresponding to images, sounds, and data. In the error code decoding unit 114, the separation unit 11
Error detection decoding is performed on the packet data input from step 6, and the error detection result and the packet data are input to the reception data analysis unit 117.

The reception data analysis unit 117 obtains the error rate of the communication line from the result of the error detection,
00 to the error code encoding control unit 105 as error occurrence rate information, and when the error detection result is an error, the local station retransmission request information to request retransmission of the erroneous packet data. To enter. On the other hand, if the error detection result is not an error, the error detection code is removed from the received packet data, and only the encoded data is taken out. The encoded data is analyzed to determine whether it is retransmission request information from the game apparatus 150, and retransmission is performed. If the request is a request, game retransmission request information requesting retransmission is input to retransmission control section 115, and if not, each encoded data is input to each of decoding sections 111-113.

The retransmission control section 115 analyzes the game retransmission request information input from the reception data analysis section 117 from the game apparatus 150, and if the requested packet data exists in the multiplexing section 106, the multiplexing section 106 The retransmission request information is notified, and if it does not exist, game retransmission rejection information is input to error code encoding section 104. Also, retransmission control section 115
Then, the local station retransmission request information input from the reception data analysis unit 117 is input to the error code encoding unit 104.

Image decoding unit 111, audio decoding unit 11
2. The data decoding unit 113 decodes the input coded data and outputs the image information to the image output unit 14.
1. The audio information is output to the audio output unit 142 and the data information is output to the data output unit 143. As the game device 150, for example, a device having a configuration including the transmission unit 100 and the reception unit 110, similar to the own device, is used.

FIG. 2 is a flowchart for explaining a multimedia data transmission method in the multimedia data communication apparatus according to Embodiment 1 of the present invention. FIG.
5 is a flowchart for explaining a multimedia data receiving method in the multimedia data communication device according to Embodiment 1 of the present invention. FIG. 4 is a flowchart for explaining the division bit length calculation method in step S202 in FIG.

Hereinafter, a multimedia data communication method will be described with reference to FIGS. 1, 2, 3 and 4. First, the operation of the transmitting section 100 will be described. In step S201 in FIG. 2, image information is input from the image input unit 131 to the image encoding unit 101 and encoded. Also, audio information is input from the audio input unit 132 to the audio encoding unit 10.
2, the data is input from the data input unit 133 to the data encoding unit 103 and encoded. Image encoding unit 101
Inputs the encoded image encoded data to the error code encoding unit 104. Similarly, the audio encoding unit 102 inputs the audio encoded data to the error code encoding unit 104, and the data encoding unit 103 inputs the data encoded data to the error code encoding unit 104.

Next, in step S202, error code encoding control section 105 calculates the division bit length of the encoded data to be transmitted to game apparatus 150. This step S202 corresponds to steps S401 and S4 in FIG.
02, step S403. First, in step S401, the error rate of the communication line is analyzed from the error rate information notified from the received data analysis unit 117, and when the error rate is high, the bit length of the division is reduced in step S402. , When the error rate is small,
In step S403, the division bit length is calculated so as to increase the division bit length.

Subsequently, in step S203, the error code encoding unit 104 divides the input image encoded data according to the division bit length information calculated by the error code encoding control unit 105 in step S202. In step S204, error detection encoding is performed on the divided image data. In step S205, the divided image data and the error detection code are packetized and output to the multiplexing unit 106 as image packet data. Similarly to the image coded data, the voice coded data and the data coded data are subjected to division, error detection coding, and packetization, and the resulting data is multiplexed as voice packet data and data packet data. Output to the unit 106.

Also, the local station retransmission request information and the game retransmission request rejection information input from retransmission control section 115 are shown in FIG.
In step S204, error detection encoding is performed. In step S205, the packet is packetized and output to the multiplexing unit 106 as local station retransmission request packet data. Step S206
In, the multiplexing unit 106 multiplexes each packet data input from the error code coding unit 104 to create multiplexed data, and the multiplexed data is transmitted to the remote control device 150 via the communication line interface 120 in step S207 of FIG. At the same time, and stores a predetermined number of each packet data in the multiplexing unit 106 in case of a retransmission request from the game apparatus 150.

Next, the operation of the receiving section 110 will be described. The receiving unit 110 receives the multiplexed data transmitted from the game device 150 via the communication line interface 120 in step S311 in FIG. Then, in step S312, the multiplexed data received by the separation unit 116 is separated into respective packet data for video, audio, and data, and each separated packet data is input to the error code decoding unit 114.

Subsequently, in step S313, the error code decoding unit 114 performs error detection decoding on each packet data input from the separation unit 116.
Receives the error detection result and the packet data into the received data analysis unit 1
Enter 17.

In step S314, the reception data analysis unit 117 obtains the error rate of the communication line from the result of the error detection and decoding. In step S315, the error rate is determined by the error code coding control unit 105 of the transmission unit 100. As error occurrence rate information.

Also, as a result of the error detection, step S316
In, if there is no error in the received packet data,
The reception data analysis unit 117 performs Step S318
The error detection code is removed from the packet data, and only the encoded data is extracted. It is analyzed whether or not the encoded data is retransmission request information from the game apparatus 150. Is input to the decoding unit corresponding to.

If there is an error in the received packet data in step S316, the received data analysis unit 117 requests the retransmission control unit 115 to retransmit the erroneous packet data in step S317, and the retransmission control unit 11
Reference numeral 5 denotes an error code encoding unit 104 of the transmitting unit 100 which transmits the local station retransmission request information as information of the packet data requesting retransmission.
To enter.

On the other hand, if the received data is the retransmission request information from the game apparatus 150 as a result of the analysis of the encoded data in the received data analysis section 117 in step S318 described above, the received game retransmission request information is retransmitted. Input to the unit 115. When the retransmission control information is input, the retransmission control unit 115 performs retransmission processing if the requested packet data is present in the multiplexing unit 106, and otherwise transmits the retransmission rejection information to the error code code at step S319. Input to the conversion unit 104.

In step S320, image decoding unit 111, audio decoding unit 112, data decoding unit 113
Decodes the encoded data input from the received data analysis unit 117, and outputs the image information obtained by the decoding to the image output unit 141, the audio information to the audio output unit 142, and the data information to the data output unit 143. I do.

In the first embodiment, received data analysis section 117 performs error detection decoding on each packet data input from separation section 116, and determines the error rate of the communication line from the error detection result. Then, this error occurrence rate is notified to the error code encoding control unit 105 as error occurrence rate information. Then, the error code encoding control unit 105 analyzes the error rate of the communication line from the notified error occurrence rate information, and when the error occurrence rate is high, shortens the division bit length in step S402, and When the error occurrence rate is low, the division bit length is calculated in step S403 so as to increase the division bit length, and the calculation result is used as the division bit length information as the error code encoding unit 104.
The error code encoding unit 104 divides the input image encoded data according to the input divided bit length information, performs error detection encoding, and creates packet data. Therefore, when the error occurrence rate is high, the length of the packet data transmitted to the game device 150 can be shortened. In general, if the packet data length is short, an error is less likely to occur, so that the possibility of the error being included in the packet data is reduced. As a result, the retransmission request from the game apparatus 150 is reduced, and the encoded data to be transmitted originally is reduced. It is possible to suppress deterioration of communication efficiency.

Even when there is a retransmission request from the game apparatus 150, when the error rate is high, even if retransmission is performed because the length of packet data to be retransmitted is shortened, the encoded data to be transmitted should be transmitted. Communication efficiency can be suppressed. When the error rate is low, the length of the packet data to be transmitted to the game device 150 can be increased, and the communication efficiency of the encoded data can be improved.

As described above, according to the first embodiment, the division bit length can be adjusted according to the error rate of the communication line, and when the error rate of the communication line is large,
Reduce the division bit length of the encoded data to reduce the packet data length of the packet data to be transmitted, and if the error rate of the communication line is low, increase the division bit length of the encoded data and transmit. By increasing the packet data length of packet data, if the error rate of the communication line is large, shorten the packet data length,
This has the effect of suppressing the occurrence of errors, reducing the frequency of retransmissions, and suppressing the degradation of communication efficiency.

Embodiment 2 FIG. 5 is a block diagram showing a configuration of a multimedia data communication apparatus according to Embodiment 2 of the present invention. In the figure, the same reference numerals as those in FIG. 1 indicate the same or corresponding parts. The description of the configuration of the attached portions is omitted.

The multimedia data communication apparatus according to the second embodiment differs from the multimedia data communication apparatus according to the first embodiment in that an importance analysis section 5171 is provided in the reception data analysis section 117a. ,
Importance analysis unit 517 in reception data analysis unit 117a
1 analyzes the importance of the received packet data for decoding, and the received data analyzing unit 117a requests the retransmission control unit 115 to perform retransmission only when the analysis result is important for decoding.

FIG. 6 is a flowchart of a multimedia data receiving method in the multimedia data communication apparatus according to the second embodiment of the present invention. The multimedia data communication method according to the second embodiment is different from the above-described embodiment. Form 1
In the multimedia data method according to the above, a step S611 of analyzing the importance of the packet data received by the own station apparatus when decoding the data and requesting retransmission only when it is determined to be important is added. In FIG. 6, processing steps denoted by the same reference numerals as those in FIG. 3 indicate the same or corresponding processing steps as those in FIG.

Hereinafter, the flow of processing of the multimedia data communication method in the multimedia data communication apparatus according to Embodiment 2 of the present invention will be described. Here, processing steps different from those of the multimedia data communication method according to Embodiment 1 of the present invention will be described, and description of the same or corresponding processing steps will be omitted.

Transmission unit 1 of multimedia data communication device
The processing flow of the first embodiment of the present invention shown in FIG.
Is the same as the processing flow of the multimedia data communication method according to the first embodiment. In the receiving unit 110 of the multimedia data communication apparatus, the steps from the reception processing step S311 by the communication line interface 120 shown in FIG. 6 to the error occurrence rate information notification processing step S315 by the reception data analysis unit 117a shown in FIG. The same processing as in the first embodiment is performed.

Notification processing step S31 of error occurrence rate information
In step S611, which is the processing subsequent to 5, the packet data received by the importance analysis unit 5171
The importance of decoding the packet data is analyzed.
As a result of the error detection, if there is no error in the received packet data in step S316, the error detection code is removed from the packet data and only the encoded data is taken out. In step S318, it is determined whether or not this is the retransmission request information from the player 150. Is analyzed, and if it is not the retransmission request information, in step S320, it is input to each decoding unit and decoded. Also, if there is an error in the received packet data in step S316, step S61
As a result of the analysis of the importance of the packet data for decoding by the importance analysis unit 5171 in 2, when it is determined that the packet data is important for decoding, the retransmission control unit 115 is requested to retransmit in step S <b> 317. If there is an error in the received packet data in step S316 and it is determined in step S612 that the packet data is not important for decoding, no retransmission is requested.

Thereafter, a retransmission request processing step S317 to the game apparatus 150 and processing steps S318 and S319 for retransmission request information from the game apparatus 150 are performed.
Is the same as the processing of the first embodiment described above.

Here, in the second embodiment, step S
At 612, the reception data analysis unit 117a requests the retransmission control unit 115 to perform retransmission only when the importance analysis unit 5171 in the reception data analysis unit 117a analyzes that the packet data received by the own station apparatus is important for decoding. Hereafter, the operation of the importance analysis unit 5171 will be described in detail by referring to the importance analysis unit 5171 when image packet data is received.
The operation will be described with reference to an example.

FIG. 7 is a diagram showing the structure of image packet data for explaining the operation of the importance analysis section 5171 of the multimedia data communication apparatus according to the second embodiment. For example, assuming that the image encoding method is ITU-TH.263, the configuration of the image encoded data is a repetition of header information 701, motion vector information 702, and other information 703 as shown in FIG. ing. In this encoding method, if there is header information and motion vector information, decoding is possible although the image quality is slightly degraded. That is, packet data including other information has a low importance for decoding, and packet data including header information and motion vector information has a high importance for decoding. Game device 150
As shown in FIG. 7B, the image packet data 711 is obtained by adding the header information 701 of the coded image data and the error detection code 701a to the image packet data 711.
The image packet data 712 obtained by adding the error detection code 702a to the
The data to which 3a has been added is transmitted as image packet data 713. In the own station device, the image packet data is
1, 712, 713, and as a result of the analysis by the reception data analysis unit 117a in step S314, it is determined that there is no error in the image packet data 711, and the error detection code is removed. At this time, the importance analysis unit 5171 determines in step S
As 611, the data from which the error detection code has been removed is analyzed, and it is recognized that this is the header information 701.

Next, received image packet data 712
At step S314.
a, and as a result, if an error occurs,
Since it is known that the information input next to the header information 701 is the motion vector information 702, the importance analysis unit 5171 determines in step S612 that there is an error in the motion vector information, and the packet including the motion vector information is determined. Since the data has a high importance for reproduction, the retransmission control unit 115 is notified of a request for retransmission of the image packet data 712.

Similarly, in step S314, the next received image packet data 713 is analyzed by the received data analysis unit 117a, and as a result, if an error occurs, the information inputted next to the motion vector information 702 Is known to be other information 703,
The importance analysis unit 5171 determines that there is an error in the other information in step S612, and notifies the retransmission control unit 115 of the request for retransmission of the image packet data 713 to the retransmission control unit 115 because the packet of the other information does not have a high importance for decoding. Will not do.

Although image packet data is illustrated here, even when audio packet data and data packet data are received, a request for retransmission of only information important for decoding is made in the same manner as when image packet data is received. Will be. Further, the image coding method described here is an example, and the image coding method is not limited to the above-described method, and may be MPEG1, MPEG2, MPEG4, ITU-TH.26.
1. Other methods such as Wavelet conversion may be used. Also,
The configuration of the image packet data given here is an example,
The configuration of the image packet data is not limited to the configuration described above, and may be another configuration.

According to the second embodiment, the same effects as those of the first embodiment can be obtained. In addition, when there is an error in the packet data, the importance analysis unit 5171 allows the importance analysis unit 5171 to decode the packet data. Since the importance is analyzed and retransmission is requested only when the importance is high, the number of retransmission requests can be suppressed while the decoding is possible, and the communication of the encoded data that should be transmitted There is an effect that deterioration in efficiency can be suppressed.

Note that even if an error has occurred in the packet data and its importance for decoding is high, the retransmission request may not always be made in some cases. In addition, other than information important for decoding, a retransmission request may be made in some cases.

Embodiment 3 FIG. FIG. 8 is a block diagram showing a configuration of a multimedia data communication apparatus according to Embodiment 3 of the present invention. In the figure, the same reference numerals as those in FIG. 5 indicate the same or corresponding parts. The description of the configuration of the attached portions is omitted. The multimedia data communication device according to the third embodiment is the same as the multimedia data communication device according to the second embodiment,
Between the image encoding unit 101, the audio encoding unit 102, the data processing unit 103, and the error code encoding unit 104,
A transmission data analysis unit 801 is provided, and an error code coding control unit 105a is provided as an error code coding control unit.
Extracts, for each of the encoded data input from the image encoding unit 101, the audio encoding unit 102, and the data processing unit 103, a data portion that is important when decoding the encoded data, and encodes the code of the important data portion. The start position and the end position in the coded data are notified to the error code coding control unit 105a as important data information. Also, each input coded data is directly input to the error code coding unit. The error code encoding control unit 105a calculates the division bit length from the error occurrence rate information and the important data information notified from the reception data analysis unit 117a, and outputs the division bit length information to the error code encoding unit 104. .

FIG. 9 is a flowchart of a multimedia data receiving method in the multimedia data communication apparatus according to the third embodiment of the present invention. The multimedia data communication method according to the third embodiment is different from the above-described embodiment. Form 2
In the multimedia data method according to the present invention, a data portion which is important when each encoded data is decoded by the transmitting unit is extracted, important data information is created for this, and error code encoding is performed based on the important data information. In FIG. 9, processing steps denoted by the same reference numerals as those in FIG. 6 indicate the same or corresponding processing steps as those in FIG.

Hereinafter, the flow of processing of the multimedia data communication method in the multimedia data communication apparatus according to Embodiment 3 of the present invention will be described. Here, processing steps different from the multimedia data communication method according to Embodiment 2 of the present invention will be described, and description of the same or corresponding processing steps will be omitted.

In step S201 shown in FIG. 9, image information is transmitted from the image input unit 131 to the image encoding unit 101 of the transmitting unit 100 of the multimedia data communication apparatus, and audio information is transmitted from the audio input unit 132 to the audio encoding unit 102. , Data from the data input unit 133 to the data encoding unit 103,
Each input and encoded data is input to the transmission data analysis unit 801. Transmission data analyzer 8
01, in step S901, extract a data portion that is important when decoding the encoded data for each encoded data. In step S902, the start position and the end position of the important data portion in the encoded data. And error code encoding control unit 10 as important data information.
Notify 5a. The error code coding control unit 105a calculates a division bit length in step S903 for error coding in the error code coding unit 104.

FIG. 10 is a flowchart of the process of the division bit length calculation method in step S903 in FIG. Step S903 includes steps S1001, S401, S402, and S403 shown in FIG. In step S1001, the error code coding control unit 105a sets the transmission data analysis unit 801
Is analyzed, and in step S401, the error rate of the communication line is analyzed from the error rate information notified from the received data analysis unit 117a. Is larger, the divided bit length is shortened in step S402, and if it is not an important data portion and the error rate is small, the encoding transmitted to the game apparatus 150 is increased in step S403 so as to increase the divided bit length. Calculate the data division bit length. The processes from the division processing step S203 to the transmission processing step S207 of the encoded data are the same as the processing of the second embodiment described above. The processing flow of the receiving unit 110 of the multimedia data communication device is the same as the processing flow of the multimedia data communication method according to the second embodiment.

Here, the operation of the transmission data analysis unit 801 according to the second embodiment and the error code encoding control unit 105a performs error encoding based on important data information notified from the transmission data analysis unit 801. The division bit length calculation process to be performed will be specifically described with reference to an example of image encoded data.

FIG. 11 is a diagram for explaining the operation of transmission data analysis section 801 and error code encoding control section 105a in the multimedia communication apparatus according to the third embodiment.
FIG. 3 is a diagram illustrating a configuration of image packet data.

For example, if the image coding method is an ITU-TH.263 image coding method, the structure of the image coded data is, as shown in FIG. 11A, header information 1101, motion vector information 1102, and other information. Information 1103 is repeated. In this encoding method, if there is header information and motion vector information, decoding is possible although the image quality is slightly degraded. That is, the header information and the motion vector information are encoded data having a higher importance for decoding, and the other information 1103 is data having a lower importance as compared with these. In step S901, the transmission data analysis unit 801 extracts information important for decoding, such as the header information 1101 and the motion vector information 1102, as shown in FIG. 11A, and starts the extracted data in the encoded image data. The position and the end position, that is, the start position of the header information and the end position of the motion vector information are output to the error code coding control unit 105a as important data information (step S90).
2). The error code encoding control unit 105a determines in step S
As 903, the division bit length of the encoded data to be transmitted to the game device 150 is calculated from the important data information notified from the transmission data analysis unit 801 and the error occurrence rate information notified from the reception data analysis unit 117 a. At this time, as shown in FIGS. 11B and 11C, the header information 1101 and the motion vector information 1102 designated as important by the important data information are obtained by combining the header information and the motion vector information. The length of the divided bit is shortened so that only the header information and only the motion vector information are used instead of the long divided bit length (steps S1001 and S402).
For the error rate 03, as shown in FIG. 11 (b), when the error rate is large, in step S402, the divided bit length is shortened so as to be divided into other information 11031 and other information 11032, and the error rate is reduced. When is smaller, as shown in FIG. 11C, in step S403, the division bit length is increased so that the data after division becomes the entire other information 1103.

Here, the image packet data is illustrated, but the same processing as the image packet data is performed for the audio packet data and the data packet data. Further, the image coding method described here is an example, and the image coding method is not limited to the above-described method, and may be MPEG1, MPEG2, MPEG4, ITU-TH.26.
1. Other methods such as Wavelet conversion may be used. Also,
The configuration of the image packet data given here is an example,
The configuration of the image packet data is not limited to the configuration described above, and may be another configuration.

As described above, according to the third embodiment, the same effects as those of the second embodiment can be obtained. In addition, the transmission data analysis unit 801 extracts an important part of each encoded data, and The error code encoding control unit 105a calculates the divided bit length so that the divided bit length of the divided bit length becomes shorter. For this reason, the reception data analysis unit of the game device 150 analyzes whether or not the erroneous reception data is important information for decoding. If the analysis result indicates that the reception data is important information, the reception data analysis unit requests the retransmission. On the local station apparatus side, important information at the time of decoding means that the divided bit length is shortened in advance and the packet data is reduced,
Even if this packet data is retransmitted, it is possible to suppress the deterioration of the communication efficiency of the encoded data to be transmitted.

In the third embodiment, header information and motion vector information are described as data important for decoding. However, in the present invention, data important for decoding includes header information and motion vector information. However, the present invention is not limited to this, and other data may be used. In addition, the important data information is not limited to information that indicates a start position and an end position of an information portion important for decoding in encoded data, but may be information that can notify important data, such as a start position and a data length. If it is, information of another configuration may be used.
In addition, the game device 150 may be able to make a retransmission request as needed even for information other than information important for decoding. Further, even when a retransmission request is issued from the game device 150, retransmission may not be performed in some cases.

In the first to third embodiments,
Although the input of the audio encoding unit 102 is audio information, the present invention is not limited to audio information and may be audio information.

In the first to third embodiments,
Although the image information, the audio information, and the data are respectively input, in the present invention, only one or only two of the image information, the audio information, and the data are input. After encoding and packetizing,
Multiplexing may be performed, and in such a case, the same effects as those of the first to third embodiments can be obtained.

[0064]

As described above, according to the present invention, means for encoding image information, audio information, and data to generate encoded data, and dividing the encoded data into division bit lengths. An error code code that generates divided data, performs error detection coding on each divided data, generates an error detection code, and packetizes the error detection code and the corresponding divided data to generate packet data. Error code encoding control means for calculating a division bit length when generating the divided data, and controlling the division bit length of the error code encoding means based on the calculated division bit length, A transmitting unit having means for multiplexing each of the packet data and transmitting the multiplexed data to the game device via the communication line; Means for separating each packet data corresponding to information, voice information, and data, means for outputting a detection decoding result obtained by performing error detection decoding on each of the separated packet data, and the error detection decoding result To determine the error occurrence rate for each packet data, output this as error occurrence rate information, and analyze the error detection result to request retransmission of the packet data in which an error is detected. Using received data analysis means for outputting information, means for respectively decoding each of the error-detected and decoded packet data in which no error was detected by the analysis by the received data analysis means, and using the retransmission request information And a retransmission control means for controlling retransmission of packet data in which an error has been detected. The control means receives the error occurrence rate information output from the reception data analysis means as input and calculates the division bit length based on the error occurrence rate information. It is possible to provide a multimedia data communication device that can reduce the frequency of communication and can suppress deterioration of communication efficiency.

Further, according to the present invention, the receiving section includes:
Means for analyzing the importance of decoding of each packet data subjected to the error detection decoding, and for notifying the analysis result to the retransmission control means, wherein the retransmission control means analyzes the notified importance. Based on the result, retransmission of packet data in which an error is detected is controlled, so that the number of retransmission requests can be suppressed, and deterioration of communication efficiency of coded data to be transmitted can be suppressed. There is an effect that a data communication device can be provided.

Further, according to the present invention, the transmitting section includes:
The error code encoding control means for analyzing the importance of each encoded data for decoding, and notifying the error code encoding control means of the analysis result, wherein the error code encoding control means Multimedia data communication apparatus which can suppress the deterioration of communication efficiency of coded data to be transmitted even if packet data is retransmitted, since the above-mentioned division bit length is calculated based on the result of the analysis. There is an effect that can be provided.

Further, according to the present invention, encoded data is generated by encoding image information, audio information, and data, and divided data obtained by dividing each encoded data into a predetermined divided bit length is generated. Obtaining an error detection code for each of the divided data, generating packet data obtained by packetizing each of the divided data and the error detection code, multiplexing the packet data, and transmitting the multiplexed packet data to a game apparatus through a communication line; The multiplexed data received from the above-mentioned apparatus via the communication line is separated into image data, audio information, and packet data respectively corresponding to the data, and error detection decoding is performed on each of the separated packet data to detect an error. If so, a multimedia data communication method for requesting the opposite device side to retransmit the packet data in which the error is detected, Depending on the error rate of the serial communication line,
Since the division bit length is controlled, it is possible to provide a multimedia data communication method capable of suppressing the occurrence of errors, reducing the frequency of retransmission, and suppressing the deterioration of communication efficiency.

Further, according to the present invention, the retransmission request of the packet data in which the error has been detected is made to the terminal device in accordance with the importance of decoding the packet data in which the error has been detected. This has the effect of providing a multimedia data communication method capable of suppressing the number of retransmission requests and suppressing deterioration in communication efficiency of coded data to be transmitted.

Further, according to the present invention, the division bit length is controlled in accordance with the degree of importance of the encoded data for decoding on the playing device side. There is an effect that a multimedia data communication method capable of suppressing deterioration of communication efficiency of coded data to be provided can be provided.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a multimedia data communication device according to Embodiment 1 of the present invention.

FIG. 2 is a flowchart for explaining a multimedia data transmission method in the multimedia data communication device according to the first embodiment of the present invention.

FIG. 3 is a flowchart for explaining a multimedia data receiving method in the multimedia data communication device according to the first embodiment of the present invention.

FIG. 4 is a flowchart for explaining a division bit length calculation method in the multimedia data communication apparatus according to Embodiment 1 of the present invention.

FIG. 5 is a block diagram showing a configuration of a multimedia data communication device according to Embodiment 2 of the present invention.

FIG. 6 is a flowchart for explaining a multimedia data receiving method in the multimedia data communication apparatus according to Embodiment 2 of the present invention.

FIG. 7 is a diagram illustrating an operation of an importance analysis unit of the multimedia data communication device according to the second embodiment of the present invention.
FIG. 3 is a diagram illustrating a configuration of image packet data.

FIG. 8 is a block diagram showing a configuration of a multimedia data communication device according to Embodiment 3 of the present invention.

FIG. 9 is a flowchart for explaining a multimedia data transmission method in the multimedia data communication apparatus according to Embodiment 3 of the present invention.

FIG. 10 is a flowchart for explaining a division bit length calculation method in the multimedia data communication apparatus according to Embodiment 3 of the present invention.

FIG. 11 is a diagram illustrating a configuration of image coded data for explaining operations of a transmission data analysis unit and an error code coding control unit in the multimedia communication device according to Embodiment 3 of the present invention.

[Explanation of symbols]

REFERENCE SIGNS LIST 100 Transmitting unit 101 Image encoding unit 102 Audio encoding unit 103 Data encoding unit 104 Error code encoding unit 105, 105a Error code encoding control unit 106 Multiplexing unit 110 Receiving unit 111 Image decoding unit 112 Audio decoding unit 113 Data decoding unit 114 Error code decoding unit 115 Retransmission control unit 116 Separation unit 117, 117a Received data analysis unit 120 Communication line interface 131 Image input unit 132 Audio input unit 133 Data input unit 141 Image output unit 142 Audio output unit 143 Data Output unit 150 Playback device 701 Header information 702 Motion vector information 703 Other information 701a to 703a, 1101a, 1102a, 110
31a, 11032a Error detection code 711-713 Image packet data 801 Transmission data analysis unit 1101 Header information 1102 Motion vector information 1103, 11031, 11032 Other information 1111-1113, 11131, 11132 Image packet data 5171 Importance analysis unit

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5K014 AA01 BA01 FA03 FA13 GA02 5K028 AA11 BB04 EE03 EE05 KK01 KK32 MM09 PP02 PP03 PP12 RR04 5K030 GA03 HB01 HB02 HB12 HB21 HB28 HB29 JA01 MB05

Claims (6)

[Claims] 1. A means for respectively encoding image information, audio information, and data to generate encoded data, and generating divided data obtained by dividing each of the encoded data into division bit lengths. On the other hand, error code coding means for performing error detection coding to generate an error detection code, packetizing the error detection code and the corresponding divided data to generate packet data, and generating the divided data. Error code encoding control means for controlling the division bit length of the error code encoding means, based on the calculated division bit length, and multiplexing the respective packet data to form a communication line. A transmitting unit having means for transmitting to the game device via the communication device; and multiplexing data transmitted from the game device via the communication line into image information, audio information, and data. Means for separating each corresponding packet data; means for outputting a detection decoding result obtained by performing error detection decoding on each of the separated packet data; analyzing the error detection decoding result; Find the error rate for packet data,
The received data analyzing means outputs this as error occurrence rate information, analyzes the error detection result, and outputs retransmission request information for requesting retransmission of the packet data in which the error has been detected. Means for decoding each of the error-detected and decoded packet data for which no error has been detected by the analysis, and retransmission control for controlling retransmission of the packet data in which the error has been detected using the retransmission request information And a receiving unit having means for receiving error rate coding information output from the received data analyzing means, and calculating the division bit length based on the error rate information. A multimedia data communication device, comprising: 2. The multimedia data communication apparatus according to claim 1, wherein the receiving unit analyzes the importance of decoding each of the error-detected and decoded packet data, and transmits the analysis result to the retransmission control unit. Multimedia data communication apparatus, characterized in that the retransmission control means controls retransmission of packet data in which an error has been detected, based on the notified analysis result of importance. . 3. The multimedia data communication device according to claim 1, wherein the transmission unit analyzes the importance of each encoded data for decoding, and notifies the error code encoding control unit of the analysis result. A multimedia data communication apparatus, comprising importance analysis means, wherein the error code encoding control means calculates the division bit length based on the notified importance analysis result. 4. Generating encoded data obtained by encoding image information, audio information, and data, generating divided data obtained by dividing each of the encoded data into a predetermined division bit length, An error detection code is obtained for the divided data and the error detection code is packetized to generate packet data. The packet data is multiplexed and transmitted to a game device via a communication line. The multiplexed data received from is separated into image information, audio information, and packet data respectively corresponding to the data, and performs error detection decoding on each of the separated packet data, and when an error is detected, A multimedia data communication method for requesting the opposite device to retransmit packet data in which an error has been detected, the method comprising: Multimedia data communication method which, and controlling the divided bit length according to. 5. The multimedia data communication method according to claim 4, wherein a request for retransmission of the packet data in which the error has been detected is sent to the playing apparatus in accordance with the importance of decoding the packet data in which the error has been detected. A multimedia data communication method characterized by performing. 6. The multimedia data communication method according to claim 4, wherein the division bit length is controlled in accordance with the importance of the encoded data for decoding on the opposite device side. Method.