JP2002290973A - Multimedia communication equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide multimedia communication equipment with which a better picture quality can be obtained over the limited range of a transmission quantity by selecting an optimal encoding system in the case of transmission by performing encoding system switching for each picture using a protocol message. SOLUTION: This equipment is provided with a plurality of encoding means 10, 11, 12 and 13, a transmitting data selecting means 14 for selecting any one of encoded data 104 outputted by the encoding means as encoded data to be transmitted, and a transmitting data generating means 15 for generating video data 16 composed of information 101, 102 or 301 on encoding of the encoded data 104 selected by the transmitting data selecting means 14 and the selected encoded data 104.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multimedia communication device capable of transmitting and receiving moving images and sounds.

[0002]

2. Description of the Related Art In a conventional multimedia communication device, information is exchanged with a partner terminal device at the start of a call, and the coding type of video or the like is basically fixed during a call.
A method of transmitting and receiving a video encoded according to the fixed encoding type is adopted. The encoding type defines the internal format of data encoded by, for example, MPEG-4, H261, H263, and the like, and the functions used in encoding. As long as the encoding type is not changed, the parameters used for encoding can be freely determined by the transmitting side. For example, the transmission period of the intra-frame coded image described in JP-A-2000-23154 and the quantization characteristic described in JP-A-8-21915 can be freely changed by the transmitting terminal.

FIG. 7 is a block diagram showing a configuration of a conventional multimedia communication apparatus described in Japanese Patent Application Laid-Open No. 2000-23154. In FIG. 7, reference numeral 51 denotes a system control unit, and 52A denotes a moving image code. 52B
Denotes a moving image coding unit 2 and 52C denotes a moving image coding unit 3.
, 53 is an encoded data output selection unit, 54 is an input terminal, and 55 is an output terminal.

Next, the operation will be described. The system control unit 51 includes a moving image encoding unit 1 (52
A), 2 (52B), and 3 (52C) are set with encoding parameters. The moving picture coding unit 1 (52A) is set to perform coding with, for example, the period of the intra-frame coded picture (I picture) being 3, and the moving picture coding unit 2 (52B).
Are set so that encoding is performed with the period of the intra-frame encoded image (I picture) being 2, and the moving image encoding unit 3 (5
2C) is set so that encoding is performed with the period of the intra-frame coded image (I picture) set to 1.

[0005] The system control unit 51 encodes the moving image input from the input terminal 54 in parallel by each moving image encoding unit, and converts the data representing the encoded image quality from each moving image encoding unit. The optimum encoding parameter is determined for each certain period during the evaluation, and the encoded data output selection unit 53 is controlled so as to select the encoded output data corresponding to the optimal encoding parameter.

[0006]

In such a conventional multimedia communication apparatus, it is impossible to immediately change the coding type and the coding parameters relating to the entire coding process during a call. For example, in the case of an H324 terminal, if an attempt is made to change the coding type or coding parameters relating to the entire code during a call, a moving picture with a new coding type is obtained after obtaining permission of the receiving terminal using an H245 protocol message. Data can be transmitted. When returning to the coding type before the change, it is necessary to similarly obtain the permission of the partner terminal device using the H245 protocol message.
For this reason, a time lag occurs between the transmission of the protocol message from the own terminal and the arrival at the partner terminal, the transmission of the response by the partner terminal, and the reception of the response by the own terminal. Normally, a video image is transmitted 15 or 10 screens per second, so that it is practically impossible to switch the coding method for each screen using a protocol message.

On the other hand, a video encoding method generally employs a method of encoding a difference between a previously transmitted image and a current image in order to increase transmission efficiency. Depending on the encoding method, a method of encoding the difference is also used for voice. When coding the difference, generally, the input image has high coding efficiency if there are many still parts, but if the image has large motion, the image quality deteriorates or the coding efficiency deteriorates. A phenomenon occurs. Since the appearance of these phenomena differs depending on the coding type and the parameters at the time of coding, if the optimum coding system can be selected at the time of transmission, better image quality can be obtained in a limited transmission amount range. Should be.
However, in the conventional multimedia communication device, as described above, it is practically impossible to switch the encoding method for each screen using a protocol message.
There has been a problem that an optimum encoding method cannot be selected for each screen during transmission.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described problem, and performs switching of an encoding system for each screen by using a protocol message to select an optimal encoding system at the time of transmission. It is another object of the present invention to provide a multimedia communication device capable of obtaining better image quality in a limited transmission amount range.

[0009]

A multimedia communication apparatus according to the present invention selects a plurality of encoding means for encoding the same moving picture and any one of encoded data output from the encoding means. Transmission data selection means for selecting the selected encoded data, transmission data generation means for generating video data consisting of information on the encoding of the selected encoded data, and the selected encoded data. is there.

[0010] In the multimedia communication apparatus according to the present invention, the information on the encoding of the selected encoded data includes:
The transmission data generating means includes coding method information indicating a coding method and coding parameter information indicating a coding parameter, and the transmission data generating unit indicates coding method information and a coding parameter indicating a coding method of the selected coded data. It comprises data type notifying means for generating video data comprising coding parameter information and selected coded data.

[0011] In the multimedia communication apparatus according to the present invention, the information about the encoding of the selected encoded data is:
The transmission data generation means comprises: coding method notification means for assigning a type number to the coding method and the coding parameter; and Number information indicating a type number assigned to an encoding method and an encoding parameter used for encoding encoded data, and a type number notifying unit for generating video data including the selected encoded data. It is.

[0012] In the multimedia communication apparatus according to the present invention, coding method information and coding parameter information are added to the head of the selected coded data.

In the multimedia communication apparatus according to the present invention, the type number information is added to the head of the selected encoded data.

[0014] The multimedia communication apparatus according to the present invention may include any one of a plurality of decoding means for decoding encoded data and a plurality of decoding means according to information on encoding of video data received from a partner terminal apparatus. And receiving data analysis means for transferring the encoded data of the video data to the selected decoding means.

[0015] In the multimedia communication apparatus according to the present invention, the information relating to the encoding includes encoding method information indicating an encoding method and encoding parameter information indicating an encoding parameter. And a decoding type selecting means for selecting a decoding means according to the coding method and the coding parameter.

[0016] In the multimedia communication apparatus according to the present invention, the information related to the encoding includes type number information indicating a type number corresponding to the encoding method and the encoding parameter, and the reception data analysis means determines whether or not the reception data is to be transmitted when the communication is started. Based on the encoding method and the encoding parameter and the type number received from the device, decoding setting means for storing information indicating the correspondence between the encoding method and the encoding parameter and the type number, and type number information of the video data, Decoding number selecting means for selecting a decoding means to be used for decoding by collating with information indicating correspondence stored in the decoding setting means.

[0017] In the multimedia communication apparatus according to the present invention, the video data includes coded data, coding method information and coding parameter information added to the head of the coded data.

[0018] In the multimedia communication apparatus according to the present invention, the video data includes coded data and type number information added to the head of the coded data.

[0019]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 FIG. 1 is a block diagram showing a configuration of a multimedia communication terminal device according to Embodiment 1 of the present invention. In FIG. 1, reference numeral 1 denotes a video input unit such as a CCD camera which takes in a video and generates a video signal 30, and 10, 11, and 12 encode the video signal 30 and encode data 104a, 104b, and 10;
For example, reference numeral 10 denotes an encoding unit that encodes according to the H263 encoding system, and reference numeral 11 denotes an encoding unit that encodes according to the Visual-4 encoding system of MPEG-4. Means 12, which is an encoding means for encoding by the H262 encoding method. Reference numeral 14 denotes transmission data selection means for selecting encoded data and outputting the selected encoded data 104 and the selection result 33;
Is transmission data generation means for generating video data 16 based on the selected coded data 104 and the selection result 33; 17 is a data type notifying means which constitutes the transmission data generation means 15; And a video data generated based on the selection result 33. Reference numeral 2 denotes a microphone that captures audio and generates an audio signal 32.
Numeral 3 denotes a speech encoding means for encoding in the GSM encoding method. Reference numeral 18 denotes a multimedia communication control protocol for notifying the transmission of audio and video with the partner terminal and determining its multiplexing parameter. Reference numeral 3 denotes a terminal control for operating the multimedia communication control protocol 18 and starting a communication start procedure. And 19 is a media demultiplexer for setting the determined multiplexing parameter. In the first embodiment, the transmission data generation unit 15 is configured by the data type notification unit 17.

FIG. 2 is a diagram showing the structure of the video data 16. In FIG. 2, reference numeral 101 denotes coding method information (1 byte) indicating a coding method, and 102 denotes coding parameter information (2 bytes) indicating a coding parameter.
04 is encoded data (n bytes). The encoding method information 101 and the encoding parameter information 102 become information relating to encoding in the first embodiment and the third embodiment described later.

The encoding system information 101 is 1-byte data, and represents a number indicating a video encoding system. For example, in the case of ITU-T H261, the number indicating the coding method is 0, in the case of ITU-T H262, the number indicating the coding method is 1, and in the case of ITU-T H263, the coding method is indicated. The number is 2.

The code parameter information 102 is 2-byte data and represents a coding parameter relating to the entire coding process. The content of this parameter differs depending on the encoding method. For example, in H263, whether or not the length of the motion compensation vector used in the differential encoding is limited, and whether or not to use the arithmetic encoding, are set to a specific bit value of 0. Or, it is represented by 1.

The encoded data 104 includes encoding method information 1
01 and output data encoded by the encoding means 10, 11 and 12 in the encoding method indicated by the encoding parameter information 102, and is encoded data (n bytes) of an image for one screen of video.

Next, the operation will be described. Communication line 50
Is opened to enable transmission of digital data (arrow (1) in FIG. 1), the terminal control unit 3 operates the multimedia communication control protocol 18 and starts a communication start procedure.

Multimedia communication control protocol 18
Notifies the transmission of voice and video with the partner terminal, and determines the multiplexing parameter. The determined multiplexing parameters are set in the media demultiplexing unit 19 by the terminal control unit 3 as setting contents (arrow (2) in FIG. 1). At this time, a specific coding method is not determined between the terminal and the partner terminal.

When the multiplexing parameter is set, the media demultiplexer 19 is ready to transmit audio and video. When transmission is possible, data is requested from the transmission source of each medium (audio and video) (arrow (3) in FIG. 1), and the acquired data is multiplexed and transmitted. In the case of the first embodiment, the source of the audio is
The transmission source of the video is the data type notifying unit 17 of the transmission data generating unit 15.

The operation in video will be described below. The data type notifying unit 17 of the transmission data generation unit 15 requests data from the transmission data selection unit 14 in response to the data request from the media demultiplexing unit 19 (arrow (4) in FIG. 1).
The coded data 104 and the selection result 33 are acquired. The data type notifying unit 17 composes the video data 16 according to the obtained selection result 33 and passes the video data 16 to the media demultiplexing unit 19.
Here, as shown in FIG. 2, the video data 16 configured includes encoded data 104 (n bytes) and encoding method information 101 (1) indicating an encoding method added before the encoded data 104. Byte) and encoding parameter information 102 (2 bytes) representing the encoding parameter.
That is, information indicating the coding method and the coding parameter of the received coded data representing the coded data is added to the top as information related to coding.

The encoding method and the encoding parameters represented by the encoding method information 101 and the encoding parameter information 102 are the encoding method and the encoding parameters of the encoding means in which the selected encoded data 104 has been encoded. And the selection result 33 generated by the transmission data selection unit 14
Is added before the encoded data 104 based on

The transmission data selection unit 14 requests data from the encoding unit 10, the encoding unit 11, and the encoding unit 12 in response to a data request from the data type notifying unit 17 of the transmission data generating unit 15 ( Arrow (5) in FIG. 1). The transmission data selection unit 14 is configured to transmit the encoded data 104 from the three encoding units 10, 11, and 12.
When a, 104b, and 104c are obtained, one of the encoded data is selected, and the selection result 33 and the selected encoded data 104 are sent to the data type notifying unit 17 of the transmission data generating unit 15. Here, selection result 33
Is information for specifying the encoding unit that has generated the selected encoded data 104, and may be, for example, a number representing the encoding unit.

Encoding means 10, 11, and 12 respectively perform moving image encoding processing on the video signal 30 from the CCD camera 1 to encode data 104a, 104b, and 10
4c, and generates the encoded data 104a, 10a according to the request of the transmission data selecting means 14 (arrow 5 in FIG. 1).
4b and 104c are passed to the transmission data selection means 14.

As mentioned above, the description so far has been with respect to video. For voice, the operation is as follows.

The voice captured by the microphone 2 is a voice signal 3
2 is input to the encoding means 13. Encoding means 13
Generates an encoded data 105 by encoding the audio signal 32 according to the GSM method.

The coded data 105 is input to the media demultiplexer 19. The media multiplexing / demultiplexing unit 19 multiplexes the coded audio data 105 and the video data 16 and transmits the multiplexed data to the partner terminal device via the communication line 50.

As described above, according to the first embodiment, in a multimedia communication terminal apparatus, encoding is performed using a plurality of encoding means with different encoding schemes and encoding parameters. Since the encoded data encoded by the encoding means is selected, and the encoding method and the encoding parameter of the selected encoded data are added to the head of the encoded data as information relating to the encoding, it is optimal for transmission. The effect that the encoded data can be transmitted to the partner terminal device with a high image quality can be obtained.

Further, according to the first embodiment, in the multimedia communication terminal device, the encoding method information and the encoding parameter information indicating the encoding method and the encoding parameter of the selected encoded data are encoded data. At the head of the other terminal, the other terminal device obtains the information on the coding before decoding the coded data, and has an effect of receiving the coded data with the optimum image quality.

In the first embodiment, a case has been described where three encoding means are used simultaneously for video. However, two encoding means or four or more encoding means are used simultaneously. The same processing is possible. The same processing as video can be performed on audio using a plurality of encoding units.

Embodiment 2 FIG. 3 is a block diagram showing a configuration of a multimedia communication terminal device according to Embodiment 2 of the present invention. 1 denote the same or corresponding parts, and a description thereof will not be repeated. In FIG.
Numeral 1 stores the encoding methods and the encoding parameters of the encoding means 10, 11 and 12 in association with the type numbers, and the encoding method and the encoding of each encoding means via the multimedia communication control protocol 18. This is an encoding method notifying unit that transmits the parameter and the type number to the partner terminal.
202 is a type number notifying unit that generates the video data 16 based on the encoded data 104 and the selection result 33,
The correspondence between the coding method and the coding parameters stored in the coding method notifying means 201 and the type numbers is also stored in the type number notifying means 202. Embodiment 2
Then, the encoding method notifying means 201 and the type number notifying means 2
02 constitutes the transmission data generating means 15.

FIG. 4 is a diagram showing the structure of the video data 16 of FIG. In FIG. 4, reference numeral 301 denotes type number information (1 byte), and reference numeral 104 denotes encoded data (n bytes), like the video data 16 of the first embodiment in FIG. The type number information 301 corresponds to the encoding method information 10 in FIG.
1 and the encoding parameter represented by the encoding parameter information 102. In the second embodiment and the fourth embodiment to be described later, the information is information on encoding. .

The type number information 301 indicates the type number in the correspondence between the coding method and the coding parameters stored in the coding method notifying means 201 and the type number notifying means 202 and the type number.

Next, the operation will be described. As described above, in the second embodiment, the transmission data generation unit 15
Is the type number notifying means 202 and the encoding method notifying means 20
1 and that the video data 16 is composed of the type number information 301 and the encoded data 104, except that it is different from the first embodiment. The following description focuses on differences in the operation based on the above.

The communication line 50 is opened to enable the transmission of digital data (arrow (1) in FIG. 3), the multiplexing parameters are determined, and the setting contents are set in the media demultiplexing unit 19 by the terminal control unit 3 ( An arrow (2) in FIG. 3) is in a state where audio and video can be transmitted.

In the second embodiment, when transmission becomes possible, the encoding method notifying means 201 transmits the information to the encoding means 10, 1 via the multimedia communication control protocol 18.
The correspondence between the coding methods and the coding parameters of Nos. 1 and 12 and the assigned type numbers is transmitted to the partner terminal device (arrow (6) in FIG. 3).

After the correspondence between the encoding system and the encoding parameter and the assigned type number is transmitted to the partner terminal device, the media demultiplexer 19 requests data from the transmission source of each media (audio and video). Then, the obtained data is multiplexed and transmitted (arrow (3) in FIG. 3). In the case of the second embodiment, the source of the audio is the encoding unit 13, and the source of the video is the data type notifying unit 17 of the transmission data generating unit 15.

The operation in video will be described below. The type number notifying unit 202 of the transmission data generation unit 15 requests data from the transmission data selection unit 14 in response to the data request from the media multiplex / demultiplex unit 19 (arrow (4) in FIG. 3).
The coded data 104 and the selection result 33 are acquired. The type number notifying unit 17 composes the video data 16 according to the obtained selection result 33 and passes it to the media demultiplexing unit 19. Here, as shown in FIG. 4, the configured video data 16 includes encoded data 104 and type number information 301 added before the encoded data 104. That is, type number information 301 indicating the type number corresponding to the encoding method and the encoding parameter of the selected encoded data 104 is added to the head of the encoded data 104.

The type number represented by the type number information 301 is the type number assigned to the encoding method and the encoding parameter of the encoding means in which the selected encoded data 104 has been encoded. Based on the selection result 33 generated by the means 14, the encoded data 104
Is added before.

The operation of the transmission data selection means 14 and the operation of the encoding means 10, 11, and 12 are the same as those in the first embodiment, and a description thereof will be omitted.

The operation related to voice is the same as that in the first embodiment, and the description is omitted.

As described above, according to the second embodiment, the type number information indicating the type number corresponding to the coding method and the coding parameter of the selected coded data is used as the information on the coding. , The same function as in the first embodiment can be realized with a reduced load during a call.

Further, according to the second embodiment, in the multimedia communication terminal device, type number information indicating a type number corresponding to the coding method and coding parameter of the selected coded data is converted into the coded data. Since it has been added to the head, it is possible for the partner terminal device to obtain information on coding before decoding the coded data and to receive the coded data with the optimum image quality.

In the second embodiment, the case where three encoding means are used simultaneously for video has been described. However, two encoding means or four or more encoding means are used simultaneously. The same processing is possible. The same processing as video can be performed on audio using a plurality of encoding units.

Embodiment 3 FIG. FIG. 5 is a block diagram showing a configuration of a multimedia communication terminal device according to Embodiment 3 of the present invention. 1 denote the same or corresponding parts, and a description thereof will not be repeated. In FIG. 5, 315
Is a decoding type selection unit that receives the video data 16 and sends the coded data 104 of the video data 16 to a decoding unit that decodes the corresponding encoding method and encoding parameter.
Reference numeral 314 denotes a reception data analysis unit including the decoding type selection unit 315. Reference numerals 310, 311 and 312 denote video decoding means for decoding the coded data sent from the decoding type selection means 315 of the reception data analysis means 314. For example, 310 denotes a decoding means for decoding by the H263 coding method. Reference numeral 311 denotes decoding means for decoding in the MPEG-4 Visual coding method, and reference numeral 312 denotes decoding means for decoding in the H262 coding method.

Reference numeral 313 denotes audio decoding means for decoding the audio coded data sent from the media demultiplexer 19. A monitor 320 displays the decoded video.
Reference numeral 321 denotes a speaker that emits the decoded sound. In the third embodiment, the reception data analysis unit 314 includes the decoding type selection unit 315.

Next, the operation will be described. Communication line 50
Is opened to enable transmission of digital data (arrow (1) in FIG. 5), the terminal control unit 3 operates the multimedia communication control protocol 18 and starts a communication start procedure.

Multimedia communication control protocol 18
Notifies the transmission of voice and video with the partner terminal, and determines the separation parameters. The determined demultiplexing parameter is set as a setting content in the media demultiplexing unit 19 by the terminal control unit 3 (arrow (2) in FIG. 5).
No specific coding scheme is determined with the partner terminal.

The media demultiplexer 19 sets a demultiplexing parameter and becomes receivable. When receiving data from a partner terminal via the communication line 50, the media demultiplexer 19 separates video or audio data and sends it to each media receiving destination. The data is passed (arrow (3) in FIG. 5). In the case of the third embodiment shown in FIG. 5, the audio receiving destination is the decoding means 313, and the video receiving destination is the decoding type selecting means 3 of the received data analyzing means 314.
Fifteen.

The decoding type selecting means 315 of the received data analyzing means 314 determines the coding method and coding parameter of the video data 16 passed from the media multiplexing / demultiplexing 19, and selects one of the corresponding decoding means 310, 311 and 312. The crab encoded data 104 is passed (arrow (4) in FIG. 5). Here, as shown in FIG. 2, the video data 16 passed from the media demultiplexer 19 includes encoded data 104 (n bytes) and an encoding scheme representing an encoding scheme added before the encoded data 104. It consists of information 101 (1 byte) and coding parameter information 102 (2 bytes) representing a coding parameter. That is, information indicating the coding method and coding parameters of the received coded data is added to the head of the coded data.

The decoding type selection means 315 of the reception data analysis means 314
1 and the encoding parameter information 102 as information relating to the encoding, a decoding means for decoding the encoded data 104 of the video data 106 is selected based on the information relating to the encoding, and the encoded data 104 is transmitted to the selected decoding means.
give.

Of the decoding means 310, 311 and 312, the decoding type selecting means 31 of the reception data analyzing means 314
The encoding means that has been selected and passed the encoded data 104 decodes the passed encoded data 104,
The video is displayed on the monitor 320.

In the above description, the data separated by the media demultiplexer 19 is video data. If the data separated by the media demultiplexer 19 is audio data, the data is sent to the decoding means 313. , The decoded voice is generated through the speaker 321.

As described above, according to the third embodiment, based on the encoding method and the encoding parameters represented by the encoding method information 101 and the encoding parameter information 102, which are information relating to the encoding of video data. hand,
Since the decoding means for decoding the encoded data of the video data is selected, an effect is obtained that the video data 16 encoded by a plurality of encoding methods can be decoded and displayed in real time.

According to the third embodiment, information indicating the coding method and coding parameter of the received coded data is added to the head of the coded data.
An advantage is obtained in that information about coding is obtained before decoding the coded data, and the coded data can be received with optimal image quality.

In the third embodiment, a case has been described where three encoding means are used simultaneously for video. However, two encoding means or four or more encoding means are used simultaneously. The same processing is possible. The same processing can be performed on audio.

Embodiment 4 FIG. 6 is a block diagram showing a configuration of a multimedia communication terminal device according to Embodiment 4 of the present invention. 1 and FIG. 5 indicate the same or corresponding parts, and a description thereof will not be repeated. In FIG. 6, reference numeral 330 denotes decoding setting means for storing the coding method and coding parameter received from the multimedia communication control protocol 18 and the corresponding type number, and 331 the coding method stored in the decoding setting means 330. With reference to the correspondence between the encoding parameter and the type number, a decoding method for the encoding method and the encoding parameter corresponding to the type number is selected, and the encoded data 104 of the video data 16 received from the media demultiplexer 19 is converted. This is a decoding number selection means for selecting and passing it to the decoding means. The decryption setting means 330 and the decryption number selecting means 331 make the received data analyzing means 314
Is configured.

Next, the operation will be described. The fourth embodiment is similar to the fourth embodiment except that the reception data analyzing unit 314 includes a decoding number selecting unit 331 and a decoding setting unit 330.
The configuration is the same as that of the third embodiment. Therefore, the following description focuses on differences in operation due to this difference in configuration.

When the communication line 50 is opened and the transmission of digital data becomes possible (arrow (1) in FIG. 6), the multimedia communication control protocol 18 notifies the other terminal of the transmission of voice and video. When the demultiplexing parameter is determined and the setting content is set in the media demultiplexing unit 19 by the terminal control unit 3 (arrow (2) in FIG. 5),
The media multiplexing / demultiplexing device 19 is set in a receivable state, and information indicating the correspondence between the encoding method and the encoding parameter and the assigned type number sent from the partner terminal is transmitted to the multimedia communication control protocol 18 is passed.

Multimedia communication control protocol 18
Transmits information indicating the correspondence between the encoding method and the encoding parameter and the assigned type number,
4 (arrow (6) in FIG. 6).
The decoding setting unit 330 stores information indicating the correspondence between the encoding method and the encoding parameter and the assigned type number.

When the information indicating the correspondence between the encoding method and the encoding parameter and the assigned type number is stored in the decoding setting means 330, the media demultiplexer 19 receives the video or audio data and The data is passed to the media receiving destination (arrow (3) in FIG. 6).

The decoding number selection means 331 of the reception data analysis means 314 includes the type number information 301 of the video data 16 passed from the media demultiplexer 19 and the decoding setting means 3
30 is compared with information indicating the correspondence between the encoding method and the encoding parameter stored in the storage unit 30 and the assigned type number,
The encoding method and the encoding parameter in which the encoded data 104 of the video data 16 are encoded are determined, and the encoded data 104 is transferred to any of the corresponding decoding units 310, 311 and 312 (arrow (4) in FIG. 6). )). Here, the video data 16 passed from the media demultiplexer 19 is
As shown in FIG. 4, encoded data 104 (n bytes)
And type number information 301 (1 byte) indicating a type number added before the encoded data 104. That is,
Type number information 301 indicating the received type number is added to the head of the encoded data 104.

The decoding type selection means 315 of the reception data analysis means 314 outputs the type number information 301 of the video data 16.
As information on the encoding, the information on the encoding is compared with information representing the correspondence between the encoding method and the encoding parameter stored in the decoding setting means 330 and the assigned type number, and the video data 106 A decoding unit for decoding the encoded data 104 is selected, and the encoded data 104 is passed to the selected decoding unit.

The operations of the decoding means 310, 311 and 312 and the monitor 320 are the same as those of the third embodiment, and the description is omitted. Also in the fourth embodiment, if the data separated by the media multiplexing / demultiplexing unit 19 is audio data, the audio data is sent to the decoding unit 313, and the decoded audio is emitted through the speaker 321.

As described above, according to the fourth embodiment, the decoding means used for decoding is selected based on the type number represented by the type number information 301 as information relating to the encoding of the video data 16. Therefore, the video data 16 encoded by a plurality of encoding schemes can be decoded and displayed in real time with a lower communication load than in the third embodiment, and displayed.

According to the fourth embodiment, type number information indicating a type number corresponding to a coding method and a coding parameter of received coded data is added to the head of coded data. Thus, it is possible to obtain information on encoding before decoding the encoded data and receive the encoded data with an optimum image quality.

In the fourth embodiment, 3
The case where two decoding means are used simultaneously has been described.
The same processing can be performed by simultaneously using three decoding units or four or more encoding units. The same processing can be performed on audio.

[0074]

As described above, according to the present invention, in a multimedia communication terminal apparatus, encoding is performed using a plurality of encoding means with different encoding schemes and encoding parameters, and one of them is encoded. By selecting the encoded data encoded by the means and adding information on the encoding of the selected encoded data to the encoded data, by selectively using a plurality of encoding means at the time of transmission, There is an effect that encoded data can be transmitted to the partner terminal device with an optimal image quality at the time of transmission.

According to the present invention, in the multimedia communication terminal device, the information representing the coding method and coding parameter of the selected coded data is added to the coded data, so that the other terminal has the optimum image quality at the time of transmission. There is an effect that encoded data can be transmitted to the device.

According to the present invention, in the multimedia communication terminal device, the type number corresponding to the selected coding method and coding parameter of the coded data is added to the coded data, so that the load during the call can be reduced. In this way, there is an effect that the encoded data can be transmitted to the partner terminal device with the optimal image quality at the time of transmission.

According to the present invention, in the multimedia communication terminal device, the information representing the coding method and the coding parameter of the selected coded data is added to the head of the coded data. There is an advantage that encoded information can be obtained before decoding data and encoded data can be received with optimal image quality.

According to the present invention, in the multimedia communication terminal apparatus, the information indicating the type of coding corresponding to the coding method and coding parameter of the selected coded data is added to the head of the coded data. The terminal device has an effect of obtaining information on encoding before decoding encoded data and receiving encoded data with optimum image quality.

According to the present invention, the decoding means for decoding the encoded data is selected based on the information on the encoding, so that the video data encoded by a plurality of encoding methods can be transmitted in real time at the time of reception. In addition, there is an effect that the image can be decoded and displayed or reproduced with the optimum image quality or sound quality.

According to the present invention, the decoding means for decoding the encoded data is selected based on the information indicating the encoding method and the encoding parameter which are the information relating to the encoding of the video data. There is an effect that video data encoded by a plurality of encoding methods can be decoded and displayed in real time.

According to the present invention, based on information indicating a type number as information relating to encoding of video data,
Since the decoding means used for decoding is selected, there is an effect that video data encoded by a plurality of encoding methods can be decoded and displayed in real time with a lower communication load.

According to the present invention, since the information indicating the encoding method and the encoding parameter of the received encoded data is added to the head of the encoded data, the encoded data is encoded before decoding. Thus, there is an effect that encoded information can be received with optimal image quality by obtaining information about

According to the present invention, since the information indicating the coding method and the type number corresponding to the coding parameter of the received coded data is added to the head of the coded data, the coded data is decoded. This is advantageous in that information on encoding can be obtained before the encoding, and encoded data can be received with optimal image quality.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of a multimedia communication terminal device according to a first embodiment of the present invention.

FIG. 2 is a configuration diagram of video data according to the first and third embodiments of the present invention.

FIG. 3 is a block diagram illustrating a configuration of a multimedia communication terminal device according to a second embodiment of the present invention.

FIG. 4 is a configuration diagram of video data according to Embodiments 2 and 4 of the present invention.

FIG. 5 is a block diagram showing a configuration of a multimedia communication terminal device according to Embodiment 3 of the present invention.

FIG. 6 is a block diagram illustrating a configuration of a multimedia communication terminal device according to a fourth embodiment of the present invention.

FIG. 7 is a block diagram showing a configuration of a conventional multimedia communication terminal device.

[Explanation of symbols]

1 CCD camera, 2 microphone, 3 terminal control unit, 10
Encoding means, 11 encoding means, 12 encoding means, 1
3 encoding means, 14 transmission data selection means, 15 transmission data generation means, 16 video data, 17 data type notification means, 18 multimedia communication control protocol, 19 media demultiplexing, 30 video signals, 32 audio signals, 33 selection results , 50 communication lines, 101 coding method information, 102 coding parameter information, 104
Encoded data, 104a encoded data, 104b encoded data, 104c encoded data, 105 encoded data, 201 encoding method notifying means, 202 type number notifying means, 301 type number information, 310 decoding means,
311 decoding means, 312 decoding means, 313 decoding means, 314 received data analysis means, 315 decoding type selection means, 320 monitor, 321 speaker, 330
Decoding setting means, 331 decoding number selecting means;

Claims (10)

[Claims] 1. A plurality of encoding means for encoding the same moving image; and transmission data selecting means for selecting any one of encoded data output from the encoding means as selected encoded data. Information on the encoding of the selected encoded data,
A multimedia communication device comprising: transmission data generation means for generating video data including the selected encoded data. 2. The information on encoding of the selected encoded data includes encoding method information indicating an encoding method and encoding parameter information indicating an encoding parameter. Data type notifying means for generating video data consisting of encoding method information indicating an encoding method of encoded data, encoding parameter information indicating an encoding parameter, and the selected encoded data. The multimedia communication device according to claim 1. 3. The information on the encoding of the selected encoded data includes type number information indicating a type number assigned to an encoding method and an encoding parameter. Encoding method notifying means for assigning a type number to the encoding parameter; type number information indicating the type number assigned to the encoding method and encoding parameter used for encoding the selected encoded data; 2. The multimedia communication apparatus according to claim 1, further comprising type number notifying means for generating video data including encoded data. 4. The multimedia communication apparatus according to claim 2, wherein the encoding system information and the encoding parameter information are added to the head of the selected encoded data. 5. The multimedia communication device according to claim 3, wherein the type number information is added to the head of the selected encoded data. 6. A plurality of decoding means for decoding the encoded data, and one of the plurality of decoding means is selected and selected according to information on encoding of video data received from a partner terminal device. A multimedia communication apparatus, comprising: reception data analysis means for passing encoded data of the video data to decoding means. 7. The information on encoding includes encoding method information indicating an encoding method and encoding parameter information indicating an encoding parameter. 7. The multimedia communication apparatus according to claim 6, further comprising decoding type selection means for selecting a decoding means according to the following. 8. The information relating to the encoding includes type number information indicating a type number corresponding to the encoding method and the encoding parameter, and the reception data analyzing means includes: Decoding setting means for storing information indicating the correspondence between the coding method and the coding parameter and the type number based on the coding parameter and the type number; and type number information of the video data stored in the decoding setting means. 7. The multimedia communication apparatus according to claim 6, further comprising decoding number selecting means for selecting a decoding means to be used for decoding by collating with information indicating correspondence. 9. The multimedia communication apparatus according to claim 7, wherein the video data comprises coded data, and coding scheme information and coding parameter information added to the head of the coded data. . 10. The multimedia communication apparatus according to claim 8, wherein the video data includes encoded data and type number information added to the head of the encoded data.