JP2002199300A - Image data transmission method, display method and image data transmitter - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image data transmission method and device that can prevent deterioration in the image quality due to a data error intruded through a transmission channel. SOLUTION: A recording means 107 records image data together with a recognition result of a voice recognition means 108 in advance, an image display means 111 displays an image received by a reception means 103, when the reception of the image data is stopped, the connection of a changeover means 109 is switched to the recording means 107 to select a displayed image among the images recorded in advance, thereby allowing the image display means 111 to consecutively display an image without a sense of incongruity with respect to an audio output.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a method and an apparatus for efficiently communicating image data, and a display method.

[0002]

2. Description of the Related Art Conventionally, image compression and encoding techniques such as MPEG include "Latest MPEG" issued by ASCII Publishing Bureau.
Textbook, page 12, FIG. 1-9,
It is known that compression based on intra-screen correlation, compression based on inter-screen correlation, and compression based on bias in code appearance probability are used.

FIG. 21 shows a basic configuration of a conventional image coding apparatus / image decoding apparatus. FIG. 21A shows a conventional image encoding apparatus, which comprises an image input terminal 2101, an information source encoding unit 2102, an entropy encoding unit 2103, and a compressed data output terminal 2104.

[0004] The image data input to the image input terminal 2101 is compressed by an information source coding means 2102 by intra-picture correlation by DCT and quantization, and by inter-picture correlation by motion compensation inter-frame predictive coding. Is performed, and compression is performed by the entropy coding unit 2103 by bias of the code appearance probability by variable length coding,
The compressed data is output from the compressed data output terminal 2104 as compressed data.

FIG. 21B shows a conventional image decoding apparatus, which comprises a compressed data input terminal 2105, an entropy decoding means 2106, an information source decoding means 2107, and an image output terminal 2108.

[0006] The compressed data input to the compressed data input terminal 2105 is subjected to variable-length decoding in the entropy decoding means 2106 to expand the compression due to the bias of the code appearance probability. Inverse quantization,
The compression is expanded by the intra-screen correlation by the inverse DCT and the compression is expanded by the inter-screen correlation by the motion-compensated inter-frame predictive decoding, and the expanded image data is output from the image output terminal 2108.

[0007] The image encoding apparatus shown in FIG.
Efficient transmission and storage are realized by using the image decoding device of (b) in combination.

[0008]

In the image compression coding technique, a data error occurs depending on a transmission line and a storage medium. The variable-length code used for compression based on the bias of the code appearance probability and the motion-compensated inter-frame prediction code used for compression based on the inter-screen correlation, which are used in the conventional image compression / expansion means, have errors in data. Is included, each has a characteristic that an error propagates to subsequent data, and causes serious deterioration of image quality. That is, when an error occurs, the variable-length code cannot correctly detect the boundaries of codewords during decoding, and cannot continue decoding even if there is no error in subsequent data. Further, in the motion compensation inter-frame prediction code, since an inter-frame difference is used as data to be transmitted, if there is an error in data to be transmitted, the effect remains in a subsequent frame, and the next intra-frame encoding is performed. The error propagates up to. SUMMARY OF THE INVENTION It is an object of the present invention to provide an image data transmission method / image data reception method and an image data communication system for preventing image quality deterioration due to data errors mixed into compressed data by a transmission path and a storage medium.

[0009]

In order to solve this problem, the present invention prepares a plurality of image data compressed in advance by a high-efficiency moving image coding method on the receiving side, and mixes data errors in a transmission path. Alternatively, when the transmission of image data from the transmission side is stopped, an image suitable for the audio data being received is selected from a plurality of image data compressed by the high-efficiency moving image coding method prepared in advance on the reception side, and the image is selected. Can be displayed without interruption.

[0010] Thus, it is possible to provide an image data transmission method, an image data reception method, and an image data communication system for preventing image quality deterioration due to data errors mixed in the transmission path.

[0011]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The invention according to claim 1 of the present invention is a method for communicating image data, in which image data received in advance is divided and recorded, and a plurality of image data are configured in advance. Thus, the image data communication method is characterized in that the image data currently being received and the image data selected from a plurality of image data recorded in advance are switched and displayed. Even if the operation is stopped, the present invention has an effect of providing a method of continuously displaying images by selecting an image to be displayed from a plurality of images recorded in advance. The invention according to claim 2 of the present invention is a method of dividing and recording image data received in advance, by dividing each received syllable of audio data simultaneously, and recording the image data and audio data at that time. 2. The image data communication method according to claim 1, wherein a plurality of image data are configured in advance, even if reception of the image data is stopped, an image that does not cause a sense of discomfort to the received audio data. Has the effect of providing

According to a third aspect of the present invention, as a method of dividing and recording received image data in advance, the received image data is divided into words at the same time, and the image data and the audio data at that time are recorded. The image data communication method according to claim 1, wherein a plurality of image data are pre-configured, and even if reception of the image data is stopped, an image that does not cause a sense of discomfort to the received audio data can be obtained. This has the effect of providing a display method.

According to a fourth aspect of the present invention, as a method of dividing and recording image data received in advance, the image data and the audio data at that time are recorded by dividing the received audio data into silent portions. By doing
2. The image data communication method according to claim 1, wherein a plurality of image data are configured in advance, even if reception of the image data is stopped, an image that does not cause a sense of discomfort to the received audio data. Has the effect of providing

According to a fifth aspect of the present invention, as a method for dividing and recording image data received in advance, a plurality of image data and audio data are recorded by dividing the image data at predetermined time intervals T and recording the data at that time. 2. The image data communication method according to claim 1, wherein the image data is configured beforehand even if the reception of the image data is stopped. It has the effect of providing.

According to a sixth aspect of the present invention, when recording image data, identification information determined on the receiving side is recorded together instead of audio data. The image data communication method described above has an effect of providing a method of displaying an image that does not cause a sense of discomfort to received audio data even when reception of image data is stopped.

According to a seventh aspect of the present invention, as a method of dividing and recording image data received in advance, image data and image data are added to the divided data on the transmitting side in accordance with the divided data. 2. The image data communication method according to claim 1, wherein a plurality of image data are pre-configured by recording the transmitted identification information. This has the effect of providing a method of displaying an image that does not cause discomfort to the data.

[0017] The invention according to claim 8 of the present invention is a method of selecting image data from a plurality of prerecorded image data, wherein the received voice data and prerecorded voice data are recognized by voice recognition. 6. The image data communication method according to claim 2, wherein the image data recorded together with the closest audio data is selected. Also, the method has an effect of providing a method of displaying an image that does not cause discomfort to received audio data.

According to a ninth aspect of the present invention, as a method of selecting image data from a plurality of image data recorded in advance, the receiving side determines the identification information by voice recognition, 8. The image data communication method according to claim 6, further comprising: selecting image data recorded together with the received audio data even if reception of the image data is stopped. This has the effect of providing a display method.

According to a tenth aspect of the present invention, as a method of selecting image data from a plurality of image data recorded in advance, identification information sent from a transmitting side is used, and the identification information is used together with the identification information. 8. The image data communication method according to claim 6, wherein recorded image data is selected, and even if reception of the image data is stopped, an image that is not uncomfortable with the received audio data is displayed. It has the effect of providing a method for performing

According to an eleventh aspect of the present invention, there is provided a method for switching between currently received image data and image data selected from a plurality of image data recorded in advance. 2. The image data communication method according to claim 1, wherein the presence / absence of data is used, and a method is provided for displaying an image that does not cause discomfort to received audio data even when reception of image data is stopped. It has the action of:

According to a twelfth aspect of the present invention, error detection is used as a method of switching between currently received image data and image data selected from a plurality of image data recorded in advance. The image data communication method according to claim 1, wherein even if reception of the image data is stopped, a method of displaying an image that does not cause discomfort to the received audio data is provided.

According to a thirteenth aspect of the present invention, there is provided a method for transmitting image data, comprising: preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a transmission side; The image data transmission method is characterized in that image data to be transmitted is selected from among the image data of the image data, and is multiplexed with the audio data together with the identification information of the image data and transmitted. This has the effect of providing a method of transmitting image data.

According to a fourteenth aspect of the present invention, as a method for selecting image data to be transmitted, at least one of a voice presence, a voice recognition result, a user recognition result, and a transmission destination is used. The image data transmission method according to claim 13 has the effect of providing a method of transmitting image data that enables display of image data without a sense of incongruity on the receiving side.

According to a fifteenth aspect of the present invention, the presence or absence of a voice, a voice recognition result,
14. The image data transmission method according to claim 13, wherein, as a result of the user recognition, one or more transmission destinations are used. This has the effect of providing a transmission method.

According to a sixteenth aspect of the present invention, there is provided image data obtained by compressing a currently input image by a high-efficiency moving image coding method and image data selected from a plurality of image data prepared in advance. 14. The image data transmitting method according to claim 13, wherein the image data is multiplexed with the audio data together with the identification information of the image data and transmitted. Has an effect of providing a transmission method.

According to a seventeenth aspect of the present invention, the multiplexing of the image data is adaptively controlled, and only the identification information of the image data is multiplexed with the audio data and transmitted. The data transmission method has an effect of providing a method of transmitting image data that enables display of image data without a sense of incongruity on the receiving side.

An invention according to claim 18 of the present invention is a method of transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a storage medium connected to a network. Then, at the source of the voice data, two or more voices, voice recognition results, user recognition results, destinations, or two or more voices, voice recognition results, user recognition results, and destinations are combined. Using things,
A data transmission method characterized by selecting image data to be transmitted to a receiving side from a plurality of image data prepared in the storage medium, and multiplexing the image data with image data identification information and audio data. This has the effect of providing a method of transmitting image data that enables display of image data without a sense of discomfort.

The invention according to claim 19 of the present invention relates to a method for transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a storage medium connected to a network. Then, at the source of the voice data, two or more voices, voice recognition results, user recognition results, destinations, or two or more voices, voice recognition results, user recognition results, and destinations are combined. Using things,
An image data transmission method comprising: selecting image data to be transmitted to a reception side from a plurality of image data prepared in the storage medium; multiplexing the image data with image data identification information and audio data; Therefore, the present invention has an effect of providing a method of transmitting image data which enables display of image data without a sense of discomfort.

The invention according to claim 20 of the present invention is a method for transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a storage medium connected to a network. Then, at the source of the voice data, two or more voices, voice recognition results, user recognition results, destinations, or two or more voices, voice recognition results, user recognition results, and destinations are combined. Using things,
Image data to be transmitted to the receiving side is selected from the plurality of image data prepared in the storage medium, and is directly transmitted from the storage medium to the receiving side. The source of the audio data includes the identification information of the image data and the audio data. Is transmitted in a multiplexed manner, and has an effect of providing a method of transmitting image data that enables display of image data without a sense of incongruity on the receiving side.

According to a twenty-first aspect of the present invention, there is provided the image data transmitting method according to the thirteenth aspect, wherein the multiplexed data is transmitted with an error detection code added thereto. Has a function of providing a method of transmitting image data which enables display of the image data.

The invention according to claim 22 of the present invention comprises a combination of the data transmission method according to any one of claims 13 to 20 and the image data communication method according to any one of claims 1 to 11. The data communication method according to the present invention has an effect of providing a method of communicating an image without a sense of incompatibility with received audio data even when reception of image data is stopped.

According to a twenty-third aspect of the present invention, there is provided a data communication method comprising a combination of the data transmission method according to the twenty-first aspect and the image data communication method according to the twelfth aspect,
Even if a data error is mixed in the communication path, the present invention has an effect of providing a method of communicating an image without a sense of discomfort to received audio data.

According to a twenty-fourth aspect of the present invention, there is provided a communication apparatus for image data, comprising: a receiving unit for receiving data; a separating unit for separating the received data into image data and audio data; Audio decoding means for decoding the divided audio data, dividing means for dividing the separated image data, recording means for recording the image data divided by the dividing means and image data identification information outputted by the sound recognizing means, Voice recognition means for controlling the division timing of the means and selection of image data recorded in the recording means, image data output by the separation means, switching means for switching the image data output by the recording means, and switching means Image decoding means for decoding the image data to be output, image display means for displaying the image output by the image decoding means, and outputting the decoded audio data An image data communication device characterized in that the image data communication device is configured to include an audio output unit. To provide a device for displaying images.

According to a twenty-fifth aspect of the present invention, by adding division control means, audio data is recorded instead of image data identification information as information to be recorded together with image data in the recording means. 3. The method according to claim 2, wherein
4. The image data communication device according to 4, wherein even if reception of image data is stopped, an image display device is provided that continuously displays images by selecting an image to be displayed from a plurality of images recorded in advance. Has an action.

According to a twenty-sixth aspect of the present invention, there is provided a communication apparatus for image data, comprising: a receiving unit for receiving data; and separating the received data into image data, image data identification information, and audio data. Separating means, an audio decoding means for decoding the separated audio data, a dividing means for dividing the image data and the image data identification information, a recording means for recording the divided image data and the image data identification information,
Selecting means for selecting image data recorded in the recording means,
Switching means for switching image data output by the separation means, image data output by the recording means, image decoding means for decoding image data output by the switching means, and decoded image output by the image decoding means An image data communication device comprising: an image display unit for displaying data; and an audio output unit for outputting decoded audio data. By selecting an image to be displayed from a plurality of recorded images, an effect is provided of providing an apparatus for continuously displaying images.

According to a twenty-seventh aspect of the present invention, there is provided an image data communication apparatus in which error detecting means is added to the configuration of the image data communication apparatus according to any one of the twenty-fourth to twenty-fourth aspects. Even if is mixed, by selecting an image to be displayed from a plurality of images recorded in advance,
This has the effect of providing a device for continuously displaying images.

According to a twenty-eighth aspect of the present invention, there is provided an image data communication apparatus in which a network connection means is added to the configuration of the image data communication apparatus according to the twenty-seventh aspect, wherein a plurality of images recorded in advance are selected. By selecting an image to be displayed, there is provided an operation of providing a device for continuously displaying images.

According to a twenty-ninth aspect of the present invention, there is provided an image data communication apparatus, comprising: a receiving unit for receiving audio data; an audio decoding unit for decoding received audio data; Network connection means, recording means for recording image data and image data identification information sent from the network, voice recognition means for controlling selection of image data recorded in the recording means, and images outputted by the recording means An image characterized by comprising image decoding means for image decoding data, image display means for displaying an image output by the image decoding means, and audio output means for outputting decoded audio data. An operation of providing a device for continuously displaying images by selecting an image to be displayed from a plurality of images recorded in advance in a data communication device. A.

According to a thirtieth aspect of the present invention, there is provided an image data transmitting apparatus, comprising: an audio input unit; a recording unit for recording a plurality of image data and image data identification information in advance; And voice data encoding means for encoding a voice, and selecting image data to be transmitted from a plurality of image data recorded in the recording means according to the image data identification information output by the voice recognition means. An image data transmitting apparatus comprising: image data selecting means; multiplexing means for multiplexing selected image data, image data identification information and audio data; and transmitting means for transmitting multiplexed data. Therefore, the present invention has an effect of providing an image data transmitting apparatus which can display image data without a sense of incongruity on the receiving side.

According to a thirty-first aspect of the present invention, there is provided an image data transmitting apparatus according to the thirty-third aspect, further comprising:
An image data transmitting apparatus characterized by adding image compression means for compressing an input image, and switching means for switching between image data output from a recording means and image data output from an image compression means, wherein image data which does not cause any discomfort on the receiving side is provided. Has an effect of providing an image data transmitting device capable of displaying the image data.

According to a thirty-second aspect of the present invention, there is provided an apparatus according to the thirty-first or thirty-first aspect, further comprising a network connection means, wherein image data to be recorded in the recording means is fetched from an external device connected to the network. The image data transmitting apparatus described above has an effect of providing an image data transmitting apparatus that enables display of image data without a sense of incongruity on the receiving side.

According to a thirty-third aspect of the present invention, the recording means is provided not in the image data transmitting apparatus but in an external apparatus connected by a network. The transmitting device has an effect of providing an image data transmitting device that can display image data without a sense of incongruity on the receiving side.

According to a thirty-fourth aspect of the present invention, in the image data transmitting apparatus according to any one of the thirty to thirty-third aspects, an error detection code adding means for adding an error detection code to multiplexed data is added. 34. The method according to claim 30, wherein:
The image data transmitting apparatus according to any one of the above, has an effect of providing an image data transmitting apparatus capable of displaying image data without a sense of incongruity on the receiving side.

According to a thirty-fifth aspect of the present invention, a plurality of compressed image data and image data identification information corresponding to the image data are stored and stored based on the image data identification information corresponding to the image data. An image storage device characterized in that the image data is output, and even if reception of the image data is stopped, the image storage device has an effect of providing an image that does not cause a sense of discomfort to the received audio data.

According to a thirty-sixth aspect of the present invention, there is provided a combination of the data transmitting device according to any one of the thirty to thirty-third aspects and the image data communication device according to any one of the twenty-fourth to twenty-sixth aspects. In such an image data communication system, there is provided an operation of providing a system for performing efficient image data communication.

According to a thirty-seventh aspect of the present invention, a data transmitting apparatus according to any one of the thirty to thirty-third aspects comprises:
An image data communication system configured by a combination of the image storage device according to claim 35 and the image data communication device according to any one of claims 24 to 26, providing an efficient system for performing image data communication. Having.

According to a thirty-eighth aspect of the present invention, there is provided an image data communication system comprising a combination of the data transmission device according to the thirty-fourth aspect and the image data communication device according to the twenty-seventh aspect. This has the effect of providing a system for continuously displaying images even when errors are mixed.

According to a thirty-ninth aspect of the present invention, an image comprising a combination of the data transmitting apparatus according to the thirty-fourth aspect, the image storage apparatus according to the thirty-fifth aspect, and the image data communication apparatus according to the twenty-seventh aspect. The data communication system has an effect of providing a system for continuously displaying images even when a data error is mixed in a communication path.

Hereinafter, an embodiment of the present invention will be described with reference to FIG.
This will be described with reference to FIG.

(Embodiment 1) FIG. 1 is a block diagram of an image data communication apparatus 101 according to Embodiment 1 of the present invention. The image data communication apparatus 101 shown in FIG.
02, receiving means 103, separating means 104, audio decoding means 105, dividing means 106, recording means 107, audio recognizing means 108, switching means 109, image decoding means 110,
It comprises an image display unit 111 and a sound output unit 112.

In the image data communication apparatus 101 shown in FIG. 1, data obtained by multiplexing image data and audio data is input from an input terminal 102 through a communication channel, and
3 to receive. The received multiplexed data is separated by the separating means 10.
In step 4, image data and audio data are separated. Separation means 1
04 is decoded by the audio decoding means 105 and the decoded audio data is output to the audio output means 11.
Output from 2.

On the other hand, the phoneme is recognized by the voice recognition means 108 using the decoded voice data, and the image data is divided by the dividing means 106 in accordance with the phoneme. The information is recorded in the recording means 107. By dividing and recording each phoneme, a plurality of image data corresponding to the phonemes are sequentially stored in the recording unit 107. The plurality of image data recorded in the recording unit 107 in advance are read out according to the phonemes recognized by the voice recognition unit 108. The image data read out from the recording means 107 in accordance with the phoneme is input to the switching means 109 together with the image data output from the separating means 104. If there is image data output from the separating means 104, the separating means 10
When there is no image data output by the separation unit 104 and the image data output by the separation unit 104, the switching unit 109 converts the image data read from the recording unit 107 by the image decoding unit 11.
Output to 0. The image decoding means 110 performs image decoding processing on the input image data, and the decoded image data is displayed on the image display means 111.

According to the configuration shown in FIG. 1, even if reception of image data is stopped, by selecting an image to be displayed from a plurality of images recorded in advance, images having no unnatural feeling with respect to audio output can be continuously output. And a device for displaying.

It should be noted that the voice recognition means 107 recognizes not a phoneme but a vowel, a syllable, a word, and the presence or absence of a voice, so that image data can be divided in units of a vowel, a syllable, a word, or a voice. good.

(Embodiment 2) FIG. 2 is a block diagram of an image data communication apparatus 201 according to Embodiment 2 of the present invention. The same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. The difference from the image data communication apparatus 101 shown in FIG. 1 is that a division control unit 202 is newly provided so that division by the division unit 106 is performed at fixed time intervals T. Then, the data to be recorded in the recording unit 107 is image data output by the separation unit 104 and decoded audio data output by the audio decoding unit 105.

With the configuration of FIG. 2, similar to the configuration of FIG.
Provided is a device for continuously displaying an image that does not cause a sense of discomfort to audio output by selecting an image to be displayed from a plurality of images recorded in advance even when reception of image data is stopped.

(Embodiment 3) FIG. 3 is a block diagram showing an image data communication apparatus 301 according to Embodiment 3 of the present invention. The same components as those in FIG. 1 are denoted by the same reference numerals, and description thereof is omitted. The difference from the image data communication apparatus 101 in FIG. 1 is that the data input to the input terminal 102 from the communication path is data in which image data, audio data, and image data identification information are multiplexed. Data, audio data, and image data identification information; and data divided by the dividing means 106 and recorded in the recording means 107 are image data and image data identification information output by the separating means 104; In addition, by newly providing the selection unit 302, selection of image data to be read from the recording unit 107 can be performed by the selection unit 302.
This is performed by checking the coincidence between the image data identification information output by the printer 04 and the image data identification information recorded in the recording means 107.

With the configuration of FIG. 3, similar to the configuration of FIG.
Provided is a device for continuously displaying an image that does not cause a sense of discomfort to audio output by selecting an image to be displayed from a plurality of images recorded in advance even when reception of image data is stopped.

The image data identification information includes one of phonemes, vowels, syllables, words, presence / absence of voice, speaker identification, and transmission source.
Use more than one.

(Embodiment 4) FIGS. 4, 5 and 6 show an image data communication apparatus 40 according to Embodiment 4 of the present invention.
1, 501, 601 are shown. 1, 2, and 3 are denoted by the same reference numerals, and description thereof is omitted. The difference between the image data transmitting apparatuses 101, 201, and 301 of FIGS. 1, 2 and 3 is that a new error detecting unit 401 is installed between the receiving unit 103 and the separating unit 104 and an error is detected. By outputting the data read from the recording means 107 by the switching means 109, even if a data error is mixed on the communication path, by selecting an image to be displayed from a plurality of images recorded in advance, the audio output can be performed. Provided is a device that continuously displays images that do not cause discomfort.

(Embodiment 5) FIGS. 7, 8 and 9 show an image data communication apparatus 70 according to Embodiment 5 of the present invention.
1 is a block diagram of an image receiving system composed of 1,801,901. 4, 5, and 6 are denoted by the same reference numerals, and description thereof is omitted. 4, 5 and 6 shown in FIG.
The difference is that a new network connection unit 702 is installed, a plurality of image data stored in advance in the recording unit 107 is read from the image storage device connected to the network 703, and the image data can be stored in the recording unit 107. It was done.

With the configuration shown in FIGS. 7, 8 and 9, even if image data is not sent from the communication channel, an image to be displayed is selected from a plurality of images recorded in advance through the network 703. This provides an apparatus that continuously displays images that do not cause a sense of discomfort to audio output.

(Embodiment 6) FIG. 10 is a block diagram of an image receiving system including an image data communication device 1001 according to Embodiment 6 of the present invention. The same components as those in FIG. 7 are denoted by the same reference numerals, and description thereof is omitted. The difference from the image data transmitting apparatus 701 in FIG.
4. Dividing means 106, switching means 109, error detecting means 4.
By omitting 02, even if image data is not received from the communication path, an image to be displayed can be selected from a plurality of images recorded through the network 703 in advance, so that an image that does not cause a sense of incongruity in audio output can be obtained. Is provided continuously.

(Embodiment 7) FIG. 11 is a block diagram of an image transmission system including an image data transmission device 1101 according to Embodiment 7 of the present invention. The image data transmitting apparatus 1101 shown in FIG. 11 includes an input terminal 1102, a network connection unit 1103, a recording unit 1104, a voice recognition unit 1105, a voice encoding unit 1106, and a multiplexing unit 11.
07, a transmission unit 1108, and an output terminal 1109. In the image data transmitting apparatus 1101 of FIG. 11, the recording unit 702 is transmitted from the image storage apparatus 1111 on the network via the network 1110 in advance.
Then, a plurality of image data and identification information of the image data are recorded. Audio data is input from an input terminal 1102, and audio data is encoded by an audio encoding unit 1106.

On the other hand, the voice data input from the input terminal 1102 is subjected to voice recognition by the voice recognition means 1105 to obtain image data identification information. As the image data identification information, one or more of phonemes, vowels, syllables, words, presence / absence of voice, speaker identification, and transmission source are used. Voice recognition means 11
The image data identification information obtained in step 05 is compared with the image data identification information recorded in the recording unit 1104 in advance, and the coincident image data is read from the recording unit 1104. The image data read from the recording unit 1104 is input to the multiplexing unit 1107 together with the image data identification information and the audio data encoded by the audio encoding unit 1106 and multiplexed. And output from the output terminal 1109.

By recording the image data to be transmitted in the recording unit 1104 in advance with the configuration shown in FIG. 11, it is possible to transmit image data that does not cause discomfort to audio data without inputting image data.

(Eighth Embodiment) FIG. 12 is a block diagram of an image transmission system including an image data transmission device 1201 according to an eighth embodiment of the present invention. The same components as those in FIG. 11 are denoted by the same reference numerals, and description thereof is omitted. FIG.
The difference from the first image data transmitting apparatus is that the image input terminal 12
02, the image encoding unit 1203, and the dividing unit 1204, the image input from the outside through the image input terminal 1202 is compressed by the image encoding unit 1203,
By dividing the compressed image data by the dividing unit 1204 according to the image data identification information obtained by the voice recognition unit 1105, a plurality of image data and the identification information of the image data are recorded in the recording unit 1104 in advance. And by providing the switching means 1205,
The image data input to the multiplexing unit 1107 can be switched between a real-time input image output from the image encoding unit 1203 and an image prepared in advance read from the recording unit 1104. The image data and the image data identification information to be recorded in the recording unit 1104 in advance may be data read from the image storage device 1111 on the network.

By switching between real-time image data and image data prepared in advance by the configuration shown in FIG. 12, when a real-time image is not suitable for transmission, such as an image in darkness, the image is prepared in advance. By transmitting the image data, it is possible to always transmit the image data that does not make the audio data uncomfortable.

(Embodiment 9) FIGS. 13 and 14 show
Image data transmitting apparatus 13 according to Embodiment 9 of the present invention
FIG. 1 shows a block diagram of an image data transmission system composed of an image data transmission system 01 and an image data 1401. The same components as those in FIG. 11 are denoted by the same reference numerals, and description thereof is omitted. The difference from the image data transmitting apparatus of FIG. 11 is that the image data transmitting apparatus does not have a recording unit inside, and
That is, the image storage device 1111 connected to the “0” is used as a recording unit.

With the configuration of FIGS. 13 and 14, image data transmitting apparatus 1301 and image data transmitting apparatus 140
1. The internal memory capacity can be reduced, and a plurality of image data transmitting devices 1301 and 140
1 can be used in parallel, images can be stored in one image storage device 1111 connected to the network 1110, so that efficient management and storage of image data can be performed.

(Embodiment 10) FIGS. 15, 16 and 1
7 and FIG. 18 show image data transmitting apparatuses 1501, 1601, 1701, and 180 according to Embodiment 10 of the present invention.
1 and image data transmitting devices 1501, 1601,
FIG. 1 shows a block diagram of an image data transmission system comprising 1701 and 1801. 11, 12, 13 and 1
The same reference numerals are given to the same portions as the respective portions of No. 4 and the description is omitted. Image data transmitting apparatuses 1501, 1601, 1701, 1801 shown in FIGS. 11, 12, 13 and 14
The difference is that the error detection code adding means 1502 is newly added.
By installing the multiplexing unit 1107 between the multiplexing unit 1107 and the transmitting unit 1108, error detection can be performed on the data receiving side. 15, 16, 17, and 1
The configuration of FIG. 8 enables error detection on the data receiving side.

(Embodiment 11) FIG. 19 is a block diagram of an image data communication system according to Embodiment 11 of the present invention. Image data transmitting devices 1101, 1201, 1
301, 1401, a communication path 1901, and image data communication apparatuses 101, 201, 301, and 1001. The image data transmitting devices 1101, 1201, 13
01, 1401, the image data communication device is 10
Any configuration among 1, 201, 301, and 1001 may be used.

According to the configuration of FIG. 19, even if image data is not transmitted from the image data transmitting apparatus, an image to be displayed can be selected from a plurality of images recorded in advance through the network 703, so that audio output can be reduced. Provided is a communication system for continuously displaying images without a sense of discomfort.

(Twelfth Embodiment) FIG. 20 is a block diagram of an image data communication system according to a twelfth embodiment of the present invention. Image data transmitting devices 1501, 1601, 1
701, 1801, a communication path 1901, and image data communication devices 401, 501, 601, 701, 801, 90
And 1. The image data transmitting device is 1501,
The image data communication devices of 1601, 1701, 1801 are 401, 501, 601, 701, 801, 9
01 may be used.

According to the configuration shown in FIG. 20, even if a data error is mixed on the communication path, by selecting an image to be displayed from among a plurality of images recorded in advance in the recording means 107, the user may feel uncomfortable with the audio output. Provided is a communication system that continuously displays images that do not exist.

[0076]

As described above, according to the present invention, even if the transmission of image data is stopped or a data error is mixed in a communication channel, an image that is not uncomfortable with the audio output is continuously displayed. An advantageous effect that a communication method and a communication system can be provided is obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image data communication device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of an image data communication device according to a second embodiment of the present invention.

FIG. 3 is a block diagram of an image data communication device according to a third embodiment of the present invention.

FIG. 4 is a block diagram of an image data communication device according to a fourth embodiment of the present invention.

FIG. 5 is a block diagram of another image data communication device according to the fourth embodiment of the present invention.

FIG. 6 is a block diagram of still another image data communication device according to the fourth embodiment of the present invention.

FIG. 7 is a block diagram of an image data communication device according to a fifth embodiment of the present invention.

FIG. 8 is a block diagram of another image data communication device according to the fifth embodiment of the present invention.

FIG. 9 is a block diagram of still another image data communication device according to the fifth embodiment of the present invention.

FIG. 10 is a block diagram of an image data communication device according to a sixth embodiment of the present invention.

FIG. 11 is a block diagram of an image data transmitting apparatus according to a seventh embodiment of the present invention.

FIG. 12 is a block diagram of an image data transmitting apparatus according to an eighth embodiment of the present invention.

FIG. 13 is a block diagram of an image data transmitting apparatus according to Embodiment 9 of the present invention.

FIG. 14 is a block diagram of an image data transmitting apparatus according to Embodiment 9 of the present invention.

FIG. 15 is a block diagram of an image data transmitting apparatus according to Embodiment 10 of the present invention.

FIG. 16 is a block diagram of another image data transmitting apparatus according to the tenth embodiment of the present invention.

FIG. 17 is a block diagram of still another image data transmitting apparatus according to the tenth embodiment of the present invention.

FIG. 18 is a block diagram of still another image data transmitting apparatus according to the tenth embodiment of the present invention.

FIG. 19 is a block diagram of an image data communication system according to Embodiment 11 of the present invention.

FIG. 20 is a block diagram of an image data communication system according to Embodiment 12 of the present invention.

FIG. 21 is a block diagram showing a configuration of a conventional image data communication system.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 101 Image data communication apparatus 102 Input terminal 103 Reception means 104 Separation means 105 Voice decoding means 106 Division means 107 Recording means 108 Voice recognition means 109 Switching means 110 Image decoding means 111 Image display means 112 Voice output means 201 Image data communication apparatus 202 Division control unit 301 Image data communication device 302 Selection unit 401 Image data communication device 402 Error detection unit 501 Image data communication device 601 Image data communication device 701 Image data communication device 702 Network connection unit 703 Network 704 Image storage device 801 Image data communication Apparatus 901 Image data communication apparatus 1001 Image data communication apparatus 1101 Image data transmission apparatus 1102 Input terminal 1103 Network connection means 1104 Recording means 110 Voice recognition means 1106 voice coding means 1107 multiplexing means 1108 transmission means 1109 output terminal 1110 network 1111 image storage device 1201 image data transmission device 1202 image input terminal 1203 image coding means 1204 division means 1205 switching means 1301 image data transmission device 1401 Image data transmitting device 1501 Image data transmitting device 1502 Error correction coding means 1601 Image data transmitting device 1701 Image data transmitting device 1801 Image data transmitting device 1901 Communication path

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5C025 AA29 BA25 BA27 CA03 DA01 DA10 5C053 FA27 GB11 GB14 GB22 GB26 GB29 JA01 KA04 KA08 LA06 LA15 5D015 KK01 5D045 AB26

Claims (39)

[Claims] 1. A method of displaying image data, comprising dividing and recording image data received in advance, and configuring a plurality of image data in advance, so that the currently received image data is And displaying the image data selected from a plurality of image data recorded in the image data. 2. A method of dividing and recording image data received in advance as a method of dividing a plurality of image data in advance by dividing the received image data into syllables and recording the image data and the audio data at that time. 2. The image data display method according to claim 1, wherein the method comprises: 3. A method of dividing and recording image data received in advance as a method of dividing a plurality of image data in advance by dividing each word of simultaneously received audio data and recording the image data and audio data at that time. 2. The image data display method according to claim 1, wherein the method comprises: 4. A method for dividing and recording image data received in advance, wherein a plurality of image data are pre-divided by dividing each simultaneously received audio data into silent portions and recording the image data and the audio data at that time. 2. The image data display method according to claim 1, wherein: 5. A method of dividing and recording image data received in advance is to form a plurality of image data in advance by dividing the image data at predetermined time intervals T and recording the image data and audio data at that time. The image data display method according to claim 1, wherein: 6. The image data display method according to claim 2, wherein, when the image data is recorded, identification information determined on the receiving side is recorded together instead of the audio data. 7. A method for dividing image data received in advance and recording the image data includes recording the image data and identification information transmitted along with the image data in accordance with the division obtained on the transmission side. 2. The image data display method according to claim 1, wherein a plurality of pieces of image data are configured in advance. 8. As a method for selecting image data from a plurality of image data recorded in advance, a voice recognition method is used.
The image data according to any one of claims 2 to 5, wherein the received audio data is compared with previously recorded audio data, and image data recorded together with the closest audio data is selected. Display method. 9. As a method for selecting image data from a plurality of image data recorded in advance, voice recognition
8. The image data display method according to claim 6, wherein identification information is determined on the receiving side, and image data recorded together with the identification information is selected. 10. A method of selecting image data from a plurality of image data recorded in advance, using identification information sent from a transmission side and selecting image data recorded together with the identification information. 7. The method according to claim 6, wherein
Or the image data display method according to 7. 11. A method for switching between currently received image data and image data selected from a plurality of image data recorded in advance by using presence / absence determination of received image data. 2. The image data display method according to claim 1, wherein: 12. An image according to claim 1, wherein error detection is used as a method for switching between currently received image data and image data selected from a plurality of image data recorded in advance. Data display method. 13. A method of transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a transmission side, and transmitting the image data from the plurality of prepared image data. And transmitting the multiplexed data together with the audio data together with the identification information of the image data. 14. A method for selecting image data to be transmitted includes presence / absence of voice, voice recognition result, user recognition result,
14. The image data transmission method according to claim 13, wherein one or more transmission destinations are used. 15. The image data transmission method according to claim 13, wherein at least one of the presence / absence of voice, a voice recognition result, a result of user recognition, and a transmission destination is used as the identification information of the image data. . 16. Switching between image data obtained by compressing a currently input image by a high-efficiency moving image encoding method and image data selected from a plurality of image data prepared in advance, and identifying information of the image data. 14. The image data transmission method according to claim 13, further comprising multiplexing and transmitting the audio data. 17. Adaptively controlling multiplexing of image data,
14. The image data transmission method according to claim 13, wherein only the identification information of the image data is multiplexed with the audio data and transmitted. 18. A method for transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a storage medium connected to a network, and Prepared in the storage medium using a combination of two or more of the presence / absence, voice recognition result, user recognition result, destination, or presence / absence of voice, voice recognition result, user recognition result, and destination. An image data transmission method characterized by selecting image data to be transmitted to a receiving side from a plurality of pieces of image data, and multiplexing the image data with image data identification information and audio data. 19. A method of transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method on a storage medium connected to a network, and Prepared in the storage medium using a combination of two or more of the presence / absence, voice recognition result, user recognition result, destination, or presence / absence of voice, voice recognition result, user recognition result, and destination. An image data transmission method, wherein image data to be transmitted to a receiving side is selected from a plurality of pieces of image data, and identification information of the image data and audio data are multiplexed and transmitted. 20. A method of transmitting image data, comprising preparing a plurality of image data compressed in advance by a high-efficiency moving image coding method in a storage medium connected to a network, and Prepared in the storage medium using a combination of two or more of the presence / absence, voice recognition result, user recognition result, destination, or presence / absence of voice, voice recognition result, user recognition result, and destination. The image data to be transmitted to the receiving side is selected from the plurality of pieces of image data, and the image data is transmitted directly from the storage medium to the receiving side. At the transmission source of the audio data, the identification information of the image data and the audio data are multiplexed. An image data transmission method characterized by transmitting. 21. The image data transmission method according to claim 13, wherein an error detection code is added to the multiplexed data and transmitted. 22. A data transmission method comprising a combination of the data transmission method according to any one of claims 13 to 20 and the image data display method according to any one of claims 1 to 11. 23. A data transmission method comprising a combination of the data transmission method according to claim 21 and the image data display method according to claim 12. 24. An image data communication device, comprising: receiving means for receiving data; separating means for separating received data into image data and audio data; and audio decoding for decoding the separated audio data. Means, dividing means for dividing the separated image data, recording means for recording the image data divided by the dividing means and image data identification information outputted by the voice recognition means, control of division timing of the dividing means and recording means. Voice recognition means for controlling selection of the recorded image data, image data output by the separation means, switching means for switching the image data output by the recording means, and image for decoding the image data output by the switching means Decoding means, image display means for displaying an image output by the image decoding means, and audio output means for outputting decoded audio data An image data communication device characterized by the above-mentioned. 25. The image according to claim 24, wherein the division control means adds audio data instead of the identification information of the image data as information to be recorded together with the image data in the recording means. Data communication device. 26. An image data communication device, comprising: a receiving unit for receiving data; a separating unit for separating the received data into image data, image data identification information, and audio data; Audio decoding means for decoding, dividing means for dividing image data and image data identification information, recording means for recording the divided image data and image data identification information, and selecting the image data recorded in the recording means Selecting means, image data output by the separating means, switching means for switching the image data output by the recording means, image decoding means for decoding the image data output by the switching means, and output by the image decoding means An image data communication device comprising: image display means for displaying decoded image data; and sound output means for outputting decoded sound data. Place. 27. An image data communication device comprising the configuration of the image data communication device according to claim 24 and an error detecting means. 28. An image data communication device comprising the configuration of the image data communication device according to claim 27 and a network connection means added. 29. An image data communication apparatus, comprising: a receiving unit for receiving audio data; an audio decoding unit for decoding received audio data; a network connection unit for connecting to a network; Recording means for recording received image data and image data identification information; voice recognition means for controlling selection of image data recorded in the recording means; and image decoding means for image decoding image data output by the recording means. And an image display means for displaying an image output by the image decoding means, and an audio output means for outputting decoded audio data. 30. An image data transmitting apparatus, comprising: a voice input unit; a recording unit for recording a plurality of image data and image data identification information in advance; a voice recognition unit for the input voice; Audio data encoding means, image data selecting means for selecting image data to be transmitted from a plurality of image data recorded in the recording means in accordance with image data identification information output from the speech recognition means, and a selected image An image data transmitting apparatus comprising: multiplexing means for multiplexing data, image data identification information, and audio data; and transmitting means for transmitting multiplexed data. 31. An image data transmitting apparatus according to claim 30, wherein said image input means, an image compressing means for compressing the input image, and a means for switching between image data output from said recording means and image data output from said image compressing means. An image data transmission device characterized by adding: 32. An apparatus according to claim 30, further comprising a network connection unit, wherein image data to be recorded in the recording unit is taken from an external device connected to the network.
Or the image data transmitting apparatus according to item 31. 33. The image data transmitting apparatus according to claim 32, wherein the recording means is provided not in the image data transmitting apparatus but in an external device connected by a network. 34. An image data transmitting apparatus according to claim 30, further comprising an error detection code adding means for adding an error detection code to the multiplexed data.
34. The image data transmitting device according to any one of claims 33. 35. A method comprising: storing a plurality of compressed image data and image data identification information corresponding to the image data; and outputting the stored image data based on the image data identification information corresponding to the image data. Image storage device. 36. An image data communication system comprising a combination of the data transmission device according to any one of claims 30 to 33 and the image data communication device according to any one of claims 24 to 26. 37. A combination of the data transmitting device according to any one of claims 30 to 33, the image storage device according to claim 35, and the image data communication device according to any one of claims 24 to 26. Image data communication system. 38. An image data communication system comprising a combination of the data transmission device according to claim 34 and the image data communication device according to claim 27. 39. The data transmission device according to claim 34,
An image data communication system comprising a combination of the image storage device according to claim 35 and the image data communication device according to claim 27.