JP3350583B2 - Synchronized output of audio / image / text information - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for simultaneously sampling and reproducing real voice, reproducing moving image data, and writing characters.

[0002]

2. Description of the Related Art Conventionally, when a computer device performs data processing and classifies data from the viewpoint of presenting information to a user, the data is classified into voice data, image data, and character data. As a result of the improvement in processing capability, images can be played not only as still images but also as moving images, and audio can not only generate sound electronically, but also record and reproduce natural sounds such as real voice, The image quality is improved.

[0003] CD-ROM or LD-ROM
For example, by recording image data on a magneto-optical disk having an enormous data storage amount, it is possible to continuously reproduce moving images for a long time.

On the reproducing side, techniques for compressing and expanding audio data and image data have been improved, and processing can be performed at a high compression rate without impairing sound quality and image quality. The realization of a high compression ratio is attributable to the improvement of the compression and decompression circuit logic and the high precision of the compression and decompression processing by the improvement of computer processing capability.

[0005] The presentation of information is performed by outputting any one of voice, image, and character alone, or simultaneously outputting a combination of each. In the case of single output, the quality of the information to be presented and the presentation speed may be considered. In the case of simultaneous output in a plurality of presentation forms, such as audio and images, there is little relevance between the presentation forms that are simultaneously outputted, and there are those in which simply outputting at the same time is sufficient, and those in which the relevance is close and the synchronized output is preferable. . When closely related data cannot be created simultaneously, the tuned output becomes a problem.

As a typical example of the problem, there is a combination of image data in which a person speaks in a moving image called a so-called animation and voice data of a spoken voice such as a narration. By recording audio data in synchronization with a moving image, synchronized output can be achieved.

As another example, there is a combination of image data in which a person speaks in animation and character data indicating the contents of the story. The characters are displayed in units of image data blocks so that the corresponding character information is displayed in a necessary scene, or a series of characters are continuously displayed at an appropriate speed from the beginning of the scene, thereby simultaneously outputting the characters.

[0008]

As described above, in the conventional computer apparatus, various measures have been devised so that the output of a relatively small data size sound or character can be adjusted simultaneously for a moving image having a large data amount. Output is realized. However, the output adjustment of the character, display in block units,
Or, it is still insufficient enough to display continuously from the beginning of the scene.

[0009] In the case of combining speech voice data with a moving image, presentation of information content mainly depends on voice. There are no examples of simultaneous output of characters to video and spoken voice in computer devices, but simultaneous output of text to video and spoken voice as an aid to understanding for those who are presented with information or as a reliable information transmission method. It is effective to do. As seen in text multiplex broadcasting and the like, it is required to respond to hearing-impaired persons and to present information in two languages.

When a conventional computer device simultaneously outputs a moving image, a voice, and a character, the moving image and the voice can be synchronized, but the output adjustment of the character is insufficient. When the same information is presented by voice and text together with animated animation, it is used as information that can be reliably transmitted by dual presentation of auditory information, visual information, and audiovisual information, but the output adjustment of the text is insufficient. There is a problem due to this.

In the case where a character presents a spoken sentence, it is desired that the character and the moving image be integrated to form specific information. However, there is a possibility that the information cannot be grasped as integrated information. When used as audiovisually presented information, character information is not effectively used if the character is presented with a delay to the spoken voice, and voice information is enabled if the character is presented first to the spoken voice. Not available.

SUMMARY OF THE INVENTION It is an object of the present invention to obtain a computer device capable of synchronizing and outputting ternary information by voice, image, and character, and to effectively use composite information.

[0013]

In order to solve the above-mentioned problems, in the tuning output device of the present invention, a unit for reproducing audio data such as narration recorded for each scene of a moving image is prepared in advance as a reference unit. When the character data is displayed using the character data, a means for performing display control in units of characters or words in the reference unit is provided. For character data that is desired to be tuned to audio and video, character data created in advance with a specific character code is used. When character data of a specific character code is displayed for one unit such as one character, for example, means for repeating the process of animating and outputting image data corresponding to one unit until the end of the character data is provided.

As described above, by controlling the display of character data created in synchronization with the reproduction of audio data in units of characters or words for each audio data reproduction unit, the output of the audio data and character data can be performed. Synchronize. By controlling the animation processing of image data using the unit display amount of character data synchronized with the reproduction of audio data,
The output of image data is synchronized with the display of character data,
A device capable of synchronously outputting ternary information of audio data, character data, and image data is configured.

FIG. 1 is a flowchart for explaining an outline of an example of the operation of the tuning output device of the present invention. Text, voice,
A narration message is used when synchronizing output with a video is required.
Output as usual and exit. If the character data is a narration message, display of screen animation data is started, and then reproduction of audio data is started.
The reproduction of the audio data is continuously executed until the end of the data.

A flag is embedded in character data, which is a narration message, to indicate the display weight of the character data. When the wait processing is completed, a message is displayed. When the character data to be displayed is not ASCII characters, the animation processing, output and message display are not synchronized, and the display of character data is synchronized only with the reproduction of audio data. When the character data to be displayed is ASCII characters, for example, every time one ASCII character is displayed, the animation process is executed, so that the animation process can be executed by the character data output in synchronization with the voice. Since the adjustment is performed, synchronized output of image data, character data, and audio data becomes possible.

[0017]

As described above, in the tuning output device of the present invention, the character data created so as to synchronize with the sound reproduction is
By performing the display control in accordance with the audio output unit, the output of the audio data and the output of the character data are synchronized. By controlling the animation processing of the image data based on the unit display amount of the character data synchronized with the sound reproduction, the output of the image data is synchronized with the display of the character data, so that the sound data, character data, image data Is a device that can tune and output the three-way information. By forming composite information of audio data, character data, and image data, it is possible to provide an advanced audiovisual technique using a computer device. In particular, the synchronized output of the character data and the image data has an effect that the correspondence to the hearing impaired person can be expanded, or the synchronized output of the character data and the voice data can present information in two languages.

[Brief description of the drawings]

FIG. 1 is a flowchart illustrating an outline of an example of an operation of a tuning output device of the present invention.

────────────────────────────────────────────────── (5) Continuation of the front page (51) Int.Cl. ⁷ Identification symbol FI H04N5 / 91 H04N5 / 91Z (56) References JP-A-5-143708 (JP, A) JP-A-62-225875 ( JP, A) JP-A-4-38782 (JP, A) JP-A-5-284464 (JP, A) Tomio Mitsunaga Two other people, "Sound Synchronized Animation Generation System", Television Society Technical Report, Television John Society, May 20, 1993, Vol. 17, No. 28, p. 17-22 (58) Fields investigated (Int. Cl. ⁷ , DB name) G06T 13/00 G06T 11/60 G06T 11/80 G11B 20/00 H04N 5/91 CSDB (Japan Patent Office)

Claims (1)

(57) [Claims] 1. A computer device for processing and outputting data represented by voice, image, and character, which is previously recorded for each scene of a moving image, and a specific reproduction unit of the recorded voice data is used as a reference. Means for performing display control in units of characters or words for each reproduction unit of the audio data when processing and displaying character data created with character codes, each time character data with a specific character code is displayed for a certain unit , Video expansion processing of image data equivalent to a certain unit,
A method for synchronizing and outputting voice / image / character information, comprising means for repeating the output process as appropriate.