JPH08205044A - Information service controller and information service control method - Google Patents

Abstract

PURPOSE: To control the reproduction output of a sub-video image according to the recognition result by recognizing the language of a voice signal through voice when service information recorded in a recording medium is reproduced in the controller having the reproduction function of the recording medium capable of recording the service information comprising a main video image, a sub-video image synchronous with the main video image and audio signals of plural channels. CONSTITUTION: A voice recognition section (RECO) 17 receives voice information reproduced and outputted from an audio signal output section 14e to recognize the classification of a language based on extraction of characteristic of utterance of a human voice signal or the like and provides the output of information being the result of kind recognition to a discrimination section (JUDGE) 18. Upon the receipt of the language classification recognition result from the voice recognition section (RECO) 17, the discrimination section (JUDGE) 18 controls the sub-picture decoder (SP-DEC) 14b of an MPEG decoder section (MPEG2-DEC) 14 to control the reproduction output of a caption.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention records, on both sides of a disk-shaped rotary recording medium, various information provided such as code-compressed video, sub-video, movie information including multi-channel audio, educational information, and photo albums. The present invention relates to an information provision control device and an information provision control method applied to a reproduction device in which a single disc or a disc pack that can be driven is used.

[0002]

2. Description of the Related Art In recent years, as a continuation of multimedia technology, various systems have been constructed in which a personal computer is interfaced with a large-capacity storage medium such as a CD-ROM, and information such as video and audio is fetched from the storage medium. It is popular.

Furthermore, recently, a high-density and large-capacity recording medium having a capacity of several times to several tens of times that of a CD-ROM has been developed. As an example, the double-sided recording system has a capacity close to 10 GB (gigabyte), and a maximum of 1
The technology of a large-capacity rotary recording medium having a transfer rate close to 0 MBpS (megabit / second) has been established.
By using this type of recording medium, for example, MPEG
With the two-system specification, it is possible to record / reproduce moving picture information on one side for two hours or more including sub-pictures and multiple audio channels. This type of large-capacity rotary recording medium is referred to as an SD disk here.

[0004]

On such a large-capacity rotary recording medium (SD disk), for example, one kind or a plurality of kinds of provided information consisting of a picture, a sub-picture synchronized with this picture, and audio of a plurality of channels are provided. When implementing a system for recording and reproducing and outputting arbitrary provided information by a reproduction player, how to effectively utilize each recording function of sub-picture, multi-channel audio, etc. is a major issue in terms of system function expandability. Becomes

The present invention has been made in view of the above circumstances,
In a system that has a playback function of a recording medium that can record main video and sub-video synchronized with the same video and information provided by multiple channels of audio, a recording function of sub-video, multi-channel audio, etc. that is synchronized with the main video. It is an object of the present invention to provide an information provision control device and an information provision control method capable of effectively utilizing system to expand system functions and usage applications.

Specifically, at the time of reproducing the provided information recorded on the recording medium, the language of the sound reproduced and outputted is recognized, and the result of the sound recognition is used as control information to control the reproduction output of video, sound and the like. It is an object of the present invention to provide an information provision control device and an information provision control method having a function of reflecting the above.

Further, at the time of reproducing the provided information recorded on the recording medium, the language of the reproduced and outputted voice is recognized by voice to generate coded character string information, and the character string information is used to generate index information. It is an object of the present invention to provide an information provision control device and an information provision control method having a function of creating and storing.

[0008]

SUMMARY OF THE INVENTION The present invention is an apparatus having a reproduction function of a recording medium capable of recording provided information by a main image, a sub image synchronized with the main image, and audio of a plurality of channels. It is characterized by comprising means for recognizing the language of the sound and means for controlling the reproduction output of the sub-picture according to the recognition result.

Further, the present invention is an apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound, and the language of the reproduced and outputted sound. And a means for controlling the sound reproduced and output according to the recognition result.

Further, the present invention is an apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of audio. It is characterized by comprising means for distinguishing a sound from a sound in another language, and means for reproducing and outputting a subtitle in a specific language by a sub-picture when a reproduced output sound in another language is identified.

Further, the present invention is an apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of audio, in a specific language reproduced and outputted. It is characterized by comprising means for discriminating between a voice and a voice in another language, and means for reproducing and outputting a plurality of sub-pictures including subtitles in a specific language when the reproduced output voice in another language is identified.

Further, the present invention is an apparatus having a reproduction function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and audio of a plurality of channels. And a means for reproducing and outputting a sound of a specific language recorded in another sound recording unit when the reproduced and output sound of the other language is identified. And

Further, according to the present invention, in a device having a reproducing function of a recording medium capable of recording provided information by a sub-video synchronized with the main video and the same video and a plurality of channels of audio, the audio is reproduced and output. And a unit for switching the reproduction scene when a specific voice is recognized.

Further, according to the present invention, in a device having a reproducing function of a recording medium capable of recording provided information by a sub-video synchronized with the main video and the same video and a plurality of channels of audio, the audio is reproduced and output. And a unit for performing multi-scene reproduction when a specific voice is recognized.

Further, the present invention recognizes the language of the reproduced and outputted sound at the time of reproducing the recording medium capable of recording the main image, the sub-image synchronized with the same image and the information provided by the plural channels of audio, An information provision control method for controlling the reproduction output of the sub-picture according to the voice recognition result is characterized.

Further, the present invention recognizes the language of the reproduced and outputted sound when reproducing the recording medium capable of recording the main image, the sub-image synchronized with the same image and the information provided by the plural channels of audio, It is characterized by an information provision control method for controlling a voice reproduced and output according to the result of the voice recognition.

Further, according to the present invention, in reproducing a recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by a plurality of channels of audio, the audio of a specific language reproduced and output and another language It is characterized by an information provision control method for reproducing and outputting a subtitle of a specific language by a sub-picture when a reproduction output sound of another language is identified.

Further, according to the present invention, when a recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by the voices of a plurality of channels, the voice of a specific language reproduced and output and another language are reproduced. And a reproduction output sound of another language are identified, and an information provision control method for reproducing and outputting a plurality of sub-pictures including subtitles of a specific language is characterized.

Further, according to the present invention, in reproducing a recording medium capable of recording information provided by a main image, a sub-image synchronized with the main image, and audio of a plurality of channels, the voice of a specific language reproduced and outputted and another language. And a reproduction output voice of another language are identified, an information provision control method for reproducing and outputting a voice of a specific language recorded in another voice recording unit is characterized.

Further, according to the present invention, when reproducing a recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by a plurality of channels of audio, a specific audio is recognized from the audio reproduced and output. However, it is characterized by an information provision control method for switching the reproduction scene when a specific voice is recognized.

Further, according to the present invention, when reproducing a recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by the voices of a plurality of channels, a specific voice is recognized from the reproduced and outputted voice. However, it is characterized by an information provision control method for performing multi-scene reproduction when a specific voice is recognized.

Further, according to the present invention, in a device having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound, the language of the reproduced and outputted sound. And a means for generating coded character string information, and a means for collecting the coded character string information in fixed time units and storing it as index information.

Further, the present invention is an apparatus having a reproducing function of a recording medium capable of recording provided information by a main image, a sub image synchronized with the same image, and audio of a plurality of channels. When the information is reproduced, a means for acquiring the frame number of the reproduction providing information, a means for recognizing the language of the reproduced and outputted voice and generating coded character string information, and a coded character string information It is characterized by comprising means for generating index information in association with the acquired frame number, and means for storing the generated index information.

Further, the present invention is an apparatus having a reproducing function of a recording medium capable of recording provided information by a main image, a sub image synchronized with the same image, and audio of a plurality of channels. When reproducing information, a means for collecting the provided information of the reproduction frame, a means for recognizing the language of the reproduced and output voice and generating coded character string information, and a method for applying the coded character string information It is characterized by comprising means for generating index information in association with the collection / providing information of the frame, and means for storing the generated index information.

Further, the present invention is an apparatus having a reproduction function of a recording medium capable of recording provided information by a main image, a sub-image synchronized with the same image, and audio of a plurality of channels. A means for acquiring the frame number of the reproduction provision information at the time of reproducing the information and collecting the provision information of the frame; and a means for recognizing the language of the reproduced and outputted voice and generating coded character string information. And a means for generating index information by associating the coded character string information with the acquired frame number and the collected provision information, and means for storing the generated index information. To do.

Further, according to the present invention, when the recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by a plurality of channels of voice is reproduced, the language of the reproduced and outputted voice is recognized. Generate coded string information,
The information provision control method is characterized in that the character string information is collected at a fixed time unit and stored as index information.

Further, according to the present invention, when reproducing a recording medium capable of recording the main image, the sub image synchronized with the main image, and the additional information by the audio of a plurality of channels, the frame number of the additional information is acquired and reproduced. The present invention is characterized by an information provision control method of recognizing a language of an output voice, generating coded character string information, and generating and storing index information by associating the character string information with a frame number.

Further, according to the present invention, when the recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by a plurality of channels of voice is reproduced, the language of the reproduced and outputted voice is recognized. Information provision control that generates coded character string information, collects the provision information of the corresponding frame, associates the coded character string information with the provision information of the corresponding frame, and generates and stores index information. Characterize the method.

Further, according to the present invention, when reproducing a recording medium capable of recording the main video, the sub-video synchronized with the same video, and the additional information by a plurality of channels of audio, the frame number of the additional information is acquired and reproduced. Generates coded character string information by recognizing the language of the output voice, collects frame provision information, and then encodes the coded character string information, the acquired frame number, and the collected provision information. A feature is an information provision control method for generating and storing index information in association with each other.

[0030]

When the provided information recorded on the recording medium is reproduced, the language of the reproduced and outputted sound is recognized, and the result of the recognition is used as control information to control the reproduction output of the main video, sub-video, audio, etc. By having a function to reflect the information in the reproduced information, for example, the content of the reproduced information reproduced can be surely and accurately transmitted, and the communication function and the usage can be expanded. Especially, the information transmission function when reproducing the information provided in multiple languages is improved. Also, the applications can be expanded.

Further, at the time of reproducing the provided information recorded on the recording medium, the language of the reproduced voice is recognized by voice to generate coded character string information, and the index information is used by using the character string information. By having the function of creating and storing the sub-image, it is possible to create and store the index information from the subtitle information of the sub-picture. By referring to the index information, it is possible to easily perform various operations such as search for an impression scene, scene sequence search, and story summary in the provided information such as a movie, and to effectively use the subtitle information.

[0032]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the hardware configuration of a system according to the first embodiment of the present invention.

In FIG. 1, reference numeral 10 indicates both sides of the disk (A side 10a and B side 10b) for long-time provision information such as movie information.
It is a high-capacity rotary recording medium (referred to as an SD disc) in which high-density recording is performed, in which long-time video information is variable-speed coded and recorded. Examples of this long-time video information include sub-video (sub-picture) synchronized with the main video and audio of multiple channels, such as movie information with subtitles / multi-channel audio, educational information, photo albums, etc. Can be listed in.

Reference numeral 11 denotes a CPU which controls the entire system, and here, in accordance with the information provision control program (PCP) stored in the main memory (MEM) 15, a caption control process by voice recognition as shown in FIG. Alternatively, an index creating process by voice recognition as shown in FIG. 4) is executed.

Reference numeral 12 is a media drive controller (MDC) for controlling the drive of the SD disk 10, and C
Under the control of the PU 11, the media drive unit (M
DU) 13 is drive-controlled. The media drive controller (MDC) 12 has data read (picked up) from the media drive unit (MDU) 13 (variable data transfer rate by variable speed encoding processing of MPEG2, for example, synchronized with main video). A buffer (BUF) for sequentially storing a predetermined amount of movie information including sub-pictures and audio of a plurality of channels is provided.

Reference numeral 13 denotes a media drive unit (MDU) that drives the SD disk 10. Under the control of the media drive controller (MDC) 12, the SD disk 10 placed on the turntable 13a is rotationally driven and controlled to drive SD. The information recorded on the disk 10 is read by the pickup 13b, and is converted into a digital data string (MPEG2 stream) of a predetermined format at a high transfer rate at a media drive controller (MD).
C) It outputs to the MPEG decoder part (MPEG2-DEC) 14 via the buffer (BUF) of 12.

Reference numeral 14 denotes an MP read from the media drive unit (MDU) 13 under the control of the CPU 11.
The data string of the EG2 stream is input via a buffer (BUF) in the media drive controller (MDC) 12 and separated into a main video, a sub video (for example, subtitles) synchronized with the main video, and audio of multiple channels. A video decoder (VD-DEC) 14a that decodes the main video and a sub-picture decoder (SP-) that decodes the main video. DEC) 1
4b, an audio decoder (AU-DEC) 14c for decoding audio information, and a video decoder (VD-D).
A video signal output unit (MUX) 14d for synthesizing the main video separated and expanded by the EC) 14a with the sub video separated and expanded by the sub-picture decoder (SP-DEC) 14b, and outputting as a video signal (for example, NTSC signal); The audio decoder (AU-DEC) 14c is provided with an audio signal output control section 14e for outputting the audio information expanded as an analog audio signal.

Reference numeral 15 denotes a main memory (MEM) provided with a control program storage area, an application program storage area, a work area, etc. Here, a caption control processing routine by voice recognition as shown in FIG. 2 and FIG. 4 are shown. An information provision control program (PCP) having such an index creation processing routine by voice recognition and an index screen creation processing routine for displaying and outputting the saved index information in a list format is stored. Further, the battery-backed non-volatile storage area is provided with an index table storage unit (INDEX-TBL) 15a for storing and managing index information created by executing the index creation processing routine, and under the control of the CPU 11. Index information is written.

Reference numeral 16 denotes a user interface unit (User I / F) having a key operation unit (KB) and a display unit, which is used here for inputting a frame number, displaying and outputting an index table, and the like.

Reference numeral 17 is a voice recognition unit (RECO) for recognizing the language of the reproduced and outputted voice to generate coded character string information, and an MPEG decoder unit (MPEG2).
-DEC) The audio information output from the audio signal output unit 14e of the DEC 14 is input to recognize the type of language (for example, Japanese, English, French, etc.) from the extraction of pronunciation features of human voice, and it is a specific language. At this time, words such as conversation are recognized by speech by extracting characteristic sounds of the language, and codes of character strings according to the pronunciation order of the words are generated. In this case, the information of the language type recognition result is used in the first embodiment, and the code of the character string according to the pronunciation order of the words is used in the second embodiment.

Reference numeral 18 receives the information of the language type recognition result obtained from the voice recognition unit (RECO) 17, and according to the contents, the MPEG decoder unit (MPEG2-DEC) 1
4 is a determination unit (JUDGE) that controls the sub-picture decoder (SP-DEC) 14b of No. 4 and here, a word other than Japanese is reproduced and output from the information of the type recognition result output from the voice recognition unit (RECO) 17. It is detected that the sub-picture decoder (SP-DE
C) Trigger 14b to control playback output of the sub-picture of Japanese subtitles.

Reference numeral 21 denotes an MPEG decoder section (MPEG2-
DEC) is a display device (DISP) that receives and outputs an NTSC signal output from the DEC 14
Is also an MPEG decoder unit (MPEG2-DEC) 1
4 is an audio output unit that receives an analog audio signal output from the audio output unit 4 and outputs an audio (audible sound) synchronized with a reproduced image.

FIG. 2 is a flow chart showing a subtitle control processing routine by voice recognition in the first embodiment of the present invention. FIG. 3 is a block diagram showing the hardware configuration of the system according to the second embodiment of the present invention. The same parts as those of the first embodiment shown in FIG. 1 are designated by the same reference numerals and the description thereof will be omitted.

The feature of the second embodiment is that the voice recognition unit (R
ECO) 17 is used to create and store an index using a character string code, and the index can be displayed and output.

In FIG. 3, 19 is an I / O register (FRAME) under the control of the CPU 11 for temporarily latching the frame number at the time of the current reproduction. 20 is character string information generated by the voice recognition unit (RECO) 17;
An index creation unit (INDEX-GE) that creates a fixed form of index information by associating a character code string of a subtitle with a frame number based on the frame number latched in the I / O register (FRAME) 18.
N). This index creation unit (INDEX-G
EN) 19 is the index information created by the CPU 11
Index table storage (INDE
X-TBL) 15a.

Reference numeral 23 is a display memory (VM) in which display screen data is expanded under the control of the CPU 11.
Here, the index table storage unit (INDEX-T
The index information according to the content of (BL) 15a is expanded in a fixed list format.

24 is an MPEG under the control of the CPU 11.
A display control unit (DISP-CONT) that selects the NTSC signal output from the decoder unit (MPEG2-DEC) 14 or the display data of the display memory (VM) 23 and controls the display output to the display device (DISP) 21. is there.

FIG. 4 is a flow chart showing an index creation processing routine by voice recognition in the second embodiment of the present invention. FIG. 5 is a diagram showing an example of a recording format of movie information recorded on the SD disk 10, which is MPEG.
The data transfer rate is made variable by the variable speed encoding process of No. 2. Therefore, moving image data, that is, MPEG2
Since the amount of information to be recorded / reproduced per unit time can be made different for the above video, high quality moving image reproduction can be performed by increasing the transfer rate for a scene with a lot of movement.

As shown in FIG. 5, one piece of movie information is composed of a file management information section and a data section, and the data section has a large number of data blocks (block # 0).
~ # N) are included. D at the beginning of each data block
There is SI (Disk Serh Information) pack and DSI
One data block is from the pack to the next DSI pack. The storage location of each DSI pack is managed by the disc search map information in the file management information section.

One data block constitutes information required to be reproduced in a certain fixed time (for example, about 1/2 second), and a large number of video packs (VIDEO).
Pack), a sub-picture pack (SP pack), and an audio pack (AUDIO pack).
The data size of these packs is fixed, but the number of packs that can be included in one data block is variable. Therefore, a larger number of video packs are included in a data block corresponding to a scene with a lot of motion.

The video pack, sub-picture pack, and audio pack each include a header part and a packet part (video packet, sub-picture packet, audio packet). The packet part is the encoded data itself.

The header portion is composed of a pack header, a system header, and a packet header. A stream ID indicating whether the corresponding packet is a video packet, subpicture packet, or audio packet is registered in the packet header. Has been done.

The operation of the embodiment of the present invention will be described below with reference to the drawings. First, the operation of the first embodiment of the present invention will be described with reference to FIGS. Turntable 1 of media drive unit (MDU) 13
The SD disc 10 in which a plurality of types of providing information (for example, movie information with subtitles) is recorded in the format as shown in FIG.
When the movie information is selected by the key operation of I / F) 16 and the reproduction is started, the SD disc 1 is controlled under the control of the CPU 11.
Playback of the movie information selected and designated from 0 is started. During this reproduction, the MPEG decoder section (MPEG2
Audio information is decoded and output from the audio signal output unit 14e of the (-DEC) 14;
It is reproduced and output from the audio output unit 22 via the (step S1 in FIG. 2).

At this time, under the control of the CPU 11, SD
MPE for displaying the selected menu read from the disk 10
The data string of the G2 stream is transferred via the buffer (BUF) in the media drive controller (MDC) 12 to the M
It is input to the PEG decoder unit (MPEG2-DEC) 14, separated into a main image, a sub-image (for example, subtitles) synchronized with the main image, and audio of a plurality of channels, which are decompressed and synchronized with each other. NTSC for menu display
It is output as a signal and an audio signal. That is, the main video is decoded by the video decoder (VD-DEC) 14a, and the sub-video (caption) is sub-picture decoder (SP-D).
EC) 14b, audio information is decoded by an audio decoder (AU-DEC) 14c, and each decoded output of the video decoder (VD-DEC) 14a and sub-picture decoder (SP-DEC) 14b is output as a video signal. The sub-picture decoder (SP-D) is supplied to the main image supplied to the unit (MUX) 14d and separated and expanded by the video decoder (VD-DEC) 14a.
EC) 14b The sub-images that have been separated and expanded are combined to create an analog video signal (NTSC signal) for display output.
Is output as Also, an audio decoder (AU-D
The audio information expanded by the EC) 14c is supplied to the audio signal output unit 14e and output as an analog audio signal. However, in the first embodiment, reproduction output control of subtitle information of the sub-picture decoded and output from the sub-picture decoder (SP-DEC) 14b is performed according to the recognition result of the audio recognition unit (RECO) 17.

The MPEG decoder section (MPEG2-D)
The NTSC signal output from the EC) 14 is the display device (D
ISP) 21, the analog audio signal is supplied to the audio output unit 22, and the movie information with audio and subtitles is displayed and output.

At this time, the audio decoder (AU-DE
C) The voice information decoded and output from 14c is transmitted to the voice recognition unit (RECO) 1 via the audio signal output unit 14e.
7 is supplied.

The voice recognition unit (RECO) 17 receives the audio decoder (AU) via the audio signal output unit 14e.
-DEC) 14c recognizes the language type and language from the voice received to generate language type determination output information and coded character string information (step S2 in FIG. 2). That is, the voice recognition unit (RECO) 17 inputs the voice information reproduced and output from the audio signal output unit 14e of the MPEG decoder unit (MPEG2-DEC) 14 and extracts a human voice pronunciation feature or the like to determine a language type (for example, (Japanese, English, French, etc.) is recognized, and when it is a specific language, words such as conversation are voice-recognized by extracting characteristic sounds of the language, and a code of a character string according to the pronunciation order of the words is generated. At this time, the information of the language type recognition result is used in the first embodiment (the code of the character string according to the pronunciation order of the words is used in the second embodiment).

The information of the language type recognition result obtained from the voice recognition unit (RECO) 17 is used as a judgment unit (JUDG).
E) is supplied to 18. The judgment unit (JUDGE) 18
When the information of the language type recognition result is received from the voice recognition unit (RECO) 17, the sub-picture decoder (SP-DEC) 14b of the MPEG decoder unit (MPEG2-DEC) 14 is controlled according to the information to reproduce and output the subtitle. Control is performed (steps S3 and S4 in FIG. 2).

That is, when the judgment unit (JUDGE) 18 detects that a word other than Japanese has been reproduced and output from the information of the type recognition result output from the voice recognition unit (RECO) 17, the sub-picture decoder (JUDGE) 18 SP-DEC) 14
Trigger b to control the playback output of the Japanese subtitle sub-picture.

Thus, for example, when a word such as an English conversation other than Japanese intervenes in the reproduced movie information, the sound (word) of the foreign language is reproduced and output in Japanese subtitles.
In addition, here, the subtitle by the sub-audio is recognized by the voice recognition unit (REC
O) The configuration is such that the reproduction output is selectively controlled according to the recognition result of 17; however, for example, subtitles of one sub-audio are always reproduced and output, and another sub-audio is recognized according to the recognition result of the voice recognition unit (RECO) 17. A configuration may also be adopted in which subtitles by sub-audio are selectively played back and output, and for example, two types of subtitles of different colors are superimposed and output, or a configuration in which subtitles are replaced. Alternatively, according to the recognition result of the voice recognition unit (RECO) 17, it is also possible to synthesize and output the Japanese voice in accordance with the Japanese subtitle. Or voice recognition unit (RECO)
According to the recognition result of 17, it is also possible to realize a configuration for switching the playback scene when a specific voice is recognized, a configuration for performing multi-scene playback, and the like.

Next, the operation of the second embodiment of the present invention will be described with reference to FIGS. 3 and 4. The operation of the second embodiment is particularly different from the operation of the first embodiment described above, according to the recognition result of the voice recognition unit (RECO) 17, using the recognized character string information, the corresponding provision information (for example, movie information). The point is to create an index.

That is, the voice recognition unit (RECO) 17 is M
When the audio information reproduced and output from the audio signal output unit 14e of the PEG decoder unit (MPEG2-DEC) 14 is input, the type of language (for example, Japanese, English, (French, etc.) is recognized, and when it is a specific language, words such as conversation are voice-recognized by extracting characteristic sounds of the language, and a code of a character string according to the pronunciation order of the words is generated (step S5 in FIG. 4, S
6).

At this time, the information of the language type recognition result is used in the first embodiment, but in the second embodiment, the code of the character string according to the pronunciation order of the words is used. When the code (character string information) of the character string according to the pronunciation order of the words is generated from the voice recognition unit (RECO) 17, the character string information is supplied to the index creation unit (INDEX-GEN) 20.

On the other hand, the CPU 11 sends the frame number information to the I / O each time the frame is updated when the movie information is reproduced.
It is latched in the O register (FRAME) 19. This I /
The frame number information temporarily stored in the O register (FRAME) 19 is stored in the index creation unit (INDEX-GE).
N) is input to 20.

Index creation unit (INDEX-GE
N) 20 receives the coded character string information according to the pronunciation order of words from the voice recognition unit (RECO) 17, and the character string information and the frame number latched in the I / O register (FRAME) 19. Based on the above, a constant length character string and a frame number are associated with each other to create constant form index information and notify the CPU 11 (step S7 in FIG. 4).

The CPU 11 writes the index information created by the index creating unit (INDEX-GEN) 20 into the index table storage unit (INDEX-TBL) 15a in the main memory (MEM) 15 (step S8 in FIG. 4). .

In this way, the index table storage unit (INDEX-TBL) in the main memory (MEM) 15 is used.
An index table in which a character code string of a subtitle and a frame number are associated with each other in a predetermined format is created in 15a.

This index table storage (IND
The index table stored in the EX-TBL) 15a is under the control of the CPU 11 according to the instruction by the key input operation of the user interface unit (User I / F) 16.
It can be expanded as display data in the display memory (VM) 23 and can be displayed on the display device (DISP) 21 via the display control unit (DISP-CONT) 24.

As described above, at the time of reproducing the provided information (movie information) recorded on the SD disc 10, the subtitle information of the sub-picture is expanded on the memory, the characters are recognized and coded, and the subtitle is coded. By having a function to create index information using the character string information that has been created, it is possible to refer to this index information and search for impression scenes, scene sequence searches, story summaries, etc. in the provided information such as movies. Work can be done easily and subtitle information can be effectively used.

In the above embodiment, the voice recognition unit (R
When the index information is created from the coded character string information according to the pronunciation order of words from ECO) 17, the index table is created by associating the frame numbers with each other.
However, the present invention is not limited to this, for example, a unit that collects index information in a fixed time unit to create an index table or a buffer (BUF) in the media drive controller (MDC) 12 collects data of a corresponding frame, and the frame is collected. Means for creating an index table by associating the above data with each other, or a voice recognition unit (RECO)
Coded character string information according to the pronunciation order of the words obtained in 17, the frame number acquired from the I / O register (FRAME) 19, the media drive controller (MD
C) A means for creating an index table by associating it with provided information (1 scene information of a movie) collected from the buffer (BUF) in 12 can also be easily realized from the above embodiment. Further, in the present embodiment, the configuration for displaying and outputting the index information is shown as an example, but the present invention is not limited to this, and it may be an output means such as a printout or a means for opening and displaying a window.

[0071]

As described above in detail, according to the present invention, when the provided information recorded on the recording medium is reproduced, the language of the reproduced and outputted voice is recognized, and the result of the voice recognition is used as the control information. As a result, by adopting a configuration having a function to be reflected in reproduction output control of main video, sub-video, audio, etc., for example, it is possible to reliably and accurately transmit the content of the reproduced provided information and to expand the transmission function and application, In particular, it is possible to improve the information transmission function and expand the applications when reproducing the provided information that handles a plurality of languages.

Further, at the time of reproducing the provided information recorded on the recording medium, the language of the reproduced voice is recognized by voice, the encoded character string information is generated, and the index information is used by using the character string information. The index information can be created and saved from the subtitle information of the sub-picture by adopting the configuration having the function of creating and saving. By referring to the index information, it is possible to easily perform various operations such as search for an impression scene, scene sequence search, and story summary in the provided information such as a movie, and to effectively use the subtitle information.

[Brief description of drawings]

FIG. 1 is a block diagram showing a hardware configuration of a system according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing a subtitle control processing routine by voice recognition according to the first embodiment of the present invention.

FIG. 3 is a block diagram showing a hardware configuration of a system according to a second embodiment of the present invention.

FIG. 4 is a flowchart showing an index creation processing routine by voice recognition according to a second embodiment of the present invention.

FIG. 5 is a diagram showing an example of a recording format of the SD disk 10 in each of the above embodiments.

[Explanation of symbols]

10 ... SD disc, 10a, 10b ... Recording surface, 11 ...
CPU, 12 ... Media drive controller (MD
C), 13 ... Media drive unit (MDU), 1
3a ... turntable, 13b ... pickup, 14 ...
MPEG decoder unit (MPEG2-DEC), 14a ...
Video decoder (VD-DEC), 14b Sub-picture decoder (SP-DEC), 14c ... Audio decoder (AU-DEC), 14d ... Video signal output unit (MU)
X), 14e ... Audio signal output section, 15 ... Main memory (MEM), 16 ... User interface section (User I /
F), 17 ... Voice recognition unit (RECO), 18 ... Judgment unit (JUDGE), 19 ... I / O register (FRAM)
E), 20 ... Index creation unit (INDEX-GE
N), 21 ... Display device (DISP), 22 ... Audio output unit (SP), 23 ... Display memory (VM), 24 ... Display control unit (DISP-CONT).

Continuation of the front page (51) Int.Cl. ⁶ Identification code Office reference number FI Technical display area H04N 5/93

Claims (28)

[Claims] 1. A device for recognizing a language of a reproduced and outputted sound in a device having a reproduction function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound. And an information provision control device comprising: means for controlling the reproduction output of the sub-picture according to the recognition result. 2. A means for recognizing a language of a reproduced and outputted sound in a device having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound. And an information providing control device comprising means for controlling the sound reproduced and output according to the recognition result. 3. An apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound, and a sound of a specific language reproduced and outputted and another language. And a means for reproducing and outputting a subtitle of a specific language by a sub-picture when a reproduction output sound of another language is identified. 4. An apparatus having a reproduction function of a recording medium capable of recording provided information by a main image, a sub-image synchronized with the same image, and audio of a plurality of channels, and an audio of a specific language reproduced and output and another language. And a means for reproducing and outputting a plurality of sub-pictures including subtitles of a specific language when the reproduction output sound of another language is identified. 5. An apparatus having a reproduction function of a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound, and reproduced and output the sound of a specific language and another language. And a means for reproducing and outputting a sound of a specific language recorded in another sound recording unit when a reproduced and output sound of another language is identified. Control device. 6. An apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with a main picture and the same picture and a plurality of channels of sound, and recognizing a specific sound from the reproduced and outputted sound. An information provision control device, comprising: a means for switching and a means for switching a reproduction scene when a specific voice is recognized. 7. An apparatus having a reproduction function of a recording medium capable of recording provided information by a sub-picture synchronized with the same picture as the main picture and a plurality of channels of sound, and recognizing a specific sound from the reproduced and outputted sound. An information provision control apparatus comprising: a means for performing multi-scene reproduction when a specific voice is recognized. 8. The language of the reproduced and output audio is recognized when the recording medium capable of recording the main video and the sub-video synchronized with the same video and the information provided by a plurality of channels of audio is recognized, and the audio recognition result is obtained. An information provision control method characterized by controlling the reproduction output of the sub-picture according to the above. 9. A speech recognition result obtained by recognizing a language of a reproduced and outputted sound when reproducing a recording medium capable of recording provided information by a sub-picture synchronized with the main picture and the same picture and a plurality of channels of sound. A method for controlling information provision, characterized in that the voice reproduced and output according to the method is controlled. 10. When reproducing a recording medium capable of recording the main image, a sub-image synchronized with the same image, and information provided by a plurality of channels of audio, the audio of a specific language reproduced and output and the audio of another language are output. A method for controlling information provision, characterized in that a subtitle of a specific language is reproduced and output by a sub-picture when the output is identified and the reproduction output sound of another language is identified. 11. When reproducing a main image, a sub-image synchronized with the main image, and a recording medium capable of recording provided information by a plurality of channels of audio, the audio of a specific language reproduced and output and the audio of another language are output. A method for controlling provision of information, characterized in that a plurality of sub-pictures including subtitles of a specific language are reproduced and output when they are identified and reproduction output sound of another language is identified. 12. When reproducing a main image, a sub-image synchronized with the same image, and a recording medium capable of recording provided information by a plurality of channels of audio, the audio of a specific language reproduced and output and the audio of another language are output. A method for controlling provision of information, characterized in that when a discriminating and reproducing output voice of another language is discriminated, a voice of a specific language recorded in another voice recording section is reproduced and outputted. 13. When reproducing a recording medium capable of recording information provided by a sub-video synchronized with the same video as the main video and audio of a plurality of channels, a specific audio is recognized from the reproduced and output audio, and a specific audio is recognized. An information provision control method, characterized in that a reproduction scene is switched when a voice is recognized. 14. When reproducing a recording medium capable of recording information provided by a sub-video synchronized with the main video and the audio of a plurality of channels, a specific audio is recognized from the reproduced and output audio, and a specific audio is recognized. An information provision control method characterized by performing multi-scene reproduction when a voice is recognized. 15. A device having a reproduction function of a recording medium capable of recording provided information by a sub-image synchronized with the main image and the sub-image and audio of a plurality of channels, recognizes the language of the reproduced and outputted voice. An information providing control device comprising: a unit for generating coded character string information; and a unit for collecting the coded character string information at a fixed time unit and storing it as index information. 16. An apparatus having a reproducing function of a recording medium capable of recording provided information by a sub-picture synchronized with the same picture as the main picture and audio of a plurality of channels, at the time of reproducing the provided information recorded on the recording medium. In this case, the means for acquiring the frame number of the reproduction provision information, the means for recognizing the language of the reproduced and output voice and generating the coded character string information, and the coded character string information for the acquisition frame number An information provision control device comprising: means for associating and generating index information; and means for storing the generated index information. 17. An apparatus having a reproducing function of a recording medium capable of recording the auxiliary information synchronized with the main image and the sub-image and the audio of a plurality of channels when reproducing the provided information recorded on the recording medium. A means for collecting the information provided for the reproduced frame, a means for recognizing the language of the reproduced and output voice and generating coded character string information, and a means for collecting the coded character string information for the corresponding frame. An information provision control device comprising: a unit for generating index information in association with the provision information; and a unit for storing the generated index information. 18. An apparatus having a function of reproducing a recording medium capable of recording provided information by sub-picture synchronized with the same picture as the main picture and audio of a plurality of channels, at the time of reproducing the provided information recorded on the recording medium. At this time, a means for acquiring the frame number of the reproduction provision information and collecting the provision information of the frame, a means for recognizing the language of the reproduced and output voice and generating coded character string information, are encoded. Information provision control, characterized in that it comprises means for generating index information by associating the obtained character string information with the acquired frame number and the collected provision information, and means for storing the generated index information. apparatus. 19. The method according to claim 15, 16 or 17 or 18, further comprising means for visually outputting the stored index information.
The information provision control device described. 20. The information provision control device according to claim 17, wherein at least one type of provision information is collected from the main video, the sub video, and the audio. 21. The information provision control apparatus according to claim 17, wherein at least one type of provision information of main video, sub-video, and audio is sampled for a plurality of frames. 22. The information provision control device according to claim 17, further comprising means for reproducing a still image by referring to index information. 23. The information provision control apparatus according to claim 17, further comprising means for reproducing a moving image with reference to index information. 24. The information provision control device according to claim 17, further comprising means for reproducing audio by referring to index information. 25. When reproducing a recording medium capable of recording the main image, the sub-image synchronized with the same image, and the information provided by a plurality of channels of audio, the language of the audio reproduced and outputted is recognized and encoded. An information provision control method characterized in that character string information is generated, and the character string information is collected at fixed time intervals and stored as index information. 26. When reproducing a recording medium on which a main image and a sub-image synchronized with the same image and audio of a plurality of channels can record the provided information, the frame number of the provided information is acquired, and the reproduced audio is output. The method for controlling information provision, comprising: recognizing the language of [1], generating coded character string information, and correlating the character string information with a frame number to generate and storing index information. 27. When reproducing a recording medium on which a main image, a sub image synchronized with the same image, and information provided by a plurality of channels of audio can be recorded, the language of the reproduced and outputted audio is recognized and encoded. Generate string information,
An information provision control method, which collects provision information of a corresponding frame, and associates coded character string information with provision information of the corresponding frame to generate and store index information. 28. When reproducing a recording medium capable of recording provided information in the form of sub-picture synchronized with the same picture as the main picture and audio of a plurality of channels, the frame number of the provided information is acquired and reproduced and outputted. Generates coded character string information by recognizing the language of, and collects the frame provision information, and associates the coded character string information with the acquired frame number and the collected provision information to create an index. An information provision control method characterized by generating and storing information.