JP2008091972A - System for automatically outputting recorded narration corresponding to still image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve entertainment properties by a narration, and to arouse a viewing desire in a system for automatically outputting a recorded narration corresponding to a still image that successively switches a series of still images to which words are related for display and outputs a narration at a prescribed part. <P>SOLUTION: A recorded narration corresponding to prescribed words related to respective still images composed in series is stored in an NR data DB 38. Voice data in which word voice inputted by a voice recognition means 31 of a voice processing section 21 is analyzed is compared with a word keyword corresponding to a still image being displayed current of a comparison table 33 by a voice comparison means 32. An NR control means 35 extracts a corresponding recorded narration from the NR data DB 38, based on a comparison individual signal identified by the word keyword at the time of agreement, and is sent to an NR output control section 18 for outputting. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an automatic recording narration automatic output system for still images that sequentially switches and displays a series of still images associated with dialogue and outputs narration at a predetermined location.

  In recent years, there has been known a digital picture-story show in which a series of digital still images are regarded as an old-fashioned picture-story show, and images of each scene are sequentially displayed while reading a dialogue. In such a digital picture-story show, it is desired to improve entertainment properties and to encourage viewers to view.

  Conventionally, a digital picture-story show generally displays a still image, and a speech corresponding to the still image is read out, and each scene is switched sequentially. However, a narration corresponding to each scene (still image) can be played. It is considered as one of the improvement of entertainment. Voices that are different from the characters are usually preferred for narration, and unlike the characters of the characters in the play, even those that were recorded in advance did not affect the spoken dialogue, but rather were recorded It is more efficient to speak the line.

  By the way, there is a technique disclosed in the following patent document as a technique for playing sound effects during conversation. In the following patent document, sound effect data and a keyword are stored in advance in association with each other with respect to the mobile communication device, and when the keyword included in the user's call voice signal is detected by the voice recognition means, the keyword is handled. Transmitting sound effect data to a mobile communication device.

JP 2002-05116 A

  However, in the above patent document, the sound effect data and the keyword are simply associated with each other, and the same sound effect always flows even if a plurality of the same keywords are included in the sound signal as the user calls. When this is applied to the narration output of the above-mentioned digital picture-story show, there is a problem that even if the still image is switched, the same recorded narration is output with the same keyword, and the effect of the recorded narration is diminished. Further, in order to output a recorded narration between lines, there is a problem that manual operations such as selection of a predetermined narration and transmission of an output trigger are required, and there is a troublesome operation.

  Accordingly, the present invention has been made in view of the above problems, and it is possible to output a recording narration without requiring a special operation, and it is possible to output a recording narration that can improve the entertainment property by the narration and stimulate the willingness to view. The purpose is to provide.

  In order to solve the above-described problem, the invention of claim 1 is a still image-corresponding recording narration automatic output system for sequentially switching and displaying a series of still images associated with dialogue and outputting narration at a predetermined location, A still image storage unit, a recording narration storage unit, a collation table, a voice input unit, a voice processing unit, a recording narration control means, and a first display unit, wherein the still image storage unit includes a plurality of still images configured in series. The recording narration storage unit records, for each still image composed of the series, a recording corresponding to a predetermined dialogue keyword among the dialogues associated with each still image. Narration data is stored, and the collation table includes a dialogue keyword for each predetermined still image and the recorded narration description. Information related to the recorded narration data corresponding to each still image stored in the unit is associated, the speech input unit inputs speech speech, and the speech processing unit analyzes and generates the input speech speech The recorded voice narration data is compared with the speech keyword corresponding to the still image currently displayed on the first display unit of the collation table, and when the speech data match, the recorded narration data individually specified by the speech keyword The recording narration control means outputs recording narration data corresponding to each still image currently displayed on the first display unit according to the information on the recording narration data from the audio processing unit. The recording narration storage unit extracts and outputs.

In the inventions of claims 2 and 3, "further comprising a line storage unit, a line display control means and a second display unit, the line storage unit stores line data for each still image composed of the series, The dialogue display control means is configured to cause the second display unit to extract and display dialogue data corresponding to a still image currently displayed from the dialogue storage unit,
“In addition to first image display control means for controlling display of a still image displayed on the first display section, second image display control means is provided, and the second display section includes the first display section. In this configuration, the still image currently displayed is displayed.

  According to the present invention, for each still image constituted by a series, the recording narration for each still image corresponding to a predetermined dialogue among the dialogues associated with each still image is stored, The voice data obtained by analyzing the input speech is compared with the speech keywords in the matching table, and when they match, they are recorded on the still image that is displayed based on the information related to the recorded narration data that is individually identified by the speech keywords. By configuring the narration to be output, it is possible to output the recorded narration without requiring any special operation, and if the displayed still image is different even with the same dialogue keyword, the corresponding recorded narration is output. It is possible to improve the entertainment properties by narration and to stimulate the willingness to see That.

Hereinafter, the best embodiment of the present invention will be described with reference to the drawings.
FIG. 1 shows a block diagram of a first embodiment of a still picture narration automatic output system according to the present invention. In FIG. 1, a recording narration automatic output system 11 for still images includes a bus 12, a central control unit 13, a ROM 14, a RAM 15, a display control unit 16, an image display unit 17 as a first display unit, and an NR (narration) output control. A unit 18, a mixing amplifier 19, a microphone 20 as a voice input unit, a speaker 21, a voice processing unit 22, a storage device 23, and an operation unit 24 are appropriately provided.

  The voice processing unit 22 includes a voice recognition unit 31 and a voice collation unit 32. Further, the storage device 23 includes a collation table 33, an NR control means 34 that is a recording narration control means, a first image display control means 35, an image DB (image database) 36 that is an image storage section, and a recording narration storage section. A certain NR data DB (database) 37 is stored.

  The central control unit 13 is a physical CPU that performs overall process control of the system, and performs algorithm processing based on a program stored in the ROM 14. The RAM 15 serves as a work area for developing and executing various programs, and is a concept including, for example, a case where the RAM 15 is configured by a semiconductor memory and is virtually built on a hard disk.

  The display control unit 16 includes an electronic circuit that decodes an image sent from a first image display control unit 35 to be described later and displays the decoded image on the image display unit 17 and a program associated therewith. Examples of the image display unit 17 include a projector screen, a cathode ray tube (CRT) display, a liquid crystal display (LCD), and a plasma display (PDP).

  The NR output control unit 18 is an electronic circuit that decodes recording narration data (file) sent from an NR control unit 34 (to be described later) and outputs the data to a mixing amplifier 19. The mixing amplifier 19 amplifies the speech of the reading person input from the microphone 20 and outputs it from the speaker 21, and amplifies the voice of the recording narration sent from the NR output control unit 18 and outputs it from the speaker 21. It is something to be made. The operation unit 24 includes switches such as a power button and a start button.

  The speech recognition means 31 provided in the speech processing unit 22 is a program that analyzes input speech and generates speech data, which is expanded in the RAM 15 and executed. In the present embodiment, for example, speech sound of an analog signal is digitally converted into font-coded sound data. In addition, it is good also as audio | voice data which imaged and analyzed the analog waveform.

  The speech verification unit 32 included in the speech processing unit 22 is a speech keyword corresponding to the speech data from the speech recognition unit 31 and the still image currently displayed on the image display unit 17 of the verification table 33 (described in FIG. 2). , And outputs the NR file name individually specified by the above-mentioned dialogue keyword when matched, and is expanded in the RAM 15 and executed.

  Here, the collation between the speech data and the speech keyword is performed, for example, when speech data (font code) input and analyzed at any time is first collated with the first sound data (font code) of the speech keyword and matched. This is a process of sequentially matching the second and subsequent one-tone data (font code), and when all the one-tone data (font code) of the dialogue keyword is matched, it is individually identified by the dialogue keyword. Output NR file name. On the contrary, if there is even one that does not match, it is repeated from the collation with the first note data of the line keyword. An example of the collation table 33 stored in the storage device 23 will be described with reference to FIG. 2. A file name (NR file) that identifies a speech narration for each still image as information about a speech keyword and recording narration data for each still image. Name).

  The NR control means 34 stored in the storage device 23 is based on the NR file name as information relating to the recorded narration data output as the collation result from the voice collation means 32, and the still image currently displayed on the image display unit 17. This is a program for extracting recorded narration data (file) corresponding to each image from the NR data DB 37 and sending it to the NR output control unit 18. The program is developed in the RAM 15 and executed. The NR output control unit 18 decodes the input recording narration data and outputs it to the mixing amplifier 19.

  The first image display control means 35 stored in the storage device 23 is a program for sequentially switching and displaying a series of still images on the image display unit 17 by a predetermined switching signal (for example, a switching button of the operation unit 24). Yes, it is expanded in the RAM 15 and executed. The image DB 36, which is a still image storage unit stored in the storage device 23, is a database that stores a predetermined number of still images configured in series as a set, and the NR data DB 37 is configured in series. This is a database that stores recording narration data associated with each still image and corresponding to each predetermined still image keyword in the dialogue for each still image.

  Here, FIG. 2 is an explanatory diagram of the collation table and the NR table of FIG. The collation table 33 shown in FIG. 2 is a table in which, for example, a still image of the first image is associated with a predetermined number of dialogue keywords corresponding to the first image and each NR file name. Assuming that images exist, a predetermined number of dialogue keywords and NR file names are associated with each still image. That is, since the dialogue keyword defined for each still image is associated with the corresponding NR file name, the matching table 33 is classified as a different NR file name even if the same dialogue keyword exists between the still images. Separated. In the same still image, the setting of overlapping dialogue keywords can be avoided by changing the length of the number of words of dialogue keywords.

  FIG. 3 shows a flowchart of the recording narration control of FIG. Here, in the above-described still image-corresponding recording narration automatic output system 11, the first image display control means 35 extracts a predetermined still image from the image DB 36 and sends it to the display control unit 16. 16 decodes the image data and displays it on the image display unit 17. At this time, when a speaker reads out the speech corresponding to the image through the microphone 20, the speech speech read out to the microphone 20 is amplified by the mixing amplifier 19 and output from the speaker 21, while Thus, the dialogue speech is input to the speech recognition means 31 of the speech processing unit 22 as needed (step (S) 1).

  That is, the voice processing unit 22 acquires information on the still image currently displayed on the image display unit 17 from the first image display control unit 35 and analyzes the speech input by the voice recognition unit 31 to obtain a voice. The voice collation means 32 sequentially collates the voice data with the speech keyword corresponding to the still image currently displayed in the collation table 33 in real time (S2). The matching is repeated until they match (S3).

  As a result of the collation by the voice collation unit 32 (S3), if they match, the NR file name associated with the matched dialogue keyword in the collation table 33 is output to the NR control unit 34 (S4). The NR control means 34 extracts the recorded narration data from the NR data DB 37 based on the NR file name input from the voice collating means 32 and sends it to the NR output control unit 18 (S5).

  The NR sound output unit 18 decodes the received recording narration data of the NR file name and outputs it to the mixing amplifier 19, and the mixing amplifier 19 amplifies the sound of the recording narration and outputs it from the speaker 21. These processes are repeated until the final image (for example, the still image of the tenth image) (S6).

  In this way, recording narration can be output without requiring a special operation, and even if the still image displayed is different even if the same dialogue keyword is displayed, different recorded narration is output and entertainment characteristics by narration It is possible to improve the quality and stimulate the willingness to view.

  Next, FIG. 4 shows a block diagram of the second embodiment of the still image corresponding automatic recording narration output system according to the present invention, and FIG. 5 shows an explanatory diagram of the dialogue display of FIG. FIG. 4A is a block diagram of a main part of the still image display system 11. The storage device 23 further stores a dialogue DB 41, dialogue display control means 42, and second image display control means 43. Is done. In addition, a transmission / reception unit 44 is provided on the bus 12, and a remote display terminal 45, which is a second display unit that wirelessly transmits data with the transmission / reception unit 44. The remote display terminal 45 appropriately includes a second display unit 46, a second display control unit 47, and a transmission / reception unit 48.

  The dialogue DB 41 is a database for storing corresponding dialogue data (dialog file name) associated with a series of still images stored in the image DB 36. In this case, as shown in FIG. 4B, the collation table 33A includes, for example, a predetermined number of dialogue data corresponding to each still image, that is, dialogue data specified by dialogue file names stored in the dialogue DB 45. Are associated with each NR file name, and a predetermined number of dialogue keywords and NR file names are associated with each still image, assuming that there is a still image of the tenth image.

  Note that the data of the dialogue DB 41 may be stored in the image DB 36 in association with the corresponding image. The dialogue display control means 42 is a program for extracting dialogue data corresponding to the still image currently displayed on the image display unit 17 from the dialogue DB 41 to the remote display terminal 45 and sending it to the transmission / reception unit 44. The data is expanded in the RAM 15 and executed. The second image display control means 43 is a program that extracts the still image currently displayed on the image display unit 17 from the image DB 36 and sends it to the transmission / reception unit 44, which is developed in the RAM 15 and executed. .

  The transmission / reception unit 44 is an electronic circuit that transmits to the remote display terminal 45 in a wireless manner with the transmission / reception unit 48. For example, connection is possible by a wireless method such as an IR method or a piconet connection method of a Bluetooth mechanism, but a wired method may also be used. The second display unit 46 included in the remote display terminal 45 is a display that displays a still image currently displayed on the image display unit 17 and dialogue data corresponding to the still image. Then, the second display control unit 47 included in the remote display terminal 45 decodes the still image data and the dialogue data sent to the transmission / reception unit 48 to display the still image on the second display unit 46, At this time, dialogue data is displayed in a telop state.

  That is, at the time of displaying a predetermined image of the system, the second image display control means 43 extracts the still image data currently displayed on the image display unit 17 and sends it to the remote display terminal 45 so that the second display is performed. The dialogue display control means 42 extracts the dialogue data corresponding to this from the dialogue DB 41, and the portion that becomes the dialogue keyword is underlined, the size of the displayed character, a different color as shown in FIG. Characterize the display and send it to the remote display terminal 45 for display.

  Therefore, when the reader reads out the speech while looking at the still image and the dialogue displayed on the remote display terminal 45 and reads out the dialogue that matches the dialogue keyword (FIG. 4B), the speech collating means 32 sends it out as a matching result. Based on the incoming NR file name, the NR control means 34 extracts the recorded narration data from the NR data DB 37 and sends it to the NR output control unit 18 to output the recorded narration from the speaker 21. This is repeated until the final still image is displayed.

  Note that although the remote display terminal 45 has been described as displaying the still image and dialogue currently displayed on the image display unit 17, the dialogue may be displayed only, and the same static on the remote display terminal 45. Displaying an image has the effect of empathizing with the reader's speech reading. On the contrary, only the still image may be displayed on the remote display terminal 45, and the point where the speech, especially the recording narration is output is characterized and displayed so that the voice of the recording narration flows to the reader. (Sentence) can be recognized. Further, since the speech reader reads out and speaks into the microphone 19 while looking at the remote display terminal 45, the remote display terminal 45 may be provided with a microphone function.

  In this way, the user who reads the speech reads the speech displayed on the remote display terminal 45, particularly the speech characterizing the speech keyword in which the recording narration flows, or the speech and the still image while viewing the speech. In the same way as above, recording narration can be output without requiring any special operation, and even when the same dialogue keyword is displayed, different recorded narration is output. It is possible to improve entertainment through narration and to stimulate viewing.

  The automatic recording narration output system for still images according to the present invention is used in a system for outputting recorded narration corresponding to each still image when a digital picture-story show dialogue is associated with a still image and a still image is displayed. Is possible.

1 is a block configuration diagram of a first embodiment of an automatic recording narration automatic output system according to the present invention. FIG. It is explanatory drawing of the collation table of FIG. It is a flowchart of the recording narration control of FIG. It is explanatory drawing of 2nd Embodiment of the recording voice-over narration automatic output system which concerns on this invention. It is explanatory drawing of the dialog display of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Still image corresponding voice recording automatic output system 17 Image display part 18 NR output control part 22 Voice processing part 31 Voice recognition means 32 Voice collation means 33 Collation table 34 NR control means 35 First image display control means 36 Image DB
37 NR data DB
41 Dialogue DB
42 Dialog display control means 43 Second image display control means 45 Remote display terminal

Claims (3)

It is a recording narration automatic output system for still images that sequentially switches and displays a series of still images associated with dialogue and outputs narration at a predetermined location,
A still image storage unit, a recording narration storage unit, a collation table, a voice input unit, a voice processing unit, a recording narration control means, and a first display unit;
The still image storage unit stores a predetermined number of still images configured in series as a set,
The recording narration storage unit stores recording narration data corresponding to a predetermined dialogue keyword among dialogues associated with each still image for each still image configured in the series,
In the collation table, dialogue keywords for each predetermined still image are associated with information related to recorded narration data corresponding to each still image stored in the recorded narration storage unit,
The speech input unit inputs speech speech,
The speech processing unit collates speech data generated by analyzing the input speech and the speech keyword corresponding to the still image currently displayed on the first display unit of the collation table, and matches. Sometimes output information about the recorded narration data individually identified by the above dialogue keywords,
The recording narration control means, according to information related to the recording narration data from the audio processing unit, records narration data corresponding to each still image currently displayed on the first display unit. An automatic recording narration output system for still images, which is characterized by being extracted and output. The automatic narration recording audio output system according to claim 1, further comprising a dialogue storage unit, dialogue display control means and a second display unit,
The dialogue storage unit stores dialogue data for each still image composed of the series,
The dialogue display control means extracts and displays dialogue data corresponding to a still image currently displayed on the second display portion from the dialogue storage portion and displays it. system.   3. The automatic recording voice narration output system according to claim 2, wherein a second image display control means is provided in addition to the first image display control means for controlling the display of the still image displayed on the first display section. A still image narration automatic output system, wherein the still image currently displayed on the first display unit is displayed on the second display unit.

Images