JP2011150705A - Video display device with built in voice recognition function - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video display device which is suitable for electronic presentation without being affected by external factors caused by change of surrounding noise environment and the vocalization method of a speaker. <P>SOLUTION: The video display device includes a voice display signal generation unit 105 that recognizes voices from a microphone and generates a voice display signal, and a video display signal generation unit 104 that processes video input and generates a video display signal, and combines and displays the signals on a screen. In this case, voice and video display memories 1053 and 103 are synchronously-controlled respectively by a CPU unit 108 and memory control circuit 109. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a video display device, and more particularly to a video display device that is used for electronic presentations and that incorporates a voice recognition function.

  2. Description of the Related Art Conventionally, video display devices typified by projector devices are used for electronic presentations and the like. In such an electronic presentation, an operator (speaker) provides an explanation while connecting a video display device and a computer or the like and sequentially displaying target electronic materials. In the case of an electronic presentation for a large number of people, an operator (speaker) may use a loudspeaker or the like depending on the situation.

  FIG. 7 is a system configuration diagram using a video display device for explaining an example of the prior art. As shown in FIG. 7, in the conventional electronic presentation system, a computer 3 and a video (VIDEO) device 4 are connected to a video display device 1 a called a projector, and are arranged at a predetermined distance from a viewer 7. The screen is generally displayed on the screen 2. In addition, at the same time, a microphone 6 is disposed in the vicinity of the operator (speaker) 5 and a system for transmitting sound to the viewer 7 using a loudspeaker 8 such as a speaker is employed.

  Also, in recent technologies, there are known ones that display voice content on an information presentation device using a voice recognition device, or display on a printing means such as a printer using voice data / character code conversion means. . For example, as described in Patent Document 1, for use in an in-vehicle voice memo device or the like, a voice uttered by a person is converted into a simple character string using a voice recognition technology, and the information presenting device is used. It is displayed on a liquid crystal display or the like.

  Furthermore, as described in Patent Document 2, a device for synthesizing and displaying the contents of voice input from a microphone on the display of a karaoke device or a lecture device has been proposed, or described in Patent Document 3. As described above, when a remote lecture is performed using a projector, various multimedia device inputs are switched using voice input.

JP-A-9-330096 JP-A-10-282970 JP 2000-250392 A

  In the video display apparatus of FIG. 7 described above, since the means for transmitting the utterance of the operator (speaker) is easily affected by external factors, changes in the surrounding noise environment and the utterance method of the operator (speaker) (pronunciation) Depending on the speed, there is a drawback in that it is difficult to hear the explanation of the operator (speaker). In addition, since such a video display device has many necessary equipment such as a speaker, there is a disadvantage that its transportation and installation work is troublesome. In other words, equipment necessary for electronic presentation is often transported to a place where the presentation is actually performed and connected, and this work is a burden. Furthermore, in the conventional video display apparatus, since the means for transmitting the utterance of the operator (speaker) is audible, there is a drawback that it is difficult to perform an electronic presentation for a hearing impaired person.

  Further, the voice memo device of Patent Document 1 does not function as a projector, and simply displays the contents inputted by voice on a liquid crystal display or the like. This is effective when taking notes while moving in a car or the like, but it cannot display images using a screen for many stationary viewers.

  In addition, the voice information display device used as a karaoke device or a lecture device of Patent Document 2 does not have a function as a projector device, requires a remote control device or a timer, and is troublesome to operate.

  On the other hand, although the distance learning apparatus of Patent Document 3 has a function as a projector, it requires an Internet line and various media devices in addition to the projector device, and is not only inconvenient to carry these devices. There is a problem that the place of use is limited.

  An object of the present invention is to solve the above-described problems, that is, an electronic presentation that is not affected by external factors due to changes in the surrounding noise environment and the operator's (speaker) utterance method (pronunciation, speed, etc.). Another object of the present invention is to provide a video display device (projector) incorporating a voice recognition function suitable for the above.

  Another object of the present invention is to provide a video display device with a built-in voice recognition function that reduces the equipment used for electronic presentations, reduces the burden of carrying, and reduces installation work such as cord connection. There is to do.

  Furthermore, another object of the present invention is to provide electronic presentations to persons with hearing impairments, to realize electronic presentations for more people, and to realize electronic presentations with better expression. An object of the present invention is to provide a video display device having a built-in voice recognition function.

  The video display device incorporating the voice recognition function of the present invention receives voice from a microphone, recognizes the inputted voice and converts it into character data, and stores the converted character data in a character display memory. An audio display signal generation unit that reads out the read character data and generates a character display signal, and an input video signal that can be output as a digital video signal by switching between the plurality of video signals that are input. A processing circuit; a video display memory for storing a digital video signal output from the input video signal processing circuit; a video display signal generator for reading the digital video signal stored in the video display memory and generating a video display signal; A display signal is generated by combining the character display signal supplied from the audio display signal generator and the video display signal supplied from the video display signal generator. Display signal synthesizing circuit, a CPU unit for controlling each circuit based on a program, a memory control circuit for controlling the video display memory and the audio display signal generating unit under the control of the CPU unit, and a display signal synthesizing circuit And a display unit for displaying a display signal. When receiving a video switching instruction from the CPU unit, it is configured to perform video switching after identifying that the content stored in the character display memory is lost.

  The voice display signal generation unit in the video display device includes a voice input terminal connected to the microphone, a voice recognition circuit that recognizes a voice signal input to the voice input terminal, and converts the voice signal into character code data for each character; A character string buffer circuit that stores character code data for each character as a character string, a character font ROM that stores character fonts, a character display memory that converts character code data into character display data, and a character display memory, and a character display memory And a character display signal generation circuit for generating a character display signal. By connecting each circuit with a bus, it can be controlled by the CPU unit and the memory control circuit.

  In addition, the CPU unit according to the present invention is configured to access the character font ROM when character code data is stored in the character string buffer circuit, convert the character code data into character pattern data, and store it in the character display memory. Is done.

  The memory control circuit according to the present invention is formed so as to control the video display memory and the character display memory and to synchronize the video screen and the voice sentence.

  In addition, the voice display signal generation unit according to the present invention includes a plurality of voice input terminals, and can be formed so that voices from a plurality of speakers are individually displayed on the display unit as characters.

  Furthermore, the voice display signal generation unit according to the present invention includes a plurality of voice recognition circuits and a plurality of character string buffer circuits corresponding to a plurality of voice input terminals, and can perform interactive display by a plurality of speakers. .

  As described above, the video display apparatus with a built-in voice recognition function of the present invention is provided with means capable of displaying voice signals as characters as auxiliary means for transmitting the voice of the operator (speaker). Even if it is difficult to hear the voice of the operator (speaker), the content can be reliably transmitted to the viewer. In other words, it is possible to guarantee a certain level of transmission without being affected by external factors such as changes in the surrounding noise environment and the operator (speaker) utterance method (sounding, speed, etc.).

  In addition, the video display device of the present invention is provided with means capable of displaying a voice signal as a transmission means in place of the loudspeaker, so that an electronic presentation can be performed without using a loudspeaker such as a speaker, For this reason, there is an effect that less equipment is used and the carrying burden can be reduced, and installation work such as cord connection can be reduced.

  In addition, since the video display device of the present invention is provided with means for converting an audio signal into visual information, an electronic presentation can be made to a person with hearing impairment, and more people are targeted. The effect is that the electronic presentation can be realized.

  Furthermore, the video display device of the present invention can produce a visual effect by voice during an electronic presentation by simultaneously transmitting an audio signal not only to the auditory sense but also to the visual presentation, and to perform an electronic presentation with better expression. There is an effect that can be.

It is a figure showing the system configuration | structure using the video display apparatus explaining the 1st Embodiment of this invention, and the front of a screen. It is a circuit block diagram of the video display apparatus shown in FIG. It is a figure explaining the example of the horizontal direction display of the screen screen in FIG. It is a figure explaining the example of the vertical direction display of the screen screen in FIG. It is a figure explaining another example of the horizontal display of the screen screen in FIG. It is a figure showing the system configuration | structure using the video display apparatus explaining the 2nd Embodiment of this invention, and the front of a screen. It is a system block diagram using the video display apparatus explaining an example of the past.

  The present invention is intended to improve the transferability and installation required for a presentation or the like (hereinafter referred to as an electronic presentation) while operating a digitized material using a computer or the like. Such an electronic presentation is generally explained by connecting a computer and a video display device and sequentially displaying the digitized material on the video display device by operating the computer. In addition, in the case of an electronic presentation for a large number of people, a loudspeaker that amplifies the voice of an operator (speaker) and the like are used depending on the situation together with a large-screen video display device. In particular, according to the present invention, the audio display signal generation unit capable of recognizing sound and displaying characters is incorporated in the video display device, thereby improving the transferability and installability of the electronic presentation.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIGS. 1A and 1B are a system configuration diagram and a front view of a screen, respectively, using a video display device for explaining a first embodiment of the present invention. As shown in FIGS. 1A and 1B, the present embodiment uses a video display device 1 to which a computer 3 and a video (VIDEO) device 4 are connected, and can be viewed by many viewers 7. FIG. 2 shows an electronic presentation system for displaying an image. A microphone 6 is connected to the image display device 1. When an operator (speaker) 5 near the viewer 7 gives voice information, for example, “Good morning” greeting, to the video display device 1 through the microphone 6, it is converted into character data by the voice recognition function, and the screen 2 1 (here, the lower side), that is, as shown in FIG. 1B, the characters “Good morning” are displayed on the screen 2 from the lower right side to the lower left side.

  For this reason, in the electronic presentation, less equipment is used, and carrying and connection work are reduced. In addition, as a supplementary means of transmission in situations where it is difficult to hear due to changes in the surrounding noise environment and external factors due to the utterance method (pronunciation, speed, etc.) of the operator (speaker) 5, a certain level of transmission is provided. And a visual effect can be easily produced for the voice of the operator (speaker) 5.

  FIG. 2 is a circuit configuration diagram of the video display apparatus shown in FIG. As shown in FIG. 2, the video display device (projector device) 1 is a projection video display device that enables a large-screen video display in which video is enlarged and projected onto a screen 2.

  The projector apparatus 1 includes a plurality of video input terminals 101 to which video signals are supplied, such as a computer, and an input video signal processing circuit 102 that performs A / D conversion processing on the video signals supplied from the plurality of video input terminals 101. The video memory 103 that stores the video signal digitized by the input video signal processing circuit 102 as video display data to be displayed and output, and the display data is sequentially read out from the video memory 103 and the video display signal is output as the video to be displayed and output. A video display signal generation circuit 104 to be generated; an audio display signal generation unit 105 surrounded by a dotted frame for converting an audio signal into a character display signal; and a video display signal supplied from the video display signal generation circuit 104 A display signal for synthesizing the character display signals supplied from the voice display signal generation unit 105 to generate a final display signal And a display unit 107 for projecting and displaying a display signal supplied from the display signal synthesizing circuit 106 and program data are incorporated, and the control bus 110 and the data bus 111 control all the circuits in the projector apparatus 1. A CPU unit 108 and a memory control circuit 109 that controls a memory in the projector apparatus 1 are provided. In particular, the memory control circuit 109 controls the video display memory 103 and the audio display signal generation unit 105 under the control of the CPU unit 108, and can reliably display all audio text on a predetermined video screen. So that they are in sync. The display unit 107 includes a display device, an optical lens, a light source lamp, and the like. In general, a device such as a liquid crystal or a DLP is often used as the display device. The image of this display device is enlarged and projected and displayed on the screen 2.

  Furthermore, the voice display signal generation unit 105 recognizes a voice input terminal 1050 to which a voice signal from the microphone 6 is supplied, and a voice signal supplied through the voice input terminal 1050, and sequentially converts the voice signal to a character code. A recognition circuit 1051, a character string buffer circuit 1052 that stores a character code supplied from the speech recognition circuit 1051, and a character display memory 1053 that stores character code data of the character string buffer circuit 1052 as character display data to be displayed and output. Then, the stored data is sequentially read from the character display memory 1053, the character display signal generation circuit 1054 for generating the character display signal to be displayed and output, and the character pattern data corresponding to the character code data stored in the character string buffer circuit 1052 are stored. And a character font ROM 1055. These circuits are connected by the control bus 110 and the data bus 111 described above. In addition, the character font ROM 1055 storing the character font and the character display memory 1053 storing the character pattern data are controlled by the memory control circuit 109 that controls the video display memory 103 so that the video screen and the audio text can be synchronized. To do. Further, when the memory control circuit 109 receives a video switching instruction from the CPU unit 108, the memory control circuit 109 recognizes that the stored contents of the character display memory 1053 are lost and switches the video.

  The projector apparatus 1 normally displays an image by enlarging and projecting a video signal of an external video device such as a computer supplied from the video input terminal 101 on the screen 2. The outline of the video signal processing operation is as follows. First, when a video signal of an external video device is supplied from the video input terminal 101 to the input video signal processing circuit 102, the video signal is A / D converted by the input video signal processing circuit 102. In this way, the video signal is sequentially converted from an analog signal to a digital signal. Next, the digital video signal is sequentially stored as video display data in the video display memory 103. Therefore, data stored in the video display memory 103 is sequentially updated with video display data obtained by digitizing a video signal input from the video input terminal 101. Further, the video display signal generation circuit 104 sequentially reads video display data stored in the video display memory 103, generates a video display signal for video display output, and supplies the video display signal to the display signal synthesis circuit 106.

  Next, the operation of the audio display signal generation unit 105 will be described. When a voice signal of the microphone 6 or the like used by the operator (speaker) 5 is supplied from the voice input terminal 1050 to the voice recognition circuit 1051, the voice signal is subjected to character recognition processing in the voice recognition circuit 1051, and each character from the voice signal is processed. Is sequentially converted into character code data. The character-coded voice signal is sequentially stored in the character string buffer circuit 1052. When the character code data is stored in the character string buffer circuit 1052, the CPU unit 108 uses the character font ROM 1055 to convert the character code data into character pattern data. Next, the converted character pattern data is sequentially stored in the character display memory 1053 as character display data. Further, the character display data stored in the character display memory 1053 is sequentially read from the character display signal generation circuit 1054. The character display signal generation circuit 1054 generates a character display signal for character display output from the read character display data, and outputs it to the display signal synthesis circuit 106. Further, the character display signal generation circuit 1054 is supplied with control data such as a character display data reading position and a character display output position from the CPU unit 108 so that the character display method and display position can be changed.

  Next, the display signal combining circuit 106 receives the video display signal supplied from the video display signal generation circuit 104 and the character display signal supplied from the character display signal generation circuit 1054 so that characters can be displayed on the video display screen. A combined display signal is generated and supplied to the display unit 107. The display signal supplied to the display unit 107 is enlarged and projected onto the screen 2 as a display image of the projector device 1. As a result, on the screen 2, the audio signal input from the audio input terminal 1050 is sequentially displayed on the video display screen of the video signal input from the video input terminal 101.

  FIGS. 3A and 3B are diagrams for explaining examples of the horizontal display of the screen screen in FIG. As shown in FIG. 3 (a), this screen 2 shows the same video screen (not shown: the same applies hereinafter) and transitions from left to right in terms of time. For example, in order to superimpose a plurality of voice sentences on one video screen, it is necessary to display the voice sentences from one to the next with a predetermined time. In this case, the voice sentence is displayed in the horizontal direction on the lower side. However, as shown in FIG. 3B, the voice sentence can be displayed in the horizontal direction on the upper side.

  4A and 4B are diagrams for explaining examples of the vertical display of the screen screen in FIG. As shown in FIGS. 4A and 4B, the screen 2 is also operationally similar to that in FIG. 3, and FIG. 4A shows a case where a voice sentence is displayed in the vertical direction on the right side. 4 (b) shows a case where a voice sentence is displayed in the left vertical direction.

  FIG. 5 is a diagram for explaining another example of the horizontal display of the screen screen in FIG. As shown in FIG. 5, the screen 2 does not move the voice sentence over time, but displays the voice sentence at a time for a predetermined time and erases the voice sentence after the predetermined time. It is. For this reason, when there are a plurality of voice sentences, they may be displayed on the screen 2 over a plurality of lines.

  3 to 5 described above may be set such that the CPU 108 of the projector apparatus 1 can perform program control. That is, by changing the control data such as the reading position and the character display output position of the character display data supplied from the CPU unit 108 to the character display signal generation circuit 1054, each image can be displayed. The position and display speed can be changed.

  FIGS. 6A and 6B are a system configuration diagram using a video display device and a front view of the screen, respectively, for explaining the second embodiment of the present invention. As shown in FIGS. 6A and 6B, in the present embodiment, two microphones 61 and 62 are connected to the projector apparatus 1 and the voices of two operators (speakers) 51 and 52 are displayed on the screen 2. It is intended to be displayed. In this case, in addition to the two voice input terminals 1050 in FIG. 2 described above, the projector apparatus 1 is also provided with two voice recognition circuits 1051 and two character string buffer circuits 1052, respectively. It is also possible to display two audio signals simultaneously by character setting, that is, by preparing a processing path corresponding to the number of input terminals. In this case, as shown in FIG. 6B, the voice of the first speaker 51 is displayed from left to right in the upper horizontal direction of the screen 2, and the voice of the second speaker 52 is displayed on the lower side. Interactive display can also be realized by displaying from right to left in the horizontal direction. Further, this display method may be displayed as shown in FIGS. 3 to 5 described above, or may be displayed in combination. The same applies when there are two or more operators (speakers).

  As described above, the two embodiments have been described by taking the most general projector device 1 as an electronic presentation video display device as an example. However, the present invention is not limited to these. For example, the same effect can be obtained by incorporating the audio display signal generation unit 105 even in a video display device such as a TV or a monitor regardless of the type of the video display device.

  Further, the display position and display speed of the characters can be changed by changing the control data such as the reading position and the character display output position of the character display data supplied from the CPU unit 108 to the character display signal generation circuit 1054. As a result, various display methods are possible, and a visual effect corresponding to the situation can be produced.

  Further, the keyword and its operation are set in advance in the CPU unit 108 so that the power of the projector apparatus 1 can be turned on / off and the video input terminal 101 can be switched, so that the CPU unit 108 can perform the character string buffer circuit. When the same character code data as the keyword is found in 1052, an operation corresponding to the keyword can be performed. As a result, when an operator (speaker) utters a keyword, the same effect as a general remote control can be obtained without using a remote control device.

DESCRIPTION OF SYMBOLS 1 Video display apparatus 2 Screen 3 Computer 4 Video (VIDEO) apparatus 6, 61, 62 Microphone 101 Video input terminal 102 Input video signal processing circuit 103 Video display memory 104 Video display signal generation circuit 105 Audio display signal generation part 106 Display signal synthesis | combination Circuit 107 Display unit 108 CPU unit 109 Memory control circuit 110 Control bus 111 Data bus 1050 Voice input terminal 1051 Voice recognition circuit 1052 Character string buffer circuit 1053 Character display memory 1054 Character display signal generation circuit 1055 Character font ROM

Claims (6)

Voice from a microphone is input, the inputted voice is recognized and converted into character data, the converted character data is stored in a character display memory, the stored character data is read, and a character display signal is An audio display signal generation unit to generate;
An input video signal processing circuit capable of inputting a plurality of video signals and switching the input video signals to output as a digital video signal;
A video display memory for storing a digital video signal output from the input video signal processing circuit;
A digital video signal stored in the video display memory, and a video display signal generator for generating a video display signal;
A display signal synthesis circuit that generates a display signal obtained by synthesizing the character display signal supplied from the audio display signal generation unit and the video display signal supplied from the video display signal generation unit;
A CPU unit for controlling each circuit based on a program;
A memory control circuit for controlling the video display memory and the audio display signal generation unit under the control of the CPU unit;
A display unit for displaying a display signal generated by the display signal synthesis circuit;
A video display device with a built-in voice recognition function, wherein when a video switching instruction is received from the CPU, the video switching is performed after identifying that the stored contents of the character display memory are lost. The voice display signal generation unit recognizes a voice input terminal connected to the microphone, a voice signal input to the voice input terminal, and converts the voice signal into character code data for each character; A character string buffer circuit that stores character code data for each character as a character string, a character font ROM that stores character fonts, a character display memory that converts and stores the character code data into character display data, and the character display 2. The voice according to claim 1, further comprising a character display signal generation circuit that reads the character display data of the memory and generates a character display signal, and is controlled from the CPU unit and the memory control circuit by connecting each circuit with a bus. Video display device with built-in recognition function. 2. The CPU unit, when character code data is stored in the character string buffer circuit, accesses the character font ROM, converts the character code data into character pattern data, and stores it in the character display memory. Alternatively, a video display device incorporating the voice recognition function according to claim 2. 3. The video display device with a built-in voice recognition function according to claim 1, wherein the memory control circuit controls the video display memory and the character display memory so that a video screen and a voice sentence can be synchronized. . The video having a voice recognition function according to claim 1 or 2, wherein the voice display signal generation unit includes a plurality of voice input terminals and displays voices of a plurality of speakers independently on the display unit. Display device. 6. The voice display signal generation unit includes a plurality of voice recognition circuits and a plurality of character string buffer circuits corresponding to the plurality of voice input terminals, and performs interactive display by the plurality of speakers. Video display device with built-in voice recognition function.

Images