JPH07244492A - Display device with vocalizing function, and object viewing method and educational method using the same - Google Patents

Abstract

PURPOSE:To provide the display device with the vocalizing function which is suitably applied to educational use and the purpose of use principally for personal relations such as negotiations, conferences, etc., and operation wherein an actual body is explained while displayed or observed, and the object viewing method and educational method using the device. CONSTITUTION:A transmission type liquid crystal display panel 4 is interposed between a recognizing person and a body to be recognized, and the recognizing person while listening to relative information on the object to be recognized which are read aloud by a speech synthesizer views a three-dimensional real image of the object which is seen through the relative information on the object displayed on the transmission type liquid crystal panel 4 over a look at the relative information.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device in which a voice synthesizer and a transmissive liquid crystal display panel are combined, an object visual recognition method and an educational method using the device.

[0002]

2. Description of the Related Art Recently, a semiconductor chip for voice synthesis has been developed, and application development of a voice synthesizer using this semiconductor chip is expected. This speech synthesizer can read text data as it is, and has been attempted to be applied to, for example, a device for guiding various messages by artificial voice.

[0003]

Although various guidance devices using artificial voice have been proposed as described above, these devices only appeal to the auditory sense, and few devices linked with visual information have been proposed. . Under the current circumstances, the applicant of the present application filed Japanese Patent Application No. 5-18923.
Among them, a text-to-speech synthesizer for mounting a moving object is proposed in which a device for displaying a guidance message and a voice synthesizer are integrated. This device reads text data read from an IC card by a voice synthesizer and, at the same time, displays the text data on a display device integrated with the main body or a display device separately provided. This device has versatility and has a wide range of application fields. On the contrary, if the device is applied to a specific field, various improvements are required. For example, there is room for improvement in applications such as educational purposes, business negotiations, meetings, and other applications centered on interpersonal relationships, and applications such as explaining while presenting the actual object or performing work while observing the actual object. Therefore, there is a demand for an apparatus configuration that enables more effective usage methods that reflect the characteristics of these usage applications.

The present invention has been made in view of the current situation, and is applied to educational purposes, applications centered on interpersonal relationships such as business negotiations, conferences, etc., while explaining or observing an actual object while presenting it. It is intended to provide a display device with a voicing function suitable for being applied to a work to be performed, etc., an object visual recognition method and an educational method using the display device.

[0005]

As a method for achieving the above object, the present inventor uses a transmissive liquid crystal display panel as a display device and interposes this transmissive liquid crystal display panel between a recognizer and an object to be recognized. The recognizer hears the relevant information of the recognition target read by the voice synthesizer, and at the same time, sees the relevant information of the recognition target displayed on the transmissive liquid crystal display panel, I came up with a method of visually recognizing a three-dimensional real image of an object.

A display device with a voice function of the present invention embodying such an idea is a removable memory for storing text data representing a Japanese or foreign language word by a set of characters and its related information. A medium, an input / output unit that detachably mounts the storage medium and reads / writes the stored contents in the medium, and Japanese or foreign language text data read by the input / output unit with an accent specific to the target language. A voice synthesizer that adds an intonation and converts it into an artificial voice to read it out, and a dot matrix that has a function of displaying one or both of the text data and its related information, and is interposed between a recognizer and a recognition target. Type transmissive LCD panel, the timing of reading text data read by the voice synthesizer, and the text data to the transmissive LCD panel. Or a control unit for controlling the display timing related information, and comprising the.

The text data may be simply displayed on the transmissive liquid crystal display panel, but a means for pointing out the corresponding portion currently read by the voice synthesizer may be provided.

Display on the transmissive liquid crystal display panel may be such that normal display is possible only when viewed from one side of the panel, but normal display is also possible when viewed from the opposite side. Thus, a left-right inverted display mechanism may be provided.

Data transfer of text data is usually done by I
C card, floppy disk, CD-ROM and MO
(A rewritable magneto-optical disk) is used, but in addition to these methods, there is a method using a communication line.

[0010]

The voicing function-equipped display device having such a structure is used as follows. First, text data and its related information are created using a word processor, a personal computer, or the like. This text data is written in a language supported by the speech synthesizer.If the speech synthesizer supports Japanese, it should be written in Japanese, and if it is a foreign language such as English or Chinese. For example, describe in the target language. The relevant information is graphic data or the like.

Next, the storage medium is mounted on the display device with a vocalization function. The transmissive liquid crystal display panel, which is the main part of the display device with voicing function, is arranged so as to be sandwiched between the recognizer and the recognition target object, and the transmissive liquid crystal display panel is sandwiched between the recognizer and the recognition target object. Are facing each other. When the storage medium is mounted, the text data and the related information in the storage medium are read into the main body of the apparatus, and by a proper operation, this data is converted into artificial voice by the voice synthesizer and read aloud. The text data is read aloud with accents and intonations specific to the target language.

At the same time that the text data is read aloud, one or both of the text data and its related information are displayed on the transmissive liquid crystal display panel while being controlled so as to match the read content. The display information may be only character information, but may be only image information or may include both character information and image information. Related information including text data displayed on the transmissive liquid crystal display panel is related to the recognition target object, and therefore the recognizer sees the real image of the recognition target object on the other side of the display panel through the transmissive liquid crystal display panel. However, the information related to the recognition target object is obtained by the artificial voice and the screen display.

When the transmissive liquid crystal display panel is provided with a means for pointing out the corresponding portion currently read by the voice synthesizer, a mark such as an underline or the like is displayed or highlighted on the corresponding display portion along with the reading. .

When a transversal liquid crystal display panel is provided with a left-right reversal display mechanism, when people face each other across the display panel, the left and right sides of the screen are switched and displayed as needed, so that both sides of the person can see each other. You can see the image.

When the communication control unit is provided, in addition to changing and updating the data via the storage medium, the text data and related information can be changed and updated through the communication line.

More specific applications of such a display device with a voice function include face-to-face education and the like. In this case, it is assumed that the person who receives the education, such as a student or child, faces the person who educates the teacher or mother with the transmissive liquid crystal display panel sandwiched between them, and explanations that include gestures of the teacher and mother. The object is recognized by observing the explanation using the real object through the text data displayed on the transmissive liquid crystal display panel and its related information, and an excellent learning effect can be obtained.

[0017]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The details of the present invention will be described below with reference to illustrated embodiments. FIG. 1 is a simplified block diagram showing a system configuration of a display device with a vocalization function of the present invention, and FIG. 2 is an external view explanatory diagram showing an embodiment of the same device. As shown in FIG. 1, this device includes a storage medium 1 typified by an IC card, an input / output unit 2 that detachably mounts the storage medium 1 to read / write data in the medium, and the input / output unit 2. A voice synthesizer 3 for reading the text data read by the computer, and a dot matrix type transmissive liquid crystal display panel 4 for displaying the text data read from the storage medium 1 and related information.
And a control section 5 for controlling the timing of reading the text data read by the voice synthesizer 3 and the timing of displaying the text data or related information on the transmissive liquid crystal display panel 4. Further, writing of the text data and related information to the storage medium 1 is performed by a data creation device 6 such as a word processor or a personal computer arranged externally, and these data are passed to the display device with a voice function via the storage medium 1. It is configured.

A removable storage medium is adopted as the storage medium 1, for example, an IC card, a floppy disk, a C
D-ROM, MO, etc. can be used. As the IC card, any one can be used as long as it can store text data and related information and can rewrite the stored content. Generally, a static RAM is used and the memory content is a built-in battery. A so-called RAM card backed up by is inexpensive and suitable. Of course, it is also possible to use an IC card using a non-volatile memory such as a flash memory, and it is also possible to use an IC card having a CPU and a built-in memory in some cases. The connection with the input / output unit 2 may be a contact type, but it is preferable to adopt a non-contact type using magnetic coupling, which is widely used in machine tools and industrial equipment. Text data and graphic data related to the text data are mainly recorded in the storage medium 1 such as an IC card. However, even if a program for controlling the operation of the display device with a vocalization function is recorded together with the data. Good.

Data transmission / reception to / from the display device with a vocalization function is as follows.
Normally, the storage medium 1 is used, but in addition to this method, the use of a communication line may be considered. For example, if the communication control unit 7 is built in the display device with a vocalization function or the communication control adapter can be externally connected,
It is also possible to send and receive text data and related information through a general public line or ISDN.

As the voice synthesizer 3, a plurality of LSIs are integrated on a substrate or a single super LSI is used as a main part.
Known materials such as those configured by can be used. Further, the voice synthesizer 3 is also equipped with an amplifier so that it can read aloud at a sufficient volume. In the conventional so-called voice synthesis circuit, analog voice data sampled using a microphone or the like is once converted into a digital signal by A / D conversion and recorded, and a digital signal is generated when an artificial voice is pronounced. After inversely converting into an analog signal by D / A conversion, this analog signal was amplified by an amplifier and sounded, whereas the voice synthesis circuit 3 used in the present invention.
Is an artificial voice that directly reads the data of a text file created by a personal computer or word processor, and does not require any voice blowing by a microphone. Further, the voice synthesizer 3 is provided with a function of adjusting accents and intonations according to the language, and by exchanging the voice synthesis LSI, for example, natural pronunciation corresponding to each language such as Japanese, English, and Chinese. It is configured to be able to. The text-to-speech synthesizer has already been commercialized, and such a general-purpose text-to-speech synthesizer can be used in the present invention.

The transmissive liquid crystal display panel 4 is of a dot matrix type capable of both character display and graphic display. The transmissive liquid crystal display panel 4 is a liquid crystal panel that does not have a reflector and allows the opposite side of the panel to be seen through the panel. For example, a product combined with an overhead projector has already been developed. In the transmissive liquid crystal display panel 4, when a normal image projected on the front surface is viewed from the rear surface side, the image becomes a horizontally inverted image, but if a mechanism that can horizontally invert the displayed image is provided as necessary, it becomes the opposite. The observation from the surface can be dealt with by appropriately switching and displaying. As the transmissive liquid crystal display panel 4, both a monochrome type and a color type can be used, but it is realistic to use the monochrome type in terms of cost.

FIG. 2 shows an embodiment of the display device with vocalization function, in which all the main parts of the display device with vocalization function are incorporated in a panel-like case 8 which is self-supporting by legs. The panel-shaped case 8 includes a transmissive liquid crystal display panel 4a.
Is inserted, a speaker 9 for utterance is attached to the upper portion thereof, an operation portion 10 is arranged at the lower portion of the transmissive liquid crystal display panel 4, and an IC card is attached to the side portion of the panel-shaped case 8. A section 11 is provided. A touch pen 12 for auxiliary operation is provided as needed. In the figure, 6 is a data creation device such as a word processor or a personal computer, and the text data created by this data creation device 6 and its related information are ICs.
It is transmitted to the display device with a voice function via the card 1a.

FIG. 3 shows another embodiment of the display device with a voicing function, in which the control box 13 incorporating the operation part 10a, the IC card mounting part 11a and various circuit groups is constructed separately from the panel-like case 8a. is there. Text data and image data related to the text data are displayed on the transmissive liquid crystal display panel 4a, and the display timing of these data is matched with the reading timing of the text data read by the voice synthesizer. As a method of displaying the text data, there are a case of displaying the characters to be read aloud one by one as they are read, and a case of displaying the text data of several lines collectively. When collectively displaying text data, it is desirable to mark the reading corresponding character in the displayed characters with an underline or the like, or to display the corresponding character in reverse video as shown in FIG.

In the illustrated embodiment, the panel-shaped case 8a is erected by legs, but it can be hung.
Further, the size of the transmissive liquid crystal display panel 4a is appropriately determined according to the purpose of use of the display device with a vocalization function.

Various other modes can be considered as the display device with a vocalization function. For example, as shown in FIG. 5, the transmissive liquid crystal display panel 4b is arranged on the front surface and the earphone 9a is led out from the side frame 14. It is considered that the goggles described above are configured, or that although not shown, this device is integrated with a helmet to incorporate an operation unit and various circuit groups in the helmet.

It is also possible to configure an alternative device to a document projector (prompter) which has been conventionally used for speech at a conference or a conference. The conventional prompter projects a character image displayed on a backlight type liquid crystal horizontally installed on a desk onto a half mirror obliquely provided at a line of sight height position. As shown in FIG. 6, the present invention proposes a device in which the backlight type liquid crystal on the desk is abolished and the transmissive liquid crystal display panel 4c is directly arranged at the eye level. In this case, it is necessary to devise a polarizing plate and a liquid crystal material so that a character image is not displayed on the back surface side of the transmissive liquid crystal display panel 4c. Since this device has a built-in voicing device, it is possible to check the displayed contents with the ear if necessary.For example, when a new person speaks in a foreign language, a powerful support function is provided. Is demonstrated.

The use range of the above-mentioned display devices with voicing functions is wide. Here, several application examples will be described. FIG. 7 shows a case of using it for early childhood education. In this case, the child and the mother face each other with the transmissive liquid crystal display panel 4 sandwiched therebetween, and the mother shows a picture of the “cat” drawn in a picture book or the like while gesturing and explaining the “cat”. Speak. On the other hand, in the transmissive liquid crystal display panel 4,
The English expression "CAT" of "cat" is displayed and the character is read aloud as "cats" by the voice synthesizer with the correct pronunciation. If necessary, the call of the “cat” and further detailed explanation regarding the “cat” can be called from the database and read out aloud. A female voice is suitable for reading aloud because it resembles that of a mother. The child understands the concept of "cat" through picture books, mother's gestures, and mother's narration as seen through the transmissive liquid crystal display panel 4, and at the same time, the English letters "CAT" and its pronunciation displayed on the transmissive liquid crystal display panel 4 are pronounced. With "cats", you will learn the English expression of "cat" from both letters and sounds. Also, by listening to the crying voice and more detailed supplementary explanations as needed, more detailed knowledge about the “cat” is acquired. In this educational method, since the mother is facing each other, the child can learn in a warm atmosphere with peace of mind, and the characters and images are displayed on the transmissive liquid crystal display panel 4, so that the child can learn with interest. You can continue to, and learn the foreign language expression of "cat" with the correct pronunciation, and you can also hear the cat's cry and detailed supplementary explanations, which is an excellent learning effect. What the mother presents is not limited to picture books, and other teaching materials may be used. The scope of application of this teaching method is not limited to the relationship between a mother and a child, but can be applied to other purposes, such as face-to-face education in an English conversation classroom or the like. The text data and the related information may be supplied to this device by using a storage medium such as an IC card, or may be supplied through a telephone line or the like. in this case,
If the publisher of the picture book also serves as a provider of text data and related information and regularly provides new data or updates the data, the latest data can be easily obtained. It can also be used by publishers as a measure to retain customers.

FIG. 8 shows a case where the present apparatus is used for assembling work training and the like, and is particularly used for learning the procedure for assembling precision parts. In this example, the transmissive liquid crystal display panel 4 is arranged above the precision component 15 arranged on the workbench, and the display content of the display panel 4 is magnified by the magnifying lens 16.
It is supposed to work while observing through. The display panel 4 displays the assembly position and the assembly procedure of each precision component, and voice guides the assembly procedure and notes as necessary. According to this method, both the precision parts to be assembled and the image displayed on the display panel 4 can be brought into the field of view of the operator, and at the same time, voice guidance is provided, so that the operator can see from the assembly target. You can proceed with work training without leaving.

FIG. 9 shows a case where this device is used in a product exhibition or a show window. The figure shows visitors and exhibited products 1
The transparent liquid crystal display panel 4 is interposed between the display panel 4 and the display 7, and the product description of the exhibited product 17 is displayed on the display panel 4 and the product description is also given by artificial voice. The display panel 4 may be installed independently, but it is also possible to embed it in a part of the show window, and it is also considered that the entire glass plate of the show window is configured using the transmissive liquid crystal display panel 4. It The present apparatus having such a structure can be used as a factory tour window. According to such a usage method, it is possible to receive an explanation of the product or the object to be visited by both the character image and the artificial voice while seeing the actual image of the product to be exhibited or the object to be observed, so that it is easy to understand and makes an impression. It is possible to introduce the remaining products and factory introductions.

FIG. 10 shows a case where the present apparatus is used as an apparatus for supporting various business negotiations and meetings. The figure shows a situation in which two people meeting each other face each other with the transmissive liquid crystal display panel 4 interposed therebetween. While the meeting items are displayed on the transmissive liquid crystal display panel 4, a voice guidance regarding the meeting contents is given by a voice synthesizer. The image displayed on the transmissive liquid crystal display panel 4 includes not only text data but also graphic data, and for example, mechanical design drawings, architectural design drawings, etc. are displayed. In this case, the image displayed on the display panel 4 needs to be usable by both persons facing each other with the panel in between, and therefore, as shown in the drawing, the display screen can be displayed in the left-right inverted manner. Is preferably attached. The reverse display mechanism is indispensable especially when the display image includes text data. According to such a usage method, the meeting can be smoothly proceeded by following the meeting items and contents displayed on the display panel 4 and the voice guidance for reading the contents.

[0031]

According to the display device with a voice function of the present invention, a transmissive liquid crystal display panel is arranged between a person who recognizes and an object to be recognized, and the transmissive liquid crystal display panel has character information relating to the object to be recognized and related information. At the same time that the information is displayed, the content displayed on the display panel is read aloud by the voice synthesizer, so that the recognizer listens to the voice guidance regarding the recognition target object, and also the corresponding text data.
It becomes possible to visually recognize the real image of the recognition target through the transmissive liquid crystal display panel on which the three-dimensional visual information is displayed.
Understanding of the recognition object is promoted.

Further, when such a device is applied to the educational field in particular, accurate and diversified related information can be provided through the transmissive liquid crystal display panel while leaving a warm atmosphere for face-to-face education, resulting in an excellent learning effect. can get.

When the transmissive liquid crystal display panel is provided with a means for pointing out the corresponding part currently read by the speech synthesizer as in claim 2, the read part is lost even if the displayed character is a foreign language. It is suitable for language learning because it does not exist.

When the transmissive liquid crystal display panel is provided with the left-right inversion display mechanism as described in claim 3, even when people face each other with the display panel sandwiched,
By switching and displaying the display panels, both persons on both sides can see the normal image.

When the communication control unit is provided as described in claim 4, in addition to changing or updating the data via the storage medium, the text data of the data can be transmitted or received or updated through the communication line. , It becomes easy to obtain the latest data easily.

[Brief description of drawings]

FIG. 1 is a simplified block diagram showing a system configuration of a display device with a voice function of the present invention.

FIG. 2 is an external view showing an embodiment of a display device with a voice function of the present invention.

FIG. 3 is an external view showing another embodiment of the display device with a voice function of the present invention.

FIG. 4 is an explanatory diagram showing an example in which a transmissive liquid crystal display panel is provided with a means for pointing out a corresponding portion being read out.

FIG. 5 is an explanatory diagram showing another embodiment of the display device with a voice function of the present invention.

FIG. 6 is an explanatory diagram showing another embodiment of the display device with a vocalization function of the present invention.

FIG. 7 is an explanatory diagram showing an example of a method of using the display device with a vocalization function of the present invention.

FIG. 8 is an explanatory diagram showing another example of a method of using the display device with a vocalization function of the present invention.

FIG. 9 is an explanatory diagram showing another example of a method of using the display device with a vocalization function of the present invention.

FIG. 10 is an explanatory diagram showing another example of a method of using the display device with a vocalization function of the present invention.

[Explanation of symbols]

1 storage medium 1a IC card 2 input / output unit 3 voice synthesizer 4 transmissive liquid crystal display panel 4a transmissive liquid crystal display panel 4b transmissive liquid crystal display panel 4c transmissive liquid crystal display panel 5 control unit 6 data creation device 7 communication control unit 8 Panel case 8a Panel case 9 Speaker 9a Earphone 10 Operation part 10a Operation part 11 IC card installation part 11a IC card installation part 12 Touch pen 13 Control box 14 Side frame 15 Precision parts 16 Magnifying lens 17 Exhibited product

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical indication H04N 7/18 R

Claims (6)

[Claims] 1. A removable storage medium for storing text data in which a Japanese or foreign language word is expressed by a set of characters and related information thereof, and a storage medium detachably mounted in the medium. An input / output unit for reading and writing stored contents; and a voice synthesizer for converting the Japanese or foreign language text data read by the input / output unit into artificial voice with accents and intonations specific to the target language, and reading the voice. , A dot-matrix transmissive liquid crystal display panel that has a function of displaying one or both of the text data and its related information, and is interposed between a recognizer and a recognition target, and text data read by a voice synthesizer. To control the timing of reading the text and the timing of displaying text data or related information on the transmissive LCD panel And, speaking function with a display device provided with. 2. The display device with a voicing function according to claim 1, further comprising means for pointing out a relevant portion of the text data displayed on the transmissive liquid crystal display panel which is currently read by the voice synthesizer. 3. The display device with a voicing function according to claim 1, further comprising a left / right reversing display mechanism so that a display when viewed from the opposite surface of the transmissive liquid crystal display panel is a positive image. 4. The display device with a voicing function according to claim 1, 2 or 3, further comprising a communication control unit for transmitting and receiving text data via a communication line. 5. A visual recognition method using the display device with a voicing function according to claim 1, wherein a recognition target and a recognition target face each other with a transmissive liquid crystal display panel sandwiched therebetween, and the recognition target read from a storage medium. While reading the related information on the transmissive liquid crystal display panel, the text data is read aloud by artificial voice with accents and intonations peculiar to the target language, and at the same time the transmissive liquid crystal display panel displaying the related information of the recognition target is transmitted. A method for visually recognizing an object, which comprises visually recognizing a three-dimensional real image of a recognition object located on the other side of a liquid crystal display panel. 6. An educational method using the display device with a vocalization function according to claim 1, wherein a teacher or an object to be taught and a person to be taught face each other with a standing transmission type liquid crystal display panel interposed therebetween. At the same time, while reading the information about the teaching content read from the storage medium on the transmissive liquid crystal display panel, the text data is read aloud by an artificial voice accompanied by accents and intonations peculiar to the target language, and at the same time, the movement of the teacher or the teaching target object is read. An educational method for visually recognizing a three-dimensional real image of a teacher or a teaching object located on the other side of a transmissive liquid crystal display panel through a transmissive liquid crystal display panel on which related information is displayed.