JPH1165510A - Head-mounted display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable a head-mounted display system to be utilized in various fields as a portable work support information display tool by displaying images, even when the hands of an observer are occupied, through utilization of a speech recognition thchnique. SOLUTION: In this system, a manual use mode and a speech using mode are inter changeable to/from each other. In the speech using mode, when digital data corresponding to word are inputted, a CPU 45 controls an image controller 47 according to the word, reads out the image data and a character font from memories 46, 48 as image-displaying data and outputs them to a liquid crystal driver 38 via an input/output interface 39. By driving a liquid crystal panel 35 by means of the liquid crystal driver 38, the image to be observed corresponding to the speech input is displayed. When digital data corresponding to a word for write instruction are inputted, the CPU 45 enabls writing the data in a memory card 70 via a memory card interface 55.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a head mounted display system having an image display unit mounted on the head of an observer, for example, a factory, large plant equipment, maintenance, inspection, maintenance of an aircraft, and a factory. For use in an order entry system in a sales service business such as a restaurant, etc.

[0002]

2. Description of the Related Art At present, a head mounted display system mainly used for forming a virtual reality space or the like is a display unit of a type in which an image is visually recognized by both eyes via a mirror in front of an observer. Is used. As the image, a computer graphic (CG) image, a real image, or the like is displayed by connecting the display unit to a computer, a video camera, a VTR, or the like by wire. In addition, in order to amplify the sense of presence, it is sometimes used in combination with a so-called tactile feedback device or 3D sound device.

On the other hand, a head-mounted display system using a display unit wirelessly connected to a computer or the like by allowing an observer to visually recognize an image with one eye or an image through a combiner has been put to practical use. It is planned. Since this system allows the observer to visually recognize both the image and the real object and expands the range of action of the observer, it is suitable for providing work support information to the observer performing various tasks. I have. For example, it can be used to display images for selection, search, confirmation, and the like of work instruction information and the like during maintenance, inspection, and maintenance of factories, large plant facilities, aircraft, and assembling work on assembly lines in factories.

[0004]

In the conventional head mounted display system, it is necessary for an observer to perform a switch operation with fingers when displaying an image. Therefore, when the observer's both hands are closed for work, image display cannot be performed, and this is not suitable for work support.

An object of the present invention is to provide a head mounted display system which can solve the above-mentioned problems.

[0006]

According to the present invention, there is provided a head mounted display system comprising: a voice input unit; voice signal processing means for generating a voice recognition signal for the voice input; And a display unit for displaying an image corresponding to the image signal, and a holding unit that holds the audio input unit and the display unit and that can be mounted on the head of the observer. According to the configuration of the present invention, the observer can visually recognize a desired image only by emitting sound.

[0007]

Embodiments of the present invention will be described below with reference to the drawings.

The head mounted display system 1 shown in FIG.
A holder 5 that can be attached to the head of the observer 4;
, A control unit 7 attachable to the waist of the observer 4 via the belt 11, and a voice input unit 8. In the present embodiment, the display unit 6 allows the observer 4 to visually recognize an image only with one eye, but may display the image with both eyes.

The holding portion 5 has a band-shaped main body portion 5a for sandwiching the head of the observer 4 by elasticity, and a pad 5b which is pressed against the head to prevent the display portion 6 from shifting from the head. . The form of the holding section 5 is not limited as long as it can be mounted on the head of the observer 4. For example, the pad 5b may not be provided or a helmet-shaped section may be used.
In the present invention, the head refers to a portion above the neck including the face.

The display unit 6 includes a display unit 6a that emits image display light, an optical system 6b that changes the optical path of the image display light and guides the image display light to the visual field of the observer 4, and the display unit 6a and the optical system. 6b connecting the arm 6c with the arm 6c. The display unit 6a is connected to the control unit 7 via a cable 9.

As shown in FIG. 2, the display unit 6a comprises a backlight 32 composed of a halogen lamp with a reflecting mirror, and a voltage regulator 33 for the backlight 32.
A heat absorbing filter 34 for absorbing the heat of the backlight 32; a liquid crystal panel 35; and a scattering plate 36 for guiding the light of the backlight 32 to the liquid crystal panel 35 with uniformity.
And a liquid crystal driver 38 connected to the liquid crystal panel 35
And an input / output interface 39 connected to the liquid crystal driver 38. Image display light is emitted from the front surface of the liquid crystal panel 35 as shown by a broken line. In place of the liquid crystal panel 35 with the backlight 32, for example, a CR
A T display may be used. Further, a cold cathode tube, a hot cathode tube, a metal halide lamp, or the like may be used as the backlight.

The optical system 6b changes the optical path of the image display light by reflection or diffraction, thereby displaying the image on the observer 4.
And a combiner such as a half mirror or a hologram element that transmits light from the front. The optical system 6b may be configured by a mirror or the like that changes the optical path by totally reflecting the image display light, and may further include a condenser lens system.

The voice input section 8 has a microphone 8a, and an arm 8b connecting the microphone 8a and the holding section 5,
The microphone 8a is arranged near the mouth of the observer 4.

As shown in FIG. 2, the control section 7 has a signal processing circuit built in the housing 50. The signal processing circuit is controlled by a main memory 44 storing a program for controlling the system, a CPU 45 executing the program, an image memory 46 storing image data, a memory 48 storing character fonts, and controlled by the CPU 45. An image controller 47 for reading and writing data from and to an image memory 46, an input / output interface 43 connected to operation switches 41 and 42 of the system, a memory card interface 55 connected to a memory card 70, and an audio signal. It has a processing unit 51.

The audio signal processing unit 51 includes the microphone 8
a, a band-pass filter 51a for removing noise contained in the sound signal input from the input signal a, an amplifier 51b for amplifying the sound signal passing through the band-pass filter 51a,
b, a first memory 51d and a second memory 51e connected to the speech recognition processor 51c. The voice recognition processor 51c digitizes the amplified voice signal by the AD converter and stores the digitized voice signal in the first memory 51d. In the second memory 51e, data obtained by digitizing a voice signal of a predetermined word is stored. The voice recognition processor 51
c compares the digital data stored in the first memory 51d with the digital data stored in the second memory 51e, and stores the digital data corresponding to the data stored in the first memory 51d in the second memory 51e. Extracted from
The extracted digital data is sent to the CPU 45 as a word corresponding to the input voice.

The present system can be switched between a manual use mode and a voice use mode as described later. In the voice use mode, when the digital data corresponding to a word is input, the CPU 45 executes the process. , The image data and the character font are read out from the memories 46 and 48 as image display data, and output to the liquid crystal driver 38 via the input / output interface 39. When the liquid crystal driver 38 drives the liquid crystal panel 35, an observation target image corresponding to the audio input is displayed. Also, the CP
When digital data corresponding to a word for a write instruction is input, U45 can write the data to the memory card 70 via the memory card interface 55. The data written in the memory card 70 can be fetched by the host computer 90 via the memory card interface 91, and can be processed by the host computer 90.

As shown in FIG. 1, a drive battery 60 for the entire system is replaceably mounted on a housing 50 of the control unit 7, and a power switch 52 and confirmation button switches 41 and 4 as the operation switches are provided. A direction button switch 42 and a socket 50a for detachably connecting the memory card 70 to the control unit 7 are formed. The confirm button switch 41 and the four-way button switch 42 are provided for a case where the present system is used manually. The switching signal between the manual use mode and the voice use mode is transmitted to the CPU 4 through the input / output interface 43 by operating the switches 41 and 42.
5 is input. In the manual use mode, the CPU 45
Stops the function of the audio signal processing unit 51 and executes a program in response to an electric signal transmitted in response to the operation of the switches 41 and 42 via the input / output interface 43. The four-way button switch 42 is composed of four switch pieces that can be operated independently, and is used for specifying the operation content and moving the cursor in the display image. The four-way button switch 4
2 is used to determine the operation content specified. When the switches 41 and 42 are pressed, a buzzer that sounds for operation confirmation may be provided in the display unit 6 or the control unit 7. Connectors 71 and 72 for connecting a wireless modem or the like to the input / output interface 43 are provided on the housing 50.
Is provided for connecting the system to an external computer or the like.

FIG. 3 shows a modification of the present invention. The difference from the above-described embodiment is that, instead of the memory card interface 55 and the memory card 70, a wireless modem 92 with an antenna is connected to the input / output interface 43 and the host computer 90 is connected via a wireless modem 93 with an antenna. It is in. In this case, when digital data corresponding to a word for a transmission instruction is input, the CPU 45 transmits the data to the host computer 90 via the input / output interface 43 and the wireless modems 92 and 93.

In the above embodiment and modified examples, the memory card interface 55 and the input / output interface 4
3 through the memory card 70 or the host computer 90
For example, when transmitting data, a buzzer that sounds during transmission may be provided so that the data transmission can be confirmed.

FIG. 4 shows a specific example of an image 100 displayed by the head mounted display system of the above modification. Here, an example is shown in which the system is applied to a restaurant order entry system. That is, when the waitress or waiter who is the observer 4 first voice-inputs the seat number of the customer who listens to the order, the input number is displayed on the display unit 6. Next, when the customer listens to the order and repeats the content to input a voice from the microphone 8a, the menu content input by the voice is displayed as order information. If the displayed content is correct, the observer 4 utters “transmit” and inputs a voice. Then, the CPU 45
Is the host computer 9 via the wireless modems 92 and 93.
Send order information to 0. At this time, the screen is updated to the next input screen simultaneously with the transmission. The host computer 90
Based on the order information, for example, work instruction information is provided to a cooking place or the like via a network such as a LAN. If the displayed menu information is incorrect, the user inputs "correction" and voice-inputs, so that the input content is deleted and the input is enabled again. Also, when bringing the completed dish to the customer, if the voice of the seat No. is input and then "confirmation" is spoken and the voice is input, the order content of the seat No. is displayed, and it can be confirmed whether or not the correct dish is being carried. It has become. This allows the waitress and waiter to take an order and confirm the order easily even when both hands are closed because the waitress and the waiter have the tableware. Further, by displaying the vacant seat information and displaying the nomination from the customer, the restaurant can be operated more smoothly.

The present invention is not limited to the above embodiment. For example, in place of the general microphone 8a, an osseous vibration pickup type voice input microphone may be arranged on the holding portion so as to be in close contact with the temporal region near the ear bone. Also,
A voice input microphone may be mounted on the optical system 6b or the arm 6c. Further, the voice input from the voice input microphone may be transmitted to an external computer by a voice transceiver, and the external computer may perform voice signal processing for generating a voice recognition signal. Alternatively, a printer may be connected to the control unit, and the voice input result may be output on paper.

[0022]

According to the present invention, it is possible to display an image even when both hands of an observer are closed by using the voice recognition technology, and it can be used in various fields as a portable work support information display tool. And a head-mounted display system that can be used in a computer.

[Brief description of the drawings]

FIG. 1 is a perspective view showing a use state of a head mounted display system according to an embodiment of the present invention.

FIG. 2 is a configuration explanatory view of the head-mounted display system.

FIG. 3 is a configuration explanatory view of a head-mounted display system according to a modified example of the present invention.

FIG. 4 is a diagram showing a display example of a head-mounted display system according to a modified example of the present invention.

[Explanation of symbols]

 Reference Signs List 4 observer 5 holding unit 6 display unit 7 control unit 8 audio input unit 51 audio signal processing unit

Continued on the front page (72) Inventor Ryutaro Nasu 1 Nishinokyo Kuwabaracho, Nakagyo-ku, Kyoto-shi, Kyoto Inside the Shimadzu Sanjo Plant

Claims (1)

[Claims] An audio input unit; an audio signal processing unit for generating an input voice recognition signal; an image signal generation unit corresponding to the audio recognition signal; and an image corresponding to the image signal A head-mounted display system, comprising: a display unit having a display unit; and a holding unit that holds the voice input unit and the display unit and that can be mounted on the observer's head.