JP6528263B2 - Head mounted display - Google Patents

Description

  The present invention relates to a head mounted display that can visualize important sounds regardless of the magnitude of the sounds and can mainly convey danger information visually to the user.

  2. Description of the Related Art In recent years, an image display device of a type mounted on the head of a user, so-called head mounted display (HMD), is widely known.

The head mount display is disposed in front of the user's eyes, and includes a display unit for displaying an image, a support member for supporting the display unit, and a battery for supplying power to the display unit (see FIG. Patent Documents 1 and 2).

People (mainly healthy people) use the brain to judge important sounds regardless of the size of the sound and avoid danger.

There is also an image display apparatus that converts the magnitude of sound into an image and displays the image on a display (see Patent Document 3).

However, at this stage, it is very difficult to select the importance of the sound recognition device using a neural network regardless of the size of the sound.

In addition, it is difficult for the hearing impaired person (especially a person with a rapid deafness) to distinguish the sound outdoors and the rear view is very important, but no method or means have been established to know the sound coming from the rear.

Patent No. 5413385 gazette Patent No. 5030595 JP, 2012-181178, A

  In view of the above-mentioned drawbacks, the present invention can also visualize sound information of a blind spot that can not be confirmed visually behind objects in the front view, and visually convey the danger to the user, and further, the rear danger. To provide a head mounted display that can also communicate.

The head mounted display according to the present invention is a head mounted display provided with a display screen unit for displaying an image according to information, in which a microphone for collecting surrounding sound is disposed in a frame, and the microphone collects the sound. When the sound made is a specific frequency registered in advance, a sound discrimination device that instructs to display flickering light and / or a picture on the display screen unit corresponding to the information can be connected to the microphone and the image display unit respectively A portable power source, which is detachably mounted on the frame and supplies power to the display screen unit, the microphone, and the sound discrimination device, is attached to the sound discrimination device, and the sound collected by the microphone is a specific frequency by the sound discrimination device When it is determined, the display screen unit displays blinking light or / and a picture corresponding to the information,
Alternatively, a camera for capturing a rear image is disposed in a frame, and when the sound collected by the microphone is from the rear and it is determined that the registered specific frequency, flickering light is first displayed on the display screen unit Thereafter, when the user's walking is stopped, the rear image by the camera is displayed on the display screen unit.
Alternatively, it is characterized in that the frame is a glasses type, the display screen unit is disposed on the inner side of one lens, and the opaque member is disposed on the back side of the display screen unit.
Alternatively, an acceleration sensor may be connected to the sound discrimination device and attached, and the rear image by the camera may be displayed on the display screen unit by detection of the user's walking stop by the acceleration sensor.

According to the head mounted display according to the present invention, a sound of a blind spot which can not be confirmed by visual observation hidden by a thing in front vision by a microphone is also collected, this sound information is visualized, and danger information is visually displayed to the user. Can tell.

In addition, since the sound of the rear can be collected by the microphone, the rear danger information can also be transmitted visually.

Also, by arranging the camera for capturing the rear image, the hazard information from the rear is first transmitted to the user by the blinking light, and then when the user's walking stops, the image is displayed. Can be clearly and visually communicated, and risk can be avoided early.

In addition, the frame is a glasses type, and the display screen unit is disposed on the inner side (face side) of one of the spectacle lenses, and the opaque member is disposed on the back side (glass lens side) of the display screen unit. The display can be made more visible.

Further, by arranging the acceleration sensor, it is possible to display the rear image by the camera on the display screen portion only when detecting the user's walking stop, and to ensure the safety of the user's walking.

It is an exploded perspective view of a head mount display concerning the present invention, and a partial expansion side view is shown in the lower part. Similarly, three views showing the state of use. Explanatory drawing of the drawing displayed on a display screen part similarly. Similarly, it is a flowchart figure which visualizes a sound, (a) is sound recognition, (b) is a sound direction. The perspective view which shows another example. It is a perspective view which shows another example, and shows the elements on larger scale in the lower part. It is the perspective view and front view which show another example, and shows the sound collection direction of a microphone in the lower part. The perspective view which shows another example. FIG. 7 is a plan view showing an arrangement possible range of a display screen unit.

The purpose of visualizing blind spot sound information that can not be confirmed visually by the shadow of a thing in the front view and to convey the danger behind is a display screen unit that displays an image, a microphone that collects surrounding sound, and a rear The present invention is realized by a camera for capturing an image, and a sound discrimination device for instructing display of a blinking light, picture or image corresponding to collected sound information on a display screen.

The present invention is not limited to the following embodiments, and various changes, modifications, and improvements can be made without departing from the scope of the invention.

A head mounted display according to the present invention will be described based on FIGS. 1-4.

The basic configuration of the head mounted display 10 of this embodiment is such that a display screen unit 12 for displaying an image according to information is provided in a frame 14.

In this example, the frame 14 is formed in a spectacles shape, is constituted by the front portion 14a and the temple portion 14b, and further the temple portion 14b is divided into two, and the temple portion 14c is detachable from the temple portion 14b. Is a connection terminal structure.

When a microphone 16 for collecting surrounding sounds is disposed in the frame 14 and the sound collected by the microphone 16 has a specific frequency registered in advance, the screen displays a blinking light and a picture corresponding to the information A sound discrimination device 18 for instructing display at 12 is detachably attached to the frame 14 so as to be connectable to the microphone and the image display unit 12, respectively.

In the present embodiment, the microphones 16 are arranged in the longitudinal direction at a predetermined interval on the temple portion 14b of the frame 14. Therefore, the sound collecting property of the sound emitted from the front and the back is improved.

Furthermore, the determination of the type and direction of the sound is performed using the difference in the horizontal distance between the two microphones 16a and 16b disposed in the temple portion 14b (in this example, a distance of about several centimeters is required) ( See Figure 4).

For this reason, it is important for the microphones 16a and 16b to be horizontal with respect to the sound to be collected, but it is sufficient to place either the front or the rear horizontally.

The frequency registered in advance is an approaching sound of a car, a horning sound, an approaching sound of a bicycle, a bell sound, a siren sound emitted by an emergency vehicle, etc.

At this time, the sound can be optionally registered by near-field wireless communication such as Bluetooth (registered trademark) via a digital portable terminal such as a smart phone, or any sound can be registered in the sound discrimination device 18 It is.

Further, although the sound discrimination device 18 is detachably disposed below the temple portion 14 b of the frame 14, it is free to use the sound discrimination device 18 as another part of the frame 14.

Further, an acceleration sensor 20 is connected to and attached to the sound discrimination device 18.

The acceleration sensor 20 is for carrying by a user and detecting the walking or the stop of walking.

A camera 22 for capturing a rear image is disposed on the frame 14.

In this example, the camera 22 is disposed on the rear surface of the temple portion 14 c of the frame 14 in order to effectively capture the rear image.

After the danger information of the rear is displayed on the display screen 12 by the blinking light in advance and transmitted to the display screen 12, the rear image by the camera 22 is displayed on the display screen 12 after the acceleration sensor 20 detects that the user has stopped walking. It is controlled to display.

A portable power source 24 for supplying power to the display screen unit 12, the microphone 16, the sound discrimination device 18, the acceleration sensor 20 and the camera 22 to which each is connected is incorporated in the sound discrimination device 18.

In the present example, the portable power source 24 is a rechargeable battery.

Further, an example of a picture displayed on the display screen unit 12 is shown in FIG.

Depending on the frequency of the danger sound collected by the microphone 16, the car approaching from the upper left of Fig. 3, the approaching of the emergency vehicle, the approaching of the bicycle, a pictorial drawing showing the direction in the lower part of the figure, the sound discrimination device 18 Is selected and instructed.

In the drawings, L indicates a spectacle lens, P indicates a pad, and H indicates a recess for mounting an integral spectacle lens.

A method of visually conveying danger information to the user using the head mounted display 10 of this example will be described.

First, the user wears the head mounted display of this example as with ordinary glasses.

After that, the user walks outdoors.

When the user is walking and the sound collected by the microphone 16 of the head mounted display 10 is a frequency registered in advance in the sound discrimination device 18, the danger information according to the frequency is first flickered with light, Then, it is displayed on the display screen unit 12 by a pictorial drawing (see the upper pictorial drawing in FIG. 3) to visually convey danger information to the user.

At this time, the direction of the sound collected by the microphone 16 is also displayed on the display screen unit 12 as a pictorial drawing (see the lower drawing in FIG. 3).

In addition, sound information of a blind spot that can not be checked visually in the shadow of a thing in front vision can be visualized, displayed on the display screen unit 12 as a picture, and transmitted to the user. Can be avoided.

In addition, since the spectacle lens L is transparent, the user can view the front view together with the display on the display screen portion 12 without affecting the user's walking.

Further, when the direction of the sound collected by the microphone 16 is the rear, the rear image photographed by the camera 22 can also be displayed on the display screen unit 12.

The type and direction of the sound collected by the microphone 16 are determined by the flow shown in FIGS. 4 (a) and 4 (b).

Since this rear image is controlled to be displayed on the display screen unit 12 only when the acceleration sensor 20 detects that the user has stopped walking, there is no problem in terms of safety.

In addition, when the portable power source 24 becomes low or disappears, it is replaced with a newly charged new portable power source.

The portable power source 24 is internally provided in the sound discrimination device 18, is chargeable, and can be removed, so it can be easily replaced.

At this time, in order to warn the user that the remaining amount of power is low, it is possible to quickly replace the display by displaying flickering light, lighting or a picture different from the danger information on the display screen unit 12.

Thus, according to the head mounted display according to the present invention, it is possible to visually convey to the user any danger information sound of the front and rear, so it is effective for the hearing impaired person (especially for the middle-eared person). It is.

Also, since the portable power source 24 and the sound discrimination device 18 are separate from the frame 14 which is the head mount display main body, the weight is not heavy, and they can be worn like ordinary glasses, and the usability is improved. There is no problem at all.

In the present example, when transmitting the front hazard information, the flashing light and the picture are displayed on the display screen unit, but the display by the flashing light may be turned on, and when transmitting the rear hazard information, Since the rear image can be displayed, it is possible to omit the display by a pictorial view.

Another example is shown in FIG.

In this example, the shape of the spectacle lens L is different from that of the previous example, and a design of a preference can be selected, and can be freely used for replacement.

Also in the present embodiment, the same effects as in the first embodiment can be obtained.

Another example is shown in FIG.

In this example, the display screen unit 12 is disposed on the inner side (face side) of the spectacle lens L to make it easy to view the picture and the image displayed on the display screen unit 12 under sunlight even while using outdoors. Furthermore, a non-transmissive member 26 is disposed on the front side (the side of the spectacle lens L) of the display screen portion 12, and the display screen portion 12 on which the non-transmissive member 26 is disposed is detachably attached to the frame 14.

Also in the present embodiment, the same effects as in the first embodiment can be obtained.

Another example is shown in FIG.

In this example, the shapes of both front surfaces of the front portion 14a of the frame 14 and the shape of the spectacle lens L are changed, and the microphones 16a and 16b are also arranged on the front portion 14a.

Therefore, in addition to the same effect as that of the first embodiment, the left and right direction of the collected sound can be clearly determined.

Another example is shown in FIG.

In this example, the control method of the sound discrimination device 18 and the color and interval of the blinking light displayed on the display screen section 12 and the design of the information picture can be successively changed by the external controller 28.

Also in this example, the same effect as that of the first embodiment can be obtained, and in the case where a smartphone is used as the external controller 28, power can be obtained from the smartphone, so that portable power can be omitted. In addition, emergency disaster information such as an earthquake or tsunami received by the smartphone can also be transmitted to the user as blinking light or a picture.

Further, FIG. 9 shows a possible arrangement range 30 of the display screen unit 12.

According to this figure, it can be understood that the display screen unit 12 can be disposed between the frame 14 and the face.

  The head mounted display according to the present invention can be used not only as glasses but also as vehicles.

DESCRIPTION OF SYMBOLS 10 Head mounted display 12 Display screen part 14 Frame 14a Front part 14b Temple part 16 Microphone 18 Sound discrimination device 20 Acceleration sensor 22 Camera 24 Portable power supply 26 Impermeable member

Claims (2)

In an optical transmission type or transmission type head mounted display in which a display screen section for displaying an image according to information is arranged,
Place a microphone on the frame to collect the ambient sound,
The frame is of the glasses type,
The display screen unit is disposed inside one lens, and the opaque member is disposed on the back side of the display screen unit,
The microphones have a pair of two microphones in the front-rear direction at predetermined intervals in the temple portion of the frame.
When the sound collected by the microphone is a specific frequency registered in advance, a sound discrimination device for instructing to display flashing light or / and a picture on the display screen unit corresponding to the information is a microphone, an image display unit, and Each of them can be connected to the frame,
Attach a portable power supply that supplies power to the display screen unit, the microphone, and the sound discrimination device to the sound discrimination device,
When the sound collected by the microphone is determined to be a specific frequency by the sound determination device, the display screen unit displays blinking light or / and a picture corresponding to the information ;
Place the camera for capturing the rear image in the frame,
When the sound collected by the microphone is from the rear and it is determined that it is a registered specific frequency, first, flashing light is displayed on the display screen unit,
Thereafter, when the user's walking stops , an optical transmission type or transmission type head mounted display characterized by displaying a rear image by the camera on the display screen . Connect the acceleration sensor to the sound discrimination device and attach it,
2. The optical transmission type or transmission type head mounted display according to claim 1 , wherein the rear image by the camera is displayed on the display screen unit by detection of the user's walking stop by the acceleration sensor.