JP6004053B2 - Head-mounted display device and method for controlling head-mounted display device - Google Patents

Description

  The present invention relates to a head-mounted display device that is a display device mounted on the head and a method for controlling the head-mounted display device.

  A head-mounted display device (Head Mounted Display (HMD)), which is a display device mounted on the head, is known. The head-mounted display device, for example, generates image light representing an image using a liquid crystal display and a light source, and guides the generated image light to a user's eye using a projection optical system or a light guide plate Thus, the user is made to recognize the virtual image.

  In the head-mounted display as described above, when the user operates the control unit of the head-mounted display for the purpose of reproducing, stopping, fast-forwarding, for example, the image, the virtual image displayed in front of the user's eyes is There was a problem that the view could be obstructed and the operation could be hindered. In order to solve such a problem, conventionally, a range including a display area is imaged with a camera, a captured image is analyzed to detect a user's hand, and one of the detected hands and the other are detected. A technique for improving the visibility of an outside scene by reducing the visibility of an image displayed in a region formed with the other hand is known (for example, Patent Document 1).

JP 2010-2111408 A JP-A-9-212382

  The present invention provides a technique for improving visibility of an outside scene by detecting that a user has attempted to operate a control unit of a head-mounted display device with a configuration different from that of a conventional head-mounted display device. The purpose is to do.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples. A head-mounted display device that includes an image display unit for causing a user to visually recognize a virtual image using an image light generation unit that generates and emits image light representing an image, and has an operation surface and the image display A control unit that controls image display by the image display unit, and a direction determination unit that determines whether a user is facing the operation surface of the control unit using invisible light. The orientation determination unit determines that the user is facing the operation surface of the control unit when the invisible light is received, and the user determines that the control unit does not receive the invisible light. It is determined that the operation surface is not facing, and the control unit determines the brightness of the image light generation unit so as to reduce the visibility of the virtual image when it is determined that the user is facing the operation surface. Or generated by the image light generator Adjusting the image light, head-mounted display device. In addition, the present invention can be realized as the following forms or application examples.
[Form 1]
A head-mounted display device,
An image display unit for causing a user to visually recognize a virtual image using an image light generation unit that generates and emits image light representing an image;
A control unit having an operation surface and connected to the image display unit to control image display by the image display unit;
A first configuration comprising: a head-side light emitting unit that is disposed on the image display unit and emits invisible light; and a control unit-side light receiving unit that is disposed on the operation surface and receives the emitted invisible light. And a control unit side light emitting unit disposed on the operation surface and emitting the invisible light, and a head side light receiving unit disposed on the image display unit and receiving the emitted invisible light. At least one of the configurations, and
An orientation determination unit that determines whether a user is facing the operation surface of the control unit using the received invisible light;
With
The orientation determination unit
When receiving the invisible light, it is determined that the user is facing the operation surface of the control unit, and when not receiving the invisible light, it is determined that the user is not facing the operation surface of the control unit. And
The controller is
When it is determined that the user is facing the operation surface, the brightness of the image light generation unit is adjusted or generated by the image light generation unit so as to reduce the visibility of the virtual image. A head-mounted display device that adjusts the image light.
[Form 2]
A head-mounted display device according to mode 1,
Comprising both the first configuration and the second configuration;
The controller is
The invisible light is alternately emitted to the head side light emitting unit and the control unit side light emitting unit,
The orientation determination unit
A head-mounted display device that determines whether a user is facing the operation surface of the control unit using an output signal of the control unit side light receiving unit and an output signal of the head side light receiving unit.

[Application Example 1]
A head-mounted display device,
An image display unit that includes an image light generation unit that generates and emits image light representing an image, and a light guide unit that guides the emitted image light to the user's eyes, and allows the user to visually recognize a virtual image When,
A control unit having an operation surface and connected to the image display unit to control image display by the image display unit;
An orientation determination unit that determines whether a user is facing the operation surface of the control unit;
With
The controller is
When it is determined that the user is facing the operation surface, the brightness of the image light generation unit is adjusted or generated by the image light generation unit so as to reduce the visibility of the virtual image. A head-mounted display device that adjusts the image light.
With this configuration, the orientation determination unit determines whether the user is facing the operation surface of the control unit, and the control unit determines that the user is facing the operation surface when the virtual image is determined. The luminance of the image light generation unit is adjusted or the image light generated by the image light generation unit is adjusted so as to reduce the visibility of the image light. For this reason, in the head-mounted display device, it is detected that the user tried to operate the control unit of the head-mounted display device with a configuration different from the conventional one, and the visibility of the outside scene in the image display unit is improved. be able to.

[Application Example 2]
The head-mounted display device according to Application Example 1,
A head-side light emitting unit that is disposed in the image display unit and emits invisible light;
A controller-side light-receiving unit that is disposed on the operation surface and receives the emitted invisible light;
With
The orientation determination unit
It is determined whether the user faces the operation surface of the control unit by determining whether or not the operation surface and the image display unit face each other using an output signal of the control unit side light receiving unit. A head-mounted display device.
With this configuration, the head-side light emitting unit that emits invisible light is arranged on the image display unit, and the control unit-side light receiving unit that receives the emitted invisible light is arranged on the operation surface. Therefore, the orientation determination unit determines whether the operation surface and the image display unit face each other using the output signal of the control unit side light receiving unit, so that the user is facing the operation surface of the control unit. Can be determined.

[Application Example 3]
The head-mounted display device according to Application Example 2,
A control unit side light emitting unit disposed on the operation surface and emitting non-visible light;
A head-side light-receiving unit that is disposed in the image display unit and receives the emitted invisible light;
With
The controller is
The invisible light is alternately emitted to the head side light emitting unit and the control unit side light emitting unit,
The orientation determination unit
By using the output signal of the control unit side light receiving unit and the output signal of the head side light receiving unit to determine whether the operation surface and the image display unit face each other, the user can A head-mounted display device that determines whether the operation surface of the control unit is facing.
With this configuration, the control unit side light emitting unit that emits invisible light is further arranged on the operation surface, and the head side light receiving unit that receives the emitted invisible light is further arranged on the image display unit. Is placed. The control unit alternately emits invisible light to the head side light emitting unit and the control unit side light emitting unit, and the direction determination unit is configured to output an output signal from the control unit side light receiving unit and an output signal from the head side light receiving unit. To determine whether the user is facing the operation surface of the control unit by determining whether or not the operation surface and the image display unit are opposed to each other. In the display device, the accuracy of determination by the orientation determination unit can be improved.

[Application Example 4]
The head-mounted display device according to application example 2 or 3,
A contact detection unit for detecting contact with the control unit disposed in the control unit;
The controller is
A head-mounted device that, when contact with the control unit is detected, causes the head-side light emitting unit to emit the invisible light and the control unit-side light emitting unit to emit the invisible light. Type display device.
With such a configuration, a contact detection unit for detecting contact with the control unit is arranged in the control unit, so that when the contact with the control unit is detected, the control unit The invisible light can be emitted by the light emitting unit, and the invisible light can be emitted by the control unit side light emitting unit.

[Application Example 5]
The head-mounted display device according to any one of Application Examples 2 to 4,
The invisible light emitted by the head-side light emitting unit includes identification information for identifying the image display unit by pulse modulation of the invisible light,
The control unit includes a storage unit that stores authentication information for authenticating the image display unit connected to the control unit,
The orientation determination unit further includes
A head including an authentication unit that authenticates the image display unit by acquiring the identification information from an output signal of the control unit side light receiving unit and searching whether the acquired identification information is included in the authentication information; Wearable display device.
With such a configuration, since the invisible light emitted from the head side light emitting unit includes identification information for identifying the image display unit, the authentication unit is identified from the output signal of the control unit side light receiving unit. The image display unit can be authenticated by acquiring information and searching for whether the acquired identification information is included in the authentication information. As a result, erroneous recognition can be reduced.

[Application Example 6]
The head-mounted display device according to any one of Application Examples 1 to 5, further comprising:
An acceleration information detection unit for detecting acceleration information of the image display unit arranged in the image display unit;
Angular velocity information detection unit for detecting angular velocity information of the image display unit arranged in the image display unit;
With
The orientation determination unit
By using the detected acceleration information and the detected angular velocity information to determine whether or not the operation surface and the image display unit are opposed to each other, the user can control the operation surface of the control unit. A head-mounted display device that determines whether the head is facing.
With such a configuration, the image display unit includes an acceleration information detection unit for detecting acceleration information of the image display unit and an angular velocity information detection unit for detecting angular velocity information of the image display unit. Therefore, the orientation determination unit can determine whether the user is facing the operation surface of the control unit using the detected acceleration information and the detected angular velocity information.

[Application Example 7]
The head-mounted display device according to any one of Application Examples 1 to 6,
The image light generator is
A display element for generating the image;
A light source for emitting image light representing the generated image;
Including
The controller is
A head-mounted type that adjusts the brightness of the image light generation unit by turning off or reducing the illumination light of the light source when it is determined that the user is facing the operation surface of the control unit Display device.
With such a configuration, when the control unit determines that the user is facing the operation surface of the control unit, the brightness of the image light generation unit is reduced by turning off or reducing the illumination light of the light source. Therefore, the visibility of the outside scene in the image display unit can be improved.

[Application Example 8]
The head-mounted display device according to any one of Application Examples 1 to 6,
The image light generator is
A display element for generating the image;
A light source including a plurality of light emitters for emitting image light representing the generated image;
Including
The controller is
When it is determined that the user is facing the operation surface of the control unit, the illumination light of at least some of the plurality of light emitters is turned off or dimmed, whereby the image light A head-mounted display device that adjusts the luminance of the generation unit.
With such a configuration, the control unit turns off or turns off the illumination light of at least some of the plurality of light emitters when it is determined that the user is facing the operation surface of the control unit. Since the brightness of the image light generation unit is adjusted by dimming, it is possible to improve the visibility of some outside scenes in the image display unit.

[Application Example 9]
The head-mounted display device according to any one of Application Examples 1 to 6,
The controller is
When transmitting image data to the image light generation unit and determining that the user is facing the operation surface of the control unit, at least part of the image data to be transmitted is dummy data indicating black A head-mounted display device that adjusts the image light generated by the image light generation unit by replacing the image light.
With such a configuration, when the control unit determines that the user is facing the operation surface of the control unit, at least a part of the image data to be transmitted to the image light generation unit is a dummy indicating black. By replacing with data, the image light generated by the image light generation unit is adjusted, so that the visibility of the outside scene in the image display unit can be improved.

[Application Example 10]
The head-mounted display device according to any one of Application Examples 1 to 6,
The image light generator is
A display element for generating the image;
A light source for emitting image light representing the generated image;
Including
The controller is
When it is determined that the user is facing the operation surface of the control unit, the image light generated by the image light generation unit is reduced by reducing a liquid crystal aperture ratio of at least a part of the display element. Head-mounted display device that adjusts
With such a configuration, when it is determined that the user is facing the operation surface of the control unit, the control unit generates image light by reducing the liquid crystal aperture ratio of at least a part of the display element. Since the image light generated by the unit is adjusted, the visibility of the outside scene in the image display unit can be improved.

  The present invention can be realized in various modes. For example, a head-mounted display device and a head-mounted display device control method, a head-mounted display system, these methods, devices, or The present invention can be realized in the form of a computer program for realizing the function of the system, a recording medium on which the computer program is recorded, or the like.

It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in one Example of this invention. It is a block diagram which shows the composition of a head mount display functionally. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing which shows an example of the virtual image recognized by the user. It is a flowchart which shows the procedure of the hand | transparent process of a head mounted display. It is explanatory drawing which shows the mode of the image light production | generation part in step S106 of FIG. It is explanatory drawing which shows a mode that a hand transparency process (FIG. 5) is performed. It is explanatory drawing which shows the other process aspect in step S106 of a hand transparent process (FIG. 5). It is explanatory drawing which shows the structure of the external appearance of the head mounted display in 2nd Example. It is a block diagram which shows functionally the structure of the head mounted display in 2nd Example. It is a flowchart which shows the procedure of the hand transmission process of the head mounted display in 2nd Example. It is a block diagram which shows functionally the structure of the head mounted display in a modification.

  Next, embodiments of the present invention will be described in the following order based on examples.

A. First embodiment:
(A-1) Configuration of the head-mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device according to an embodiment of the present invention. The head-mounted display device HM is a display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display HM of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene.

  The head-mounted display HM includes an image display unit 20 that allows the user to visually recognize a virtual image while being mounted on the user's head, and a control unit (controller) 10 that controls the image display unit 20.

  The image display unit 20 is a wearing body that is worn on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes an ear hook unit 21, a right display drive unit 22, a left display drive unit 24, a right optical panel 26, a left optical panel 28, a head-side light emitting unit 61, and a head-side light reception. Part 65. The ear hook portion 21 is a member provided so as to cross over the user's ear from the end portions of the right display drive portion 22 and the left display drive portion 24, and functions as a temple. The right optical panel 26 and the left optical panel 28 are disposed so as to be positioned in front of the user's right and left eyes, respectively, when the user wears the image display unit 20. The right display driving unit 22 is disposed at a connection portion between the right ear hooking portion 21 and the right optical panel 26. Further, the left display driving unit 24 is disposed at a connection portion between the left ear hooking portion 21 and the left optical panel 28. Hereinafter, the right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical panel 26 and the left optical panel 28 are also collectively referred to simply as “optical panel”.

  The head-side light emitting unit 61 and the head-side light receiving unit 65 are adjacent to the front surface of the housing forming the optical panel (in the present embodiment, near the upper center of the right optical panel 26 and the left optical panel 28). Is arranged. An infrared light emitting diode is used for the head side light emitting unit 61 in the present embodiment, and emits infrared light which is invisible light. Further, an infrared photodiode is used for the head-side light receiving unit 65 in the present embodiment, and receives infrared light.

  The display driving unit includes an LCD (Liquid Crystal Display), a projection optical system, and the like (not shown). Details will be described later. The optical panel includes a light guide plate (not shown) and a light control plate. The light guide plate is formed of a light transmissive resin material or the like, and emits image light taken from the display driving unit toward the user's eyes. The light control plate is a thin plate-like optical element, and is arranged so as to cover the front side (the side opposite to the user's eye side). The light control plate protects the light guide plate, suppresses damage to the light guide plate, adhesion of dirt, etc., and adjusts the light transmittance of the light control plate to adjust the amount of external light entering the user's eyes. The ease of visual recognition of the virtual image can be adjusted. The light control plate can be omitted.

  The image display unit 20 further includes a right earphone 32 for the right ear and a left earphone 34 for the left ear. The right earphone 32 and the left earphone 34 are respectively attached to the right and left ears when the user wears the image display unit 20.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48 connected to the control unit 10, a right cord 42 in which the main body cord 48 branches into two, a left cord 44, and a connecting member 46 provided at the branch point. Yes. The right cord 42 is connected to the right display driving unit 22, and the left cord 44 is connected to the left display driving unit 24. The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. A connector (not shown) that is fitted to each other is provided at the end of the main body cord 48 opposite to the connecting member 46 and the control section 10, and the main body cord 48 connector and the connector of the control section 10 are provided. The control unit 10 and the image display unit 20 are connected to or disconnected from each other by the fitting / releasing. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for operating the head mounted display HM. The control unit 10 includes a lighting unit 12, a touch pad 14, a cross key 16, a power switch 18, a control unit side light emitting unit 62, and a control unit side light receiving unit 66. The lighting unit 12 notifies the operation state of the head mounted display HM (for example, ON / OFF of the power supply) according to the light emission state. For example, an LED (Light Emitting Diode) can be used as the lighting unit 12. The touch pad 14 detects a user's finger operation on the operation surface of the touch pad 14 and outputs a signal corresponding to the detected content. The cross key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head mounted display HM by detecting a slide operation of the switch. Of the casing of the control unit 10, the surface on which the main components (that is, the touch pad 14 and the cross key 16) for the user to operate the control unit 10 are arranged is “operation surface”. Also called.

  The control unit side light emitting unit 62 and the control unit side light receiving unit 66 have a center line in a vertical direction on the operation surface of the control unit 10 that is difficult to hide when the user holds the control unit 10 in his / her hand. It is arranged near the center line when taken. In this embodiment, the control unit side light emitting unit 62 and the control unit side light receiving unit 66 are arranged on both sides of the lighting unit 12 on the operation surface. An infrared light emitting diode is used for the control unit side light emitting unit 62 in the present embodiment, and emits infrared light which is invisible light. In addition, an infrared photodiode is used for the control unit side light receiving unit 66 in this embodiment, and receives infrared rays.

  FIG. 2 is a block diagram functionally showing the configuration of the head mounted display HM. The control unit 10 includes a control unit side light emitting unit 62, a control unit side light receiving unit 66, an input information acquisition unit 110, a storage unit 120, a power supply 130, a CPU 140, an interface 180, and a transmission unit (Tx) 51. And 52, and each part is mutually connected by a bus (not shown).

  The input information acquisition unit 110 has a function of acquiring a signal (for example, an operation input to the touch pad 14, the cross key 16, and the power switch 18) according to an operation input by the user. The storage unit 120 is a storage unit including a ROM, a RAM, a DRAM, a hard disk, etc. (not shown). The power supply 130 supplies power to each part of the head mounted display HM. As the power supply 130, for example, a secondary battery can be used.

  The CPU 140 provides a function as an operating system (OS) 150 by executing a program installed in advance. The CPU 140 also functions as an orientation determination unit 145, an image processing unit 160, an audio processing unit 170, and a display control unit 190 by developing firmware and computer programs stored in a ROM and a hard disk in the RAM and executing them. To do. Details of these parts will be described later.

  The control unit side light receiving unit 66 receives the infrared light emitted from the head side light emitting unit 61, and outputs an output signal corresponding to the received infrared signal pattern to the direction determination unit 145. The direction determination unit 145 controls the driving of the head side light emitting unit 61, the control unit side light emitting unit 62, the head side light receiving unit 65, and the control unit side light receiving unit 66, and the head side light receiving unit 65 and the control unit side. Using the output signal from the light receiving unit 66, hand transmission processing is executed. The hand transmission process is a process of erasing the virtual image displayed on the image display unit 20 when it is determined that the user is facing the operation surface of the control unit 10. Details will be described later.

  The interface 180 is an interface for connecting various external devices OA (for example, a personal computer PC, a mobile phone terminal, and a game terminal) serving as a content supply source to the control unit 10. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, a wireless LAN interface, or the like can be provided. The content means information content including an image (still image, moving image), sound, and the like.

  The image processing unit 160 generates a clock signal PCLK, a vertical synchronization signal VSync, a horizontal synchronization signal HSync, and image data Data based on content input through the interface 180, and outputs these signals to the image through the connection unit 40. This is supplied to the display unit 20. Specifically, the image processing unit 160 acquires an image signal included in the content. For example, in the case of a moving image, the acquired image signal is generally an analog signal composed of 30 frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates a clock signal PCLK using a PLL circuit (not shown) or the like according to the period of the separated vertical synchronization signal VSync and horizontal synchronization signal HSync.

  The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal in the DRAM in the storage unit 120 for each frame as image data Data (RGB data) of the target image. Note that the image processing unit 160 may execute image processing such as resolution conversion processing, various tone correction processing such as adjustment of luminance and saturation, and keystone correction processing on the image data as necessary. .

  The image processing unit 160 transmits the generated clock signal PCLK, vertical synchronization signal VSync, horizontal synchronization signal HSync, and image data Data stored in the DRAM in the storage unit 120 via the transmission units 51 and 52, respectively. . The image data Data transmitted via the transmission unit 51 is also referred to as “right eye image data”, and the image data Data transmitted via the transmission unit 52 is also referred to as “left eye image data”. The transmission units 51 and 52 function as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The display control unit 190 generates control signals for controlling the right display drive unit 22 and the left display drive unit 24. Specifically, the display control unit 190 uses the control signal to turn on / off the right LCD 241 by the right LCD control unit 211, turn on / off the right backlight 221 by the right backlight control unit 201, and control the left LCD. The left display drive unit 22 and the left display drive unit 24 are controlled by individually controlling the ON / OFF of the left LCD 242 by the unit 212 and the ON / OFF of the left backlight 222 by the left backlight control unit 202. Each controls the generation and emission of image light. For example, the display control unit 190 may cause both the right display driving unit 22 and the left display driving unit 24 to generate image light, generate only one image light, or neither may generate image light.

  The display control unit 190 transmits control signals for the right LCD control unit 211 and the left LCD control unit 212 via the transmission units 51 and 52, respectively. In addition, the display control unit 190 transmits control signals for the right backlight control unit 201 and the left backlight control unit 202, respectively.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and supplies the acquired audio signal to the right earphone 32 and the left earphone 34 of the image display unit 20 via the connection unit 40.

  The image display unit 20 includes a right display driving unit 22, a left display driving unit 24, a right light guide plate 261 as the right optical panel 26, a left light guide plate 262 as the left optical panel 28, and a head side light emitting unit 61. A head-side light receiving unit 65, a right earphone 32, and a left earphone 34.

  The head-side light receiving unit 65 receives the infrared light emitted from the control unit-side light emitting unit 62, and outputs an output signal corresponding to the received infrared signal pattern to the direction determining unit 145. The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are also collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 has a function of driving the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED. The right LCD control unit 211 has a function of driving the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the reception unit 53. Have. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  FIG. 3 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal corresponding to each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221. It has a function of modulating into effective image light PL representing an image. As shown in FIG. 3, in this embodiment, the backlight method is adopted. However, the image light may be emitted using a front light method or a reflection method.

  The right projection optical system 251 in FIG. 2 is configured by a collimating lens that converts image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical panel 26 guides the image light output from the right projection optical system 251 to the right eye of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”.

  The left display driving unit 24 includes a receiving unit (Rx) 54, a left backlight (BL) control unit 202 and a left backlight (BL) 222 that function as a light source, a left LCD control unit 212 and a left that function as a display element. An LCD 242 and a left projection optical system 252 are included. The left backlight control unit 202, the left LCD control unit 212, the left backlight 222, and the left LCD 242 are collectively referred to as an “image light generation unit”, the left projection optical system 252, and the left light guide plate 262. Are also collectively referred to as “light guides”. The right display drive unit 22 and the left display drive unit 24 are paired. Since each unit of the left display drive unit 24 has the same configuration and operation as each unit described in the right display drive unit 22, a detailed description will be given. Omitted.

  FIG. 4 is an explanatory diagram illustrating an example of a virtual image recognized by the user. As described above, the image light guided to both eyes of the user of the head mounted display HM forms an image on the retina of the user, so that the user can visually recognize the virtual image. As shown in FIG. 4, a virtual image VI is displayed in the visual field VR of the user of the head mounted display HM. In addition, the user can see the outside scene SC through the right optical panel 26 and the left optical panel 28 except for the portion of the user's visual field VR where the virtual image VI is displayed. In the head mounted display HM of the present embodiment, the outside scene SC can be seen through the virtual image VI even in the portion where the virtual image VI is displayed in the visual field VR of the user.

(A-2) Hand transparency process:
FIG. 5 is a flowchart showing the procedure of the hand-transmitting process of the head mounted display HM. In the hand transparent process, the operation surface of the control unit 10 and the image display unit 20 face each other because the user is facing the operation surface of the control unit 10, that is, because the user tried to operate the control unit 10. This is a process of erasing the virtual image displayed on the image display unit 20 when it is detected that it has become, and is always executed after the head mounted display HM is activated.

  The direction determination unit 145 of the control unit 10 causes the head side light emitting unit 61 and the control unit side light emitting unit 62 to emit light (step S102). Specifically, the direction determination unit 145 of the control unit 10 drives the head side light emitting unit 61 and the control unit side light emitting unit 62 alternately to thereby turn the head side light emitting unit 61 and the control unit side light emitting unit. Infrared rays are alternately emitted to 62. Thus, by alternately emitting infrared rays, it is possible to suppress interference between infrared rays from the head-side light emitting unit 61 and infrared rays from the control-unit-side light emitting unit 62. The unit time for time division can be arbitrarily determined.

  The direction determination unit 145 determines whether or not the head side light receiving unit 65 and the control unit side light receiving unit 66 have received infrared rays (step S104). Specifically, the orientation determination unit 145 determines whether or not both the output signal from the head side light receiving unit 65 and the output signal from the control unit side light receiving unit 66 are received within a predetermined time. . When both are received, the orientation determination unit 145 determines that the head side light receiving unit 65 and the control unit side light receiving unit 66 have received infrared rays (step S104: YES). When neither one is received, the direction determination unit 145 determines that the head side light receiving unit 65 and the control unit side light receiving unit 66 are not receiving infrared rays (step S104: NO). Although the predetermined time can be arbitrarily determined, it is preferably set to be twice or more the unit time in step S102.

  When the head-side light receiving unit 65 and the control unit-side light receiving unit 66 do not receive infrared rays (step S104: NO), the orientation determination unit 145 causes the process to transition to step S102, and the head-side light emitting unit 61 and the control are controlled. The part side light emitting part 62 is caused to emit light. On the other hand, when the head side light receiving unit 65 and the control unit side light receiving unit 66 receive infrared rays (step S104: YES), the direction determination unit 145 turns off the backlight (step S106). Specifically, the orientation determination unit 145 requests the display control unit 190 of the control unit 10 to turn off the backlight.

  FIG. 6 is an explanatory diagram showing the state of the image light generation unit in step S106 of FIG. In step S <b> 106 in FIG. 5, the display control unit 190 that has received the request from the orientation determination unit 145 receives a control signal indicating that the right backlight 221 is turned off by the right backlight control unit 201 and the left backlight control unit 202. A control signal indicating that the left backlight 222 is driven off is transmitted to the image display unit 20. The right backlight control unit 201 that has received the signal turns off the right backlight 221. Similarly, the left backlight control unit 202 that has received the signal turns off the left backlight 222. As a result, as shown in FIG. 6, since the images drawn on the right LCD 241 and the left LCD 242 are not emitted as image light, the display of the virtual image VI disappears from the visual field VR of the user.

  After the backlight is turned off, the orientation determination unit 145 determines whether or not the head side light receiving unit 65 and the control unit side light receiving unit 66 continue to receive infrared rays (step S108). The determination in step S108 is performed by the same method as in step S104.

  When the head-side light receiving unit 65 and the control unit-side light receiving unit 66 continue to receive infrared light (step S108: YES), the direction determination unit 145 causes the process to transition to step S106 and continues the backlight off state. To do. On the other hand, when any one of the head side light receiving unit 65 and the control unit side light receiving unit 66 does not receive infrared rays (step S104: YES), the direction determining unit 145 turns on the backlight (step S110). Specifically, the orientation determination unit 145 requests the display control unit 190 of the control unit 10 to turn on the backlight, and ends the process.

  In step S <b> 110 of FIG. 5, the display control unit 190 that has received the request from the orientation determination unit 145 receives a control signal indicating that the right backlight 221 is turned on by the right backlight control unit 201 and the left backlight control unit 202. A control signal indicating that the left backlight 222 is turned on is transmitted to the image display unit 20. The right backlight control unit 201 that has received the signal turns on the right backlight 221. Similarly, the left backlight control unit 202 that has received the signal turns on the left backlight 222. As a result, the images drawn on the right LCD 241 and the left LCD 242 are emitted as image light, and the virtual image VI is displayed again in the visual field VR of the user.

  FIG. 7 is an explanatory diagram showing how the hand transparency process (FIG. 5) is executed. FIG. 7A shows a state where the user wearing the head mounted display HM is facing a place other than the operation surface of the control unit 10. When the user wearing the head mounted display HM is facing a place other than the operation surface of the control unit 10, the infrared CA emitted from the head side light emitting unit 61 of the image display unit 20, and the control unit of the control unit 10 Both the infrared rays MA emitted from the side light emitting unit 62 are not received (FIG. 5, step S104: NO). Accordingly, since the backlight is not turned off (step S106) in the hand transmission process, the virtual image VI is displayed in the visual field VR of the user.

  FIG. 7B shows a state where the user wearing the head mounted display HM faces the operation surface of the control unit 10. When the user wearing the head mounted display HM faces the operation surface of the control unit 10, the infrared CA emitted from the head side light emitting unit 61 of the image display unit 20 is transmitted to the control unit side light receiving unit 66 of the control unit 10. Is received by. Similarly, infrared MA emitted from the control unit side light emitting unit 62 of the control unit 10 is also received by the head side light receiving unit 65 of the image display unit 20 (FIG. 5, step S104: YES). Accordingly, the backlight is turned off (step S106) in the hand transmission process, and the display of the virtual image VI disappears from the visual field VR of the user. As a result of the display of the virtual image VI blocking the visual field VR disappearing, the user can clearly see the outside scene, that is, the operation surface of the control unit 10.

  7B, the user wearing the head mounted display HM is facing the operation surface of the control unit 10, in other words, the optical panel surface of the image display unit 20 and the control unit. The state in which the ten operation surfaces face each other is also referred to as “the operation surface and the image display unit 20 face each other”.

  When the right backlight 221 and the left backlight 222 include a plurality of light emitters (LEDs or the like), for example, the following process may be performed in step S106 of the hand transmission process (FIG. 5).

  FIG. 8 is an explanatory diagram showing another processing mode in step S106 of the hand transparency process (FIG. 5). A right backlight 221 and a left backlight 222 shown in FIG. 8 are light sources including 12 LEDs. In step S <b> 106 of FIG. 5, the orientation determination unit 145 requests the display control unit 190 of the control unit 10 to turn off some of the LEDs. The display control unit 190 that has received the request sends an identifier for identifying each LED to the right backlight control unit 201 and the left backlight control unit 202, and a control signal for designating ON / OFF of each LED. Send. The right backlight control unit 201 that has received the signal turns off some of the designated LEDs in the right backlight 221. Similarly, the left backlight control unit 202 turns off some specified LEDs in the left backlight 222.

  As a result, as shown in FIG. 8, among the images drawn on the right LCD 241 and the left LCD 242, an image corresponding to a portion of the region PT where the turned-off LED is arranged is not emitted as image light. For this reason, the virtual image VI of the other part except the area | region PT is displayed on a user's visual field VR. In this way, the virtual image VI of the portion corresponding to the region PT where the extinguished LED is arranged is not displayed, so that the visibility of the outside scene in the region PT can be improved.

  In FIG. 8, the operation description and function description of the control unit 10 may be displayed in other portions except for the region PT. Then, the user can check the operation surface on the control unit side while referring to the operation explanation and the function explanation while wearing the head mounted display HM. For this reason, convenience can be improved.

  Furthermore, in step S106 of the hand transparency process (FIG. 5), the orientation determination unit 145 may perform the following process, for example, instead of turning off the backlight.

  In step S <b> 106 of FIG. 5, the orientation determination unit 145 requests the display control unit 190 of the control unit 10 to reduce the luminance of the backlight. Upon receiving the request, the display control unit 190 designates the backlight brightness together with a control signal for designating ON / OFF of the backlight to the right backlight control unit 201 and the left backlight control unit 202. Send a control signal. As a control signal for designating the luminance of the backlight, for example, a PWM (Pulse Width Modulation) signal can be used. In this way, in step S106, the illumination light is reduced by the backlight (right backlight 221, left backlight 222) instead of turning off the backlight. If the illumination light is dimmed, the image light emitted by the image light generation unit becomes weak (the luminance of the image light generation unit decreases), so the virtual image VI displayed in the user's visual field VR is thin and blurred. It looks like this. Therefore, the user can easily see the outside scene, that is, the operation surface of the control unit 10.

  In step S106 in FIG. 5, the orientation determination unit 145 requests the display control unit 190 of the control unit 10 to reduce the aperture ratio of the LCD (liquid crystal). The display control unit 190 that has received the request transmits a control signal for designating the aperture ratio of the LCD to the right LCD control unit 211 and the left LCD control unit 212. In this way, in step S106, instead of turning off the backlight, the aperture ratio of the LCD (right LCD 241 and left LCD 242) is reduced. If the liquid crystal aperture ratio decreases, the image light emitted by the image light generation unit becomes weak, so that the virtual image VI displayed in the user's visual field VR becomes a light and blurry display. Therefore, the user can easily see the outside scene, that is, the operation surface of the control unit 10.

  In step S106 of FIG. 5, the orientation determination unit 145 requests the image processing unit 160 of the control unit 10 to set the image data Data to be black dummy data. The image processing unit 160 that has received the request changes the image data Data to be transmitted to the image display unit 20 to black one-color dummy data. In this way, in step S106, the image drawn on the LCD (the right LCD 241 and the left LCD 242) is adjusted to a black one-color dummy image, and the image light generation unit emits the corresponding image light. The virtual image VI displayed in the visual field VR of the user is displayed as if it disappeared. Therefore, the user can easily see the outside scene, that is, the operation surface of the control unit 10. Note that the image processing unit 160 may replace at least a part of the image data Data with black one-color dummy data.

  As described above, according to the first embodiment, the orientation determination unit 145 determines whether the user is facing the operation surface of the control unit 10, and the control unit 10 is the user facing the operation surface. In order to adjust the luminance of the image light generation unit or adjust the image light PL generated by the image light generation unit so as to reduce the visibility of the virtual image VI, the head mounted display HM Therefore, with a configuration different from the conventional one, it is possible to detect that the user has tried to operate the control unit 10 of the head mounted display HM, and to improve the visibility of the outside scene SC on the image display unit 20.

  Specifically, a head-side light emitting unit 61 that emits invisible light (infrared rays) is disposed in the image display unit 20, and the control unit side that receives the emitted invisible light is disposed on the operation surface of the control unit 10. A light receiving unit 66 is disposed. In addition, a control unit side light emitting unit 62 that emits invisible light (infrared rays) is further arranged on the operation surface of the control unit 10, and the image display unit 20 further includes a head that receives the emitted invisible light. A side light receiving unit 65 is disposed. The control unit 10 causes the head-side light emitting unit 61 and the control unit-side light emitting unit 62 to emit invisible light alternately, and the orientation determination unit 145 outputs the output signal from the control unit-side light receiving unit 66 and the head Using the output signal of the side light receiving unit 65, it is determined whether or not the operation surface of the control unit 10 and the image display unit 20 face each other. When the user intends to operate the control unit 10 of the head mounted display HM, the user looks at the operation surface of the control unit 10, that is, the user faces the operation surface (in other words, the user's head). Therefore, the orientation determination unit 145 determines whether the operation surface of the control unit 10 and the image display unit 20 are opposed to each other as described above. It can be determined whether the user is facing the operation surface.

  When it is determined that the user faces the operation surface (that is, the operation surface of the control unit 10 and the image display unit 20 face each other), the control unit 10 determines the light source (the right backlight 221, the left backlight). By turning off or reducing the illumination light IL of the light 222), the luminance of the image light generation unit can be adjusted so as to reduce the visibility of the virtual image VI. In addition, when it is determined that the user faces the operation surface (that is, the operation surface of the control unit 10 and the image display unit 20 face each other), the control unit 10 transmits the image to the image light generation unit. By replacing at least part of the image data Data with dummy data indicating black, the image light PL generated by the image light generation unit can be adjusted so as to reduce the visibility of the virtual image VI. In addition, when it is determined that the user faces the operation surface (that is, the operation surface of the control unit 10 and the image display unit 20 face each other), the control unit 10 displays the display element (right LCD 241, left By reducing the liquid crystal aperture ratio of at least a part of the LCD 242), the image light PL generated by the image light generation unit can be adjusted so as to reduce the visibility of the virtual image VI. In this way, the visibility of the virtual image VI that blocks the user's visual field VR is reduced. As a result, the visibility of the outside scene in the image display unit can be improved, and the user can operate the outside scene, that is, the operation of the control unit 10. You can see the face clearly.

  Furthermore, according to the present embodiment, an infrared light emitting unit that emits infrared rays is used as the head side light emitting unit 61 and the control unit side light emitting unit 62, and the head side light receiving unit 65 and the control unit side light receiving unit 66 are emitted. Since an infrared light receiving unit that receives infrared light is used, a head mounted display HM that improves the visibility of the outside scene in the image display unit 20 with a configuration different from the conventional one can be realized at low cost.

  Furthermore, according to the present embodiment, a set of a light emitting unit and a light receiving unit is arranged in the control unit 10 and the image display unit 20, respectively. The control unit 10 alternately emits invisible light (infrared rays) to the two light emitting units (the head side light emitting unit 61 and the control unit side light emitting unit 62), and the direction determination unit 145 includes two light receiving units ( Since it is determined whether the operation surface of the control unit 10 and the image display unit 20 face each other using output signals from the control unit side light receiving unit 66 and the head side light receiving unit 65), erroneous determination is suppressed. In addition, the accuracy of determination by the direction determination unit 145 can be improved.

B. Second embodiment:
In the second embodiment of the present invention, a configuration capable of improving the reliability and power saving in the hand transmission process will be described. Below, only the part which has a different structure and operation | movement from 1st Example is demonstrated. In the figure, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment described above, and detailed description thereof is omitted.

(B-1) Configuration of the head-mounted display device:
FIG. 9 is an explanatory diagram showing an external configuration of the head mounted display HMa in the second embodiment. FIG. 10 is a block diagram functionally showing the configuration of the head mounted display HMa in the second embodiment. The difference from the first embodiment shown in FIGS. 1 and 2 is that a control unit 10a is provided instead of the control unit 10, and an image display unit 20a is provided instead of the image display unit 20.

  The image display unit 20 a includes a head side light emitting unit 61 a instead of the head side light emitting unit 61. The head-side light emitting unit 61a has a function of emitting infrared light that is invisible light. The head-side light emitting unit 61a emits an infrared signal having a signal pattern including identification information of the image display unit 20a by pulse-modulating the emitted infrared light. The identification information is information including an arbitrary character string or the like for identifying the image display unit 20a.

  The control unit 10 a includes a direction determination unit 145 a instead of the direction determination unit 145 and a contact detection unit 71. In addition, authentication information CI is stored in the storage unit 120 of the control unit 10a. The contact detection unit 71 is a part on the opposite side of the operation surface of the control unit 10a, and a part that is assumed to come into contact with the user's hand when the user performs an operation while holding the control unit 10a in his / her hand. (For example, it is arrange | positioned in the center part and the edge part of right and left). The contact detection unit 71 in the present embodiment is configured using a touch sensor, and detects contact by a user. Various types of touch sensors can be used. The orientation determination unit 145a includes an authentication unit 146. Details of the authentication unit 146 will be described later. In the authentication information CI stored in the storage unit 120, identification information of the image display unit 20a connected to the control unit 10a is stored in advance.

(B-2) Hand transparency processing:
FIG. 11 is a flowchart showing the procedure of the hand transparency process of the head mounted display HMa in the second embodiment. The only difference from the first embodiment shown in FIG. 5 is that steps S202 and S204 are further provided, and the other operations are the same as those of the first embodiment. First, the orientation determination unit 145a determines whether or not contact with the control unit 10a is detected based on an output signal from the contact detection unit 71 (step S202). If no contact is detected, the orientation determination unit 145a causes the process to transition to step S202. On the other hand, when contact is detected, the direction determination unit 145a of the control unit 10 shifts the process to step S204, and drives the head side light emitting unit 61a and the control unit side light emitting unit 62.

  In step S104, when it is determined that both the output signal from the head-side light receiving unit 65 and the output signal from the control unit-side light receiving unit 66 have been received, the authentication unit 146 of the orientation determination unit 145a determines the image display unit 20a. Is authenticated (step S204). Specifically, the authentication unit 146 matches the identification information of the image display unit 20 a acquired from the output signal from the control unit side light receiving unit 66 with the identification information in the authentication information CI stored in the storage unit 120. Or not, the image display unit 20a is authenticated. When the identification information included in the output signal matches the identification information in the authentication information CI, the authentication unit 146 determines that the authentication of the image display unit 20a has been successful (step S204: YES). On the other hand, if they do not match, the authentication unit 146 determines that the authentication of the image display unit 20a has failed (step S204: NO). When the authentication by the authentication unit 146 fails, the direction determination unit 145a shifts the process to step S102, and causes the head side light emitting unit 61a and the control unit side light emitting unit 62 to emit light. On the other hand, when the authentication by the authentication unit 146 is successful, the direction determination unit 145a shifts the process to step S106 and turns off the backlight.

  As described above, according to the second embodiment, the control unit 10a is provided with the contact detection unit 71 for detecting contact with the control unit 10a, and the orientation determination unit 145a of the control unit 10a includes the control unit 10a. When contact with 10a is detected, infrared emission by the head side light emitting unit 61a and infrared emission by the control unit side light emitting unit 62 are executed. When the user intends to operate the head mounted display HMa, the user generally takes the control unit 10a, and according to the second embodiment, the light emitting unit (head side light emitting unit 61, control The power consumption of the head mounted display HMa can be reduced as compared with a configuration in which infrared light is always emitted by the part-side light emitting part 62).

  Further, according to the second embodiment, the infrared light emitted from the head-side light emitting unit 61a includes identification information for identifying the image display unit 20a, and the authentication unit 146 outputs the output from the control unit-side light receiving unit 66. The image display unit 20a can be authenticated by acquiring the identification information of the image display unit 20a from the signal and searching whether the acquired identification information is included in the authentication information CI stored in advance. For this reason, for example, in public spaces, it is possible to reduce erroneous detection (incorrect recognition) of infrared rays emitted from other devices capable of emitting infrared rays, and to improve the reliability in hand transmission processing. Can be made. As described above, according to the second embodiment, in the head mounted display HMa, it is possible to further improve the reliability and power saving performance of the hand transmission process.

C. Variations:
In addition, this invention is not restricted to said Example and embodiment, A various structure can be taken in the range which does not deviate from the summary. For example, a function realized by software may be realized by hardware. In addition, the following modifications are possible.

C1. Modification 1:
In the said Example, it illustrated about the structure of the head mounted display. However, the configuration of the head-mounted display can be arbitrarily determined without departing from the gist of the present invention. For example, each component can be added, deleted, converted, and the like.

  In the above embodiment, for convenience of explanation, it is assumed that the control unit includes a transmission unit (51, 52) and the image display unit includes a reception unit (53, 54). However, each of the transmission units (51, 52) and the reception units (53, 54) of the above embodiment has a function capable of bidirectional communication, and can function as a transmission / reception unit.

  For example, as illustrated in FIG. 12, the connection unit may be omitted, and the control unit and the image display unit may be configured to perform wireless communication. Specifically, the control unit further includes a wireless communication unit (81), and the image display unit further includes a wireless communication unit (82) and a power source (280). In this case, the wireless communication unit 81 functions as the transmission unit (51, 52) in the above embodiment, and the wireless communication unit 82 functions as the reception unit (53, 54) in the above embodiment.

  For example, the configurations of the control unit and the image display unit illustrated in FIG. 1 can be arbitrarily changed. Specifically, for example, the touch panel may be omitted from the control unit, and the operation may be performed using only the cross key. Further, the control unit may be provided with another operation interface such as an operation stick. Moreover, it is good also as what receives an input from a keyboard or a mouse | mouth as a structure which can connect devices, such as a keyboard and a mouse | mouth, to a control part. In addition, a communication unit using Wi-Fi (wireless fidelity) or the like may be provided in the control unit.

  For example, the control unit illustrated in FIG. 1 is connected to the image display unit via a wired signal transmission path. However, the control unit and the image display unit may be connected by a connection via a wireless signal transmission path such as a wireless LAN, infrared communication, or Bluetooth (registered trademark).

  For example, although the head-mounted display is a binocular transmissive head-mounted display, the head-mounted display may be configured as a non-transmissive head-mounted display that blocks the outside scene when the user wears the head-mounted display. Good. A monocular head-mounted display may be used.

  For example, the image light generation unit is configured using left and right backlight control units, left and right LCD control units, left and right backlights, and left and right LCDs. EL (Organic Electro-Luminescence) and an organic EL control unit may be used. In that case, the organic EL and the organic EL control unit correspond to an “image light generation unit”.

  For example, the functional units such as the image processing unit, the display control unit, and the audio processing unit are described as being realized by the CPU developing and executing a computer program stored in the ROM or hard disk on the RAM. However, these functional units may be configured using an ASIC (Application Specific Integrated Circuit) designed to realize the function.

  For example, in the above-described embodiment, the image display unit is a head-mounted display that is mounted like glasses, but the image display unit is a normal flat display device (liquid crystal display device, plasma display device, organic EL display device, etc.) ). Also in this case, the connection between the control unit and the image display unit may be a connection via a wired signal transmission path or a connection via a wireless signal transmission path. In this way, the control unit can be used as a remote controller for a normal flat display device.

  Further, as the image display unit, instead of the image display unit worn like glasses, an image display unit of another shape such as an image display unit worn like a hat may be adopted. Further, the earphone may be an ear-hook type or a headband type, or may be omitted.

  For example, in the above embodiment, the secondary battery is used as the power source. However, the power source is not limited to the secondary battery, and various batteries can be used. For example, a primary battery, a fuel cell, a solar cell, a thermal cell, or the like may be used.

C2. Modification 2:
In the above embodiment, the image processing unit outputs the same image data as right-eye image data and left-eye image data. However, the image processing unit may be configured to allow the user to visually recognize a 3D virtual image by using different image data for the right eye image data and the left eye image data.

C3. Modification 3:
In the hand transmission process (FIGS. 5 and 11) of the above-described embodiment, the orientation determining unit displays the control unit and the image display depending on whether the head side light receiving unit and the output signal from the control unit side light receiving unit are received. It was decided to determine whether or not the part is facing. However, the aspect in the said Example is an example to the last, and the direction determination part can determine whether the control part and the image display part are facing using various methods.

  For example, one of the set of the head side light emitting unit and the control unit side light receiving unit or the set of the control unit side light emitting unit and the head side light receiving unit may be omitted. Even in this case, in the head mounted display, it is possible to detect that the user tried to operate the control unit with a configuration different from the conventional one, and to improve the visibility of the outside scene in the image display unit. Moreover, since only one set of the light emitting part and the light receiving part is required, it can be realized at low cost.

  For example, instead of a light emitting unit (head side light emitting unit, control unit side light emitting unit) and a light receiving unit (head side light receiving unit, control unit side light receiving unit), or in addition to a light emitting unit and a light receiving unit, an image The display unit may include an acceleration information detection unit for detecting acceleration information of the image display unit and an angular velocity information detection unit for detecting angular velocity information of the image display unit. For example, an acceleration sensor can be used as the acceleration information detection unit. For example, a gyro sensor can be used as the angular velocity information detection unit.

  When the configuration includes an acceleration information detection unit and an angular velocity information detection unit instead of the light emitting unit and the light reception unit, the orientation determination unit is configured to move the image display unit derived from the acceleration information and the angular velocity information (that is, the image display unit). The movement of the head wearing the user) matches the movement assumed in advance (for example, the movement of the user looking at the operation surface with his head facing down). Can be determined (step S104: YES). In this way, the same effect as in the embodiment can be obtained even when the acceleration information detection unit and the angular velocity information detection unit are configured in place of the light emitting unit and the light receiving unit.

  When the configuration includes an acceleration information detection unit and an angular velocity information detection unit in addition to the light emitting unit and the light receiving unit, the orientation determination unit receives output signals from both the head side light receiving unit and the control unit side light receiving unit. If it is determined that the movement of the image display unit (the movement of the user's head) derived from the acceleration information and the angular velocity information, the movement of the user's head (for example, the head down) is determined. It is possible to determine whether or not it coincides with the (directed movement). By doing so, it is possible to further improve the accuracy of the determination of “whether the user is facing the operation surface” in the hand transparency process.

  In addition to the light emitting unit and the light receiving unit, when the acceleration information detection unit and the angular velocity information detection unit are provided and the backlight includes a plurality of light emitters (LEDs), the orientation determination unit turns off the backlight. When performing the operation (step S106), which one of the plurality of light emitters is turned off according to the movement of the image display unit (the movement of the user's head) derived from the acceleration information and the angular velocity information. Can be determined. By doing so, the virtual image display of the portion corresponding to the region corresponding to the movement of the user's head is eliminated, so that the user's usability can be improved.

  Instead of the light emitting unit and the light receiving unit, or in addition to the light emitting unit and the light receiving unit, the image display unit may include a distance measuring sensor. In the case where a distance measuring sensor is provided instead of the light emitting unit and the light receiving unit, the same effect as in the embodiment can be obtained. Further, in the case where the distance measuring sensor is provided in addition to the light emitting unit and the light receiving unit, it is possible to further improve the accuracy of determination of “whether the user is facing the operation surface” in the hand transmission process. Furthermore, the orientation determination unit may adjust the luminance of the light source according to the distance between the control unit and the image display unit derived from the measurement result of the distance measuring sensor. For example, if the distance between the control unit and the image display unit is short, the orientation determination unit decreases the luminance of the light source (that is, reduces the luminance of the image light generation unit and reduces the display of the virtual image VI), and the control unit and the image If the distance from the display unit is long, the luminance of the light source can be increased (that is, the luminance of the image light generation unit is increased to make the virtual image VI display darker).

  In place of the light emitting unit and the light receiving unit or in addition to the light emitting unit and the light receiving unit, the image display unit includes a distance measuring sensor, and the backlight includes a plurality of light emitters (LEDs). When turning off the backlight (step S106), the direction determination unit further determines which of the plurality of light emitters according to the distance between the control unit and the image display unit derived from the measurement result of the distance measuring sensor. It can be determined whether to turn off the light emitter. For example, the orientation determination unit increases the number of light emitters that are turned off when the distance between the control unit and the image display unit is short (that is, increases the area of the non-image display area in the virtual image VI). If the distance to the part is long, the number of light emitters to be turned off can be reduced (that is, the area of the virtual image VI in which no image is displayed is reduced).

  Instead of the light emitting unit and the light receiving unit, or in addition to the light emitting unit and the light receiving unit, an imaging unit (for example, a CCD camera) may be provided in the control unit or the image display unit. When the control unit is configured to include an imaging unit, the orientation determination unit analyzes the captured image and determines whether the image includes the optical panel housing of the image display unit. When the captured image includes the optical panel housing, the orientation determination unit can determine that the operation surface and the image display unit face each other (step S104: YES). On the other hand, when the image display unit is configured to include the imaging unit, the orientation determination unit analyzes the captured image, and whether the image includes a touch pad or a cross key arranged on the operation surface of the control unit. Determine whether or not. When the captured image includes a touch pad or a cross key, the orientation determination unit can determine that the operation surface and the image display unit face each other (step S104: YES). When the configuration includes an imaging unit instead of the light emitting unit and the light receiving unit, the same effect as in the embodiment can be obtained. Moreover, when it is set as the structure provided with an imaging part in addition to a light emission part and a light-receiving part, the precision of determination of "the user is facing the operation surface" in hand transmission processing can be improved more.

C4. Modification 4:
In the hand transmission process (FIG. 11) of the second embodiment, the orientation determination unit drives the light emitting unit (the head side light emitting unit, the control unit side light emitting unit) when contact is detected by the contact detection unit. It was decided. However, the aspect in the said Example is an example to the last, and various deformation | transformation are possible.

  For example, the control unit may include an acceleration information detection unit (acceleration sensor) for detecting acceleration information of the control unit instead of the contact detection unit. In this case, the orientation determination unit can determine YES in step S202 when the acceleration information detection unit detects the inclination of the control unit. In this way, the same effect as in the embodiment can be obtained even when the acceleration information detection unit is provided instead of the contact detection unit.

  For example, the control unit can substitute the touch pad as a contact detection unit. In this way, a head mounted display can be realized at low cost.

DESCRIPTION OF SYMBOLS 10, 10a ... Control part 12 ... Lighting part 14 ... Touch pad 16 ... Cross key 18 ... Power switch 20, 20a ... Image display part 21 ... Ear hook part 22 ... Right display drive part 24 ... Left display drive part 26 ... Right optical Panel 28 ... Left optical panel 32 ... Right earphone 34 ... Left earphone 40 ... Connector 42 ... Right cord 44 ... Left cord 46 ... Connecting member 48 ... Body code 51 ... Transmitter 52 ... Transmitter 53 ... Receiver 54 ... Receiver 61, 61a ... head side light emitting unit 62 ... control unit side light emitting unit 65 ... head side light receiving unit 66 ... control unit side light receiving unit 71 ... contact detection unit 81 ... wireless communication unit 82 ... wireless communication unit 110 ... input information acquisition Unit 120 ... Storage unit 130 ... Power supply 140 ... CPU
145, 145a ... orientation determination unit 146 ... authentication unit 160 ... image processing unit 170 ... audio processing unit 180 ... interface 190 ... display control unit 201 ... right backlight control unit (image light generation unit, light source)
202 ... Left backlight control unit (image light generation unit, light source)
211 ... Right LCD controller (image light generator, display element)
212 ... Left LCD controller (image light generator, display element)
221 ... Right backlight (image light generator, light source)
222: Left backlight (image light generator, light source)
241 ... Right LCD (image light generator, display element)
242 ... Left LCD (image light generation unit, display element)
251 ... Right projection optical system (light guide unit)
252 ... Left projection optical system (light guide)
261 ... Right light guide plate (light guide part)
262 ... Left light guide plate (light guide part)
PCLK ... Clock signal VSync ... Vertical sync signal HSync ... Horizontal sync signal Data ... Image data CA ... Infrared MA ... Infrared OA ... External equipment SC ... Outside view PC ... Personal computer VI ... Virtual image CI ... Authentication information IL ... Illumination light PL ... Image light HM, HMa ... Head-mounted display (head-mounted display device)
VR: Field of view

Claims (13)

A head-mounted display device,
An image display unit for causing a user to visually recognize a virtual image using an image light generation unit that generates and emits image light representing an image;
A control unit having an operation surface and connected to the image display unit to control image display by the image display unit;
A first configuration comprising: a head-side light emitting unit that is disposed on the image display unit and emits invisible light; and a control unit-side light receiving unit that is disposed on the operation surface and receives the emitted invisible light. And a control unit side light emitting unit disposed on the operation surface and emitting the invisible light, and a head side light receiving unit disposed on the image display unit and receiving the emitted invisible light. At least one of the configurations, and
An orientation determination unit that determines whether a user is facing the operation surface of the control unit using the received invisible light;
With
The orientation determination unit
When receiving the invisible light, it is determined that the user is facing the operation surface of the control unit, and when not receiving the invisible light, it is determined that the user is not facing the operation surface of the control unit. And
The controller is
When it is determined that the user is facing the operation surface, the brightness of the image light generation unit is adjusted or generated by the image light generation unit so as to reduce the visibility of the virtual image. A head-mounted display device that adjusts the image light. The head-mounted display device according to claim 1 ,
Comprising both the first configuration and the second configuration ;
The controller is
The invisible light is alternately emitted to the head side light emitting unit and the control unit side light emitting unit,
The orientation determination unit
A head-mounted display device that determines whether a user is facing the operation surface of the control unit using an output signal of the control unit side light receiving unit and an output signal of the head side light receiving unit. The head-mounted display device according to claim 2 , further comprising:
A contact detection unit for detecting contact with the control unit disposed in the control unit;
The controller is
A head-mounted device that, when contact with the control unit is detected, causes the head-side light emitting unit to emit the invisible light and the control unit-side light emitting unit to emit the invisible light. Type display device. A head-mounted display device according to any one of claims 1 to 3 ,
The invisible light emitted by the head-side light emitting unit includes identification information for identifying the image display unit by pulse modulation of the invisible light,
The control unit includes a storage unit that stores authentication information for authenticating the image display unit connected to the control unit,
The orientation determination unit further includes
A head including an authentication unit that authenticates the image display unit by acquiring the identification information from an output signal of the control unit side light receiving unit and searching whether the acquired identification information is included in the authentication information; Wearable display device. The head-mounted display device according to any one of claims 1 to 4 , further comprising:
An acceleration information detection unit for detecting acceleration information of the image display unit arranged in the image display unit;
Angular velocity information detection unit for detecting angular velocity information of the image display unit arranged in the image display unit;
With
The orientation determination unit
By using the detected acceleration information and the detected angular velocity information to determine whether or not the operation surface and the image display unit are opposed to each other, the user can control the operation surface of the control unit. A head-mounted display device that determines whether the head is facing. The head-mounted display device according to any one of claims 1 to 5 ,
The image light generator is
A display element for generating the image;
A light source for emitting image light representing the generated image;
Including
The controller is
A head-mounted display device that adjusts the brightness of the image light generation unit by turning off or reducing the illumination light of the light source when it is determined that the user is facing the operation surface. The head-mounted display device according to any one of claims 1 to 5 ,
The image light generator is
A display element for generating the image;
A light source including a plurality of light emitters for emitting image light representing the generated image;
Including
The controller is
When it is determined that the user is facing the operation surface, the luminance of the image light generation unit is reduced by turning off or reducing the illumination light of at least some of the plurality of light emitters. Head-mounted display device that adjusts The head-mounted display device according to any one of claims 1 to 5 ,
The controller is
The image data is transmitted to the image light generation unit, and when it is determined that the user is facing the operation surface, at least a part of the image data to be transmitted is replaced with dummy data indicating black A head-mounted display device that adjusts the image light generated by the image light generation unit. The head-mounted display device according to any one of claims 1 to 5 ,
The image light generator is
A display element for generating the image;
A light source for emitting image light representing the generated image;
Including
The controller is
When it is determined that the user is facing the operation surface, the image light generated by the image light generation unit is adjusted by reducing the liquid crystal aperture ratio of at least a part of the display element. Head-mounted display device. A method for controlling a head-mounted display device having an operation surface and an image display unit ,
(A) a step of causing a user to visually recognize a virtual image using an image light generation unit that generates and emits image light representing an image;
(B) controlling the image display in the step (a);
(C) at least one of invisible light emitted from the control unit side light emitting unit arranged on the operation surface and invisible light emitted from the head side light emitting unit arranged on the image display unit using, a step of determining whether the user is facing forward SL operation surface, when receiving the non-visible light, it is determined that the user is facing the operating surface of the control unit, the A step of determining that the user is not facing the operation surface of the control unit when not receiving invisible light; and
In (d) If the user is determined to be facing forward SL operation surface, so reducing the visibility of the virtual image, to adjust the brightness of the image light generator, or the image light generator Adjusting the image light generated by:
A method for controlling a head-mounted display device. A head-mounted display device,
An image display unit for causing a user to visually recognize a virtual image using an image light generation unit that generates and emits image light representing an image;
A control unit having an operation surface and connected to the image display unit to control image display by the image display unit;
A head-side light emitting unit that is disposed in the image display unit and emits invisible light;
A controller-side light-receiving unit that is disposed on the operation surface and receives the emitted invisible light;
A direction determination unit that determines whether a user is facing the operation surface of the control unit , and
The invisible light emitted by the head-side light emitting unit includes identification information for identifying the image display unit,
The control unit further includes:
A storage unit for storing authentication information for authenticating the image display unit in advance;
By acquiring the identification information from the output signal of the control unit side light receiving unit and searching whether the acquired identification information is included in the authentication information, the image display unit is authenticated ,
When the authentication of the image display unit is successful and it is determined that the user is facing the operation surface, the brightness of the image light generation unit is adjusted so as to reduce the visibility of the virtual image. Or a head-mounted display device that adjusts the image light generated by the image light generation unit . The head-mounted display device according to claim 11 ,
The head-mounted display device, wherein the identification information is information for identifying the image display unit by pulse modulation of the invisible light. A method for controlling a head-mounted display device having an operation surface,
(A) a step of causing a user to visually recognize a virtual image by an image display unit including an image light generation unit that generates and emits image light representing an image;
(B) a step of controlling image display in the step (A) ;
(C) a step of emitting invisible light by the head-side light emitting unit arranged in the image display unit;
(D) The step of receiving the invisible light emitted in the step (C) by the control side light receiving unit disposed on the operation surface;
(E) determining whether the user is facing the operation surface;
With
The invisible light emitted by the step (C) includes identification information for identifying the image display unit,
In the step (B),
The identification information is acquired from the output signal obtained in the step (D), and whether the acquired identification information is authentication information stored in advance and is included in authentication information for authenticating the image display unit. By authenticating the image display unit, the image display unit is successfully authenticated, and when it is determined that the user is facing the operation surface, the visibility of the virtual image is reduced. As described above , the head-mounted display device that adjusts the luminance of the image light generation unit or adjusts the image light generated by the image light generation unit .

Images