JP2016122039A - Display device and control method of display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device attached to the head of a user, and appropriately adjust luminance of display with simple processing.SOLUTION: A head-mounted type display device 100 includes an image display part 20 that is attached to the head of a user and irradiates the eyes of the user with image light, and an illuminance sensor 68 that detects light. The head-mounted type display device 100 includes a sub control part 150. The sub control part 150 performs adjustment processing of adjusting luminance of display on the image display part 20 according to a luminance value set by a control part 110. The sub control part 150 performs light adjustment processing (correction processing) of obtaining a light adjustment index on the basis of a detection value from the illuminance sensor 68 to correct the luminance of the display on the image display part 20.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a display device and a display device control method.

  Conventionally, a display device mounted on a user's head is known (see, for example, Patent Document 1). In a display device that emits light, it is common to be able to adjust the intensity of light emitted from the display device, in other words, the luminance or brightness of the display, and the same applies to a display device mounted on the head.

JP 2006-12042 A

When the user's eye is close to the display device as in the display device described in Patent Document 1, it is required to set the display brightness according to the user's preference. The display brightness of the display device is influenced not only by the user's senses but also by other factors such as external light incident on the user's eyes. For example, there is a possibility that how the display device perceives the brightness of the display device varies greatly between the case where the light emitted from the display device and the outside light enter the user's eyes from the same direction and the case where the outside light does not enter. . For this reason, there is a problem that the control regarding the display brightness of the display device is likely to be complicated, the processing load becomes high, and it is difficult to adjust the brightness as desired by the user.
The present invention has been made in view of the above circumstances, and an object of the present invention is to appropriately adjust the display brightness by a simple process in a display device mounted on a user's head.

In order to achieve the above object, the present invention provides a head-mounted display device mounted on a user's head, the display unit for irradiating image light to the user's eyes, and light detection And a correction process for adjusting the display luminance of the display unit, and a correction process for correcting the display luminance of the display unit by obtaining a correction coefficient based on the detection value of the light detection unit. And a control unit.
According to the present invention, the process of adjusting the display brightness and the process of changing the display brightness based on the detection value of the light detection unit can be easily executed. Therefore, the display brightness can be appropriately adjusted by the light load process. it can.

In the display device according to the aspect of the invention, the control unit obtains the correction coefficient using a detection value of the light detection unit, and the display unit after the adjustment process in the correction process according to the obtained correction coefficient. The display brightness is corrected.
According to the present invention, it is possible to easily execute the process of changing the adjusted luminance corresponding to the detection value of the light detection unit after adjusting the luminance of the display.

Further, the present invention is characterized in that, in the display device, the control unit obtains the correction coefficient by performing a calculation process by applying a detection value of the light detection unit to a predetermined calculation formula. To do.
According to the present invention, the correction coefficient corresponding to the detected value can be easily obtained by arithmetic processing.

Further, the present invention is characterized in that, in the display device, the control unit obtains the correction coefficient by applying a detection value of the light detection unit to a preset table.
According to the present invention, it is possible to reduce the processing load for obtaining a correction coefficient corresponding to a detected value.

In the display device according to the aspect of the invention, the control unit may perform an operation of correcting the display brightness after the adjustment process according to the correction coefficient in the correction process to correct the display brightness. Features.
According to the present invention, it is possible to promptly change the display brightness by reflecting the correction coefficient.

Further, according to the present invention, in the display device, the control unit multiplies the display luminance value of the display unit set in the adjustment process by the correction coefficient by the correction process, thereby obtaining the display luminance of the display unit. It is characterized by correcting the value.
According to the present invention, by using the coefficient, the detection value of the light detection unit can be reflected on the adjusted display brightness by a light load process, and the display brightness can be adjusted appropriately. .

The control unit performs a hysteresis process when changing the luminance value of the display on the display unit to the corrected luminance value by the correction process, and changes the luminance value of the display on the display unit to the high luminance side. The hysteresis processing condition can be set independently for each of the case and the case of changing the luminance value to the low luminance side.
According to the present invention, since hysteresis can be set with respect to a change in the luminance of the display unit, it is possible to maintain good visibility for the user when the detection value of the light detection unit changes. In addition, since the hysteresis can be set independently for the case where the brightness value of the display is made brighter and the case where it is made darker, it can be set according to the characteristics of the human eye or according to the user's preference and the usage environment of the display device. Hysteresis can be set.

Further, in the display device according to the present invention, the display unit includes a right-eye display unit that irradiates image light to the right eye of the user, and a left eye that irradiates image light to the left eye of the user. And the control unit sets the luminance of the right-eye display unit and the luminance of the left-eye display unit independently by the adjustment process.
According to the present invention, the brightness of the display can be adjusted corresponding to each of the left and right eyes, and then the detection value of the light detection unit is reflected on the brightness of the adjusted display. Can be adjusted appropriately.

Further, the present invention is characterized in that, in the display device, the display unit is a see-through display unit that transmits external light and enters the eyes of the user.
According to the present invention, it is possible to appropriately adjust the display brightness in accordance with the amount of external light that greatly affects the display brightness.

Moreover, the present invention is characterized in that, in the display device, the light detection unit includes a light sensor that detects light from a direction that is transmitted through the display unit and visually recognized by the user.
According to the present invention, it is possible to appropriately adjust the display brightness in accordance with the amount of external light that greatly affects the display brightness.

In the display device according to the aspect of the invention, the display device includes a second control unit that is configured separately from the control unit and connected to the control unit, and the second control unit corrects the control unit with respect to the correction unit. Instructing the process, the control unit executes the adjustment process and the correction process based on an instruction from the second control unit.
According to the present invention, it is possible to suppress the load on the second control unit that gives an instruction to the control unit and appropriately adjust the display luminance.

In order to achieve the above object, a display device control method according to the present invention includes a display unit that is mounted on a user's head and that irradiates the user's eyes with image light, and light detection that detects light. An adjustment process for adjusting the display brightness of the display unit, and a correction coefficient is obtained based on the detection value of the light detection unit to correct the display brightness of the display unit. It is characterized by executing correction processing.
According to the present invention, the process of adjusting the display brightness and the process of changing the display brightness based on the detection value of the light detection unit can be easily executed. Therefore, the display brightness can be appropriately adjusted by the light load process. it can.

Explanatory drawing which shows the external appearance structure of a head mounting | wearing type display apparatus. The figure which shows the structure of the optical system of an image display part. The functional block diagram of each part which comprises a head mounting | wearing type display apparatus. It is a flowchart which shows operation | movement of a head mounted display apparatus, (A) shows operation | movement of a control apparatus, (B) shows operation | movement of an image display part. The figure which shows the external appearance structure of the head mounted display apparatus as a modification.

FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device 100 (display device) according to an embodiment to which the present invention is applied.
The head-mounted display device 100 includes an image display unit 20 (display unit) that allows the user to visually recognize a virtual image while being mounted on the user's head, and a control device 10 that controls the image display unit 20. I have. The control device 10 also functions as a controller for the user to operate the head mounted display device 100.

  The image display unit 20 is a wearing body that is worn on the user's head, and has a glasses shape in the present embodiment. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a left display driving unit 24, a right optical image display unit 26, a left optical image display unit 28, and a camera 61. (Imaging part) and a microphone 63 are provided. The right optical image display unit 26 and the left optical image display unit 28 are arranged so as to be positioned in front of the right and left eyes of the user when the user wears the image display unit 20, respectively. One end of the right optical image display unit 26 and one end of the left optical image display unit 28 are connected to each other at a position corresponding to the eyebrow of the user when the user wears the image display unit 20.

  The right holding unit 21 extends from the end ER which is the other end of the right optical image display unit 26 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member. Similarly, the left holding unit 23 extends from the end EL which is the other end of the left optical image display unit 28 to a position corresponding to the user's temporal region when the user wears the image display unit 20. It is a member provided. The right holding unit 21 and the left holding unit 23 hold the image display unit 20 on the user's head like a temple of glasses.

  The right display drive unit 22 and the left display drive unit 24 are disposed on the side facing the user's head when the user wears the image display unit 20. The right display drive unit 22 and the left display drive unit 24 are collectively referred to simply as “display drive unit”, and the right optical image display unit 26 and the left optical image display unit 28 are simply referred to as “optical image display unit”. Also called.

The display drive units 22 and 24 include liquid crystal displays 241 and 242 (hereinafter referred to as “LCDs 241 and 242”), projection optical systems 251 and 252, which will be described later with reference to FIG.
The right optical image display unit 26 and the left optical image display unit 28 include light guide plates 261 and 262 (FIG. 2) and a light control plate 20A. The light guide plates 261 and 262 are formed of a light transmissive resin or the like, and guide the image light output from the display driving units 22 and 24 to the user's eyes. The light control plate 20A is a thin plate-like optical element, and is disposed so as to cover the front side of the image display unit 20 which is the side opposite to the user's eye side. As the light control plate 20A, various materials such as a material that has almost no light transmission, a material that is nearly transparent, a material that attenuates the amount of light and transmits light, and a material that attenuates or reflects light of a specific wavelength may be used. it can. By appropriately selecting the optical characteristics (light transmittance, etc.) of the light control plate 20A, the external light amount incident on the right optical image display unit 26 and the left optical image display unit 28 from the outside is adjusted to visually recognize the virtual image. You can adjust the ease. In the present embodiment, a case will be described in which at least a light control plate 20A having such a light transmittance that a user wearing the head-mounted display device 100 can visually recognize an outside scene is used. The light control plate 20A protects the right light guide plate 261 and the left light guide plate 262, and suppresses damage to the right light guide plate 261 and the left light guide plate 262, adhesion of dirt, and the like.
The dimming plate 20A may be detachable from the right optical image display unit 26 and the left optical image display unit 28, or may be mounted by replacing a plurality of types of dimming plates 20A, or may be omitted. .

The camera 61 is disposed at the boundary between the right optical image display unit 26 and the left optical image display unit 28. In a state where the user wears the image display unit 20, the position of the camera 61 is substantially in the middle of both eyes of the user in the horizontal direction and above the eyes of the user in the vertical direction. The camera 61 is a digital camera that includes an imaging element such as a CCD or CMOS, an imaging lens, and the like, and may be a monocular camera or a stereo camera.
The camera 61 images at least a part of the outside view in the front side direction of the head-mounted display device 100, in other words, the user's view direction when the head-mounted display device 100 is mounted. The width of the angle of view of the camera 61 can be set as appropriate, but the imaging range of the camera 61 is a range that includes the outside world visually recognized by the user through the right optical image display unit 26 and the left optical image display unit 28. preferable. Furthermore, it is more preferable that the imaging range of the camera 61 is set so that the entire field of view of the user through the light control plate 20A can be imaged.

An illuminance sensor 68 is disposed on the frame 2. The illuminance sensor 68 is an ambient light sensor that detects the amount of external light and outputs a detection value. The illuminance sensor 68 is disposed in the vicinity of the camera 61, receives light emitted toward the illuminance sensor 68 from the direction including the angle of view of the camera 61, and detects the amount of light.
In the present embodiment, a configuration in which one illuminance sensor 68 is provided in the frame 2 is taken as an example, but a plurality of illuminance sensors 68 can also be provided. Further, the position of the illuminance sensor 68 may be provided at the end ER or the end EL in addition to the center in the width direction of the frame 2 as shown in FIG.

FIG. 2 is a principal plan view showing the configuration of the optical system provided in the image display unit 20. FIG. 2 shows the user's left eye LE and right eye RE for explanation.
The left display driving unit 24 includes a left backlight 222 having a light source such as an LED and a diffusion plate. The left display driving unit 24 includes a transmissive left LCD 242 disposed on the optical path of light diffused by the diffusion plate of the left backlight 222, a lens group that guides the image light L transmitted through the left LCD 242, and the like. The left projection optical system 252 is provided. The left LCD 242 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

The left projection optical system 252 includes a collimator lens that converts the image light L emitted from the left LCD 242 into a parallel light beam. The image light L converted into a parallel light beam by the collimating lens is incident on the left light guide plate 262 (optical element). The left light guide plate 262 is a prism formed with a plurality of reflecting surfaces that reflect the image light L, and the image light L is guided to the left eye LE side through a plurality of reflections inside the left light guide plate 262. The left light guide plate 262 is formed with a half mirror 262A (reflection surface) positioned in front of the left eye LE.
The image light L reflected by the half mirror 262A is emitted from the left optical image display unit 28 toward the left eye LE, and this image light L forms an image on the retina of the left eye LE so that the user can visually recognize the image.

  The right display driving unit 22 is configured to be symmetrical with the left display driving unit 24. The right display driving unit 22 includes a right backlight 221 having a light source such as an LED and a diffusion plate. The right display driving unit 22 includes a transmissive right LCD 241 disposed on the optical path of light diffused by the diffusion plate of the right backlight 221, a lens group that guides the image light L transmitted through the right LCD 241, and the like. A right projection optical system 251 is provided. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

The right projection optical system 251 has a collimator lens that converts the image light L emitted from the right LCD 241 into a light beam in a parallel state. The image light L converted into a parallel light beam by the collimating lens is incident on the right light guide plate 261 (optical element). The right light guide plate 261 is a prism formed with a plurality of reflecting surfaces that reflect the image light L, and the image light L is guided to the right eye RE side through a plurality of reflections inside the right light guide plate 261. The right light guide plate 261 is formed with a half mirror 261A (reflection surface) located in front of the right eye RE.
The image light L reflected by the half mirror 261A is emitted from the right optical image display unit 26 toward the right eye RE, and this image light L forms an image on the retina of the right eye RE to make the user visually recognize the image.

  The image light L reflected by the half mirror 261A and the external light OL transmitted through the light control plate 20A are incident on the right eye RE of the user. The image light L reflected by the half mirror 262A and the external light OL transmitted through the light control plate 20A are incident on the left eye LE. As described above, the head-mounted display device 100 causes the image light L and the external light OL of the internally processed image to overlap each other and enter the user's eyes, and for the user, seeing through the light control plate 20A. An outside scene can be seen, and an image by the image light L is visually recognized over the outside scene. Thus, the head-mounted display device 100 functions as a see-through display device.

  The left projection optical system 252 and the left light guide plate 262 are collectively referred to as “left light guide unit”, and the right projection optical system 251 and the right light guide plate 261 are collectively referred to as “right light guide unit”. The configuration of the right light guide and the left light guide is not limited to the above example, and any method can be used as long as a virtual image is formed in front of the user's eyes using image light. It may be used, or a semi-transmissive reflective film may be used.

  In addition, the illuminance sensor 68 detects external light in the outside scene direction that the user permeates through the right light guide plate 261 and the left light guide plate 262 and is visually recognized by the user. That is, it is attached to the frame 2 so as to receive the external light OL of FIG. That is, the illuminance sensor 68 detects the external light OL that is incident on the user's eyes as the background light of the image light L.

  The image display unit 20 (FIG. 1) is connected to the control device 10 via the connection unit 40. The connection unit 40 is a harness including a body cord 48, a right cord 42, a left cord 44, and a connecting member 46 that are connected to the control device 10. The right cord 42 and the left cord 44 are branched into two main body cords 48, and the right cord 42 is inserted into the housing of the right holding portion 21 from the distal end portion AP in the extending direction of the right holding portion 21, and the right display driving portion. 22 is connected. Similarly, the left cord 44 is inserted into the housing of the left holding unit 23 from the distal end AP in the extending direction of the left holding unit 23 and connected to the left display driving unit 24. The right cord 42, the left cord 44, and the main body cord 48 only need to be capable of transmitting digital data, and can be constituted by, for example, a metal cable or an optical fiber. Further, the right cord 42 and the left cord 44 may be combined into a single cord.

  The connecting member 46 is provided at a branch point between the main body cord 48, the right cord 42 and the left cord 44, and has a jack for connecting the earphone plug 30. A right earphone 32 and a left earphone 34 extend from the earphone plug 30. A microphone 63 is provided in the vicinity of the earphone plug 30. The earphone plug 30 to the microphone 63 are combined into one cord, and the cord branches from the microphone 63 and is connected to each of the right earphone 32 and the left earphone 34.

  For example, as shown in FIG. 1, the microphone 63 is arranged such that the sound collection unit of the microphone 63 faces the user's line of sight, collects sound, and outputs a sound signal. For example, the microphone 63 may be a monaural microphone or a stereo microphone, may be a directional microphone, or may be an omnidirectional microphone.

  The image display unit 20 and the control device 10 transmit various signals via the connection unit 40. The end of the main body cord 48 opposite to the connecting member 46 and the control device 10 are provided with connectors (not shown) that fit together. By fitting the connector of the main body cord 48 and the connector of the control device 10 or removing this fitting, the control device 10 and the image display unit 20 can be contacted and separated.

  The control device 10 has a box-shaped main body that is separate from the main body of the image display unit 20, and controls the head-mounted display device 100. The control device 10 includes switches including an enter key 11, a lighting unit 12, a display switching key 13, a luminance switching key 15, a direction key 16, a menu key 17, and a power switch 18. In addition, the control device 10 includes a track pad 14 that is operated by a user with fingers.

  The determination key 11 detects a pressing operation and outputs a signal for determining the content operated by the control device 10. The lighting unit 12 includes a light source such as an LED (Light Emitting Diode), and notifies the operating state (for example, power ON / OFF) of the head-mounted display device 100 according to the lighting state of the light source. The display switching key 13 outputs, for example, a signal instructing switching of the image display mode in response to the pressing operation.

  The track pad 14 has an operation surface for detecting a contact operation, and outputs an operation signal according to an operation on the operation surface. The detection method on the operation surface is not limited, and an electrostatic method, a pressure detection method, an optical method, or the like can be adopted. The luminance switching key 15 outputs a signal instructing increase / decrease of the luminance of the image display unit 20 in response to the pressing operation. The direction key 16 outputs an operation signal in response to a pressing operation on a key corresponding to the up / down / left / right direction. The power switch 18 is a switch for switching power on / off of the head-mounted display device 100.

FIG. 3 is a functional block diagram of each part constituting the head-mounted display device 100.
The control device 10 includes a control unit 110 (second control unit) that controls the control device 10 and the image display unit 20. The control unit 110 is configured by, for example, a microprocessor, and is connected to a memory 121 that temporarily stores data processed by the control unit 110 and a flash memory 122 that stores data processed by the control unit 110 in a nonvolatile manner. Is done. Both the memory 121 and the flash memory 122 are constituted by semiconductor elements, and are connected to the control unit 110 via a data bus.

The control unit 110 includes a power supply control unit 123, a UI (user interface) control unit 124, a wireless I / F (interface) control unit 125, an audio control unit 126, a sensor IC 127, and an external I / F (interface) unit 128. Is connected.
The head-mounted display device 100 includes a primary battery or a secondary battery as a power source, and the power control unit 123 is configured by an IC connected to these batteries. The power supply control unit 123 detects the remaining capacity of the battery according to the control of the control unit 110, and outputs detection value data or data indicating that the remaining capacity is equal to or less than the set value to the control unit 110.

  The UI control unit 124 includes the determination key 11, the display switching key 13, the track pad 14, the luminance switching key 15, the direction key 16, and the menu key 17 shown in FIG. 1, the lighting unit 12, and the track pad. 14 is an IC to be connected. Each of the operation units functions as an input unit, and the lighting unit 12 and the track pad 14 function as an output unit, and constitute a user interface of the head-mounted display device 100. The UI control unit 124 detects an operation in the operation unit, and outputs operation data corresponding to the operation to the control unit 110. Further, the UI control unit 124 performs lighting / extinguishing of the lighting unit 12 and display on the track pad 14 according to the control of the control unit 110.

The wireless I / F control unit 125 is a control IC connected to a wireless communication interface (not shown), and executes communication using the wireless communication interface according to the control of the control unit 110. The wireless communication interface included in the control device 10 performs wireless data communication conforming to a standard such as a wireless LAN (WiFi (registered trademark)), Miracast (registered trademark), Bluetooth (registered trademark), or the like.
The audio control unit 126 is an IC that is connected to the right earphone 32, the left earphone 34, and the microphone 63 and includes an A / D (analog / digital) converter, an amplifier, and the like. The sound control unit 126 outputs sound from the right earphone 32 and the left earphone 34 based on the sound data input from the control unit 110. In addition, the voice control unit 126 generates voice data based on the voice collected by the microphone 63 and outputs the voice data to the control unit 110.

  The sensor IC 127 includes, for example, a three-axis acceleration sensor, a three-axis gyro sensor, and a three-axis geomagnetic sensor, and includes, for example, one IC including the sensor. The sensor IC 127 performs detection according to the control of the control unit 110 and outputs data indicating the detection value of each sensor to the control unit 110. The number and types of sensors included in the sensor IC 127 are not limited, and an illuminance sensor, a temperature sensor, a pressure sensor, and the like may be included.

  The external I / F unit 128 is an interface that connects the head-mounted display device 100 to an external device. For example, an interface corresponding to a wired connection such as a USB interface, a micro USB interface, a memory card interface, or the like can be used, and a wireless communication interface may be used. Various external devices that supply content to the head-mounted display device 100 can be connected to the external I / F unit 128. These external devices can also be called image supply devices that supply images to the head-mounted display device 100. For example, a personal computer (PC), a mobile phone terminal, a portable game machine, or the like is used. In addition, the external I / F unit 128 may be provided with terminals connected to the right earphone 32, the left earphone 34, and the microphone 63. In this case, the analog audio signal processed by the audio control unit 126 passes through the external I / F unit 128. Input and output.

An I / F (interface) unit 115 is connected to the control unit 110. The I / F unit 115 is an interface including a connector connected to one end of the connection unit 40, and the other end of the connection unit 40 is connected to the I / F unit 155 of the image display unit 20.
The control unit 110 performs data communication with the sub-control unit 150 included in the image display unit 20 via the connection unit 40.

  The control unit 110 executes a program stored in a built-in ROM, and controls each unit of the head-mounted display device 100. The control unit 110 acquires the detection value of the sensor based on the data input from the sensor IC 127 and stores it in the memory 121. At this time, the control unit 110 adds and stores time stamp information indicating the time when the detection value is acquired in association with the detection value of the sensor.

  Further, the control unit 110 receives data indicating detection values of the sensors (the illuminance sensor 68, the 9-axis sensor 162, and the GPS 163) included in the image display unit 20 via the connection unit 40. The control unit 110 stores the received data in the memory 121. The data received by the control unit 110 includes time stamp information added by the sub-control unit 150. The control unit 110 adds the time stamp information added to the detection value of the sensor IC 127 as described above in a manner that can be distinguished from the time stamp information added by the sub control unit 150 and stores the time stamp information in the memory 121. The memory 121 stores the sensor detection value in a data format to which time stamp information is added as one of the data attributes. Here, the control unit 110 may store sensor detection value data in the flash memory 122.

  The control unit 110 receives content data from an external device connected by the external I / F unit 128 or the wireless I / F control unit 125 and stores the content data in the flash memory 122. The content data is data such as text and images displayed on the image display unit 20, and may include audio data output from the right earphone 32 and the left earphone 34. The control unit 110 controls the head-mounted display device 100 to reproduce content. Specifically, the control unit 110 transmits content display data to the sub-control unit 150 to execute display, and outputs audio data of the content to the audio control unit 126 to output audio. When the content data received from the external device includes data indicating a condition related to reproduction, the control unit 110 reproduces the content according to the condition. For example, when a detection value of a sensor such as a position or inclination detected in the image display unit 20 satisfies a condition, a text or an image corresponding to the detection value is displayed.

The image display unit 20 includes a sub-control unit 150 that performs communication with the control unit 110 and controls each unit of the image display unit 20. The sub control unit 150 is configured by, for example, a microprocessor, is connected to the connection unit 40 by the I / F unit 155, and executes data communication with the control unit 110 via the connection unit 40.
The sub-control unit 150 is connected to an illuminance sensor 68, a 9-axis sensor 162, and GPS 163 sensors. As described above, the illuminance sensor 68 is an IC of an ambient light sensor (ALS), or an IC in which a plurality of sensors including the ambient light sensor and peripheral circuits of the sensors are unitized. The 9-axis sensor 162 is an IC including a 3-axis acceleration sensor, a 3-axis gyro sensor, and a 3-axis geomagnetic sensor.
The illuminance sensor 68 is driven by the control of the sub control unit 150, and outputs a light amount detection value to the sub control unit 150. The 9-axis sensor 162 is driven by the control of the sub-control unit 150 and outputs data indicating the detection value of each built-in sensor to the sub-control unit 150.

  The GPS 163 receives a position detection signal transmitted from a GPS satellite or a pseudo GPS transmitter (not shown) installed indoors, calculates the current position of the image display unit 20, and outputs the calculated data to the sub-control unit. 150. The GPS 163 may be configured to have only a function as a receiver that receives a signal for position detection. In this case, the sub-control unit 150 may perform a process of calculating the current position based on data output from the GPS 163.

The EEPROM 165 (setting data storage unit) stores data related to processing executed by the sub-control unit 150 in a nonvolatile manner.
In addition, the camera 61 is connected to the sub-control unit 150, and the sub-control unit 150 controls the camera 61 to execute imaging, and transmits captured image data of the camera 61 to the control unit 110.

  Connected to the sub-control unit 150 are an LCD drive unit 167 that performs drawing by driving the right LCD 241 and an LCD drive unit 168 that performs drawing by driving the left LCD 242. The sub-control unit 150 receives content data from the control unit 110, generates display data for displaying text and images included in the received data, outputs the display data to the LCD driving units 167 and 168, and executes display.

  The sub control unit 150 is connected to a backlight driving unit 169 that drives the right backlight 221 and a backlight driving unit 170 that drives the left backlight 222. The sub control unit 150 outputs control data including timing data for PWM control to the backlight driving units 169 and 170. The backlight driving units 169 and 170 supply driving voltages and pulses to the right backlight 221 and the left backlight 222 based on the control data input from the sub control unit 150, and the right backlight 221 and the left backlight 222. Lights up.

  Further, the sub control unit 150 designates the pulse width or duty of the pulse output from the backlight drive unit 169 to the right backlight 221 based on the data output to the backlight drive unit 169. Duty refers to the ratio between the on period and the off period of a pulse. Similarly, the sub control unit 150 specifies the pulse width or duty of the pulse output from the backlight drive unit 170 to the left backlight 222 based on the data output to the backlight drive unit 170. The right backlight 221 and the left backlight 222 are individual light sources such as LEDs, and the brightness of light emission, that is, the luminance can be adjusted by PWM control. Therefore, the amount of the image light L (FIG. 2) incident on the user's eyes can be adjusted by the control of the sub control unit 150. Further, the sub control unit 150 outputs different data to each of the backlight driving unit 169 and the backlight driving unit 170, and can individually adjust the luminance of the right backlight 221 and the luminance of the left backlight 222.

The backlight drive unit 169 can adjust the luminance of the right backlight 221 in steps, and the backlight drive unit 170 can also adjust the luminance of the left backlight 222 in steps. In the present embodiment, a configuration in which the brightness can be adjusted in 256 steps is given as an example. The sub control unit 150 outputs data specifying the luminance of the right backlight 221 and the left backlight 222 to the backlight driving units 169 and 170. This data is a luminance value from 0 to 255 indicating the luminance level. The backlight driving units 169 and 170 generate a pulse corresponding to the luminance value specified by the data input from the sub control unit 150 and output the pulse to the right backlight 221 and the left backlight 222, respectively.
In the sub-control unit 150, a luminance value set in consideration of luminance suitable for display and gamma values of the right LCD 241 and the left LCD 242 is set as an initial value.

The connection unit 40 that connects the control unit 110 and the sub-control unit 150 has a plurality of data buses including a control data bus 41A, an image data bus 41B, and display data buses 41C and 41D. These data buses can transmit data independently of each other, but the signal lines constituting each data bus may be physically partitioned, and each data bus may have a common signal line. It may be configured virtually or logically.
The control data bus 41A transmits control data transmitted from the control unit 110 to the sub control unit 150, sensor detection value data transmitted from the sub control unit 150 to the control unit 110, and the like. The image data bus 41 </ b> B transmits captured image data of the camera 61 from the sub control unit 150 to the control unit 110. The display data bus 41C transmits data to be displayed by the right display drive unit 22, and the display data bus 41D transmits data to be displayed by the left display drive unit 24.

  The sampling periods of a plurality of sensors including the illuminance sensor 68, the nine-axis sensor 162, and the GPS 163 included in the image display unit 20 may be greatly different. For example, the sampling period (sampling frequency) of the acceleration sensor of the 9-axis sensor 162 may be 200 times / second or more. On the other hand, the sampling cycle of the illuminance sensor 68 is slower, and it can be considered that even 1 to 10 times / second (1000 to 100 ms cycle) is sufficiently useful. In these sensors, the sub-control unit 150 sets a sampling cycle, and the sub-control unit 150 acquires a detection value according to the set sampling cycle. The sub-control unit 150 transmits detection value data sampled from each sensor to the control unit 110 in a time division manner on the control data bus 41A.

  For this reason, the control data bus 41A is not occupied for a long time in order to control a sensor having a slow sampling cycle (in other words, a low sampling frequency or a long sampling interval). As a result, the overhead of the control data bus 41A can be reduced, and the detection values of a large number of sensors can be efficiently transmitted on the control data bus 41A. Further, the sub-control unit 150 has a RAM (not shown), and temporarily stores the detection value of the sensor in the RAM. The sub control unit 150 adjusts the transmission timing of the data stored in the RAM and sends the data to the control data bus 41A. Therefore, the operation of the sub-control unit 150 is also not easily restricted by the sampling period of each sensor, and the situation where the processing of the sub-control unit 150 is occupied for sensor control can be prevented.

FIG. 4 is a flowchart showing the operation of the head-mounted display device 100, (A) shows the operation of the control device 10, and (B) shows the operation of the image display unit 20.
When the start of the display operation is instructed by an operation on the control device 10, the control unit 110 generates an activation command and transmits it to the sub-control unit 150 (step S11). This command is transmitted via the control data bus 41A, and the sub-control unit 150 receives the command (step S21).

  The sub control unit 150 starts its operation, initializes the sub control unit 150 according to the command, and initializes each part of the image display unit 20 including the illuminance sensor 68, the 9-axis sensor 162, and the GPS 163 (step S22). ). Subsequently, the sub control unit 150 operates the backlight driving units 169 and 170 to turn on the right backlight 221 and the left backlight 222 (step S23). In step S23, the sub control unit 150 outputs initial value data as PWM control data for the backlight driving units 169 and 170. Further, the sub control unit 150 activates the camera 61, the 9-axis sensor 162, the GPS 163, and the like as necessary.

Subsequently, the control unit 110 generates a command for instructing acquisition of data for luminance adjustment, and transmits the command to the sub-control unit 150 (step S12).
The sub control unit 150 receives the command transmitted from the control unit 110 (step S24), and reads out and acquires the brightness adjustment data, which is the data for brightness adjustment, from the EEPROM 165 according to the received command (step S25). The sub control unit 150 transmits the acquired brightness adjustment data to the control unit 110 (step S26), and the control unit 110 receives the brightness adjustment data transmitted by the sub control unit 150 (step S13).

  The brightness adjustment data is an initial value for adjusting the brightness of the right backlight 221 and the left backlight 222. For example, variations in luminance between the right backlight 221 and the left backlight 222 may occur due to individual differences in light sources such as LEDs provided in the right backlight 221 and the left backlight 222. In this case, when the backlight driving units 169 and 170 output the same pulse to the right backlight 221 and the left backlight 222, the amount of image light L incident on the right eye of the user and the image light incident on the left eye. There is a possibility that the light quantity of L is not aligned and a sense of incongruity may be produced. The brightness adjustment data is used to align the brightness of the right backlight 221 and the brightness of the left backlight 222 so that the user does not perceive variations in the display brightness of the right optical image display unit 26 and the left optical image display unit 28. It is data of. The brightness adjustment data is set in advance and stored in the EEPROM 165. For example, brightness adjustment data is obtained by inspection at the time of shipment of the head-mounted display device 100 and stored in the EEPROM 165.

  The control unit 110 calculates a brightness setting value based on the brightness adjustment data received from the sub-control unit 150 (step S14). Subsequently, the control unit 110 transmits a setting command for designating a luminance setting value and data indicating the calculated luminance setting value to the sub-control unit 150 (step S15). The setting value calculated by the control unit 110 in step S14 is a value that is the basis of data output from the sub control unit 150 to the backlight driving units 169 and 170. This is a value obtained by adding a correction that prevents the difference between the left and right luminances from being felt to the luminance that is the initial value (default value) of the right backlight 221 and the left backlight 222.

  The sub control unit 150 receives the setting command and data transmitted from the control unit 110 (step S27), and starts PWM control of the right backlight 221 and the left backlight 222 according to the received setting value (step S28). . That is, the sub control unit 150 generates PWM control data, outputs the data to the backlight driving units 169 and 170, and adjusts the luminance of the right backlight 221 and the left backlight 222.

  Further, the sub control unit 150 determines whether or not to perform automatic light control (step S29). The automatic light control is a process of adjusting the display brightness of the right optical image display unit 26 and the left optical image display unit 28 in accordance with the brightness of the outside of the head-mounted display device 100. Whether or not to perform automatic dimming is set in advance, and data indicating the setting state is stored in, for example, the flash memory 122 or the EEPROM 165.

  When performing automatic light control (step S29; YES), the sub-control unit 150 activates the illuminance sensor 68 and starts detecting the amount of light (step S30). Next, the sub control unit 150 acquires a detection value of the illuminance sensor 68 (step S31), and calculates a dimming index (correction coefficient) based on the acquired detection value of the illuminance sensor 68 (step S32).

The dimming index can be obtained, for example, by calculation represented by the following formula (1).
X = A × Q ^ B + C (1)
However, X is a dimming index and A, B, and C are constants. Q is the average environmental illuminance (unit: [lux]) obtained from the detection value of the illuminance sensor 68.
The above equation (1) and the constants A, B, and C are stored in advance in the EEPROM 165, for example.
The constants A, B, and C are determined so that, for example, the dimming index X = 1 when the average ambient illuminance Q is 400 lux, which is an average indoor environment, or the vicinity thereof. For example, 0 <A ≦ 1, 0 <B ≦ 1, and 0 ≦ C ≦ 1.

  The sub-control unit 150 may perform the calculation of the above formula (1) using the detection value of the illuminance sensor 68 as it is as the value of the average environmental illuminance Q, or may detect a plurality of times from the illuminance sensor 68 within a preset period. A value may be acquired, and an average of the acquired detection values may be used as the value of the average environmental illuminance Q. Further, the detection value of the illuminance sensor 68 or the average value thereof may be converted into the average environmental illuminance Q by a preset calculation process.

  Further, the sub-control unit 150 may obtain the average environment illuminance Q by performing noise filtering on the detection value of the illuminance sensor 68. For example, the length of time for acquiring the detection value of the illuminance sensor 68 is preset as the illuminance acquisition time (unit: [seconds]), and the sub-control unit 150 detects the detection value (illuminance at a predetermined sampling period during the illuminance acquisition time. ) To get. The sub-control unit 150 calculates the average ambient illuminance by averaging the acquired detection values except for the largest predetermined value and the smallest predetermined value. The number of values to be trimmed from the detection value is set in advance, or is set in the sub-control unit 150 by the control unit 110 using a setting command.

Subsequently, the sub control unit 150 obtains a luminance adjustment value (step S33). The luminance adjustment value is a value obtained by correcting the luminance value set in the backlight driving units 169 and 170 by the sub-control unit 150 with the dimming index X before the dimming control. The brightness adjustment value can be obtained by, for example, calculation represented by the following formula (2).
Luminance adjustment value = Luminance value x Dimming index X (2)

The luminance value is a luminance value calculated by the control unit 110 in step S14 based on the luminance adjustment data stored in the EEPROM 165, and is a value taking into account individual differences between the right backlight 221 and the left backlight 222, etc. The detection value of the illuminance sensor 68 is not reflected. For example, the luminance value is written in the register of the sub-control unit 150 by the setting command transmitted by the control unit 110 in step S15. The sub-control unit 150 multiplies the luminance value by the dimming index to change the luminance value data output to the backlight driving units 169 and 170 in accordance with the luminance of external light, in other words, the environmental illuminance. To do. Specifically, the value of the brightness value written in the register is updated to the brightness adjustment value obtained by the above equation (2). As will be described later, when the dimming process is executed in a loop, the brightness adjustment value written in the register is updated.
As the brightness adjustment value, the value obtained by the above equation (2) may be used as it is, but adjustment may be performed. For example, when the luminance value before being multiplied by the dimming index is not 0, the minimum value of the luminance adjustment value may be set to 1, and the value obtained by the above equation (2) may be corrected.

  When the correction coefficient is calculated by the above formula (1), the detection value of the illuminance sensor 68 may be converted into a correction coefficient based on a predetermined correction curve. In this case, the correction curve may be different for each scene. It may be set. In this case, for example, a scene is selected by a user operation on the control device 10, and a correction coefficient is obtained by a correction curve corresponding to the selected scene, that is, a function corresponding to the above equation (1). Further, the sub-control unit 150 may automatically determine the scene based on the detection value of the illuminance sensor 68 and the change over time of the detection value.

Specific examples of the scene include the following scene.
[1] “Low illuminance environment mode” that makes it easy to see the images and videos displayed by the right optical image display unit 26 and the left optical image display unit 28 and the outside scene even in a low illuminance environment.
[2] In a bright room such as a living room, the text, images, video, and the like displayed by the right optical image display unit 26 and the left optical image display unit 28 can be easily viewed, and is suitable for displaying business documents, for example. "The outside world, video compatibility mode".
[3] “Theater viewing mode” suitable for viewing movies, for example, by increasing the visibility of images and videos displayed by the right optical image display unit 26 and the left optical image display unit 28 while reducing the visibility of outside scenes. "
[4] The visibility of text and images displayed by the right optical image display unit 26 and the left optical image display unit 28 is ensured in a bright environment such as outdoors on a clear sky, and for example, manuals such as work instructions can be read under hot summer weather. The "blue sky document browsing mode" was made.

  Further, the sub-control unit 150 may obtain the dimming index using an LUT (LookUpTable) that associates the detection value of the illuminance sensor 68 with the dimming index instead of the arithmetic processing shown in the above formula (1). Good. When this LUT is a LUT that sets a dimming index for the representative value of the illuminance sensor 68, the dimming index corresponding to the detection value of the illuminance sensor 68 may be obtained by interpolation calculation. Further, the sub-control unit 150 uses a LUT that obtains a luminance adjustment value based on the dimming index and the currently set luminance value, instead of the arithmetic processing shown in the above equation (2), and performs luminance adjustment. A value may be obtained. When the LUT has a configuration including a representative value, the sub control unit 150 may perform an interpolation calculation. These LUTs may be stored in advance in the EEPROM 165 or the flash memory 122, for example.

  In addition, an LUT may be stored in advance for each scene corresponding to the scenes illustrated in [1] to [4], and the sub control unit 150 may select an LUT corresponding to the scene to obtain a correction coefficient.

  That is, the sub control unit 150 updates the data output to the backlight driving units 169 and 170 to the data of the brightness adjustment value obtained in step S33 (step S34). As a result, the pulses output from the backlight driving units 169 and 170 to the right backlight 221 and the left backlight 222 are changed to pulses corresponding to the brightness adjustment value.

  Thereafter, the sub control unit 150 determines whether or not to end the dimming process (step S35). If it is determined that the dimming process is not finished (step S35; NO), the sub-control unit 150 returns to step S31. Thereby, the loop of the dimming process is continued, and the luminance of the right backlight 221 and the left backlight 222 is adjusted as needed, reflecting the detection value of the illuminance sensor 68.

  Further, when the end of the dimming process is instructed by the operation of the control device 10 or when the luminance of the right backlight 221 and the left backlight 222 is set by manual operation, the sub control unit 150 ends the dimming process Then, it determines (step S35; YES). In this case, the sub control unit 150 determines whether or not to end the display process (step S36). If the display process is not terminated (step S36; NO), the process returns to step S29. Further, when the end of the display process is instructed by the operation of the control device 10 or when the head-mounted display device 100 is turned off by the power switch 18 of the control device 10, the sub control unit 150 ends the display process. Then, it determines and stops (step S36; YES).

  As described above, the image light L that is incident on the user's eyes from the right light guide plate 261 and the left light guide plate 262 is adjusted in accordance with the environmental illuminance detected by the illuminance sensor 68, so that the image displayed by the image display unit 20 is displayed. The visibility of can be kept good. The visibility of the images displayed by the see-through half mirrors 261A and 262A is affected by the intensity and light amount of the external light OL. However, the sub-control unit 150 performs the operation of FIG. Can be handled seamlessly in real time.

When the luminance value or the luminance adjustment value is updated in step S34 based on the detected illuminance value acquired in step S31, intermediate steps may be inserted for the specified number of times in order to reduce a sudden change in luminance. In this case, when changing (updating) the luminance adjustment value, while changing the luminance of the right backlight 221 and the left backlight 222 from the luminance adjustment value before the change to the luminance adjustment value after the change, one or more The brightness of the intermediate step is set. Thereby, the brightness | luminance of the right backlight 221 and the left backlight 222 changes in steps.
In the sub-control unit 150, the number of bright adaptations is set as the number of intermediate steps when the luminance value is increased from a low state, and the number of dark adaptations is set as the number of intermediate steps when the luminance value is decreased from a high state. Is set. Further, the dimming time is set as the time for performing the intermediate step.

For example, when the dimming index obtained in step S32 is the first value P1 and the dimming index obtained before that is the second value P2 (where P2 <P1), for each dimming time, The luminance value changes by an intermediate value represented by the following formula (3).
Intermediate value = (P1-P2) / number of light adaptations (3)
In the case of P1 <P2, the luminance value changes by an intermediate value represented by the following formula (4) every dimming time.
Intermediate value = (P2−P1) / number of dark adaptations (4)
By this processing, even if the environmental illuminance detected by the illuminance sensor 68 changes suddenly, the change in the amount of the image light L incident on the user's eyes is alleviated, so that the feeling of use is not impaired.

  As shown in the above formulas (3) and (4), in the head-mounted display device 100, the number of intermediate steps (the number of light adaptations and the number of dark adaptations) is independently determined for each of light adaptation and dark adaptation. Is set. Also, the dimming time may be set for each of light adaptation and dark adaptation. Therefore, when the sub control unit 150 changes the display brightness brightly, the process is performed according to the number of intermediate steps and the dimming time set for the light adaptation. When the display brightness is changed to dark, the process is performed according to the number of intermediate steps and the dimming time set for dark adaptation.

In this way, hysteresis can be set for changes in luminance for both light adaptation and dark adaptation. Therefore, for example, when the brightness of the surroundings of the user greatly changes, by appropriately changing the display brightness, it is possible to suppress a decrease in the visibility of the outside scene and ensure the visibility. In the head-mounted display device 100 in which the outside scene can be seen through, it is possible to enhance the user's sense of security and is effective. Further, it is particularly effective in a usage method of moving with the head-mounted display device 100 mounted.
Furthermore, since hysteresis can be set independently for each of light adaptation and dark adaptation, there is an advantage that a change in luminance can be set more appropriately.

Further, the sub control unit 150 acquires sensors by controlling sensors such as the illuminance sensor 68, the 9-axis sensor 162, and the GPS 163, and transmits the detection value to the control unit 110. For this reason, compared with the case where the control part 110 controls each sensor, the processing load of the control part 110 and the occupation time of the process of the control part 110 can be reduced significantly. In addition, when each sensor is connected to the control unit 110, it is difficult to transmit the detection values of the sensors having different sampling cycles through the same signal line, so the number of signal lines provided in the connection unit 40 corresponds to the number of sensors. And increase. For this reason, there is a concern about an unfavorable situation such that the harness of the connection portion 40 becomes thick and handling decreases, and the number of sensors is limited. As in this embodiment, the sub-control unit 150 acquires the detection values of each sensor, adjusts the transmission timing via the control data bus 41A, and transmits the detection values of a plurality of sensors. All of the above can be prevented and efficient processing can be realized. For example, the sub-control unit 150 preferentially performs an operation of transmitting a detection value of a sensor with a short sampling cycle at a preset timing, and transmits a detection value of a sensor with a long sampling cycle during the idle time of the operation. May be.
And since the sub control part 150 performs the light control process of step S30-S34 corresponding to the environmental illumination intensity which the illumination intensity sensor 68 detects, without increasing the load of the control part 110, and also by the connection part 40 Dimming can be performed without increasing the amount of data transmitted.

  As described above, the head-mounted display device 100 according to the embodiment to which the present invention is applied is mounted on the user's head and irradiates the user's eyes with image light, and the light. And an illuminance sensor 68 for detection. The head-mounted display device 100 includes a sub control unit 150. The sub control unit 150 performs adjustment processing for adjusting the display brightness of the image display unit 20 in accordance with the brightness value set by the control unit 110. The sub-control unit 150 obtains a dimming index based on the detection value of the illuminance sensor 68 and executes a dimming process (correction process) for correcting the display brightness of the image display unit 20. For this reason, since the process of adjusting the display brightness and the process of changing the display brightness based on the detection value of the illuminance sensor 68 can be easily executed, the display brightness can be appropriately adjusted by a process with a light load.

The sub-control unit 150 obtains a correction coefficient by applying the detection value of the illuminance sensor 68 to an arithmetic expression set in advance, for example, as in the above formula (1), so that the process of changing the display brightness is easy. Can be executed. Further, the sub control unit 150 may obtain a correction coefficient corresponding to the detection value of the illuminance sensor 68 using the LUT.
Further, the sub-control unit 150 corrects the luminance value of the display on the image display unit 20 by multiplying the luminance value of the right backlight 221 and the left backlight 222 set in step S28 by the dimming index by the dimming process. . For this reason, the detection value of the illuminance sensor 68 can be reflected on the adjusted display brightness.

  Further, the sub-control unit executes a hysteresis process when changing the display luminance value of the image display unit 20 to the corrected luminance value. The hysteresis processing condition can be set independently for each of the case where the luminance value of the display of the image display unit 20 is changed to the high luminance side and the case where the luminance value is changed to the low luminance side. For this reason, when the detection value of the illuminance sensor 68 changes, the visibility for the user can be maintained well. In addition, since the hysteresis can be set independently for the case where the luminance value of the image display unit 20 is made brighter and the case where the luminance value is made darker, the hysteresis can be set according to the characteristics of the human eye, or the user's preference and the use environment of the display device. Hysteresis can be set according to.

The image display unit 20 includes a right-eye image display unit that irradiates the user's right eye with image light, and a left-eye image display unit that irradiates the user's left eye with image light. The sub-control unit 150 independently sets the luminance of the right backlight 221 of the right-eye image display unit and the luminance of the left backlight 222 of the left-eye image display unit. For this reason, it is possible to adjust the luminance corresponding to each of the left and right eyes. Then, the detection value of the illuminance sensor 68 is reflected on the adjusted luminance, and the adjustment can be made appropriately.
Since the image display unit 20 is a see-through type image display unit 20 that transmits external light OL and enters the user's eyes, the luminance is adjusted according to the amount of external light that has a large influence on the luminance of the display. By doing so, the visibility of display can be kept good.
Further, as in the above-described embodiment, the illuminance sensor 68 is preferably configured to detect light from a direction that is transmitted through the image display unit 20 and visually recognized by the user.

  In the present embodiment, the spectacle-type frame 2 is illustrated as an example of the main body. The shape of the main body is not limited to the spectacles type, as long as it is attached and fixed to the user's head, and if it is a shape that is worn across the user's left and right eyes, preferable. For example, in addition to the eyeglass shape described here, it may have a snow goggles-like shape that covers the upper part of the user's face, and is arranged in front of the left and right eyes of the user like binoculars. It may be a shape.

  In the present embodiment, the configuration in which the illuminance sensor 68 and the camera 61 are fixedly provided on the frame 2 has been described as an example. However, the camera 61 may be configured to be displaceable. This example is shown as a modification.

[Modification]
FIG. 5 is a diagram showing an external configuration of a head-mounted display device 100B as a modification of the present embodiment.
The head-mounted display device 100B in the modified example has a configuration in which an image display unit 20B is connected to the control device 10 of the above-described embodiment. In the image display unit 20B, the same components as those of the image display unit 20 are denoted by the same reference numerals and description thereof is omitted.

  The image display unit 20B is connected to the control device 10 via the connection unit 40, similarly to the image display unit 20 (FIG. 1). The image display unit 20 </ b> B and the control device 10 transmit various signals via the connection unit 40.

The image display unit 20B is a mounting body to be mounted on the user's head, and has a glasses-shaped frame 6 (main body) in the present embodiment. The frame 6 has a right part 6A located in front of the user's right eye and a left part 6B located in front of the left eye. The right part 6A and the left part 6B are bridge parts 6C (connecting parts). It is the shape connected by. The bridge portion 6C connects the right portion 6A and the left portion 6B to each other at a position corresponding to the eyebrow of the user when the user wears the image display portion 20B.
The right part 6A and the left part 6B are connected to the temple parts 6D and 6E, respectively. The temple parts 6D and 6E support the frame 6 on the head of the user like temples of glasses. The right optical image display unit 26 is arranged in the right part 6A, and the left optical image display unit 28 is arranged in the left part 6B. When the user wears the image display unit 20B, the right and left of the user Located in front of the eyes.

  The temple portion 6D is provided to extend from the end ER, which is the other end of the right optical image display portion 26, to a position corresponding to the user's temporal region when the user wears the image display portion 20B. . Similarly, the temple portion 6E extends from the end EL, which is the other end of the left optical image display portion 28, to a position corresponding to the user's temporal region when the user wears the image display portion 20B. Provided. The temple portion 6D contacts the right ear or the vicinity thereof in the user's head, and the temple portion 6E contacts the user's left ear or the vicinity thereof, and holds the image display portion 20B on the user's head.

  The frame 6 is provided with a camera unit 3. The camera unit 3 includes a camera pedestal 3C where the upper camera 61B is disposed, and arms 3A and 3B that support the camera pedestal 3C. The arm portion 3A is rotatably connected to the temple portion 6D by a hinge 60A provided at the distal end portion AP of the temple portion 6D. The arm portion 3B is rotatably connected to the temple portion 6E by a hinge 60B provided at the distal end portion AP of the temple portion 6E. Therefore, the camera unit 3 as a whole can be rotated up and down in the direction indicated by the arrow K in the drawing, that is, in the mounted state. The camera unit 3 contacts the frame 6 at the lower end of the rotation range. The upper end of the rotation range of the camera unit 3 is determined by the specifications of the hinges 60A and 60B.

The camera pedestal portion 3C is a plate-like or bar-like member that extends over the right portion 6A, the left portion 6B, and the bridge portion 6C, and the upper camera 61B is embedded at a position corresponding to the bridge portion 6C. It is installed complicatedly. The upper camera 61B is a digital camera that includes an imaging element such as a CCD or CMOS, an imaging lens, and the like, and may be a monocular camera or a stereo camera.
The upper camera 61B images at least a part of the outside scene in the front side direction of the head-mounted display device 100, in other words, the user's visual field direction when the image display unit 20B is mounted. The width of the angle of view of the upper camera 61B can be set as appropriate. For example, at the lower end of the rotation range of the camera unit 3, the imaging range of the upper camera 61B is determined by the user as the right optical image display unit 26 and the left optical image. It is preferable that the outside world visually recognized through the display part 28 is included. Furthermore, it is more preferable that the imaging range of the upper camera 61B is set so that the entire field of view of the user through the light control plate 20A can be imaged. The upper camera 61B executes imaging under the control of the control unit 110 (FIG. 3) and outputs captured image data.

  In the image display unit 20B, an illuminance sensor 68 is disposed in the bridge unit 6C. The illuminance sensor 68 receives light from the outside scene direction that is visible to the user through the right optical image display unit 26 and the left optical image display unit 28, and outputs a detection value indicating the amount of light.

As described above, even in the configuration in which the camera unit 3 on which the upper camera 61B is mounted is provided so as to be displaceable with respect to the frame 6, the sub-control unit 150 (which includes the illuminance sensor 68 and acquires the detection value of the illuminance sensor 68) The above control can be executed according to FIG. In this case, even if the shape of the frame is different, the same effect as in the above embodiment can be obtained.
Further, the upper camera 61B may be attached to the camera unit 3 so as to be displaceable.

In addition, this invention is not restricted to the structure of the said embodiment and modification, It can implement in a various aspect in the range which does not deviate from the summary.
Further, for example, instead of the image display units 20 and 20B, an image display unit of another method such as an image display unit worn like a hat may be adopted, and an image corresponding to the left eye of the user is used. And a display unit that displays an image corresponding to the right eye of the user. The display device of the present invention may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet. In this case, the part for positioning the position with respect to the user's body and the part positioned with respect to the part can be used as the mounting portion.

As the control device 10, a notebook computer, a tablet computer, or a desktop computer may be used. Alternatively, a game machine, a portable phone, a portable electronic device including a smartphone or a portable media player, other dedicated devices, or the like may be used as the control device 10.
For example, as a configuration for generating image light in the image display units 20 and 20B, a configuration including an organic EL (Organic Electro-Luminescence) display and an organic EL control unit may be used. Further, as a configuration for generating image light, LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like can be used.

The optical system that guides the image light to the user's eyes may include an optical member that transmits external light that is incident on the apparatus from the outside and that is incident on the user's eyes together with the image light. Moreover, you may use the optical member which is located ahead of a user's eyes and overlaps a part or all of a user's visual field. Further, a scanning optical system that scans a laser beam or the like to obtain image light may be employed. Further, the optical member is not limited to guiding the image light inside the optical member, and may have only a function of guiding the image light by refracting and / or reflecting it toward the user's eyes.
For example, the present invention can also be applied to a laser retinal projection type head mounted display. That is, the light emitting unit includes a laser light source and an optical system that guides the laser light source to the user's eyes, and the laser light is incident on the user's eyes to scan the retina and form an image on the retina. A configuration that allows the user to visually recognize an image may be employed.
Further, the present invention can be applied to a display device that employs a scanning optical system using a MEMS mirror and uses MEMS display technology. That is, a light emitting unit includes a signal light forming unit, a scanning optical system having a MEMS mirror that scans light emitted from the signal light forming unit, and an optical member on which a virtual image is formed by light scanned by the scanning optical system. You may prepare. In this configuration, the light emitted from the signal light forming unit is reflected by the MEMS mirror, enters the optical member, is guided through the optical member, and reaches the virtual image forming surface. When the MEMS mirror scans the light, a virtual image is formed on the virtual image forming surface, and the user recognizes the virtual image with the eyes, thereby recognizing the image. The optical component in this case may be one that guides light through a plurality of reflections, such as the right light guide plate 261 and the left light guide plate 262 of the above embodiment, and may use a half mirror surface. .

  Further, at least a part of each functional block shown in FIG. 3 may be realized by hardware, or may be realized by cooperation of hardware and software, as shown in FIG. It is not limited to a configuration in which independent hardware resources are arranged. Further, each functional unit shown in FIG. 3 is not limited to an example constituted by a microprocessor and an IC, and a configuration in which a plurality of functional units are mounted on a larger scale integrated circuit may be adopted. -a-chip) or the like. Further, the configuration formed in the control device 10 may be formed in the image display unit 20 in an overlapping manner.

  2, 6 ... Frame, 10 ... Control device, 20, 20B ... Image display unit (display unit), 22 ... Right display drive unit, 24 ... Left display drive unit, 40 ... Connection unit, 41A ... Control data bus, 41B ... Image data bus, 41C, 41D ... display data bus, 61 ... camera, 63 ... microphone, 68 ... illuminance sensor (light detection unit), 100, 100B ... head-mounted display device (display device), 110 ... control unit ( (Second control unit), 121 ... memory, 122 ... flash memory, 123 ... power supply control unit, 124 ... UI control unit, 124 ... control unit, 125 ... wireless I / F control unit, 126 ... voice control unit, 127 ... sensor IC, 128 ... external I / F unit, 150 ... sub control unit (control unit), 155 ... I / F unit, 162 ... 9-axis sensor, 163 ... GPS, 165 ... EEPROM, 167, 168 ... LCD Moving parts, 169, 170 ... backlight driving section, 221 ... right backlight, 222 ... left backlight, 241 ... right LCD, 242 ... left liquid crystal display, 251 ... right projection optical system, 252 ... left projection optical system.

Claims (12)

A head-mounted display device mounted on a user's head,
A display unit that emits image light to the eyes of the user;
A light detection unit for detecting light;
An adjustment process for adjusting the display brightness of the display unit, and a control unit for executing a correction process for obtaining a correction coefficient based on the detection value of the light detection unit and correcting the display brightness of the display unit;
A display device comprising: The control unit obtains the correction coefficient using a detection value of the light detection unit;
The display device according to claim 1. The control unit obtains the correction coefficient by performing a calculation process by applying a detection value of the light detection unit to a preset calculation formula;
The display device according to claim 2. The control unit obtains the correction coefficient by applying a detection value of the light detection unit to a preset table;
The display device according to claim 2. The control unit performs an operation of correcting the display brightness after the adjustment process according to the correction coefficient in the correction process, and corrects the display brightness.
The display device according to claim 1, wherein: The control unit corrects the display brightness value of the display unit by multiplying the display brightness value of the display unit set in the adjustment process by the correction coefficient by the correction process;
The display device according to claim 5. The control unit performs a hysteresis process when changing the luminance value of the display of the display unit to the corrected luminance value by the correction process,
The hysteresis processing condition can be set independently for each of the case where the display brightness value of the display unit is changed to the high brightness side and the case where the brightness value is changed to the low brightness side,
The display device according to claim 1, wherein: The display unit includes a right-eye display unit that irradiates image light to the user's right eye, and a left-eye display unit that irradiates image light to the user's left eye,
The control unit sets the brightness of the right-eye display unit and the brightness of the left-eye display unit independently by the adjustment process;
The display device according to claim 1, wherein: The display unit is a see-through display unit that transmits external light and enters the user's eyes;
The display device according to claim 1, wherein: The light detection unit includes a light sensor that detects light from a direction that the user sees through the display unit;
The display device according to claim 9. The control unit is configured as a separate body, and includes a second control unit connected to the control unit,
The second control unit instructs the control unit to perform the correction process,
The control unit performs the adjustment process and the correction process based on an instruction of the second control unit;
The display device according to claim 1, wherein: Controlling a display device that is mounted on the user's head and includes a display unit that irradiates the user's eyes with image light, and a light detection unit that detects light,
An adjustment process for adjusting the display brightness of the display unit and a correction process for correcting the display brightness of the display unit by obtaining a correction coefficient based on the detection value of the light detection unit;
A control method of a display device characterized by the above.

Images