JP6136162B2 - Head-mounted display device and method for controlling head-mounted display device - Google Patents

Description

  The present invention relates to a head-mounted display device and a method for controlling the head-mounted display device.

  A head-mounted display device (Head Mounted Display (HMD)), which is a display device mounted on the head, is known. The HMD, for example, generates image light representing an image using a liquid crystal display and a light source, and guides the generated image light to the user's eyes using a projection optical system or a light guide plate. To recognize the virtual image. For example, Patent Document 1 describes a see-through type HMD.

JP 2009-92810 A

  FIG. 1 is an explanatory diagram for explaining a human visual field. It is known that a normal human visual field is about 60 degrees on the parietal side, about 70 degrees on the foot side, about 90 degrees on the ear side, and about 120 degrees on the nose side in the case of one eye. Further, the visual field of 60 degrees in the horizontal direction around the nose can be seen simultaneously by the left and right eyes. Hereinafter, a visual field that can be viewed simultaneously by both eyes is also referred to as a “binocular visual field”. Similarly, a visual field that can be viewed only with the left eye is also referred to as a “left eye visual field”, and a visual field that can be viewed with only the right eye is also referred to as a “right eye visual field”.

  The HMD includes a monocular type HMD that allows a right image or a left eye to recognize a virtual image, and a binocular type HMD that causes both the right eye and the left eye to recognize a virtual image, as described in Patent Document 1. is there. In the case of a monocular type HMD, a virtual image is visible to the eyes of the user on the side using the HMD. In addition, the outside scene is visible to the eyes of the user who is not using the HMD. As described above, the phenomenon in which different objects are visible to the left and right eyes in the binocular visual field of the user has a problem of promoting the user's eye strain. Further, even in the case of a binocular HMD, the same problem as described above occurs when different virtual images are displayed on the left and right eyes of the user.

  For this reason, a technique capable of realizing a head-mounted display device (HMD) that can reduce the occurrence of eye strain caused by different things seen by the left and right eyes in the user's binocular visual field is desired. It was.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following application examples or forms. Examples of application of the present invention are:
A head-mounted display device that allows a user to visually recognize a virtual image and an outside scene,
An image light generation unit that generates and emits image light representing an image;
A control unit for displaying an image on the image light generation unit;
With
The controller is
As the display mode of the image, the region occupied by the left-eye visual field or right-eye visual field of the user in the state where the head-mounted display device is mounted in the image light emitting region in the image light generation unit A head-mounted display device that has a mode for displaying the image on the screen and makes a transition to the mode. The form of the present invention is as follows.

(1) According to an aspect of the present invention, a head-mounted display device that allows a user to visually recognize a virtual image and an outside scene is provided. The head-mounted display device includes: an image light generation unit that generates and emits image light representing an image; and the image light generation unit emits the image light in the image light generation unit in a predetermined display mode. The image is displayed in a region occupied by the left eye visual field or the right eye visual field of the user while wearing the head-mounted display device in the possible region. According to the head-mounted display device of this aspect, an image is displayed in the region occupied by the left eye field or the right eye field in the image light emitting region in the image light generator. Therefore, it is possible to avoid the occurrence of a phenomenon in which different objects are visible to the left and right eyes in the binocular visual field of the user. As a result, it is possible to realize a head-mounted display device that can reduce the occurrence of eye strain caused by different things seen by the left and right eyes in the user's binocular visual field.

(2) In the head-mounted display device of the above aspect, a detection unit that detects the movement of the user's eyes when the head-mounted display device is mounted; In response, a first display mode for displaying the image in the image light emitting area in the image light generating unit, and the left eye visual field in the image light emitting area in the image light generating unit or A determination unit that determines a second display mode in which the image is displayed in an area occupied by the right eye visual field. According to the head-mounted display device of this aspect, since the first display mode and the second display mode are switched according to the movement of the user's eyes, the convenience for the user can be improved.

(3) In the head-mounted display device according to the above aspect; the detection unit; an imaging unit that captures an image of the eyeball of the user in a state in which the head-mounted display device is mounted; and the captured eyeball image The analysis unit for acquiring a gaze movement amount that is the movement amount of the iris with respect to the center position of the user's eyeball and a gaze movement direction that is the movement direction of the iris with respect to the center position of the user's eyeball And the determination unit is configured to generate the image light when the acquired line-of-sight movement direction is the first direction and the acquired line-of-sight movement amount exceeds a predetermined threshold. The part may be in the first display mode. According to the head-mounted display device of this aspect, the determining unit is the line-of-sight movement amount that is the movement amount of the iris with respect to the center position of the user's eyeball, and the movement direction of the iris with respect to the center position of the user's eyeball. The image light generation unit is set to the first display mode using the line-of-sight movement direction. As a result, the user can switch from the second display mode to the first display mode by the movement of the line of sight.

(4) In the head-mounted display device according to the above aspect; the determining unit; the acquired line-of-sight movement direction is a second direction, and the acquired line-of-sight movement amount is a predetermined threshold value. When it exceeds, it is good also considering the said image light production | generation part as said 2nd display mode. According to the head-mounted display device of this aspect, the determining unit is the line-of-sight movement amount that is the movement amount of the iris with respect to the center position of the user's eyeball, and the movement direction of the iris with respect to the center position of the user's eyeball. The image light generation unit is set to the second display mode using the line-of-sight movement direction. As a result, the user can switch from the first display mode to the second display mode by the movement of the line of sight.

(5) In the head-mounted display device according to the above aspect; the detection unit includes an eyelid detection unit that detects a state of the eyelid of the user in a state where the head-mounted display device is mounted; When it is detected that at least one of the right eyelid and the left eyelid of the user is kept closed for a predetermined time, the image light generation unit is set to the first display mode. It is good. According to the head-mounted display device of this aspect, the determination unit detects that at least one of the right eyelid and the left eyelid of the user is kept closed for a predetermined time. The image light generator is set to the first display mode. As a result, the user can switch from the second display mode to the first display mode by opening and closing the eyelid.

(6) In the head-mounted display device according to the above aspect; the determination unit; if it is detected that both the eyelid of the right eye and the eyelid of the left eye of the user are open, the image The light generation unit may be in the second display mode. According to the head-mounted display device of this aspect, the determination unit sets the image light generation unit to the first when the user's right eyelid and left eyelid are both open. 2 display mode. As a result, the user can switch from the first display mode to the second display mode by opening and closing the eyelid.

(7) In the head-mounted display device according to the above aspect, the method further includes: transmitting image data generated from the image to the image light generation unit, and generating and emitting the image light by the image light generation unit A main control unit for controlling the image light; the main control unit can emit the image light in the image light generation unit by inserting dummy data into the image data in the second display mode; The image may be displayed in a region occupied by the left eye field or the right eye field in the region. According to the head-mounted display device of this aspect, the main control unit can cause the image light generation unit to realize the second display mode by inserting dummy data into the image data.

(8) In the head-mounted display device according to the above aspect, the method further includes: transmitting image data generated from the image to the image light generation unit, and generating and emitting the image light by the image light generation unit A main control unit for controlling the image light; in the second display mode, by operating a signal for switching the validity / invalidity of the image light generation by the image light generation unit, the image light The image may be displayed in a region occupied by the left eye field or the right eye field in the image light emitting region in the generation unit. According to the head-mounted display device of this aspect, the main control unit operates the signal for switching the validity / invalidity of the image light generation by the image light generation unit, whereby the second display is performed on the image light generation unit. A mode can be realized.

(9) In the head mounted display device according to the above aspect; the main control unit; obtains position designation information for designating a position where the image is displayed in the second display mode; and the second display mode. Then, instead of the area occupied by the left eye field or the right eye field in the image light emitting area in the image light generator, the image is displayed at a position specified by the position specification information. Also good. According to the head-mounted display device of this aspect, the main control unit can display an image at the position specified by the position specifying information in the second display mode of the image light generation unit. If the position designation information can be set according to the user's preference, the usability of the head-mounted display device can be improved.

(10) In the head mounted display device according to the above aspect; the image light generation unit is provided to correspond to either the right eye or the left eye of the user; the main control unit; In the second display mode, the image may be displayed at an end of the image light generation unit on the side where the image light generation unit is provided in the image light emitting area. According to the head-mounted display device of this form, a monocular head-mounted type that can reduce the occurrence of eyestrain caused by different things seen by the left and right eyes in the binocular visual field of the user A display device can be realized.

(11) In the head-mounted display device of the above aspect; the image light generation unit is provided to correspond to the right eye and the left eye of the user; the main control unit; the second display mode In the image light generation unit corresponding to the right eye of the user, the image light is displayed on a right end portion of the image light emitting area, and the image light corresponding to the left eye of the user is displayed. In the generation unit, the image may be displayed on a left end portion of the image light emitting area. According to the head-mounted display device of this embodiment, a binocular head-mounted device that can reduce the occurrence of eye strain caused by different things visible to the left and right eyes in the user's binocular visual field. A mold display device can be realized.

(12) In the head-mounted display device according to the above aspect, the head-mounted display device is further held in a manner movable in the horizontal direction in the vicinity of the user's eye in a state in which the head-mounted display device is mounted. A light guide plate that guides the image light emitted from the image light generation unit to the eyes of the user; the main control unit is capable of emitting the image light in the image light generation unit in the second display mode; Instead of displaying the image in the region occupied by the left eye field or the right eye field in the region, the guide is directed toward the user's ear side in a state where the head-mounted display device is worn. The light plate may be moved. According to the head-mounted display device of this aspect, in the second display mode, the light guide plate is moved toward the user's ear side in a state where the head-mounted display device is mounted. By adjusting the amount of movement, in the second display mode, it is possible to avoid a phenomenon in which different objects are visible to the left and right eyes in the binocular visual field of the user. As a result, it is possible to realize a head-mounted display device that can reduce the occurrence of eye strain caused by different things seen by the left and right eyes in the user's binocular visual field.

  A plurality of constituent elements of each embodiment of the present invention described above are not essential, and some or all of the effects described in the present specification are to be solved to solve part or all of the above-described problems. In order to achieve the above, it is possible to appropriately change, delete, replace with a new component, and partially delete the limited contents of some of the plurality of components. In order to solve some or all of the above-described problems or achieve some or all of the effects described in this specification, technical features included in one embodiment of the present invention described above. A part or all of the technical features included in the other aspects of the present invention described above may be combined to form an independent form of the present invention.

  For example, the device as one embodiment of the present invention can be realized as, for example, a head-mounted display device, but can also be realized as a device other than the head-mounted display device. Any or all of the technical features of each form of the head-mounted display device described above can be applied to this device.

  The present invention can be realized in various modes. For example, a head-mounted display device, a control method for the head-mounted display device, and a computer for realizing the functions of these methods or devices. It can be realized in the form of a program, a recording medium on which the computer program is recorded, or the like.

It is explanatory drawing explaining a human visual field. It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in one Embodiment of this invention. It is a block diagram which shows the composition of a head mount display functionally. It is explanatory drawing which shows a mode that image light is inject | emitted by the image light production | generation part. It is explanatory drawing which shows an example of the virtual image recognized by the user. It is a state transition diagram shown about the display mode which the image light production | generation part of a head mounted display can take. It is explanatory drawing for demonstrating display mode. It is explanatory drawing for demonstrating the setting of the image display area by a user. It is explanatory drawing about the acquisition method of a gaze movement direction and a gaze movement amount. It is explanatory drawing about the method of detecting the state of a user's eyelid. It is a block diagram which shows functionally the structure of the head mounted display apparatus in 2nd Embodiment. It is explanatory drawing for demonstrating the display mode in 2nd Embodiment. It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in a modification.

A. First embodiment:
A-1. Configuration of head mounted display device:
FIG. 2 is an explanatory diagram showing an external configuration of the head-mounted display device according to the embodiment of the present invention. The head-mounted display device HM is a head-mounted display device mounted on the head, and is also called a head mounted display (HMD). The head-mounted display HM of the present embodiment is an optically transmissive head-mounted display device that allows a user to visually recognize a virtual image and at the same time directly view an outside scene. The head-mounted display HM includes an image display unit 20 that allows the user to visually recognize a virtual image while being mounted on the user's head, and a control unit (controller) 10 that controls the image display unit 20.

  The image display unit 20 is a mounting body attached to the user's head, and in the present embodiment, has a substantially glasses shape with no left lens. The image display unit 20 includes a right holding unit 21, a right display driving unit 22, a left holding unit 23, a right optical image display unit 26, and a right camera 61.

  The right optical image display unit 26 is disposed at a position corresponding to the right eye of the user when the head mounted display HM is mounted. A central holding portion 71 is disposed at a position above the right optical image display portion 26 and corresponding to the eyebrow of the user when the head mounted display HM is mounted. The center holding portion 71 is formed such that the width from one end ER to the other end EL is approximately twice the width L1 of the right optical image display portion 26. Extending from one end ER of the center holding portion 71 to a position corresponding to the user's temporal region when the head mounted display HM is mounted, the right holding is performed by extending substantially at a right angle to the right optical image display portion 26. A portion 21 is provided. From the other end EL of the center holding portion 71 to a position corresponding to the user's temporal region when the head mounted display HM is mounted, the left holding is performed by extending substantially at a right angle to the right optical image display portion 26. A portion 23 is provided. The right holding unit 21 and the left holding unit 23 hold the head mounted display HM on the user's head like a temple of glasses.

  The nose pad 72 is a member that extends in the vertical direction so as to come into contact with the right side of the user's nose in a state where the head mounted display HM is mounted from the center holding portion 71. The nose pad 74 is a member that extends in the vertical direction so as to be in contact with the left side of the nose of the user wearing the head mounted display HM from the center holding portion 71. The nose pads 72 and 74 fix the head mounted display HM to the user's head so as to be sandwiched from both sides of the user's nose.

  The right display driving unit 22 is disposed on the inner side of the right holding unit 21, in other words, on the side facing the user's head when the head mounted display HM is mounted, on the end ER side. Hereinafter, the right holding unit 21 and the left holding unit 23 are collectively referred to simply as “holding unit”, the right display driving unit 22 is simply “display driving unit”, and the right optical image display unit 26 is simply “optical image”. Also referred to as “display unit”. The display driving unit includes an LCD (Liquid Crystal Display), a projection optical system, and the like. Details will be described later. The optical image display unit as an optical member includes a light guide plate and a light control plate. The light guide plate is formed of a light transmissive resin material or the like, and emits image light taken from the display driving unit toward the user's eyes. The light control plate is a thin plate-like optical element, and is arranged so as to cover the front side of the head mounted display HM, in other words, the side opposite to the eye side of the user. The light control plate protects the light guide plate and suppresses damage to the light guide plate, adhesion of dirt, and the like. Moreover, the light control board can adjust the external light quantity which enters into a user's eyes by adjusting light transmittance, and can adjust the ease of visual recognition of a virtual image. The light control plate can be omitted.

  The right camera 61 is disposed on the inner surface of the right optical image display unit 26, in other words, on the surface facing the right eye of the user wearing the head mounted display HM. The right camera 61 includes an infrared illumination and a CCD camera, and acquires an eyeball image of the right eye of the user. The right camera 61 corresponds to an “imaging unit” in the claims.

  The image display unit 20 further includes a connection unit 40 for connecting the image display unit 20 to the control unit 10. The connection unit 40 includes a main body cord 48 connected to the control unit 10, a right cord 42 in which the main body cord 48 branches into two, a left cord 44, and a connecting member 46 provided at the branch point. Yes. The right cord 42 is inserted into the casing of the right holding unit 21 from the distal end AP in the extending direction of the right holding unit 21 and connected to the right display driving unit 22. Similarly, the left cord 44 is inserted into the housing of the left holding portion 23 from the front end portion AP in the extending direction of the left holding portion 23.

  The image display unit 20 and the control unit 10 transmit various signals via the connection unit 40. Each end of the main body cord 48 opposite to the connecting member 46 and the control unit 10 are provided with connectors (not shown) that are fitted to each other. The connector of the main body cord 48 and the control unit 10 The control unit 10 and the image display unit 20 are connected to or disconnected from each other by the fitting / releasing of the connector. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The control unit 10 is a device for operating the head mounted display HM. The control unit 10 includes a lighting unit 12, a touch pad 14, a cross key 16, and a power switch 18.

  The lighting unit 12 notifies the operation state of the head mounted display HM by the light emission state. The operating state of the head mounted display HM is, for example, power ON / OFF. For example, an LED (Light Emitting Diode) can be used as the lighting unit 12. The touch pad 14 detects a user's finger operation on the operation surface of the touch pad 14 and outputs a signal corresponding to the detected content. The cross key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head mounted display HM by detecting a slide operation of the switch.

  FIG. 3 is a block diagram functionally showing the configuration of the head mounted display HM. The control unit 10 includes an input information acquisition unit 110, a storage unit 120, a power supply 130, a CPU 140, an interface 180, and a transmission unit (Tx) 51. The aforementioned units are connected to each other by a bus (not shown).

  The input information acquisition unit 110 acquires a signal corresponding to an operation input by the user such as an operation input to the touch pad 14, the cross key 16, the power switch 18, and the like. The storage unit 120 is a storage unit including a ROM, a RAM, a DRAM, a hard disk, and the like. Further, the storage unit 120 includes position designation information 122. The position designation information 122 is a setting value used when the image light generation unit (described later) is set to the one-eye viewing mode. The power supply 130 supplies power to each part of the head mounted display HM. As the power supply 130, for example, a secondary battery can be used.

  The CPU 140 provides a function as an operating system (OS) 150 by executing a program installed in advance. In addition, the CPU 140 expands and executes firmware and computer programs stored in the ROM and the hard disk in the RAM, thereby executing an analysis unit 142, a determination unit 144, an image processing unit 160, an audio processing unit 170, and a display control unit 190. Also works. The analysis unit 142 receives the eyeball image of the right eye of the user acquired by the right camera 61, analyzes the eyeball image, and detects the movement of the user's eyes. The analysis unit 142 and the right camera 61 correspond to a “detection unit” in the claims. The determination unit 144 determines the display mode of the image light generation unit (described later). Details of each part will be described later.

  The image processing unit 160 generates a signal to be supplied to the image display unit 20 based on content input via the interface 180 and transmits the signal to the image display unit 20. The signal supplied to the image display unit 20 differs between the analog format and the digital format.

  For example, in the case of an analog format, the image processing unit 160 generates and transmits a clock signal PCLK, a vertical synchronization signal VSync, a horizontal synchronization signal HSync, and image data Data. Specifically, the image processing unit 160 acquires an image signal included in the content. For example, in the case of a moving image, the acquired image signal is generally an analog signal composed of 30 frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. Further, the image processing unit 160 generates the clock signal PCLK using a PLL circuit or the like according to the period of the separated vertical synchronization signal VSync, horizontal synchronization signal HSync, and the like. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like. Thereafter, the image processing unit 160 stores the converted digital image signal in the DRAM in the storage unit 120 for each frame as image data Data of RGB data.

  For example, in the case of a digital format, the image processing unit 160 generates and transmits a clock signal PCLK and image data Data. Specifically, when the content is in a digital format, the clock signal PCLK is output in synchronization with the image signal. For this reason, A / D conversion of the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the analog image signal becomes unnecessary.

  The image processing unit 160 performs image processing such as resolution conversion processing, various tone correction processing such as adjustment of luminance and saturation, and keystone correction processing on the image data Data stored in the storage unit 120. May be executed. The image processing unit 160 sends the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data stored in the DRAM in the storage unit 120 to the transmission unit 51. Send through. At this time, the transmission unit 51 functions as a transceiver for serial transmission between the control unit 10 and the image display unit 20.

  The display control unit 190 generates a control signal for controlling the right display driving unit 22. Specifically, the display control unit 190 individually controls ON / OFF driving of the right LCD 241 by the right LCD control unit 211 and ON / OFF driving of the right backlight 221 by the right backlight control unit 201 based on the control signal. By controlling, the generation and emission of image light by the right display driving unit 22 are controlled. For example, the display control unit 190 may cause the right display driving unit 22 to generate image light or not generate image light. The display control unit 190 transmits a control signal for the right LCD control unit 211 and a control signal for the right backlight control unit 201 via the transmission unit 51, respectively.

  The audio processing unit 170 acquires the audio signal included in the content, amplifies the acquired audio signal, and connects the connection unit 40 to the speaker in the right earphone 32 and the speaker in the left earphone 34 of the image display unit 20. Supply through. For example, when a Dolby (registered trademark) system is adopted, processing is performed on an audio signal, and different sounds with different frequencies or the like are output from the right earphone 32 and the left earphone 34, respectively.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the control unit 10. Examples of the external device OA include a personal computer PC, a mobile phone terminal, and a game terminal. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, a wireless LAN interface, or the like can be provided.

  The image display unit 20 includes a right display drive unit 22, a right light guide plate 261 as the right optical image display unit 26, a right camera 61, a right earphone 32, and a left earphone 34.

  The right display driving unit 22 includes a receiving unit (Rx) 53, a right backlight (BL) control unit 201 and a right backlight (BL) 221 that function as a light source, a right LCD control unit 211 that functions as a display element, and a right An LCD 241 and a right projection optical system 251 are included. The right backlight control unit 201, the right LCD control unit 211, the right backlight 221 and the right LCD 241 are also collectively referred to as “image light generation unit”.

  The receiving unit 53 functions as a receiver for serial transmission between the control unit 10 and the image display unit 20. The right backlight control unit 201 has a function of driving the right backlight 221 based on the input control signal. The right backlight 221 is a light emitter such as an LED or electroluminescence (EL). The right LCD control unit 211 has a function of driving the right LCD 241 based on the clock signal PCLK, the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the image data Data input via the reception unit 53. The right LCD 241 is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix.

  FIG. 4 is an explanatory diagram illustrating a state in which image light is emitted by the image light generation unit. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal corresponding to each pixel position arranged in a matrix, thereby changing the illumination light IL emitted from the right backlight 221. It has a function of modulating into effective image light PL representing an image. As shown in FIG. 4, the backlight system is adopted in this embodiment, but a configuration in which image light is emitted using a front light system or a reflection system may be used.

  The right projection optical system 251 in FIG. 3 is configured by a collimating lens that converts image light emitted from the right LCD 241 to light beams in a parallel state. The right light guide plate 261 as the right optical image display unit 26 guides the image light output from the right projection optical system 251 to the right eye RE of the user while reflecting the image light along a predetermined optical path. The right projection optical system 251 and the right light guide plate 261 are collectively referred to as “light guide unit”. In addition, as long as a light guide part forms a virtual image in front of a user's eyes using image light, arbitrary systems can be used, for example, a diffraction grating may be used and a transflective film is used. Also good.

  FIG. 5 is an explanatory diagram illustrating an example of a virtual image recognized by the user. As described above, the image light guided to the right eye of the user of the head mounted display HM forms an image on the retina of the right eye of the user, so that the user looks as if with both eyes. A virtual image can be visually recognized. As shown in FIG. 5, a virtual image VI is displayed in the visual field VR of the user of the head mounted display HM. For the portion of the visual field VR of the user where the virtual image VI is displayed, the user can see the outside scene SC directly for the left eye via the virtual image VI of the optical image display unit for the right eye. . With respect to portions other than the portion where the virtual image VI is displayed in the visual field VR of the user, the user can see the outside scene SC through the optical image display unit for the right eye and directly for the left eye. Further, the head mounted display HM of the present embodiment is a monocular type head mounted display having only an optical image display unit (right optical image display unit 26) corresponding to the right eye. For this reason, as shown in the figure, the display position of the virtual image VI in the user's visual field VR is shifted to the right.

A-2. Display mode of image light generator:
FIG. 6 is a state transition diagram showing display modes that the image light generation unit of the head mounted display HM can take. The image light generation unit in the present embodiment can take two display modes, that is, a one-eye view mode SM and a full-view mode AM. When the image light generation unit of the head mounted display HM is in the one-eye visual field mode SM, the determination unit 144 monitors whether or not the full visual field mode transition condition is satisfied. Then, after the full visual field mode transition condition is satisfied, the determination unit 144 causes the image light generation unit to transition to the full visual field mode AM. In addition, when the image light generation unit of the head mounted display HM is in the full-view mode AM, the determination unit 144 monitors whether the one-eye view mode transition condition is satisfied. Then, after the one-eye viewing mode transition condition is satisfied, the determination unit 144 causes the image light generation unit to transition to the one-eye viewing mode SM. Note that the state (initial state) that is initially taken when the head mounted display HM is activated may be either state.

A-2-1. Display mode description:
FIG. 7 is an explanatory diagram for explaining the display mode. FIG. 7A shows a state of the right LCD 241 when the image light generation unit is set to the one-eye viewing mode SM. In the single-eye viewing mode SM, the horizontal end of the image light emitting area in the image light generation unit is set as an “image display area”, and an image based on content or the like is displayed on the image display area AW. Let The “image light emitting area in the image light generation unit” means that when the image light generation unit is composed of a backlight and an LCD as in this embodiment, all the liquid crystal is arranged in the LCD. An area is defined as an area that can be illuminated by a backlight.

  Further, the “horizontal end” as the image display area AW means that the image light generation unit corresponding to the right eye of the user can emit image light in the image light generation unit as in this embodiment. The right end of the region is the region occupied by the visual field (FIG. 1, right eye visual field) that can be seen by the user only with the right eye. In a monocular type head-mounted display having an image light generating unit corresponding to the left eye of the user, the left end of the image light emitting area in the image light generating unit is used. The area occupied by the visual field (FIG. 1, left-eye visual field) that can be seen only by the left eye. This example shows an example in which the positional relationship between the LCD drawing and the actual virtual image visually recognized by the user corresponds to the structure of the head mounted display HM. When the drawing and the virtual image on the LCD are reversed vertically and horizontally, the drawing position on the LCD varies depending on the right eye field or the left eye field which is finally visually recognized by the user as a virtual image.

  In the example of FIG. 7, the image display area AW is defined as all areas at the end in the horizontal direction, and the vertical direction is not considered. However, the image display area AW may be defined as at least a part of the horizontal end, and the vertical direction may be considered. In this case, for example, the upper right portion of the right LCD 241 in FIG. 7A can be used as the image display area AW.

  The size and position of the image display area AW may be determined in advance and stored in the position designation information 122 of the storage unit 120. Further, as described with reference to FIG. 8, it may be set by the user and stored in the position designation information 122.

  FIG. 8 is an explanatory diagram for explaining the setting of the image display area by the user. FIG. 8A shows an example in which the horizontal width of the image display area AW is changed while the end portion EP of the image display area AW is fixed. For example, the image processing unit 160 and the display control unit 190 cause the image display unit 20 to display a setting change screen as shown in FIG. The user operates the touch pad 14 and the cross key 16 provided on the controller 10 to move the slide bar SB displayed on the screen. By moving the slide bar SB, the horizontal width of the image display area AW can be changed. The image processing unit 160 stores the horizontal width of the image display area AW set in this way in the position designation information 122.

  FIG. 8B shows an example in which the image display area AW having a certain size is moved in the horizontal direction inside the LCD. For example, the image processing unit 160 and the display control unit 190 cause the image display unit 20 to display a setting change screen as shown in FIG. The user operates the touch pad 14 and the cross key 16 provided on the controller 10 to move the pointer PB displayed on the screen. The image display area AW can be moved in the horizontal direction by moving the pointer PB. The image processing unit 160 stores the position of the image display area AW set in this way in the position designation information 122.

One of the following methods (1) and (2) can be used as a method for displaying an image on the image display area AW.
(1) The image processing unit 160 reads the position designation information 122. When generating the image data Data, the image processing unit 160 inserts dot data generated from the image based on the content into the image display area AW specified from the position designation information 122, and other than the image display area. In the area BW, black dummy dot data is inserted.
(2) The image processing unit 160 reads the position designation information 122, and operates a signal (Enable signal) for switching validity / invalidity of image light generation by the image light generation unit. Specifically, the image processing unit 160 sets the output value of the Enable signal in the image display area AW specified from the position designation information 122 to Hi (valid). Further, the image processing unit 160 sets the output value of the Enable signal in the other area BW to Lo (invalid).
In the above (1) and (2), the image processing unit 160 functions as a “main control unit” in the claims.

  As a result of the above, in the example of FIG. 7A, the right LCD 241 displays a concierge image using a dog character in the image display area AW and black display in the other area BW.

  FIG. 7B shows a state of the right LCD 241 when the image light generation unit is set to the full-view mode AM. In the full-view mode AM, an image based on the content or the like is displayed on all the image light emitting areas in the image light generation unit. As shown in FIGS. 7A and 7B, the image processing unit 160 cooperates with the OS 150, a predetermined application, and the like to perform image light in the one-eye field mode SM and the whole field mode AM. You may change the image displayed on a production | generation part. Specifically, the image processing unit 160 displays an image or video to be originally displayed as it is in the full-view mode AM. On the other hand, in the case of the one-eye view mode SM, the image processing unit 160 may display an image or video obtained by simplifying or abstracting an image or video to be originally displayed with an icon or the like.

  The single-eye visual field mode SM corresponds to the “second display mode” in the claims. Similarly, the full-view mode AM corresponds to the “first display mode” in the claims.

A-2-2. Full-field mode transition condition:
The full-field mode transition condition in FIG. 6 can be arbitrarily determined. For example, one or a plurality of conditions (a1) to (a3) described below can be selected.
Condition (a1): When the line-of-sight movement direction acquired by the analysis unit 142 is the first direction and the line-of-sight movement amount exceeds a predetermined threshold.

  FIG. 9 is an explanatory diagram of a method for acquiring the line-of-sight movement direction and the line-of-sight movement amount. FIG. 9A shows an overview when a user wearing the head mounted display HM is viewed from the side surface on the right eye side. For convenience of illustration, the right holding portion 21 is represented by a broken line. The analysis unit 142 receives an eyeball image of the right eye of the user acquired by the right camera 61 disposed on the inner surface of the right optical image display unit 26 as shown in FIG. Then, the analysis unit 142 analyzes the received eyeball image to obtain the gaze movement direction and the gaze movement amount of the right eye. The “line-of-sight movement amount” is the movement direction of the iris AE relative to the center position AX of the user's eyeball. In the present embodiment, the line-of-sight movement amount is expressed by orthogonal coordinates (x, y) with the center position AX as a reference (0, 0). The “line-of-sight movement direction” is the amount of movement of the iris AE relative to the center position AX of the user's eyeball. In the present embodiment, the line-of-sight movement direction is expressed by orthogonal coordinate codes.

  For example, in the example of FIG. 9B, a diagram in the case where the iris AE is located at the center position AX, and the line-of-sight movement amount and the line-of-sight movement direction (x, y) at that time are shown. In this example, since the iris AE is on the center position AX, the line-of-sight movement amount and the line-of-sight movement direction are (± 0, ± 0). In the example of FIG. 9C, a diagram when the iris AE moves to the left with respect to the center position AX, and the line-of-sight movement amount and the line-of-sight movement direction (x, y) at that time are shown. In this example, since the iris AE moves in the horizontal direction from the center position AX, the line-of-sight movement amount and the line-of-sight movement direction are (+10, ± 0).

  Note that the condition “first direction” of the line-of-sight movement direction and the condition “a predetermined threshold value” of the line-of-sight movement amount in the condition (a1) can be arbitrarily determined. For example, the first direction can be “the x direction indicating the horizontal direction and the plus direction”. The predetermined threshold value can be “10”. Further, the first direction and the predetermined threshold value may be determined in advance and stored in the storage unit 120. Further, it may be set by the user and stored in the storage unit 120.

  If the condition (a1) is adopted as the whole visual field mode transition condition, the determination unit 144 performs the line-of-sight movement amount that is the movement amount of the iris AE with respect to the center position AX of the user's eyeball and the center position AX of the user's eyeball. The image light generation unit is set to the full-field mode AM (first display mode) using the line-of-sight movement direction that is the movement direction of the iris AE. As a result, the user can switch from the one-eye view mode SM (second display mode) to the full-view mode AM (first display mode) by the movement of the line of sight.

  Condition (a2): When it is detected that at least one of the right eyelid and the left eyelid of the user is kept closed for a predetermined time.

  FIG. 10 is an explanatory diagram of a method for detecting the state of the user's eyelid. In order to detect the state of the user's eyelid, the image display unit 20 shown in FIG. Further, the analysis unit 142 detects the state of the right eyelid and the left eyelid of the user, that is, whether the eyelid is open or closed, according to the output value from the infrared sensor 80.

  FIG. 10 shows an overview when the user's eye wearing the head mounted display HM is looked down from the top of the user in the vertical direction. The infrared sensor 80 includes an infrared light emitting unit 81 and an infrared light receiving unit 86. The infrared light emitting unit 81 emits infrared rays toward both eyes of the user. The infrared light emitting unit 81 further includes a right infrared light emitting unit 82 and a left infrared light emitting unit 84. The right infrared light emitting unit 82 is provided in the right display driving unit 22 and emits infrared rays toward the right eye of the user. The left infrared light emitting unit 84 is provided at a position corresponding to the position where the right infrared light emitting unit 82 is provided, which is an end of the left holding unit 23, and emits infrared rays toward the left eye of the user. The infrared light receiving unit 86 is provided inside the center holding unit 71, in other words, on the side facing the user's head when the head mounted display HM is mounted, and at a position corresponding to the user's eyebrow. It has been. The infrared light receiving unit 86 receives infrared light reflected by both eyes of the user.

  The infrared light emitted from the right infrared light emitting unit 82 is reflected by the right light guide plate 261 of the image display unit 20 and enters the right eye RE of the user. The reflected infrared light from the right eye RE with respect to the incident light reaches the infrared light receiving unit 86 and is detected by the infrared sensor 80. The infrared light emitted from the left infrared light emitting unit 84 is the same as the infrared light emitted from the right infrared light emitting unit 82. Since the infrared reflectance differs between the state where the user's eyes are open and the state where the eyes are closed, different values are output from the infrared light receiving unit 86. Therefore, the analysis unit 142 can determine whether the user's eyes are open or closed based on the output value from the infrared sensor 80.

  The “predetermined time” in the condition (b1) can be arbitrarily determined. The predetermined time may be determined in advance and stored in the storage unit 120, or may be set by the user and stored in the storage unit 120. When this condition is adopted, the analysis unit 142 and the infrared sensor 80 function as “eyelid detection unit” and “detection unit” in the claims.

  If the condition (a2) is adopted as the full-field mode transition condition, the determination unit 144 detects that at least one of the right eyelid and the left eyelid of the user has been closed for a predetermined time. In this case, the image light generation unit is set to the full-view mode AM (first display mode). As a result, the user can switch from the one-eye view mode SM (second display mode) to the full-view mode AM (first display mode) by opening and closing the eyelid.

  Condition (a3): When a display mode switching request from the outside is acquired. Specifically, when the determination unit 144 acquires that the full-view mode AM is selected via the touch pad 14 or the cross key 16 provided in the controller 10.

  If the condition (a3) is adopted as the full-field mode transition condition, the determining unit 144 changes from the one-eye visual mode SM (second display mode) to the full-field mode in response to an operation from the touch pad 14 or the cross key 16. Switching to AM (first display mode) can be performed.

A-2-3. Single-eye viewing mode transition condition:
The one-eye visual field mode transition condition in FIG. 6 can be arbitrarily determined. For example, one or a plurality of conditions (b1) to (b3) described below can be selected. In the following description, the same number as the number assigned in the all-field mode transition condition is the corresponding condition. The single-eye visual field mode transition condition is preferably a condition corresponding to the full-field mode transition condition. Specifically, when the full-field mode transition condition is the condition (a1), the single-eye visual field mode transition condition is The condition (b1) is preferable.

  Condition (b1): When the line-of-sight movement direction acquired by the analysis unit 142 is the second direction, and the line-of-sight movement amount exceeds a predetermined threshold. The line-of-sight movement direction and the line-of-sight movement amount are as described in “A-2-2. Full-field mode transition condition:”. Further, the condition “second direction” of the line-of-sight movement direction and the condition “predetermined threshold value” of the line-of-sight movement amount in the condition (b1) can be arbitrarily determined. For example, the second direction can be “the x direction indicating the horizontal direction and the minus direction”. The predetermined threshold value can be “10”. Further, the second direction and the predetermined threshold value may be determined in advance and stored in the storage unit 120. Further, it may be set by the user and stored in the storage unit 120.

  If the condition (b1) is adopted as the one-eye visual field mode transition condition, the determination unit 144 includes the line-of-sight movement amount that is the movement amount of the iris AE with respect to the center position AX of the user's eyeball and the center position AX of the user's eyeball. The image light generation unit is set to the one-eye visual field mode SM (second display mode) using the line-of-sight movement direction that is the movement direction of the iris AE with respect to. As a result, the user can switch from the full-view mode AM (first display mode) to the one-eye view mode SM (second display mode) by the movement of the line of sight.

  Condition (b2): When it is detected that both the right eyelid and the left eyelid of the user are open. The method for detecting the state of the eyelid is as described in “A-2-2. Full-field mode transition condition:”.

  If the condition (b2) is adopted as the one-eye visual field mode transition condition, the determination unit 144 determines that the image light is detected when both the right eyelid and the left eyelid of the user are detected. The generation unit is set to a one-eye visual field mode SM (second display mode). As a result, the user can switch from the full-view mode AM (first display mode) to the one-eye view mode SM (second display mode) by opening and closing the eyelid.

  Condition (b3): When a display mode switching request from the outside is acquired. Specifically, when the determination unit 144 acquires that the one-eye viewing mode SM is selected via the touch pad 14 or the cross key 16 provided in the controller 10.

  If the condition (b3) is adopted as the one-eye view mode transition condition, the determination unit 144 changes from the full-view mode AM (first display mode) to the one-eye view in response to an operation from the touch pad 14 or the cross key 16. Switching to mode SM (second display mode) can be performed.

  As described above, according to the first embodiment, in the one-eye viewing mode SM (second display mode), the image display that is the horizontal end of the image light emitting area in the image light generation unit. An image is displayed in the area AW. Since the image display area AW that is the “end” is an area occupied by the left eye field or the right eye field, in the one-eye field mode SM (second display mode) Occurrence of a phenomenon in which different objects are visible to the eyes can be avoided. As a result, it is possible to reduce the occurrence of eye strain caused by different things seen in the left and right eyes in the user's binocular visual field, and to realize a head-mounted display HM (head-mounted display device) that is kind to the user's eyes. can do.

  In addition, if the above-described conditions (a1) and (b1) or conditions (a2) and (b2) are used as the all-field mode transition condition and the one-eye field mode transition condition, the movement of the line of sight and the opening / closing of the eyelid, According to the movement of the user's eyes, it is possible to switch between the full-view mode AM (first display mode) and the one-eye view mode SM (second display mode). For this reason, the convenience for the user can be improved.

  Further, according to the first embodiment, the image processing unit 160 (main control unit) displays the image designated by the position designation information 122 in the one-eye viewing mode SM (second display mode) of the image light generation unit. An image can be displayed at the position of the area AW. As described with reference to FIG. 8, if the position designation information 122 can be set to the user's preference, the usability of the head mounted display HM (head mounted display device) can be improved.

B. Second embodiment:
In the second embodiment of the present invention, a binocular head mounted display will be described. Below, only the part which has a different structure and operation | movement from 1st Embodiment is demonstrated. In the figure, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment described above, and detailed description thereof is omitted.

B-1. Configuration of head mounted display device:
FIG. 11 is a block diagram functionally showing the configuration of the head-mounted display device in the second embodiment. The difference from the head mounted display HM shown in the first embodiment is that the control unit 10a includes an analysis unit 142a instead of the analysis unit 142, and the control unit 10a includes a determination unit 144a instead of the determination unit 144. The control unit 10 a includes a transmission unit (Tx) 52, and the image display unit 20 a includes a left display drive unit 24, a left optical image display unit 28, and a left camera 62.

  Details of the transmission unit 52 are the same as those of the transmission unit 51 described in FIG. The details of the left display drive unit 24 are the same as those of the right display drive unit 22 described with reference to FIG. 3, and the details of the left optical image display unit 28 are the same as those of the right optical image display unit 26 described with reference to FIG. In the head mounted display HMa of the second embodiment, the right optical image display unit 26 and the left optical image display unit 28 are physically partitioned, and only the right optical image display unit 26 is provided to the right eye of the user. Have a visible structure. Similarly, only the left optical image display unit 28 is visible to the user's left eye. Further, the image processing unit 160 independently generates right-eye image data Data1 to be supplied to the right display drive unit 22 and left-eye image data Data2 to be supplied to the left display drive unit 24. Send. As a result, different virtual images VI are displayed on the left and right eyes of the user on the head mounted display HMa.

  The left camera 62 is disposed on the inner surface of the left optical image display unit 28, in other words, the surface facing the left eye of the user wearing the head mounted display HMa. The left camera 62 includes an infrared illumination and a CCD camera, and acquires an eyeball image of the user's left eye. The analysis unit 142a receives the eyeball image of the left eye of the user acquired by the left camera 62 in addition to the eyeball image of the user's right eye acquired by the right camera 61, and analyzes the binocular image. Detecting user's eye movement. In the present embodiment, the analysis unit 142a, the right camera 61, and the left camera 62 correspond to a “detection unit” in the claims.

B-2. Display mode of image light generator:
The display modes that the image light generation unit of the head mounted display HMa of the second embodiment can take are the same as those of the first embodiment shown in FIG.

B-2-1. Display mode description:
FIG. 12 is an explanatory diagram for explaining a display mode in the second embodiment. FIG. 12A shows the state of the right LCD 241 and the left LCD 242 when the image light generation unit is set to the one-eye viewing mode SM. In the example of FIG. 7A, the right LCD 241 displays a concierge image using a dog character in the image display area AW and black display in the other area BW. Similarly, on the left LCD 242, a calendar and a clock image are displayed in the image display area AW, and black display is performed in the other area BW. As described above, in the one-eye view mode SM in the present embodiment, the image light generation unit (right LCD 241) corresponding to the user's right eye, and the image light generation unit (left LCD 242) corresponding to the user's left eye. Thus, different images can be displayed.

  12B and 12C show the state of the right LCD 241 and the left LCD 242 when the image light generation unit is set to the full-view mode AM. In the full-view mode AM, an image based on the content or the like is displayed on all the image light emitting areas in the image light generation unit. In the full-view mode AM, the user activates the image light generation unit (right LCD 241) corresponding to the right eye or activates the image light generation unit (left LCD 242) corresponding to the left eye. Can be selected. When the image light generation unit corresponding to the left eye is in an active state, all of the image light emitting areas of the right LCD 241 and the left LCD 242 are displayed on the left LCD 242 in the one-eye viewing mode SM. An image is displayed (FIG. 12B). Similarly, when the image light generation unit corresponding to the right eye is in an active state, all of the image light emitting areas of the right LCD 241 and the left LCD 242 are displayed on the right LCD 241 in the one-eye viewing mode SM. The image that has been displayed is displayed (FIG. 12C).

B-2-2. Full-field mode transition condition:
The all-field mode transition condition in the second embodiment is substantially the same as that in the first embodiment described in “A-2-2. All-field mode transition condition:”. However, the analysis unit 142a and the determination unit 144a of the second embodiment also take into account the movement of the user's left eye (gaze movement and eyelid opening / closing).

B-2-3. Single-eye viewing mode transition condition:
The single-eye visual field mode transition conditions in the second embodiment are substantially the same as those in the first embodiment described in “A-2-3. Single-eye visual field mode transition conditions”. However, the analysis unit 142a and the determination unit 144a of the second embodiment also take into account the movement of the user's left eye (gaze movement and eyelid opening / closing).

  As described above, also in the head mounted display HMa (head-mounted display device) of the second embodiment, the same effect as that of the first embodiment can be obtained.

C. Variations:
In the above embodiment, a part of the configuration realized by hardware may be replaced by software, and conversely, a part of the configuration realized by software may be replaced by hardware. Good. In addition, the following modifications are possible.

・ Modification 1:
In the said embodiment, it illustrated about the structure of the head mounted display. However, the configuration of the head-mounted display can be arbitrarily determined without departing from the gist of the present invention. For example, each component can be added, deleted, converted, and the like.

  In the above embodiment, for convenience of explanation, the control unit includes a transmission unit, and the image display unit includes a reception unit. However, each of the transmission unit and the reception unit of the above-described embodiment has a function capable of bidirectional communication, and can function as a transmission / reception unit.

  For example, the connection unit may be omitted, and the control unit and the image display unit may be configured to perform wireless communication. Specifically, the control unit further includes a first wireless communication unit, and the image display unit further includes a second wireless communication unit and a power source. In this case, the first wireless communication unit functions as a transmission unit in the embodiment, and the second wireless communication unit functions as a reception unit in the embodiment.

  For example, the configurations of the control unit and the image display unit illustrated in FIG. 2 can be arbitrarily changed. Specifically, for example, the touch pad may be omitted from the control unit, and the operation may be performed using only the cross key. Further, the control unit may be provided with another operation interface such as an operation stick. Moreover, it is good also as what receives an input from a keyboard or a mouse | mouth as a structure which can connect devices, such as a keyboard and a mouse | mouth, to a control part. In addition, a communication unit using Wi-Fi (wireless fidelity) or the like may be provided in the control unit.

  For example, the control unit illustrated in FIG. 2 is connected to the image display unit via a wired signal transmission path. However, the control unit and the image display unit may be connected by a connection via a wireless signal transmission path such as a wireless LAN, infrared communication, or Bluetooth (registered trademark).

  For example, the head mounted display may be configured as a non-transmissive head mounted display in which transmission of an outside scene is blocked when the user wears the head mounted display.

  FIG. 13 is an explanatory diagram showing an external configuration of a head mounted display in a modified example. In the example of FIG. 13A, the difference from the head mounted display HM shown in FIG. 1 is that the image display unit 20b includes a right optical image display unit 26b instead of the right optical image display unit 26. The right optical image display unit 26b is disposed obliquely above the right eye of the user when the head mounted display is mounted. In the example of FIG. 13B, the difference from the head mounted display HM shown in FIG. 1 is that the image display unit 20c includes a right optical image display unit 26c instead of the right optical image display unit 26. The right optical image display unit 26c is disposed obliquely below the right eye of the user when the head mounted display is mounted. Thus, the optical image display unit can be realized as a head-mounted display in which only a part of the user's eyes is covered, in other words, the optical image display unit does not completely cover the user's eyes.

  For example, functional units such as an image processing unit, a display control unit, an analysis unit, a determination unit, and a voice processing unit are realized by a CPU developing and executing a computer program stored in a ROM or a hard disk on the RAM. It was described as a thing. However, these functional units may be configured using an ASIC (Application Specific Integrated Circuit) designed to realize the function.

  For example, in the above-described embodiment, it is assumed that the image display unit is a head mounted display that is mounted like glasses, but the image display unit is a normal flat display device (liquid crystal display device, plasma display device, organic EL display device, etc. ). Also in this case, the connection between the control unit and the image display unit may be a connection via a wired signal transmission path or a connection via a wireless signal transmission path. If it does in this way, a control part can also be utilized as a remote control of a usual flat type display device.

  Further, as the image display unit, instead of the image display unit worn like glasses, an image display unit of another shape such as an image display unit worn like a hat may be adopted. Further, the earphone may be an ear-hook type or a headband type, or may be omitted. Further, for example, it may be configured as a head mounted display mounted on a vehicle such as an automobile or an airplane. Further, for example, it may be configured as a head-mounted display built in a body protective device such as a helmet.

  For example, in the above-described embodiment, the secondary battery is used as the power source. However, the power source is not limited to the secondary battery, and various batteries can be used. For example, a primary battery, a fuel cell, a solar cell, a thermal cell, or the like may be used.

  For example, in the above embodiment, the image light generation unit is configured using a backlight, a backlight control unit, an LCD, and an LCD control unit. However, the above aspect is merely an example. The image light generation unit may include a configuration unit for realizing another method together with or in place of these configuration units.

  For example, the image light generation unit may include an organic EL (Organic Electro-Luminescence) display and an organic EL control unit. Further, for example, the image generation unit may use LCOS (Liquid crystal on silicon, LCoS is a registered trademark), a digital micromirror device, or the like instead of the LCD. Further, for example, the present invention can be applied to a laser retinal projection type head mounted display. In the case of the laser retinal projection type, the “image light emitting area in the image light generation unit” can be defined as an image area recognized by the user's eyes.

Modification 2
In the said embodiment, an example of the all visual field mode transition condition and the one eye visual field mode transition condition was shown. However, the transition conditions shown in the above embodiment are merely examples, and various conditions can be employed.

  For example, in the binocular head-mounted display of the second embodiment, when the configuration allows the user to visually recognize a 3D virtual image, the head-mounted display is a mode for displaying a 3D virtual image. The transition condition may be a monocular visual field mode transition condition in which the head mounted display is in a mode for displaying a 2D virtual image.

  For example, in the head mounted display of the first embodiment or the second embodiment, a camera capable of photographing the front of the user with the head mounted display mounted thereon is mounted, and the user's hand movement or Shoot gestures. The full-field mode transition condition is satisfied when the first pattern hand movement or gesture is performed, and the one-eye visual mode transition condition is satisfied when the second pattern hand movement or gesture is performed. It is good. In this way, the user can switch between the first display mode and the second display mode using hand movements and gestures instead of eye movements. Can be improved.

  For example, the virtual image reproduction time may be measured, and the one-eye visual field mode transition condition may be that the virtual image reproduction time exceeds a predetermined time. In this case, it is also possible to set the full-field mode transition condition that a predetermined time has elapsed in the one-eye field mode. In this way, it is possible to suppress accumulation of eye strain of the user due to continuous use of the head mounted display for a long time.

・ Modification 3:
In the above embodiment, (1) a method for inserting black dummy dot data and (2) a method for operating an Enable signal have been described as methods for displaying an image on the image display area AW. However, these methods are merely examples, and various modifications are possible.

  For example, at least one of the right light guide plate and the left light guide plate is configured to be held in such a manner that it can move in the horizontal direction in front of the user's eyes when the head mounted display is mounted. In the single-eye viewing mode, the right light guide plate and the left light guide plate may be moved toward the left and right ears of the user with the head-mounted display attached, respectively. Even in such a configuration, the same effects as those of the above-described embodiments (1) and (2) are obtained by adjusting the movement amount of the right light guide plate and the left light guide plate based on the position designation information stored in the storage unit. Can be obtained.

-Modification 4:
The present invention is not limited to the above-described embodiments, examples, and modifications, and can be realized with various configurations without departing from the spirit thereof. For example, the technical features in the embodiments, examples, and modifications corresponding to the technical features in each embodiment described in the summary section of the invention are to solve some or all of the above-described problems, or In order to achieve part or all of the above-described effects, replacement or combination can be performed as appropriate. Further, if the technical feature is not described as essential in the present specification, it can be deleted as appropriate.

10. Control unit (controller)
DESCRIPTION OF SYMBOLS 12 ... Illuminating part 14 ... Touch pad 16 ... Cross key 18 ... Power switch 20 ... Image display part 21 ... Ear hook part 22 ... Right display drive part 24 ... Left display drive part 26 ... Right optical image display part 28 ... Left optical image Display unit 32 ... Right earphone 34 ... Left earphone 40 ... Connection unit 42 ... Right cord 44 ... Left cord 46 ... Connecting member 48 ... Body code 51 ... Transmitting unit 52 ... Transmitting unit 53 ... Receiving unit 54 ... Receiving unit 61 ... Right camera (Detection unit, imaging unit)
62 ... Left camera (detection unit, imaging unit)
71 ... Center holding part 72 ... Nose pad 74 ... Nose pad 80 ... Infrared sensor (detection part, eyelid detection part)
DESCRIPTION OF SYMBOLS 81 ... Infrared light emission part 82 ... Right infrared light emission part 84 ... Left infrared light emission part 86 ... Infrared light receiving part 110 ... Input information acquisition part 120 ... Memory | storage part 122 ... Position designation information (position designation information)
130 ... Power supply 140 ... CPU
142 ... analysis unit (detection unit, analysis unit)
144: Determination unit (determination unit)
160: Image processing unit (main control unit)
170: Audio processing unit 180 ... Interface 190 ... Display control unit 201 ... Right backlight control unit (image light generation unit)
202 ... Left backlight control unit (image light generation unit)
211 ... Right LCD controller (image light generator)
212 ... Left LCD controller (image light generator)
221 ... Right backlight (image light generator)
222: Left backlight (image light generator)
241 ... Right LCD (image light generator)
242 ... Left LCD (image light generator)
251 ... Right projection optical system (light guide unit)
252 ... Left projection optical system (light guide)
261 ... Right light guide plate (light guide part)
262 ... Left light guide plate (light guide part)
PCLK ... clock signal VSync ... vertical synchronization signal HSync ... horizontal synchronization signal Data ... image data Data1 ... right eye image data Data2 ... left eye image data OA ... external device SC ... outside view VI ... virtual image IL ... illumination light PL ... light VR ... View EL, ER ... End SB ... Slide bar PB ... Pointer RE ... Right eye LE ... Left eye AE ... Iris SM ... Single eye view mode AM ... Full view mode AW ... Image display area BW ... Other than image display area Area AX ... Center position HM ... Head-mounted display device (head mounted display)
PC ... Personal computer

Claims (12)

A head-mounted display device that allows a user to visually recognize a virtual image and an outside scene,
An image light generation unit that generates and emits image light representing an image;
A detection unit for detecting movement of the user's eyes in a state in which the head-mounted display device is mounted;
A control unit for displaying an image on the image light generation unit;
With
The controller is
A first display mode for displaying the image in the image light emitting area in the image light generating unit according to the detected eye movement, and the image light emitting area in the image light generating unit. A determination unit configured to determine a second display mode in which the image is displayed in a region occupied by the left eye visual field or the right eye visual field of the user while the head-mounted display device is mounted. Head mounted display device. The head-mounted display device according to claim 1 ,
The detector is
An imaging unit that captures the eyeball image of the user in a state in which the head-mounted display device is mounted;
By analyzing the captured eyeball image, a gaze movement amount that is a movement amount of the iris with respect to a center position of the user's eyeball, and a gaze movement direction that is a movement direction of the iris with respect to the center position of the user's eyeball And an analysis unit for obtaining
With
The determination unit
When the acquired line-of-sight movement direction is the first direction and the acquired amount of line-of-sight movement exceeds a predetermined threshold, the image light generation unit is set to the first display mode. Head mounted display device. The head-mounted display device according to claim 2 ,
The determination unit
When the acquired line-of-sight movement direction is the second direction and the acquired line-of-sight movement amount exceeds a predetermined threshold, the image light generation unit is set to the second display mode. Head mounted display device. The head-mounted display device according to any one of claims 1 to 3 ,
The detection unit includes an eyelid detection unit that detects the state of the user's eyelid in a state in which the head-mounted display device is mounted,
The determination unit
When it is detected that at least one of the right eyelid and the left eyelid of the user is kept closed for a predetermined time, the image light generation unit is set to the first display mode. Head mounted display device. The head-mounted display device according to claim 4 ,
The determination unit
A head-mounted display device that sets the image light generation unit to the second display mode when it is detected that both the right eyelid and the left eyelid of the user are open. . The head-mounted display device according to any one of claims 1 to 5 , further comprising:
A main control unit that transmits image data generated from the image to the image light generation unit and controls generation and emission of the image light by the image light generation unit;
The main control unit
In the second display mode, by inserting dummy data into the image data, an area occupied by the left eye field or the right eye field in the image light emitting area in the image light generation unit A head-mounted display device that displays the image on the head. The head-mounted display device according to any one of claims 1 to 5 , further comprising:
A main control unit that transmits image data generated from the image to the image light generation unit and controls generation and emission of the image light by the image light generation unit;
The main control unit
In the second display mode, the left eye in the image light emitting area in the image light generation unit is operated by operating a signal for switching the validity / invalidity of the image light generation by the image light generation unit. A head-mounted display device that displays the image in a field of view or an area occupied by the right eye field of view. The head-mounted display device according to claim 6 or 7 ,
The main control unit
Obtaining position designation information for designating a position where the image is displayed in the second display mode;
In the second display mode, instead of the area occupied by the left eye field or the right eye field in the image light emitting area in the image light generator, the position designated by the position designation information is used. A head-mounted display device that displays the image. The head-mounted display device according to any one of claims 6 to 8 ,
The image light generation unit is provided so as to correspond to either the right eye or the left eye of the user,
The main control unit
In the second display mode, a head-mounted display in which the image is displayed at an end of the image light generation unit on the side where the image light generation unit is provided in the image light emission possible region. apparatus. The head-mounted display device according to any one of claims 6 to 8 ,
The image light generation unit is provided to correspond to the right eye and the left eye of the user,
The main control unit
In the second display mode, the image light generation unit corresponding to the user's right eye displays the image at a right end portion of the image light emitting area, and the user's left eye A head-mounted display device that causes the image light generation unit corresponding to to display the image on the left end portion of the image light emitting area. The head-mounted display device according to any one of claims 1 to 5 , further comprising:
A main control unit that transmits image data generated from the image to the image light generation unit and controls generation and emission of the image light by the image light generation unit;
The image light emitted from the image light generation unit is held in a manner movable in the horizontal direction in the vicinity of the user's eye in a state in which the head-mounted display device is worn, and the image light emitted from the image light generation unit is A light guide plate that leads to the eyes,
With
The main control unit
In the second display mode, instead of displaying the image in the area occupied by the left eye field or the right eye field in the image light emitting area in the image light generation unit, A head-mounted display device that moves the light guide plate toward an ear side of the user in a state in which the wearable display device is mounted. A head-mounted display device that allows a user to visually recognize a virtual image and an outside scene,
An image light generation unit that generates and emits image light representing an image;
A control unit for displaying an image on the image light generation unit;
With
The controller is
As a display mode of the image, a first display mode for displaying the image in the image light emitting area in the image light generating unit, and an image light emitting area in the image light generating unit, A second display mode in which the image is displayed in a region occupied by the left-eye visual field or the right-eye visual field of the user in a state where the head-mounted display device is mounted, and the first and second displays Head-mounted display device that transitions to each mode.

Images