JP5909849B2 - Head-mounted display device and method for controlling head-mounted display device - Google Patents

Description

  The present invention relates to a head-mounted display device that forms a virtual image in a visual field region of an observer by being mounted on the observer's head.

  2. Description of the Related Art In recent years, a head-mounted display device that forms a virtual image in an observer's visual field region by being used on the viewer's head has been known. This head-mounted display device is also referred to as a head mounted display (HMD), a transmissive HMD that allows an observer to see the outside scene even when the HMD device is mounted, and an observer who has an HMD device. There is known a non-transparent HMD in which an outside scene is blocked in a state where the camera is mounted. The transmissive HMD forms a virtual image together with the outside scene in the viewer's field of view by reflecting image light generated by a light modulation element such as a liquid crystal panel with an optical system or the like disposed in front of the viewer's eyes.

  The above-described HMD device is used by being worn on a human head, and employs a configuration in which a virtual image is formed in a visual field region of an observer, that is, a position very close to the eyes. For this reason, there has been a problem that the focal position of the virtual image is shifted due to individual differences in the position of the eyes, and the position of the virtual image is shifted with the shift of the focal position. With respect to this point, conventionally, a technique is known in which a virtual image is formed at a focal length that matches the observer's focus by moving the position of a display panel or the like (for example, Patent Document 1).

Japanese Patent Laid-Open No. 10-262165

  However, the conventional configuration requires a separate mechanism for moving the position of the display panel or the like, which causes a problem that the HMD device is complicated.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a technique capable of adjusting a focal position in a head-mounted display device without requiring a separate mechanism.

SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples. A head-mounted display device that is mounted on an observer's head and forms a virtual image in front of the observer's left and right eyes, corresponding to the right eye of the observer generated from a target image used to form a virtual image An image processing unit that adjusts image data for the right eye and image data for the left eye corresponding to the left eye of the observer, a display element for the right eye that generates image light from the image data for the right eye, and the left A left-eye display element that generates image light from image data for the eye, the right-eye display element, a light guide unit that forms a virtual image from the image light generated by the left-eye display element, and the right Adjustment information for displaying the target image in a target image display area that is smaller than the display area with respect to the display areas of the eye display element and the left eye display element, Stores adjustment information assigned to information for identification Comprising a憶部, wherein the adjustment information further adjustment information in the case of forming a virtual image of the two-dimensional in the head-mounted display device, to form a virtual image of three dimensional in the head-mounted display device The image processing unit corresponds to an observer who is using the head-mounted display device from the storage unit , and the one selected by the observer Arrangement position of the target image display area in the right eye area which is the display area in the right eye display element with respect to the right eye image data, using the acquired adjustment information. And adjusting the position of the target image display area in the left eye area, which is the display area of the left eye display element, with respect to the left eye image data. In addition, the present invention can be realized as the following forms or application examples.

[Application Example 1]
A head-mounted display device that is mounted on an observer's head and forms a virtual image in front of the observer's left and right eyes,
An image processing unit that adjusts image data for the right eye corresponding to the right eye of the observer generated from the target image used for forming the virtual image, and image data for the left eye corresponding to the left eye of the observer;
A right-eye display element that generates image light from the right-eye image data;
A left-eye display element that generates image light from the left-eye image data;
A light guide that forms a virtual image from image light generated by the right-eye display element and the left-eye display element;
With
The image processing unit
Obtaining adjustment information for displaying the target image in a target image display area that is smaller than the display area with respect to the display areas of the right-eye display element and the left-eye display element;
Using the adjustment information, the arrangement position of the target image display region in the right eye region which is the display region of the right eye display element is adjusted with respect to the right eye image data, and the left eye image A head-mounted display device that adjusts an arrangement position of the target image display region in a left eye region that is the display region of the left eye display element with respect to image data.
With such a configuration, the image processing unit uses the adjustment information for displaying the target image in the target image display area that is smaller than the display areas of the right-eye display element and the left-eye display element. Adjusting the arrangement position of the target image display area in the display area (right eye area) of the right eye display element for the right eye image data, and displaying the left eye image data on the left eye display element Since the arrangement position of the target image display region in the region (left eye region) is adjusted, the focus position can be adjusted without requiring a separate mechanism in the head-mounted display device.

[Application Example 2]
A head-mounted display device according to Application Example 1,
The image processing unit further includes:
Generating the right-eye image data and the left-eye image data using the target image;
A head-mounted display device that adjusts the arrangement position of the target image display area in the right eye area and the arrangement position of the target image display area in the left eye area in conjunction with each other.
With such a configuration, the image processing unit can generate right-eye image data and left-eye image data. Further, the image processing unit adjusts the arrangement position of the target image display area in the right eye area and the arrangement position of the target image display area in the left eye area in association with each other. In a head-mounted display device that includes an ophthalmic display element, the focal position can be easily adjusted.

[Application Example 3]
A head-mounted display device according to Application Example 2,
The adjustment information includes
By moving the arrangement position of the central part of the target image display area in the right eye area and the arrangement position of the central part of the target image display area in the left eye area in the same direction, Center position information for changing the position of the center of the target image display area;
By moving the vertical arrangement position of the target image display area in the right eye area and the vertical arrangement position of the target image display area in the left eye area in reverse directions, Vertical position information for changing the position of the upper end of the target image display area;
By moving the arrangement position in the left and right direction of the target image display area in the right eye area and the arrangement position in the left and right direction of the target image display area in the left eye area in reverse directions, Left and right interval information for changing the interval of the target image display area,
A head-mounted display device including at least one of the above.
With such a configuration, the adjustment information can include at least one of the center position information, the vertical position information, and the left and right distance information, and thus flexible adjustment is possible.

[Application Example 4]
The head-mounted display device according to any one of Application Examples 1 to 3,
The image processing unit
By inserting dummy data into at least a part of the right-eye image data and the left-eye image data, the arrangement position of the target image display area in the right-eye area, and the left-eye A head-mounted display device that adjusts an arrangement position of the target image display area in the area.
With such a configuration, adjustment of the arrangement position of the target image display area in the display area can be realized by a simple method of changing image data.

[Application Example 5]
The head-mounted display device according to any one of Application Examples 1 to 4, further comprising:
A head-mounted display device comprising an adjustment information input unit for receiving input of the adjustment information from an observer.
With such a configuration, input of adjustment information from an observer can be received.

  The present invention can be realized in various modes. For example, a head-mounted display device and a head-mounted display device control method, a head-mounted display system, these methods, devices, or The present invention can be realized in the form of a computer program for realizing the function of the system, a recording medium on which the computer program is recorded, or the like.

It is explanatory drawing which shows the structure of the external appearance of the head mounted display apparatus in one Example of this invention. It is a block diagram which shows the composition of a head mount display functionally. It is explanatory drawing which shows an image when the virtual image formed with the head mounted display is recognized by the observer. It is explanatory drawing for demonstrating the display area and object image display area in an image position adjustment process. It is explanatory drawing for demonstrating the method of an image position adjustment process. It is explanatory drawing which shows an example of the designation | designated screen for designating the adjustment information used in an image position adjustment process. It is explanatory drawing which shows an example of the preview formed in LCD when center position information is designated. It is explanatory drawing which shows an example of the preview formed on LCD when the up-and-down position information is designated. It is explanatory drawing which shows an example of the preview formed on LCD when the left-right space | interval information is designated. It is a flowchart which shows the flow of the process in which a head mounted display forms a virtual image using adjustment information.

  Next, embodiments of the present invention will be described in the following order based on examples.

A. Example:
(A-1) Configuration of the head-mounted display device:
FIG. 1 is an explanatory diagram showing an external configuration of a head-mounted display device according to an embodiment of the present invention. A head-mounted display device (hereinafter also referred to as a “head-mounted display”) HM is mounted on the head of an observer and forms a virtual image in front of the left and right eyes of the observer. The head mounted display HM includes a controller 10, an image display unit 20, an earphone 30, and a connection unit 40.

  The controller 10 and the image display unit 20 are connected by the connection unit 40, so that various signals are transmitted between them. The connecting portion 40 includes a right cord 42, a left cord 44, a connecting member 46, and a main body cord 48. The connecting member 46 is connected to a right cord 42 extending from an end portion of the right display portion 22, a left cord 44 extending from an end portion of the left display portion 24, and a main body cord 48. The main body cord 48 is formed with a connector for connecting to the controller 10 at the end opposite to the side connected to the connecting member 46. For the right cord 42, the left cord 44, and the main body cord 48, for example, a metal cable or an optical fiber can be adopted.

  The controller 10 is a device for operating the head mounted display HM. The controller 10 includes a lighting unit 12, a touch panel 14, a cross key 16, and a power switch 18. The lighting unit 12 notifies the operation state of the head mounted display HM (for example, ON / OFF of the power supply) according to the light emission state. For example, an LED (Light Emitting Diode) can be used as the lighting unit 12. The touch panel 14 detects the operation of the observer's finger on the operation surface of the touch panel 14 and outputs a signal corresponding to the detected content. The cross key 16 detects a pressing operation on a key corresponding to the up / down / left / right direction, and outputs a signal corresponding to the detected content. The power switch 18 switches the power-on state of the head mounted display HM by detecting a slide operation of the switch.

  The image display unit 20 is a mounting body attached to the observer's head and has a glasses shape. The image display unit 20 includes an ear hook unit 21, a right display unit 22, a left display unit 24, a right optical panel 26, and a left optical panel 28. Hereinafter, the right display unit 22 and the left display unit 24 are collectively referred to simply as “display unit”, and the right optical panel 26 and the left optical panel 28 are also referred to simply as “optical panel”. The ear hook portion 21 is a member provided so as to cross over the ears of the observer from the end portions of the right display portion 22 and the left display portion 24, and functions as a temple.

  The display unit includes an LCD (Liquid Crystal Display), a projection optical system, and the like (not shown). Details will be described later. The optical panel includes a light guide plate (not shown) and a light control plate. The light guide plate is formed of a light-transmitting resin material or the like, and emits image light taken from the display unit toward the observer's eyes. The light control plate is a thin plate-like optical element, and is disposed so as to cover the front side (external side) of the light guide plate. The light control plate protects the light guide plate and suppresses damage to the light guide plate, adhesion of dirt, and the like.

  The earphone 30 is a mounting body that is mounted on the ear of the observer while the image display unit 20 is mounted on the head of the observer. The earphone 30 includes a right earphone 32 for the right ear and a left earphone 34 for the left ear, and each converts an electrical signal into a sound wave.

  FIG. 2 is a block diagram functionally showing the configuration of the head mounted display HM. The controller 10 includes an input information acquisition unit 110, a storage unit 120, a power supply 130, a CPU 140, and an interface 180, and the respective units are connected to each other via a bus (not shown).

  The input information acquisition unit 110 has a function of acquiring an operation input by an observer, for example, an operation input for the touch panel 14, the cross key 16, and the power switch 18 in FIG. The storage unit 120 is a storage unit including a ROM, a RAM, a DRAM, a hard disk, and the like (not shown). The power supply 130 is a secondary battery that supplies power to each part of the head mounted display HM.

  The CPU 140 provides a function as an operating system (OS) 150 by executing a program installed in advance. The CPU 140 also functions as an image processing unit 160 (details will be described later) and a sound processing unit 170 (details will be described later) by developing firmware and computer programs stored in a ROM and a hard disk in a RAM and executing them. To do.

  The interface 180 is an interface for connecting various external devices OA that are content supply sources to the controller 10. As the interface 180, for example, a USB interface, a micro USB interface, a memory card interface, or the like can be provided. The content means information content including an image (still image, moving image), sound, and the like.

  The image processing unit 160 includes a position adjustment unit 161 (details will be described later), and includes image data for right eye that is image data to be supplied to the right display unit 22 and image data to be supplied to the left display unit 24. It has a function of generating certain left-eye image data. Specifically, the image processing unit 160 acquires an image signal included in the content. For example, in the case of a moving image, the acquired image signal is generally an analog signal composed of 30 frame images per second. The image processing unit 160 separates synchronization signals such as the vertical synchronization signal VSync and the horizontal synchronization signal HSync from the acquired image signal. The image processing unit 160 converts the analog image signal from which the synchronization signal is separated into a digital image signal using an A / D conversion circuit or the like (not shown). Thereafter, the image processing unit 160 stores the converted digital image signal as image data (RGB data) of the target image in the DRAM in the storage unit 120 for each frame. Note that the image processing unit 160 performs various tone correction processing such as resolution conversion processing, brightness and saturation adjustment, and keystone correction on the image data of the target image stored in the storage unit 120 as necessary. Image processing such as processing may be executed.

  The audio processing unit 170 acquires an audio signal included in the content, amplifies the acquired audio signal, and outputs the amplified audio signal to the right speaker 311 and the left speaker 312, respectively.

  The image display unit 20 includes a right display unit 22, a left display unit 24, a right light guide plate 261 as the right optical panel 26, and a left light guide plate 262 as the left optical panel 28. The right display unit 22 includes a right LCD control unit 211, a right backlight (BL) 221, a right LCD 241, and a right projection optical system 251. The left display unit 24 includes a left LCD control unit 212, a left backlight (BL) 222, a left LCD 242, and a left projection optical system 252. Note that the right display unit 22 and the left display unit 24 are paired, and each unit of the left display unit 24 has the same configuration and operation as each unit described in the right display unit 22, and detailed description thereof is omitted. .

  The right LCD control unit 211 has a function of driving the right LCD 241 based on the vertical synchronization signal VSync, the horizontal synchronization signal HSync, and the right-eye image data input via the connection unit 40. The right LCD 241 as a right eye display element is a transmissive liquid crystal panel in which a plurality of pixels are arranged in a matrix. The right LCD 241 changes the transmittance of the light transmitted through the right LCD 241 by driving the liquid crystal corresponding to each pixel position arranged in a matrix, so that the illumination light emitted from the right backlight 221 is changed. It has a function of modulating into effective image light representing an image. The right backlight 221 is a light emitter such as an LED. The right projection optical system 251 is configured by a collimator lens that converts the image light emitted from the right LCD 241 to light beams in a parallel state.

  FIG. 3 is an explanatory diagram showing an image when a virtual image formed by the head mounted display HM is recognized by an observer. As described above, the image light emitted through the right LCD 241 is converted into a light beam by the right projection optical system 251 and repeatedly totally reflected by the right light guide plate 261. The light beam is emitted from the light exit surface of the right light guide plate 261 to the outside, and enters the observer's right eye as image light. The same applies to the left LCD 242, the left projection optical system 252, and the left light guide plate 262. The image light respectively incident on the left and right eyes of the observer forms an image on the retina of the observer. Thereby, the observer can recognize as if one virtual image VI was formed in the visual field region. The projection optical system and the light guide plate are also collectively referred to as “light guide unit”. The light guide unit guides the image light generated by the display element (LCD) to the eyes of the observer, in other words, forms a virtual image from the image light generated by the display element.

(A-2) Image position adjustment processing:
FIG. 4 is an explanatory diagram for explaining a display area and a target image display area in the image position adjustment process. The image position adjustment process is a process for adjusting the arrangement position of the target image display area FA in the display area PA, and is executed by the position adjustment unit 161. FIG. 4A shows the display area of the right LCD 241. FIG. 4B shows the display area of the left LCD 242. The display area PA means the maximum area that can be displayed on the display elements (the right LCD 241 and the left LCD 242). The display area PA of the right LCD 241 is also referred to as a “right eye area”. Similarly, the display area PA of the left LCD 242 is also referred to as a “left eye area”. The target image display area FA means an area where an image (still image or moving image) in the content is actually displayed. The target image display area FA is an area smaller than the display area PA. The position adjustment unit 161 further performs image position adjustment processing on the image data of the target image (that is, the image data generated by the image signal included in the content and stored in the storage unit 120), thereby Eye image data and left eye image data are generated and output.

  FIG. 5 is an explanatory diagram for explaining a method of image position adjustment processing. FIG. 5A shows a state in which image data for each line is output. The position adjustment unit 161 outputs RGB data for the first line in synchronization with the rising edge (timing t1) of the horizontal synchronizing signal HSync after the falling edge of the vertical synchronizing signal VSync. Thereafter, the position adjustment unit 161 sequentially outputs RGB data for one line every time the horizontal synchronization signal HSync rises.

  When the target image display area FA is adjusted in the vertical direction PL (FIGS. 4A and 4B) in the display area PA, the position adjustment unit 161 sets the dummy line data for the amount that the target image display area FA is to be shifted. Insert. Specifically, for example, when the target image display area FA is arranged at the lower end of the display area PA as in the right eye area of FIG. 4A, the position adjustment unit 161 outputs a predetermined number of dummy line data. Thereafter, the image data of the target image is output. On the other hand, for example, when the target image display area FA is arranged at the upper end of the display area PA, the position adjustment unit 161 outputs a predetermined number of dummy line data after outputting the image data of the target image. Note that the number of dummy line data to be inserted and the position at which the dummy line data is to be inserted are determined according to the value given by the adjustment information. The adjustment information is information serving as a parameter for adjusting the arrangement position of the target image display area FA in the display area PA. Details will be described later.

  In the example of FIG. 5A, dummy line data for two lines is output after timing t1, and line data of image data of the target image is output after timing t2. For this reason, a virtual image in which the target image display area FA is shifted downward by two lines with respect to the display area PA is formed. As described above, the position adjusting unit 161 moves the target image display area FA in the vertical direction PL in the display area PA by including the dummy line data in a part of the line data to be output.

  FIG. 5B shows a state in which image data for each dot (pixel) is output. In other words, FIG. 5B is a diagram in which one line data shown in FIG. 5A is represented in dot units. The position adjustment unit 161 sequentially outputs RGB data from the first dot in synchronization with the rising edge (timing t1) of the Enable signal after the falling edge of the horizontal synchronization signal HSync.

  When the target image display area FA is adjusted in the horizontal direction HL (FIGS. 4A and 4B) in the display area PA, the position adjustment unit 161 sets dummy dot data for the amount of the target image display area FA to be shifted. Insert. Specifically, for example, when the target image display area FA is arranged at the right end of the display area PA as in the right eye area of FIG. 4A, the position adjustment unit 161 outputs a predetermined number of dummy dot data. Thereafter, the image data of the target image is output. On the other hand, for example, when the target image display area FA is arranged at the left end of the display area PA, the position adjustment unit 161 outputs a predetermined number of dummy dot data after outputting the image data of the target image. Note that the number of dummy dot data to be inserted and the position at which the dummy dot data is to be inserted are determined according to the value given by the adjustment information. The contents of the dummy dot data can be arbitrarily determined, for example, black dot data.

  In the example of FIG. 5B, dummy dot data for one dot is output after timing t1, and dot data of the image data of the target image is output thereafter. Therefore, a virtual image is formed in which the target image display area FA is shifted by one dot in the right direction with respect to the display area PA. Thus, the position adjustment unit 161 moves the target image display area FA in the horizontal direction HL in the display area PA by including dummy dot data in a part of the dot data to be output. Note that the position adjustment unit 161 may adjust the position of the target image display area FA in the horizontal direction HL by shifting the position of the Enable signal instead of including dummy dot data in part of the output dot data. Good.

  In this way, the image processing unit 160 can realize the adjustment of the arrangement position of the target image display area FA in the display area PA by a simple method of changing the image data.

(A-3) Specification of adjustment information:
FIG. 6 is an explanatory diagram showing an example of a designation screen for designating adjustment information used in the image position adjustment process. The designation screen EW serving as the adjustment information input unit is a screen that the position adjustment unit 161 displays on the right display unit 22 and the left display unit 24 as a virtual image VI (FIG. 3). The designation screen EW includes a center position designation part CA, a vertical position designation part LA, a left and right interval designation part TA, a preview button PB, an OK button BO, and a cancel button BN.

  The center position designating part CA is a field for designating the arrangement position of the center part of the target image display area FA. The center position designating part CA includes a cross key BT1 and center position information VL1. The cross key BT1 is an input unit for inputting parameters for moving the position of the central portion of the target image display area FA in the vertical and horizontal directions (FIG. 4: vertical direction PL, horizontal direction HL). The center position information VL1 is an area in which a numerical value indicating the amount of movement of the center position of the target image display area FA designated by the cross key BT1 with respect to the default position is displayed.

  The vertical position designation portion LA is a field for designating an arrangement position in the vertical direction of the target image display area FA. The vertical position designation portion LA includes a set of movement buttons BT2 and vertical position information VL2. The move button BT2 is an input unit for inputting parameters for moving the position of the target image display area FA in the up-down direction (FIG. 4: vertical direction PL). The vertical position information VL2 is an area in which a numerical value indicating the amount of movement of the vertical position of the target image display area FA designated by the movement button BT2 with respect to the default position is displayed.

  The left-right interval designating part TA is a field for designating the arrangement position in the left-right direction of the target image display area FA. The left / right distance designation section TA includes a set of movement buttons BT3 and left / right distance information VL3. The movement button BT3 is an input unit that inputs parameters for moving the arrangement position of the target image display area FA in the left-right direction (FIG. 4: horizontal direction HL). The left-right interval information VL3 is an area in which a numerical value indicating the amount of movement of the left-right position of the target image display area FA designated by the movement button BT3 with respect to the default position is displayed.

  The observer uses the designation screen EW to input a desired center position, vertical position, and left / right spacing, and then presses the preview button PB. By pressing the preview button PB, the position adjustment unit 161 acquires the values of the center position information VL1, the vertical position information VL2, and the left and right interval information VL3 specified on the specification screen EW. The center position information VL1, the vertical position information VL2, and the left and right distance information VL3 are collectively referred to as “adjustment information”. The position adjustment unit 161 uses the acquired adjustment information and the adjustment image prepared in advance to perform the processing described in (A-2) image position adjustment processing, and the right eye image data and the left eye image data. Image data is generated and output.

  FIG. 7 is an explanatory diagram showing an example of a preview formed on the LCD when the center position information VL1 is designated. The right side of FIG. 7 shows the target image display area FA of the display area PA (right eye area) of the right LCD 241 corresponding to the right eye of the observer. The left side of FIG. 7 shows a target image display area FA of the display area PA (left eye area) of the left LCD 242 corresponding to the left eye of the observer. An adjustment image CD is displayed in each of the right eye area and the target image display area FA of the left eye area. Although any image can be used as the adjustment image CD, it is preferable to use an image provided with guides in the vicinity of the end and in the center as shown in the figure. When the center position information VL1 is designated on the designation screen EW, the adjustment image CD in the right eye region and the adjustment image CD in the left eye region have designated the arrangement position of the center portion of the adjustment image CD. In accordance with the value of the center position information VL1, each is displayed in a state of moving in conjunction with the same direction (arrows (1) to (4)).

  Thus, by specifying the center position information VL1, the observer can specify the arrangement position of the center of the target image display area FA in the display area PA. The position of the center of the target image in the image light incident on the left and right eyes of the observer can be matched.

  FIG. 8 is an explanatory diagram showing an example of a preview formed on the LCD when the vertical position information VL2 is designated. 8, the target image display area FA of the display area PA (right eye area) of the right LCD 241 is shown on the right side, and the target image display area FA of the display area PA (left eye area) of the left LCD 242 is shown on the left side. ing. When the vertical position information VL2 is designated on the designation screen EW, the vertical arrangement positions of the adjustment image CD are designated for the adjustment image CD in the right eye region and the adjustment image CD in the left eye region. Depending on the value of the vertical position information VL2, it is displayed in a state of moving in the reverse direction (arrows (1) and (2)).

  Thus, by specifying the vertical position information VL2, the observer can specify the arrangement position in the vertical direction of the target image display area FA in the display area PA. The arrangement position in the vertical direction of the target image in the incident image light can be adjusted.

  FIG. 9 is an explanatory diagram showing an example of a preview formed on the LCD when the left / right distance information VL3 is designated. 9, the target image display area FA of the display area PA (right eye area) of the right LCD 241 is shown on the right side, and the target image display area FA of the display area PA (left eye area) of the left LCD 242 is shown on the left side. ing. When the left / right distance information VL3 is designated on the designation screen EW, the adjustment image CD in the right eye region and the adjustment image CD in the left eye region have designated the arrangement positions in the left and right directions of the adjustment image CD. Depending on the value of the left-right distance information VL3, the information is displayed in a state of moving in the reverse direction (arrows (1) and (2)).

  Thus, by specifying the left-right distance information VL3, the observer can specify the arrangement position in the left-right direction of the target image display area FA in the display area PA. It is possible to adjust the interval between the target images in the image light incident on the left and right eyes of the observer at intervals suitable for (eye width).

  After confirming the preview, the observer presses the OK button BO on the designation screen EW shown in FIG. By pressing the OK button BO, the position adjustment unit 161 acquires the adjustment information (center position information VL1, vertical position information VL2, left and right interval information VL3) designated on the designation screen EW and stores it in the storage unit 120. The adjustment information stored in the storage unit 120 is used thereafter in the image position adjustment process.

  FIG. 10 is a flowchart showing a flow of processing in which the head mounted display HM forms a virtual image using the adjustment information. First, the image processing unit 160 generates image data (right-eye image data, left-eye image data) (step S102). Next, the position adjustment unit 161 acquires adjustment information stored in the storage unit 120 (step S104). Using the acquired adjustment information, the position adjustment unit 161 performs image position adjustment processing (FIG. 5) (step S106). Thereafter, the right LCD 241 and the left LCD 242 generate image light (step S108), and the right projection optical system 251 and the left projection optical system 252 form a virtual image (step S110). Details of steps S102, S108, and S110 are as described in FIG. As a result, a virtual image VI based on the adjustment information designated on the designation screen EW is formed in front of the observer's eyes (FIG. 3).

  As described above, according to the embodiment, the image processing unit 160 (position adjustment unit 161) performs the processing for the right-eye image data and the left-eye image data generated using the target image used for forming the virtual image. Adjustment information (center position information VL1) for displaying the target image in the target image display area FA that is smaller than the display area PA of the right-eye display element (right LCD 241) and the left-eye display element (left LCD 242). , Using the vertical position information VL2 and the horizontal interval information VL3), the arrangement position of the image in the display area PA (right eye area) of the right LCD 241 and the arrangement position of the image in the display area PA (left eye area) of the left LCD 242 Adjust in conjunction with. The display unit (the right display unit 22 and the left display unit 24) forms a virtual image using these image data. For this reason, in the head-mounted display device (head mounted display), the focal position can be adjusted without requiring a separate mechanism.

  Further, the adjustment information includes center position information VL1 for designating the arrangement position of the central portion of the target image display area FA, and vertical position information VL2 for designating the arrangement position in the vertical direction of the target image display area FA. And left and right interval information VL3 for designating the arrangement position in the left and right direction of the target image display area FA is included. For this reason, the observer designates the adjustment information on the designation screen EW, so that, for example, image light incident on the left and right eyes of the observer in accordance with individual differences in the positions of the eyes of the observer such as the eye width. The position of the target image occupying can be adjusted. As a result, the image quality in the head mounted display can be improved and the observer's fatigue can be reduced. Furthermore, when variations occur during manufacturing with respect to the left and right projection optical systems (the right projection optical system 251 and the left projection optical system 252), the target image occupying the image light cannot be displayed at a uniform position in the initial state. Accompanying virtual image blur may occur. Even in such a case, according to the configuration of the above-described embodiment, it is possible to easily eliminate the problems caused by the manufacturing variations.

B. Variations:
In addition, this invention is not restricted to said Example and embodiment, A various structure can be taken in the range which does not deviate from the summary. For example, a function realized by software may be realized by hardware. In addition, the following modifications are possible.

B1. Modification 1:
In the said Example, it illustrated about the structure of the head mounted display. However, the configuration of the head-mounted display can be arbitrarily determined without departing from the gist of the present invention. For example, each component can be added, deleted, converted, and the like.

  For example, the configurations of the controller, the image display unit, the earphone, and the connection unit illustrated in FIG. 1 can be arbitrarily changed. Specifically, for example, the touch panel may be omitted from the controller, and the operation may be performed using only the cross key. Further, the controller may be provided with another operation interface such as an operation stick. Moreover, it is good also as what receives an input from a keyboard or a mouse | mouth as a structure which can connect devices, such as a keyboard and a mouse | mouth, to a controller. Moreover, you may provide the communication part using Wi-Fi (wireless fidelity) etc. in a controller. Further, the earphone may be an ear-hook type or a headband type, or may be omitted.

  For example, although the head-mounted display is a binocular transmissive HMD, the head-mounted display may be configured as a non-transmissive HMD in which an outside scene is blocked when an observer wears the HMD device. Moreover, it is good also as a monocular type HMD.

  For example, the display unit is configured by using an LCD, an LCD control unit, and a backlight. Instead, an organic EL (Organic Electro-Luminescence) and an organic EL control unit are used. May be. In this case, the organic EL corresponds to the “display element” in the claims.

  For example, functional units such as an image processing unit and an audio processing unit are described as being realized by a CPU developing and executing a computer program stored in a ROM or a hard disk on a RAM. However, these functional units may be configured using an ASIC (Application Specific Integrated Circuit) designed to realize the function.

B2. Modification 2:
In the above embodiment, an example of the image position adjustment process is shown. However, the processing procedure shown in the above embodiment is merely an example, and various changes can be made.

  For example, the adjustment information used in the image position adjustment process is input by the observer using a designation screen. However, the position adjustment unit may acquire the adjustment information by another method. For example, the position adjustment unit may acquire adjustment information from an external device (for example, a PC or the like) connected via an interface. Furthermore, for example, after providing a sensor for detecting the distance (eye width) between the left and right eyes of the observer and the distance (eye relief) between the exit pupil and the final surface of the eyepiece, Adjustment information may be automatically generated according to the detection result of the sensor.

  For example, the designation screen includes a center position designation section for designating adjustment information, a vertical position designation section, and a left and right interval designation section. However, it is sufficient that at least one of these is included, and some of them can be omitted.

  For example, on the designation screen, the position adjustment unit displays a preview screen adjusted using adjustment information (center position information, vertical position information, left and right interval information) on the display unit when the preview button is pressed. However, the preview button on the designation screen can be omitted. Specifically, for example, the position adjustment unit displays the preview screen and the designated screen in an overlapping manner, and displays the preview screen adjusted in real time based on the value of the adjustment information changed on the designated screen. Also good.

  For example, the arrangement position of the target image display area in the right eye area and the arrangement position of the target image display area in the left eye area are not necessarily adjusted in conjunction with each other, and may be individually adjustable. Further, a configuration in which a mode for individually adjusting the arrangement positions of the left and right target image display areas and a mode for adjusting the arrangement positions of the left and right target image display areas in conjunction with each other may be selected.

  For example, the adjustment information designated on the designation screen may be stored in the storage unit after being assigned to information (for example, a user name) for identifying the observer. In that case, in the formation of the virtual image (FIG. 10), the image position adjustment process can be executed individually for each observer. Therefore, even when one head-mounted display is shared by a plurality of persons, It is possible to adjust the focal position suitable for each.

  For example, the designation screen for designating the adjustment information is a screen that is displayed as a virtual image VI on both the right display unit 22 and the left display unit 24. However, the designation screen may be displayed on either the right display unit 22 or the left display unit 24. Even when the designated screen is displayed on one of the right display unit 22 and the left display unit 24, preview formation (FIGS. 7 to 9) and adjustment information designated on the designation screen are displayed. The formation of the used virtual image (FIG. 10) is preferably performed on both eyes of the head mounted display. Furthermore, the designation screen may be displayed on the display unit after providing the controller with a display unit (liquid crystal display or the like).

B3. Modification 3:
In the above-described embodiment, the image processing unit generates right-eye image data and left-eye image data from the same image, and individually adjusts these. However, the image processing unit, for example, generates different right-eye image data and left-eye image data from different images, or different right-eye image data and left-eye that have been processed for 3D display from the same image. Image data may be generated and adjusted individually. For the right-eye image data and the left-eye image data generated so as to be capable of 3D display, parallax adjustment for changing the stereoscopic degree of 3D display can be performed using the above-described image position adjustment processing. Further, in this case, the head mounted display is provided with a 2D mode and a 3D mode, and adjustment information in the 2D mode and adjustment information in the 3D mode are individually held in the storage unit to form a virtual image (FIG. 10). ) Can be selected and executed.

DESCRIPTION OF SYMBOLS 10 ... Controller 12 ... Lighting part 14 ... Touch panel 16 ... Cross key 18 ... Power switch 20 ... Image display part 21 ... Ear hook part 22 ... Right display part 24 ... Left display part 26 ... Right optical panel 28 ... Left optical panel 30 ... Earphone 32 ... Right earphone 34 ... Left earphone 40 ... Connector 42 ... Right cord 44 ... Left cord 46 ... Connecting member 48 ... Body code 110 ... Input information acquisition unit 120 ... Storage unit 130 ... Power source 140 ... CPU
DESCRIPTION OF SYMBOLS 160 ... Image processing part 161 ... Position adjustment part 170 ... Audio | voice processing part 180 ... Interface 211 ... Right LCD control part 212 ... Left LCD control part 221 ... Right backlight 222 ... Left backlight 241 ... Right LCD (display element for right eyes) )
242 ... Left LCD (display element for left eye)
251 ... Right projection optical system 252 ... Left projection optical system 261 ... Right light guide plate 262 ... Left light guide plate 311 ... Right speaker 312 ... Left speaker EW ... Designated screen OA ... External device PA ... Display region (right eye region, left eye region) )
FA ... Target image display area TA ... Left / left interval designation part CA ... Center position designation part LA ... Up / down position designation part PB ... Preview button CD ... Adjustment image VI ... Virtual image HM ... Head mounted display BN ... Cancel button VL1 ... Center position information VL2 ... Up / down position information VL3 ... Left / right distance information BT1 ... Cross key BT2 ... Move button BT3 ... Move button

Claims (6)

A head-mounted display device that is mounted on an observer's head and forms a virtual image in front of the observer's left and right eyes,
An image processing unit that adjusts image data for the right eye corresponding to the right eye of the observer generated from the target image used for forming the virtual image, and image data for the left eye corresponding to the left eye of the observer;
A right-eye display element that generates image light from the right-eye image data;
A left-eye display element that generates image light from the left-eye image data;
A light guide that forms a virtual image from image light generated by the right-eye display element and the left-eye display element;
Adjustment information for displaying the target image in a target image display area that is smaller than the display area with respect to the display areas of the display element for the right eye and the display element for the left eye. A storage unit for storing adjustment information assigned to information for identifying a person,
With
The adjustment information further includes adjustment information when a two-dimensional virtual image is formed on the head-mounted display device, and adjustment information when a three-dimensional virtual image is formed on the head-mounted display device. Including
The image processing unit
From the storage unit, corresponding to an observer using the head-mounted display device , and obtaining one of the adjustment information selected by the observer ,
Using the acquired adjustment information, the arrangement position of the target image display region in the right eye region which is the display region of the right eye display element is adjusted with respect to the right eye image data, and the left eye A head-mounted display device that adjusts an arrangement position of the target image display region in a left eye region that is the display region of the left eye display element for eye image data. The head-mounted display device according to claim 1,
The image processing unit further includes:
Generating the right-eye image data and the left-eye image data using the target image;
A head-mounted display device that adjusts the arrangement position of the target image display area in the right eye area and the arrangement position of the target image display area in the left eye area in conjunction with each other. The head-mounted display device according to claim 2,
The adjustment information includes
By moving the arrangement position of the central part of the target image display area in the right eye area and the arrangement position of the central part of the target image display area in the left eye area in the same direction, Center position information for changing the position of the center of the target image display area;
By moving the vertical arrangement position of the target image display area in the right eye area and the vertical arrangement position of the target image display area in the left eye area in reverse directions, Vertical position information for changing the position of the upper end of the target image display area;
By moving the arrangement position in the left and right direction of the target image display area in the right eye area and the arrangement position in the left and right direction of the target image display area in the left eye area in reverse directions, Left and right interval information for changing the interval of the target image display area,
A head-mounted display device including at least one of the above. A head-mounted display device according to any one of claims 1 to 3,
The image processing unit
By inserting dummy data into at least a part of the right-eye image data and the left-eye image data, the arrangement position of the target image display area in the right-eye area, and the left-eye A head-mounted display device that adjusts an arrangement position of the target image display area in the area. The head-mounted display device according to any one of claims 1 to 4, further comprising:
A head-mounted display device comprising an adjustment information input unit for receiving input of the adjustment information from an observer. A method for controlling a head-mounted display device that is mounted on an observer's head and forms a virtual image in front of the observer's left and right eyes,
(A) adjusting the right-eye image data corresponding to the right eye of the observer generated from the target image used for forming the virtual image and the left-eye image data corresponding to the left eye of the observer;
(B) generating image light from the right-eye image data;
(C) generating image light from the left-eye image data;
(D) forming a virtual image from the image light generated by the step (b) and the step (c);
With
The step (a)
Adjustment information for displaying the target image in a target image display area that is smaller than the display area with respect to the display area of the display element used in the step (b) and the step (c). Adjustment information for forming a two-dimensional virtual image in the head-mounted display device, and adjustment information for forming a three-dimensional virtual image in the head-mounted display device. One of the adjustment information corresponding to the observer using the head-mounted display device and selected by the observer is acquired from the adjustment information assigned to the information for identification. ,
Using the acquired adjustment information, the arrangement position of the target image display area in the right eye area which is the display area in the display element used in the step (b) is adjusted with respect to the image data for the right eye. And a head-mounted display that adjusts an arrangement position of the target image display region in the left eye region that is the display region of the display element used in the step (c) with respect to the image data for the left eye. Control method of the device.

Images