JP2016038484A - Virtual image display device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a virtual image display device and method that allow a user to easily switch a display position of a video.SOLUTION: A virtual image display device 100 includes an image conversion device 10, a virtual image forming member 20, and a second conversion part 40. The second conversion part 40 adjusts the attitude of a first conversion part 12 constituting the image conversion device 10 to switch an area to display a virtual image between a plurality of display areas. This configuration can expand an area or an angle of view where a virtual image can be displayed, and suppress an increase in size or an increase in cost of the first conversion part 12.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a virtual image display device and a virtual image display method such as a head-mounted display used by being mounted on a head.

2. Description of the Related Art As a head-mounted display type virtual image display device, a device that is worn like glasses and presents image light and external light in an overlapping manner is known (see Patent Document 1).
Here, in the virtual image display device as described above, if the image displayed in front of the eyes can be moved to the corner or the image displayed in the corner can be moved to the front, the usability of the virtual image display device is improved. In this type of virtual image display device, in order to ensure a large amount of image movement, it is conceivable to widen the displayable region and locally change the display region. However, it is not easy to widen the display area, and there is a tendency for the virtual image display device to increase in size and cost as a price for widening the display area.

JP2012-41230A

  It is an object of the present invention to provide a virtual image display apparatus and method that can easily switch a video display area.

  In order to achieve the above object, a first virtual image display device according to the present invention includes a first conversion unit that emits video light, a virtual image forming member that forms a virtual image when irradiated with video light, and a first conversion unit. And a second converter that changes the display area of the image light.

  In the virtual image display device, since the second conversion unit changes the display area of the image light by the first conversion unit, an area or image that can display a virtual image while suppressing an increase in size or cost of the first conversion unit. The corner can be widened. Note that the display area can include, for example, a position set as a changed position or a peripheral position obtained by shifting the front of the eye (that is, the center position) to the left or the right.

  In a specific aspect of the present invention, in the virtual image display device, the second conversion unit includes at least a part of the first conversion unit so that display is performed in any of a plurality of preset display areas. On the other hand, an operation corresponding to display switching is performed.

  In another aspect of the present invention, the plurality of display areas include a main display area and a sub display area, and the second conversion unit changes display from one of the main display area and the sub display area to the other. In this case, it is possible to perform operations such as displaying in the sub display area under a certain condition based on display in the main display area.

  In still another aspect of the present invention, the resolution of the sub display area is lower than the resolution of the main display area. In this case, a high quality image can be formed in the main display area, and a simple image can be formed in the sub display area.

  In still another aspect of the present invention, the first converter widens the gap between the pixels when operating in the high transmission mode. In this way, by widening the gap between the pixels, observation of external light becomes easy. In addition, when thinning out pixels in the high transmission mode, the resolution can also be lowered.

  In still another aspect of the present invention, the second conversion unit relatively reduces the area of the display area when operating in the energy saving mode. In this case, the effectiveness of the energy saving operation can be enhanced.

  In still another aspect of the present invention, the second conversion unit switches a region for displaying a virtual image by changing the posture of the first conversion unit. In this case, the second conversion unit can have a simple structure.

  In another aspect of the present invention, the virtual image forming member covers at least a portion in front of the wearer's eyes when worn. In this case, a virtual image can be displayed at least in the front direction of the eye.

  In yet another aspect of the present invention, the first conversion unit is disposed closer to the wearer's temple than the virtual image forming member when worn. In this case, it is relatively easy to secure a space for arranging the first conversion unit and the second conversion unit.

  In still another aspect of the invention, the first conversion unit includes a scanning optical system that scans to form image light by reflecting the modulated signal light. In this case, the virtual image can be displayed as the return light from the virtual image forming member by causing the signal light from the scanning optical system to enter the predetermined region on the virtual image forming member while scanning.

  In still another aspect of the invention, the first conversion unit includes an image forming element that emits image light from a two-dimensional image area. In this case, a virtual image can be displayed by projecting the image formed on the first conversion unit as a virtual image via a virtual image forming member or the like.

  In still another aspect of the present invention, the image forming element is a light modulation element that two-dimensionally modulates illumination light.

  In still another aspect of the present invention, the image forming element is a light emitting element that forms a two-dimensional light emission pattern.

  In still another aspect of the invention, the first conversion unit includes a lens that projects the image light from the image forming element as a virtual image in cooperation with the virtual image forming member.

  In still another aspect of the present invention, the virtual image forming member transmits external light and superimposes image light and external light on the wearer. In this case, the see-through type virtual image forming member allows the first conversion unit to observe the virtual image while confirming the external image.

  In still another aspect of the present invention, a detection unit for detecting instruction information from the wearer regarding the operation of the second conversion unit is further provided. In this case, the second converter can be operated based on the instruction information from the wearer, and the display can be switched between a plurality of display areas.

  In still another aspect of the present invention, the detection unit detects instruction information from the wearer based on at least one of the wearer's gesture, voice, and line of sight. In this case, the input of instruction information is simplified.

  In still another aspect of the present invention, the virtual image is displayed in the display area corresponding to the instruction information from the wearer by operating the second conversion unit based on the detection result of the detection unit.

  In order to achieve the above object, a second virtual image display device according to the present invention has a virtual image forming member that receives a video light from the first conversion unit to form a virtual image, and is different in type from the first conversion unit. A virtual image display device that changes a region where a virtual image is displayed by two different stages of control.

  In the virtual image display device, since the region where the virtual image is displayed is changed by the two-stage control of different types for the first conversion unit, the other type of control is performed so as to extend the control range of one type. Thus, the display direction or display area of the virtual image can be easily switched.

  In a specific aspect of the invention, the first conversion unit includes a main actuator that forms a virtual image, and includes a sub-actuator that changes the formation direction of the virtual image by changing the posture of the first conversion unit.

  In order to achieve the above object, a first virtual image display method according to the present invention is a virtual image display method for forming a virtual image by receiving video light from a first conversion unit by a virtual image forming member, and the second conversion unit Thus, the display area of the image light by the first conversion unit is changed.

  In the virtual image display method, since the display area of the image light by the first conversion unit is changed by the second conversion unit, an area or image that can display a virtual image while suppressing an increase in size or cost of the first conversion unit. The corner can be widened.

  In order to achieve the above object, a second virtual image display method according to the present invention is a virtual image display method for forming a virtual image by receiving video light from a first conversion unit by a virtual image forming member, the first conversion unit On the other hand, a region for displaying a virtual image is changed by two-stage control of different types.

  In a specific aspect of the present invention, in the virtual image display method described above, instruction information from the wearer is detected based on at least one of the wearer's gesture, voice, and line of sight, and a display area corresponding to the detected instruction information To display a virtual image.

It is a figure which shows the external appearance of the virtual image display apparatus which concerns on 1st Embodiment. (A) is a figure explaining the principal part structure of a virtual image display apparatus, Comprising: It is a figure explaining the projection to a basic position (1st display area), (B) is a change position (2nd display). It is a figure explaining projection to an area. (A) is a figure explaining the back surface of a virtual image formation member, and is a figure explaining the display of the image | video to a basic position or a change position. (B) is a figure explaining the back surface etc. of the virtual image formation member in a modification. It is a block diagram explaining the circuit-like structure of a virtual image display apparatus. It is a perspective view explaining the scanning optical system in the 1st conversion part. (A) And (B) is a side sectional view and a plan view explaining a scanning optical system and its peripheral mechanism. It is a block diagram explaining the structural example of a main control part. It is a flowchart explaining the operation example of the virtual image display apparatus which concerns on embodiment. (A)-(C) are the figures explaining the method for recognizing the instruction information from a wearer. (A) And (B) is a figure explaining the example of switching of a display. It is a figure which shows the virtual image display apparatus which concerns on 2nd Embodiment. It is a figure which shows the modification of the virtual image display apparatus of FIG. It is a figure which shows the virtual image display apparatus which concerns on 3rd Embodiment. It is a figure which shows the virtual image display apparatus which concerns on 4th Embodiment. It is a figure explaining operation | movement of the virtual image display apparatus of a modification.

[First Embodiment]
Hereinafter, a virtual image display device and a virtual image display method according to a first embodiment of the present invention will be described in detail with reference to the drawings.

  A virtual image display device 100 of the present embodiment shown in FIG. 1 is a head-mounted display having an appearance like glasses, and image light based on a virtual image is given to a wearer who is to be an observer wearing the virtual image display device 100. It is possible to recognize the image and allow the wearer to observe the outside world image with see-through.

  In FIG. 1, the virtual image display device 100 is shown in a state where half is omitted. The illustrated first display device 100 </ b> A is a portion that forms a virtual image for the left eye (a virtual image provided to the right eye EY as viewed from a third party) of the virtual image display device 100. The virtual image display device 100 is a pair of a first display device 100A for the left eye and a second display device for the right eye, but the second display device has the same structure as the first display device 100A. The illustration is omitted because it has only left and right reversed. Note that the first display device 100A alone functions as a virtual image display device.

  Hereinafter, an example of the structure of the virtual image display device 100 will be described by describing an example of the structure of the first display device 100A with reference to FIG. In the virtual image display device 100 at the time of wearing, the front direction with respect to the eye EY of the wearer is the direction of the optical axis OA, and the forward direction parallel to the optical axis OA from the wearer side is the + Z direction. The vertical direction is defined as ± X direction, and the horizontal direction is defined as ± Y direction.

  The first display device 100A forms the signal light GL, reflects the signal light GL and emits it as scanning light SL, and image light as reflected light of the scanning light SL received from the image conversion device 10. The virtual image forming member 20 that forms the PL and the second conversion unit that changes the display area of the video light PL by switching the arrangement of at least a part of the first conversion unit 12 provided in the image conversion apparatus 10. 40 and a video display processing unit 91 that operates the image conversion device 10 and the second conversion unit 40. The image conversion device 10 and the second conversion unit 40 are disposed on the wearer's temple KK side or the ear side, and the virtual image forming member 20 is closer to the nose NS (+ Y side) of the image conversion device 10 and the image conversion device 10. The front side of the wearer's eye EY (that is, in front of the eye) is disposed so as to entirely cover the front side (+ Z side) of the wearer. The second conversion unit 40 is a switching drive unit, and can be called a subactuator in the sense that the angle of the first conversion unit 12 that is an image conversion unit is changed at a desired timing, and greatly increases the emission direction of the scanning light SL. Have a changing role. The second conversion unit (switch drive unit) 40 is a part that adjusts a state (specifically, an inclined state) different from the function necessary for forming the image light in the first conversion unit (image conversion unit) 12. More specifically, it is a portion that switches the region or position where the virtual image is displayed by adjusting the posture of the first conversion unit 12. In other words, the control of the second conversion unit 40 and the control of the first conversion unit 12 are functionally different types. That is, the first conversion unit 12 and the second conversion unit 40 display a virtual image by two-stage control of different types. The operation of the second conversion unit 40, that is, the sub-actuator is relatively slower than the first conversion unit 12 that is the main actuator. Here, it can be considered that the first conversion unit 12 controls the scanning-type first stage, and the switch-type second stage control that turns the second conversion unit 40 on and off.

  Of the first display device 100A, the image conversion device 10 includes a signal light forming unit 11 having a light source (not shown), a first conversion unit 12 that is a scanning optical system or an imager, and a scanning that is an element driving unit having a drive circuit. The system drive device 13 etc. are provided. The signal light forming unit 11 emits signal light GL that is intensity-modulated laser light, and the signal light GL becomes scanning light SL that is two-dimensionally scanned by reflection from the first conversion unit 12. . The scanning system driving device (element driving unit) 13 operates the first conversion unit 12. In other words, the scanning system driving device 13 electromagnetically changes the attitude of the mirror 12a provided in the first conversion unit (scanning optical system) 12 so that the emission angle of the scanning light SL is within a predetermined solid angle range. Change at high speed.

The virtual image forming member 20 is a curved plate-like member, and includes a reflective layer 20a that receives irradiation of the scanning light SL, and a support member 20b that supports the reflective layer 20a. The reflection layer 20a is, for example, a hologram sheet, that is, a thin-film optical element having a three-dimensional refractive index distribution that makes it possible to convert incident light into a desired wavefront. The reflective layer 20a forms video light PL that gathers on the wearer's eyes EY from the scanning light SL reflected by the first conversion unit 12. The reflective layer 20a not only directs the scanning light SL incident on the virtual image forming member 20 in the direction of the eye EY like a symmetric concave mirror, but also adjusts the reflectance so that it looks like a half mirror. Reflects the image light PL while dimming it and transmits the external light OL. Since the support member 20b is relatively thin and has a substantially constant thickness, the non-coherent external light OL has almost no effect other than dimming by the reflective layer 20a. It has no diopter. As a result, not only a virtual image but also light from the outside enters the wearer's eye EY, and the virtual image display device 100 can superimpose both the image by the image conversion device 10 and the outside image. It has a see-through configuration.
The reflective layer 20a can be replaced with a simple half mirror by adjusting the shape of the support member 20b or optimizing the arrangement relationship of the support member 20b with respect to the image conversion device 10.

  As shown in FIG. 1, the virtual image forming member 20 is fixed and supported by an upper frame 50 a of the frame 50 and the like. The virtual image forming member 20 is elongated in the lateral direction and has a size that is disposed in front of the eye EY of the wearer and covers the eye EY as a whole. That is, the virtual image forming member 20 is disposed so as to substantially cover the visual field of the eye EY, and the contour shape of the virtual image forming member 20 or the shape of the support member 20b has a shape that follows the appearance of the virtual image display device 100. ing. The reflection layer 20a is locally formed at the center of the support member 20b. As shown in FIG. 2A, the reflection layer 20a receives the standard scanning light SL irradiated from the first conversion unit 12 of the image conversion apparatus 10 in an intermediate direction between the + Y direction and the + Z direction. Is reflected to the eye EY in the −Z direction as image light PL, and a virtual image is formed, and the wearer recognizes this virtual image.

FIG. 3A shows the appearance of the virtual image forming member 20 on the back surface 20d side, but the back surface 20d of the virtual image forming member 20 represents the field of view of the wearer's eyes EY for convenience. In the center of the virtual image forming member 20, there is a region where the reflective layer 20a is formed. When the first converter 12 is in a standard posture (see FIG. 2A) that is not inclined, the basic position in the front direction or central direction of the eye EY within the field of view corresponding to the region of the reflective layer 20a. A main image G1 is displayed as a video in the main display area A1 corresponding to (front display or center display). The main display area A1 is a basic display area (main setting area). On the other hand, as shown in FIG. 2 (B), when the first converter 12 is in a tilted special posture, within the visual field corresponding to the region of the reflective layer 20a, the vicinity of the periphery deviating from the front of the eye EY Specifically, the sub-image G2 is displayed (peripheral display) as a video in the sub-display area A2 corresponding to the change position of the temple KK. This sub display area A2 is an additional display area (sub setting area). Here, the additional sub display area A2 partially overlaps with the basic main display area A1. In both the display areas A1 and A2, video can be displayed, and information such as characters and symbols other than video can be displayed.
It should be noted that when displaying in the main display area (main setting area) A1 and when displaying in the sub display area (sub setting area) A2, there is a slight difference in the scanning operation of the first conversion unit 12 for both displays. It is possible to prevent relative distortion from occurring in the images displayed in the areas A1 and A2.
Also, a difference can be provided between the resolution when displaying in the main display area (main setting area) A1 and the resolution when displaying in the sub display area (sub setting area) A2. For example, when the virtual image forming member 20 is configured on the premise that the sub display area A2 is not a target of gaze, the resolution of the sub display area A2 can be made lower than the resolution of the main display area A1. In this case, a high-quality image can be formed in the main display area A1, and a simple image can be formed in the sub-display area A2.
Further, whether the main display area A1 or the sub display area A2 is arranged at the reference position or the center position in the front direction of the eye EY is not fixed, and the sub display area A2 is arranged in front of the eye EY. It is also possible to arrange the main display area A1 and the sub display area A2 in front of the eye EY so that they almost overlap each other. At this time, a wide main display area A1 is used for still image display, and high-resolution display is performed by increasing the optical scanning density, and a narrow sub-display area A2 is used for moving image display to reduce the optical scanning density. It is also possible to display speed priority.

FIG. 3B is a diagram illustrating a modification of the display example of the virtual image illustrated in FIG. In this modification, the sub display area A2 is formed in a region that does not overlap with the main display area A1. The arrangement relationship between the main display area A1 and the sub display area A2 is not limited to the above example, and can be variously changed. For example, the sub display area A2 can be set near the nose or between the eyebrows of the main display area A1, and the sub display area A2 can be set at a position shifted vertically or obliquely from the main display area A1. Further, it is not necessary to make the sub display area A2 equal to or narrower than the main display area A1, and the sub display area A2 can be made wider than the main display area A1. The main display area A1 and the sub display area A2 are not limited to rectangles, and may have various contour shapes.
In the first display device 100A for the left eye, when the sub display area A2 is set or arranged on the ear side or the temple side of the main display area A1, in the second display device for the right eye, which is not shown, in principle The sub display area A2 is set or arranged on the nose side or the eyebrow side of the main display area A1. However, in the second display device, it is possible to perform display only in the main display area A1 without setting the sub display area A2.

  In the main display area A1 and the sub display area A2 shown in FIG. 3B, the display size can be switched according to the operation mode. For example, a still image display mode and a moving image display mode can be set in the virtual image display device 100. In the still image display mode, a relatively static image such as a computer screen is displayed. May display a dynamic image. In such a case, in the still image display mode, the display areas A1 and A2 are set to be wide as a standard, and the optical scanning density is increased to display at a high resolution. On the other hand, in the moving image display mode, the display areas A1 and A2 are set to be relatively narrow, and the optical scanning density is lowered to perform display that changes at high speed without interruption.

  In addition, in the virtual image display device 100, a normal operation mode and an energy saving operation mode can be set. In the energy saving operation mode, power consumption during the display operation of the virtual image display device 100 may be suppressed. In such a case, in the normal operation mode, the display areas A1 and A2 are set to be wide as a standard, and the optical scanning density is increased to display a high resolution. On the other hand, in the energy saving operation mode, the display areas A1 and A2 are set to be relatively narrow, and the optical scanning density is lowered to display a low resolution. In the operation in the energy saving mode, the display can be changed to the one in which the energy consumption is relatively reduced among the plurality of display areas A1 and A2.

  The image conversion apparatus 10 and its control system will be described in more detail with reference to FIG. The image conversion apparatus 10 includes a signal light forming unit 11 for forming the signal light GL and a light source driving circuit 14. In the illustrated example, the signal light forming unit 11 and the first conversion unit 12 are arranged in a separated state, and the optical fiber FB and the relay lens ML are connected therebetween. The signal light forming unit 11 forms combined light that is signal light GL to be the video light PL (see FIG. 1 and the like). Therefore, the signal light forming unit 11 includes color light sources 11r, 11g, and 11b that generate red (R light), green (G light), and blue (B light) color lights, and color light sources 11r, 11g, and 11b. And a synthesizing optical system 11a including a dichroic mirror and the like for synthesizing each color light. The relay lens ML adjusts the light beam state of the signal light GL.

  The video display processing unit 91 includes a sensor, an integrated circuit, and the like, and operates the image conversion device 10 via the scanning system driving device 13 and the light source driving circuit 14 based on a command signal from the main control unit 95. The signal light GL and the scanning light SL are formed. The video display processing unit 91 also has a role of operating the second conversion unit 40 based on a command signal from the main control unit 95.

  As shown in FIG. 5, the first conversion unit 12 is a scanning optical system called a MEMS optical scanner. In addition to the mirror 12a, the first conversion unit 12 includes an outer frame 12b, an inner frame 12c, a support frame 12d, and a drive unit 12h. Is provided. The mirror 12a is swingably supported by the inner frame 12c via a torsion bar 12f functioning as a spring, and the inner frame 12c is supported by the outer frame 12b swingably via a torsion bar 12g functioning as a spring. The outer frame 12b is supported at four corners by the support frame 12d, and the support frame 12d is tiltably supported on a base 42e associated with a frame body 42a (see FIG. 6A) of the tilt switching mechanism 42 described later. ing. The drive unit 12h is supported on the bottom of the support frame 12d, operates in response to a signal from the scanning system drive device 13 shown in FIG. 4, and applies a tilting force to the mirror 12a via a coil (not shown). . Thereby, the mirror 12a directed in the z direction can be periodically tilted in the x direction and the y direction, and the trajectory of the normal line of the mirror 12a crossing the xy section can be made two-dimensional, for example, a raster.

  As shown in FIGS. 4, 6 (A) and 6 (B), the second conversion unit 40 holds the first conversion unit (scanning optical system) 12 so as to be accommodated. The second conversion unit 40 includes a tilt switching mechanism 42 and a tilt switching drive unit 43. The tilt switching mechanism 42 includes a frame body 42a and an urging portion 42b. On the bottom surface 42f of the frame body 42a, a base portion 42e for supporting the first conversion portion 12 in a swingable manner is fixed. That is, the main body portion 12p including the support frame 12d, the outer frame 12b, and the like of the first conversion portion 12 supported by the frame body 42a is supported by the fulcrum 42q of the base portion 42e, and the x direction and the y direction are within the frame body 42a. It is possible to incline. Four leaf spring-like elastic members 12m extend between the frame body 42a and the first converter 12. Each elastic member 12m is fixed to the lower part of the support frame 12d on one end side, and is fixed to the inner periphery of the frame body 42a on the other end side. For this reason, the main body 12p of the first conversion unit 12 is maintained in the state shown in the figure (that is, the state of the reference position) when no external force acts on this, and when the external force acts on this, in FIG. The state is inclined to the right side or the left side (that is, the state of the inclined position). The urging unit 42b includes a magnet 42i and a coil 42j. Here, the magnet 42i is being fixed to the inner peripheral part of the frame 42a via the support member 42k. The magnet 42i is arranged with a predetermined polarity. On the other hand, the coil 42j is fixed in a state of being wound around the support frame 12d of the first conversion unit 12. When an appropriate current is passed through the coil 42j, the main body 12p of the first converter 12 is inclined from the upright state at the reference position to the ± x side by the action of the magnet 42i. The line is inclined from the state parallel to the z direction toward + x or −x.

  As shown in FIG. 4, the first display device 100 </ b> A includes a camera 67 and a main control unit 95 in addition to the image conversion device 10 and the second conversion unit 40. The camera 67 is a combination of a microlens and a solid-state image sensor. The camera 67 is fixed so as to be embedded at a position facing the eyebrows of the frame 50 and acquires an image in the front direction of the virtual image forming member 20. The field of view of the camera 67 is slightly narrower than that of the wearer wearing the virtual image display device 100. The main control unit 95 performs arithmetic processing when performing image processing on the image acquired from the camera 67 and acquiring necessary image information. Here, the camera 67 functions as a detection unit for detecting image instruction information from the wearer of the virtual image display device 100. In a specific example, the wearer's gesture (for example, hand movement) is used as the instruction information from the wearer.

  FIG. 7 is a block diagram illustrating the main control unit 95. The main control unit 95 includes an operation input unit 62, a storage unit 63, an interface 64, and a control processing circuit 61. The operation input unit 62 includes a key, a touch panel, a switch, and the like, and is used for inputting a wearer's operation and instructions. The storage unit 63 includes a ROM, a RAM, a hard disk, and other storage devices. The interface 64 is used to connect various external devices serving as content providers to the control processing circuit 61. Examples of the external device include a personal computer, a portable terminal, and a game terminal. The control processing circuit 61 reads and executes a computer program stored in a storage device that constitutes the storage unit 63, thereby enabling operation of an operating system, application software, and the like.

  In addition to the camera 67, a 9-axis sensor 68, a microphone 69, and the like are provided along with the main control unit 95. The 9-axis sensor 68 is a motion sensor that detects 3-axis acceleration, 3-axis angular velocity, and 3-axis geomagnetism. The 9-axis sensor 68 is fixed to the frame 50 like the camera 67, and outputs a detection signal indicating the movement of the wearer's head when the wearer wears the virtual image display device 100. Thereby, various operations including the speed, acceleration, rotation and the like of the wearer's head can be detected. The 9-axis sensor 68 can function as a detection unit for detecting instruction information attached to a line of sight or the like from the wearer of the virtual image display device 100. The microphone 69 detects sound generated by the wearer. The microphone 69 can function as a detection unit for detecting voice instruction information from the wearer of the virtual image display device 100.

  The main controller 95 is also used as the second display device 100B shown in FIG. That is, the second display device 100B for the right eye includes a video display processing unit 92 and a main control unit 95 in addition to the main body portion 90 including the image conversion device 10, the virtual image forming member 20, and the like.

  Hereinafter, an operation example of the virtual image display device 100 will be described with reference to FIG. First, the control processing circuit 61 operates the camera 67 to perform photographing, captures imaging data as an image, and stores it in the storage unit 63 (step S11). At this time, the control processing circuit 61 can perform correction on the imaging data so as to cancel movements such as twisting and tilting of the wearer's head by image processing based on the detection output of the 9-axis sensor 68.

  Next, the control processing circuit 61 calculates difference data from the imaging data acquired in step S11 (step S12). Here, the difference data is gradation information related to adjacent pixels. For example, by obtaining the absolute value of the difference between the target pixel of a specific color and the adjacent pixel of the same color in the specific direction (including the surroundings) and sequentially changing the target pixel, A gradation difference with respect to the same color is obtained as a two-dimensional distribution. The difference data need not be determined for each color. For example, the difference data can be determined based only on lightness information obtained by averaging the colors. Further, the difference data is not limited to the brightness difference, but may include HSV and other parameters related to hue.

  Next, in the difference data calculated in step S12, the control processing circuit 61 groups a series of pixel data in which the difference is equal to or smaller than a predetermined threshold to capture the contour, and stores the captured contour in the storage unit 63 (step S13). That is, pixel grouping is performed by using adjacent pixels with small difference values as one region. When this grouped pixel has a certain number (that is, area), the outer periphery (outer periphery and inner side) is captured as a contour. In this case, not only a single group but also a plurality of groups may be obtained, and a plurality of contours may be captured.

FIG. 9A shows an example of an image captured by the camera 67. The imaging region CR of the camera 67 is set to be substantially in the center narrower than the visual field VR including the movement of the wearer's eye EY. When the wearer wants to input instruction information to the virtual image display device 100, the wearer inserts his / her hand Yh into the imaging region CR of the visual field VR. Thereby, an image in which the hand Yh as the foreground is superimposed on the background SC, that is, imaging data can be captured. When an image as shown in FIG. 9A is taken, not only the hand Yh but also the mountains and trees of the background SC are captured.
Note that the capturing of the contour described above is merely an example, and various contour cutting methods such as known edge extraction processing can be used as well as gradation information. In addition, small outlines can be combined with adjacent large outlines.

  Next, the control processing circuit 61 determines whether or not the contour captured in step S13 has sufficiently moved or deformed compared to the previous time (step S14). If no contour has been captured in the previous process, the process returns to step S11 and the process up to step S13 is repeated without proceeding to step S14. Whether or not the contour has moved can be determined, for example, by calculating the barycentric coordinates and following the changes. That is, when the change in the barycentric coordinates exceeds a predetermined threshold, it can be determined that the captured contour has moved significantly. Whether or not the contour shape has been deformed or changed can be determined by taking a difference from the contour captured last time. In this case, the contour movement component is also included. The change in the contour shape can be numerically analyzed by parameterizing a plurality of characteristic components constituting the contour and tracking the variation of the characteristic parameters related to these characteristic components.

  When it is determined that the grasped contour has moved or deformed in step S14 (Y in step S14), the control processing circuit 61 reads the stored hand contour from the reference contour storage unit 63a of the storage unit 63 as a contrast shape ( Step S15). On the other hand, if it is determined that there is no movement or shape deformation of the grasped contour (N in step S14), the process is temporarily terminated. When there is no movement or shape deformation of the grasped outline, there is a high possibility that the background SC shown in FIG. If there is no such movement or shape deformation, it is considered that the case where the wearer's hand Yh is not moving is included, but if the hand Yh is not moving, it means that there is no instruction from the wearer, Since the movement of the hand Yh entering and exiting the imaging region CR is always detected, no problem occurs.

  FIG. 9B illustrates a hand contour that is stored as a contrast shape in the reference contour storage unit 63 a of the storage unit 63. The reference contour storage unit 63a stores data corresponding to the contour A01 of the hand Yh with the thumb opened and the index finger extended, data corresponding to the contour A02 of the hand Yh with only the index finger extended and the other fingers bent, the index finger and the middle finger Is stored as two-dimensional pattern data corresponding to the contour A03 of the hand Yh obtained by extending the other finger and bending another finger.

  Next, the control processing circuit 61 compares one or more contours captured in step S13 with the stored hand contours read in step S15, and determines a match / mismatch (step S16). At this time, the similarity or approximation of the line segment or curve constituting the contour is determined while adjusting the relative size between the contour captured by image processing such as enlargement / reduction and the stored hand contour. When judging the coincidence / non-coincidence of contours, it is also possible to numerically analyze by parameterizing a plurality of feature components constituting the contours and tracking variations of these feature component parameters. When a plurality of contours are captured, the above process is repeated a plurality of times.

  If it is determined in step S17 that the grasped contour matches the stored hand contour (Y in step S16), the control processing circuit 61 determines that the corresponding grasped contour is the one that has read the wearer's hand Yh. (Step S17). Specifically, the recognition flag 63b in the storage unit 63 indicating that the hand recognition is completed is set to 1. If the recognition flag is 1, it means that the specific contour captured in step S13 is determined to be the hand Yh. If the recognition flag is 0, the specific contour captured in step S13 is the hand Yh. It means that it was judged not. If the recognition flag is 0, that is, if the grasped contour does not match the stored hand contour (N in step S16), the process is temporarily terminated.

Next, the control processing circuit 61 checks the trajectory of the specific grasped contour (contour of the moving hand Yh) determined to be identical in step S17 (step S18). The locus of the specific grasped contour can be determined by quantifying the movement of the center of gravity of the contour or the movement of a characteristic part such as the tip of the index finger. Specifically, when the process from step S11 to S17 is repeated in the previous process or the process before that, and a specific grasped contour (the contour of the moving hand Yh) is obtained, the pixel of the contour of the hand Yh Since the above movement amount is known, the movement amount is stored in the movement data unit 63d for the target contour of the storage unit 63, and the change in the movement amount is also accumulated in the movement data unit 63d as time-change data. As a result, a trajectory that increases with time can be recorded for a specific grasped contour (the contour of the moving hand Yh).
During the trajectory check, a mark that moves along with the corresponding portion of the image can be displayed in an overlapping manner corresponding to a characteristic portion such as the tip of the index finger. In other words, display technology related to augmented reality is applied.

  FIG. 9C illustrates the trajectory acquired in step S18. In the example shown in the figure, it quickly enters the imaging region CR at the initial portion T1 of the trajectory TR, moves slowly so as to fluctuate at the second stage T2, moves linearly at high speed in the horizontal direction at the third stage T3, It moves slowly so as to fluctuate in 4 stages T4.

Next, the control processing circuit 61 determines whether or not the trajectory checked in step S18 satisfies a predetermined condition indicating an instruction input (step S19). Specifically, it is determined whether or not there is a portion corresponding to the third stage T3 in the trajectory TR shown in FIG. That is, when the trajectory TR has a third stage T3 that moves at high speed from the right to the left of the imaging region CR, it is determined that the instruction is to request that the wearer move the video to the left (hereinafter, “left movement instruction”). Then, the instruction flag 63c in the storage unit 63 indicating that the instruction to move left is accepted is set to +1. Although not shown, when the trajectory TR has a stage of moving at high speed from the left to the right of the imaging region CR, an instruction for requesting the wearer to move the image to the right (hereinafter referred to as “right movement”). The instruction flag 63c in the storage unit 63 indicating that the right movement instruction has been accepted is set to -1.
The movement instruction is not limited to the above-described method, and various instructions can be used. For example, when the vector size and direction of the section with the largest movement satisfy the predetermined conditions, it is determined that the predetermined condition indicating the instruction input is satisfied, and whether the movement direction is left or right depending on the direction of the vector of the section with the largest movement. Judgment can be made. Further, when a plurality of movements are combined, it may be determined that the predetermined condition is satisfied. Specifically, when there is a greater horizontal movement continuously (for example, within 1 second) after a predetermined vertical movement, it is determined that there is an instruction for the horizontal movement. is there.

  Next, when the control processing circuit 61 determines in step S19 that there has been an instruction input that satisfies the predetermined condition, the control processing circuit 61 instructs the video display processing section 91 to switch the display position, and operates the second conversion section 40 appropriately to change the display position. The orientation of one conversion unit (scanning optical system) 12 is adjusted, and the display position is switched to change the direction of emission of the scanning light SL toward the virtual image forming member 20 in the direction desired by the wearer (step S20). That is, the second conversion unit 40 displays the first conversion unit 12 so that the display is performed in any of the plurality of preset display areas A1 and A2 under the control of the control processing circuit 61. The operation corresponding to the change or display switching is performed. Specifically, for example, in FIGS. 3 (A) and 3 (B), when the display is performed in the main display area A1, the control processing circuit 61 confirms the instruction to move left as the fingertip instruction recognition unit 61a. In this case, the control processing circuit 61 moves the image of the main display area A1 to the sub display area A2 by appropriately operating the second conversion unit 40, or erases the display of the main display area A1 and moves to the sub display area A2. It is possible to display other images such as settings and other menu screens. On the other hand, for example, in FIGS. 3A and 3B, when the display is performed in the sub display area A2, when the control processing circuit 61 confirms the right movement instruction as the fingertip instruction recognition unit 61a, The control processing circuit 61 moves the image of the sub display area A2 to the main display area A1 by appropriately operating the second conversion unit 40, or erases the display of the sub display area A2 and displays another image in the main display area A1. Can be displayed.

  FIGS. 10A and 10B specifically illustrate the switching of the display position in step S20. In this case, the image GA that was originally projected on the setting area or display area on the right side in the field of view FL is moved to the setting area or display area on the left side in the field of view FL according to the instruction of the hand Yh of the wearer.

  In the above, the movement of one hand Yh is checked as a gesture of the wearer, but both hands, a glowing rod, or the like may be used, or an instruction may be input directly from the operation input unit 62.

In the above, the second conversion unit 40 is operated using the image recognition technology, and the display is switched between the plurality of display areas A1 and A2, but the instruction information from the wearer is detected using the wearer's line of sight. You can also
Specifically, since various movements of the wearer's head can be detected using detection signals of the 9-axis sensor 68, changes in the wearer's line of sight can be indirectly checked. When the wearer's line of sight or head shows a specific way of movement, for example, if the same as the trajectory TR shown in FIG. 9C, the control processing circuit 61 moves left from the wearer as the line-of-sight instruction recognition unit 61b. It can be determined that the instruction is received. The 9-axis sensor 68 can identify and detect movements of the wearer's neck, for example, longitudinal movement around the ± X direction or the Y axis, and lateral movement around the ± Y direction or the X axis. It can be converted into eye movement. However, a camera that acquires an image of the eye EY can be provided instead of the 9-axis sensor 68, and the movement of the eyeball, that is, the line of sight can be directly checked. Specifically, for example, when it is detected that the eyeball, that is, the line of sight is facing the front direction of the wearer's face, when the image is displayed in the sub display area A2, the image is moved to the main display area A1. When switching is performed and it is detected that the eyeball, that is, the line of sight is directed leftward with respect to the front direction of the wearer's face, when the image is displayed in the main display area A1, the image is displayed in the sub display area A2. An operation such as switching to move is possible.
Further, if the wearer's voice is detected using the detection signal of the microphone 69, the instruction information from the wearer can be detected by voice analysis of the wearer's voice. Specifically, when a voice such as “move left”, “move right”, or the like is detected, the control processing circuit 61 operates as a voice instruction recognition unit 61c according to the contents of the instructions, the main display area A1 and the sub display area A2. Can be switched between.

  In the above, by waiting for the wearer's instruction or detecting the line of sight and operating the second conversion unit 40, the posture of the first conversion unit 12 can be kept constant while displaying between the plurality of display areas A1 and A2. Although the switching is performed, the second conversion unit 40 can be operated in a time division manner. That is, the display on the main display area A1 and the display on the sub display area A2 can be repeated at predetermined time intervals. When the predetermined time interval is short, it can be perceived that the display in the main display area A1 and the display in the sub display area A2 are performed in parallel.

  According to the virtual image display device 100 of the present embodiment, the second conversion unit 40 switches the region in which the virtual image is displayed by adjusting the posture of the first conversion unit 12 between the plurality of display areas A1 and A2. It is possible to widen a region or an angle of view in which a virtual image can be displayed while suppressing an increase in size or cost of 12.

[Second Embodiment]
The virtual image display device according to the second embodiment will be described below. The virtual image display device according to the present embodiment is a modification of the virtual image display device 100 according to the first embodiment, and is the same as the virtual image display device 100 according to the first embodiment unless otherwise described.

  As shown in FIG. 11, in the virtual image display device according to this embodiment, the first conversion unit 12 included in the image conversion device 10 includes a transmissive liquid crystal display panel 112 a that is an image forming element or a light modulation element, and a flat plate. And a projection lens 112c. The liquid crystal display panel (light modulation element) 112a has a flat plate shape and emits image light PL from a two-dimensional image area. The liquid crystal display panel 112a has a structure in which a liquid crystal layer is sandwiched between a pair of light transmissive substrates on which transparent electrodes are formed, and transparent electrodes formed on one light transmissive substrate side are formed in a matrix pattern with pixel patterns. Yes. A pair of polarizing filters are disposed outside the pair of light transmissive substrates, and the transmitted light can be modulated in a two-dimensional pattern. The illumination unit 112b is formed by light emitting elements such as LEDs and OLEDs, and emits two-dimensionally uniform illumination light GL toward the liquid crystal display panel 112a. The projection lens 112c is, for example, a collimating lens, and causes the image light PL as modulated light that has passed through the liquid crystal display panel 112a illuminated by the illumination unit 112b to enter the virtual image forming member 20 illustrated in FIG. The projection lens 112 c projects the image light PL from the liquid crystal display panel (light modulation element) 112 a as a virtual image in cooperation with the virtual image forming member 20.

  Also in the present embodiment, the posture of the main body portion 12p of the first conversion unit 12 is operated by operating the second conversion unit 40 incorporating the inclination switching mechanism 42 using a recognition technique (see FIG. 8 or the like) regarding the instruction from the wearer. Can be changed. Thereby, the area where the virtual image is displayed can be freely switched between the two display areas A1 and A2 shown in FIG. 3A, for example, reflecting the will of the wearer.

  FIG. 12 shows a modification of the image conversion apparatus 10 shown in FIG. In this case, a self-luminous display panel (light emitting element) 212a is used instead of the liquid crystal display panel 112a, and the illumination unit 112b in FIG. 11 is omitted. As the self-luminous display panel 212a, for example, a self-luminous display device including an organic EL element called an OLED can be used.

[Third Embodiment]
The virtual image display device according to the third embodiment will be described below. The virtual image display device according to the present embodiment is a modification of the virtual image display device 100 according to the first embodiment, and is the same as the virtual image display device 100 according to the first embodiment unless otherwise described.

  As shown in FIG. 13, in the virtual image display device according to the present embodiment, the first conversion unit 12 constituting the image conversion device 10 includes a DMD panel 312a that is an image forming element or a light modulation element, an illumination unit 312b, A projection lens 312c. The DMD panel (light modulation element) 312a has a flat plate shape and emits image light PL from a two-dimensional image area. The DMD panel 312a, also called a digital mirror device, is a two-dimensional array of a large number of micromirrors, and corresponds to an image in the front direction where the projection lens 312c is arranged by adjusting the tilt angle of each micromirror. The light to be taken out can be taken out. The illumination unit 312b includes a lens in addition to a light source such as an LED, and emits two-dimensionally uniform illumination light GL toward the DMD panel 312a. The projection lens 312c is, for example, a collimating lens, and makes the image light PL as modulated light reflected by the DMD panel 312a illuminated by the illumination unit 312b incident on the virtual image forming member 20 shown in FIG. The projection lens 312c projects the image light PL from the DMD panel (light modulation element) 312a as a virtual image in cooperation with the virtual image forming member 20.

  Also in this embodiment, the posture of the main body portion 12p of the first conversion portion 12 is operated by operating the second conversion portion 40 incorporating the inclination switching mechanism 42 using a recognition technique (see FIG. 8 and the like) related to instructions from the wearer. Can be changed. Thereby, the area where the virtual image is displayed can be freely switched between the two display areas A1 and A2 shown in FIG. 3A, for example, reflecting the will of the wearer.

[Fourth Embodiment]
The virtual image display device according to the fourth embodiment will be described below. The virtual image display device according to the present embodiment is a modification of the virtual image display device 100 according to the first embodiment, and is the same as the virtual image display device 100 according to the first embodiment unless otherwise described.

  As shown in FIG. 14, in the virtual image display device according to this embodiment, the first conversion unit 12 included in the image conversion device 10 includes a reflective liquid crystal display panel 412 a that is an image forming element or a light modulation element, and illumination. A unit 112b, a projection lens 112c, and a deflection beam splitter 412d. The liquid crystal display panel (light modulation element) 412a has a flat plate shape and emits image light PL from a two-dimensional image area. The liquid crystal display panel 412a has a structure in which a liquid crystal layer is sandwiched between a light transmissive substrate on which a transparent electrode is formed and a mirror substrate, and the transparent electrodes formed on the light transmissive substrate side are formed in a matrix pattern with a pixel pattern. Yes. A polarizing filter is disposed outside the light transmissive substrate, and the reflected light can be modulated in a two-dimensional pattern. The deflecting beam splitter 412d guides the illumination light GL from the illumination unit 112b to the liquid crystal display panel 412a, and guides the image light PL from the liquid crystal display panel 412a to the projection lens 112c. The projection lens 112c makes the image light PL as the modulated light reflected by the liquid crystal display panel 412a illuminated by the illumination unit 112b incident on the virtual image forming member 20 shown in FIG. The projection lens 112c projects the image light PL from the liquid crystal display panel (light modulation element) 412a as a virtual image in cooperation with the virtual image forming member 20.

  Also in this embodiment, the posture of the main body portion 12p of the first conversion portion 12 is operated by operating the second conversion portion 40 incorporating the inclination switching mechanism 42 using a recognition technique (see FIG. 8 and the like) related to instructions from the wearer. Can be changed. Thereby, the area where the virtual image is displayed can be freely switched between the two display areas A1 and A2 shown in FIG. 3A, for example, reflecting the will of the wearer.

  The present invention is not limited to the above embodiments, and can be implemented in various modes without departing from the scope of the invention.

  In the virtual image display device 100 according to the above-described embodiment, the urging portion 42b configuring the subactuator is an electromagnetic device including the magnet 42i and the coil 42j. However, the urging portion 42b is formed of a piezo element or the like. You can also.

  In the above, the region in which the user wearing the virtual image display device 100 displays the virtual image is switched to the desired one of the plurality of display areas A1 and A2, but the region in which the virtual image is displayed regardless of the user's intention display Can be changed. For example, when a danger or abnormality is detected, such as when the camera 67 detects an object that approaches rapidly from the front direction, the image displayed in the main display area A1 can be moved to the sub display area A2. Furthermore, when it is detected that the user is walking, it is possible in principle to display an image in the sub display area A2. In this case, for example, when the user's intention is displayed, the image displayed in the sub-domain A2 can be set to be moved to the main display area A1.

FIG. 15 is a diagram for explaining the operation of a modification of the virtual image display device according to the first embodiment. When an image is displayed in the main display area A1 (Y in step S51), the control processing circuit 61 refers to the storage unit 62 and determines whether or not the high transmission mode is set according to the wearer's instruction or the like. Confirmation (step S52). When the high transmission mode is set (Y in step S52), the control processing circuit 61 outputs a command to the video display processing units 91 and 92 to perform image processing for widening the gap between the pixels (step S53). . That is, in the high transmission mode, the image display processing units 91 and 92 are caused to perform image processing such as thinning out pixels by removing dots. As a result, the luminance of the video light PL is lowered and the resolution is lowered, but the transmittance of the external light OL can be relatively increased by widening the gap between the pixels.
In the above, when an image is displayed in the main display area A1 (Y in step S51), image processing is performed to widen the gap between pixels for the video light PL (step S53). Even when an image is displayed in the display area A2, it is possible to perform image processing for widening the gap between pixels for the video light PL.

  Moreover, in the said embodiment, although the virtual image formation member 20 has covered the front of a wearer's eyes entirely, the virtual image formation member 20 may cover the part of the corner in front of eyes, etc. partially.

  In the signal light forming unit 11, the optical fiber FB or the like is unnecessary, and the signal light GL can be directly incident on the first conversion unit 12 from the color light sources 11r, 11g, and 11b.

  In the above embodiment, the posture of the first conversion unit 12 is changed by the second conversion unit 40, but as a part of the first conversion unit 12 at the subsequent stage of the first conversion unit 12 (that is, the virtual image forming member 20 side). By providing a small mirror and changing the posture of the mirror, it is possible to switch to a desired one of the plurality of display areas A1 and A2 and perform display.

  The support member 20b of the virtual image forming member 20 is a transparent member that transmits visible light. However, the support member 20b does not have to be colorless and transparent, and may have an action of coloring or dimming the ambient light OL. . Alternatively, the support member 20b can be made substantially colorless and transparent, and a filter for dimming or coloring can be detachably fixed to the outside of the support member 20b.

  DESCRIPTION OF SYMBOLS 10 ... Image converter, 11 ... Signal light formation part, 12 ... 1st conversion part, 12a ... Mirror, 12d ... Support frame, 12h ... Drive part, 12m ... Elastic member, 13 ... Scanning system drive device, 14 ... Light source drive Circuit: 20 ... Virtual image forming member, 20a ... Reflective layer, 20b ... Support member, 40 ... Second conversion part, 42 ... Inclination switching mechanism, 42a ... Frame body, 42b ... Energizing part, 42i ... Magnet, 42j ... Coil, 42k ... support member, 43 ... tilt switching drive unit, 50 ... frame, 50a ... upper frame, 61 ... control processing circuit, 62 ... operation input unit, 63 ... storage unit, 64 ... interface, 67 ... camera, 68 ... 9 axes Sensor 69. Microphone 90 Body part 91, 92 Video display processing unit 95 Main control unit 100 Virtual image display device 100A 100B Display device, A1 ... main display area, A2 ... sub display area, A01, A02, A03 ... contour, EY ... eye, FL ... field of view, G1 ... main image, G2 ... sub image, GL ... illumination light, GL ... signal light NS ... Nose, OA ... Optical axis, OL ... External light, PL ... Video light, SL ... Scanning light

Claims (23)

A first converter that emits image light;
A virtual image forming member that forms a virtual image upon receiving image light; and
A virtual image display device comprising: a second conversion unit that changes a display area of image light by the first conversion unit.   The second conversion unit performs an operation corresponding to display switching on at least a part of the first conversion unit so that display is performed in any of a plurality of preset display areas. Item 8. The virtual image display device according to Item 1.   The plurality of display areas include a main display area and a sub display area, and the second conversion unit changes display from one of the main display area and the sub display area to the other. The virtual image display device described.   The virtual image display device according to claim 3, wherein a resolution of the sub display area is lower than a resolution of the main display area.   5. The virtual image display device according to claim 1, wherein the first conversion unit widens a gap between pixels when operating in the high transmission mode.   The virtual image display device according to any one of claims 1 to 5, wherein the second conversion unit relatively reduces an area of the display area when operating in the energy saving mode.   The virtual image display device according to any one of claims 1 to 6, wherein the second conversion unit switches a region for displaying a virtual image by changing an attitude of the first conversion unit.   The virtual image display device according to any one of claims 1 to 7, wherein the virtual image forming member covers at least a part of the wearer's eyes in front of the wearer.   The virtual image display device according to claim 8, wherein the first conversion unit is disposed closer to the temple of the wearer than the virtual image forming member when worn.   10. The virtual image display according to claim 1, wherein the first conversion unit includes a scanning optical system that scans to form image light by reflecting the modulated signal light. 11. apparatus.   The virtual image display device according to any one of claims 1 to 9, wherein the first conversion unit includes an image forming element that emits image light from a two-dimensional image area.   The virtual image display device according to claim 11, wherein the image forming element is a light modulation element that two-dimensionally modulates illumination light.   The virtual image display device according to claim 11, wherein the image forming element is a light emitting element that forms a two-dimensional light emitting pattern.   The virtual image according to any one of claims 11 to 13, wherein the first conversion unit includes a lens that projects video light from the image forming element as a virtual image in cooperation with the virtual image forming member. Display device.   The virtual image display device according to any one of claims 1 to 14, wherein the virtual image forming member transmits external light and presents the image light and the external light in a superimposed manner to a wearer.   The virtual image display device according to any one of claims 1 to 15, further comprising a detection unit for detecting instruction information from a wearer regarding the operation of the second conversion unit.   The virtual image display device according to claim 16, wherein the detection unit detects instruction information from the wearer based on at least one of the wearer's gesture, voice, and line of sight.   The virtual image is displayed on a display area corresponding to instruction information from a wearer by operating the second conversion unit based on a detection result of the detection unit, according to any one of claims 16 and 17. Virtual image display device. A virtual image forming member that receives the image light from the first converter and forms a virtual image;
A virtual image display device that changes a region in which a virtual image is displayed by two-stage control of different types with respect to the first conversion unit. The first converter has a main actuator that forms a virtual image,
The virtual image display device according to claim 19, further comprising a subactuator that changes a virtual image formation direction by changing a posture of the first conversion unit. A virtual image display method for forming a virtual image by receiving image light from a first conversion unit by a virtual image forming member,
A virtual image display method in which a display area of video light by the first converter is changed by a second converter. A virtual image display method for forming a virtual image by receiving image light from a first conversion unit by a virtual image forming member,
A virtual image display method of changing a region in which a virtual image is displayed by two-stage control of different types with respect to the first conversion unit.   The instruction information from the wearer is detected based on at least one of the wearer's gesture, voice, and line of sight, and a virtual image is displayed in a display area corresponding to the detected instruction information. The virtual image display method according to item.

Images