JP6023568B2 - Head-mounted device - Google Patents

Description

  The present invention relates to a head-mounted device or the like.

  2. Description of the Related Art In recent years, development of a head-mounted device that displays a video or an image (hereinafter simply referred to as an image) toward a user's pupil by a display unit that is mounted on the head and placed in the user's field of view has progressed. It is out.

  For example, the head-mounted device disclosed in Patent Document 1 includes a camera (imaging unit) in such a head-mounted device, and displays an image captured by the camera on a display unit. This makes it possible to check the captured image on the display unit while the user is moving the line of sight while capturing the image with the same line of sight as the user.

  In addition, for example, Patent Document 2 discloses a wearable device that switches a display position of a displayed image based on information of an acceleration sensor built in the wearable device.

JP 2008-67218 A U.S. Pat. No. 8,184,070

  As described above, even when a conventional head-mounted device is used, the user can check the image on the display unit without moving the line of sight. However, there is a problem that an advanced control device is required for that purpose.

  Also, depending on the usage status of the head-mounted device by the user, the user always wants to check the display image, and the user does not normally check the display image, but only when it is necessary You may want to check the image.

  However, in the conventional method, the display position of the display image cannot be changed according to the use state of the user without performing complicated processing.

  In addition, when the virtual image position of the display image is fixed at the same position, the user's eyes are moved by the viewpoint when the user is looking at a distant view and when the user is looking at a close view. Needed to see the display image and scenery while adjusting the focus position. As a result, the user may feel tired of the eyes and may cause a sense of distance.

  According to some aspects of the present invention, a head-mounted device capable of switching and displaying a display position of a display image or a virtual image position of a display image according to a use situation of a user's head-mounted device. Etc. can be provided.

  One aspect of the present invention includes a display unit that displays a display image in a visual field range of a user, and a support unit that is attached to a wearing tool that can be mounted on the user's head and supports the display unit. The display unit is based on a relative position of the display unit with respect to the user, and is at least one of a display position of the display image and a virtual image position in the distance direction of the display image in the display area of the display unit. This relates to a head-mounted device that switches between two displays.

  In one embodiment of the present invention, the user moves the display unit in accordance with a use situation. The display unit displays the display image by switching the display position of the display image or the virtual image position of the display image according to the position of the display unit main body.

  Therefore, the display position of the display image or the virtual image position of the display image can be switched and displayed according to the usage status of the user's head-mounted device.

  Moreover, in one aspect of the present invention, the display mode setting unit includes a display mode setting unit that performs a display mode setting process of the display image, and the display mode setting unit includes a front view mode in which the display unit is positioned in the visual line direction of the user. And the display unit performs the setting process for setting the display mode in any one of peripheral vision modes located in a direction different from the line-of-sight direction of the user, and the display unit performs the setting for the user. Based on the relative position of the display unit and the set display mode, at least one of the display position of the display image and the virtual image position of the display image in the distance direction in the display area of the display unit. You may switch and display them.

  Accordingly, it is possible to switch and display the display position of the display image or the virtual image position of the display image in accordance with not only the position of the display unit but also the direction in which the user is normally viewing.

  Moreover, in one aspect of the present invention, the display unit includes the first display unit when the display mode is set to the front view mode and the display unit is positioned in front of the user's eyeball. The display image may be displayed at a display position, and the display image may be displayed at a second display position when the display unit is positioned in the lower front direction of the user's eyeball.

  Thus, when the user is viewing the same direction as the direction in which the display unit is located at the normal time, the display unit is positioned in front of the user's eyeball, and the display unit is positioned in the lower front direction of the user's eyeball. It is possible to change the display position of the display image, etc.

  In one aspect of the present invention, when the display unit is positioned in the front lower direction of the user when the display mode is set to the front view mode, The display image may be displayed at the second display position below the first display position.

  This makes it possible to display the display image in the same direction as the line-of-sight direction, for example, when the user wants to simultaneously view the landscape currently being viewed by the user and the display image.

  In the aspect of the invention, the display unit may include a third display unit when the display mode is set to the peripheral vision mode and the display unit is positioned in front of the user's eyeball. When the display image is displayed at a display position and the display unit is positioned in the lower front direction of the user's eyeball, the display image may be displayed at a fourth display position.

  Accordingly, when the user is viewing the direction different from the direction in which the display unit is located at the normal time, when the display unit is positioned in front of the user's eyeball, the display unit is positioned in the lower front direction of the user's eyeball. It is possible to change the display position of the display image, etc.

  In one aspect of the present invention, when the display mode is set in the peripheral vision mode, the display unit is positioned in the lower front direction of the user's eyeball. The display image may be displayed at the fourth display position below the third display position.

  Accordingly, for example, when the user wants to view the display image only when necessary, the display image can be displayed in the upper direction or the lower direction than the line-of-sight direction.

  In the aspect of the present invention, the display unit may be configured such that when the display mode is set to the front view mode and the display unit is positioned in front of the user's eyeball, the virtual image position is set. Displays the first display image that is the first virtual image position, and the display unit is positioned in the lower front direction of the user's eyeball, the second virtual image position is the second virtual image position. A display image may be displayed.

  Thus, when the user is viewing the same direction as the direction in which the display unit is located at the normal time, the display unit is positioned in front of the user's eyeball, and the display unit is positioned in the lower front direction of the user's eyeball. It is possible to change the virtual image position of the display image, etc.

  In one aspect of the present invention, when the display unit is positioned in the front lower direction of the user when the display mode is set to the front view mode, The second display image in which the virtual image position in the distance direction is the second virtual image position closer to the user than the first virtual image position may be displayed.

  As a result, when the user is looking in the same direction as the direction in which the display unit is located, it is shown to the user that the display image is displayed at a position close to the scenery that the user is viewing. Etc. becomes possible.

  In the aspect of the present invention, the display unit may be configured such that when the display mode is set to the peripheral vision mode and the display unit is positioned in front of the user's eyeball, the virtual image position is set. Displays a third display image at the third virtual image position, and the display unit is positioned in the lower front direction of the user's eyeball, the fourth virtual image position is the fourth virtual image position. A display image may be displayed.

  Accordingly, when the user is viewing the direction different from the direction in which the display unit is located at the normal time, when the display unit is positioned in front of the user's eyeball, the display unit is positioned in the lower front direction of the user's eyeball. It is possible to change the virtual image position of the display image, etc.

  In one aspect of the present invention, when the display mode is set in the peripheral vision mode, the display unit is positioned in the lower front direction of the user's eyeball. The fourth display image in which the virtual image position in the distance direction is the fourth virtual image position farther from the user than the third virtual image position may be displayed.

  As a result, when the user is looking in a different direction from the direction in which the display unit is located, it is shown to the user that the display image is displayed at a position close to the scenery that the user is viewing. Etc. becomes possible.

  Moreover, in one mode of the present invention, it includes a detection unit that detects the position of the display unit, and the display unit detects that the display unit has moved relative to the user. In this case, at least one of the display position of the display image and the virtual image position in the distance direction of the display image in the display area of the display unit may be switched and displayed.

  Thereby, for example, it is possible to save the user from inputting the position of the display unit to the head-mounted device.

  Moreover, in 1 aspect of this invention, the imaging part which images the front of the said user may be included, and the said display part may display the said display image produced | generated from the captured image which the said imaging part imaged.

  Accordingly, it is possible to check the captured image on the display unit while the user is moving the line of sight while capturing the image with the same line of sight as the user.

  According to another aspect of the present invention, a display unit that displays a display image in a user's visual field range, and a support unit that is attached to a mounting tool that can be mounted on the user's head and supports the display unit, And the display unit displays a first display image whose virtual image position is the first virtual image position when the user is looking in the front direction of the eyeball, and the user displays the periphery in front of the eyeball. When viewing, the present invention relates to a head-mounted device that displays a second display image in which the virtual image position is the second virtual image position.

  Thereby, the virtual image position of the display image can be changed according to the direction in which the user is looking.

  In another aspect of the present invention, the display unit is configured so that the virtual image position is closer to the user than the first virtual image position when the user is looking around the front of the eyeball. The second display image that is the second virtual image position may be displayed.

  As a result, the display image can be shown to the user as if the display image is displayed at a position close to the scenery the user is viewing.

The system configuration example of 1st Embodiment. 2A and 2B are explanatory diagrams of the head-mounted device in the first embodiment. The flowchart explaining the flow of a process of 1st Embodiment. 4A and 4B are explanatory diagrams of the position of the display unit main body and the first display position. FIGS. 5A and 5B are explanatory diagrams of the position of the display unit main body and the second display position. 6A and 6B are explanatory diagrams of the position of the display unit main body and the third display position. 7A and 7B are explanatory diagrams of the position of the display unit main body and the fourth display position. FIG. 8A and FIG. 8B are explanatory diagrams of a head-mounted device in the second embodiment. FIG. 9A to FIG. 9C are explanatory diagrams of the inside of the support part of the head-mounted device according to the second embodiment. FIG. 10A and FIG. 10B are explanatory views of the inside of the support portion during rotation according to the second embodiment. The flowchart explaining the flow of a process of 2nd Embodiment.

  Hereinafter, the first embodiment and the second embodiment will be described. First, the background of each embodiment and the outline of the method will be described together. Next, a system configuration example, a method, and a flow of processing will be described in detail for each embodiment, and finally a modified example will be described. In addition, each embodiment described below does not unduly limit the content of the present invention described in the claims. In addition, all the configurations described in the embodiments are not necessarily essential configuration requirements of the invention.

1. Overview In recent years, there has been a development of a head-mounted device that projects a video or an image (hereinafter simply referred to as an image) toward a user's pupil by a display unit that is mounted on the head and placed in the user's field of view. Progressing.

  For example, the head mounted device disclosed in Patent Document 1 described above includes a camera (imaging unit) in such a head mounted device, and displays an image captured by the camera on the display unit. This makes it possible to check the captured image on the display unit while the user is moving the line of sight while capturing the image with the same line of sight as the user. That is, the head-mounted device can be used as a so-called view finder or visual aid device.

  In addition, for example, Patent Document 2 described above discloses a wearable device that switches a display position of a displayed image based on information of an acceleration sensor built in the wearable device.

  As described above, even when a conventional head-mounted device is used, it is possible to confirm the display image on the display unit while moving the line of sight while confirming the landscape. However, there is a problem that an advanced control device is required for that purpose.

  Also, depending on the usage status of the head-mounted device by the user, the user always wants to check the display image, and the user does not normally check the display image, but only when it is necessary You may want to check the image.

  For example, when confirming information on the display in front of the user, the user wants to confirm the information while viewing the landscape with the display of the head-mounted device. There are many.

  In addition, when working toward the desk, when displaying an image representing the work procedure on the display unit of the head-mounted device, the user works with the eyes slightly lowered. In many cases, the user wants to check the displayed information by moving the display unit according to the direction.

  In addition, when you are walking in the city, when displaying an image representing the city navigation information on the display unit of the head-mounted device, the display image usually obstructs the field of view, so only when it is necessary I often want to check the displayed image.

  However, in the conventional method, the display position of the display image cannot be changed according to the use state of the user without performing complicated processing.

  Therefore, in the first embodiment described below, the position of the display image displayed on the display unit is adjusted according to the usage status of the user's head-mounted device and the position of the display unit. As a result, the user wants to display the display image in the front direction or in the downward direction with a reduced line of sight, or always wants to view the display image in front of the field of view or to view the display image around the field of view. According to the needs, a head-mounted device that displays a display image can be realized.

  In addition, when the virtual image position of the display image is fixed at the same position, the user's eyes are moved by the viewpoint when the user is looking at a distant view and when the user is looking at a close view. Needed to see the display image and scenery while adjusting the focus position. As a result, the user may feel tired of the eyes and may cause a sense of distance.

  Therefore, in the second embodiment described below, display images having different virtual image positions in the distance direction are displayed on the display unit in accordance with the usage status of the user's head-mounted device and the position of the display unit. . Thereby, it becomes possible to display a display image as if it had the same distance as the distance to the scenery of the outside world which the user is seeing. For example, when the user is looking at a mountain that is 1 km away, the display image is displayed so as to appear to be the same distance as the distance to the mountain. When a document on a desk 30 cm ahead is being viewed, the display image is displayed so that it appears to be the same distance as the distance to the document. As a result, it becomes unnecessary for the user to adjust the focus with his / her eyes when viewing the display image, so that the user's eyes can be less tired and the distance can be confused. .

2. 1. First Embodiment 2.1 System Configuration Example Next, FIG. 1 shows a configuration example of a head-mounted device (head-mounted imaging device or head-mounted display device) according to the present embodiment.

  The head-mounted device 100 includes a display unit 110, a support unit 120, a display mode setting unit 130, and a detection unit 140. The head-mounted device 100 is not limited to the configuration shown in FIG. 1, and various modifications such as omitting some of these components or adding other components are possible. .

  Next, the connection of each part is demonstrated. The display unit 110 is attached to the support unit 120 and connected to the detection unit 140. The display mode setting unit 130 is connected to the display unit 110. Further, the detection unit 140 is connected to the display unit 110 and the display mode setting unit 130.

  The head-mounted device 100 is attached to a mounting tool. For example, the wearing tool is eyeglasses GL as shown in FIG. 2 (A), the lens held in front of the user's eyes, the front end is connected to both sides of the lens, and the rear end is the user's eye. And a temple portion locked to the ear. The wearing device is not limited to the eyeglass type, and may be any other configuration as long as the head wearing device can be worn on the user's head. Specifically, a helmet-type, headphone-type, hat-type, or band-type wearing tool may be used.

  Next, processing performed in each part of the head-mounted device 100 will be described.

  First, the display part 110 displays a display image in a user's visual field range. For example, the display unit 110 (DS in FIG. 2A) uses an eyepiece optical system such as an optical prism, a lens, or a mirror to display an image to be displayed on a display element using liquid crystal, organic EL, or the like. To enter. Examples of the display unit 110 include a half mirror type, a hologram type, and an optical bar type.

  Next, the support unit (housing) 120 is attached to a mounting tool that can be mounted on the user's head, and supports the display unit 110. For example, the support part 120 is attached to the temple part of the wearing tool as shown in FIG.

  And the support part 120 (SU of FIG. 2 (A)) of this embodiment has the slide part SL, for example.

  The slide portion SL is provided on the front surface of the support portion 120, and supports the arm so that it can translate in a plane substantially parallel to the surface of the lens. In this slide portion SL, as shown in FIG. 2 (A), the position where the tip of the arm is disposed in front of the wearer's eyeball and the tip of the arm as shown in FIG. 2 (B). The movement range of the arm is restricted between the portion and the position below the wearer's eyeball. Note that the positional relationship between the user's eyeball EY and the display unit DS in the state of FIG. 2A is as shown in FIG. 4B, which will be described later, and in the state of FIG. The positional relationship is as follows. The display portion DS in FIG. 2B is positioned below the position shown in FIG. 4B as indicated by an arrow Y1 in FIG. 5B because the slide portion SL slides downward.

  And a slide part has an arm extended toward a front-end | tip part from a base end part, and it is provided so that the base end part of an arm may slide.

  Thus, when the support part 120 has a slide part, the display part 110 is provided in the front-end | tip part of the arm of a slide part.

  The slide unit is preferably configured such that the display unit 110 moves along the same rotation axis as the rotation center of the eyeball. Further, it is particularly preferable that the optical axis of the display screen in the vertical direction is rotated so that the user can always visually recognize the display image.

  Next, the detection unit 140 detects the position of the display unit 110. For example, when the display unit 110 (DS) is provided at the tip of the slide portion SL as shown in FIG. 2A, the detection unit 140 has the tip of the arm of the slide portion SL in front of the wearer's eyeball. It is detected whether it is in a state of being placed in the front (hereinafter referred to as arm position A), and whether the tip is in the front lower position of the wearer (hereinafter referred to as arm position B). A signal corresponding to the detection result is output to the display mode setting unit 130.

  As such a detection unit 140, a switch using a rotating contact, a sensor using a magnet and a Hall element, a system using an encoder, a photo interrupter and a slit, or the like can be adopted. The detection unit 140 may output, as a detection result, whether the current arm is located at one of the two positions, or may output at which position in the slide range the arm is located as a continuous value. .

  Then, the display mode setting unit 130 sets the display mode to either the front view mode in which the user looks at the front direction of the eyeball or the peripheral vision mode in which the user looks around the front of the eyeball.

  Further, the head-mounted device 100 may be provided with an imaging unit (not shown). For example, the imaging unit is provided so that the front of the user is imaged and the imaging lens is exposed on the front surface of the support unit 120.

  Although not shown in the drawings, the support unit 120 may include, for example, an image processing unit, a storage unit, an electronic board that functionally implements an input / output unit, and a battery.

  The image processing unit performs processing for generating an image used as a graphical user interface (GUI) for operating the imaging unit, image data transmitted from the outside, and image processing for image data stored in the storage unit. . The image processing unit may perform image processing on a captured image taken when an imaging unit (not shown) is optionally provided, and store the image data in the storage unit. The storage unit stores a display image to be displayed on the display unit 110 and a database, and serves as a work area for the display mode setting unit 130 and the detection unit 140. The function of the storage unit is a memory such as a RAM, It can be realized by an HDD or the like.

  Further, the input / output unit outputs an image subjected to predetermined image processing in the image processing unit or outputs from an external computer device or the like by communication with an external computer device or the like via a communication cable or wirelessly. Receive input of image data.

  Note that the functions of the display mode setting unit 130 and the detection unit 140 can be realized by hardware such as various processors (CPU or the like), ASIC (gate array or the like), GPU, or a program.

2.2 Details of Processing Hereinafter, the operation of the head-mounted device of the present embodiment will be described with reference to the flowchart of FIG.

  First, the head-mounted device is turned on (S101), and the display unit is turned on (S102).

  Next, it is determined whether the display mode is set to the front view mode or the peripheral view mode (S103).

  Here, the front view mode is a display mode in which the display unit is positioned in the user's line-of-sight direction, and the peripheral vision mode is a display mode in which the display unit is positioned in a direction different from the user's line-of-sight direction. The display unit being positioned in the user's line of sight means that the display unit is positioned on an extension of the line of sight from the user's eyeball.

  The front view mode is a display mode that is set when a display image is displayed in substantially the same direction as the user's line of sight. The peripheral view mode displays a display image in a direction different from the user's line of sight. It can also be said that the display mode is set in the case of. In other words, the front view mode is a display mode that is set when the user wants to view the display image near the center of the visual field range, and the peripheral vision mode is displayed in the peripheral region of the visual field range. This is the display mode that is set when you want to view images.

  For example, when displaying a display image over a landscape, the display mode is set to the front view mode.

  On the other hand, when you are working toward a desk and you want to display an image representing the work procedure on the display section of the head-mounted device as a reference in the corner of the field of view, or when walking in the city, When displaying an image representing city navigation information on the display unit and when it is bothersome to overlap with the landscape, the display mode is set to the peripheral vision mode.

  The display mode is set by, for example, ON / OFF of the display mode changeover switch provided in the head-mounted device, the measurement result of the eyeball focal position by the lens thickness measurement by the fundus camera sensor, or the lens reflection. This is performed based on the measurement result of the lens thickness by moving the surface image, the detection result of the front line of sight and the downward line of sight by line of sight detection, and the like.

  Next, when the display mode is set to the front view mode, the display position of the display image on the display unit is detected (S104).

  And in order to determine the position which displays a display image in the display area of a display part, a detecting part detects the position of a display part main part (S105).

  For example, when it is desired to display information superimposed on a distant view of the user using the display image of the display unit of the head-mounted device, the display image is also displayed on the user's eyeball in order to reduce the user's gaze movement as much as possible. It is desirable to display in the front direction. In this example, it is assumed in this case that the user slides the display unit and moves it in the direction of the front of the user's eyeball.

  On the other hand, when shooting a landscape of the user's hand using the imaging unit and displaying the captured image on the display unit of the head-mounted device, the display image is also the user's It is better to display in the lower front direction of the eyeball. In this example, in this case, it is assumed that the user slides the display unit and moves it toward the lower front of the user's eyeball.

  Based on the above assumption, the detection unit detects the position of the arm of the slide unit as the position of the display unit, and outputs the arm position signal A to the display unit when the detected arm position is the arm position A. . Then, as shown in FIG. 4A, the display unit displays a display image at the first display position AR1 in the display area DS of the display unit (S106). At this time, the positional relationship between the user's eyeball EY and the display unit DS is as shown in FIG.

  Note that the display unit displays the entire image or a part of the image received from the outside or the image generated by the image processing unit as a display image.

  On the other hand, when the detected arm position is the arm position B, the arm position signal B is output to the display unit. Then, as shown in FIG. 5A, the display unit displays a display image at the second display position AR2 of the display area DS of the display unit (S107). At this time, the positional relationship between the user's eyeball EY and the display unit DS is as shown in FIG.

  Also, when the display mode is set to the peripheral vision mode, the display position of the display image on the display unit is detected (S108), as in the case where the display mode is set to the front view mode (S108). Detects the position of the display unit body (S109). The display position of the display image in the display area of the display unit is similarly switched according to the position of the display unit main body.

  For example, when the user is working while looking at his / her hand to the desk, when displaying an image or the like representing the work procedure on the display unit of the head-mounted device, the display image is It is desirable to block the view and not interfere with the work. Therefore, the display image should be displayed at a position in the front direction of the eyeball, not in the lower front direction of the eyeball viewed by the user. In this example, it is assumed in this case that the user slides the display unit and moves it in the direction of the front of the user's eyeball.

  On the other hand, when you are walking in the city, when displaying an image representing the city navigation information on the display unit of the head-mounted device, the user usually looks at the front view and only when necessary I often want to see the navigation information displayed on the display. In view of safety, it is not preferable that the display image interferes with the user's field of view. Therefore, it is desirable to display the display image at a position that does not hinder the user's field of view, and as a result, the safety of the user is ensured. In this example, in this case, it is assumed that the user slides the display unit and moves it toward the lower front of the user's eyeball.

  Based on the above assumption, the detection unit detects the position of the arm of the slide unit as the position of the display unit, and outputs the arm position signal A to the display unit when the detected arm position is the arm position A. . Then, as shown in FIG. 6A, the display unit displays a display image at the third display position AR3 in the display area DS of the display unit (S110). At this time, the positional relationship between the user's eyeball EY and the display unit DS is as shown in FIG.

  On the other hand, when the detected arm position is the arm position B, the arm position signal B is output to the display unit. Then, as shown in FIG. 7A, the display unit displays the display image at the fourth display position AR4 in the display area DS of the display unit (S111). At this time, the positional relationship between the user's eyeball EY and the display unit DS is as shown in FIG.

  Then, it is determined whether or not the apparatus is turned off. If the apparatus is turned off, the process is terminated. If the apparatus remains on, the process returns to step S103 (S112). The above is the processing flow of the present embodiment.

  As described above, in the present embodiment, when the user wants to simultaneously view the landscape currently being viewed and the display image, the display image is displayed in the same direction as the viewing direction, and the display image is displayed only when the user needs. When viewing is desired, the display image is displayed in a direction different from the viewing direction. This makes it possible to display the display image at a position that does not obstruct the field of view when it is unnecessary, while reducing the user's line-of-sight movement as much as possible.

3. Second Embodiment 3.1 System Configuration Example Next, a head-mounted device according to a second embodiment will be described. Note that in the present embodiment described below, the same reference numerals are given to the components common to the first embodiment, and the description thereof is omitted.

  First, the basic configuration is the same as the configuration of the first embodiment shown in FIG. 1, but is different from the first embodiment in that the support portion 120 has a rotation mechanism (pivot portion). The other display unit 110, display mode setting unit 130, and detection unit 140 are the same as those in the first embodiment, and thus description thereof is omitted.

  The rotation mechanism (pivot unit) of the support unit 120 rotates the display unit 110 with respect to the wearing tool.

  For example, as shown in FIG. 8A, the rotation mechanism PB is connected to the support part SU while sandwiching the temple part of the wearing tool GL. And as shown in FIG.8 (B), the whole support part SU can be rotated with respect to the mounting tool GL (or user) centering | focusing on the rotation mechanism PB. At this time, only the support part SU rotates and the position of the wearing tool does not change. Therefore, the position of the display unit DS with respect to the user's eyeball can be changed by such a rotation operation.

  A specific example of the internal structure of the support portion 120 will be described with reference to FIG. FIG. 9A is a view of the head-mounted device viewed from directly above. The head-mounted device in FIG. 9A includes a rotation mechanism PB, a display element DD, a guide part GD that slides the display element DD, a rotation mechanism PB, and a guide part GD. And a link mechanism LI for mechanically connecting the two. And it has optical bar BR provided with a display part (eyepiece optical system) outside the support part, and head attachment jig mount part JM. In addition, when this head-mounted device is viewed from the side direction perpendicular to FIG. 9A, it is as shown in FIG. 9B. LT in FIG. 9B is a display panel and a lighting unit. However, it is not necessarily limited to this configuration. The positional relationship between the user's eyeball EY and the display unit DS when the support unit is in the state of FIG. 9B is as shown in FIG.

  Then, as shown in FIG. 10A, when the support portion is rotated by the angle θ by the rotation mechanism PB, the entire support portion is inclined by θ ° with respect to the wearing tool. Further, in conjunction with this turning operation, the display element DD moves back and forth with respect to the eyepiece optical system (the distance has changed by d in FIG. 10A), and as a result, the virtual image position changes. . The positional relationship between the user's eyeball EY and the display unit DS when the support unit is in the state shown in FIG. 10A is as shown in FIG. The display portion DS in FIG. 10B is positioned below the position in FIG. 9C as indicated by an arrow Y3 in FIG. 10B because of the rotation by the rotation mechanism.

3.2 Details of Processing Hereinafter, the operation of the head-mounted device of the present embodiment will be described with reference to the flowchart of FIG. The operations in steps S201 to S204, S208, and S212 are the same as those in steps S101 to S104, S108, and S112 in FIG.

  In the first embodiment described above, the detection unit detects the position of the display unit main body in order to determine the display image display position in the display area of the display unit (S105 and S109 in FIG. 3). In this embodiment, the detection unit detects the position of the display unit main body in order to determine the virtual image position of the display image (S205, S209).

  For example, when the user is walking in a city, the user is looking at the front, and therefore often sees a natural distant view. At this time, when the virtual image position of the display image is close to the user, the user needs to focus far when viewing the front view, and focus close when viewing the display image. . As a result, the user's eyes are fatigued or the sense of distance is confused. Therefore, when the user is looking at a distant view, it is desirable to set the virtual image position of the display image to a distant position. This is the same even when the display mode is set to the front view mode and when the display mode is set to the peripheral view mode.

  On the other hand, when the user is working at a desk, the user is mostly looking at his / her hand. At this time, if the virtual image position of the display image is far from the user, the user needs to focus close when viewing the work situation at hand, and focus far when viewing the display image. is there. Therefore, in order to reduce the chance of focus adjustment by the user's own eyes as much as possible, the virtual image position of the display image is also close to the user when the user is looking at a nearby scene, contrary to the case described above. Position is desirable. This is the same even when the display mode is set to the front view mode and when the display mode is set to the peripheral view mode.

  However, the user wants to view the display image near the center of the field of view when the display mode is set to the front view mode regardless of whether the virtual image position is far or near. Therefore, it is assumed that the user rotates the display unit and moves it in the front direction of the user's eyeball. On the other hand, when the display mode is set to the peripheral vision mode, the user wants to view the display image around the visual field. Assume that you are moving in the direction.

  Based on the above assumption, when the display mode is set to the front view mode, the detection unit detects the position of the display unit main body. When it is determined that the display unit is positioned in the front direction of the user's eyeball, the display unit displays a first display image whose virtual image position is the first virtual image position (S206). On the other hand, when it is determined that the display unit is positioned in the lower front direction of the user's eyeball, the display unit is a second virtual image position whose virtual image position is closer to the user than the first virtual image position. Is displayed (S207).

  On the other hand, when the display mode is set to the peripheral vision mode, the detection unit similarly detects the position of the display unit main body. When it is determined that the display unit is positioned in the front direction of the user's eyeball, the display unit displays a third display image whose virtual image position is the third virtual image position (S210). On the other hand, when it is determined that the display unit is positioned in the lower front direction of the user's eyeball, the display unit is a fourth virtual image position whose virtual image position is farther from the user than the third virtual image position. Is displayed (S211).

  This makes it possible to make the display image appear as if it is close to the scenery the user is looking at, so that the user does not have to make frequent focus adjustments with their own eyes. Is possible.

4). Summary of Methods Next, the methods of the first embodiment and the second embodiment will be described together.

  The head-mounted device 100 according to the first embodiment and the second embodiment described above is a display unit 110 that displays a display image in the visual field range of the user, and a mounting tool that can be mounted on the user's head. And a support unit 120 that is attached and supports the display unit 110. Then, the display unit 110 displays at least one of the display position of the display image and the virtual image position in the distance direction of the display image in the display area of the display unit 110 based on the relative position of the display unit 110 to the user. Switch to display.

  In the present embodiment, as described above, the user moves the display unit 110 according to the use situation. Then, the display unit 110 displays the display image by switching the display position of the display image or the virtual image position of the display image according to the position of the display unit 110 main body.

  Therefore, the display position of the display image or the virtual image position of the display image can be switched and displayed according to the usage status of the head-mounted device 100 of the user.

  Here, the relative position of the display unit 110 with respect to the user refers to the relative position of the display unit 110 with respect to the user's eyeball, for example.

  The display area of the display unit 110 refers to an area where a display image can be displayed on the display unit. For example, this is the DS region in FIG.

  Furthermore, the display position (display range) refers to a position where the display image is actually displayed. The display position may be the entire display area of the display unit 110 or a partial range of the display area. For example, it is the range of AR1 in FIG.

  The head-mounted device 100 according to the first embodiment and the second embodiment may include a display mode setting unit 130 that performs display image display mode setting processing. The display mode setting unit 130 may be either one of a front view mode in which the display unit 110 is positioned in the user's line-of-sight direction and a peripheral vision mode in which the display unit 110 is positioned in a direction different from the user's line-of-sight direction. A setting process for setting the display mode may be performed. Furthermore, the display unit 110 displays the display position of the display image in the display area of the display unit 110 and the virtual image position in the distance direction of the display image based on the relative position of the display unit 110 with respect to the user and the set display mode. At least one of them may be switched and displayed.

  Thereby, not only the position of the display unit 110 but also the display position of the display image or the virtual image position of the display image can be switched and displayed according to the direction in which the user is normally viewing.

  In addition, when the display mode is set to the front view mode and the display unit 110 is positioned in front of the user's eyeball, the display unit 110 displays a display image at the first display position and displays the display image. When the unit 110 is positioned in the lower front direction of the user's eyeball, the display image may be displayed at the second display position.

  Here, the second display position is a position different from the first display position.

  Further, the front of the user's eye refers to the forward direction of the user's face. This direction is different from the user's line-of-sight direction, and as long as the user takes the same posture, the front of the user's eyeball does not change. For example, when the user stands perpendicular to the ground and the user's line of sight is parallel to the ground, the front of the eyeball is also parallel to the ground. In this case, the front of the eyeball remains in the direction parallel to the ground even when the user changes only the line-of-sight direction to the front lower direction without changing the posture. Conversely, for example, when the user takes a posture of sleeping on his back from an upright state, the front of the eyeball is in a direction perpendicular to the ground. As with the front of the eyeball, the lower front direction of the eyeball is also a direction independent of the direction of the user's line of sight.

  Thus, when the user is viewing the same direction as the direction in which the display unit 110 is located at the normal time, when the display unit 110 is positioned in front of the user's eyeball, the display unit 110 is at the lower front of the user's eyeball. It becomes possible to change the display position of the display image depending on the position in the direction.

  Further, for example, the first display position is AR1 in FIG. 4A, and the second display position is AR2 in FIG. 5A.

  In other words, when the display mode is set to the front view mode and the display unit 110 is positioned in the lower front direction of the user's eyeball, the display unit 110 has a second lower position than the first display position. A display image may be displayed at the display position.

  This makes it possible to display the display image in the same direction as the line-of-sight direction, for example, when the user wants to simultaneously view the landscape currently being viewed by the user and the display image.

  Further, when the display mode is set to the peripheral vision mode and the display unit 110 is positioned in front of the user's eyeball, the display unit 110 displays a display image at the third display position and displays the display image. When the unit 110 is positioned in the lower front direction of the user's eyeball, the display image may be displayed at the fourth display position.

  Here, the fourth display position is a position different from the first display position and the third display position described above. However, the third display position may be the same display position as the first display position, and the fourth display position may be the same display position as the second display position described above.

  As a result, when the user is viewing the direction different from the direction in which the display unit 110 is located at the normal time, when the display unit 110 is positioned in front of the user's eyeball, the display unit 110 is at the lower front of the user's eyeball. It becomes possible to change the display position of the display image depending on the position in the direction.

  Further, for example, the third display position is AR3 in FIG. 6A, and the fourth display position is AR4 in FIG. 7A.

  That is, when the display mode is set to the peripheral vision mode and the display unit 110 is positioned in the lower front direction of the user's eyeball, the display unit 110 has a fourth lower position than the third display position. A display image may be displayed at the display position.

  Accordingly, for example, when the user wants to view the display image only when necessary, the display image can be displayed in the upper direction or the lower direction than the line-of-sight direction.

  As described above, it is possible to display a display image at a position where the visual field is not obstructed when it is unnecessary, while reducing the user's line-of-sight movement as much as possible.

  In addition, when the display mode is set to the front view mode and the display unit 110 is positioned in front of the user's eyeball, the display unit 110 includes a first virtual image position that is the first virtual image position. When a display image is displayed and the display unit 110 is positioned in the lower front direction of the user's eyeball, a second display image whose virtual image position is the second virtual image position may be displayed.

  Thus, when the user is viewing the same direction as the direction in which the display unit 110 is located at the normal time, when the display unit 110 is positioned in front of the user's eyeball, the display unit 110 is at the lower front of the user's eyeball. The virtual image position of the display image can be changed depending on the position in the direction.

  When the display mode is set to the front view mode and the display unit 110 is positioned in the lower front direction of the user's eyeball, the display unit 110 has the virtual image position in the distance direction as the first virtual image. A second display image that is a second virtual image position closer to the user than the position may be displayed.

  Accordingly, when the user is viewing the same direction as the direction in which the display unit 110 is located at the normal time, the display image is displayed to the user so that the display image is displayed at a position close to the scenery the user is viewing. It becomes possible.

  In addition, when the display mode is set to the peripheral vision mode and the display unit 110 is positioned in front of the user's eyeball, the display unit 110 has a third virtual image position whose virtual image position is the third virtual image position. When the display image is displayed and the display unit 110 is positioned in the lower front direction of the user's eyeball, a fourth display image whose virtual image position is the fourth virtual image position may be displayed.

  As a result, when the user is viewing the direction different from the direction in which the display unit 110 is located at the normal time, when the display unit 110 is positioned in front of the user's eyeball, the display unit 110 is at the lower front of the user's eyeball. The virtual image position of the display image can be changed depending on the position in the direction.

  Further, when the display mode is set to the peripheral vision mode and the display unit 110 is positioned in the lower front direction of the user's eyeball, the display unit 110 has the virtual image position in the distance direction as the third virtual image. A fourth display image that is a fourth virtual image position farther from the user than the position may be displayed.

  Accordingly, when the user is viewing a direction different from the direction in which the display unit 110 is located at a normal time, the display image is displayed to the user so that the display image is displayed at a position close to the scenery the user is viewing. It becomes possible.

  As described above, it is possible to prevent the user from frequently performing focus adjustment with his / her eyes.

  In addition, the head-mounted device 100 according to the first embodiment and the second embodiment may include a detection unit 140 that detects the position of the display unit 110. When the detection unit 140 detects that the display unit 110 has moved relative to the user, the display unit 110 displays the display position of the display image and the display image distance in the display area of the display unit 110. At least one of the virtual image positions in the direction may be switched and displayed.

  Thus, for example, it is possible to save the user from inputting the position of the display unit 110 to the head-mounted device 100.

  Further, the head-mounted device 100 of the first embodiment and the second embodiment may include an imaging unit that images the front of the user. The display unit 110 may display a display image generated from the captured image captured by the imaging unit.

  This makes it possible to check the captured image on the display unit 110 while the user moves the line of sight while capturing an image with the same line of sight as the user.

5). Other Embodiments In the second embodiment described above, the virtual image position of the display image is changed according to the position of the display unit. However, in other embodiments, based on information other than the position of the display unit, The virtual image position of the display image may be changed.

  That is, the head-mounted device 100 according to another embodiment is attached to a display unit 110 that displays a display image in a user's visual field range and a mounting tool that can be mounted on the user's head. And a support part 120 to support. When the user is looking at the front direction of the eyeball, the display unit 110 displays the first display image whose virtual image position is the first virtual image position, and the user looks at the periphery in front of the eyeball. If there is, the second display image whose virtual image position is the second virtual image position is displayed.

  Thereby, the virtual image position of the display image can be changed according to the direction in which the user is looking.

  In addition, when the user is looking around the front of the eyeball, the display unit 110 displays a second display image in which the virtual image position is a second virtual image position that is closer to the user than the first virtual image position. It may be displayed.

  As a result, the display image can be shown to the user as if the display image is displayed at a position close to the scenery the user is viewing.

  In another embodiment, display images having different angles of view may be displayed on the display unit according to the position of the display unit.

  For example, when the user of the head-mounted device is walking in the city, if the display unit is moved in the front direction of the user's eyeball, the angle of view of the display image is reduced and the user can Then, it is also possible to capture a distant view that is difficult to visually recognize and display the captured image on the display unit.

  On the other hand, when the user of the head-mounted device is walking in the city, if the display unit is moved in the lower front direction of the user's eyeball, the angle of view of the display image is increased, and the user It is also possible to capture a wide range of scenes from the front to the hand that cannot be seen when facing down, and display the captured image on the display unit.

  As described above, the first embodiment and the second embodiment have been described in detail. However, it is easy for those skilled in the art that many modifications that do not substantially depart from the novel matters and effects of the present invention are possible. You can understand. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, a term described at least once together with a different term having a broader meaning or the same meaning in the specification or the drawings can be replaced with the different term in any part of the specification or the drawings. Further, the configuration and operation of the head-mounted device are not limited to those described in this embodiment, and various modifications can be made.

100 head-mounted device, 110 display unit, 120 support unit,
130 display mode setting unit, 140 detection unit

Claims (12)

A display unit for displaying a display image in a user's visual field range;
A support unit attached to a mounting tool that can be mounted on the user's head and supporting the display unit;
A display mode setting unit for performing processing for setting a display mode of the display image;
Including
The display mode setting unit
The display mode is set to either the front view mode in which the display unit is positioned in the user's line-of-sight direction or the peripheral vision mode in which the display unit is positioned in a direction different from the user's line-of-sight direction. Perform the setting process,
The display unit
Based on the relative position of the display unit to the user and the set display mode , the display position of the display image in the display area of the display unit and the virtual image position in the distance direction of the display image A head-mounted device characterized by switching and displaying at least one. In claim 1 ,
The display unit
In the case where the display mode is set to the front view mode,
When the display unit is located in front of the user's eyeball, the display image is displayed at a first display position;
A head-mounted device that displays the display image at a second display position when the display unit is positioned in a lower front direction of the user's eyeball. In claim 2 ,
The display unit
In the case where the display mode is set to the front view mode,
When the display unit is positioned in the lower front direction of the user's eyeball, the display image is displayed at the second display position below the first display position. Wearable device. In any one of Claims 1 thru | or 3 ,
The display unit
In the case where the display mode is set to the peripheral vision mode,
When the display unit is located in front of the user's eyeball, the display image is displayed at a third display position;
A head-mounted apparatus that displays the display image at a fourth display position when the display unit is positioned in a lower front direction of the user's eyeball. In claim 4 ,
The display unit
In the case where the display mode is set to the peripheral vision mode,
When the display unit is positioned in the lower front direction of the eyeball of the user, the display image is displayed at the fourth display position below the third display position. Wearable device. In any one of Claims 1 thru | or 5 ,
The display unit
In the case where the display mode is set to the front view mode,
When the display unit is located in front of the user's eyeball, the first display image in which the virtual image position is the first virtual image position is displayed;
A head-mounted apparatus that displays a second display image in which the virtual image position is a second virtual image position when the display unit is positioned in the lower front direction of the user's eyeball. In claim 6 ,
The display unit
In the case where the display mode is set to the front view mode,
When the display unit is positioned in the lower front direction of the eyeball of the user, the virtual image position in the distance direction is the second virtual image position closer to the user than the first virtual image position. A head-mounted device that displays a second display image. In any one of Claims 1 thru | or 7 ,
The display unit
In the case where the display mode is set to the peripheral vision mode,
When the display unit is located in front of the user's eyeball, the virtual image position is a third display image that is a third virtual image position;
A head-mounted device that displays a fourth display image in which the virtual image position is a fourth virtual image position when the display unit is positioned in a lower front direction of the user's eyeball. In claim 8 ,
The display unit
In the case where the display mode is set to the peripheral vision mode,
When the display unit is positioned in the lower front direction of the user's eyeball, the virtual image position in the distance direction is the fourth virtual image position farther from the user than the third virtual image position. A head-mounted device that displays a fourth display image. In any one of Claims 1 thru | or 9 ,
A detection unit for detecting the position of the display unit;
The display unit
When the detection unit detects that the display unit has moved relative to the user, the display position of the display image in the display region of the display unit and the distance direction of the display image A head-mounted apparatus characterized by switching and displaying at least one of the virtual image positions. In any one of Claims 1 thru | or 10 .
Including an imaging unit for imaging the front of the user;
The display unit
A head-mounted apparatus that displays the display image generated from a captured image captured by the imaging unit. A display unit for displaying a display image in a user's visual field range;
A support unit attached to a mounting tool that can be mounted on the user's head and supporting the display unit;
Including
The display unit
When the user is looking in the front direction of the eyeball, the first display image whose virtual image position is the first virtual image position is displayed,
When the user is looking around the front of the eyeball, a second display image is displayed in which the virtual image position is a second virtual image position closer to the user than the first virtual image position. A head-mounted device characterized by

Images