JP2013232744A - Display system, display adjustment system, display adjustment method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display system for adjusting a display device, e.g., an HMD for providing a 3D video to a user, by displaying a check pattern to a display image for right eye and a display image for left eye.SOLUTION: The display image for right eye and the display image for left eye of a display device are controlled, as a check pattern, so that both eyes are not merged but different figures are displayed. The user adjusts relative relation of the display image for right eye and the display image for left eye so that the corresponding specific parts of two images match each other, by performing instruction or operation. Based on an instruction of the user, the display system controls the image data of the display image for right eye and the display image for left eye so that the check patterns match each other, by shifting the image data vertically and horizontally. Furthermore, the position of the image display device can be changed based on the operation or instruction of the user.

Description

  The present invention relates to a system for adjusting a display device for providing a viewer with a 3D image.

  In recent years, as represented by 3D movies, 3D games, 3D televisions, and the like, three-dimensional (3D) images capable of three-dimensional expression are often used in various fields. A typical method for observing 3D images is a method using 3D glasses. For example, the observer can perform the space division or the time division on the image for the left eye and the image for the right eye projected on the screen at a distance (approximately several meters) sufficiently away from the observer by 3D glasses. Get stereoscopic vision with your eyes. In this method, since a 3D image is projected onto the screen, many observers can view the same 3D image at a time.

As another method for providing 3D images to an observer, a head mounted display (HMD: Head)
When a viewer wears a display device (such as Mounted Display), a left eye image and a right eye image are displayed at positions close to the observer's eyes, and 3D images are individually displayed to the observer. There is a way to provide.

  In a spectacle-type HMD, a 3D image is displayed in front of an observer's eyes (a lens position, which is normal glasses). For example, using a liquid crystal display, an organic EL display, and an optical system, an image for the left eye is displayed in front of the left eye, and an image for the right eye is displayed in front of the right eye. By capturing it, you can see a three-dimensional image.

In such a display device such as an HMD, an observer can individually view a 3D image and a magnified virtual image by a virtual image optical system, and thus individually view a large 3D image such as a 3D game or a 3D television. Suitable for cases. In addition to the display of 3D video, the virtual reality (VR) can be realized by providing a display image in conjunction with the movement of the observer's head or a specific identification sign, so that the outside scene can be observed transparently. : Virtual
It is also suitable for application to an application that provides augmented reality (AR) or augmented reality (AR).

  The display device such as the above-described HMD displays the left-eye image and the right-eye image at a position close to the observer's eye, and gives the observer the parallax between the left-eye image and the right-eye image. Gives a 3D image with a stereoscopic effect. However, the left-eye image and the right-eye image have an appropriate display position (display position in the HMD) or an appropriate relative positional relationship between these images depending on the shooting conditions and the like.

  Here, for example, if the image for the left eye and the image for the right eye are not displayed at appropriate positions, an object that should be stereoscopically viewed by binocular fusion will appear as a double image. If the display position shift is within a certain range, the figure shown in the left and right images is fused in both eyes in the brain to unconsciously try to see the figure as a solid. In this case, the observer will cause symptoms or discomfort such as eye or brain fatigue or headache.

  On the other hand, in a display device such as an HMD in which an observer repeatedly wears and removes many times, the position of the image display device properly adjusted in the manufacturing stage changes due to deformation or secular change due to some impact, The left-eye image and the right-eye image may not be displayed at appropriate positions. Further, depending on the characteristics of the user who is an observer (for example, the arrangement of the eyeballs, etc.), adjustment may be necessary during use.

In order to prevent the occurrence of such a problem, several methods have been proposed so far for adjusting the position of the image display device so that the image display in the HMD is performed at the correct position. For example, Patent Document 1 discloses a method in which a “cross-shaped” test pattern is displayed as the left and right images, and the pixel of the image data is moved and adjusted so that the test patterns match in the left and right image display devices. It is disclosed.

JP 2011-212235 A

  However, in the conventional technology including the above-described Patent Document 1, the left-eye image and the right-eye image are adjusted so that the left-eye image and the right-eye image are displayed at appropriate positions. There is no idea of not fusing (not binocular fusion) or displaying different figures.

  In addition, when different figures that are not fused with both eyes are displayed in the left-eye image and the right-eye image, the figure displayed in one display image and the figure displayed in the other display image can be seen in a predetermined positional relationship. As described above, a configuration in which an observer gives an instruction to adjust at least one of the left-eye image and the right-eye image is not disclosed in the related art.

  Furthermore, after the image for the left eye and the image for the right eye are once adjusted, a change in the relative positional relationship between the image display device and the observer (observer's eyes, face, head, etc.) is measured. The configuration for automatically adjusting the image display of the left-eye image and the right-eye image based on the change is not disclosed in the related art.

  Still further, the left eye image and the right eye image are displayed with different figures that do not fuse both eyes as described above, and another figure that can be binocularly fused, or the left eye image and the right eye. The conventional art does not disclose a configuration in which different figures that are not fused with both eyes as described above are displayed on the ophthalmic image and the outside scene is transparently displayed.

  Accordingly, an object of the present invention is to provide a display system that displays different graphics that do not fuse both eyes in a left-eye image and a right-eye image.

  Furthermore, the object of the present invention is to display different graphics that do not fuse with both eyes in the left-eye image and the right-eye image, and that the graphic displayed in one display image and the graphic displayed in the other display image are An object of the present invention is to provide a display system capable of adjusting the image display of at least one of a left-eye image and a right-eye image by giving an instruction by an observer so that the image can be seen in a predetermined positional relationship.

  A further object of the present invention is to provide a relative positional relationship between the image display device and an observer (observer's eyes, face, head, etc.) after the image for the left eye and the image for the right eye are once adjusted. It is an object of the present invention to provide a display system capable of measuring the change in the image and automatically adjusting the image display of the left-eye image and the right-eye image based on the change.

  Still further, an object of the present invention is to display different figures that do not fuse both eyes in the left-eye image and right-eye image, and display different figures that can be binocularly fused, An object of the present invention is to provide a display system configured to display different figures that do not fuse both eyes as described above in the eye image and the right eye image and to transparently display the outside scene.

  The first embodiment of the present invention is arranged at a position close to or in contact with the user's eye, and displays image display means for displaying a left eye display image and a right eye display image, and a first graphic on the left eye display image. Display control means for controlling to display the second graphic on the right-eye display image, and when the user views the left-eye display image and the right-eye display image with both eyes, the first graphic and An image display adjusting means capable of adjusting an image display based on a user instruction or operation so that the second graphic is in the first positional relationship, wherein the image display adjusting means Makes it possible to adjust the image display by changing at least one of a change in the position or direction of the image display means and a change in at least one of the left-eye display image and the right-eye display image. , 1st figure and 2nd figure Are different figures that do not fuse with both eyes, and one of the figures includes at least one straight line extending in the horizontal direction, and the two figures are overlapped in a situation where there is no vertical shift or rotational shift. When combined, it is a graphic that can take the first positional relationship, and the first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line, or , At least in a position close to any two points on the straight line, the positional relationship seems to have an equal interval.

  With such a configuration of the present invention, a user of a display device (image display means, image display device) such as an HMD can easily adjust the image display of the display device by viewing different figures that do not fuse both eyes with the left and right eyes. can do. Note that the display system includes a display device (such as an HMD main body) only, a system including a display device and a controller, a system including a display device, a controller, and an adjustment control device, a system including a display device and an adjustment control device, and the like. Various configurations are possible.

  In a second embodiment of the present invention, in the first embodiment, when the image display means is a transmissive type and an outside scene is displayed to the user through the image display means together with the first graphic and the second graphic, When the user views the display image for the left eye and the display image for the right eye with both eyes, the image display adjustment means is configured such that the first graphic and the second graphic are the first graphic and the first graphic and the second graphic are viewed in three dimensions. The display system is configured so that the image display can be adjusted so as to satisfy the positional relationship.

  With such a configuration of the present invention, the user of the display device can easily adjust the image display of the display device while keeping the user's eyeball in a preferable state by looking at the outside scene.

  According to a third embodiment of the present invention, in the first or second embodiment, the display control means further displays a third graphic on the display image for the left eye and displays a fourth graphic on the display image for the right eye. The fourth graphic is a graphic that is the same as or different from the third graphic and can be binocularly fused with the third graphic, and the image display adjusting means is a display for the left eye that the user uses with both eyes. When viewing the image and the display image for the right eye, the image display is performed such that the first graphic and the second graphic are in the first positional relationship while viewing the third graphic and the fourth graphic by binocular fusion. Configured to be adjustable.

  According to a fourth embodiment of the present invention, in the first to third embodiments, the relative positional relationship between the image display means and the user when the image display means is arranged close to the user's eyes. A detecting means for detecting a change in the image, and when the change in the relative positional relationship is detected by the detecting means after the image display is adjusted, a notification process for notifying the user that the change has occurred And, it is configured to execute at least one of automatic adjustment processing for automatically adjusting to a state after the image display is adjusted by canceling out the deviation caused by the change.

  With such a configuration of the present invention, the user of the display device can readjust the image display automatically or easily even if the mounting position of the display device is shifted after the adjustment of the image display is finished.

  In the fifth embodiment of the present invention, in the first to fourth embodiments, when the image display is further adjusted based on the user's instruction, the display control means further displays the left eye display image. 5 figures are displayed, and the sixth figure is controlled to be displayed on the right-eye display image. The sixth figure is the same or different figure from the fifth figure, and can be binocularly fused with the fifth figure. And the image display adjustment means provides a user instruction regarding the sense of distance between the fifth graphic and the sixth graphic that are visible by binocular fusion when the user views the display image for the left eye and the display image for the right eye with both eyes. Alternatively, the image display can be adjusted based on the operation.

  According to a sixth embodiment of the present invention, in the first to fifth embodiments, when the image display is further adjusted based on a user instruction, the display control means adds a seventh display image to the left-eye display image. When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment unit controls the display of the eighth figure on the right-eye display image. The image display can be adjusted based on the user's instruction or operation so that the seventh graphic and the eighth graphic are in the second positional relationship, and the seventh graphic and the eighth graphic are in a relationship that does not cause binocular fusion. If they are different figures and overlap in a situation where there is no deviation, the figure becomes the second positional relationship. The second positional relationship is that the seventh graphic and the eighth graphic overlap at least at two specific points. Or a relationship that looks in contact, or at least on a straight line Or it has all equal intervals at positions adjacent respectively to the specific three points have, or configured to be in a positional relationship that appear to have equal spacing in a set of specific locations.

  The seventh embodiment of the present invention is arranged at a position close to or in contact with the user's eyes, and displays image display means for displaying a display image for the left eye and a display image for the right eye, and the first graphic is displayed on the display image for the left eye. Display control means for controlling to display the second graphic on the right-eye display image, and when the user views the left-eye display image and the right-eye display image with both eyes, the first graphic and An image display adjusting unit capable of adjusting an image display based on a user instruction or operation so that the second graphic is in a predetermined positional relationship, wherein the image display adjusting unit includes: Image display can be adjusted by changing the position or direction of the image display means and changing at least one of the left-eye display image and the right-eye display image. 1 figure and 2nd The shape is a different figure that is in a relationship that does not fuse both eyes, and is a figure that has a predetermined positional relationship when superimposed in a situation where there is no deviation, and the predetermined positional relationship is that the first graphic and the second graphic are At least a relationship that appears to overlap or touch at three specific points that are not on a straight line, or at least at a position that is close to each of three specific points that are not on a straight line, or that is at a specific set of positions It is configured to be a positional relationship that appears to have equal spacing.

  According to an eighth embodiment of the present invention, a first graphic is displayed on a left-eye display image displayed by an image display device arranged at a position close to or in contact with a user's eye, and the right image displayed by the image display device is displayed. When the user views the left eye display image and the right eye display image with both eyes, the display control means for controlling to display the second graphic on the eye display image, the first graphic and the second graphic are 1 is a display adjustment system including an image display adjustment unit capable of adjusting an image display based on a user instruction or operation so that the image display adjustment unit is an image display device. The image display can be adjusted by changing at least one of the change in the position or direction of the image and the change in at least one of the left-eye display image and the right-eye display image. The two figures are different figures that are not in a binocular fusion, and one of the figures includes at least one straight line extending in the horizontal direction, and the two figures are free from vertical deviation and rotational deviation. Is a figure that can take the first positional relationship, and the first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line. Or at least a positional relationship that seems to have equal intervals at positions close to any two points on a straight line.

  In a ninth embodiment of the present invention, in the eighth embodiment, the image display device is a transmissive type, and when the outside scene is displayed through the image display device together with the first graphic and the second graphic to the user, When the user views the display image for the left eye and the display image for the right eye with both eyes, the image display adjustment means is configured such that the first graphic and the second graphic are the first graphic and the first graphic and the second graphic are viewed in three dimensions. The image display can be adjusted so that the positional relationship is satisfied.

  According to a tenth embodiment of the present invention, in the eighth or ninth embodiment, the display control means further displays a third graphic on the display image for the left eye and displays a fourth graphic on the display image for the right eye. The fourth graphic is a graphic that is the same as or different from the third graphic and can be binocularly fused with the third graphic, and the image display adjusting means is a display for the left eye that the user uses with both eyes. When viewing the image and the display image for the right eye, the image display is performed such that the first graphic and the second graphic are in the first positional relationship while viewing the third graphic and the fourth graphic by binocular fusion. Configured to be adjustable.

  The eleventh embodiment of the present invention is the relative positional relationship between the image display device and the user when the image display device is arranged close to the user's eye in the eighth to tenth embodiments. When a change in relative positional relationship is detected by the detection means after the image display is adjusted, the user is notified that the change has occurred. It is configured to execute at least one of a notification process and an automatic adjustment process that automatically adjusts to a state after the image display is adjusted by canceling out the deviation caused by the change.

  In a twelfth embodiment of the present invention, in the eighth to eleventh embodiments, when the image display is further adjusted based on a user instruction, the display control means further displays the left eye display image. 5 figures are displayed, and the sixth figure is controlled to be displayed on the right-eye display image. The sixth figure is the same or different figure from the fifth figure, and can be binocularly fused with the fifth figure. And the image display adjustment means provides a user instruction regarding the sense of distance between the fifth graphic and the sixth graphic that are visible by binocular fusion when the user views the display image for the left eye and the display image for the right eye with both eyes. Alternatively, the image display can be adjusted based on the operation.

  In a thirteenth embodiment of the present invention, in the eighth to twelfth embodiments, when the image display is further adjusted based on the user's instruction, the display control means adds the seventh display image to the left eye display image. When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment unit controls the display of the eighth figure on the right-eye display image. The image display can be adjusted based on the user's instruction or operation so that the seventh graphic and the eighth graphic are in the second positional relationship, and the seventh graphic and the eighth graphic are in a relationship that does not cause binocular fusion. If they are different figures and overlap in a situation where there is no deviation, the figure becomes the second positional relationship. The second positional relationship is that the seventh graphic and the eighth graphic overlap at least at two specific points. Or a relationship that looks in contact, or at least a straight line Not either have all equal intervals at positions adjacent respectively to a specific three-point, or configured to be a positional relationship that appear to have equal spacing in a set of specific locations in.

  In a fourteenth embodiment of the present invention, a first graphic is displayed on a display image for the left eye displayed by an image display device arranged at a position close to or in contact with the user's eyes, and the right image displayed by the image display device Display control means for controlling to display the second graphic on the eye display image, and when the user views the left eye display image and the right eye display image with both eyes, the first graphic and the second graphic are predetermined. The display adjustment system includes an image display adjustment unit capable of adjusting the image display based on a user instruction or operation so that the image display device has the positional relationship. The image display can be adjusted by changing at least one of the change in position or direction and at least one of the left-eye display image and the right-eye display image. The second graphic is a different graphic in a relationship that does not fuse both eyes, and is a graphic that has a predetermined positional relationship when superimposed in a situation where there is no deviation, and the predetermined positional relationship is the first graphic and the second graphic Have at least a relationship that appears to overlap or touch at three specific points that are not on a straight line, or at least have equal spacing at positions close to each of three specific points that are not on a straight line, or It is configured to be a positional relationship that appears to have equal spacing in pairs.

  In a fifteenth embodiment of the present invention, a first graphic is displayed on a display image for the left eye displayed by an image display device arranged at a position close to or in contact with the user's eyes, and the right image displayed by the image display device is displayed. A display control step for controlling to display the second graphic on the display image for the eye; and when the user views the display image for the left eye and the display image for the right eye with both eyes, the first graphic and the second graphic are The display adjustment method includes an image display adjustment step capable of adjusting the image display based on a user instruction or operation so that the image display adjustment step is performed by the image display device. The image display can be adjusted by changing at least one of the change in the position or direction of the image and the change in at least one of the left-eye display image and the right-eye display image. The shape and the second figure are different figures that are not in a binocular fusion, and one of the figures includes at least one straight line that extends in the horizontal direction, and there is no vertical or rotational deviation. When two figures are overlapped, they are figures that can take the first positional relationship. The first positional relation is that the first figure and the second figure overlap or touch at least at any two points on the straight line. It is configured to be a positional relationship that can be seen, or at least a positional relationship that seems to have an equal interval at positions close to any two points on a straight line.

  In a sixteenth embodiment of the present invention, in the fifteenth embodiment, the image display device is a transmissive type, and when an outside scene is displayed through the image display device together with the first graphic and the second graphic to the user, In the image display adjustment step, when the user views the display image for the left eye and the display image for the right eye with both eyes, the first graphic and the second graphic are changed to the first graphic while viewing the object in the outside scene in three dimensions. The image display can be adjusted so that the positional relationship is satisfied.

  According to a seventeenth embodiment of the present invention, a first graphic is displayed on a display image for the left eye displayed by an image display device arranged near or in contact with a user's eye, and the right image displayed by the image display device is displayed. A display control step for controlling to display the second graphic on the display image for the eye, and when the user views the display image for the left eye and the display image for the right eye with both eyes, the first graphic and the second graphic are predetermined. And an image display adjustment step capable of adjusting the image display based on a user instruction or operation so that the image display adjustment step corresponds to the position or direction of the image display device. And by changing at least one of at least one of the left-eye display image and the right-eye display image, the image display can be adjusted. The second graphic is a different graphic in a relationship that does not fuse both eyes, and is a graphic that has a predetermined positional relationship when superimposed in a situation where there is no deviation, and the predetermined positional relationship is the first graphic and the second graphic Have at least a relationship that appears to overlap or touch at three specific points that are not on a straight line, or at least have equal spacing at positions close to each of three specific points that are not on a straight line, or It is configured to be a positional relationship that appears to have equal spacing in pairs.

  In an eighteenth embodiment of the present invention, the first graphic is displayed on the display image for the left eye displayed on the computer by the image display device arranged at a position close to or in contact with the user's eyes, and is displayed by the image display device. Display control means for controlling to display the second graphic on the right-eye display image, and when the user views the left-eye display image and the right-eye display image with both eyes, A program that functions as an image display adjustment unit capable of adjusting image display based on a user instruction or operation so that two figures are in the first positional relationship, and the image display adjustment unit includes: The image display can be adjusted by changing at least one of the change in the position or direction of the image and the change in at least one of the left-eye display image and the right-eye display image. The shape and the second figure are different figures that are not in a binocular fusion, and one of the figures includes at least one straight line that extends in the horizontal direction, and there is no vertical or rotational deviation. When two figures are overlapped, they are figures that can take the first positional relationship. The first positional relation is that the first figure and the second figure overlap or touch at least at any two points on the straight line. It is configured to be a positional relationship that can be seen, or at least a positional relationship that seems to have an equal interval at positions close to any two points on a straight line.

  In a nineteenth embodiment of the present invention, in the eighteenth embodiment, the image display device is a transmissive type, and when an outside scene is displayed through the image display device together with the first graphic and the second graphic to the user, When the user views the display image for the left eye and the display image for the right eye with both eyes, the image display adjustment means is configured such that the first graphic and the second graphic are the first graphic and the first graphic and the second graphic are viewed in three dimensions. The image display can be adjusted so that the positional relationship is satisfied.

  In a twentieth embodiment of the present invention, the first graphic is displayed on the display image for the left eye displayed on the computer by the image display device arranged at a position close to or in contact with the eyes of the user, and is displayed by the image display device. Display control means for controlling to display the second graphic on the right-eye display image, and when the user views the left-eye display image and the right-eye display image with both eyes, A program that functions as an image display adjustment unit capable of adjusting an image display based on a user's instruction or operation so that two figures are in a predetermined positional relationship. The image display can be adjusted by changing at least one of a change in position or direction and a change in at least one of the left-eye display image and the right-eye display image. The shape and the second graphic are different graphics that have a relationship that does not cause binocular fusion. If the shapes and the second graphic are overlapped in a situation where there is no deviation, the graphic has a predetermined positional relationship. Two figures appear to overlap or touch at least three specific points that are not on a straight line, or have at least equal intervals at positions close to each of three specific points that are not on a straight line, or It is configured to be a positional relationship that appears to have equal spacing in the set of positions.

  With the display system according to the present invention, when an observer performs a simple operation, that is, when different figures that do not fuse both eyes are displayed on the left-eye image and the right-eye image, the figure displayed on one display image; By instructing the graphic displayed on the other display image to appear in a predetermined positional relationship, the image display of the left-eye image and the right-eye image is adjusted to an appropriate positional relationship for viewing 3D video can do.

  In addition, the display system according to the present invention enables automatic image display after the left-eye image and the right-eye image are once adjusted based on the change in the relative positional relationship between the image display device and the observer. Adjustments are made.

  In addition to the display of different figures that do not fuse with both eyes, the display system according to the present invention displays another figure that can be binocularly fused and an external scene that can be obtained transparently. Adjustment of effective image display of the ophthalmic image is performed.

It is a basic diagram which shows the basic composition of HMD contained in the display system which concerns on the 1st Embodiment of this invention. It is the basic diagram which showed the outline of HMD contained in the display system which concerns on the 1st Embodiment of this invention, and the display image of 1st calibration. It is an approximate line figure showing a display image of the 2nd calibration in a display system concerning a 1st embodiment of the present invention. It is an approximate line figure showing a display image of the 3rd calibration in a display system concerning a 1st embodiment of the present invention. It is a basic diagram which shows the example of the check pattern in the display system which concerns on the 1st Embodiment of this invention. It is a basic diagram which shows the example of the shift | offset | difference of the check pattern in the display system which concerns on the 1st Embodiment of this invention. It is a basic diagram for demonstrating the shift | offset | difference of a check pattern and the adjustment method in the display system which concerns on the 1st Embodiment of this invention. It is a basic diagram for demonstrating the example of the display system using the 1st adjustment method based on the 1st Embodiment of this invention. It is a basic diagram for demonstrating the modification of the display system which uses the 1st adjustment method based on the 1st Embodiment of this invention. It is a flowchart which shows the processing flow of the display system shown in FIG. It is a basic diagram for demonstrating the example of the display system using the 2nd adjustment method based on the 1st Embodiment of this invention. It is a basic diagram which showed the outline of HMD contained in the display system which concerns on the 2nd Embodiment of this invention, and the image display of the display image for left eyes, and the display image for right eyes. It is a basic diagram for demonstrating imaging | photography conditions regarding the conventional 3D image | video imaging | photography control system. It is a basic diagram which illustrates the display screen for left eyes and the display screen for right eyes in the display system which concerns on the 2nd Embodiment of this invention. It is a basic diagram which shows the example of the check pattern in the display system which concerns on the 2nd Embodiment of this invention. It is a basic diagram which shows the example of the shift | offset | difference of the check pattern in the display system which concerns on the 2nd Embodiment of this invention. It is a basic diagram for demonstrating the display system which concerns on the 3rd, 4th embodiment of this invention. It is a basic diagram which shows the example of the hardware constitutions of the computer which comprises the adjustment control apparatus of the display system which concerns on the 1st Embodiment of this invention.

  The display system according to the first embodiment of the present invention is different in that the left-eye image (left-eye display image) and the right-eye image (right-eye display image) are not fused (cannot be binocularly fused). Display graphics and adjust the image display of at least one of the left-eye display image and the right-eye display image according to instructions from the display device user (for example, a display device wearer or an observer). It is what.

  First, a display device included in the display system according to the first embodiment of the present invention will be described. The display device of the present invention includes a display device that can provide a 3D video to a user, in other words, an image display device that can provide a left-eye video to the left eye and a right-eye video to the right eye. At the same time, the image display device can be arranged at a position close to or in contact with the user, and a typical example is a head mounted display (HMD). However, the mounting method is not limited to mounting on the head. For example, various wearing methods such as glasses, goggles, and helmets are conceivable.

  In addition, the image display device according to the present invention refers to an apparatus that provides an image at a position close to the eye of the observer or a position in contact with the eye of the observer. For example, it may be arranged in contact with the human eyeball, such as one integrated with a contact lens.

  As a display method of the image display device provided in the display device, as shown in FIG. 1A, a non-transmission method in which an eyepiece optical system 12 is provided between the human eye 13 and the image forming device 11, or as shown in FIG. 1B. By arranging the half mirror 19 between the image forming apparatus 16 and the eyepiece optical system 17 as described above, an outside scene (an outside scene entering the human field of view when there is no obstacle) is projected onto the human eye 18. There is a transmission method (optical see-through method) configured as described above. The image forming apparatus is an apparatus that reproduces an image based on an input video signal (image data, video data) or the like. In this example, the image forming apparatus is, for example, a liquid crystal display (LCD) or an organic EL display. The video signal includes data for reproducing a still image and a moving image.

  However, the two display systems shown in FIGS. 1A and 1B are merely examples of basic systems. Many other schemes using various optical paths and projection patterns are conceivable in order to satisfy the structural limitations and other requirements of the display device. In addition, transmissive liquid crystal displays have been developed, and the display system of the present invention can be applied to these configurations and all variations proposed in the future.

  Here, in the display device, video information (light, etc.) for finally causing the human eye to perceive the image from the image forming device that receives the video signal for displaying the image and forms the image. Are collectively referred to as “image display device” or “image display means” (for example, the image display device 10 shown in FIG. 1A and the image display device 15 shown in FIG. 1B).

  Furthermore, the image display device of the display device of the present invention can include a variety of projection types. For example, a retinal projection method in which video information is emitted toward the user's eyeball is included in addition to a virtual image projection method in which the user views a video displayed near or in contact with the user's eye. In the present specification, an apparatus that can provide a left-eye image to the user's left eye and a right-eye image to the user's right eye by such a retinal projection method is also referred to as an image display device.

  The display device of the present invention generally has a configuration in which a display image for the left eye and a display image for the right eye are individually provided to the left eye and the right eye of the user by two independent image forming devices, respectively. However, a method of distributing video information from one image forming apparatus into a left-eye display image and a right-eye display image temporally or spatially by a shutter method or a polarization filter method is also included.

  FIG. 1C is a flowchart showing a rough flow of the display adjustment method of the present invention. As shown in FIG. 1C, the adjustment of the display is configured by three adjustment steps. First, in step S10, in accordance with a user instruction, first calibration is performed to adjust the vertical and vertical shifts and rotation shifts in the left-eye display image and the right-eye display image. Next, in step S12, in accordance with the user's instruction, second calibration is performed to adjust the sense of distance between the objects displayed in the left-eye display image and the right-eye display image. Finally, in step S14, a third calibration for adjusting the left / right shift between the left-eye display image and the right-eye display image is performed in accordance with a user instruction. However, the rotation here refers to a rotation about an axis substantially parallel to the user's eye axis or visual axis.

  Here, of the three adjustment steps, the first calibration is indispensable for adjusting the display device because many of the shifts in the display device are vertical and vertical shifts and rotational shifts. On the other hand, the second calibration and the third calibration are arbitrary. These can be selectively performed, for example, the first calibration and the second calibration can be performed, or the first calibration and the third calibration can be performed. . Note that the second calibration can be performed after the third calibration.

  In the present specification, the vertical (vertical direction) relating to the displacement of the display image is perpendicular to the direction of the base line connecting the eyes of the user (the user base length direction) and perpendicular to the user's eye axis or visual axis. Direction. Moreover, right and left (horizontal direction) is a user baseline length direction. Here, the vertical direction and the horizontal direction indicate rough directions, and do not mean directions in a strict sense toward one point.

  Next, the check pattern and the display position of the check pattern in the display system according to the first embodiment of the present invention will be described. Hereinafter, an HMD will be described as an example of the display device, but the display device of the display system of the present invention is not limited to such an HMD.

  FIG. 2 shows an example of a graphic displayed in the first calibration in the first embodiment of the present invention. FIG. 2A shows a glasses-type HMD 20 used in the display system according to the first embodiment of the present invention. The user usually wears the HMD 20 on the head (face) in the same manner as wearing glasses. The HMD 20 is provided with a left-eye display device 21 that is an image display device for displaying a left-eye display image on the left eye, and is positioned in front of the user's left eye when worn. Similarly, the HMD 20 is provided with a right-eye display device 22 that is an image display device for displaying a right-eye display image on the right eye, and is positioned in front of the user's right eye when worn.

  2B illustrates a left-eye display image 21a displayed on the left-eye display device 21 and a right-eye display image 22a displayed on the right-eye display device 22. In the central portion of the left-eye display image 21a, a graphic 23 composed of two substantially parallel straight lines, which is one of the check patterns according to the first embodiment of the present invention, is displayed. A special X-shaped figure 24, which is one of the check patterns according to the first embodiment of the present invention, is displayed at the center of 22a.

  The lower part of FIG. 2B shows an image perceived in the brain by the user viewing the two figures (figure 23 and figure 24) shown in the upper part of FIG. Such an image is formed into an image enlarged by a lens or the like). As shown in the figure, when the figure 23 and the figure 24 are displayed at appropriate positions, the figure 23 and the figure 24 overlap with each other, and the two arrow vertices of the figure 24 overlap each of the two straight lines of the figure 23 ( Or touch).

  In the first calibration, the vertical shift and rotational shift of the left-eye display image and the right-eye display image are adjusted to appropriate positions. Therefore, when the user views the display image with the HMD 20, the user gives a predetermined instruction so that the perceived image 25 in the lower part of FIG. Here, no adjustment is made for the left-right shift between the left-eye display image and the right-eye display image, and therefore the graphic 23 and the graphic 24 are not configured to detect a horizontal shift.

  FIG. 3 shows an example of a graphic displayed in the second calibration in the first embodiment of the present invention. In FIG. 3A, the left eye display image 41 a is displayed at a predetermined position of the left eye display device 41, and the right eye display image 42 a is displayed at a predetermined position of the right eye display device 42. Here, in the left-eye display image 41a and the right-eye display image 42a, the same figure (41d, 42d) is displayed. When the user views the display image on the HMD 20, the user gives a predetermined instruction so that the two shapes are fused with each other and perceived with a preferable distance feeling or a predetermined distance feeling.

  In FIG. 3A, for example, the figure 41d is arranged at the center of the left-eye display image 41a (or the point 71c at a predetermined distance and direction with the reference point 71b as a reference), and the figure 42d is The eye display image 42a is arranged at the center (or so that the point 72c at a predetermined distance and direction is centered on the reference point 72b). In FIG. 3B, the graphic 51d is arranged from the left of the center of the left-eye display image 51a, and the graphic 52d is arranged from the right of the center of the right-eye display image 52a. In this case, the arrangement of FIG. 3B is perceived as a position farther away from the user than the arrangement of FIG. 3A. The user adjusts the sense of distance by changing the arrangement of the figure in the horizontal direction (baseline length direction of the user's eyes) in the left-eye display image 41a and the right-eye display image 42a.

  In the example of FIG. 3, the sense of distance is adjusted by displaying a figure with the same shape, but the same adjustment is performed using a set of figures having parallax as described later with reference to FIGS. 13 and 14. It can also be done.

  FIG. 4 shows an example of a graphic displayed in the third calibration in the first embodiment of the present invention. In FIG. 4A, the left eye display image 71 a is displayed at a predetermined position of the left eye display device 71, and the right eye display image 72 a is displayed at a predetermined position of the right eye display device 72. Here, a graphic 71d for adjusting the sense of distance shown in FIG. 3 is displayed on the display image 71a for the left eye, and further, a graphic 71e for adjusting the left / right deviation is displayed. On the other hand, the graphic 72d for adjusting the sense of distance shown in FIG. 3 is displayed on the right-eye display image 72a, and further, a graphic 72e for adjusting the left / right deviation is displayed.

  FIG. 4B is an image perceived as a result of the user viewing the left-eye display image 71a and the right-eye display image 72a shown in FIG. 4A. If the display image is displayed at an appropriate position, as shown in FIG. 4B, a figure obtained by binocular fusion of the figure 71d and the figure 72d in FIG. 4A is perceived at the center, and the left-eye display image is displayed around the figure. A graphic 71e displayed on 71a and a graphic 72e displayed on the right-eye display image 72a are perceived.

  Here, when the graphic 71e and the graphic 72e are displayed at appropriate positions, the user overlaps, and the arrow vertices of the graphic 72e appear to overlap (or touch) each of the four corners of the graphic 71e. If it does not look like that, it means that the figure 71e and the figure 72e are not displayed at appropriate positions, but the vertical deviation and the rotational deviation are already adjusted by the first calibration, so that For this, it is only necessary to adjust the left-right shift. Therefore, the user gives a predetermined instruction to adjust the left / right deviation so that the figure 71e and the figure 72e can be viewed in the above-described positional relationship.

  Similar to the example of FIG. 3, parallax images as described later with reference to FIGS. 13 and 14 can be used instead of the graphic 71 d and the graphic 72 d.

  Next, an example of a check pattern that can be used in the display system according to the first embodiment of the present invention will be described. In the present invention, different check patterns are displayed for the left-eye display image and the right-eye display image, and this graphic set (that is, two graphics) is overlapped or touched at any two points in the horizontal direction. Adjusts the image display. Thus, the user can adjust (that is, calibrate, calibrate) the display device such as the HMD. Here, as the displacement between the two figures, the displacement in the up / down / left / right (vertical and horizontal directions) and the rotational displacement are assumed.

  Here, with reference to FIG. 5, a graphic set of several check patterns (a check pattern displayed on the left-eye display image and a check pattern displayed on the right-eye display image) will be considered. The pattern of FIG. 5A is the figure which FIG. 5A (1) displays on the display image for left eyes by 1st calibration, and is a figure which consists of two parallel lines extended in a horizontal direction. FIG. 5A (2) is a figure displayed on the right-eye display image in the first calibration, and is a special-shape figure having four arrow-shaped protrusions (the left-eye display image figure and the right-side figure). The figure of the display image for the eye can be appropriately replaced (the same applies to the following patterns).

  This graphic set has a shape different from each other when overlapping is performed without vertical displacement and rotational displacement (for example, the state shown in the lower part of FIG. 2B). Each of the parallel lines is overlapped or touched by two arrowheads having a special shape. In this way, when two figures overlap or touch at least two points (four points in this example) on two parallel lines, the user can at least vertically shift and rotate the left and right display images. It can be judged that there is no deviation. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the first calibration. Although the two points are on the parallel lines, the horizontal position is arbitrary.

  The quadrilateral (substantially square) figure which is the solid line part in FIG. 5A (3) is a figure displayed on the left-eye display image in the third calibration. At this time, the figure of FIG. 5A (2) (shown by a dotted line in FIG. 5A (3)) is displayed in the display image for the right eye.

  When this figure set is overlapped in a state where there is no vertical and horizontal displacement and no rotational displacement (for example, the state shown in FIG. 4B), the shape sets are different from each other, so both eyes are not fused. The vertices of the four corners of the quadrangle overlap with or touch the four arrow tips of the special shape in FIG. 5A (2). In this way, when two figures overlap or touch at least two specific points (in this example, four points), it is understood that there is no vertical and horizontal deviation and rotational deviation, and a 3D video figure is displayed. It can be determined that sometimes appropriate three-dimensional display is performed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the third calibration.

  Further, the figure in FIG. 5A (2) has no line in the center portion, and for example, when the figure displayed by the second calibration is displayed as it is, as shown in FIG. It is configured. However, when the visibility is not taken into consideration or when the second calibration is not performed, a line can be arranged at the center as shown in FIG. 5A (2) '.

  The pattern of FIG. 5B is a figure which FIG. 5B (1) displays on the display image for left eyes by 1st calibration, and is similar to FIG. 5A (1) from two parallel lines extended in a horizontal direction. It is a figure that becomes. FIG. 5B (2) is a graphic displayed on the display image for the right eye in the first calibration, and is a special-shaped graphic having four hook-shaped protrusions.

  This figure set has different shapes when superimposed in the absence of vertical and rotational deviations, so it does not fuse with both eyes, and each of the two parallel lines has a special shape. Two hook-shaped protrusions overlap or touch. In this way, when two figures overlap or touch at least two points (in this case, four hook-shaped protrusions) on two parallel lines, the user can at least vertically display the left and right display images. It can be determined that there is no deviation and no rotational deviation. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the first calibration. Although the two points are on the parallel lines, the horizontal position is arbitrary.

  The rectangular figure which is a solid line part in FIG. 5B (3) is a figure displayed on the left-eye display image in the third calibration. At this time, the figure of FIG. 5B (2) (shown by a dotted line in FIG. 5B (3)) is displayed in the display image for the right eye.

  This figure set has a shape different from each other when superimposed in a state where there is no vertical and horizontal deviation and no rotational deviation, and therefore, the binocular fusion does not occur. Four hook-shaped protrusions having a special shape of 5B (2) overlap or contact each other. In this way, it is understood that there are no vertical and horizontal deviations and rotational deviations when two figures overlap or touch at least at two specific points (in this example, four hook-shaped protrusions). When is displayed, it can be determined that appropriate stereoscopic display is performed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the third calibration.

  Further, the reason why the figure in FIG. 5B (2) is configured so that there is no line in the center is the same reason as in FIG. 5A (2). As shown in FIG. 5B (2) ', a line may be arranged in the central portion.

  As described above, in order to determine that there is no vertical displacement and rotational displacement, it is sufficient that at least overlap or contact at two points is recognized. However, for the sake of visibility, i.e., it is possible to easily determine whether two figures overlap or touch each other. It is preferable that In addition, when a straight line is formed, it is a sufficiently long one, and it is also one of preferred embodiments that the overlapping or contact is visually recognized in a plurality of straight line portions.

  The pattern of FIG. 5C is a figure which FIG. 5C (1) displays on the display image for left eyes by 1st calibration, and consists of two straight lines extended on a straight line in the horizontal direction. FIG. 5C (2) is a figure displayed on the right-eye display image in the first calibration, and is a figure including two Y-shaped figures composed of a linear portion extending in the horizontal direction and a V-shaped shape. .

  This figure set has two different shapes when there is no vertical displacement and no rotational displacement, so there is a low possibility of binocular fusion because there are parts of different shapes. Two straight line portions of the Y-shaped figure (graphics displayed on the right-eye display image) overlap each other (graphics displayed on the left-eye display image). In this way, the two figures overlap at least two points on the two straight lines (in this case, two straight line portions), so that the user can at least vertically shift the left and right display images, and It can be determined that there is no rotational deviation. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the first calibration. The two points are on one straight line extending in the horizontal direction, but the position in the horizontal direction is arbitrary.

  The figure consisting of three orthogonal straight lines, which are solid line parts in FIG. 5C (3), is a figure displayed on the left-eye display image in the third calibration. At this time, the figure of FIG. 5C (2) (indicated by a dotted line in FIG. 5C (3)) is displayed in the display image for the right eye.

  This graphic set has a shape different from each other when superimposed in a state where there is no vertical or horizontal shift and rotational shift, and therefore, the binocular fusion is not performed, and the straight line of the graphic in FIG. A straight line portion extending outward from the intersection (a straight line portion extending to the left side and a straight line portion extending to the right side) and a straight line portion extending in the horizontal direction of the figure in FIG. In this way, it is understood that there are no vertical and horizontal shifts and rotational shifts by overlapping two figures at at least two specific points (in this example, two straight lines), and a 3D video figure is displayed. It can be determined that an appropriate three-dimensional display is performed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the third calibration.

  The figure in FIG. 5C (2) is configured so that there is no line at the center for the same reason as in FIG. 5A (2). If there is no problem of binocular fusion, a line may be arranged at the center as shown in FIG. 5C (2) '.

  The pattern of FIG. 5D is a figure that FIG. 5D (1) displays on the display image for the left eye in the first calibration, and is similar to FIG. 5A (1) from two parallel lines extending in the horizontal direction. It is a figure that becomes. FIG. 5D (2) is a figure displayed on the right-eye display image in the first calibration, and is a rectangular figure whose side length is shorter than the interval between the two parallel lines in FIG. 5A (1). It is.

  This figure set has a shape different from each other when superimposed in the absence of vertical displacement and rotational displacement, so a quadrangle is placed between two parallel lines without binocular fusion. It seems that there is a predetermined interval between the parallel lines and the sides of the quadrangle. In this way, two figures appear to be arranged at equal intervals at positions close to at least two points on two parallel lines (in this case, two upper and lower parts where two figures are close). The user can determine that the left and right display images are free from at least vertical shift and rotational shift. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the first calibration. FIG. 5D (4) shows a state in which the two graphics are equally spaced at the two locations. The positions of the two points in the horizontal direction are arbitrary as described above.

  The octagonal figure which is the solid line part in FIG. 5D (3) is a figure displayed on the display image for the left eye in the third calibration. At this time, the figure of FIG. 5D (2) (shown by a dotted line in FIG. 5D (3)) is displayed in the display image for the right eye.

  This figure set is different from each other in the case of overlapping without vertical and horizontal deviations and rotational deviations, so it does not fuse both eyes, and the four sides of the octagon, Four sides of 5D (2) are arranged with a predetermined interval. As described above, the two figures are arranged at predetermined positions at specific positions (in this example, four places on the top, bottom, left, and right where the sides of the two figures are close to each other), so that they are shifted vertically and horizontally and rotated. It can be determined that there is no shift, and it is determined that an appropriate three-dimensional display is performed when a 3D video figure is displayed.

  More specifically, in the case of a square and regular octagon graphic set, it can be seen that the two graphic sides are suitable by being arranged at equal intervals at four locations that are close to each other. Moreover, if it is a square and a horizontally long octagonal figure set (example in FIG. 5D (3)), the two opposite sides of these two figures are close to each other (that is, a set of specific positions). It turns out that it is appropriate to arrange them at equal intervals. That is, the distance between both sides is equal at two locations where the upper and lower sides of a square and a horizontally long octagon are close to each other, and the distance between both sides is equal at two locations where the left and right sides are close to each other. As is apparent from FIG. 5D (3), in this case, the interval between the upper and lower sides is wider than the interval between the left and right sides.

  Further, for example, if a triangle and a slightly smaller hexagonal figure set that fits in this triangle, at least positions that are close to three specific points that are not in a straight line (in this example, each side of two figures is It can be seen that it is appropriate by appearing to be arranged at equal intervals at three adjacent points.

  By arranging as described above, it can be seen that there is no vertical / horizontal shift and rotational shift, and it can be determined that an appropriate stereoscopic display is performed when a 3D video figure is displayed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed in the third calibration.

  Thus, although the example of the check pattern which can be used in the display system which concerns on the 1st Embodiment of this invention was shown, it is not necessarily limited to these. Various other graphic sets can be employed to effectively adjust the image display. In addition, as a preferable figure set, two figures do not fuse with both eyes (when an appropriate superposition is performed, they can be recognized as completely different shapes).

  When these two figures overlap or touch each other, it is sufficient that overlap or contact is recognized at at least two points. However, as shown in FIGS. 5B and 5C, a certain range (for example, a range such as a straight line portion having an arbitrary length). May overlap or touch. Further, the check pattern graphic displayed on the left-eye display image or the right-eye display image does not have to be connected together as in the image illustrated in FIG. , Points, circles, polygons, and the like.

  In addition, it can be added as a preferable condition that each check pattern can be easily distinguished from the background, and that two check patterns can be easily distinguished from each other. For this reason, it is also possible to set different colors, patterns, and fill patterns for the check pattern graphic sets. The check pattern is normally a still image, but each or one of the check patterns may be a moving image as long as the above conditions are satisfied.

  Furthermore, since there is a figure set that cannot recognize vertical and horizontal deviations and rotational deviations, such figures should not be selected. For example, when one figure overlaps with the other figure and the figure is moved in the up / down / left / right direction, a combination of figures that cannot be visually recognized or a perfect circle that cannot be seen as rotating is a check pattern. Can not be adopted as. As described above, in the first embodiment, vertical, horizontal, and rotational shifts and rotational shifts are targeted for adjustment, and other shifts such as size distortion and keystone distortion are not considered.

  Next, with reference to FIG. 6, a pattern that recognizes that “deviation” has occurred when the user views the check pattern with both eyes will be described. FIG. 6 shows an image formed in the user's brain for convenience. Here, the vertical shift, the rotational shift, and the horizontal shift, which are mainly adjustment targets of the display system according to the first embodiment of the present invention, will be described. Here, an example is shown in which the graphic set shown in FIGS. 5A (1) and 5A (2) or the graphic set shown in FIGS. 5A (3) and 5A (2) is used as a check pattern.

  FIG. 6A shows a state in which the special figure displayed in the right-eye display image is shifted in the vertical direction (the state shifted by dy in the upward direction) with respect to the figure composed of two parallel lines displayed in the left-eye display image. ). FIG. 6B shows a state in which the angle of the special figure displayed on the right-eye display image is different from the figure composed of two parallel lines displayed on the left-eye display image (shifted by an angle θ counterclockwise). State). FIG. 6C shows a state in which the special figure displayed in the right-eye display image is shifted in the horizontal direction (the state shifted by dx in the right direction) with respect to the square figure displayed in the left-eye display image. ing.

  Next, an example of a factor causing the check pattern deviation as described above will be described with reference to FIGS. 7A and 7B.

  FIG. 7A shows an image display device similar to that shown in FIG. 3A and the like. A check pattern 81e is displayed on the left-eye display image 81a displayed on the left-eye display device 81, and a check pattern 82e is displayed on the right-eye display image 82a displayed on the right-eye display device 82. Thus, the check pattern 82e has a rotational deviation as shown in FIG. 6B. In this example, such a rotational shift occurs because the arrangement of the right-eye display device 82 in the display device is shifted (rotated) from an appropriate position.

  In FIG. 7B, a check pattern 91e is displayed on the left-eye display image 91a displayed on the left-eye display device 91, and a right-eye display image 92a displayed on the right-eye display device 92 is A check pattern 92e is displayed. The check pattern 92e has at least a left-right shift as shown in FIG. 6C and a rotation shift as shown in FIG. 6B. In this example, such a shift is appropriate in the arrangement of the right-eye display device 92, but the display (projection) of the right-eye display image 92a in the right-eye display device 92 is, for example, that of an optical device. This is because it is not performed correctly due to a setting failure or the like, and is shifted from an appropriate position.

  Next, an image display adjustment method regarding the left-eye display image or the right-eye display image in the display system according to the first embodiment of the present invention will be described. In the display system of the present invention, when a check pattern is displayed to the user, there is a shift between the check pattern graphic displayed on the left-eye display image and the check pattern graphic displayed on the right-eye display image. Is recognized, at least one of the left-eye display image and the right-eye display image is adjusted according to the user's instruction.

  As a first adjustment method, for at least one of the left-eye display image and the right-eye display image, by changing image data (video data) for performing image display, For example, it is a method of adjusting so that an appropriate 3D image is displayed when a figure of a 3D image is displayed, such as adjusting so that it appears to overlap or touch at least two points (so-called digital approach).

  As a second adjustment method, for example, adjustment is performed such that at least two points overlap or touch each other by changing the position and the arrangement angle of at least one of the left-eye display device and the right-eye display device. This is a method of adjusting so that an appropriate three-dimensional display is displayed when a 3D video figure is displayed (in other words, an analog approach).

  In the first adjustment method, the user operates the panel of the display device or the input device of the adjustment control device to adjust the image display of the left and right graphic sets. More specifically, the image data is changed so as to eliminate (cancel) the deviation. For example, in the case of a horizontal shift, each pixel of the image data is moved in the horizontal direction (reverse direction). If the rotation is shifted, each pixel of the image data is moved so as to rotate the image data in the opposite direction, and if the size is small, each pixel of the image data is converted so that it is displayed in a large size.

  The adjustment method (image data changing method) set in this way is stored as necessary, and is subsequently called appropriately when the display device is used, and according to the stored adjustment method. Input image data is converted. When moving image data is reproduced, the stored adjustment method is applied to image data of all frames.

  In the second adjustment method, the user operates the operation panel of the display device or the input device of the adjustment control device to adjust the image display of the left and right graphic sets. This adjustment is performed by moving a part or the whole of the image display device arranged so as to be movable according to a user instruction. Such movement is performed via an operation panel or an input device of the adjustment control device. The user's instruction inputted in this way is transmitted to, for example, a displacement device, an ultrasonic motor, etc., and the position and arrangement direction of a part or the whole of the image display device (for example, the image forming device and the lens) are changed.

  In addition, when the image display device is arranged so as to be movable with a screw or the like, the user can change the position and arrangement direction of the image display device by turning the screw while looking at the left and right graphic sets. it can. As shown in FIG. 1, the image display device includes an image forming device and an optical device such as a lens. However, when these are individually moved, distortion or the like may occur. It is preferable to move as a whole while maintaining the relative positional relationship.

  The second adjustment method has two separate image display devices (image forming devices) and is suitable for use with a display device that does not come into contact with the user's eyes.

  Note that the essence of the present invention is that the check pattern has an adjusting means that is oriented so that the two figures appear to satisfy a predetermined condition, and as a result, for some reason. Even if the two figures cannot be placed exactly at the ideal location, such a system does not depart from the scope of the present invention.

  Here, considering that the image display is adjusted for the check pattern shift as shown in FIG. 7A, for example, in the first adjustment method, the physical movement of the right-eye display device 82 is involved. Without the operation, the user gives an instruction on the operation panel or the like, changes the image data so that the right-eye display image 82a is rotated to the right as a whole, rotates the check pattern 82e to the right, and the deviation from the check pattern 81e. This figure set can be arranged at a desired position. On the other hand, in the second adjustment method, the user gives an instruction on the operation panel or the like to physically rotate the right-eye display device 82 to the right, and as a result, the two graphic sets can be arranged at desired positions.

  Although the first adjustment method and the second adjustment method have been described above, the first adjustment method and the second adjustment method can be combined and applied to check pattern deviation. For example, the right rotation of the check pattern 82e is handled by the physical rotation of the right-eye display device 82 until the rotation of a certain angle (second adjustment method), and the rotation of the remaining angles is displayed for the right eye. The image data of the image 82a is changed and rotated to the right (first adjustment method). Further, when there is a left / right shift in the graphic set, and the display device includes a slide switch for roughly adjusting the lens interval, the display image is roughly adjusted by the slide switch, and then the first With this adjustment method, it is possible to finely adjust the left and right positions.

  Next, with reference to FIG. 7C, the image display adjustment method will be further described. Up to now, as shown in FIG. 7A, one of the left and right, for example, a change in the position and arrangement direction of the right-eye display device 82 and a change in the image data of the right-eye display image 82a can be detected. However, it is possible to adjust the image display by simultaneously changing the left and right image display devices and display images.

  For example, as shown in FIG. 7C, when the vertical image shift between the check pattern 101e and the check pattern 102e is dy in an image formed by the user in the brain, the display device for the right eye or the display image for the right eye With this change, the display position of the two graphic sets can be adjusted by moving the check pattern 101e upward. However, in addition to such an adjustment method, the display device for the left eye or the display image for the left eye is changed and the change of the display device for the right eye or the display image for the right eye is instructed, that is, the check pattern 101e. Is moved upward by dy2, and the check pattern 102e is moved downward by dy1 so that the display positions of the two graphic sets can be adjusted.

  In this way, it is also possible to adjust the image display by moving the left and right check patterns (that is, a graphic set made up of two graphics) to each other. However, since 3D images need to display the left and right images at the correct angles, etc., it is preferable to adjust the left and right check patterns to each other if rotation deviation or keystone distortion occurs. Sometimes not.

  Next, the configuration of the display system and the operation panel according to the first embodiment of the present invention will be described with reference to FIG. FIG. 8A shows an outline of the configuration of the display system 110 that adjusts the image display by the first adjustment method described above. As illustrated, the display system 110 includes an HMD 111 that is a display device, and an HMD controller 112 that is connected to the HMD 111 with a cable or the like. The HMD controller 112 receives image data for displaying 3D video from the content providing apparatus, performs processing necessary to display the image data on the HMD 111, and transmits the image data to the HMD 111.

  FIG. 8B shows an example of the operation panel 120 arranged on the HMD 111. The user of the HMD 111 operates the operation panel 120 with his / her hand while viewing the check pattern displayed on the image display device of the HMD 111 with the HMD 111 attached, so that the two figures can be seen in a predetermined positional relationship. Adjust the display. The operation panel 120 is provided at the bottom of the image display device of the HMD 111, for example. In this example, the operation panel 120 is provided with an adjustment start button 121, an adjustment OK button 122, a left image / right image selection switch 123, an up / down / left / right adjustment button 124, and a left / right rotation adjustment button 125.

  When the user presses the adjustment start button 121, the adjustment of the HMD 111 is started, and a check pattern is displayed on the left-eye display image and the right-eye display image. Further, when the user presses the adjustment OK button 122, the current calibration operation is terminated, and the next calibration is performed. For example, when the first calibration is completed, the second calibration is displayed on the image display device of the HMD 111 by pressing the adjustment OK button 122. For example, when the adjustment OK button 122 is pressed and held, the second and third calibrations are skipped and the adjustment process is terminated.

  When the user selects a left image with the left image / right image selection switch 123, the image display content of the left-eye display image is vertically, horizontally, and horizontally by pressing a vertical and horizontal adjustment button 124 or a horizontal rotation adjustment button 125. To change. While watching the check pattern, the user repeatedly presses the button and makes adjustments until the figures respectively displayed on the left and right display images can be seen in a predetermined positional relationship.

  FIG. 8C shows a functional block diagram of the display system 130. The display system 130 corresponds to the display system 110 shown in FIG. 8A. The display system 130 includes an HMD 131 and an HMD controller 132, and the HMD 131 includes a user instruction receiving unit 131a and an image display unit 131b. The HMD controller 132 includes an image display adjustment unit 132a and a display control unit 132b, and further includes an adjustment parameter storage unit 132c that stores adjustment parameters.

  The instruction from the user is provided from the HMD 131 to the HMD controller 132 by the user instruction receiving unit 131a that receives the operation content of the operation panel 120 as shown in FIG. 8B. The user instruction can be directly input to the HMD controller 132 by providing the operation panel 120 in the HMD controller 132 or can be input via another device. The image display unit 131b receives image data for displaying an image from the HMD controller 132, outputs an image to the image forming apparatus based on the image data, and finally provides the user with an image display.

  The image display adjustment unit 132a starts image display adjustment in accordance with a user instruction from the HMD 131, generates image data to display a check pattern on the left-eye display image and the right-eye display image, and the display control unit 132b. Send to. The image data is transmitted to the image display unit 131b of the HMD 131 by the display control unit 132b, where a check pattern is provided to the user.

  Thereafter, the user adjusts the position of the check pattern by giving an instruction, and the image data of the adjusted check pattern is transmitted to the display control unit 132b. For example, the user gives an instruction on the operation panel 120 and moves or rotates one or both of the check pattern of the left-eye display image and the right-eye display image up and down, left and right, or two figures are desired. Adjust the image display so that it is displayed at the position. The adjustment contents such as the movement width and the movement direction are stored as adjustment parameters in the adjustment parameter storage unit 132c. At this time, the adjustment parameter can be stored in various storage formats such as a database and a flat file. Further, a plurality of adjustment parameters may be stored for each user, each content, and each content type, for example.

  The display control unit 132b transmits the check pattern transmitted from the image display adjustment unit 132a to the image display unit 131b of the HMD 131 at the stage of image display adjustment, and the content transmission unit of the content providing apparatus 133 at the stage of content reproduction. The image data of the content transmitted from 133a is received, and each image data is changed at any time based on the adjustment parameter acquired from the adjustment parameter storage unit 132c (for example, moved up, down, left, and right according to the user's instruction, and rotated. After that, the changed image data is transmitted to the image display unit 131b of the HMD 131. The content provided from the content providing device 133 includes various 3D video content including 3D movies and 3D games.

  In the display system according to the first embodiment of the present invention, normally, immediately after the user adjusts the image display, the display device is mounted as it is and the content is played back (stored in the adjustment parameter storage unit 132c at this time). It is assumed that the image data of the content is changed using the adjustment parameters. However, after the user adjusts the image display, the display device can be mounted several hours or days later, and the previously stored adjustment parameters can be read and the content can be reproduced (at this time, read out). The image data of the content is changed using the adjusted parameters as they are). Further, when the user adjusts the image display, the adjustment parameters stored by the previous adjustment can be read out, and further adjustment of the image display can be started based on this. When adjustment parameters of a plurality of patterns are stored, it is necessary to provide a button for instructing which pattern of adjustment parameters to use on the operation panel 120.

  Various forms are conceivable for the display system of the present invention that adjusts the image display by the first adjustment method. For example, the display system as shown in FIG. 8 adjusts the image display by the user and the image display using the check pattern by the display device (HMD 111) and the controller (HMD controller 112) which is an accessory device of the display device. Display control during adjustment and content playback. The display system shown in FIG. 9 to be described later realizes the above function by an adjustment control device configured by a computer such as a PC in addition to the display device and the controller.

  In addition, there are various configurations such as a configuration in which the above function (adjustment / display control) is realized by using only the display device or the display device and the adjustment control device. It is also possible to incorporate the functions relating to the adjustment / display control of the present invention into the content providing apparatus, and to configure the adjustment control apparatus and the content providing apparatus in an integrated manner. In addition, the controller can be integrated by incorporating the functions relating to the adjustment / display control of the present invention, and the controller, the adjustment control device, and the content providing device can be configured integrally.

  Further, a configuration in which the display device is excluded from the above display system can be considered, and this will be referred to as a display adjustment system. For example, when you already have a display device (e.g., HMD), you can purchase only a display adjustment system to make effective display device adjustments. Such a merit is particularly remarkable when the display device has a configuration as shown in FIG. 9 described later, that is, a configuration in which the display device does not receive an instruction from the user.

  Similar to the above display system, such a display adjustment system can also be configured by integrating the adjustment control device and the content providing device by incorporating the function relating to the adjustment / display control of the present invention into the content providing device. In addition, the controller can be integrated by incorporating the functions relating to the adjustment / display control of the present invention, and the controller, the adjustment control device, and the content providing device can be configured integrally.

  FIG. 9 shows a modification of the display system according to the first embodiment of the present invention in which the image display is adjusted by the first adjustment method. FIG. 9A shows an outline of the configuration of the display system 150. As illustrated, the display system 150 includes an HMD 151 that is a display device, an HMD controller 152 connected to the HMD 151 with a cable, and an adjustment control device 153 connected to the HMD controller 152 with a cable. The adjustment control device 153 receives the image data for displaying the 3D video from the content providing device, transmits it to the HMD controller 152, and also adjusts the image display based on an instruction from the user.

  FIG. 9B shows an example of a user instruction input screen 160 displayed on the display device of the adjustment control device 153. The user of the HMD 151 wears the HMD 151 and presses a key or the like according to the user instruction input screen 160 while looking at the check pattern displayed on the image display device of the HMD 151 so that the check pattern can be seen in a predetermined positional relationship. Adjust the image display. In this case, the user of the HMD 151 needs to look at the check pattern displayed on the image display device of the HMD 151 and to view the user instruction input screen 160 displayed on the display device of the adjustment control device 153. A transmissive HMD that can see the environment is desirable. However, even if it is not a transmissive HMD, it is possible to make adjustments by storing the position of the key to be pressed in advance or by letting a third party press the key by conveying the check pattern matching status. it can.

  On the user instruction input screen 160, for example, a left image / right image selection area 161, a display image adjustment guide area 162, an adjustment start button 163, and an adjustment OK button 164 are displayed. The display image adjustment guide area 162 displays guide information indicating which key is used to perform the vertical and horizontal adjustments, the left rotation adjustment, and the right rotation adjustment. The display portion may be adjusted by clicking with a mouse or the like. The user instructs adjustment of the display image by pressing keys corresponding to these on the keyboard of the adjustment control device 153. By pressing the key once, the image display changes by a certain movement width (or fluctuation due to rotation). While watching the check pattern, the user repeatedly presses the corresponding key to adjust the display positions of the left and right check patterns.

  When the user presses the adjustment start button 163, the adjustment of the HMD 171 is started, and a check pattern is displayed on the left-eye display image and the right-eye display image. Further, when the user presses the adjustment OK button 164, the current calibration operation is terminated, and the next calibration is performed. If the adjustment OK button 164 is pressed and held, the second and third calibrations are skipped and the adjustment process is terminated.

  FIG. 9C shows a functional block diagram of the display system 170. The display system 170 corresponds to the display system 150 shown in FIG. 9A. The display system 170 includes an HMD 171, an HMD controller 172, and an adjustment control device 173. Here, the HMD 171 includes an image display unit 171a, and the HMD controller 172 includes a display control unit 172a. The adjustment control device 173 includes an image display adjustment unit 173a and a display control unit 173b, and further includes an adjustment parameter storage unit 173c that stores adjustment parameters.

  The image display adjustment unit 173a of the adjustment control device 173 receives a user instruction, adjusts the position of the check pattern based on this instruction, and transmits the image data of the adjusted check pattern to the display control unit 173b. The content of the adjustment is stored in the adjustment parameter storage unit 173c as an adjustment parameter.

  The display control unit 173b transmits the check pattern transmitted from the image display adjustment unit 173a to the display control unit 172a of the HMD controller 172 at the stage of image display adjustment, and the content of the content providing apparatus 174 at the stage of content playback. The image data of the content transmitted from the transmission unit 174a is received, and each image data is changed as needed based on the adjustment parameters acquired from the adjustment parameter storage unit 173c (for example, moved up, down, left, and right as instructed by the user) Then, the changed image data is transmitted to the display control unit 172a of the HMD controller 172. The display control unit 172a of the HMD controller 172 performs processing necessary for displaying the received image data on the image display unit 171a of the HMD 171 and transmits the processed image data to the HMD 171.

  8C and 9C, when the user adjusts image display, adjustment parameters are stored in an external storage device or the like so that they can be reused. However, the user uses the display device. The image display may be adjusted each time, and the adjustment parameter obtained at that time may be used only for content reproduction at that time and discarded after use of the display device.

  Next, with reference to the flowchart of FIG. 10, what kind of processing is performed in each device in the display system 170 having the configuration shown in FIG. 9 will be described. In FIG. 10, the HMD 171, the HMD controller 172, and the adjustment control device 173 indicate what processing is performed in what order.

  First, in step S20, display image adjustment processing (first calibration) is started by a user operation on the adjustment control device 173. Then, in adjustment control device 173, user instruction input screen 160 is displayed in step S22. Next, in step S24, the adjustment control device 173 checks whether adjustment parameters are already stored in the adjustment parameter storage unit 173c.

  If adjustment parameters are stored (YES in step S24), in step S26, the position and direction of the check pattern displayed on the left and right display images are changed by the adjustment parameters. If the adjustment parameter is not stored, the process proceeds to step S28 as it is. In step S28, the image display image data including the check pattern is transmitted to the HMD controller 172, and the process proceeds to step S30. In this example, when the adjustment of the image display is started, the adjustment parameter (that is, the adjustment parameter stored by the past adjustment) is used. A new adjustment may be performed for each adjustment.

  In step S <b> 30, the HMD controller 172 performs processing such as conversion of the received image data for HMD output as necessary, and transmits the processed image data to the HMD 171. In step S32, the HMD 171 displays a check pattern on the image display unit 171a based on the received image data.

  Thereafter, in step S34, the adjustment control device 173 checks whether the adjustment OK button has been pressed from the user of the HMD 171 via the user instruction input screen 160. If the adjustment OK button has not been pressed (NO in step S34), the process proceeds to step S36, where a check pattern adjustment instruction is received from the user of the HMD 171 via the user instruction input screen 160, and is received in step S38. Based on the adjustment instruction, the display image is changed so as to change the position of the check pattern, the generated image data is transmitted to the HMD controller 172, and the processing in step S30 is repeated.

  As described above, when the user of the HMD 171 performs the adjustment, the fine adjustment loop of steps S30 to S38 is repeatedly executed. If the adjustment OK button has been pressed (YES in step S34), that is, if the desired adjustment has been completed for the display positions of the two figures, or the user who understands the adjustment content has pressed the adjustment OK button, in step S40. It is checked whether there is a next adjustment step. For example, when there is a next adjustment step such as the second calibration or the third calibration (YES in step S40), a check pattern corresponding to the next adjustment step is prepared in step S42, and the image data is stored. Transmit to the HMD controller 172.

  When there is a next adjustment step (NO in step S40), image data for displaying a sign of completion of adjustment is generated and transmitted to the HMD controller 172. In step S46, the transmitted image data is subjected to processing such as conversion of the received image data for HMD output, if necessary, and transmitted to the HMD 171. In step S48, the HMD 171 displays a sign indicating that the adjustment has been completed on the image display unit 171a based on the received image data.

  Further, when there is a next adjustment step (NO in step S40), the adjustment control device 173 stores the adjustment content at this time in the adjustment parameter storage unit 173c as new adjustment content in step S44.

  Next, a configuration of still another display system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 11A shows a functional block diagram relating to the display system 190 shown in FIG. 8, which can also adjust the image display by the second adjustment method in the display system that performs the first adjustment method.

  The display system 190 includes an HMD 191 and an HMD controller 192, and the HMD 191 includes a user instruction receiving unit 191a, an image display unit 191b, and an image display adjustment unit 191c. The HMD controller 192 includes an image display adjustment unit 192a and a display control unit 192b, and further includes an adjustment parameter storage unit 192c that stores adjustment parameters.

  The image display adjustment unit 192a starts image display adjustment by a user operation (for example, pressing an adjustment start button on the operation panel with the HMD 191), and displays a check pattern on the left-eye display image and the right-eye display image. The image data is generated and transmitted to the display control unit 192b. The image data is transmitted to the image display unit 191b of the HMD 191 where a check pattern is provided to the user. Here, the first adjustment method is not used, and the adjustment is performed only by the second adjustment method. The adjustment start instruction by the user may be transmitted to the HMD controller 192 via the user instruction receiving unit 191a of the HMD 191 as described above, or may be directly input to the HMD controller 192.

  When image display adjustment is performed by the second adjustment method, the image display adjustment unit 191c of the HMD 191 changes the position and direction of the image display unit 191b itself according to an operation from the user. The image display unit 191b including an image forming apparatus, a combination of the image forming apparatus and an optical device, or the like is disposed so that the position and direction of the display apparatus can be changed. The image display adjustment unit 191c is a mechanical element such as a screw, a rotary dial lever, or a toggle mechanism that is physically connected to the image display unit 191b. The position and direction of the image display unit 191b connected to these mechanical elements are changed by a user's operation of the mechanical elements such as turning a screw, and thereby two figures are displayed at desired positions. The image display is adjusted so that

  Thus, since the position and direction of the image display unit 191b are changed by the mechanical element, basically, the position and direction of the image display unit 191b are held as they are after the change. Therefore, when the display system 190 supports only the second adjustment method, the adjustment parameter storage unit 192c is not necessary.

  FIG. 11B shows a functional block diagram related to the display system 200 that can also adjust the image display by the second adjustment method in the display system that performs the first adjustment method shown in FIG. 9.

  The display system 200 includes an HMD 201, an HMD controller 202, and an adjustment control device 203. The HMD 201 includes an image display unit 201a and an image display adjustment unit 201b. The HMD controller 202 includes a display control unit 202a, and the adjustment control device 203 further includes an image display adjustment unit 203a, a display control unit 203b, and an adjustment parameter storage unit 203c that stores adjustment parameters.

  The image display adjustment unit 203a starts image display adjustment according to a user instruction, generates image data to display a check pattern on the left-eye display image and the right-eye display image, and transmits the image data to the display control unit 203b. The image data is transmitted to the image display unit 201a of the HMD 201 via the HMD controller 202, where a check pattern is provided to the user. Here, the first adjustment method is not used, and the adjustment is performed only by the second adjustment method.

  When image display adjustment is performed by the second adjustment method, the image display adjustment unit 203a of the adjustment control device 203 changes the position and direction of the image display unit 201a itself in accordance with an instruction from the user. An image display unit 201a including an image forming apparatus or a combination of an image forming apparatus and an optical device is arranged so that the position and direction of the display apparatus can be changed. The image display adjustment unit 201b is a mechanical element such as a displacement device or an ultrasonic motor that is physically connected to the image display unit 201a, and a signal from the image display adjustment unit 203a based on a user instruction. The operation is controlled by. By controlling these mechanical elements, the position and direction of the image display unit 201a are changed, and thereby the image display is adjusted so that two figures are displayed at desired positions.

  Thus, since the position and direction of the image display unit 201a are changed by the mechanical element, basically, the position and direction of the image display unit 201a are held as they are after the change. Therefore, when the display system 200 supports only the second adjustment method, the adjustment parameter storage unit 203c is not necessary. However, since it is possible to grasp the control content (for example, instruction information and displacement information for mechanical elements) for the image display adjustment unit 201b, it is stored in the adjustment parameter storage unit 203c as an adjustment parameter. Can do.

  Next, a display system according to the second embodiment of the present invention will be described. This display system uses the same figure set to try to adjust the vertical and horizontal shifts, rotation shifts, and other shifts such as size distortion and keystone distortion between the left eye display image and the right eye display image. Thus, unlike the first embodiment, a plurality of calibration steps as shown in FIG. 1C are not performed.

  FIG. 12A shows a glasses-type HMD 320 used in the display system according to the second embodiment of the present invention, which is the same as the HMD shown in FIG. 2A. 12B illustrates a left-eye display image 321a displayed on the left-eye display device 321 and a right-eye display image 322a displayed on the right-eye display device 322. A substantially square graphic 323 is displayed at the center of the left-eye display image 321a, and a special-shaped graphic 324 is displayed at the center of the right-eye display image 322a.

  The lower part of FIG. 12B shows an image perceived by the user who views the two figures (figure 323 and figure 324) shown in the upper part of FIG. As shown in the figure, when the figure 323 and the figure 324 are displayed at appropriate positions, they overlap each other so that the arrow-shaped protrusion vertex of the figure 324 coincides with each of the four corners of the figure 323. Looks like.

  Here, with reference to FIG. 13 and FIG. 14A, the situation where the photographed 3D video is displayed will be described. In FIG. 13, a left-eye display image is captured by the left camera 332L, and a right-eye display image is captured by the right camera 332R. The left camera 332L and the right camera 332R are arranged at an interval of the base line length b, and their optical axes intersect on the convergence plane 331. In this situation, the visual target 330 at the optical axis intersection is photographed by the left camera L and the right camera R, respectively.

  FIG. 14A shows a situation in which a 3D video imaged in the above situation is displayed. The left-eye display image 341a (taken by the left camera 332L) is displayed at a predetermined position on the left-eye display device 341. Image) is displayed, and a right-eye display image 342a (an image captured by the right camera 332R) is displayed at a predetermined position of the right-eye display device 342. Here, the object corresponding to the visual target 330 is displayed as a graphic 341d in the display image 341a for the left eye, and is displayed as a graphic 342d in the display image 342a for the right eye. The video captured in 3D is perceived as a three-dimensional video when the user views it due to the parallax between the graphic 341d and the graphic 342d.

  As described above, the graphic 341d and the graphic 342d display the visual target 330 at the intersection of the optical axes of the two cameras, and the left-eye display image and the right-eye display image are displayed at appropriate positions. For example, the user perceives this figure (object) as being at a position of zero depth. Here, the appropriate position can be the “center” of each image display device. For example, for the display image 341a for the left eye, the center of the figure 341d is a predetermined value with reference to the reference point 341b. It can also arrange | position so that it may become the point 341c in a distance and a direction. Similarly, the display image 342a for the right eye is arranged so that the center of the graphic 342d is a point 342c at a predetermined distance and direction with the reference point 342b as a reference. That is, the graphic representing the visual target 330 needs to be arranged at corresponding positions in the left-eye display image 341a and the right-eye display image 342a.

  The check pattern used in the present invention can be controlled so that, for example, in the display of 3D video as described above, the target at the intersection of the optical axes of the camera is displayed at the point to be displayed. By arranging the check patterns at such corresponding positions (positions where the parallax should be zero), the user can determine whether the two check patterns match, and as a result, favorable adjustment for image display It can be performed.

  FIG. 14B is an example in which check patterns used in the display system of the present invention are displayed on the left-eye display device 351 and the right-eye display device 352, respectively. In the left-eye display device 351, the center of the check pattern 351e is arranged to be a point 351c at a predetermined distance and direction with reference to the reference point 351b of the left-eye display image 351a. In the right-eye display device 352, the center of the check pattern 352e that is different from the check pattern 351e and does not fuse both eyes is at a predetermined distance and direction with reference to the reference point 352b of the right-eye display image 352a. It arrange | positions so that it may become the point 352c.

  Next, an example of a check pattern that can be used will be described with reference to FIG. First, in FIG. 15A (1), the figure displayed on the left-eye display image is a quadrangle (substantially square) figure, and the figure displayed on the right-eye display image has four arrow-shaped protrusions. A figure with a special shape (the figure of the display image for the left eye and the figure of the display image for the right eye can be interchanged as appropriate. The same applies to the following patterns).

  This figure set, when appropriately overlaid (for example, in the state shown in the lower part of FIG. 12B), has a shape different from each other, so it does not fuse both eyes, and has a quadrangular vertex and a special shape. The four arrow tips overlap or touch each other. Thus, when two figures overlap or touch at least at three specific points (4 points in this example), it is understood that there is no deviation between the left and right display images, and when a 3D video figure is displayed. It can be determined that appropriate three-dimensional display is performed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed.

  In FIG. 15A (2), the left half of the figure displayed on the right-eye display image is completely identical to the left half of the figure displayed on the left-eye display image, as compared to the figure set of FIG. 15A (1). The shape is like this.

  In FIG. 15B (1), the graphic displayed on the left-eye display image is a square, and the graphic displayed on the right-eye display image is a regular octagon. Since this figure set has different shapes from each other when appropriate overlaying is performed, both eyes are not fused, and a part of the four sides of the square and the four sides of the octagon overlap or contact each other. In this way, it is understood that there is no deviation in the left and right display images by overlapping or touching two figures at at least three specific points (in this example, four straight lines), and a 3D video figure is displayed. It can be determined that sometimes appropriate three-dimensional display is performed. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed.

  In FIG. 15B (2), the figure displayed on the left-eye display image is a triangle (substantially equilateral triangle) figure, and the figure displayed on the right-eye display image is a figure composed of lines extending in three directions from the center. is there. This figure set has different shapes when properly overlaid, so it does not fuse both eyes, and the three corners of the triangle overlap with the three ends of the line. Or touch. As described above, when two figures overlap or touch at least three specific points, it is understood that there is no deviation between the left and right display images, and an appropriate three-dimensional display is displayed when a 3D video figure is displayed. It can be judged. Therefore, the user adjusts the image display so that it looks like this when the left and right display images are viewed.

  In FIG. 15C, the graphic displayed on the left-eye display image is a square, and the graphic displayed on the right-eye display image is a square that is slightly smaller than the square of the left-eye display image. Since this figure set has different shapes from each other when appropriate overlaying is performed, the two eyes are not fused, and the four sides of the left eye display image and the four squares of the right eye display image are displayed. One side is arranged at a predetermined interval. In this way, two figures are arranged at equal intervals over the entire length of the adjacent portions at specific positions (in this example, four places on the top, bottom, left, and right where the sides of the two figures are close to each other). It can be determined that there is no shift in the displayed image, and that appropriate 3D display is performed when a 3D video figure is displayed. The user adjusts the image display so that it looks like this when the left and right display images are viewed.

  Further, if the figure displayed on the left-eye display image is a square and the figure displayed on the right-eye display image is a horizontally long rectangle, the two opposing sides of the two figures are close to each other (that is, It can be seen that it is appropriate to arrange them at equal intervals in a specific set of positions). That is, the distance between both sides is equal at two locations where the upper and lower sides of a square and a horizontally long rectangle are close to each other, and the distance between both sides is equal at two locations where the left and right sides are close to each other. In this case, the interval between the upper and lower sides is wider than the interval between the left and right sides.

  Further, for example, if a triangle and a slightly smaller hexagonal figure set that fits in this triangle, at least positions that are close to three specific points that are not in a straight line (in this example, each side of two figures is It can be seen that it is appropriate by appearing to be arranged at equal intervals at three adjacent points.

  As described above, examples of check patterns that can be used in the display system according to the second embodiment of the present invention have been described, but the present invention is not limited to these. Various other graphic sets can be employed to effectively adjust the image display. In addition, as a preferable figure set, it is a condition that both eyes are not fused (can be recognized as completely different shapes when appropriate superposition is performed). When it is confirmed that there is no deviation by visually checking the overlap or contact of two figures, the two figures should overlap or touch at least three points that are not on a straight line (appropriate overlay is performed). In this case, if there is no overlap or contact at two points or three points on a straight line, rotation about a straight line passing through these two points or three points cannot be recognized.

  In addition, it can be added as a condition that each check pattern can be easily distinguished from the background, and that two check patterns can be easily distinguished from each other. For this reason, it is also possible to set the check pattern graphic set in consideration of the color, pattern, and fill pattern. The check pattern is normally a still image, but each or one of the check patterns may be a moving image as long as the above conditions are satisfied.

  Next, with reference to FIG. 16, a typical pattern that recognizes that “deviation” has occurred when the user views the check pattern with both eyes will be described. FIG. 16 shows an image formed in the user's brain for convenience. Many of what the user actually recognizes will eventually be the deviations shown in FIG. 16, deviations similar to these, and combinations of these deviations. Here, an example is shown in which the figure set in FIG. 15A (1) is used as a check pattern.

  FIG. 16A (1) shows a state in which the special figure displayed in the right eye display image is shifted in the horizontal direction (left direction or right direction) with respect to the square figure displayed in the left eye display image. . FIG. 16A (2) shows a state in which the special figure displayed on the right eye display image is shifted in the vertical direction (upward or downward) with respect to the square figure displayed on the left eye display image. ing.

  FIG. 16B (1) shows a state in which the angle of the special figure displayed on the right eye display image is different from the square figure displayed on the left eye display image. FIG. 16B (2) shows a state in which the size of the special graphic displayed on the right-eye display image is different from the square graphic displayed on the left-eye display image.

  FIG. 16C (1) shows a state in which horizontal keystone distortion occurs in a quadrilateral graphic displayed on the left-eye display image and a special graphic displayed on the right-eye display image. FIG. 16C (2) shows a state in which vertical keystone distortion occurs in the quadrangular figure displayed on the left-eye display image and the special figure displayed on the right-eye display image.

  As described above, in the first embodiment, the shift between the left-eye display image and the right-eye display image is to be adjusted with respect to the vertical and horizontal shifts and the rotational shifts. In the second embodiment, it is assumed that the rotation axis is an axis that is substantially horizontal to the eye axis and the visual axis. However, in the second embodiment, it includes a shift due to rotation by the rotation axis in all directions. The distortion is also taken into account. However, the adjustment method for adjusting the deviation and the configuration of the display system are basically the same as those in the first embodiment.

  However, in the first adjustment method described above, it is assumed that each pixel of the image data is changed using, for example, affine transformation in consideration of the possibility of a size shift or keystone distortion. In the second adjustment method, the image display device is moved not only in the vertical and horizontal directions but also in the front-rear direction in which the distance from the user's eyes varies, in the direction perpendicular to the user's eye axis and visual axis. Various movements, such as rotation along, can be envisaged.

  In addition, on the operation panel 120 shown in FIG. 8B and the user instruction input screen shown in FIG. 9B, buttons for instructing the enlargement or reduction of the graphic size (if necessary) A button for instructing the rotation of the figure other than the rotation with the axis or the visual axis as the rotation axis can be set. Further, regarding the flowchart of FIG. 10, in the case of the display system according to the second embodiment, since there are no calibration steps, a process for checking whether there is the next adjustment as in step S40, In this connection, the process for performing the next adjustment is not necessary.

  Next, with reference to FIG. 17A, the structure of the display system which concerns on the 3rd Embodiment of this invention is demonstrated. The HMD 360 illustrated in FIG. 17A includes a sensor 361a and a sensor 361b that detect changes in the relative positional relationship between the user and the HMD (displacement, that is, movement of the HMD 360 relative to the user) at both upper ends.

  These sensors, for example, irradiate the skin of the user wearing the HMD 360 with a laser beam or the like, and read the surface state with an interference pattern caused by surface reflection, so that the relative positional relationship between the user and the HMD 360 is determined. Detect changes. Here, the change in the positional relationship indicates a change in position in a direction substantially perpendicular to the user's eye axis or visual axis.

  When the sensor detects a change in the relative positional relationship of the display device such as the HMD 360, the display image is automatically readjusted based on the detected change amount (distance) and the moving direction, and the change is dealt with. (Automatic adjustment process). For example, it is possible to change the image data so as to shift up, down, left, and right, cancel the shift caused by the change, and control the relative positional relationship to be the positional relationship immediately after the image display is adjusted. Further, the change can be canceled by moving the image display device itself by an ultrasonic motor or the like. In FIG. 17A, two sensors are displayed, but one sensor may be provided. When two sensors (361a, 361b) are used as shown in FIG. 17A, changes in the inclination of the HMD 360 can be grasped, and changes in the relative positional relationship can be detected with higher accuracy.

  When the sensor detects that a change in the relative positional relationship between the user and the HMD has occurred, the fact is displayed on the display screen of the HMD 360 (with or without the automatic adjustment process described above). It may be controlled to notify the user by sounding a warning sound (notification process). In the case of such a change, there is basically no change in the relative positional relationship between the left and right display screens, and the influence on the 3D effect is limited. Therefore, in many cases, after receiving the above notification, the user can adjust the display image by adjusting the mounting position of the HMD 360 by hand while viewing the displayed check pattern. If the change is within the specified range, perform the automatic readjustment as described above. Otherwise, make sure that manual adjustment is necessary (assuming automatic readjustment is not possible). You may make it alert | report or may readjust halfway.

  Further, the sensor (361a, 361b) can also measure a change in the distance between the user wearing the HMD 360 and the display screen of the HMD 360 (distance in a direction substantially parallel to the user's eye axis or visual axis). It is. In this case, similarly to the above, the display image can be automatically readjusted according to the measurement result, and the change in the distance is notified to the user so as to prompt the user to adjust the position. You can also

  Next, with reference to FIG. 17B, the structure of the display system which concerns on the 4th Embodiment of this invention is demonstrated. The left-eye display device 371 and the right-eye display device 372 in the display device such as the HMD shown in FIG. 17B are transmissive display devices. Here, a graphic pattern of a check pattern is displayed at a predetermined position corresponding to the left-eye display image 371a and the right-eye display image 372a. That is, the left eye display image 371a displayed on the left eye display device 371 includes the check pattern 371e, and the right eye display image 372a displayed on the right eye display device 372 includes the check pattern 372e. Is included. These two check patterns are figures that do not fuse with both eyes. Furthermore, since this display device is a transmission type, the actual external environment is displayed transparently, for example, the actual object shape 371d and shape 372d are displayed at positions different from the above-described check pattern that does not fuse both eyes. (Recognized).

  As described above, in another display system according to the present invention, in a transmissive display device, a check pattern that cannot be binocularly fused is displayed on the left and right display images while allowing the actual external environment to be seen.

  When a display device such as an HMD is transmissive, a part of the actual external environment can be seen, so that the external environment can be stereoscopically viewed as usual. In this case, in a situation where a check pattern that does not fuse both eyes is displayed along with the external environment, both eyes are already in the optimal relative position by looking at the external environment, so the check pattern is shifted in the left and right display images. If it looks like it, you can fix it.

  In the present invention, when a display device such as an HMD is non-transmissive, a check pattern shift can be recognized on the assumption that both eyes are in an appropriate position even in a situation where the external environment is not visible. It is said. However, because the eyeball has no visual feedback, it can be unstable. Therefore, as shown in FIG. 17B, the check pattern is adjusted while looking at the external environment so that the two eyes can perform the adjustment operation while maintaining an optimal relative position.

  Further, as a modification of the display system according to the fourth embodiment of the present invention, an example using a non-transmissive display device can be considered. In this system, a check pattern that does not allow binocular fusion is displayed at a predetermined position corresponding to the display image for the left eye and the display image for the right eye, and at the corresponding predetermined position that is different from the predetermined position, The figure that can be fused is also displayed, and the user adjusts the displayed image by moving the display image including the check pattern up and down, left and right, and rotating while viewing the figure that can be fused with both eyes in three dimensions. I do.

  Similar to the above, this configuration attempts to ensure that both eyes are in an appropriate position, and considers the case where it is insufficient to see the actual external environment as described above. In other words, when viewing the actual external environment, there is no guarantee that both eyes are facing directly in front and the angle of convergence is different. Make sure that is in the proper position. In the configuration in which the actual external environment is viewed, in the adjustment of the image display, especially the adjustment in the left-right direction may be difficult, and in order to deal with this, for example, the restriction that the user views a front object at a distance of 3 meters It is preferable to adjust the image display after providing.

  Next, with reference to FIG. 18, a configuration example of a computer configuring the adjustment control device 173 (see FIG. 9C) included in the display system according to the first embodiment of the present invention will be described. However, the computer 400 in FIG. 13 only exemplifies a typical configuration of a computer that realizes each function of the adjustment control device.

The computer 400 includes a CPU (Central
Processing Unit) 401, memory 402, AV input interface 403, AV output interface 404, display controller 405, display 406, input device interface 407, keyboard 408, mouse 409, external recording medium interface 410, external storage device 411, network interface 412 And a bus 413 connecting these components to each other.

  The CPU 401 controls the operation of each component of the computer 400 and executes each function under the control of the OS. For example, control is performed on the processing of the image display adjustment unit 173a and the display control unit 173b shown in FIG. 9C.

The memory 402 is generally composed of a RAM (Random Access Memory). The memory 402 is loaded with a program for realizing each function executed by the CPU 401 (functions such as the image display adjustment unit 173a and the display control unit 173b), and temporarily stores data necessary for the program. The

  The AV input interface 403 inputs a video signal (image data) necessary for displaying 3D video from the content providing apparatus 440 via, for example, an HDMI cable. Here, the content providing apparatus 440 corresponds to the content providing apparatus 174 illustrated in FIG. 9C.

  The AV output interface 404 outputs the changed (adjusted) image data to the HMD controller 450 via, for example, an HDMI cable. If there is no HMD controller, it can also be output directly to a display device such as an HMD. Here, the HMD controller 450 corresponds to the HMD controller 172 shown in FIG. 9C.

The display controller 405 processes drawing data transmitted from the CPU 401 or the like, and displays an LCD (Liquid Crystal).
A screen is displayed on a display 406 including a display device including a display) and a touch screen. For example, a user instruction input screen 160 shown in FIG. 9B is displayed.

  The input device interface 407 receives signals from input devices such as a keyboard 408, a mouse 409, and a touch screen that are operated by the user for input, and transmits the signals to the CPU 401. Input data and the like are stored in the memory 402 and the like. For example, input to the user instruction input screen 160 displayed on the display 406 is performed using the keyboard 408 and the mouse 409.

  The external recording medium interface 410 accesses the external recording medium 420 to control data transmission / reception. For example, the optical disk 421 is driven to access the recording surface, and the recorded data is read, or the data stored in the external storage device 411 is written to the optical disk 421. In addition, the portable flash memory 422 is accessed and data is exchanged with the computer 400.

  The external storage device 411 is generally a storage device such as a hard disk. The external storage device 411 stores a program for realizing the function of the image display adjustment unit 173a executed by the CPU 401, and stores data used by the program. The adjustment parameter storage unit 173c of FIG. 9C is one of the external storage devices 411, and adjustment parameters are stored therein.

  The network interface 412 realizes connection with a network 430 including a LAN and the Internet, and controls data transmission / reception between the computer 400 and the network 430. The network interface 412 allows the computer 400 to transmit and receive data by connecting to a LAN or the Internet. A program executed by the CPU 401 and realizing each function of the present invention can be provided to the computer 400 from the outside via the network interface 412 or the external recording medium interface 410 described above.

  Here, an example of a computer configuring the adjustment control device 173 has been described. However, the HMD controllers (132, 172) illustrated in FIGS. 8C and 9C can also be configured by the same computer (however, the display 406, the keyboard 408, etc. Some components are not required). Further, by using the configuration of the computer 400, the adjustment control device 173 and the content providing device 174 shown in FIG. 9C can be configured as one computer, or the HMD controller 172 and the adjustment control device 173 shown in FIG. The controller 172, the adjustment control device 173, and the content providing device 174 can each be configured as one computer.

20, 111, 131, 151, 171, 191, 201, 320, 360 ... HMD, 21 ... display device for left eye, 22 ... display device for right eye, 110, 130, 150, 170, 190, 200 ... display system, 112, 132, 152, 172, 192, 202 ... HMD controller, 133, 174, 193, 204 ... content providing device, 153, 173, 203 ... adjustment control apparatus

Claims (20)

An image display means arranged in a position close to or in contact with the user's eye and displaying a left-eye display image and a right-eye display image;
Display control means for controlling to display a first graphic on the left-eye display image and to display a second graphic on the right-eye display image;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user's instruction or operation so that the first graphic and the second graphic are in the first positional relationship. And image display adjustment means capable of adjusting image display based on
The image display adjustment means changes at least one of a change in the position or direction of the image display means and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics that are not in a binocular fusion, and one of the graphics includes at least one straight line extending in the horizontal direction, and there is a vertical shift and a rotational shift. If the two figures are overlapped in a situation where there is no, the figure can take the first positional relationship,
The first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line, or at least two arbitrary points on the straight line The display system is characterized by a positional relationship that seems to have equal intervals at positions close to each other. The display system according to claim 1.
The image display means is transmissive, and when the outside scene is displayed to the user through the image display means together with the first graphic and the second graphic,
When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment unit is configured to view the object of the outside scene in three dimensions and the first graphic and the second A display system characterized in that the image display can be adjusted so that a figure is in the first positional relationship. The display system according to claim 1 or 2,
The display control means further controls to display a third graphic on the left-eye display image and to display a fourth graphic on the right-eye display image,
The fourth graphic is a graphic that is the same as or different from the third graphic and can be binocularly fused with the third graphic;
When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment means is configured to view the third graphic and the fourth graphic by binocular fusion, A display system characterized in that the image display can be adjusted so that the first graphic and the second graphic are in the first positional relationship. The display system according to any one of claims 1 to 3,
When the image display means is disposed close to the user's eyes, the image display means further comprises a detection means for detecting a change in the relative positional relationship between the image display means and the user,
After the adjustment of the image display, when the change of the relative positional relationship is detected by the detection unit, a notification process for notifying the user that the change has occurred, and according to the change A display system that performs at least one of automatic adjustment processing that automatically adjusts to a state after adjustment of the image display by canceling out the generated deviation. The display system according to any one of claims 1 to 4,
When further adjusting the image display based on the user instruction,
The display control means further controls to display a fifth graphic on the display image for the left eye and display a sixth graphic on the display image for the right eye,
The sixth graphic is a graphic that is the same as or different from the fifth graphic and can be binocularly fused with the fifth graphic;
When the user views the left eye display image and the right eye display image with both eyes, the image display adjustment means is configured to sense the sense of distance between the fifth graphic and the sixth graphic that can be seen by binocular fusion. The display system is capable of adjusting the image display based on an instruction or operation of the user. The display system according to any one of claims 1 to 5,
When further adjusting the image display based on the user instruction,
The display control means controls to display a seventh graphic on the left-eye display image and display an eighth graphic on the right-eye display image,
The image display adjustment means is configured such that when the user views the left eye display image and the right eye display image with both eyes, the seventh graphic and the eighth graphic are in the second positional relationship. In addition, it is possible to adjust the image display based on the instruction or operation of the user,
The seventh figure and the eighth figure are different figures that are in a relationship that does not fuse both eyes, and are the figures that become the second positional relationship when superimposed in a situation without deviation,
The second positional relationship is a relationship in which the seventh graphic and the eighth graphic appear to overlap or touch at least at two specific points, or at least positions close to three specific points that are not on a straight line. The display system is characterized in that all of them have equal intervals, or are in a positional relationship that seems to have equal intervals in a specific set of positions. An image display means arranged in a position close to or in contact with the user's eye and displaying a left-eye display image and a right-eye display image;
Display control means for controlling to display a first graphic on the left-eye display image and to display a second graphic on the right-eye display image;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user is instructed or operated so that the first graphic and the second graphic are in a predetermined positional relationship. And image display adjustment means capable of adjusting the image display based on
The image display adjustment means changes at least one of a change in the position or direction of the image display means and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics in a relationship that does not fuse both eyes, and are superimposed on each other in a situation where there is no shift, and are the graphics that have the predetermined positional relationship,
The predetermined positional relationship is such that the first graphic and the second graphic appear to overlap or touch at least at specific three points not on a straight line, or at least specific three points not on a straight line, respectively. A display system characterized by having a positional relationship that all appear to have equal spacing at adjacent positions, or appear to have equal spacing at a specific set of positions. A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. Display control means for controlling the display;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user's instruction or operation so that the first graphic and the second graphic are in the first positional relationship. And image display adjustment means capable of adjusting image display based on
The image display adjustment means changes at least one of a change in the position or direction of the image display device and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics that are not in a binocular fusion, and one of the graphics includes at least one straight line extending in the horizontal direction, and there is a vertical shift and a rotational shift. If the two figures are overlapped in a situation where there is no, the figure can take the first positional relationship,
The first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line, or at least two arbitrary points on the straight line The display adjustment system is characterized by a positional relationship that seems to have equal intervals at positions close to each other. The display adjustment system according to claim 8.
The image display device is transmissive, and when an outside scene is displayed to the user through the image display device together with the first graphic and the second graphic,
When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment unit is configured to view the object of the outside scene in three dimensions and the first graphic and the second A display adjustment system, wherein the image display can be adjusted so that a figure is in the first positional relationship. The display adjustment system according to claim 8 or 9,
The display control means further controls to display a third graphic on the left-eye display image and to display a fourth graphic on the right-eye display image,
The fourth graphic is a graphic that is the same as or different from the third graphic and can be binocularly fused with the third graphic;
When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment means is configured to view the third graphic and the fourth graphic by binocular fusion, The display adjustment system, wherein the image display can be adjusted so that the first graphic and the second graphic are in the first positional relationship. The display adjustment system according to any one of claims 8 to 10,
When the image display device is disposed close to the eyes of the user, a detection unit that detects a change in relative positional relationship between the image display device and the user is provided,
After the adjustment of the image display, when the change of the relative positional relationship is detected by the detection unit, a notification process for notifying the user that the change has occurred, and according to the change A display adjustment system, wherein at least one of automatic adjustment processing for automatically adjusting to a state after the adjustment of the image display is performed by canceling out the generated shift. The display adjustment system according to any one of claims 8 to 11,
When further adjusting the image display based on the user instruction,
The display control means further controls to display a fifth graphic on the display image for the left eye and display a sixth graphic on the display image for the right eye,
The sixth graphic is a graphic that is the same as or different from the fifth graphic and can be binocularly fused with the fifth graphic;
When the user views the left eye display image and the right eye display image with both eyes, the image display adjustment means is configured to sense the sense of distance between the fifth graphic and the sixth graphic that can be seen by binocular fusion. The display adjustment system is capable of adjusting the image display based on an instruction or operation of the user. The display adjustment system according to any one of claims 8 to 12,
When further adjusting the image display based on the user instruction,
The display control means controls to display a seventh graphic on the left-eye display image and display an eighth graphic on the right-eye display image,
The image display adjustment means is configured such that when the user views the left eye display image and the right eye display image with both eyes, the seventh graphic and the eighth graphic are in the second positional relationship. In addition, it is possible to adjust the image display based on the instruction or operation of the user,
The seventh figure and the eighth figure are different figures that are in a relationship that does not fuse both eyes, and are the figures that become the second positional relationship when superimposed in a situation without deviation,
The second positional relationship is a relationship in which the seventh graphic and the eighth graphic appear to overlap or touch at least at two specific points, or at least positions close to three specific points that are not on a straight line. The display adjustment system is characterized in that all have equal intervals or a positional relationship that appears to have equal intervals in a specific set of positions. A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. Display control means for controlling the display;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user is instructed or operated so that the first graphic and the second graphic are in a predetermined positional relationship. And image display adjustment means capable of adjusting the image display based on
The image display adjustment means changes at least one of a change in the position or direction of the image display device and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics in a relationship that does not fuse both eyes, and are superimposed on each other in a situation where there is no shift, and are the graphics that have the predetermined positional relationship,
The predetermined positional relationship is such that the first graphic and the second graphic appear to overlap or touch at least at specific three points not on a straight line, or at least specific three points not on a straight line, respectively. A display adjustment system characterized in that all of the adjacent positions have equal intervals, or are in a positional relationship that appears to have equal intervals at a specific set of positions. A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. A display control step for controlling the display;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user's instruction or operation so that the first graphic and the second graphic are in the first positional relationship. And an image display adjustment step capable of adjusting the image display based on
The image display adjustment step includes changing at least one of a change in the position or direction of the image display device and a change in at least one of the display image for the left eye and the display image for the right eye. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics that are not in a binocular fusion, and one of the graphics includes at least one straight line extending in the horizontal direction, and there is a vertical shift and a rotational shift. If the two figures are overlapped in a situation where there is no, the figure can take the first positional relationship,
The first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line, or at least two arbitrary points on the straight line The display adjustment method is characterized in that it is a positional relationship that seems to have equal intervals at positions close to each other. The display adjustment method according to claim 15, wherein
The image display device is transmissive, and when an outside scene is displayed to the user through the image display device together with the first graphic and the second graphic,
In the image display adjustment step, when the user views the display image for the left eye and the display image for the right eye with both eyes, the first graphic and the second image are viewed while viewing the object in the outside scene in three dimensions. A display adjustment method, wherein the image display can be adjusted so that a figure is in the first positional relationship. A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. A display control step for controlling the display;
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user is instructed or operated so that the first graphic and the second graphic are in a predetermined positional relationship. And an image display adjustment step capable of adjusting the image display based on
The image display adjustment step includes changing at least one of a change in the position or direction of the image display device and a change in at least one of the display image for the left eye and the display image for the right eye. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics in a relationship that does not fuse both eyes, and are superimposed on each other in a situation where there is no shift, and are the graphics that have the predetermined positional relationship,
The predetermined positional relationship is such that the first graphic and the second graphic appear to overlap or touch at least at specific three points not on a straight line, or at least specific three points not on a straight line, respectively. A display adjustment method characterized by having a positional relationship that all appear to have equal intervals at adjacent positions or appear to have equal intervals at a specific set of positions. On the computer,
A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. Display control means for controlling display, and
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user's instruction or operation so that the first graphic and the second graphic are in the first positional relationship. Is a program that functions as an image display adjustment means capable of adjusting the image display,
The image display adjustment means changes at least one of a change in the position or direction of the image display device and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics that are not in a binocular fusion, and one of the graphics includes at least one straight line extending in the horizontal direction, and there is a vertical shift and a rotational shift. If the two figures are overlapped in a situation where there is no, the figure can take the first positional relationship,
The first positional relationship is a positional relationship in which the first graphic and the second graphic appear to overlap or touch at least at any two points on the straight line, or at least two arbitrary points on the straight line A program having a positional relationship that seems to have equal intervals at positions close to each other. The program according to claim 18, wherein
The image display device is transmissive, and when an outside scene is displayed to the user through the image display device together with the first graphic and the second graphic,
When the user views the left-eye display image and the right-eye display image with both eyes, the image display adjustment unit is configured to view the object of the outside scene in three dimensions and the first graphic and the second A program characterized in that the image display can be adjusted so that a graphic is in the first positional relationship. On the computer,
A first graphic is displayed on the display image for the left eye displayed by the image display device arranged near or in contact with the user's eye, and the second graphic is displayed on the display image for the right eye displayed by the image display device. Display control means for controlling display, and
When the user views the display image for the left eye and the display image for the right eye with both eyes, the user is instructed or operated so that the first graphic and the second graphic are in a predetermined positional relationship. Based on this, a program that functions as an image display adjustment means capable of adjusting image display,
The image display adjustment means changes at least one of a change in the position or direction of the image display device and a change in at least one of the left-eye display image and the right-eye display image. Allows adjustment of the image display,
The first graphic and the second graphic are different graphics in a relationship that does not fuse both eyes, and are superimposed on each other in a situation where there is no shift, and are the graphics that have the predetermined positional relationship,
The predetermined positional relationship is such that the first graphic and the second graphic appear to overlap or touch at least at specific three points not on a straight line, or at least specific three points not on a straight line, respectively. A program characterized by being in a positional relationship that all appear to have equal intervals at adjacent positions or appear to have equal intervals at a specific set of positions.