JP2020166069A - Parallax inspection method and parallax inspection system - Google Patents

Abstract

To provide a parallax inspection method and a parallax inspection system that can inspect the parallax of virtual images.SOLUTION: A parallax inspection method is a parallax inspection method for inspecting the parallax of a virtual image displayed by a virtual image display system 100. The virtual image display system 100 displays the virtual image based on an image by projecting the image by an optical system 130. The parallax inspection method includes a detection process and an estimation process. In the detection process, a detector 10 disposed at the observation position of the virtual image is used to detect an incident angle at which the light forming the virtual image is incident on the detector 10. In the estimation process, the parallax of the virtual image at the observation position is estimated based on the incident angle.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to a parallax inspection method and a parallax inspection system. More specifically, the present disclosure relates to a parallax inspection method and a parallax inspection system for inspecting the parallax of a virtual image.

Patent Document 1 discloses an image display device (virtual image display system) that projects a virtual image onto a target space. This image display device is an automobile HUD (Head-Up Display) device. The projected light, which is the image light emitted from the automobile HUD device in the dashboard, is reflected by the windshield and directed toward the driver who is the viewer. As a result, the driver can visually recognize the image such as the navigation image as a virtual image, and visually recognizes the virtual image as if it is superimposed on the background such as the road surface.

JP-A-2017-142491

In the image display device disclosed in Patent Document 1, if the position of the virtual image seen by the left eye or the position of the virtual image seen by the right eye changes due to aberration of the optical system or the like, the driver may feel a sense of discomfort when looking at the virtual image. And could cause eye fatigue. Therefore, in an image display device, it has been requested to inspect a change in the position of a virtual image, that is, parallax, which occurs according to a difference in the position of a viewpoint.

An object of the present disclosure is to provide a parallax inspection method and a parallax inspection system capable of inspecting the parallax of a virtual image.

The parallax inspection method of one aspect of the present disclosure is a parallax inspection method for inspecting the parallax of a virtual image displayed by a virtual image display system. The virtual image display system displays the virtual image based on the image by projecting an image by an optical system. The parallax inspection method includes a detection process and an estimation process. In the detection process, a detector arranged at the observation position of the virtual image is used to detect the incident angle at which the light forming the virtual image is incident on the detector. In the estimation process, the parallax of the virtual image at the observation position is estimated based on the incident angle.

The parallax inspection system of one aspect of the present disclosure is a parallax inspection system that inspects the parallax of a virtual image displayed by the virtual image display system. The virtual image display system displays the virtual image based on the image by projecting an image by an optical system. The parallax inspection system includes a detection processing unit and an estimation processing unit. The detection processing unit detects the incident angle at which the light forming the virtual image is incident on the detector by using a detector arranged at the observation position of the virtual image. The estimation processing unit estimates the parallax of the virtual image at the observation position based on the incident angle.

According to the present disclosure, it is possible to provide a parallax inspection method and a parallax inspection system capable of inspecting the parallax of a virtual image.

FIG. 1 is a schematic explanatory view of a parallax inspection system according to an embodiment of the present disclosure. FIG. 2 is an explanatory diagram of parallax inspected by the same parallax inspection system. FIG. 3 is a flowchart illustrating the operation of the parallax inspection system described above. FIG. 4 is an explanatory diagram of a measurement method in which the parallax inspection system of the above measures the viewing distance. FIG. 5 is an explanatory diagram of a setting method in which the parallax inspection system of the above sets the orientation of the detector. FIG. 6 is an explanatory diagram illustrating a method in which the parallax inspection system of the above measures parallax at the first observation position and the second observation position. FIG. 7 is an explanatory diagram showing an example of a virtual image displayed by the virtual image display system when the parallax inspection system inspects the parallax. FIG. 8 is an explanatory diagram when the same parallax inspection system inspects parallax in the vertical direction.

The embodiments described below are merely one of the various embodiments of the present disclosure. The embodiments of the present disclosure are not limited to the following embodiments, and may include other embodiments. In addition, the following embodiments can be variously modified according to the design and the like as long as they do not deviate from the technical idea of the present disclosure.

(Embodiment)
(1) Overview As shown in FIG. 1, the parallax inspection system 1 of the present embodiment is a parallax inspection system 1 that inspects the parallax of a virtual image displayed by the virtual image display system 100. The virtual image display system 100 displays a virtual image based on the image by projecting the image by the optical system 130. The parallax inspection system 1 includes a detection processing unit 31 and an estimation processing unit 32. The detection processing unit 31 detects the incident angle at which the light forming the virtual image is incident on the detector 10 by using the detector 10 arranged at the observation position of the virtual image. The estimation processing unit 32 estimates the parallax of the virtual image at the observation position based on the incident angle.

FIG. 2 is an explanatory diagram for explaining the parallax generated in the virtual image displayed by the virtual image display system 100. Reference numeral 200 in FIG. 2 is an eye box showing a visible range of the virtual image displayed by the virtual image display system 100. The observation position is a position where a person's viewpoint exists if the subject observing the virtual image is a person, and a position where the detector 10 is arranged if the subject observing the virtual image is the detector 10. Here, assuming that X1 in FIG. 2 is the position of the right eye of the person in the eye box 200 and X2 in FIG. 2 is the position of the left eye of the person in the eye box 200, X0 in FIG. 2 is Indicates the position of the virtual viewpoint between the left and right eyes. Hereinafter, this position is also referred to as "intermediate observation position X0", and V0 in FIG. 2 indicates a virtual image when viewed from the intermediate observation position X0. The virtual image V0 is an example of a virtual image displayed by the virtual image display system 100 when the parallax inspection system 1 inspects the parallax. The virtual image V0 includes the reference point VP0, and the detector 10 detects the incident angle at which the light from the reference point VP0 is incident on the virtual image V0. The shape of the virtual image V0 is, for example, a circle, and the center position of the circular virtual image V0 is the reference point VP0 of the virtual image V0. The shape of the virtual image V0 is not limited to a circle, and the shape of the virtual image V0 may be a polygon such as a triangle or a quadrangle. Further, in FIG. 2, the range in which the virtual image display system 100 can display the virtual image V0 is illustrated by the dotted line VA0.

Here, in an ideal state in which the optical components (lens, mirror, etc.) constituting the optical system 130 have no aberration or the like, the virtual image seen from the first observation position X1 corresponding to the right eye and the second observation position X2 corresponding to the left eye is , The position is the same as the position of the virtual image V0 seen from the intermediate observation position X0. That is, the position of the virtual image V0 seen from the intermediate observation position X0 is the same as the ideal position where the virtual image should be visible at the first observation position X1 and the second observation position X2 in the horizontal direction and the vertical direction. Hereinafter, the position of the virtual image V0 seen from the intermediate observation position X0 is also referred to as a “reference position”. In the following description, the left-right direction is a direction parallel to the direction in which the left eye and the right eye are lined up. Further, the vertical direction is a direction in which the virtual image V0 is viewed from the intermediate observation position X0 and a direction orthogonal to the left-right direction. Therefore, the horizontal direction and the vertical direction are not limited to the horizontal direction and the vertical direction, respectively, and the horizontal direction and the vertical direction may be different from the horizontal direction and the vertical direction, respectively, depending on the mounting state of the detector 10. ..

As described above, in the ideal state, a virtual image should be visible at the reference position even at the first observation position X1 and the second observation position X2. However, in reality, aberrations occur in the optical components constituting the optical system 130 due to manufacturing variations and the like, and the positions of the virtual images seen from the first observation position X1 and the second observation position X2 and the intermediate observation positions X0 are viewed. A deviation occurs in the horizontal direction and / or the vertical direction from the position of the virtual image (reference position). In the example of FIG. 2, the position of the virtual image V1 seen at the first observation position X1 is shifted to the right from the reference position, and the position of the virtual image V2 seen at the second observation position X2 is shifted to the left from the reference position. In this way, when aberrations or the like occur in the optical components constituting the optical system 130, the positions of the virtual images that can be seen at different observation positions (for example, the positions of the virtual images V1 and V2 that can be seen at the first observation position X1 and the second observation position X2). A deviation occurs between the reference position and the reference position, and this deviation is called "parallax".

Here, the magnitude of the deviation between the position of the virtual image V1 seen at the first observation position X1 and the reference position is the direction in which light is incident from the reference point VP0 of the virtual image V0 to the first observation position X1 and the reference point of the virtual image V1. It is represented by an angle (incident angle A1) formed by the direction in which light is incident from the VP1 to the first observation position X1. Similarly, the magnitude of the deviation between the position of the virtual image V2 seen at the second observation position X2 and the reference position is the direction in which light is incident from the reference point VP0 of the virtual image V0 to the second observation position X2 and the reference point of the virtual image V2. It is represented by an angle (incident angle A2) formed by the direction in which light is incident from the VP2 to the second observation position X2. Therefore, the parallax dA when the virtual image V0 is viewed with the left and right eyes is the incident angle A1 indicating the magnitude of the gap between the position of the virtual image V1 viewed from the right eye and the reference position, and the position of the virtual image V2 viewed from the left eye. It is the total value (A1 + A2) of the incident angle A2, which represents the magnitude of the deviation from the reference position.

In the parallax inspection system 1 of the present embodiment, the light forming a virtual image is incident on the detector 10 in which the detection processing unit 31 is arranged at the observation positions (for example, the first observation position X1 and the second observation position X2). Detect the angle of incidence. When the direction in which the virtual image is visible changes at the observation position due to aberrations of the optical components constituting the optical system 130, the incident angle at which the light forming the virtual image is incident on the detector 10 changes. Therefore, the estimation processing unit 32 can estimate the position where the virtual image can be seen at the observation position based on the incident angle detected by the detection processing unit 31, can estimate the parallax of the virtual image at the observation position, and can estimate the virtual image. It is possible to realize a parallax inspection system 1 capable of inspecting the parallax. Therefore, the estimation result of the parallax by the parallax inspection system 1 can be used for product development of the virtual image display system 100 with reduced parallax, quality control of mass-produced products of the virtual image display system 100, and the like.

(2) Details Hereinafter, the parallax inspection system 1 according to the present embodiment will be described with reference to the drawings.

(2.1) Configuration First, a virtual image display system 100 in which the parallax inspection system 1 of the present embodiment inspects parallax will be described.

The virtual image display system 100 is a head-up display mounted on a moving body such as an automobile. Although the virtual image display system 100 is mounted on a moving body and used, the parallax inspection system 1 of the present embodiment is displayed by the virtual image display system 100 in a state where the virtual image display system 100 is not mounted on the moving body. Examine the parallax of the virtual image. The parallax inspection system 1 may inspect the parallax with the virtual image display system 100 mounted on the moving body.

The virtual image display system 100 includes an image display unit 120, a control unit 121, an optical system 130, and a housing 140.

The housing 140 is formed of, for example, a synthetic resin in a box shape. The housing 140 accommodates an image display unit 120, a control unit 121, and an optical system 130, and is attached to, for example, a dashboard of an automobile.

The image display unit 120 includes a display device such as a liquid crystal display or an organic EL (Electro Luminescence) display. The image display unit 120 displays an image for forming a virtual image on the display surface.

The control unit 121 includes, for example, a computer system. A computer system mainly comprises one or more processors and one or more memories as hardware. The function of the control unit 121 is realized by executing a program recorded in one or more memories of a computer system by one or more processors. The program is pre-recorded in one or more memories of the computer system. The program may be provided through a telecommunication line, or may be recorded and provided on a non-temporary recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system.

The optical system 130 includes an optical system for enlarging the image display unit 120, and includes, for example, a first mirror 131 and a second mirror 132. When the virtual image display system 100 is mounted and used in an automobile, the optical system 130 further includes an automobile windshield. Since the parallax inspection system 1 of the present embodiment inspects the virtual image displayed by the virtual image display system 100 in a state where the virtual image display system 100 is not attached to the automobile, the optical system 130 is a substitute part of the windshield. Includes a reflector 150. The optical system 130 may not include the reflecting mirror 150 and the second mirror 132 may be a combiner, or the optical system 130 may not include the second mirror 132.

The first mirror 131 is, for example, a convex mirror, and reflects an image displayed on the display surface of the image display unit 120 toward the second mirror 132.

The second mirror 132 is, for example, a concave mirror, and reflects an image incident from the first mirror 131 toward the reflector 150.

The reflecting surface of the reflecting mirror 150 is formed to have a surface shape similar to that of a windshield of an automobile equipped with a virtual image display system 100. The reflecting mirror 150 reflects an image incident from the second mirror 132 through the opening 141 of the housing 140 toward the eye box 200 to produce a virtual image based on the image displayed on the display surface of the image display unit 120. Project to 200.

Next, the parallax inspection system 1 will be described.

The parallax inspection system 1 includes a detector 10 arranged in the eye box 200, an acquisition unit 20, a processing unit 30, an output unit 40, and a displacement device 50.

The displacement device 50 includes, for example, a biaxial ball screw arranged along the left-right direction and the vertical direction, a drive motor for rotating the biaxial ball screw, and a mounting base combined with the biaxial ball screw. The detector 10 is attached to the mounting base. When the ball screw arranged in the left-right direction is rotated by the drive motor in response to the control command input from the processing unit 30, the mounting base moves in the left-right direction according to the rotation of the ball screw. When the ball screw arranged in the vertical direction is rotated by the drive motor in response to the control command input from the processing unit 30, the mounting base moves in the vertical direction according to the rotation of the ball screw. As a result, the processing unit 30 can move the detector 10 mounted on the mounting base to a desired position in the left-right direction and the up-down direction by using the displacement device 50.

Further, as shown in FIG. 5, the displacement device 50 includes a first motor 51 that rotates the detector 10 around the X axis (an axis parallel to the left-right direction) and a Y-axis (parallel to the vertical direction) of the detector 10. It has a second motor 52 that rotates around the axis). By rotating the first motor 51 and / or the second motor 52 in response to the control command input from the processing unit 30, the detector 10 can be rotated around the X-axis and / or the Y-axis. The direction in which the detector 10 takes an image, that is, the direction of the optical axis AX1 of the detector 10 can be directed to a desired direction.

The detector 10 includes, for example, a camera that captures a virtual image projected onto the eyebox 200 by the virtual image display system 100. This camera (detector 10) has a two-dimensional image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and captures a two-dimensional image. The detector 10 is arranged at the first observation position X1 corresponding to the right eye, for example, in a state where the virtual image display system 100 is displaying the virtual image V0, and photographs the virtual image V1 seen from the first observation position X1. Further, the detector 10 is arranged at the second observation position X2 corresponding to the left eye, for example, in a state where the virtual image display system 100 is displaying the virtual image V0, and photographs the virtual image V2 seen from the second observation position X2.

The acquisition unit 20 acquires image data of an image in which the detector 10 has captured the virtual image V1 while the detector 10 is arranged at the first observation position X1, and outputs the acquired image data to the processing unit 30. Further, the acquisition unit 20 acquires the image data of the image in which the detector 10 has captured the virtual image V2 while the detector 10 is arranged at the second observation position X2, and outputs the acquired image data to the processing unit 30. ..

The processing unit 30 includes a detection processing unit 31 and an estimation processing unit 32. In other words, the processing unit 30 has functions as a detection processing unit 31 and an estimation processing unit 32. The processing unit 30 includes, for example, a computer system. A computer system mainly comprises one or more processors and one or more memories as hardware. The function of the processing unit 30 is realized by executing a program recorded in one or more memories of a computer system by one or more processors. Programs executed by one or more processors are pre-recorded in one or more memories of a computer system. The program may be provided through a telecommunication line, or may be recorded and provided on a non-temporary recording medium such as a memory card, an optical disk, or a hard disk drive that can be read by a computer system.

In the detection processing unit 31, the light forming a virtual image is incident on the detector 10 based on the image data at the first observation position X1 and the image data at the second observation position X2 acquired by the acquisition unit 20 from the detector 10. Performs detection processing to detect the incident angle.

For example, the detection processing unit 31 detects the direction of the virtual image V1 seen from the first observation position X1 based on the image data at the first observation position X1. In other words, the detection processing unit 31 detects the incident angle at which the light forming the virtual image V1 is incident at the first observation position X1 based on the image data at the first observation position X1. When the detector 10 is used to detect the incident angle of light at the first observation position X1, the detector 10 has the optical axis AX1 of the detector 10 at the first observation position X1 as shown in FIG. It is arranged in the direction in which the calculated projection position of the virtual image exists on the extension line. The calculated projection position of the virtual image is the projection position (reference position) of the virtual image V0 seen from the intermediate observation position X0. As described above, the detector 10 is arranged so that the incident angle of the light from the virtual image V0 at the reference position is 0 degrees, and the incident angle at which the light is incident from the virtual image V0 at the reference position is used as a reference. , The incident angle A1 at which the light from the virtual image V1 seen at the first observation position X1 is incident is obtained.

Further, the detection processing unit 31 detects the direction of the virtual image V2 seen from the second observation position X2 based on the image data at the second observation position X2. In other words, the detection processing unit 31 detects the incident angle at which the light forming the virtual image V2 is incident at the second observation position X2 based on the image data at the second observation position X2. When the detector 10 is used to detect the incident angle of light at the second observation position X2, the detector 10 has the optical axis AX1 of the detector 10 at the second observation position X2 as shown in FIG. It is arranged in the direction in which the calculated projection position of the virtual image (reference position of the virtual image V0) exists on the extension line. That is, the detector 10 is arranged in a direction in which the incident angle of the light from the virtual image V0 at the reference position is 0 degrees, and the second is based on the incident angle at which the light is incident from the virtual image V0 at the reference position. The incident angle A2 at which the light from the virtual image V2 seen at the observation position X2 is incident is obtained.

In the estimation processing unit 32, the left and right eyes are the first observation position X1 and based on the incident angle A1 at the first observation position X1 and the incident angle A2 at the second observation position detected by the detection processing unit 31. The parallax in the state of being located at the second observation position X2 is estimated. The estimation processing unit 32 obtains the sum (A1 + A2) of the incident angle A1 at the first observation position X1 and the incident angle A2 at the second observation position, so that the parallax of the virtual image V0 displayed by the virtual image display system 100 We are looking for the size of dA.

Further, the processing unit 30 compares the magnitude of the parallax dA estimated by the estimation processing unit 32 with a predetermined threshold value. If the parallax dA is less than the threshold value, the processing unit 30 determines that the virtual image display system 100 to be inspected is a non-defective product, and if the parallax dA is equal to or more than the threshold value, the virtual image display system 100 to be inspected is a defective product. Judge. The processing unit 30 may evaluate the quality of the virtual image displayed by the virtual image display system 100 to be inspected at a plurality of stages based on the parallax dA estimated by the estimation processing unit 32.

The output unit 40 includes, for example, at least one of a display device that displays characters, symbols, and the like, and a speaker that outputs sound. The output unit 40 displays, for example, an estimation result by the estimation processing unit 32 and a determination result in which the processing unit 30 determines the quality of the virtual image display system 100 based on the estimation result by the estimation processing unit 32. The speaker is used to output to the user (inspector) of the parallax inspection system 1.

(2.2) Operation The process of inspecting the parallax of the virtual image displayed by the virtual image display system 100 by the parallax inspection system 1 of the present embodiment will be described with reference to the flowchart of FIG.

When the parallax inspection system 1 is used to inspect the parallax of a virtual image, the user (inspector) of the parallax inspection system 1 uses the virtual image display system 100 to display the virtual image V0 for inspection. Here, when the virtual image display system 100 projects a virtual image into the eye box 200, the parallax differs depending on the position of the viewpoint even in the eye box 200. Therefore, the parallax inspection system 1 of the present embodiment has a plurality of parallax inspection systems 1 in the eye box 200. Measure parallax at position. In other words, the parallax inspection system 1 estimates the parallax at each of the plurality of observation positions set in the eye box 200 where the virtual image V0 can be visually recognized. Each of the plurality of observation positions is a first observation position X1 corresponding to the position of the right eye of the user (observer) observing the virtual image V0, and a second observation position corresponding to the position of the left eye of the user (observer). Includes X2.

When the parallax inspection system 1 measures the parallax at each of the plurality of observation positions in the eye box 200, the virtual image display system 100 displays a plurality of virtual images V0 at each of the plurality of observation positions as shown in FIG. .. The plurality of virtual images V0 are displayed so as to be arranged along two directions (for example, a horizontal direction and a vertical direction) orthogonal to each other in the space where the plurality of virtual images V0 are projected. When the parallax is measured accurately at each of the plurality of observation positions, the parallax inspection system 1 sets the detector 10 at the observation position (first observation position X1 and second observation position X2) of the inspection target among the plurality of observation positions. To place. Then, the parallax inspection system 1 has the detector 10 directed to a plurality of measurement points including the central position of the virtual image V0 displayed at the observation position to be inspected and its periphery, and the parallax at each of the plurality of measurement points. To measure.

When it is desired to shorten the time required to measure the parallax at a plurality of observation positions, the parallax inspection system 1 arranges the detector 10 at the observation position of the inspection target and displays a virtual image at the observation position of the inspection target. Point the detector 10 at the center position of V0. Then, the parallax inspection system 1 measures the parallax at each of a plurality of measurement points including the center position of the virtual image V0 and its periphery in a state where the detector 10 is directed to the center position of the virtual image V0. In this case, since the process of pointing the detector 10 at each of the plurality of measurement points is eliminated, the time required to measure the parallax at the plurality of observation positions can be shortened.

The processing unit 30 of the parallax inspection system 1 has a plurality of virtual images V0 displayed at a plurality of virtual image positions, and among the plurality of virtual images V0, the virtual image V0 to be inspected (hereinafter, the virtual image to be inspected is a virtual image V10). In some cases), the process of measuring the parallax of the virtual image V10 to be inspected is performed.

Information on a plurality of virtual image positions (coordinates) on which a plurality of virtual images V0 are displayed is preset in the processing unit 30 of the parallax inspection system 1, and the intermediate observation positions X0 and the first are based on the coordinates of the virtual image V10 to be inspected. The coordinates of the 1 observation position X1 and the 2nd observation position X2 are determined respectively.

When the coordinates of the intermediate observation position X0, the first observation position X1, and the second observation position X2 are determined based on the coordinates of the virtual image position of the virtual image V10 to be inspected, the processing unit 30 of the parallax inspection system 1 performs the intermediate observation. A process of measuring the viewing distance L1 from the position X0 to the virtual image V0 to be inspected is performed (S1). In other words, the detection processing unit 31 measures the viewing distance L1 between the virtual image position of the virtual image V0 and the observation position (intermediate observation position X0). As shown in FIG. 4, the processing unit 30 controls the displacement device 50 so that the optical axis of the detector 10 is parallel to the straight line connecting the intermediate observation position X0 and the virtual image V0. The detector 10 is moved to the first observation position X1 in a state where the orientation is changed. The processing unit 30 causes the detector 10 to image a virtual image in a state where the detector 10 is arranged at the first observation position X1. After that, the processing unit 30 changes the direction of the detector 10 so that the optical axis of the detector 10 is parallel to the straight line connecting the intermediate observation position X0 and the virtual image V0. 2 Move to the observation position X2. The processing unit 30 causes the detector 10 to image a virtual image in a state where the detector 10 is arranged at the second observation position X2. The image data captured by the detector 10 at the first observation position X1 and the second observation position X2 is input to the processing unit 30 via the acquisition unit 20. At this time, the processing unit 30 uses the triangular method based on the distance D1 between the first observation position X1 and the second observation position X2 and the direction in which the virtual image can be seen at the first observation position X1 and the second observation position X2. The viewing distance L1 is calculated. Although the detection processing unit 31 measures the viewing distance L1 by the stereo measurement method, for example, the viewing distance L1 may be measured by the contrast method.

When the viewing distance L1 is calculated, the processing unit 30 controls the displacement device 50 to move the detector 10 to the first observation position X1 to arrange the detector 10 at the first observation position X1 (S2). ). Further, the processing unit 30 controls the displacement device 50 to rotate the first motor 51 and the second motor 52, so that the virtual image V0 seen from the intermediate observation position X0 is on the extension line of the optical axis AX1 of the detector 10. The orientation of the detector 10 is changed so that the reference position (center position) exists. Here, in order to change the direction of the detector 10 so that the reference position of the virtual image V0 exists on the extension line of the optical axis AX1 of the detector 10, the rotation angle α1 for rotating the first motor 51 and the first The rotation angle β1 for rotating the two motors 52 is obtained by using the following equations 1 and 2. The coordinates of the observation position (first observation position X1 or second observation position X2) when the intermediate observation position X0 is the origin are (Xa1, Ya1), and the depression angle of the virtual image V0 when viewed from the origin is θ1. Let φ1 be the azimuth angle of the virtual image V0 when viewed from the origin. In this way, the detection processing unit 31 of the processing unit 30 uses the measurement result of the viewing distance L1 to determine that the calculated virtual image position of the virtual image V0 exists on the extension line of the optical axis AX1 of the detector 10. Find the direction of 10.

The processing unit 30 moves the detector 10 to the first observation position X1 and causes the detector 10 to take an image in a state where the optical axis AX1 of the detector 10 is directed to the reference point VP0 of the virtual image V0. The image data captured by the detector 10 is input to the detection processing unit 31 via the acquisition unit 20. The detection processing unit 31 measures (calculates) the incident angle A1 at which the light forming the virtual image V1 is incident from the virtual image V1 seen from the first observation position X1 based on the image data input via the acquisition unit 20. (S3). In other words, the detection processing unit 31 executes the first processing and the second processing. In the first process, the orientation of the detector 10 is set so that the calculated virtual image position of the virtual image V0 exists on the extension line of the optical axis AX1 of the detector 10 at the observation position (first observation position X1). In the second process, the incident angle A1 at which the light forming the virtual image is incident on the detector 10 is detected with the orientation of the detector 10 set. That is, the first parallax (incident angle A1) of the virtual image V1 at the first observation position X1 is obtained with the detector 10 arranged at the first observation position X1. Here, the detection processing unit 31 is based on the distance between the position where the light incident from the reference point VP1 of the virtual image V1 is formed on the imaging surface of the image sensor of the detector 10 and the origin position of the imaging surface. , The incident angle A1 is calculated. In other words, the detection processing unit 31 of the light forming the virtual image based on the position of the virtual image (for example, the virtual image V1 seen from the first observation position X1) in the image captured by the image sensor included in the detector 10. Detect the angle of incidence.

Next, the processing unit 30 controls the displacement device 50 to move the detector 10 to the second observation position X2, thereby arranging the detector 10 at the second observation position X2 (S4). Further, the processing unit 30 controls the displacement device 50 to rotate the first motor 51 and the second motor 52, so that the virtual image V0 seen from the intermediate observation position X0 is on the extension line of the optical axis AX1 of the detector 10. The orientation of the detector 10 is changed so that the virtual image position exists. Here, at the second observation position X2, the rotation angle α1 for rotating the first motor 51 and the rotation angle β1 for rotating the second motor 52 are obtained by using the above equations 1 and 2.

The processing unit 30 moves the detector 10 to the second observation position X2, and directs the optical axis of the detector 10 to the calculated virtual image position of the virtual image V0 (specifically, the reference point VP0 of the virtual image V0). Then, the detector 10 is made to take an image. The image data captured by the detector 10 is input to the detection processing unit 31 via the acquisition unit 20. The detection processing unit 31 measures (calculates) the incident angle A2 at which the light forming the virtual image V2 is incident from the virtual image V2 viewed from the second observation position X2, based on the image data input via the acquisition unit 20. ) (S5). Here, the detection processing unit 31 is based on the distance between the position where the light incident from the reference point VP2 of the virtual image V2 is formed on the imaging surface of the image sensor of the detector 10 and the origin position of the imaging surface. , The incident angle A2 is calculated. That is, the detection processing unit 31 obtains the second parallax (incident angle A2) of the virtual image V2 at the second observation position X2 in a state where the detector 10 is arranged at the second observation position X2.

When the detection processing unit 31 measures the incident angle A1 of the light at the first observation position X1 and the incident angle A2 of the light at the second observation position X2, the estimation processing unit 32 incidents on the incident angle A1. The differential dA is calculated by obtaining the sum with the angle A2 (S6). That is, the estimation processing unit 32 estimates the parallax based on the first parallax (incident angle A1) and the second parallax (incident angle A2). Furthermore, the estimation processing unit 32 estimates the magnitude of the parallax at the observation position based on the incident angle at which the light forming the virtual image is incident on the detector 10, and displays the virtual image based on the magnitude of the parallax. The quality of the system 100 can be evaluated in more detail.

When the parallax dA is estimated by the estimation processing unit 32, the processing unit 30 determines the quality of the virtual image display system 100 to be inspected by comparing the magnitude of the parallax dA with a predetermined threshold value (S7). The processing unit 30 determines that the display of the virtual image display system 100 is good if the parallax dA is less than the threshold value, and determines that the display of the virtual image display system 100 is poor if the parallax dA is equal to or more than the threshold value.

When the determination process of step S7 is completed, the processing unit 30 determines whether or not the inspection process is terminated by determining whether or not there is a virtual image among the plurality of virtual images V0 that has not been processed to measure the parallax. Judgment (S8).

If the processing unit 30 determines in step S8 that there is a virtual image V0 for which the parallax has not been measured, that is, the inspection process is not completed (S8: No), the processing unit 30 sets the virtual image V0 for which the parallax has not been measured as the inspection target. The processing after step S2 is performed on the virtual image V0 to be inspected.

On the other hand, in the determination of step S8, when the processing unit 30 determines that there is no virtual image V0 for which the disparity has not been measured, that is, the inspection process is completed (S8: Yes), the processing unit 30 measures the disparity for each of the plurality of observation positions. The result is output from the output unit 40 (S9). For example, the output unit 40 displays the measurement result of measuring the parallax for each of the plurality of observation positions on the display device, or outputs the measurement result by voice or the like from the speaker. As a result, the user (inspector) of the parallax inspection system 1 can determine the quality of the virtual image display system 100 to be inspected based on the information output from the output unit 40.

The processing unit 30 of the parallax inspection system 1 of the present embodiment obtains the parallax in the left-right direction for the virtual image V0 displayed by the virtual image display system 100, and obtains the parallax in the vertical direction as shown in FIG. You may. For example, in a state where the detector 10 is arranged at the first observation position X1, the processing unit 30 starts from the first observation position X1 in a plane orthogonal to the optical axis direction and the left-right direction (that is, in the vertical direction). The incident angle A11 at which the light forming the visible virtual image V1 is incident is obtained. Further, the processing unit 30 obtains an incident angle A12 at which the light forming the virtual image V2 seen from the second observation position X2 is incident while the detector 10 is arranged at the second observation position X2. Then, the processing unit 30 can obtain the parallax in the vertical direction of the virtual image to be inspected by obtaining the sum of the incident angle A11 and the incident angle A12.

Further, the processing unit 30 obtains the parallax in the left-right direction and the parallax in the up-down direction at each of the plurality of observation positions, so that the parallax in which the virtual image V0 can be seen rotated from the original position can be inspected. it can.

In the parallax inspection system 1 of the present embodiment, since the image is captured at the first observation position X1 and the second observation position X2 by using one detector 10, when two detectors 10 are used. It is possible to reduce the detection error due to the variation in the performance of the two detectors 10. In the present embodiment, one detector 10 is used to capture an image at the first observation position X1 and the second observation position X2, but the two detectors 10 (first detector and second detector 10) are captured. The detector) may be used to capture images at the first observation position X1 and the second observation position X2. If two detectors 10 (first detector and second detector) are used, images at the first observation position X1 and the second observation position X2 can be captured at the same time, so that the time required for the inspection can be shortened.

(3) Modified Example The above embodiment is only one of various embodiments of the present disclosure. The above-described embodiment can be changed in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. The parallax inspection method executed by the parallax inspection system 1 is a parallax inspection method for inspecting the parallax of the virtual image displayed by the virtual image display system 100. The parallax inspection method includes a detection process and an estimation process. In the detection process, the detector 10 arranged at the observation position of the virtual image is used to detect the incident angle at which the light forming the virtual image is incident on the detector 10. In the estimation process, the parallax of the virtual image at the observation position is estimated based on the incident angle. The (computer) program according to one aspect is a program for causing a computer system to execute a detection process and an estimation process.

Hereinafter, modifications of the above embodiment will be listed. The modifications described below can be applied in combination as appropriate. In the following, the above embodiment may be referred to as a "basic example".

The parallax inspection system 1 and the virtual image display system 100 in the present disclosure include a computer system. The main configuration of a computer system is a processor and memory as hardware. When the processor executes the program recorded in the memory of the computer system, the functions of the parallax inspection system 1 and the virtual image display system 100 in the present disclosure are realized. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, and may be recorded on a non-temporary recording medium such as a memory card, optical disk, or hard disk drive that can be read by the computer system. May be provided. A processor in a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) programmed after the LSI is manufactured, or a logical device capable of reconfiguring the junction relationship inside the LSI or reconfiguring the circuit partition inside the LSI should also be adopted as a processor. Can be done. A plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips. The plurality of chips may be integrated in one device, or may be distributed in a plurality of devices. The computer system referred to here includes a microcontroller having one or more processors and one or more memories. Therefore, the microcontroller is also composed of one or more electronic circuits including a semiconductor integrated circuit or a large-scale integrated circuit.

Further, in the above embodiment, it is not an essential configuration for the parallax inspection system 1 that a plurality of functions in the parallax inspection system 1 are integrated in one housing, and a plurality of components of the parallax inspection system 1 are present. It may be distributed in the housing. Further, at least a part of the functions of the parallax inspection system 1, for example, a part of the functions of the parallax inspection system 1 may be realized by a cloud (cloud computing) or the like. On the contrary, in the above embodiment, at least a part of the functions of the parallax inspection system 1 distributed in a plurality of devices may be integrated in one housing.

In the above embodiment, in the comparison of binary values such as the angle of incidence, the place where "greater than or equal to" may be "greater than". That is, in the comparison of the two values, whether or not the two values are equal can be arbitrarily changed depending on the setting of the reference value or the like, so there is no technical difference between "greater than or equal to" and "greater than". Similarly, "less than or equal to" may be "less than".

In the above embodiment, the detector 10 includes a camera including a two-dimensional image sensor to determine the incident angle at which the light forming the virtual image is incident, but the detector 10 includes the two-dimensional image sensor. Not limited to. The detector 10 may include, for example, an optical component in which a pinhole is formed and a one-dimensional image sensor. The detector 10 uses a one-dimensional image sensor, and detects a position where light forming a virtual image enters the one-dimensional image sensor through a pinhole and forms an image on the incident surface of the image sensor, thereby detecting the virtual image. The incident angle of the light forming the above may be obtained.

Further, the virtual image display system 100 in which the parallax inspection system 1 inspects the parallax is not limited to those applied to automobiles, but is also applied to moving objects other than automobiles such as two-wheeled vehicles, trains, aircraft, construction machinery, and ships. It is possible. Further, the virtual image display system 100 is not limited to the one mounted on the moving body, and may be applied to a head-mounted display or a glasses-type display device that the user wears on the head and uses.

(Summary)
As described above, the parallax inspection method of the first aspect is a parallax inspection method for inspecting the parallax of the virtual image (V0) displayed by the virtual image display system (100). The virtual image display system (100) displays an image-based virtual image (V0) by projecting an image by an optical system (130). The parallax inspection method includes a detection process and an estimation process. In the detection process, the light forming the virtual image (V1, V2) is incident on the detector (10) by using the detector (10) arranged at the observation position (X1, X2) of the virtual image (V1, V2). The incident angle (A1, A2) is detected. In the estimation process, the parallax of the virtual image (V1, V2) at the observation position (X1, X2) is estimated based on the incident angle (A1, A2).

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the second aspect, in the first aspect, the detection process includes a first process and a second process. In the first process, the detector (10) has a calculated projection position of the virtual image (V0) on the extension line of the optical axis (AX1) of the detector (10) at the observation positions (X1, X2). Set the orientation. In the second process, the incident angle at which the light forming the virtual image (V1, V2) is incident on the detector (10) is detected with the orientation of the detector (10) set.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the third aspect, in the second aspect, the detection process includes a third process and a fourth process. In the third process, the viewing distance (L1) between the projection position of the virtual image (V0) and the observation position (X1, X2) is measured. In the fourth process, using the measurement result of the viewing distance (L1), the detector (V0) has a calculated projection position of the virtual image (V0) on the extension line of the optical axis (AX1) of the detector (10). 10) Find the direction.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the fourth aspect, in any one of the first to third aspects, the parallax is estimated at each of a plurality of observation positions set in the eye box (200) where the virtual image (V0) can be visually recognized. To do.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the fifth aspect, in any one of the first to fourth aspects, the virtual image (V1, V2) includes the reference point (VP1, VP2), and the detector (10) is the virtual image (V1, V1,). At V2), the incident angles (A1, A2) at which the light from the reference points (VP1, VP2) are incident are detected.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the sixth aspect, in any one of the first to fifth aspects, the virtual image display system (100) projects a plurality of virtual images (V0), and the plurality of virtual images (V0) are a plurality of virtual images. (V0) is displayed so as to be arranged along two directions orthogonal to each other in the projected space.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the seventh aspect, in any one of the first to sixth aspects, the observation position is the first observation position (X1) corresponding to the position of the right eye of the user who observes the virtual image (V1, V2). And a second observation position (X2) corresponding to the position of the user's left eye.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the eighth aspect, in the seventh aspect, the detection process and the estimation process are performed in a state where the detector (10) is arranged at the first observation position (X1), and the first observation position (X1) is performed. The first parallax (A1) of the virtual image (V1) in) is obtained. In the parallax inspection method, the detection process and the estimation process are performed with the detector (10) arranged at the second observation position (X2), and the second parallax (V2) of the virtual image (V2) at the second observation position (X2) is performed. A2) is required. In the estimation process, the parallax is estimated based on the first parallax (A1) and the second parallax (A2).

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the ninth aspect, in any one of the first to eighth aspects, the detector (10) includes an image sensor, and in the detection process, a virtual image (V1) in the image captured by the image sensor. , V2), the incident angle of light (A1, A2) is detected.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the tenth aspect, in the ninth aspect, the image sensor (10) captures a two-dimensional image.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the eleventh aspect, in any one of the first to tenth aspects, in the estimation process, the magnitude of the parallax at the observation position (X1, X2) is determined based on the incident angle (A1, A2). presume.

According to this aspect, it is possible to provide a parallax inspection method capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

The parallax inspection system (1) of the twelfth aspect is a parallax inspection system (1) that inspects the parallax of the virtual image (V0) displayed by the virtual image display system (100). The imaginary image display system (100) displays an image-based imaginary image (V0) by projecting an image by an optical system (130). The parallax inspection system (1) includes a detection processing unit (31) and an estimation processing unit (32). The detection processing unit (31) uses the detectors (10) arranged at the observation positions (X1, X2) of the virtual image (V0), and the light forming the virtual image (V0) is incident on the detector (10). The incident angle (A1, A2) is detected. The estimation processing unit (32) estimates the parallax of the virtual image (V0) at the observation positions (X1, X2) based on the incident angles (A1, A2).

According to this aspect, it is possible to provide a parallax inspection system (1) capable of inspecting the parallax of the virtual image displayed by the virtual image display system (100).

In the parallax inspection method of the thirteenth aspect, in any one of the first to eleventh aspects, the parallax of the virtual image displayed by using the alternative component (150) of the optical component included in the optical system (130) is inspected.

In the parallax inspection method of the fourteenth aspect, in any one of the first to eleventh and thirteenth aspects, the detector (10) detects the light from the virtual image at the first observation position (X1). It includes a device and a second detector that detects light from a virtual image at the second observation position (X2).

Not limited to the above aspects, various configurations (including modifications) of the parallax inspection system (1) according to the above embodiment include a parallax inspection method, a (computer) program, a non-temporary recording medium on which the program is recorded, or the like. It can be embodied in.

The configurations according to the second to eleventh and thirteenth to fourteenth aspects are not essential configurations for the parallax inspection method and can be omitted as appropriate.

1 Parallax inspection system 10 Detector 31 Detection processing unit 32 Estimating processing unit 100 Virtual image display system 130 Optical system 200 Eyebox A1 Incident angle (first parallax)
A2 incident angle (second parallax)
L1 viewing distance V0 virtual image VP0 reference point X1 first observation position (observation position)
X2 2nd observation position (observation position)

Claims (12)

A parallax inspection method for inspecting the parallax of a virtual image displayed by a virtual image display system that displays a virtual image based on the image by projecting an image with an optical system.
A detection process for detecting the incident angle at which the light forming the virtual image is incident on the detector using a detector arranged at the observation position of the virtual image.
It includes an estimation process for estimating the parallax of the virtual image at the observation position based on the incident angle.
Parallax inspection method. The detection process is
At the observation position, the orientation of the detector is set so that the calculated projection position of the virtual image exists on the extension line of the optical axis of the detector.
Includes detecting the incident angle at which the light forming the virtual image is incident on the detector with the orientation of the detector set.
The parallax inspection method according to claim 1. The detection process is
Measuring the viewing distance between the projection position of the virtual image and the observation position,
Using the measurement result of the viewing distance, the orientation of the detector such that the calculated projection position of the virtual image exists on the extension line of the optical axis of the detector includes.
The parallax inspection method according to claim 2. The parallax is estimated at each of the plurality of observation positions set in the eye box in which the virtual image can be visually recognized.
The parallax inspection method according to any one of claims 1 to 3. The virtual image includes a reference point, and the detector detects the incident angle at which light from the reference point is incident in the virtual image.
The parallax inspection method according to any one of claims 1 to 4. The virtual image display system projects a plurality of the virtual images.
The plurality of virtual images are displayed so as to be arranged along two directions orthogonal to each other in the space in which the plurality of virtual images are projected.
The parallax inspection method according to any one of claims 1 to 5. The observation position includes a first observation position corresponding to the position of the user's right eye observing the virtual image and a second observation position corresponding to the position of the user's left eye.
The parallax inspection method according to any one of claims 1 to 6. The first parallax of the virtual image at the first observation position is obtained with the detector arranged at the first observation position.
The second parallax of the virtual image at the second observation position is obtained with the detector arranged at the second observation position.
In the estimation process, the parallax is estimated based on the first parallax and the second parallax.
The parallax inspection method according to claim 7. The detector includes an image sensor
In the detection process, the incident angle of the light is detected based on the position of the virtual image in the image captured by the image sensor.
The parallax inspection method according to any one of claims 1 to 8. The image sensor captures a two-dimensional image.
The parallax inspection method according to claim 9. In the estimation process, the magnitude of the parallax at the observation position is estimated based on the incident angle.
The parallax inspection method according to any one of claims 1 to 10. A parallax inspection system that inspects the parallax of a virtual image displayed by a virtual image display system that displays a virtual image based on the image by projecting an image with an optical system.
A detection processing unit that detects the incident angle at which the light forming the virtual image is incident on the detector using a detector arranged at the observation position of the virtual image.
It includes an estimation processing unit that estimates the parallax of the virtual image at the observation position based on the incident angle.
Parallax inspection system.

Images