JP7331618B2 - Glass inspection device, glass inspection method - Google Patents

Description

The present invention relates to a glass inspection apparatus and a glass inspection method.

A head-up display unit (hereinafter referred to as a HUD unit) is a device mounted on a vehicle that magnifies an image with a concave mirror and projects it onto the glass of the vehicle to display a virtual image of the image so that it can be visually recognized by the driver from inside the vehicle. is. Since the driver's visibility of the virtual image is affected by the quality of the glass onto which the image is projected, it is important to inspect the quality of the glass onto which the image is projected.

Since the HUD unit projects an image through a concave mirror, when inspecting the quality of the glass on which the image is projected, it is common to use a HUD unit that includes a concave mirror (see, for example, Patent Document 1). ).

JP 2015-75381 A

However, HUD units differ from vehicle to vehicle, and are difficult to obtain during preparation for production of HUD units. In addition, the concave mirror of the HUD unit may be moved when inspecting the glass, but a control circuit and control program for moving the concave mirror are required, which requires time for preparation. Further, if the concave mirror of the HUD unit is moved during glass inspection, the durability of the HUD unit becomes a problem. Thus, using a HUD unit for inspecting glass poses various problems.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a glass inspection apparatus capable of inspecting the quality of glass on which an image of a HUD unit is projected without using a HUD unit. do.

The present glass inspection apparatus is a glass inspection apparatus used in combination with a head-up display unit, and includes an image display and an inspection image displayed on the image display, which is projected onto the glass. An imaging device that captures a virtual image, an image processing unit that processes image data of the virtual image captured by the imaging device , and a storage unit that stores design data of an optical system of the head-up display unit in advance. When the direction of gravity is defined as the Z direction, and the X direction and the Y direction that intersect each other in a plane that intersects the Z direction are defined, the image display device is positioned at least at a first position and the first position is in the Z direction. The image processing unit is configured to be able to move to a second position where the coordinates of the a first XY coordinate calculator for obtaining a first XY coordinate of a point of the emitted inspection image; and a base for forming an arbitrary point of the virtual image when the image display is at the second position. a second XY coordinate calculator for calculating a second XY coordinate of a point of the inspection image from which a light ray is emitted; an optical path specifying unit that specifies an optical path of a light ray that forms each point in the entire display area of the virtual image by specifying 2XY coordinates; and based on the optical path specified by the optical path specifying unit, the a data calculation unit that calculates data related to the quality of the glass, the virtual image includes a main image and a double image, and the first XY coordinate calculation unit calculates the image display at the first position. At a certain time, the main image first XY coordinates of the point of the inspection image from which the main image ray that is the source for forming the arbitrary point of the main image is emitted are obtained, and the arbitrary point of the double image is obtained. The double image first XY coordinates of the point of the inspection image from which the double image light rays that form the basis for forming the image are emitted, and the second XY coordinate calculation unit calculates At a certain time, the main image second XY coordinates of the point of the inspection image from which the main image ray that is the source for forming the arbitrary point of the main image is emitted are obtained, and the arbitrary point of the double image is obtained. The second XY coordinates of the point of the inspection image from which the double image light rays that form the basis for forming the double image are obtained, and the optical path specifying unit calculates By specifying the main image first XY coordinates and the main image second XY coordinates from which the original principal image ray is emitted, the principal image ray serving as the original for forming each point in the entire display area of the main image By specifying the optical path of and specifying the double image first XY coordinates and the double image second XY coordinates from which the double image light rays that are the originals when forming the same point of the double image are emitted, The concave mirror of the head-up display unit is specified based on the design data read out from the storage unit, and the optical paths of the double image rays that are the original for forming each point in the entire display area of the double image are specified. and a position of a light source, and based on the positions of the concave mirror and the light source and the optical path of the principal image ray, the emission position of the light source that emits light to the optical path of the principal image ray is identified.

According to one embodiment of the disclosure, it is possible to provide a glass inspection apparatus capable of inspecting the quality of glass onto which an image of a HUD unit is projected without using a HUD unit.

It is a mimetic diagram showing an example of an inspection device concerning this embodiment. It is an example of the hardware block diagram of the control part of the inspection apparatus which concerns on this embodiment. It is an example of the functional block diagram of the control part of the inspection apparatus which concerns on this embodiment. It is an example of the flowchart which shows the inspection method using the inspection apparatus which concerns on this embodiment. FIG. 5 is an example of a flowchart showing details of step S103 in FIG. 4; FIG. FIG. 6 is a diagram schematically showing the processing from steps S201 to S206 in FIG. 5; FIG. 7 is a diagram schematically showing how the display position of the X-coordinate line image is moved in the X direction at the first position; FIG. 6 is a diagram schematically showing the processing from steps S213 to S216 in FIG. 5; FIG. 10 is a diagram schematically showing how the display position of the Y-coordinate line image is moved in the Y direction at the first position; FIG. 5 is an example of a flowchart showing details of step S104 in FIG. 4. FIG. FIG. 11 is a diagram schematically showing the processing from steps S301 to S306 in FIG. 10; FIG. 10 is a diagram schematically showing how the display position of the X-coordinate line image is moved in the X direction at the second position; FIG. 11 is a diagram schematically showing the processing from steps S313 to S316 in FIG. 10; FIG. 10 is a diagram schematically showing how the display position of the Y-coordinate line image is moved in the Y direction at the second position; FIG. 5 is an example of a flowchart showing details of step S105 in FIG. 4; FIG. It is an example of virtual image data of an X-coordinate line image and a Y-coordinate line image. It is an example of main image data of an X-coordinate line image and a Y-coordinate line image. FIG. 4 is a diagram showing an example of labeling a main image for each pixel and specifying coordinates; FIG. 4 is a diagram showing an example of a main image projection matrix at a first position; FIG. 4 is a diagram (part 1) schematically showing movement of an X-coordinate line image and movement of a virtual image; FIG. 11 is a diagram (part 2) schematically showing the movement of the X-coordinate line image and the movement of the virtual image; FIG. 3 is a diagram (part 3) schematically showing movement of an X-coordinate line image and movement of a virtual image; FIG. 4 is a diagram (4) schematically showing the movement of the X-coordinate line image and the movement of the virtual image; FIG. 10 is a diagram (part 1) schematically showing movement of a Y-coordinate line image and movement of a virtual image; FIG. 11 is a diagram (part 2) schematically showing movement of a Y-coordinate line image and movement of a virtual image; FIG. 11 is a diagram (part 3) schematically showing the movement of the Y-coordinate line image and the movement of the virtual image; FIG. 12 is a diagram (part 4) schematically showing the movement of the Y-coordinate line image and the movement of the virtual image; FIG. 4 is a diagram showing an example of a main image projection matrix for first and second positions; It is a figure explaining specification of the XY coordinate in a 2nd position. It is a figure explaining specification of a principal image ray. It is a figure explaining the identification of the concave mirror of a HUD unit, and the position of a light source. FIG. 10 is a diagram for explaining identification of a display position of a main image within a virtual image display area with respect to an arbitrary emission position of a light source; FIG. 5 is an example of a flowchart showing details of step S106 in FIG. 4; FIG. It is an example of the flowchart which shows the inspection method of the parameter of glass using the inspection apparatus which concerns on this embodiment. It is a figure explaining the inspection method of the parameter of glass using the inspection apparatus which concerns on this embodiment.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments for carrying out the invention will be described with reference to the drawings. In each drawing, the same components are denoted by the same reference numerals, and redundant description may be omitted.

[Outline of inspection equipment]
FIG. 1 is a schematic diagram showing an example of an inspection apparatus according to this embodiment. Referring to FIG. 1, an inspection apparatus 1 is an inspection apparatus capable of inspecting glass used in combination with a HUD unit without using a HUD unit. , and an inspection result output unit 40 . The inspection device 1 can calculate data relating to the quality of the glass used in combination with the HUD unit.

Here, the data related to the quality of the glass means, for example, main image distortion and double image distortion (distance between the main image and the double image) in a virtual image generated by the light from the HUD unit being reflected by the glass. , glass thickness, surface shape, wedge angle, and the like.

In the following description, a vehicle windshield (WS50) is exemplified as an example of the glass that is the inspection object, but the glass that is the inspection object is not limited to the vehicle windshield.

In FIG. 1, the WS 50 is mounted at the same angle as when mounted on the vehicle. In FIG. 1, reference numeral 60 denotes a virtual image captured by the imaging device 20 after the inspection image displayed by the image display 10 is reflected by the WS 50 . That is, 60 is a virtual image that can be visually recognized if the driver of the vehicle were on board at the position of the imaging device 20 . The inspection device 1 will be described in detail below.

The image display 10 generates and displays an inspection image under the control of the control section 30 . The inspection image displayed on the image display 10 is directly projected onto the WS 50 without passing through an optical element such as a mirror to generate a virtual image 60 . As the image display device 10, for example, a liquid crystal display device or the like is used.

When the direction of gravity (vertical direction when the WS 50 is attached to the vehicle) is defined as the Z direction, and the X direction and the Y direction that intersect each other in a plane that intersects the Z direction are defined, the image display device 10 controls the control unit 30 , and can move to at least two positions having different coordinates in the Z direction (for example, a first position and a second position, which will be described later).

In the following description, it is assumed that the image display device 10 is movable in the Z direction, and the X direction and the Y direction are defined in a plane perpendicular to the Z direction. The longitudinal direction of the vehicle and the Y direction are the lateral directions of the vehicle when the WS 50 is attached to the vehicle. However, it is not limited to this, and for example, the image display device 10 may be moved in a direction oblique to the Z direction. Also, the X direction and the Y direction need not be orthogonal to each other.

The imaging device 20 captures a virtual image 60 generated by projecting the inspection image displayed on the image display 10 onto the WS 50 . In order to capture the virtual image 60, the imaging device 20 is configured such that the imaging direction can be adjusted to any angle within the horizontal plane and the vertical plane. Also, the imaging device 20 is configured to be movable in the X, Y and Z directions. The imaging device 20 moves in a predetermined direction under the control of the control unit 30, for example. Note that the imaging direction corresponds to the line-of-sight direction of the vehicle driver during actual use. As the imaging device 20, for example, a CCD (Charge-Coupled Device) camera, a CMOS (Complementary Metal-Oxide-Semiconductor) camera, or the like can be used.

The control unit 30 is a unit that controls the image display device 10, the imaging device 20, the inspection result output unit 40, and the like. The control unit 30 will be described later.

The inspection result output unit 40 is a unit that outputs inspection results of the inspection apparatus 1 . As the inspection result output unit 40, for example, a liquid crystal display device, an organic EL display device, or the like may be used to visually display the inspection result as an image or numerical value. Alternatively, the inspection result output unit 40 may be configured to output the inspection result as data to the outside, may be configured to output the inspection result to the outside as sound, or may be configured in another way.

FIG. 2 is an example of a hardware block diagram of the controller of the inspection apparatus according to this embodiment. As shown in FIG. 2, the control unit 30 has a CPU 31, a ROM 32, a RAM 33, an I/F 34, and a bus line 35 as main components. The CPU 31 , ROM 32 , RAM 33 and I/F 34 are interconnected via a bus line 35 . The control unit 30 may have other hardware blocks as needed.

The CPU 31 controls each function of the control section 30 . The ROM 32, which is a storage unit, stores programs executed by the CPU 31 to control each function of the control unit 30 and various information. A RAM 33, which is a storage unit, is used as a work area for the CPU 31 and the like. Also, the RAM 33 can temporarily store predetermined information. The I/F 34 is an interface for connecting with other devices and the like, and is connected with an external network or the like, for example.

The control unit 30 includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit) designed to execute a predetermined function, a DSP (digital signal processor), FPGA (field programmable gate array), SOC (System on a chip), or GPU (Graphics Processing Unit). Also, the control unit 30 may be a circuit module or the like.

FIG. 3 is an example of a functional block diagram of the control unit of the inspection apparatus according to this embodiment. As shown in FIG. 3, the control section 30 has a display positioning section 310, a display control section 320, an imaging device control section 330, and an image processing section 340 as main functional blocks. The image processing unit 340 is a unit that processes image data of a virtual image captured by the imaging device 20, and includes a first XY coordinate calculation unit 341, a second XY coordinate calculation unit 342, an optical path identification unit 343, and a data calculation unit 344. have. The control unit 30 may have other functional blocks as necessary. Also, the image processing unit 340 may have other functional blocks as necessary. The function of each functional block of the control unit 30 will be described in the explanation of the flow chart below.

[Inspection method using inspection device]
FIG. 4 is an example of a flowchart showing an inspection method using the inspection apparatus according to this embodiment. First, in step S101, WS50 is set. Since the positional relationship between the WS 50 and the HUD unit during actual use is set for each vehicle type, here, the WS 50 is predetermined so that the positional relationship between the WS 50 and the image display unit 10 corresponds to the setting during actual use. set in position. For example, the WS 50 can be carried on a belt conveyor and set at a predetermined position using a robot, but is not limited to this.

Next, in step S<b>102 , the imaging device control unit 330 positions the imaging device 20 at a predetermined position where the virtual image 60 of the inspection image displayed by the image display device 10 can be captured. The imager 20 is positioned, for example, at the standard eyepoint of the driver of the vehicle.

Next, in step S103, the image display 10 is set to the first position (Near) to start the inspection. Details of step S103 in FIG. 4 are shown in the flow chart in FIG.

First, in step S201 of FIG. 5, the display positioning unit 310 positions the image display 10 at the first position (Near). Next, in step S<b>202 , the imager controller 330 determines the focus of the imager 20 . That is, the imaging device control unit 330 adjusts the focus of the imaging device 20 to an optimum position where the virtual image 60 of the inspection image displayed at the first position can be captured.

Next, in step S203, the display controller 320 generates an X-coordinate line image as an inspection image. The X coordinate line image is, for example, an image in which a plurality of straight lines parallel to the Y direction are juxtaposed at predetermined intervals. The X coordinate of each line included in the X coordinate line image is known.

Next, in step S<b>204 , the display controller 320 displays an X-coordinate line image at a predetermined position on the image display 10 . Next, in step S<b>205 , the imaging device control unit 330 captures the virtual image 60 of the X-coordinate line image with the imaging device 20 . Next, in step S206, the imaging device control unit 330 stores the virtual image of the X-coordinate line image captured in step S205. The virtual image of the X-coordinate line image is stored, for example, in the RAM 33, which is a storage unit.

FIG. 6 is a diagram schematically showing the processing from steps S201 to S206 in FIG. In FIG. 6, image display 10 is positioned at a first position (Near) near WS 50 in the Z direction, and image display 10 is displaying X coordinate line image 10x. The X-coordinate line image 10x is reflected by the WS 50, and a virtual image 60x of the X-coordinate line image 10x is generated in the virtual image display area 600. FIG.

The virtual image 60x includes a main image indicated by solid lines and a double image indicated by dashed lines. Although the double image is indicated by broken lines for the sake of convenience, it is actually a continuous line like the main image, and is displayed with a lower luminance than the main image. The virtual image 60x is captured by the imaging device 20 and stored in the RAM 33 or the like.

Here, the X-coordinate line image 10x is a line image in which five lines parallel to the Y direction are arranged at predetermined intervals, but is not limited to this. The X-coordinate line image 10x has a length that can cover the entire area where the HUD unit displays the virtual image, and the predetermined interval is preferably narrow within a range that does not hinder the separation of the main image and the double image.

Returning to the description of FIG. 5, next, in step S207, the imaging device control unit 330 determines whether imaging of the X-coordinate line image 10x has been completed at all predetermined positions. The processing from steps S204 to S206 in FIG. 5 is performed at a plurality of discrete locations in the X direction by moving the display position of the X coordinate line image 10x in the X direction. In step S207, it is determined whether or not the processes from steps S204 to S206 have been performed at all preset locations in the X direction.

If it is determined in step S207 that imaging has not been completed at all positions (in the case of NO), the process proceeds to step S208, and the display controller 320 selects a predetermined position for displaying the X-coordinate line image 10x. Shift in the X direction. After that, the process moves to step S204, and the same processing is repeated.

FIG. 7 is a diagram schematically showing how the display position of the X coordinate line image is moved in the X direction at the first position. In practice, the inspection is performed by displaying the X coordinate line image 10x at several tens of positions in the X direction. When the display position of the X-coordinate line image 10x moves, the positions of the main image and the double image in the virtual image 60x also move accordingly. A virtual image 60x of the X-coordinate line image 10x at all positions is captured by the imaging device 20 and stored in the RAM 33 or the like. In addition, in FIG. 7, the position of the image display 10 does not move.

Returning to the description of FIG. 5, if it is determined in step S207 that imaging has been completed at all positions (YES), the process proceeds to step S213. In steps S213 to S218, the same processing as in steps S203 to S208 is performed by replacing the X coordinate line image 10x with the Y coordinate line image 10y. As a result, all the processing of the flowchart shown in FIG. 5 ends. Note that the Y coordinate line image is, for example, an image in which a plurality of straight lines parallel to the X direction are juxtaposed at predetermined intervals. The Y coordinate of each line included in the Y coordinate line image is known.

FIG. 8 is a diagram schematically showing the processing from steps S213 to S216 in FIG. In FIG. 8, image display 10 is positioned at a first position (Near) near WS 50 in the Z direction, and image display 10 displays Y coordinate line image 10y. The Y-coordinate line image 10y is reflected by the WS 50, and a virtual image 60y of the Y-coordinate line image 10y is generated in the virtual image display area 600. FIG.

The virtual image 60y includes a main image indicated by solid lines and a double image indicated by dashed lines. Although the double image is indicated by broken lines for the sake of convenience, it is actually a continuous line like the main image, and is displayed with a lower luminance than the main image. The virtual image 60y is captured by the imaging device 20 and stored in the RAM 33 or the like.

Here, the Y-coordinate line image 10y is a line image in which five lines parallel to the X direction are arranged at predetermined intervals, but is not limited to this. The Y-coordinate line image 10y has a length that can cover the entire area where the HUD unit displays the virtual image, and the predetermined interval is preferably narrow within a range that does not hinder the separation of the main image and the double image.

Returning to the description of FIG. 5, next, in step S217, the imaging device control unit 330 determines whether imaging of the Y-coordinate line image 10y has been completed at all predetermined positions. The processing from steps S214 to S216 in FIG. 5 is performed at a plurality of discrete locations in the Y direction by moving the display position of the Y coordinate line image 10y in the Y direction. In step S217, it is determined whether or not the processes from steps S214 to S216 have been performed at all preset locations in the Y direction.

If it is determined in step S217 that imaging has not been completed at all positions (in the case of NO), the process proceeds to step S218, and the display controller 320 selects a predetermined position for displaying the Y-coordinate line image 10y. Shift in the Y direction. After that, the process moves to step S214, and the same processing is repeated.

FIG. 9 is a diagram schematically showing how the display position of the Y coordinate line image is moved in the Y direction at the first position. In practice, the inspection is performed by displaying the Y coordinate line images 10y at several tens of positions in the Y direction. When the display position of the Y-coordinate line image 10y moves, the positions of the main image and the double image in the virtual image 60y also move accordingly. A virtual image 60y of the Y-coordinate line image 10y at all positions is captured by the imaging device 20 and stored in the RAM 33 or the like. In addition, in FIG. 9, the position of the image display 10 does not move.

Returning to the description of FIG. 5, if it is determined in step S217 that imaging has been completed at all positions (YES), the processing of the flowchart shown in FIG. 5 ends.

Returning to the description of FIG. 4, next, in step S104, the image display 10 is set to the second position (Far), and inspection is started. Details of step S104 in FIG. 4 are shown in the flow chart in FIG. 10, except that the image display 10 is positioned at the second position (Far) farther from the WS 50 than the first position (Near) in the Z direction. This is the same as the processing of S218.

FIG. 11 is a diagram schematically showing the processing from steps S301 to S306 in FIG. In FIG. 11, image display 10 is positioned at a second position (Far) far from WS 50 in the Z direction, and image display 10 is displaying X coordinate line image 10x. The X-coordinate line image 10x is reflected by the WS 50, and a virtual image 60x of the X-coordinate line image 10x is generated in the virtual image display area 600. FIG.

The virtual image 60x includes a main image indicated by solid lines and a double image indicated by dashed lines. Although the double image is indicated by broken lines for the sake of convenience, it is actually a continuous line like the main image, and is displayed with a lower luminance than the main image. The virtual image 60x is captured by the imaging device 20 and stored in the RAM 33 or the like.

FIG. 12 is a diagram schematically showing how the display position of the X-coordinate line image is moved in the X direction at the second position. In practice, the inspection is performed by displaying the X coordinate line image 10x at several tens of positions in the X direction. When the display position of the X-coordinate line image 10x moves, the positions of the main image and the double image in the virtual image 60x also move accordingly. A virtual image 60x of the X-coordinate line image 10x at all positions is captured by the imaging device 20 and stored in the RAM 33 or the like. In addition, in FIG. 12, the position of the image display 10 does not move.

FIG. 13 is a diagram schematically showing the processing from steps S313 to S316 in FIG. In FIG. 13, image display 10 is positioned at a second position (Far) far from WS 50 in the Z direction, and image display 10 displays Y coordinate line image 10y. The Y-coordinate line image 10y is reflected by the WS 50, and a virtual image 60y of the Y-coordinate line image 10y is generated in the virtual image display area 600. FIG.

The virtual image 60y includes a main image indicated by solid lines and a double image indicated by dashed lines. Although the double image is indicated by broken lines for the sake of convenience, it is actually a continuous line like the main image, and is displayed with a lower luminance than the main image. The virtual image 60y is captured by the imaging device 20 and stored in the RAM 33 or the like.

FIG. 14 is a diagram schematically showing how the display position of the Y coordinate line image is moved in the Y direction at the second position. In practice, the inspection is performed by displaying the Y coordinate line images 10y at several tens of positions in the Y direction. When the display position of the Y-coordinate line image 10y moves, the positions of the main image and the double image in the virtual image 60y also move accordingly. A virtual image 60y of the Y-coordinate line image 10y at all positions is captured by the imaging device 20 and stored in the RAM 33 or the like. In addition, in FIG. 14, the position of the image display 10 does not move.

Returning to the description of FIG. 4, next, in step S105, the position of the main image light source is calculated. Details of step S105 in FIG. 4 are shown in the flow chart in FIG.

First, in step S401 of FIG. 15, the first XY coordinate calculation unit 341 of the image processing unit 340 reads the imaged data of the first position (Near). Specifically, the first XY coordinate calculation unit 341 calculates the data of the virtual images 60x of all the X coordinate line images 10x stored in step S206 in FIG. 5 and the virtual images 60y of all the Y coordinate line images 10y stored in step S216 data. For example, images 60x(1) to 60x(n) shown in FIG. 16(a) and images 60y(1) to 60y(m) shown in FIG. 16(b) can be read as data. Note that one square in FIGS. 16(a) and 16(b) indicates one pixel of the image pickup device 20. As shown in FIG.

An image 60x(1) shown in FIG. 16A is data of a virtual image 60x (white is the main image, gray is the double image) of the X-coordinate line image 10x captured first. An image 60x(2) is data of a virtual image 60x of the X-coordinate line image 10x captured for the second time after shifting the position. An image 60x(n) is data of a virtual image 60x of the X-coordinate line image 10x captured n-th time with the position shifted. This case is an example in which virtual images 60x of n pieces of X-coordinate line images 10x are picked up by shifting the positions.

Similarly, an image 60y(1) shown in FIG. 16(b) is data of a virtual image 60y (white is the main image, gray is the double image) of the Y-coordinate line image 10y captured first. An image 60y(2) is virtual image data of the Y-coordinate line image 10y captured for the second time after shifting the position. An image 60y(m) is data of a virtual image of the Y-coordinate line image 10y captured m-th time after shifting the position. In this case, it is an example in which virtual images 60y of m Y-coordinate line images 10y are picked up by shifting the positions.

Next, in step S402, the first XY coordinate calculator 341 extracts only the main image from the images 60x(1) to 60x(n) and the images 60y(1) to 60y(m) read out in step S401. For example, from the images of FIGS. 16(a) and 16(b), the main images of images 60x(1) to 60x(n) shown in FIG. 17(a) and the image 60y( 1) The main image from 60y(m) is extracted. Since the main image and the double image differ greatly in luminance, the main image and the double image can be easily distinguished.

Next, in step S403, the first XY coordinate calculation unit 341 calculates the main images of the images 60x(1) to 60x(n) and the main images of the images 60y(1) to 60y(m) extracted in step S402 for each pixel. to identify the coordinates. For example, as shown in FIGS. 18A and 18B, the coordinates are specified by labeling.

Next, in step S404, the first XY coordinate calculator 341 creates a main image projection matrix for the first position based on the coordinates specified in step S403. For example, a main image projection matrix for the first position is created as shown in FIG. Although only three coordinates are illustrated in FIG. 19, coordinates are specified for all pixels.

Here, a method for specifying coordinates from read imaging data by the first XY coordinate calculation unit 341 will be described in more detail.

First, the first XY coordinate calculator 341 selects a pixel (G1) whose coordinates are to be specified. Next, the first XY coordinate calculation unit 341 generates an image (for example, each image in FIG. 17A) by extracting only the main image from all the images obtained by capturing the virtual image 60x of the X coordinate line image 10x, and generates An image in which the pixel G1 and the main image are overlapped is selected from the obtained images. This will be described with reference to FIGS. 20 to 23. FIG.

20 to 23 are diagrams schematically showing the movement of the X-coordinate line image and the movement of the virtual image, and schematically showing how the virtual image 60x moves when the X-coordinate line image 10x is moved. . Here, in order to facilitate understanding, a virtual image 60x is used instead of the image read by the first XY coordinate calculation unit 341 for explanation. Although the main image and the virtual image are shown in FIGS. 20 to 23, the first XY coordinate calculator 341 actually uses an image obtained by extracting only the main image. 20 to 23, for the sake of convenience, the position in the virtual image display area 600 corresponding to the pixel G1 is marked with an X and indicated as P1 (that is, the X mark is not the displayed virtual image).

In FIG. 20, the main image included in the virtual image 60x does not overlap the position P1. FIG. 21 shows a virtual image 60x when the display position of the X-coordinate line image 10x is moved by a predetermined distance in the X-direction with respect to the position of FIG. In FIG. 21, the main image included in the virtual image 60x does not overlap the position P1.

FIG. 22 shows a virtual image 60x when the display position of the X-coordinate line image 10x is moved by a predetermined distance in the X-direction with respect to the position of FIG. In FIG. 22, the main image included in the virtual image 60x does not overlap the position P1.

FIG. 23 shows a virtual image 60x when the display position of the X-coordinate line image 10x is moved by a predetermined distance in the X-direction with respect to the position of FIG. In FIG. 23, the main image included in the virtual image 60x overlaps the position P1.

From the above results, it can be seen that the line X1 shown in FIG. 23 is displayed as the main image passing through the position P1. That is, assuming that the X coordinate of X1 is Xa (known), it can be seen that the ray passing through Xa is reflected by WS 50 and forms the main image at position P1.

Next, the first XY coordinate calculation unit 341 generates an image (for example, each image in FIG. 17B) by extracting only the main image from all images obtained by capturing the virtual image 60y of the Y coordinate line image 10y, and generates An image in which the pixel G1 and the main image are overlapped is selected from the obtained images. This will be described with reference to FIGS. 24 to 27. FIG.

24 to 27 are diagrams schematically showing the movement of the Y-coordinate line image and the movement of the virtual image, and schematically showing how the virtual image 60y moves when the Y-coordinate line image 10y is moved. . Here, in order to facilitate understanding, a virtual image 60y is used instead of the image read by the first XY coordinate calculation unit 341 for explanation. Although the main image and the virtual image are shown in FIGS. 24 to 27, the first XY coordinate calculator 341 actually uses an image obtained by extracting only the main image. 24 to 27, for the sake of convenience, the position in the virtual image display area 600 corresponding to the pixel G1 is marked with an X and indicated as P1 (that is, the X mark is not the displayed virtual image). For convenience, the line X1 identified in FIG. 23 is also shown on the image display 10. In FIG.

In FIG. 24, the main image included in virtual image 60y does not overlap position P1. FIG. 25 shows a virtual image 60y when the display position of the Y-coordinate line image 10y is moved by a predetermined distance in the Y+ direction with respect to the position shown in FIG. In FIG. 21, the main image included in virtual image 60y does not overlap position P1.

FIG. 26 shows a virtual image 60y when the display position of the Y-coordinate line image 10y is moved by a predetermined distance in the Y+ direction with respect to the position shown in FIG. In FIG. 26, the main image included in virtual image 60y does not overlap position P1.

FIG. 27 shows a virtual image 60y when the display position of the Y-coordinate line image 10y is moved by a predetermined distance in the Y+ direction with respect to the position shown in FIG. In FIG. 27, the main image included in the virtual image 60y overlaps the position P1.

From the above results, it can be seen that the line Y1 shown in FIG. 27 is displayed as the main image passing through the position P1. In other words, if the Y coordinate of Y1 is Ya (known), it can be seen that the ray passing through Ya is reflected by WS 50 and forms the main image at position P1.

Considering that the X coordinate is already specified as Xa in FIG. 23, the light ray passing through the position Pn1 whose XY coordinates are (Xa, Ya) is reflected by the WS 50 to form the main image at the position P1. It can be seen that

That is, the XY coordinates (sometimes referred to as first XY coordinates) of the first position corresponding to the pixel G1 are (Xa, Ya). Therefore, as shown in FIG. 28A, (Xa, Ya) is stored at the position of pixel G1 in the main image projection matrix at the first position. By performing the above processing for all the pixels of the image pickup device 20, the XY coordinates of the positions of all the pixels in FIG. 28(a) are specified, and the main image projection matrix for the first position is completed. The primary image projection matrix of the first position indicates which XY coordinates of the first position the ray should pass through in order to form the primary image at each pixel.

Returning to the description of FIG. 15, next, the processes of steps S405 to S408 are executed. The processing of steps S405 to S408 is the same as the processing of steps S401 to S404, except that the second XY coordinate calculation unit 342 of the image processing unit 340 reads the imaging data at the second position (Far). As a result, a main image projection matrix for the second position is created.

As in the case of the first position, the image data of the virtual image 60x when the X-coordinate line image 10x is moved shows that the line X2 shown in FIG. 29 is displayed as the main image passing through the position P1. I understand. In other words, if the X coordinate of X2 is Xb (known), it is assumed that the ray passing through Xb is reflected by WS 50 and forms the main image at position P1.

Also, it is assumed from the image data of the virtual image 60y when the Y-coordinate line image 10y is moved that the line Y2 shown in FIG. 29 is displayed as the main image passing through the position P1. In other words, if the Y coordinate of Y2 is Yb (known), it is assumed that the ray passing through Yb is reflected by the WS 50 and forms the main image at the position P1.

Considering that the X coordinate has already been specified as Xb, the light ray passing through the position Pf1 whose XY coordinates are (Xb, Yb) is reflected by the WS 50 and forms the main image at the position P1. I understand.

That is, the XY coordinates of the second position corresponding to the pixel G1 (sometimes referred to as second XY coordinates) are (Xb, Yb). Therefore, as shown in FIG. 28B, (Xb, Yb) is stored at the position of pixel G1 in the main image projection matrix at the second position. By performing the above processing for all the pixels of the image pickup device 20, the XY coordinates of the positions of all the pixels in FIG. 28(b) are specified, and the main image projection matrix for the second position is completed. The main image projection matrix at the second position indicates which XY coordinates at the second position the ray should pass through to form the main image at each pixel.

Considering together the results obtained in steps S401 to S404 and the results obtained in steps S405 to S408, as shown in FIG. The main image is generated at the position P1 within the display area 600. FIG. Note that the ray that forms the main image may be referred to as the main image ray. Also, a light ray that is the source of generating a double image may be referred to as a double image ray.

In this way, the main image displayed at an arbitrary position within the virtual image display area 600 is formed by a light ray that has passed through the first position (Near) or the second position (Far). can be identified. In other words, the main image displayed at an arbitrary position within the virtual image display area 600 is displayed at the first position (Near) and the second position ( It is possible to know which position of Far) was formed by the light ray that passed through.

Returning to the description of FIG. 15, next, in step S409, the optical path specifying unit 343 of the image processing unit 340 creates a main image light source position matrix. First, the optical path specifying unit 343 reads CAD data of the optical system of the HUD unit pre-stored in the RAM 33 or the like as a storage unit, and specifies the positions of the concave mirror and the light source of the HUD unit based on the read CAD data. Note that the light source of the HUD unit is a liquid crystal display device or the like that displays an image that is the basis of the virtual image.

Next, the optical path specifying unit 343 specifies the emission position of the light source that emits light to the optical path of the main image ray based on the specified positions of the concave mirror and the light source and the optical path of the main image ray. Specifically, the optical path identification unit 343 obtains the intersection point between the light ray R1 obtained in FIG. 30 and the concave mirror. For example, as shown in FIG. 31, the positions of the concave mirror 70 and the light source 80 of the HUD unit with respect to the position of the WS 50 are identified, and the intersection point I1 between the light ray R1 and the concave mirror 70 is obtained.

Next, the optical path identification unit 343 obtains a light ray R2 reflected at the position of the intersection I1 of the concave mirror 70. FIG. Since the three-dimensional shape of the reflecting surface of the concave mirror 70, the orientation of the reflecting surface, and the like are specified from the CAD data of the optical system of the HUD unit, the ray R2 can be obtained.

Next, the optical path identification unit 343 obtains an intersection point I2 between the light ray R2 and the light source 80. FIG. Since the position of the light source 80 is specified from the CAD data of the HUD unit, the intersection point I2 can be obtained. That is, based on the main image projection matrix at the first position, the main image projection matrix at the second position, and the CAD data of the optical system of the HUD unit, the emission of the light source 80 when the main image is displayed at the position P1 of the virtual image 60y The intersection point I2, which is the position, can be obtained. The optical path specifying unit 343 stores the obtained coordinates of the intersection point I2 at the position of the pixel G1 in the main image light source position matrix as shown in FIG.

By performing the above processing for all pixels of the image pickup device 20, the XY coordinates of the emission position of the light source 80 are specified for all pixels, and the main image light source position matrix is completed. The main image light source position matrix indicates from which position of the light source 80 light rays are emitted in order to form the main image in each pixel.

With the main image light source position matrix, for example, as schematically shown in FIG. 32, the display position of the main image within the virtual image display area 600 with respect to an arbitrary emission position of the light source 80 can be specified. Note that the actual emission positions of the light sources 80 are much larger than the number shown. This completes the description of step S409.

Returning to the description of FIG. 4, next, in step S106, the optical path specifying unit 343 calculates the double image light source position. Details of step S106 in FIG. 4 are shown in the flow chart of FIG.

The processing of steps S501 to S509 shown in FIG. 33 is the same as the processing of steps S401 to S409 shown in FIG. 15 except that the optical path specifying unit 343 handles a double image instead of the main image. That is, the optical path specifying unit 343 determines the emission position of the light source that emits the light beam to the optical path of the double image light beam based on the positions of the concave mirror and the light source of the HUD unit specified based on the CAD data and the optical path of the double image light beam. identify. As a result, a double image light source position matrix similar to that of FIG. 31 is created. A double image display position for an arbitrary emission position of the light source 80 can be specified by the double image light source position matrix.

Next, in step S107, the data calculation unit 344 of the image processing unit 340 calculates main image distortion. First, the image processing unit 340 reads CAD data of a windshield (hereinafter referred to as windshield (CAD)) stored in advance in the RAM 33 or the like that is a storage unit. Then, when a windshield (CAD) is used, it is calculated at which position in the virtual image display area 600 the main image is formed by the rays emitted from the respective emission positions of the light source 80 (see FIG. 32, etc.).

Next, the data calculation unit 344 calculates the position of the main image formed when the main image beam emitted from the same emission position of the light source 80 uses the windshield (CAD) read from the storage unit and the WS50 to be measured. is compared with the position of the main image formed when using , and the main image distortion is calculated based on the difference between the two. The data calculator 344 calculates the main image distortion for all emission positions of the light source 80 based on the difference.

Next, in step S108, the data calculator 344 calculates double image distortion. Specifically, the data calculator 344 calculates the position of the main image generated by the main image ray emitted from the same emission position of the light source 80 and the double image ray generated by the double image ray emitted from the same emission position of the light source 80 . The positions of the images are compared, and the double image distortion is calculated based on the difference between the two. The data calculation unit 344 calculates the double image distortion based on the above difference for all emission positions of the light source 80 . The position of the main image generated by the principal image ray emitted from the same emission position of the light source 80 and the position of the double image generated by the double image ray have already been obtained in the processes from steps S103 to S106. ing.

Next, in step S109, the data calculation unit 344 compares the main image distortion calculated in step S107 and the double image distortion calculated in step S108 with a predetermined threshold value, and performs quality determination. The data calculation unit 344 transmits the determination result to the inspection result output unit 40, and the inspection result output unit 40 outputs the inspection result as video, audio, data, or the like. All the processes shown in FIG. 4 are thus completed.

If necessary, the inspection apparatus 1 changes the WS 50 to another windshield to perform the inspection. If inspection is to be performed, the process proceeds to step S101 in FIG. 4 and repeats the same processing as described above. The controller 30 may be provided with input means for inputting the measurement conditions from the outside, and the operator of the inspection apparatus 1 may input the number of windshields to be inspected in advance. In this case, the processing from steps S101 to S109 is repeated until the control unit 30 determines that the number input from the input means has been reached.

Also, in order to correspond to different viewpoint positions of the driver, the same WS 50 may be inspected by sequentially changing (moving) the imaging device 20 to different positions.

This completes the description of the measurement of the main image distortion and the double image distortion, but the inspection apparatus 1 can also inspect glass parameters in addition to the main image distortion and the double image distortion.

FIG. 34 is an example of a flowchart showing a method of inspecting parameters of glass using the inspection apparatus according to the present embodiment.

First, in step S601, the optical path specifying unit 343 of the image processing unit 340 obtains the intersection of the light beam R1 incident on the WS50 and the main image line of sight E1. For example, if the light ray R1 shown in FIG. 31 can be specified, the main image line of sight E1 for the light ray R1 can be specified as shown in FIG. can.

Next, in step S602, the optical path specifying unit 343 calculates the angle of the fourth plane M4, which is the plane inside the vehicle of the WS 50, at the intersection of the light ray R1 and the main image line of sight E1. Since the main image is generated by being reflected by the fourth surface M4 of the WS 50, considering that the angle of incidence and the angle of reflection are the same, as shown in FIG. The angle of the fourth surface M4 of the WS50 (angle with respect to the horizontal plane) can be calculated. Since the intersection of the rays and the principal image line of sight can be obtained for all rays, the angle of the entire fourth surface M4 of WS50 can be obtained.

Next, in step S603, the data calculation unit 344 of the image processing unit 340 calculates the position and angle of the first surface M1, which is the surface of the WS 50 on the outside of the vehicle. As shown in FIG. 34(c), considering the double image generated at the position P5, this double image is caused by the ray R5 incident on the fourth surface M4 being refracted at the fourth surface M4, and the WS50 The light is reflected by the first surface M1, which is a surface on the vehicle outer side, and is refracted again by the fourth surface M4. Since the angle of the fourth surface M4 has already been obtained, the position and angle of the first surface M1 can be obtained. By considering all double images, the position and angle of the entire first surface M1 of WS50 can be obtained.

Next, in step S604, the data calculation unit 344 calculates related items. Here, the related items are values calculated based on the information obtained in steps S601 to S603, such as the thickness of the WS 50 and the wedge angle distribution.

The data calculation unit 344 transmits, for example, the surface shape of the WS 50 and the wedge angle distribution to the inspection result output unit 40, and the inspection result output unit 40 outputs the inspection result as video, audio, data, and the like. Alternatively, the data calculation unit 344 compares the shape of the surface of the WS 50 and the wedge angle distribution with the CAD data of the windshield, and transmits the comparison result to the inspection result output unit 40, and the inspection result output unit 40 displays the comparison result as an image. , voice, data, etc. may be output.

As described above, in the inspection apparatus 1, the first XY coordinate calculation unit 341 emits a light beam that serves as a base for forming an arbitrary point of the virtual image when the image display device 10 is at the first position (Near). A first XY coordinate of a point in the inspection image is obtained. Further, the second XY coordinate calculation unit 342 calculates the point of the inspection image from which the original light beam for forming an arbitrary point of the virtual image is emitted when the image display device 10 is at the second position (Far). Obtain the second XY coordinates.

Then, the optical path specifying unit 343 specifies the first XY coordinates and the second XY coordinates from which light beams are emitted to form the same point of the virtual image, thereby forming each point of the entire display area of the virtual image. Identify the optical path of the light ray that is the source of the Then, the data calculation unit 344 calculates the main image distortion as data related to the quality of the glass based on the optical path specified by the optical path specifying unit 343 and the design data (for example, CAD data) of the optical system of the head-up display unit. data, double image distortion data, glass thickness data, glass wedge angle data, and glass surface shape data.

According to the inspection apparatus 1, it is possible to inspect the quality of the glass on which the image of the HUD unit is projected without using the HUD unit.

Although the preferred embodiments and the like have been described in detail above, the present invention is not limited to the above-described embodiments and the like, and various modifications and substitutions can be made to the above-described embodiments and the like without departing from the scope of the claims. can be added.

For example, in the above embodiment, light for forming each point in the entire display area of the virtual image passes through based on the data acquired at the first position (Near) and the second position (Far). identified the optical path. However, it is not limited to this, and an optical path through which light passes for forming each point in the entire virtual image display area may be specified based on data acquired at three or more locations with different coordinates in the Z direction. good.

In the above embodiment, the XY coordinates of the first position and the second position corresponding to the projection position of the virtual image are obtained while moving the X coordinate line image and the Y coordinate line image whose coordinates are clear. However, the inspection image is not limited to this, and for example, a checkerboard pattern image that allows simultaneous identification of the X and Y coordinates, or a pattern image that allows the coordinates to be determined based on the difference in color may be used. Using these images is preferable in that the number of times of imaging can be reduced.

1 inspection device 10 image display device 10x X-coordinate line image 10y Y-coordinate line image 20 imaging device 30 control unit 31 CPU
32 ROMs
33 RAM
34 interfaces
35 Bus line 40 Inspection result output unit 50 Windshield (WS)
60, 60x, 60y Virtual image 70 Concave mirror 80 Light source 310 Display device positioning unit 320 Display device control unit 330 Image pickup device control unit 340 Image processing unit 341 First XY coordinate calculation unit 342 Second XY coordinate calculation unit 343 Optical path identification unit 344 Data calculation unit 600 Virtual image display area

Claims (8)

A glass inspection device used in combination with a head-up display unit,
an image display;
an imaging device that captures a virtual image generated by projecting the inspection image displayed on the image display onto the glass;
an image processing unit that processes image data of the virtual image captured by the imaging device;
a storage unit storing in advance design data of the optical system of the head-up display unit ;
When the direction of gravity is defined as the Z direction, and the X direction and the Y direction that intersect each other in a plane that intersects the Z direction are defined, the image display device has at least a first position and the first position is a coordinate in the Z direction. is configured to be movable to different second positions,
The image processing unit
A first XY coordinate calculation unit for obtaining a first XY coordinate of a point of the inspection image from which a light beam forming an arbitrary point of the virtual image is emitted when the image display is at the first position. and,
A second XY coordinate calculator for calculating a second XY coordinate of a point of the inspection image from which a light beam forming an arbitrary point of the virtual image is emitted when the image display is at the second position. and,
By specifying the first XY coordinates and the second XY coordinates from which light rays are emitted, which are the basis for forming the same point of the virtual image, the basis for forming each point in the entire display area of the virtual image. an optical path specifying unit that specifies the optical path of the light ray,
a data calculation unit that calculates data related to the quality of the glass based on the optical path specified by the optical path specifying unit ;
The virtual image includes a main image and a double image,
The first XY coordinate calculator calculates a point of the inspection image from which a main image ray is emitted to form an arbitrary point of the main image when the image display is at the first position. find the first XY coordinates of the main image of the double image, and find the first XY coordinates of the double image of the point of the inspection image from which the original double image light beam for forming an arbitrary point of the double image is emitted,
The second XY coordinate calculator calculates a point of the inspection image from which a main image ray is emitted as a base for forming an arbitrary point of the main image when the image display is at the second position. find the second XY coordinates of the main image of the double image, and find the second XY coordinates of the double image of the point of the inspection image from which the original double image light beam for forming an arbitrary point of the double image is emitted,
The optical path specifying unit specifies the main image first XY coordinates and the main image second XY coordinates from which the main image ray is emitted to form the same point of the main image. In addition to specifying the optical path of the main image ray that is the source for forming each point in the entire display area of the above, By specifying the first XY coordinates of the double image and the second XY coordinates of the double image, an optical path of the double image ray that is the source for forming each point in the entire display area of the double image is specified, and further the storage is performed. The position of the concave mirror and the light source of the head-up display unit is specified based on the design data read from the unit, and the position of the main image ray is determined based on the positions of the concave mirror and the light source and the optical path of the main image ray. A glass inspection apparatus for specifying the emission position of the light source that emits light to the optical path . The storage unit stores design data of the glass in advance,
The data calculation unit
The position of the main image formed when the main image ray emitted from the same emission position of the light source uses the design data of the glass read from the storage unit, and the position of the main image formed when the glass to be measured is used. 2. A glass inspection apparatus according to claim 1 , wherein the position of the main image is compared and the main image distortion is calculated based on the difference between the two. The optical path specifying unit
3. The glass according to claim 1 or 2 , wherein an emission position of the light source that emits light to the optical path of the double image light is specified based on the positions of the concave mirror and the light source and the optical path of the double image light. inspection equipment. The data calculation unit
comparing the position of the main image generated by the principal image ray emitted from the same emission position of the light source and the position of the double image generated by the double image ray emitted from the same emission position of the light source; 4. The glass inspection apparatus according to claim 3 , wherein the double image distortion is calculated based on the difference between . The data calculator calculates any one of the thickness data of the glass, the wedge angle data of the glass, and the surface shape data of the glass based on the optical path of the main image ray and the optical path of the double image ray. 5. The glass inspection apparatus according to any one of claims 1 to 4 , wherein one or more of the above is calculated. The glass inspection apparatus according to any one of claims 1 to 5 , wherein the inspection image is directly projected onto the glass without an optical system. The glass inspection apparatus according to any one of claims 1 to 6 , wherein the glass is a vehicle windshield. A glass inspection method used in combination with a head-up display unit,
an imaging step of imaging a virtual image generated by projecting the inspection image displayed on the image display onto the glass;
an image processing step of processing the image data of the virtual image captured in the imaging step;
When the direction of gravity is defined as the Z direction, and the X direction and the Y direction that intersect each other in a plane that intersects the Z direction are defined, the image display device has at least a first position and the first position is a coordinate in the Z direction. is configured to be movable to different second positions,
The image processing step includes:
A first XY coordinate calculation step of obtaining a first XY coordinate of a point of the inspection image from which a light beam forming an arbitrary point of the virtual image is emitted when the image display is at the first position. and,
A second XY coordinate calculation step of obtaining a second XY coordinate of a point of the inspection image from which a light beam forming an arbitrary point of the virtual image is emitted when the image display is at the second position. and,
By specifying the first XY coordinates and the second XY coordinates from which light rays are emitted, which are the basis for forming the same point of the virtual image, the basis for forming each point in the entire display area of the virtual image. an optical path identification step of identifying the optical path of a ray of
a data calculation step of calculating data related to the quality of the glass based on the optical path identified in the optical path identification step ;
The virtual image includes a main image and a double image,
In the first XY coordinate calculation step, when the image display device is at the first position, a point of the inspection image emitted from which a main image ray forming an arbitrary point of the main image is emitted. find the first XY coordinates of the main image of the double image, and find the first XY coordinates of the double image of the point of the inspection image from which the original double image light beam for forming an arbitrary point of the double image is emitted,
In the second XY coordinate calculation step, when the image display device is at the second position, a point of the inspection image emitted from which a main image ray forming an arbitrary point of the main image is emitted. find the second XY coordinates of the main image of the double image, and find the second XY coordinates of the double image of the point of the inspection image from which the original double image light beam for forming an arbitrary point of the double image is emitted,
In the optical path specifying step, the main image first XY coordinates and the main image second XY coordinates from which the main image ray is emitted to form the same point of the main image are specified. In addition to specifying the optical path of the main image ray that is the source for forming each point in the entire display area of the above, By specifying the first XY coordinates of the double image and the second XY coordinates of the double image, the optical path of the double image light beam that is the source for forming each point in the entire display area of the double image is specified, and further the head The positions of the concave mirror and the light source of the head-up display unit are specified based on the design data read from the storage unit that stores the design data of the optical system of the up-display unit in advance, and the positions of the concave mirror and the light source are determined. A method of inspecting glass, wherein an emission position of the light source that emits light to the optical path of the main image ray is specified based on the optical path of the main image ray.

Images