JP2021067528A - Glass inspection device and glass inspection method - Google Patents

Abstract

To provide a glass inspection device with which it is possible to inspect the quality of glass to which the image of a HUD unit is projected, without using a HUD unit.SOLUTION: The glass inspection device comprises: an image display 10; an imaging device 20 for imaging the virtual image generated as an image for inspection that is displayed on the image display is projected to a glass 50; and an image processing unit for processing the image data of the virtual image imaged by the imaging device. The image display is constituted so as to be movable at least to a first position and a second position differing in Z axis coordinate from the first position. The image processing unit includes an optical path specification unit for specifying the optical path of a beam that is the source of forming the respective points of the whole display area of the virtual image when located at the first position and at the second position, and a data calculation unit for calculating the data associated with the quality of the glass on the basis of the optical path specified by the optical path specification unit.SELECTED DRAWING: Figure 1

Description

The present invention relates to a glass inspection device and a glass inspection method.

A head-up display unit (hereinafter referred to as a HUD unit) is a device mounted on a vehicle that magnifies an image with a concave mirror and projects it onto the glass of the vehicle so that a virtual image of the image is visually displayed to the driver from inside the vehicle. Is. It is important to inspect the quality of the glass on which the image is projected, as the visibility of the virtual image by the driver is affected by the quality of the glass on which the image is projected.

Since the HUD unit projects an image through a concave mirror, when inspecting the quality of the glass on which the image is projected, a method of inspecting using a HUD unit including a concave mirror is common (see, for example, Patent Document 1). ).

JP-A-2015-75381

However, the HUD unit differs depending on the vehicle model, and it is difficult to obtain the HUD unit during the preparation for production. Further, when inspecting the glass, the concave mirror of the HUD unit may be moved, but a control circuit and a control program for moving the concave mirror are required, and preparation is required. Further, if the concave mirror of the HUD unit is moved during the inspection of the glass, the durability of the HUD unit also becomes a problem. Thus, the use of HUD units for glass inspection involves various problems.

The present invention has been made in view of the above points, and an object of the present invention is to provide a glass inspection apparatus capable of inspecting the quality of glass on which an image of the HUD unit is projected without using the HUD unit. To do.

The glass inspection device is a glass inspection device used in combination with a head-up display unit, and is generated by projecting an image display and an inspection image displayed on the image display onto the glass. It has an imager that captures a virtual image and an image processing unit that processes the image data of the virtual image captured by the imager, and the direction of gravity is the Z direction, and they intersect each other in a plane that intersects the Z direction. When the X direction and the Y direction are defined, the image display is configured to be movable to at least a first position and a second position whose coordinates in the Z direction are different from those of the first position, and the image processing unit is described. With the first XY coordinate calculation unit that obtains the first XY coordinates of the points of the inspection image from which the light rays that are the source for forming an arbitrary point of the virtual image are emitted when the image display is in the first position. Second XY coordinate calculation for obtaining the second XY coordinates of the points of the inspection image from which the light rays that are the source for forming an arbitrary point of the virtual image are emitted when the image display is in the second position. To form each point of the entire display area of the virtual image by specifying the first XY coordinates and the second XY coordinates from which the light beam that is the source of forming the same point of the virtual image is emitted. It has an optical path specifying unit that specifies the optical path of the light beam that is the source of the image, and a data calculating unit that calculates data related to the quality of the glass based on the optical path specified by the optical path specifying unit.

According to one embodiment of the disclosure, it is possible to provide a glass inspection apparatus capable of inspecting the quality of the glass on which the image of the HUD unit is projected without using the HUD unit.

It is a schematic diagram which shows an example of the inspection apparatus which concerns on this embodiment. It is an example of the hardware block diagram of the control part of the inspection apparatus which concerns on this embodiment. This is an example of a functional block diagram of the control unit of the inspection device according to the present embodiment. This is an example of a flowchart showing an inspection method using the inspection device according to the present embodiment. This is an example of a flowchart showing the details of step S103 of FIG. It is a figure which shows typically the process from step S201 to S206 of FIG. It is a figure which shows typically the mode that the display position of the X coordinate line image is moved in the X direction at the 1st position. It is a figure which shows typically the process from step S213 to S216 of FIG. It is a figure which shows typically the mode that the display position of the Y coordinate line image is moved in the Y direction at the 1st position. This is an example of a flowchart showing the details of step S104 of FIG. It is a figure which shows typically the process from step S301 to S306 of FIG. It is a figure which shows typically the mode that the display position of the X coordinate line image is moved in the X direction at the 2nd position. It is a figure which shows typically the process from step S313 to S316 of FIG. It is a figure which shows typically the mode that the display position of the Y coordinate line image is moved in the Y direction at the 2nd position. This is an example of a flowchart showing the details of step S105 in FIG. It is an example of the virtual image data of the X coordinate line image and the Y coordinate line image. It is an example of the data of the main image of the X coordinate line image and the Y coordinate line image. It is a figure which shows the example which specifies the coordinates by labeling the main image for each pixel. It is a figure which shows an example of the main image projection matrix of a 1st position. It is a figure (the 1) which shows typically the movement of the X coordinate line image and the movement of a virtual image. It is a figure (the 2) which shows typically the movement of the X coordinate line image and the movement of a virtual image. It is a figure (the 3) which shows typically the movement of the X coordinate line image and the movement of a virtual image. It is a figure (the 4) which shows typically the movement of the X coordinate line image and the movement of a virtual image. It is a figure (the 1) which shows typically the movement of the Y coordinate line image and the movement of a virtual image. It is a figure (No. 2) which shows typically the movement of the Y coordinate line image and the movement of a virtual image. It is a figure (the 3) which shows typically the movement of the Y coordinate line image and the movement of a virtual image. It is a figure (4) which shows typically the movement of the Y coordinate line image and the movement of a virtual image. It is a figure which shows an example of the main image projection matrix of a 1st position and a 2nd position. It is a figure explaining the identification of the XY coordinates in the 2nd position. It is a figure explaining the identification of the main image ray. It is a figure explaining the identification of the position of the concave mirror and the light source of the HUD unit. It is a figure explaining the identification of the display position of the main image in the virtual image display area with respect to the arbitrary emission position of a light source. This is an example of a flowchart showing the details of step S106 of FIG. This is an example of a flowchart showing a method of inspecting glass parameters using the inspection apparatus according to the present embodiment. It is a figure explaining the inspection method of the parameter of a glass using the inspection apparatus which concerns on this embodiment.

Hereinafter, modes for carrying out the invention will be described with reference to the drawings. In each drawing, the same components may be designated by the same reference numerals and duplicate description may be omitted.

[Overview of inspection equipment]
FIG. 1 is a schematic view showing an example of an inspection device according to the present embodiment. Referring to FIG. 1, the inspection device 1 is an inspection device capable of inspecting glass used in combination with the HUD unit without using the HUD unit, and is an image display 10, an imager 20, and a control unit 30. And an inspection result output unit 40. The inspection device 1 can calculate data related to the quality of the glass used in combination with the HUD unit.

Here, the data related to the quality of the glass is, for example, the main image distortion or the double image distortion (distance between the main image and the double image) in the virtual image generated by reflecting the light from the HUD unit by the glass. , Glass thickness, surface shape, wedge angle, etc.

In the following description, a vehicle windshield (WS50) will be illustrated as an example of the glass to be inspected, but the glass to be inspected is not limited to the windshield of the vehicle.

In FIG. 1, the WS50 is mounted at the same angle as when mounted on a vehicle. Further, in FIG. 1, reference numeral 60 denotes a virtual image in which the inspection image displayed by the image display 10 is reflected by the WS50 and captured by the imager 20. That is, 60 is a virtual image that can be visually recognized if the driver of the vehicle is on board at the position of the imager 20. Hereinafter, the inspection device 1 will be described in detail.

The image display 10 generates and displays an inspection image under the control of the control unit 30. The inspection image displayed on the image display 10 is directly projected onto the WS 50 without an optical element such as a mirror, and a virtual image 60 is generated. As the image display 10, for example, a liquid crystal display device or the like is used.

When the gravitational direction (vertical direction when the WS50 is attached to the vehicle) is the Z direction and the X and Y directions intersecting each other in the plane intersecting the Z direction are defined, the image display 10 is controlled by the control unit 30. It is configured to be movable to at least two positions (for example, a first position and a second position described later) having different coordinates in the Z direction.

In the following description, it is assumed that the image display 10 can move in the Z direction, the X and Y directions orthogonal to each other in the plane orthogonal to the Z direction are defined, and the X direction is when the WS50 is attached to the vehicle. The front-rear direction and the Y direction of the vehicle are the left-right directions of the vehicle when the WS50 is attached to the vehicle. However, the present invention is not limited to this, and for example, the image display 10 may be moved in an oblique direction with respect to the Z direction. Further, the X direction and the Y direction do not have to be orthogonal to each other.

The imager 20 captures a virtual image 60 generated by projecting an inspection image displayed on the image display 10 onto the WS50. The imager 20 is configured so that the imaging direction can be adjusted to an arbitrary angle in the horizontal plane and the vertical plane in order to enable the virtual image 60 to be imaged. Further, the imager 20 is configured to be movable in the X direction, the Y direction, and the Z direction. The imager 20 is controlled by, for example, the control unit 30 and moves in a predetermined direction. The imaging direction corresponds to the line-of-sight direction of the driver of the vehicle during actual use. As the imager 20, for example, a CCD (Charge-Coupled Device) camera, a CMOS (Complementary Metal-Oxide-Semiconductor) camera, or the like can be used.

The control unit 30 is a unit that controls the image display 10, the imager 20, the inspection result output unit 40, and the like. The control unit 30 will be described later.

The inspection result output unit 40 is a unit that outputs the inspection result of the inspection device 1. As the inspection result output unit 40, for example, a liquid crystal display device, an organic EL display device, or the like may be used to visually display the inspection result as an image or a numerical value. Alternatively, the inspection result output unit 40 may be configured to output the inspection result as data to the outside, may be configured to output the inspection result to the outside as sound, or may have another configuration.

FIG. 2 is an example of a hardware block diagram of the control unit of the inspection device according to the present embodiment. As shown in FIG. 2, the control unit 30 has a CPU 31, a ROM 32, a RAM 33, an I / F 34, and a bus line 35 as main components. The CPU 31, ROM 32, RAM 33, and I / F 34 are connected to each other via a bus line 35. The control unit 30 may have other hardware blocks, if necessary.

The CPU 31 controls each function of the control unit 30. The ROM 32, which is a storage unit, stores a program executed by the CPU 31 to control each function of the control unit 30 and various information. The RAM 33, which is a storage unit, is used as a work area or the like of the CPU 31. Further, the RAM 33 can temporarily store predetermined information. The I / F 34 is an interface for connecting to another device or the like, and is connected to, for example, an external network or the like.

The control unit 30 includes a processor programmed to execute each function by software such as a processor implemented by an electronic circuit, an ASIC (Application Specific Integrated Circuit) designed to execute a predetermined function, and a DSP (digital). It may be a signal processor), an FPGA (field programmable gate array), an SOC (System on a chip), or a GPU (Graphics Processing Unit). Further, the control unit 30 may be a circuit module or the like.

FIG. 3 is an example of a functional block diagram of the control unit of the inspection device according to the present embodiment. As shown in FIG. 3, the control unit 30 includes a display positioning unit 310, a display control unit 320, an imager control unit 330, and an image processing unit 340 as main functional blocks. The image processing unit 340 is a unit that processes image data of a virtual image captured by the imager 20, and includes a first XY coordinate calculation unit 341, a second XY coordinate calculation unit 342, an optical path identification unit 343, and a data calculation unit 344. have. The control unit 30 may have other functional blocks, if necessary. Further, the image processing unit 340 may have other functional blocks as needed. The functions of each functional block of the control unit 30 will be described in the description of the flowchart described later.

[Inspection method using inspection equipment]
FIG. 4 is an example of a flowchart showing an inspection method using the inspection device according to the present embodiment. First, in step S101, WS50 is set. Since the positional relationship between the WS50 and the HUD unit during actual use is set for each vehicle type, here, the WS50 is specified so that the positional relationship between the WS50 and the image display 10 corresponds to the setting during actual use. Set to the position. The WS50 can be carried, for example, mounted on a belt conveyor and set in a predetermined position using a robot, but the WS50 is not limited to this.

Next, in step S102, the imager control unit 330 positions the imager 20 at a predetermined position where the virtual image 60 of the inspection image displayed by the image display 10 can be imaged. The imager 20 is positioned, for example, to come to the position of the standard eye point of the driver of the vehicle.

Next, in step S103, the image display 10 is set to the first position (Near) and the inspection is started. The details of step S103 of FIG. 4 are shown in the flowchart of FIG.

First, in step S201 of FIG. 5, the display positioning unit 310 positions the position of the image display 10 to the first position (Near). Next, in step S202, the imager control unit 330 determines the focus of the imager 20. That is, the imager control unit 330 adjusts the focus of the imager 20 to an optimum position where the virtual image 60 of the inspection image displayed at the first position can be imaged.

Next, in step S203, the display control unit 320 generates an X coordinate line image as an inspection image. The X coordinate line image is, for example, an image in which a plurality of straight lines parallel to the Y direction are juxtaposed at predetermined intervals. X coordinate line The X coordinate of each line included in the image is known.

Next, in step S204, the display control unit 320 displays the X coordinate line image at a predetermined position of the image display 10. Next, in step S205, the imager control unit 330 images the virtual image 60 of the X coordinate line image with the imager 20. Next, in step S206, the imager control unit 330 stores a virtual image of the X coordinate line image captured in step S205. The virtual image of the X coordinate line image is stored in, for example, the RAM 33, which is a storage unit.

FIG. 6 is a diagram schematically showing the processes of steps S201 to S206 of FIG. In FIG. 6, the image display 10 is positioned at the first position (Near) close to the WS50 in the Z direction, and the image display 10 displays the X coordinate line image 10x. The X coordinate line image 10x is reflected by WS50, and a virtual image 60x of the X coordinate line image 10x is generated in the virtual image display area 600.

The virtual image 60x includes a main image shown by a solid line and a double image shown by a broken line. However, although the double image is shown by a broken line for convenience, it is actually one continuous line like the main image, and is displayed with lower brightness than the main image. The virtual image 60x is imaged by the imager 20 and stored in the RAM 33 or the like.

Here, the X coordinate line image 10x is a line image in which five lines parallel to the Y direction are arranged at predetermined intervals, but the present invention is not limited to this. The X coordinate line image 10x is preferably long enough to cover the entire area where the HUD unit displays a virtual image, and the predetermined interval is narrow as long as it does not interfere with the separation of the main image and the double image.

Returning to the description of FIG. 5, next, in step S207, the imager control unit 330 determines whether or not the imaging of the X coordinate line image 10x is completed at all the predetermined positions. The processes from steps S204 to S206 in FIG. 5 are executed at a plurality of discrete locations in the X direction by moving the display position of the X coordinate line image 10x in the X direction. In step S207, it is determined whether or not the processes from steps S204 to S206 have been executed at all preset locations in the X direction.

If it is determined in step S207 that the imaging has not been completed at all the positions (NO), the process proceeds to step S208, and the display control unit 320 sets a predetermined position for displaying the X coordinate line image 10x. Shift in the X direction. After that, the process proceeds to step S204, and the same process is repeated.

FIG. 7 is a diagram schematically showing how the display position of the X coordinate line image is moved in the X direction at the first position. Actually, the X coordinate line image 10x is displayed at several tens of positions in the X direction for inspection. When the display position of the X coordinate line image 10x moves, the positions of the main image and the double image in the virtual image 60x also move accordingly. A virtual image 60x of the X coordinate line image 10x at all positions is imaged by the imager 20, and stored in the RAM 33 or the like. In FIG. 7, the position of the image display 10 does not move.

Returning to the description of FIG. 5, when it is determined in step S207 that the imaging is completed at all the positions (YES), the process proceeds to step S213. In steps S213 to S218, the X coordinate line image 10x is replaced with the Y coordinate line image 10y, and the same processing as in steps S203 to S208 is executed. As a result, all the processing of the flowchart shown in FIG. 5 is completed. The Y coordinate line image is, for example, an image in which a plurality of straight lines parallel to the X direction are juxtaposed at predetermined intervals. Y coordinate line The Y coordinate of each line included in the image is known.

FIG. 8 is a diagram schematically showing the processes from steps S213 to S216 of FIG. In FIG. 8, the image display 10 is positioned at the first position (Near) close to the WS50 in the Z direction, and the image display 10 displays the Y coordinate line image 10y. The Y coordinate line image 10y is reflected by the WS50, and a virtual image 60y of the Y coordinate line image 10y is generated in the virtual image display area 600.

The virtual image 60y includes a main image shown by a solid line and a double image shown by a broken line. However, although the double image is shown by a broken line for convenience, it is actually one continuous line like the main image, and is displayed with lower brightness than the main image. The virtual image 60y is imaged by the imager 20 and stored in the RAM 33 or the like.

Here, the Y coordinate line image 10y is a line image in which five lines parallel to the X direction are arranged at predetermined intervals, but the present invention is not limited to this. The Y coordinate line image 10y has a length that can cover the entire area where the HUD unit displays a virtual image, and it is preferable that the predetermined interval is narrow as long as the separation between the main image and the double image is not hindered.

Returning to the description of FIG. 5, next, in step S217, the imager control unit 330 determines whether or not the imaging of the Y coordinate line image 10y is completed at all the predetermined positions. The processes from steps S214 to S216 in FIG. 5 are executed at a plurality of discrete locations in the Y direction by moving the display position of the Y coordinate line image 10y in the Y direction. In step S217, it is determined whether or not the processes from steps S214 to S216 have been executed at all preset locations in the Y direction.

If it is determined in step S217 that the imaging has not been completed at all the positions (NO), the process proceeds to step S218, and the display control unit 320 sets a predetermined position for displaying the Y coordinate line image 10y. Shift in the Y direction. After that, the process proceeds to step S214, and the same process is repeated.

FIG. 9 is a diagram schematically showing how the display position of the Y coordinate line image is moved in the Y direction at the first position. Actually, the Y coordinate line image 10y is displayed at several tens of positions in the Y direction for inspection. When the display position of the Y coordinate line image 10y moves, the positions of the main image and the double image in the virtual image 60y also move accordingly. The virtual image 60y of the Y coordinate line image 10y at all positions is imaged by the imager 20, and stored in the RAM 33 or the like. In FIG. 9, the position of the image display 10 does not move.

Returning to the description of FIG. 5, when it is determined in step S217 that the imaging is completed at all the positions (YES), all the processing of the flowchart shown in FIG. 5 is completed.

Returning to the description of FIG. 4, next, in step S104, the image display 10 is set to the second position (Far) and the inspection is started. The details of step S104 of FIG. 4 are shown in the flowchart of FIG. The processing of steps S301 to S318 shown in FIG. 10 is performed in steps S201 to S201 shown in FIG. 5, except that the image display 10 is positioned in the second position (Far) farther from the WS50 than the first position (Near) in the Z direction. This is the same as the process of S218.

FIG. 11 is a diagram schematically showing the processes of steps S301 to S306 of FIG. In FIG. 11, the image display 10 is positioned at a second position (Far) far from the WS50 in the Z direction, and the image display 10 displays the X coordinate line image 10x. The X coordinate line image 10x is reflected by WS50, and a virtual image 60x of the X coordinate line image 10x is generated in the virtual image display area 600.

The virtual image 60x includes a main image shown by a solid line and a double image shown by a broken line. However, although the double image is shown by a broken line for convenience, it is actually one continuous line like the main image, and is displayed with lower brightness than the main image. The virtual image 60x is imaged by the imager 20 and stored in the RAM 33 or the like.

FIG. 12 is a diagram schematically showing how the display position of the X coordinate line image is moved in the X direction at the second position. Actually, the X coordinate line image 10x is displayed at several tens of positions in the X direction for inspection. When the display position of the X coordinate line image 10x moves, the positions of the main image and the double image in the virtual image 60x also move accordingly. A virtual image 60x of the X coordinate line image 10x at all positions is imaged by the imager 20, and stored in the RAM 33 or the like. In FIG. 12, the position of the image display 10 does not move.

FIG. 13 is a diagram schematically showing the processes from steps S313 to S316 in FIG. In FIG. 13, the image display 10 is positioned at a second position (Far) far from the WS50 in the Z direction, and the image display 10 displays the Y coordinate line image 10y. The Y coordinate line image 10y is reflected by the WS50, and a virtual image 60y of the Y coordinate line image 10y is generated in the virtual image display area 600.

The virtual image 60y includes a main image shown by a solid line and a double image shown by a broken line. However, although the double image is shown by a broken line for convenience, it is actually one continuous line like the main image, and is displayed with lower brightness than the main image. The virtual image 60y is imaged by the imager 20 and stored in the RAM 33 or the like.

FIG. 14 is a diagram schematically showing how the display position of the Y coordinate line image is moved in the Y direction at the second position. Actually, the Y coordinate line image 10y is displayed at several tens of positions in the Y direction for inspection. When the display position of the Y coordinate line image 10y moves, the positions of the main image and the double image in the virtual image 60y also move accordingly. The virtual image 60y of the Y coordinate line image 10y at all positions is imaged by the imager 20, and stored in the RAM 33 or the like. In FIG. 14, the position of the image display 10 does not move.

Returning to the description of FIG. 4, next, in step S105, the position of the main image light source is calculated. The details of step S105 of FIG. 4 are shown in the flowchart of FIG.

First, in step S401 of FIG. 15, the first XY coordinate calculation unit 341 of the image processing unit 340 reads out the imaging data of the first position (Near). Specifically, the first XY coordinate calculation unit 341 includes data of all the virtual images 60x of the X coordinate line images 10x stored in step S206 of FIG. 5, and virtual images 60y of all the Y coordinate line images 10y stored in step S216. Read the data of. For example, the images 60x (1) to 60x (n) shown in FIG. 16A and the images 60y (1) to 60y (m) shown in FIG. 16B can be read as data. Note that one square in FIGS. 16A and 16B indicates one pixel of the imager 20.

The image 60x (1) shown in FIG. 16A is data of a virtual image 60x (white is the main image and gray is the double image) of the X coordinate line image 10x first captured. Further, the image 60x (2) is the data of the virtual image 60x of the X coordinate line image 10x imaged for the second time by shifting the position. Further, the image 60x (n) is the data of the virtual image 60x of the X coordinate line image 10x captured at the nth time by shifting the position. In this case, it is an example in which the virtual image 60x of n X coordinate line images 10x is imaged by shifting the position.

Similarly, the image 60y (1) shown in FIG. 16B is the data of the virtual image 60y (white is the main image and gray is the double image) of the Y coordinate line image 10y first captured. Further, the image 60y (2) is data of a virtual image of the Y coordinate line image 10y captured a second time by shifting the position. Further, the image 60y (m) is data of a virtual image of the Y coordinate line image 10y captured at the mth time by shifting the position. In this case, it is an example in which the virtual image 60y of m Y coordinate line images 10y is imaged by shifting the position.

Next, in step S402, the first XY coordinate calculation unit 341 extracts only the main image from the images 60x (1) to 60x (n) and the images 60y (1) to 60y (m) read in step S401. For example, from the images of FIGS. 16 (a) and 16 (b), the main images of the images 60x (1) to 60x (n) shown in FIG. 17 (a) and the image 60y (shown in FIG. 17 (a)). 1) The main image of 60y (m) is extracted. Since the brightness of the main image and the double image are significantly different, the main image and the double image can be easily distinguished from each other.

Next, in step S403, the first XY coordinate calculation unit 341 plots the main images of the images 60x (1) to 60x (n) extracted in step S402 and the main images of the images 60y (1) to 60y (m) pixel by pixel. Label to specify the coordinates. For example, the coordinates are specified by labeling as shown in FIGS. 18 (a) and 18 (b).

Next, in step S404, the first XY coordinate calculation unit 341 creates a main image projection matrix at the first position based on the coordinates specified in step S403. For example, as shown in FIG. 19, the main image projection matrix at the first position is created. Although only three coordinates are illustrated in FIG. 19, the coordinates are specified for all the pixels.

Here, a method in which the first XY coordinate calculation unit 341 specifies the coordinates from the read imaging data will be described in more detail.

First, the first XY coordinate calculation unit 341 selects a pixel (referred to as G1) whose coordinates should be specified. Next, the first XY coordinate calculation unit 341 generates an image in which only the main image is extracted from all the images obtained by capturing the virtual image 60x of the X coordinate line image 10x (for example, each image in FIG. 17A) and generates the image. An image in which the pixel G1 and the main image overlap is selected from the images. This will be described with reference to FIGS. 20 to 23.

20 to 23 are diagrams schematically showing the movement of the X coordinate line image and the movement of the virtual image, and schematically show how the virtual image 60x moves when the X coordinate line image 10x is moved. .. Here, in order to facilitate understanding, a virtual image 60x will be used instead of the image read by the first XY coordinate calculation unit 341. Although the main image and the virtual image are shown in FIGS. 20 to 23, the first XY coordinate calculation unit 341 actually uses an image obtained by extracting only the main image. In FIGS. 20 to 23, for convenience, a cross is marked at a position in the virtual image display area 600 corresponding to the pixel G1 and displayed as P1 (that is, the x mark is not the displayed virtual image).

In FIG. 20, the main image included in the virtual image 60x does not overlap with the position P1. FIG. 21 shows a virtual image 60x when the display position of the X coordinate line image 10x is moved by a predetermined distance in the X− direction with respect to the position of FIG. In FIG. 21, the main image included in the virtual image 60x does not overlap with the position P1.

FIG. 22 shows a virtual image 60x when the display position of the X coordinate line image 10x is moved by a predetermined distance in the X− direction with respect to the position of FIG. In FIG. 22, the main image included in the virtual image 60x does not overlap with the position P1.

FIG. 23 shows a virtual image 60x when the display position of the X coordinate line image 10x is moved by a predetermined distance in the X− direction with respect to the position of FIG. In FIG. 23, the main image included in the virtual image 60x overlaps the position P1.

From the above results, it can be seen that the line X1 shown in FIG. 23 is displayed as the main image passing through the position P1. That is, assuming that the X coordinate of X1 is Xa (known), it can be seen that the light ray passing through Xa is reflected by the WS50 and a main image is generated at the position P1.

Next, the first XY coordinate calculation unit 341 generates an image in which only the main image is extracted from all the images obtained by capturing the virtual image 60y of the Y coordinate line image 10y (for example, each image in FIG. 17B) and generates the image. An image in which the pixel G1 and the main image overlap is selected from the images. This will be described with reference to FIGS. 24 to 27.

24 to 27 are diagrams schematically showing the movement of the Y coordinate line image and the movement of the virtual image, and schematically show how the virtual image 60y moves when the Y coordinate line image 10y is moved. .. Here, in order to facilitate understanding, a virtual image 60y will be used instead of the image read by the first XY coordinate calculation unit 341. Although the main image and the virtual image are shown in FIGS. 24 to 27, the first XY coordinate calculation unit 341 actually uses an image obtained by extracting only the main image. In FIGS. 24 to 27, for convenience, a cross is marked at a position in the virtual image display area 600 corresponding to the pixel G1 and displayed as P1 (that is, the x mark is not the displayed virtual image). Further, for convenience, the line X1 specified in FIG. 23 is shown on the image display 10.

In FIG. 24, the main image included in the virtual image 60y does not overlap with the position P1. FIG. 25 shows a virtual image 60y when the display position of the Y coordinate line image 10y is moved in the Y + direction by a predetermined distance with respect to the position of FIG. 24. In FIG. 21, the main image included in the virtual image 60y does not overlap with the position P1.

FIG. 26 shows a virtual image 60y when the display position of the Y coordinate line image 10y is moved in the Y + direction by a predetermined distance with respect to the position of FIG. 25. In FIG. 26, the main image included in the virtual image 60y does not overlap with the position P1.

FIG. 27 shows a virtual image 60y when the display position of the Y coordinate line image 10y is moved in the Y + direction by a predetermined distance with respect to the position of FIG. 26. In FIG. 27, the main image included in the virtual image 60y overlaps the position P1.

From the above results, it can be seen that the line Y1 shown in FIG. 27 is displayed as the main image passing through the position P1. That is, assuming that the Y coordinate of Y1 is Ya (known), it can be seen that the light ray passing through Ya is reflected by the WS50 and a main image is generated at the position P1.

Considering that the X coordinate has already been specified to Xa in FIG. 23, a light ray passing through the position Pn1 whose XY coordinate is (Xa, Ya) is reflected by the WS50 to generate a main image at the position P1. You can see that.

That is, the XY coordinates (sometimes referred to as the first XY coordinates) of the first position corresponding to the pixel G1 are (Xa, Ya). Therefore, as shown in FIG. 28A, (Xa, Ya) is stored at the position of the pixel G1 of the main image projection matrix at the first position. By performing the above processing for all the pixels of the imager 20, the XY coordinates of the positions of all the pixels in FIG. 28A are specified, and the main image projection matrix of the first position is completed. The main image projection matrix at the first position indicates which XY coordinates of the first position the light beam passes through in order to form a main image at each pixel.

Returning to the description of FIG. 15, next, the processes of steps S405 to S408 are executed. The processing of steps S405 to S408 is the same as the processing of steps S401 to S404 except that the second XY coordinate calculation unit 342 of the image processing unit 340 reads out the imaged data at the second position (Far). As a result, the main image projection matrix at the second position is created.

Similar to the case of the first position, from the data of the virtual image 60x when the X coordinate line image 10x is moved, the line X2 shown in FIG. 29 is displayed as the main image passing through the position P1. Suppose you understand. That is, assuming that the X coordinate of X2 is Xb (known), it is found that the light ray passing through Xb is reflected by WS50 and a main image is generated at the position P1.

Further, it is assumed that the line of Y2 shown in FIG. 29 is displayed as the main image passing through the position P1 from the data of the virtual image 60y when the Y coordinate line image 10y is moved. That is, assuming that the Y coordinate of Y2 is Yb (known), it is found that the light ray passing through Yb is reflected by WS50 and a main image is generated at the position P1.

Considering that the X coordinate has already been specified to Xb, the light ray passing through the position Pf1 whose XY coordinate is (Xb, Yb) is reflected by the WS50 to generate the main image at the position P1. I understand.

That is, the XY coordinates (sometimes referred to as the second XY coordinates) of the second position corresponding to the pixel G1 are (Xb, Yb). Therefore, as shown in FIG. 28B, (Xb, Yb) is stored at the position of the pixel G1 of the main image projection matrix at the second position. By performing the above processing for all the pixels of the imager 20, the XY coordinates of the positions of all the pixels in FIG. 28B are specified, and the main image projection matrix of the second position is completed. The main image projection matrix at the second position indicates which XY coordinates of the second position the light beam passes through in order to form a main image at each pixel.

Considering the results obtained in steps S401 to S404 and the results obtained in steps S405 to S408 together, as shown in FIG. 30, the light ray R1 passing through the positions Pn1 and Pf1 is reflected by the WS50 and becomes a virtual image. It means that the main image is generated at the position P1 in the display area 600. The light ray that is the source of the main image may be referred to as the main image light ray. Further, a ray that is a source of generating a double image may be referred to as a double image ray.

In this way, which position of the first position (Near) and the second position (Far) the main image displayed at an arbitrary position in the virtual image display area 600 is formed by the light rays. Can be identified. In other words, the main image displayed at an arbitrary position in the virtual image display area 600 by the main image projection matrix at the first position and the main image projection matrix at the second position is the first position (Near) and the second position (Near). It is possible to know which position of Far) the light beam has passed through.

Returning to the description of FIG. 15, next, in step S409, the optical path specifying unit 343 of the image processing unit 340 creates a main image light source position matrix. First, the optical path specifying unit 343 reads out the CAD data of the optical system of the HUD unit stored in advance in the RAM 33 or the like, which is a storage unit, and identifies the positions of the concave mirror and the light source of the HUD unit based on the read CAD data. The light source of the HUD unit is a liquid crystal display device or the like that displays an image that is the source of a virtual image.

Next, the optical path specifying unit 343 specifies the emission position of the light source that emits light into the optical path of the main image ray based on the positions of the specified concave mirror and the light source and the optical path of the main image ray. Specifically, the optical path specifying unit 343 obtains the intersection of the light ray R1 obtained in FIG. 30 and the concave mirror. For example, as shown in FIG. 31, the positions of the concave mirror 70 and the light source 80 of the HUD unit with respect to the position of WS50 are specified, and the intersection I1 between the light ray R1 and the concave mirror 70 is obtained.

Next, the optical path specifying unit 343 obtains a light ray R2 reflected at the position of the intersection I1 of the concave mirror 70. Since the three-dimensional shape of the reflecting surface of the concave mirror 70, the direction of the reflecting surface, and the like are specified from the CAD data of the optical system of the HUD unit, the light ray R2 can be obtained.

Next, the optical path specifying unit 343 obtains the intersection I2 between the light ray R2 and the light source 80. Since the position of the light source 80 is specified from the CAD data of the HUD unit, the intersection I2 can be obtained. That is, the light source 80 is emitted when the main image is displayed at the position P1 of the virtual image 60y based on the main image projection matrix at the first position, the main image projection matrix at the second position, and the CAD data of the optical system of the HUD unit. The intersection I2, which is the position, can be obtained. The optical path specifying unit 343 stores the obtained coordinates of the intersection I2 at the position of the pixel G1 in the main image light source position matrix as shown in FIG.

By performing the above processing for all the pixels of the imager 20, the XY coordinates of the emission position of the light source 80 are specified for all the pixels, and the main image light source position matrix is completed. The main image light source position matrix indicates from which position of the light source 80 the light beam is emitted in order to form the main image in each pixel.

From the main image light source position matrix, for example, as schematically shown in FIG. 32, the display position of the main image in the virtual image display area 600 with respect to an arbitrary emission position of the light source 80 can be specified. The actual emission position of the light source 80 is much larger than the number shown in the figure. This is the end of the description of step S409.

Returning to the description of FIG. 4, next, in step S106, the optical path specifying unit 343 calculates the position of the double image light source. The details of step S106 of FIG. 4 are shown in the flowchart of FIG. 33.

The processing of steps S501 to S509 shown in FIG. 33 is the same as the processing of steps S401 to S409 shown in FIG. 15, except that the optical path specifying unit 343 handles a double image instead of the main image. That is, the optical path specifying unit 343 is the emission position of the light source that emits a light ray into the optical path of the double image ray based on the position of the concave mirror and the light source of the HUD unit specified based on the CAD data and the optical path of the double image ray. To identify. As a result, a double image light source position matrix similar to that in FIG. 31 is created. The double image light source position matrix can specify the display position of the double image with respect to an arbitrary emission position of the light source 80.

Next, in step S107, the data calculation unit 344 of the image processing unit 340 calculates the main image distortion. First, the image processing unit 340 reads out the CAD data of the windshield (hereinafter referred to as the windshield (CAD)) stored in advance in the RAM 33 or the like which is a storage unit. Then, when the windshield (CAD) is used, it is calculated at which position in the virtual image display region 600 the main image is formed by the light rays emitted from the respective emission positions of the light source 80 (see FIG. 32 and the like).

Next, the data calculation unit 344 determines the position of the main image formed when the main image ray emitted from the same emission position of the light source 80 uses the windshield (CAD) read from the storage unit, and the WS50 to be measured. Is compared with the position of the main image formed when is used, and the main image distortion is calculated based on the difference between the two. The data calculation unit 344 calculates the main image distortion based on the above difference for all the emission positions of the light source 80.

Next, in step S108, the data calculation unit 344 calculates the double image distortion. Specifically, the data calculation unit 344 includes a position of the main image generated by the main image ray emitted from the same emission position of the light source 80 and a double image generated by the double image ray emitted from the same emission position of the light source 80. The position of the image is compared, and the double image distortion is calculated based on the difference between the two. The data calculation unit 344 calculates the double image distortion based on the above difference for all the emission positions of the light source 80. The position of the main image generated by the main image ray emitted from the same emission position of the light source 80 and the position of the double image generated by the double image ray have already been obtained in the processes from steps S103 to S106. ing.

Next, in step S109, the data calculation unit 344 compares the main image distortion calculated in step S107 with the double image distortion calculated in step S108 with a predetermined threshold value, and determines whether the quality is good or bad. The data calculation unit 344 transmits the determination result to the inspection result output unit 40, and the inspection result output unit 40 outputs the inspection result as video, audio, data, or the like. As a result, all the processes shown in FIG. 4 are completed.

If necessary, the inspection device 1 changes the WS50 to another windshield and executes the inspection. When executing the inspection, the process proceeds to step S101 of FIG. 4 and the same process as described above is repeated. The control unit 30 may be provided with an input means for inputting measurement conditions from the outside, and the operator of the inspection device 1 may input the number of windshields to be inspected in advance. In this case, the processes from steps S101 to S109 are repeated until the control unit 30 determines that the number of inputs has been reached from the input means.

Further, in order to correspond to different viewpoint positions of the driver, the imager 20 may be sequentially changed (moved) to different positions for the same WS50 for inspection.

This completes the description of the measurement of the main image distortion and the double image distortion, but the inspection device 1 can inspect the parameters of the glass in addition to the main image distortion and the double image distortion.

FIG. 34 is an example of a flowchart showing a method of inspecting glass parameters using the inspection apparatus according to the present embodiment.

First, in step S601, the optical path specifying unit 343 of the image processing unit 340 obtains the intersection of the light ray R1 incident on the WS50 and the main image line of sight E1. For example, if the light ray R1 shown in FIG. 31 can be specified, the main image line of sight E1 with respect to the light ray R1 can be specified as shown in FIG. 35 (a), so that the intersection of the light ray R1 and the main image line of sight E1 can be obtained. it can.

Next, in step S602, the optical path specifying unit 343 calculates the angle of the fourth surface M4, which is the surface inside the WS50 at the intersection of the light ray R1 and the main image line of sight E1. Since the main image is generated by being reflected by the fourth surface M4 of WS50, considering that the incident angle and the reflection angle are equal, as shown in FIG. 34 (b), at the intersection of the light ray R1 and the main image line of sight E1. The angle (angle with respect to the horizontal plane) of the fourth surface M4 of the WS50 can be calculated. Since the intersection of the light ray and the main image line of sight can be obtained for all the light rays, the angle of the entire fourth surface M4 of the WS50 can be obtained.

Next, in step S603, the data calculation unit 344 of the image processing unit 340 calculates the position and angle of the first surface M1 which is the surface on the outside of the WS50. As shown in FIG. 34 (c), considering the double image generated at the position of P5, in this double image, the light ray R5 incident on the fourth surface M4 is refracted by the fourth surface M4, and the WS50 It is generated by reflecting on the first surface M1 which is the outer surface of the vehicle and refracting it again on the fourth surface M4. Since the angle of the fourth surface M4 has already been obtained, the position and angle of the first surface M1 can be obtained. By considering all the double images, the position and angle of the entire first surface M1 of the WS50 can be obtained.

Next, in step S604, the data calculation unit 344 calculates related items. Here, the related items are values calculated based on the information obtained in steps S601 to S603, and are, for example, the thickness of WS50 and the distribution of wedge angles.

For example, the data calculation unit 344 transmits the shape of the surface of the WS50 and the distribution of the wedge angle to the inspection result output unit 40, and the inspection result output unit 40 outputs the inspection result as video, audio, data, or the like. Alternatively, the data calculation unit 344 compares the shape of the surface of the WS50 and the distribution of the wedge angle with the CAD data of the windshield, transmits the comparison result to the inspection result output unit 40, and the inspection result output unit 40 displays the comparison result as an image. , Voice, data, etc. may be output.

As described above, in the inspection device 1, the first XY coordinate calculation unit 341 emits a light ray that is a source for forming an arbitrary point of the virtual image when the image display 10 is in the first position (Near). The first XY coordinates of the points of the inspection image are obtained. Further, the second XY coordinate calculation unit 342 indicates that when the image display 10 is in the second position (Far), a light ray that is a source for forming an arbitrary point of the virtual image is emitted from the point of the inspection image. Find the second XY coordinates.

Then, the optical path specifying unit 343 forms each point of the entire display area of the virtual image by specifying the first XY coordinates and the second XY coordinates from which the light rays that are the source of forming the same points of the virtual image are emitted. Identify the optical path of the source ray for. Then, the data calculation unit 344 determines the main image distortion as data related to the quality of the glass based on the design data (for example, CAD data) of the optical path of the optical path and the head-up display unit specified by the optical path identification unit 343. One or more of data, double image distortion data, glass thickness data, glass wedge angle data, and glass surface shape data are calculated.

According to the inspection device 1, it is possible to inspect the quality of the glass on which the image of the HUD unit is projected without using the HUD unit.

Although the preferred embodiments and the like have been described in detail above, they are not limited to the above-described embodiments and the like, and various modifications and substitutions are made to the above-mentioned embodiments and the like without departing from the scope of claims. Can be added.

For example, in the above embodiment, light for forming each point of the entire display area of the virtual image passes based on the data acquired at the first position (Near) and the second position (Far). The optical path was identified. However, the present invention is not limited to this, and even if the optical path through which the light for forming each point of the entire display area of the virtual image is specified is specified based on the data acquired at three or more locations where the coordinates in the Z direction are different. Good.

Further, in the above embodiment, an example is shown in which the XY coordinates of the first position and the second position corresponding to the projection position of the virtual image are obtained while moving the X coordinate line image and the Y coordinate line image whose coordinates are clear. However, the present invention is not limited to this, and as the inspection image, for example, a checkered pattern image in which the X coordinate and the Y coordinate can be specified at the same time, an image in which the coordinates can be determined by the difference in color, and the like may be used. When these images are used, it is preferable in that the number of times of imaging can be reduced.

1 Inspection device 10 Image display 10x X coordinate line image 10y Y coordinate line image 20 Imager 30 Control unit 31 CPU
32 ROM
33 RAM
34 I / F
35 Bus line 40 Inspection result output unit 50 Windshield (WS)
60, 60x, 60y Virtual image 70 Concave mirror 80 Light source 310 Display positioning unit 320 Display control unit 330 Imager control unit 340 Image processing unit 341 1st XY coordinate calculation unit 342 2nd XY coordinate calculation unit 343 Optical path identification unit 344 Data calculation unit 600 Virtual image display area

Claims (10)

A glass inspection device used in combination with a head-up display unit.
Image display and
An imager that captures a virtual image generated by projecting an inspection image displayed on the image display onto the glass, and an imager.
It has an image processing unit that processes image data of the virtual image captured by the imager.
When the direction of gravity is the Z direction and the X and Y directions that intersect each other in the plane intersecting the Z direction are defined, the image display has at least the first position and the coordinates of the first position in the Z direction. Is configured to be movable to a different second position,
The image processing unit
A first XY coordinate calculation unit that obtains the first XY coordinates of a point of the inspection image from which a light ray that is a source for forming an arbitrary point of the virtual image is emitted when the image display is in the first position. When,
A second XY coordinate calculation unit that obtains the second XY coordinates of a point in the inspection image from which a light ray that is a source for forming an arbitrary point of the virtual image is emitted when the image display is in the second position. When,
By specifying the first XY coordinates and the second XY coordinates from which the light rays that are the source of forming the same point of the virtual image are emitted, the source for forming each point of the entire display area of the virtual image is used. The optical path identification part that identifies the optical path of the light beam,
A glass inspection apparatus having a data calculation unit for calculating data related to the quality of the glass based on the optical path specified by the optical path identification unit. The imaginary image includes a main image and a double image.
The first XY coordinate calculation unit is a point of the inspection image from which a main image ray that is a source for forming an arbitrary point of the main image is emitted when the image display is in the first position. The first XY coordinates of the main image of the above are obtained, and the first XY coordinates of the points of the inspection image from which the original double image ray for forming an arbitrary point of the double image is emitted are obtained.
The second XY coordinate calculation unit is a point of the inspection image from which a main image ray that is a source for forming an arbitrary point of the main image is emitted when the image display is in the second position. The second XY coordinates of the main image of the above are obtained, and the second XY coordinates of the points of the inspection image from which the original double image ray for forming an arbitrary point of the double image is emitted are obtained.
The optical path specifying unit specifies the main image first XY coordinates and the main image second XY coordinates from which the main image rays that are the basis for forming the same point of the main image are emitted. The optical path of the main image ray that is the basis for forming each point in the entire display area of the above is specified, and the double image ray that is the basis for forming the same point of the double image is emitted. According to claim 1, by specifying the first XY coordinates of the double image and the second XY coordinates of the double image, the optical path of the double image ray which is the basis for forming each point of the entire display area of the double image is specified. The glass inspection device described. It has a storage unit that stores the design data of the optical system of the head-up display unit in advance.
The optical path identification part is
Based on the design data read from the storage unit, the positions of the concave mirror and the light source of the head-up display unit are specified.
The glass inspection apparatus according to claim 2, wherein the emission position of the light source that emits light into the optical path of the main image ray is specified based on the positions of the concave mirror and the light source and the optical path of the main image ray. The storage unit stores the design data of the glass in advance.
The data calculation unit
The position of the main image formed when the main image ray emitted from the same emission position of the light source uses the design data of the glass read from the storage unit, and the position of the main image formed when the glass to be measured is used. The glass inspection apparatus according to claim 3, wherein the position of the main image is compared and the distortion of the main image is calculated based on the difference between the two. The optical path identification part is
The glass according to claim 3 or 4, which specifies the emission position of the light source that emits a light ray into the optical path of the double image ray based on the positions of the concave mirror and the light source and the optical path of the double image ray. Inspection device. The data calculation unit
The position of the main image generated by the main image ray emitted from the same emission position of the light source is compared with the position of the double image generated by the double image ray emitted from the same emission position of the light source, and both are compared. The glass inspection apparatus according to claim 5, wherein the double image distortion is calculated based on the difference between the two. The data calculation unit has any of the glass thickness data, the glass wedge angle data, and the glass surface shape data based on the optical path of the main image ray and the optical path of the double image ray. The glass inspection apparatus according to any one of claims 2 to 6, which calculates one or more of them. The glass inspection apparatus according to any one of claims 1 to 7, wherein the inspection image is directly projected onto the glass without going through an optical system. The glass inspection device according to any one of claims 1 to 8, wherein the glass is a windshield for a vehicle. A glass inspection method used in combination with a head-up display unit.
An imaging step in which an inspection image displayed on an image display is projected onto the glass to capture a virtual image generated.
It has an image processing step for processing the image data of the virtual image captured in the imaging step.
When the direction of gravity is the Z direction and the X and Y directions that intersect each other in the plane intersecting the Z direction are defined, the image display has at least the first position and the coordinates of the first position in the Z direction. Is configured to be movable to a different second position,
The image processing step
A first XY coordinate calculation step for obtaining the first XY coordinates of a point in the inspection image from which a light ray that is a source for forming an arbitrary point of the virtual image is emitted when the image display is in the first position. When,
A second XY coordinate calculation step for obtaining the second XY coordinates of a point in the inspection image from which a light ray that is a source for forming an arbitrary point of the virtual image is emitted when the image display is in the second position. When,
By specifying the first XY coordinates and the second XY coordinates from which the light rays that are the source of forming the same point of the virtual image are emitted, the source for forming each point of the entire display area of the virtual image is used. An optical path identification step that identifies the optical path of a ray of light
A glass inspection method comprising a data calculation step of calculating data related to the quality of the glass based on the optical path specified in the optical path specifying step.

Images