EP4364108A1 - Méthode d'analyse de la qualité optique d'un vitrage, méthode de calibration d'une caméra, vitrage analysé - Google Patents
Méthode d'analyse de la qualité optique d'un vitrage, méthode de calibration d'une caméra, vitrage analyséInfo
- Publication number
- EP4364108A1 EP4364108A1 EP22744805.7A EP22744805A EP4364108A1 EP 4364108 A1 EP4364108 A1 EP 4364108A1 EP 22744805 A EP22744805 A EP 22744805A EP 4364108 A1 EP4364108 A1 EP 4364108A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- pattern
- points
- image
- glazing
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
Definitions
- TITLE Method for analyzing the optical quality of glazing, method for calibrating a camera, glazing analyzed
- the invention relates to a method for analyzing the optical quality of a region of a glazing, said region being intended to be placed in front of an acquisition or measurement device such as a camera.
- the invention thus relates to a method for calibrating a camera from said analysis method and a glazing thus analyzed.
- the invention is particularly suitable for measuring the optical quality of a delimited zone of the glazing of a transport vehicle, such as a car or airplane windshield, in front of which an optical image recording device or a device for measuring the environment outside the vehicle is placed for the operation of an intelligent system for assisting the driving of said vehicle.
- ADAS intelligent driver assistance System
- ADAS autonomous driver assistance System
- these on-board systems can provide real-time information on the state of road traffic and/or on the state of equipment and mechanical and/or electrical elements of the vehicle, assess the state of fatigue or distraction of the driver, detecting and anticipating possible threats from the environment outside the vehicle, or even helping the driver to carry out certain difficult maneuvers such as overtaking other vehicles or parking.
- these systems integrate numerous devices or sensors making it possible to collect data on the driver, the vehicle and/or on their environment.
- Some systems such as parking assistance systems, autonomous driving systems or even collision anticipation systems, implement one or more optical image acquisition devices or speed measurement devices. environment outside the vehicle.
- These devices are generally placed in the enclosure of the vehicle, behind one of the windows of said vehicle, said window then generally having a protective function for this device. They can also be incorporated directly into the glazing, for example between two sheets of glass of laminated glazing, one of which is provided with a cavity to accommodate it.
- the glazing can be any of the usual glazings of the vehicle: windshield, rear window, side glazings. Most often the optical devices are placed behind the windshield in order to acquire information from the front of the vehicle.
- the information or data acquired by the devices are processed by embedded systems to obtain the desired functionality.
- the intelligent on-board systems which implement optical recording devices or measuring devices arranged behind the glazing it is necessary for the data acquired by said optical devices to be reliable, i.e. say free of any artefact.
- said glazing must have sufficient optical quality in order to avoid defects and/or optical aberrations such as aberrations of sphericity, chromatism, astigmatism, coma.
- These devices are generally arranged behind inclined glazing and, in the majority of cases in an area of the glazing delimited by decorative elements making it possible to hide from view from outside the vehicles the elements of said devices apart from their active elements for the acquisition of images or the measurement of any other parameter.
- the delimited zones can also include on their surface functional elements which are directly placed in the acquisition or measurement fields of the acquisition or measurement devices. These elements can, for example, be networks of heating wires with different geometries, or even functional layers with optical or thermal properties. These functional elements also cause optical distortions.
- the glazings comprising a delimited zone intended to be placed in front of an acquisition or measurement device are manufactured before the integration of said device. It is therefore necessary to check the optical quality of the delimited zone in order to prevent the presence of optical distortions from being the cause of harmful artefacts in the images or signals acquired by these devices.
- the state of the art describes many methods for checking or measuring the optical quality of glazing, in particular windshields for vehicles.
- an object of the invention is to propose a method for analyzing the optical quality of a region of a glazing (perforated or not perforated) without the aforementioned drawbacks, thus easier to implement industrially (target at more short distance than the working distance -object detection distance etc-, simple equipment at a reasonable price which is used for any type of camera, whatever the working distance%) without sacrificing measurement accuracy.
- a first object of the invention is to propose a method for analyzing the optical quality of a region of a glazing (in particular curved and/or laminated) in particular of a land, rail or aeronautical vehicle, in particular a windshield.
- a limited zone transmission window
- the glazing having a through hole filled with an insert (transparent to the working wavelength of ADAS) or a partial hole (on the internal glass sheet of a laminated glazing) optionally with an insert (transparent to the length of ADAS working wave), from image analysis of a pattern including: 1) a (first) digital image acquisition step comprising:
- a first fixed (and illuminated) pattern M1 comprising a first set of (contrasted) patterns extending along two dimensions (X, Y orthogonal in particular Y vertical axis), of preferably 2D patterns - in particular on a first panel (in particular plane) -, at a distance L1 at least centimeter and preferably at most 5 m from an optical device for acquiring (digital) images along the optical axis (Z) of the optical device, in particular at least 10 or 50 or better still at least 100 patterns in the depth of field, acquisition thus comprising, in any order, the following sub-steps: la) the provision of a first reference image h, theoretical or acquired, of the first pattern M1 (simulated or physical) preferably in the depth of field of the optical device, in the absence of said glazing,
- the glazing being placed between the optical device and the first pattern M1, with said surface region in the field of view of the optical device, the acquisition of a first deformed image i of said first pattern M1 ( physical), in particular image distortion induced by said region, glazing inclined at a first angle preferably identical to the angle of the glazing or +/-5° or +/- 1° in the position mounted in a vehicle
- test pattern Mi at a distance L2 distinct from L1 of the optical device, preferably L2- L1 in absolute value is at least 1 cm or 10 cm or 20cm, acquisition thus comprising, in any order, the following sub-steps: lb) the provision of a second reference image I2, theoretical or acquired, of the target Mi (simulated or physical), preferably in the depth of field of the optical device, in the absence of said glazing
- the glazing being placed between the optical device and the target Mi, with said region in the field of view of the optical device, the acquisition of a second deformed image G2 of the target Mi (physical), preferably glazing inclined following a second angle preferably identical or substantially identical to the first angle, the following sub-steps: 1a) to 1'b) being in any order, with the possible acquisitions 1a) and 1b) possibly being simultaneous and/or with the acquisitions 1'a) and 1'b) possibly simultaneous.
- reference images I1, I2 they can be pre-recorded acquired images (acquired well in advance), theoretical images (simulated by computer) or images acquired in the same sequence of acquisitions as the distorted images l'1 , G2.
- first theoretical or acquired reference image 11 (respectively the second theoretical or acquired image I2) and then make a series of acquisitions of deformed images with different glazings (in “batch”) consecutively for the first chart M1 and for the chart Mi.
- the method comprises: 2) a step for generating image points in pixels (points marked on the images) which are:
- the image points are preferably points of interest (or remarkable) of the patterns, or notably central points of portions of a region containing a pattern that can be recognized.
- Image points can be in any zone of the image that one is able to locate on the reference image 11 and on the deformed image l'1 (respectively I2 and G2).
- step 3 it includes:
- the method according to the invention thus makes it possible to deduce, to predict a field of apparent displacements simulated for a distance L3 which can be very large from measurements and calculations of apparent displacement fields at distances L1, L2 chosen in fashion.
- the simulated apparent displacement field provides information on the quality of the glazing and will make it possible to calibrate a camera, i.e. to correct the deformations on the image in real time.
- the glazing may preferably be inclined relative to the optical axis of the digital optical device at an angle corresponding to the angle provided in the use of said glazing in a vehicle, and the angle is identical during 1'a) and 1'b).
- steps 1) and 2) and 2) and 3) can be intertwined.
- An image is needed to be able to analyze it but the analysis of this image can begin during the supply or acquisition of other images l '1 , I2 etc.
- the carrier panels M1 or M2 are not necessarily strictly in a plane orthogonal to the optical axis.
- the distance L1 and L2 are measured along the optical axis, between the camera and the point of the staff that intersects the optical axis.
- Each pattern is illuminated by any known means: backlighting, side lighting (spotlights, ambient light).
- Each target is fixed (immobile during acquisition).
- the patterns are discernible.
- the patterns are opaque or transparent, colored or colorless, identical or distinct.
- Patterns can be disjoint.
- the patterns can be of any shape, geometric (disk, oval, etc.) of size adapted to the desired resolution and depending on the size of the pixels of the sensors of the optical device.
- the patterns can form a regular and even periodic arrangement of disjointed patterns: network with a mesh of given shape (hexagonal square, etc.).
- the pattern can be a tiling of two patterns of different colors (rectangular, square, etc.) alternately, for example the pattern can be a checkerboard of black and white or colored and transparent.
- 2D patterns are preferred as opposed to 1D patterns which extend substantially along a direction such as a straight or wavy line such as a sinusoid.
- sub-steps 1'a) and 1'b) are carried out without moving the glazing relative to the optical device and even without moving the glazing and the optical device, sub-steps 1'a) and 1'b) being at least successive and preferably simultaneous when Mi is the second pattern M2.
- Mi is the second pattern M2, the first pattern M1 obscuring the pattern M2, with L2>L1 (M1 being closer to M2 of the optical device), the sub-steps 1 b) and 1 'b) are in l lack of M1.
- sub-steps 1a) (for example under acquisition step) and 1’a) (for example under acquisition step) are in the presence or in the absence of M2.
- step 1) when the target (M1 or M1) is a checkerboard or a network of aligned patterns, it is possible to arrange for each line of patterns to be misaligned with the line of pixels of the acquisition device.
- the acquisition device used for the invention can be based on one or more sensors sensitive to different parts of the electromagnetic spectrum, that is to say in the visible but also outside the visible, in particular in the ultraviolet (UV) or in- below or in the infrared (IR) in particular the near infrared or the far infrared and beyond.
- UV ultraviolet
- IR infrared
- the first pattern M1 (if chosen not simulated for the reference image) and, where applicable, the pattern M2 and their illuminations are chosen so that these patterns and the patterns which constitute them are imaged contrasted manner by the acquisition device used so that each step of the invention can be carried out.
- the light emitted, reflected or diffused by the sights M1 or M2 and picked up by the optical device can be in spectral ranges S1 and S2 which can be equal, partially overlap or be completely distinct.
- S1 and S2 are not necessarily in the visible.
- Mi is the second target M2, the acquisitions of step 1) are in the presence of M1 and M2.
- the optical device can be chosen polychromatic:
- M1 can be colored with a color Co1 (corresponding to a spectral range S1, i.e. M1 emits, scatters or reflects light in the spectral range S1).
- M2 can be colored with a color Co2, Co2 distinct from Co1 (corresponding to a spectral range S2 distinct from S1, i.e. M2 emitting, scattering or reflecting light in a spectral range S2).
- the device is polychromatic, the first deformed image I'1 (and the first reference image 11 acquired) containing color patterns C'1 and the second deformed image G2 (and the second reference image I2 acquired) and containing color patterns Co'2 distinct from Co'1.
- the patterns of M1 are colored with a color C1
- the patterns of M2 are colored with a color Co2 distinct from C1
- the colors Co1 and Co2 being digitally rendered by the polychromatic image acquisition device by colors Co'1 and Co'2 (the rendered color is not necessarily the real color).
- the acquisitions of the sub-steps 1 'a) and 1 'b) are simultaneous, the possible acquisitions of the sub-steps 1a) and 1 b) are simultaneous.
- the first deformed image l'1 (in particular colored with color Co'1) and the second deformed image G2 (in particular colored with color Co'2 distinct from Co'1) are combined on a first common deformed image l'1c (in particular colored with two colors Co'1 and Co'2), before step 3), the first common image l'1c is segmented so as to obtain the images l '1 and l '2 (in particular colored with color Co'1 and Co '2).
- the common (reference) image 11c is segmented so as to obtain the (reference) images 11 and I2, in particular colored with colors Co′1 and Co′2).
- the digital acquisition device is not focused on one of the targets in particular (if necessary, a certain blur is allowed on the image of one or more sights).
- the method comprises establishing a so-called predictive cartography in all pixels of the apparent so-called simulated displacements p3, in particular if necessary by interpolation (linear, polynomial) of the first and second apparent displacements.
- the so-called predictive mapping can be obtained from a first mapping of the first displacements in any pixel and from a second mapping of the second interpolated displacements in any pixel, in particular mappings directly obtained by using an image correlation.
- the so-called predictive mapping can be obtained from a first mapping of the first interpolated displacements and a second mapping of the second interpolated displacements.
- [Math 4] fo being the focal length of the optical device pi being the first apparent displacement in any pixel
- step 2) includes (automatic) detection of points, in particular using techniques known to those skilled in the art of image processing, in particular with sub-pixel detection of points, in particular:
- the detections are optionally all or part simultaneous, in particular the detections 2a) and 2b) or 2c and 2d) or 2'a) and 2'b) or 2'c and 2'd) possibly being simultaneous
- the origin point 01 or 02 can coincide with a point of interest and be located at the same time.
- the detections 2′a) and 2′a) or 2b) and 2′b) or 2c) and 2′c) or 2d) and 2′d) are possibly simultaneous, in parallel and preferably carried out after segmentation as described later. It is possible to order Ki in parallel with other image processing operations. We can start ordering certain points already detected and continue the detection for others.
- the method may include:
- first pairs (K1, K ⁇ ) and second pairs (K2, K'2) of ordered points of interest each first pair comprising first point of interest K1 and (its) first other point of interest K ⁇ shifted, each second pair comprising second point of interest K2 and (its) second other point of interest K'2 shifted.
- the pairing between points is used to determine the apparent displacements.
- the first and second apparent displacements correspond to the difference between the coordinates of the image points K1 , K ⁇ and K2, K'2
- At least 100 first and second pairs are formed which correspond to physical points distributed over the pattern in a regular or irregular manner and according to a sufficient mesh to scan the region of the glazing.
- first and second pairs can be done simultaneously, in parallel, (after the segmentation detailed later).
- the points of interest are chosen from:
- step 2) can be based on the correlation of digital images
- the first pattern M1 is preferably a pattern of random or pseudo-random patterns
- the pattern Mi is preferably a pattern of random or pseudo-random patterns and comprises: - the comparison of image portions of the first reference image 11 with the first deformed image G1 or conversely the comparison of deformed image portions of the first deformed image l'1 with the first reference image 11, preferably the first points are the centers C1 of the image portions and the first shifted points are the centers C'1 of the deformed image portions.
- the second points are preferably the centers C2 of the image portions, the second offset points are the centers C'2 of the deformed image portions.
- the invention also relates to a calibration method (for real-time deformed image corrections) of an optical camera (in the visible, LIDAR, thermal camera, etc.) placed in the passenger compartment of a vehicle in the field of view of a region of said vehicle glazing forming a camera zone analyzed according to the analysis method described above, calibration using the cartography of the apparent displacements simulated in particular so as to compensate on the images of the optical camera for the effects of refraction (shift, distortion ) light radiation through the region of said glazing.
- an optical camera in the visible, LIDAR, thermal camera, etc.
- the working distance is the distance of the camera from a detection object outside the passenger compartment.
- the invention also relates to a vehicle, in particular autonomous or semi-autonomous, comprising the glazing thus analyzed and the said camera thus calibrated, in particular a camera positioned to receive light radiation passing through the glazing through the said region forming the camera zone, camera chosen among: camera in the visible, in the infrared, in particular LIDAR; thermal camera.
- the invention also relates to road or rail vehicle glazing, which incorporates a data storage device in the form of a data matrix or a bar code which refers to a database, the database containing mapping of apparent simulated displacements in particular the data storage device is on said glazing, in particular on the periphery, in particular printed on the glazing, engraved (by laser, etc.) or glued to the glazing.
- a data storage device in the form of a data matrix or a bar code which refers to a database
- the database containing mapping of apparent simulated displacements in particular the data storage device is on said glazing, in particular on the periphery, in particular printed on the glazing, engraved (by laser, etc.) or glued to the glazing.
- the invention also relates to a vehicle, in particular autonomous or semi-autonomous, comprising the glazing and an image acquisition device in the passenger compartment, in particular an optical camera positioned to receive light radiation passing through the glazing through said region forming a camera zone, camera chosen from: camera in the visible, in the infrared, in particular LIDAR; thermal camera
- the glazing according to the invention can be laminated and comprise:
- first sheet of glass intended to be the exterior glazing with a first external main face F1 and a second internal main face F2 oriented towards the passenger compartment
- spacer material with a main face Fa oriented towards F2 and with a main face Fb opposite to Fa, in particular polyvinyl butyral PVB (acoustic and/or corner etc.)
- the camera is an infrared vision system at the working wavelength in the near infrared (LIDAR, etc.) placed in the passenger compartment behind said glazing and comprising a transmitter and/or receiver so as to send and/or receive radiation passing through the first glass sheet possibly with a through hole (4), in the thickness of the second glass sheet, the through hole being centimetric, closed or open hole.
- LIDAR near infrared
- the camera is an infrared vision system at the working wavelength in the far infrared placed in the passenger compartment behind said glazing and opposite an insert transparent at the working wavelength housed at the level a through hole in the glazing.
- the invention relates to a method for analyzing the optical quality of a region (preferably limited) of a preferably curved glazing (for example along at least one or two radii of curvature) from image analysis of a pattern, which includes a certain number of steps with sub-steps in particular:
- a first digital image acquisition step comprising:
- the glazing being placed between the optical device and the target Mi, with said region in the field of view of the optical device, the acquisition of a second deformed image G2 of the target Mi.
- the sub-steps 1'a) and 1'b) are carried out without moving the glazing relative to the optical device and even without moving the glazing and the optical device, the sub-steps 1'a) and 1'b) being at less successive and preferably simultaneous when Mi is the second pattern M2.
- Mi is the second pattern M2, with L2>L1, the first pattern M1 obscuring the pattern M2, the substeps 1 b) and 1 'b) are in the absence of M1.
- Mi is the second target M2
- the acquisitions of step 1) are in the presence of M1 and M2, preferably successive or simultaneous acquisitions of sub-steps 1 'a) and 1 'b), in particular the The device is polychromatic, the first deformed image l′1 containing color patterns Co′1 and the second deformed image G2 containing color patterns Co′2 distinct from Co′1 .
- the acquisitions of substeps 1'a) and 1'b) are simultaneous, any acquisitions of substeps 1a) and 1b) are simultaneous and the first distorted image 1'1 and the second distorted image G2 are combined on a deformed common image l'1c, before step 3), the common image l'1c is segmented so as to obtain the images l'1 and G2 and possibly the first reference image 11 and the second reference image I2 are combined on a common image 11c and before step 3), the common image 11c is segmented so as to obtain the images I1 and I2.
- the method comprises: 2) a step for generating image points which are:
- step 2) can comprise a detection of points, in particular by sub-pixel detection of points,
- the method includes:
- each first pair comprising a first point of interest and its first other offset point of interest
- each second pair comprising second point of interest and its second other offset point of interest.
- the points of interest are chosen from:
- step 2) is based on the correlation of digital images, and includes:
- the first points are the centers C1 of the image portions and the first shifted points are the centers C'1 of the deformed image portions.
- the second points are preferably the centers image portions, the second shifted points are the centers of the distorted image portions.
- step 3 the method includes:
- FIG. 1 schematically represents in front view a glazing 100 for a motor vehicle, such as a windshield.
- the following figures illustrate a system for implementing a first step 1) of the method for analyzing the optical quality of the delimited region of the glazing according to a first aspect of the invention:
- FIG. 2 or figure 2 is a schematic representation of the system for the implementation of a sub-step 1a) of the first step.
- FIG. 3 or figure 3 is a schematic representation of the system for the implementation of a sub-step 1 'a) of the first step.
- FIG. 4 or figure 4 is a schematic representation of the system for the implementation of a sub-step 1 b) of the first step.
- FIG. 5 or figure 5 is a schematic representation of the system for the implementation of a sub-step 1 'b) of the first step.
- FIG. 6 is an explanatory schematic representation of the method according to the invention with a system of a first target M1 to L1 and a first target M1 (displaced) or M2 to L2.
- the following figures illustrate a system for implementing a first step 1) of the method for analyzing the optical quality of the delimited region of the glazing according to a second aspect of the invention:
- FIG. 7 or figure 7 is a schematic representation of the system for the implementation of a sub-step 1a) of the first step.
- FIG. 8 or figure 8 is a schematic representation of the system for the implementation of a sub-step 1 'a) of the first step.
- FIG. 9 or figure 9 is a schematic representation of a reference image with a field of first apparent displacements.
- FIG. 10 is a map 301 of the first interpolated apparent displacements for L1 of 0.5 m.
- FIG. 11 or figure 11 is a map of the second interpolated apparent displacements for L2 of 0.75m.
- FIG. 12 or figure 12 is a map of apparent third displacements interpolated for L3 of 1 m measured as experimental verification.
- FIG. 13 or figure 13 is a predictive map of apparent displacements simulated for L3 of 1m calculated from maps 301 and 302.
- FIG. 14 or figure 14 is a map of the difference between third apparent displacements and simulated apparent displacements.
- FIG. 15 shows a first reference image of a reference pattern M1 with random patterns (dots) 401 and a portion of image Im 11 of the first deformed image l′1.
- FIG. 16 shows a field of first displacements for four portions of disjoint images of the first deformed image.
- FIG. 17 is a schematic representation of a glazing comprising a delimited zone intended to be placed on the optical path of an optical device such as a camera.
- FIG. 18 is a schematic representation in side view of a glazing comprising a delimited zone intended to be placed on the optical path of an optical device such as a camera.
- FIG. 1 schematically represents a glazing 100 for a motor vehicle, such as a windshield.
- the glazing 100 comprises a sheet of glass 1 and an enamel strip 12.
- the enamel strip 12 forms a delimited zone 10 intended to be placed on the optical path of an optical device, such as a camera of a intelligent driver assistance system.
- the surface of the delimited zone is generally less than 0.5m 2 .
- the enamel strip 12 can be arranged entirely on the surface of only one of the two main faces of the glass sheet 1, or be divided into several parts, each of the parts being arranged on one and on the other of the faces of the sheet of glass 1 and all of the parts globally forming a delimited zone 10.
- the strip of enamel can also be made of several parts, each part being arranged on the surface of two or more glass sheets according to the number of parts so as to form a delimited area.
- the following figures illustrate a system for implementing a first step 1) of the method for analyzing the optical quality of the delimited region of the glazing according to a first aspect of the invention.
- Figure 2 is a schematic representation of the system for the implementation of a sub-step 1a) of the first step, namely:
- a first reference image h of a fixed (and illuminated) target M1 31 comprising a first set of (contrasted) patterns 32, 33 extending along two dimensions (X, Y orthogonal in particular Y vertical axis ), preferably 2D patterns - in particular on a first panel (in particular plane) -, at a distance L1 at least centimeter and preferably at most 5 m from an optical device for acquiring (digital) images 2 following the optical axis (Z) of the optical device, in particular at least 10, 50 or better still 100 patterns in the depth of field.
- FIG. 3 is a schematic representation of the system for the implementation of a sub-step 1 a) of the first step, namely the glazing 100 being placed between the optical device 2 and the first pattern M1 31 , with said region of surface in the field of view of the optical device, the acquisition of a first deformed image i of said first pattern M1 (physical), 31 to L1.
- the (curved) glazing is inclined at a first angle preferably identical to the angle of the glazing or +/-5° or +/-1° in the mounted position in a vehicle.
- FIG. 4 is a schematic representation of the system for the implementation of a sub-step 1'b) of the first step, namely the glazing 100 remaining placed between the optical device 2 and the first pattern M1 31 , with said region of surface in the field of view of the optical device, the acquisition of a second deformed image G2 of said first target M1 (physical), 31 at a distance L2 distinct from L1 of the optical device 2, preferably L2-L1 in absolute value is at least 1cm or 10cm or 20cm.
- Figure 5 is a schematic representation of the system for the implementation of a sub-step 1a) of the first step, namely the acquisition of a second reference image I 2 of the target M1 31 fixed (and illuminated) at the distance L2 (glazing absent).
- FIG. 6 is an explanatory schematic representation of the method according to the invention with a system 30' of a target M1 to L1 of the objective 22 and a system 30' to L2 of the first target M1 (displaced) or of the target M2 target 22.
- the detector 21 is preferably positioned so that the focus is made on the plane containing the real object A1 (respectively A2) at a distance L1 (respectively L2), each plane being successively preferably in the depth of field of the 'purpose.
- ⁇ Bi The angle with the optical axis Z (the horizontal) of the virtual ray at the point Bi is denoted ⁇ Bi with ⁇ i, j ⁇ ⁇ ⁇ 1,2 ⁇
- the virtual points Bi are defined by their position y Bi with ⁇ i,j ⁇ e ⁇ 1,2 ⁇ :
- the angle b is defined as the angle of the light ray coming from A1 or A2 or passing through A1 and A2 after it has passed through the transparent element 100, that is to say between the points H2 and G.
- the ray therefore goes intercept objective 22 at point y G : [Math 8] where ⁇ i, j ⁇ ⁇ ⁇ 1,2 ⁇
- P is the size of the physical pixel on the 21 ⁇ 1 detector and Y2 are the magnifications defined by:
- tan b represents the effect of refraction in 100 of the ray issuing from with an angle a.
- p 1 , p 2 , L 1 , L 2 , ⁇ 1 , y 2 and P are then known or determined.
- the following figures illustrate a system for implementing a first step 1) of the method for analyzing the optical quality of the delimited region of the glazing according to a second aspect of the invention.
- Figure 7 is a schematic representation of the system for implementing a simultaneous sub-step of 1a) and 1b) of the first step.
- the two reference images are acquired at the same time thanks to colored M1 31 checkerboard 32, 32' and colored M2 31' checkerboard 32, 32' patterns adapted respectively to L1 and L2 (different colors).
- M1 31 is closer to the 2' optical device of the RBG type.
- Figure 8 is a schematic representation of the system for the implementation of a simultaneous sub-step 1 'a) and 1 'b) of the first step.
- the two distorted images are acquired at the same time thanks to the appropriate M1 31 checkerboard 32, 32' and M2 31' checkerboard 32, 32' test charts.
- the glazing 100 is between the first M1 31 and the optical device 2'.
- FIG. 9 is a schematic representation 200 of a reference image (of a checkerboard of black and white patterns corresponding to the first pattern M1) with a field of first apparent displacements p1 i by pairs of first points of interest (K1i K'1i) which are the corners of the patterns.
- FIG. 10 is a map 301 of the first apparent displacements interpolated for L1 of 0.5 m.
- the patterns of the M1 checkerboard pattern are squares with a side of 5.4mm.
- the glazing is inclined at 30° with respect to the horizontal.
- FIG. 11 is a map 302 of the second interpolated apparent displacements for L2 of 0.75 m.
- the patterns of the M2 checkerboard pattern are squares with sides of 8.1mm.
- FIG. 12 is a map 303 of apparent third displacements interpolated for L3 of 1 m measured as experimental verification.
- the patterns of the M2 checkerboard pattern are squares with a side of 10.8mm.
- FIG. 13 is a predictive map 304 of apparent displacements simulated for L3 of 1 m calculated from maps 301 and 302.
- FIG. 14 is a map 305 of the difference between apparent third displacements and simulated apparent displacements.
- FIG. 15 shows a first reference image 400 of a reference pattern M1 with random patterns (dots) 401 and an image portion Im 11 of the first deformed image l '1 which is a sliding window on the first image of reference until the best localization of the image portion is found on the original image (calculation of the correlation function between the distorted image portion and portions of the reference image of equivalent size, the best location is defined by a maximum correlation function).
- the central point of this deformed image portion and the central point of the equivalent reference image portion are identified.
- the first apparent displacement is calculated between the two central points of the image portions.
- FIG. 16 shows a field of first displacements for four portions of disjoint images of the first deformed image Im11, Iml2, Iml3 and Iml4.
- Each first displacement p1 1 p1 2 p1 3 p1 4 apparent is illustrated between the two central points (C1 1 , C'1 1 ) (C1 2 , C'1 2 ) (C1 3 , C'1 3 ) (C1 4 , C'1 4 ) portions of images.
- FIG. 17 is a schematic representation of a glazing 1000 comprising a delimited zone 10 being intended to be placed on the optical path of an optical device such as a camera.
- the glazing 1000 incorporates a data storage device 2000 in the form of a data matrix or a bar code which refers to a database containing the cartography of the simulated apparent displacements.
- the data storage device is on said glazing printed on the periphery in a recess of the enamel strip 12 on the glazing (on the inside face 11 for example).
- Figure 18 is a schematic representation in side view of a glazing according to Figure 17 comprising the delimited zone placed on the optical path of an ADAS optical device such as a 2” camera.
- the delimited zone is a zone delimited by edges, in particular opaque edges, in particular edges formed by decorative elements making it possible to hide from view elements of devices, such as devices of on-board intelligent systems, arranged behind the glazing .
- the delimited area can have various shapes and/or include additional functional elements depending on the uses:
- the part in the form of a circle can, for example, be used to install an additional device such as a rain sensor or an outdoor light sensor.
- the rectangular portion with rounded edges further comprises a shading band on its outer periphery.
- the delimited zone can comprise a heating element on its surface, making it possible to eliminate any mist or frost likely to form on said surface and hinder the acquisition of an optical device placed opposite.
- the delimited zone of the glazing is a zone delimited by at least two edges, preferably three edges.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2107080A FR3124782B1 (fr) | 2021-06-30 | 2021-06-30 | Méthode d’analyse de la qualité optique d’un vitrage, méthode de calibration d’une caméra, vitrage analysé |
| PCT/FR2022/051287 WO2023275486A1 (fr) | 2021-06-30 | 2022-06-28 | Méthode d'analyse de la qualité optique d'un vitrage, méthode de calibration d'une caméra, vitrage analysé |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4364108A1 true EP4364108A1 (fr) | 2024-05-08 |
Family
ID=77411875
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22744805.7A Pending EP4364108A1 (fr) | 2021-06-30 | 2022-06-28 | Méthode d'analyse de la qualité optique d'un vitrage, méthode de calibration d'une caméra, vitrage analysé |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20240320818A1 (fr) |
| EP (1) | EP4364108A1 (fr) |
| CN (1) | CN115735234A (fr) |
| FR (1) | FR3124782B1 (fr) |
| WO (1) | WO2023275486A1 (fr) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP4016444B1 (fr) * | 2020-12-15 | 2025-06-18 | Continental Autonomous Mobility Germany GmbH | Procédé de rectification d'images et/ou de points d'image, système par caméra et véhicule |
| CN118731915A (zh) * | 2023-03-28 | 2024-10-01 | 上海禾赛科技有限公司 | 激光雷达的标定方法、标定设备及标定系统 |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB8424074D0 (en) * | 1984-09-24 | 1984-10-31 | British Aerospace | Testing light transmitting articles |
| FR2951544A1 (fr) * | 2009-10-21 | 2011-04-22 | Saint Gobain | Procede d'analyse de la qualite d'un vitrage |
| EP3293701B1 (fr) * | 2016-09-07 | 2019-11-06 | Conti Temic microelectronic GmbH | Procédé et appareil pour la compensation de distorsions d'images statiques introduites par un parebrise sur une caméra d'aide à la conduite automobile |
| CN106600642A (zh) * | 2016-10-31 | 2017-04-26 | 纵目科技(上海)股份有限公司 | 图像处理装置、图像校正、标定点查找方法及系统 |
| NL2018852B1 (en) * | 2017-05-05 | 2018-11-14 | Illumina Inc | Optical distortion correction for imaged samples |
| EP3844556B1 (fr) * | 2018-08-29 | 2026-03-11 | Saint-Gobain Sekurit France | Dispositif de vérification pour un affichage tête haute (hud) |
| FR3087891B1 (fr) * | 2018-10-24 | 2020-11-20 | Entpe | Dispositif optique pour la mesure des proprietes optiques des materiaux. |
| CN113165324B (zh) * | 2018-12-05 | 2023-06-30 | 中央硝子株式会社 | 具有修正结构的汽车玻璃 |
| US12091356B2 (en) * | 2019-02-13 | 2024-09-17 | Agc Glass Europe | Automotive glazing having superior optical quality |
| US12117405B2 (en) * | 2019-09-13 | 2024-10-15 | Acr Ii Glass America Inc. | Method and system for providing optical distortion information of a vehicle glazing |
| FR3101420B1 (fr) * | 2019-09-30 | 2023-12-29 | Saint Gobain | Méthode d’évaluation de la qualité optique d’une zone délimitée d’un vitrage |
| FR3104258B1 (fr) * | 2019-12-06 | 2021-12-31 | Saint Gobain | Méthode de mesure de la qualité optique d’une zone donnée d’un vitrage, dispositif de mesure associé |
| US11548356B2 (en) * | 2020-03-10 | 2023-01-10 | Racing Optics, Inc. | Protective barrier for safety glazing |
-
2021
- 2021-06-30 FR FR2107080A patent/FR3124782B1/fr active Active
-
2022
- 2022-06-28 US US18/575,674 patent/US20240320818A1/en active Pending
- 2022-06-28 WO PCT/FR2022/051287 patent/WO2023275486A1/fr not_active Ceased
- 2022-06-28 CN CN202280004523.6A patent/CN115735234A/zh active Pending
- 2022-06-28 EP EP22744805.7A patent/EP4364108A1/fr active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023275486A1 (fr) | 2023-01-05 |
| FR3124782A1 (fr) | 2023-01-06 |
| CN115735234A (zh) | 2023-03-03 |
| US20240320818A1 (en) | 2024-09-26 |
| FR3124782B1 (fr) | 2023-12-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Fade et al. | Long-range polarimetric imaging through fog | |
| BE1022486B1 (fr) | Un systeme d'appareil de prise de vues tof et une methode pour mesurer une distance avec le systeme | |
| EP2333481B1 (fr) | Système optronique et procédé d'élaboration d'images en trois dimensions dédiés à l'identification | |
| EP1989582B1 (fr) | Procede et dispositif d'identification et de calibration de systemes optiques panoramiques | |
| CA2880145C (fr) | Procede de controle non destructif d'une preforme d'aube | |
| FR2936605A1 (fr) | Dispositif d'analyse de la surface d'un substrat | |
| US12578287B2 (en) | Method for measuring the optical quality of a given region of a glazing unit, associated measuring device | |
| EP4364108A1 (fr) | Méthode d'analyse de la qualité optique d'un vitrage, méthode de calibration d'une caméra, vitrage analysé | |
| WO2021048066A1 (fr) | Ensemble de détection de défauts sur une carrosserie d'un véhicule automobile | |
| FR2633476A1 (fr) | Systemes de visualisation que l'on peut regarder sans devoir baisser la tete | |
| EP1084379A1 (fr) | Procede et dispositif d'acquisition opto-electrique de formes par illumination axiale | |
| JP7163060B2 (ja) | 迅速な複合材製造の高速度低ノイズインプロセスハイパースペクトル非破壊評価のためのシステム及び方法 | |
| KR101795728B1 (ko) | 적외선 영상 측정 및 처리 시스템 | |
| CA3152356A1 (fr) | Methode d'evaluation de la qualite optique d'une zone delimitee d'un vitrage | |
| EP2616764A1 (fr) | Dispositif et procédé de mesure de la forme d'un miroir ou d'une surface speculaire | |
| FR3056501A1 (fr) | Systeme d'aide a l'identification d'un vehicule automobile et son procede de mise en oeuvre | |
| EP2732401B1 (fr) | Dispositif et procede d'imagerie pour produire une image de marquages routiers | |
| EP2080153B1 (fr) | Installation de détection de l'unicité d'une personne dans un volume | |
| FR3088724A1 (fr) | Dispositif de detection optique des defauts d’un materiau en feuille, muni de deux tetes de detection | |
| FR3069065A1 (fr) | Procede et dispositif de determination de l'orientation d'un laser de balayage fixe | |
| FR2893573A1 (fr) | Procede de deection d'obstacles mis en oeuvre au sein d'un vehicule automobile. | |
| WO2026062119A1 (fr) | Procede pour la caracterisation d'un objet | |
| CN121955019A (zh) | 光学镜片成像系统及光学镜片缺陷检测方法 | |
| EP0742432A1 (fr) | Dispositif de contrÔle optique de la qualité d'articles transparents ou translucides | |
| EP4716932A1 (fr) | Vérification de conformité de faisceau d'éclairage dans un véhicule |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240130 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SAINT-GOBAIN SEKURIT FRANCE |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20260316 |