Classifications

• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
  • B62D—MOTOR VEHICLES; TRAILERS
  • B62D65/00—Designing, manufacturing, e.g. assembling, facilitating disassembly, or structurally modifying motor vehicles or trailers, not otherwise provided for
  • B62D65/005—Inspection and final control devices
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
  • B62D—MOTOR VEHICLES; TRAILERS
  • B62D65/00—Designing, manufacturing, e.g. assembling, facilitating disassembly, or structurally modifying motor vehicles or trailers, not otherwise provided for
  • B62D65/02—Joining sub-units or components to, or positioning sub-units or components with respect to, body shell or other sub-units or components
  • B62D65/024—Positioning of sub-units or components with respect to body shell or other sub-units or components
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/002—Measuring arrangements characterised by the use of optical techniques for measuring two or more coordinates
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
  • G01B11/03—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by measuring coordinates of points
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/14—Measuring arrangements characterised by the use of optical techniques for measuring distance or clearance between spaced objects or spaced apertures
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B11/00—Measuring arrangements characterised by the use of optical techniques
  • G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
  • G01B11/245—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures using a plurality of fixed, simultaneously operating transducers
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B21/00—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
  • G01B21/02—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness
  • G01B21/04—Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant for measuring length, width, or thickness by measuring coordinates of points
  • G01B21/042—Calibration or calibration artifacts
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B5/00—Measuring arrangements characterised by the use of mechanical techniques
  • G01B5/0025—Measuring of vehicle parts
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
  • G01B7/00—Measuring arrangements characterised by the use of electric or magnetic techniques
  • G01B7/14—Measuring arrangements characterised by the use of electric or magnetic techniques for measuring distance or clearance between spaced objects or spaced apertures
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/0002—Inspection of images, e.g. flaw detection
  • G06T7/0004—Industrial image inspection
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/0002—Inspection of images, e.g. flaw detection
  • G06T7/0004—Industrial image inspection
  • G06T7/001—Industrial image inspection using an image reference approach
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/10—Segmentation; Edge detection
  • G06T7/13—Edge detection
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/20—Analysis of motion
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/50—Depth or shape recovery
  • G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/50—Depth or shape recovery
  • G06T7/55—Depth or shape recovery from multiple images
  • G06T7/593—Depth or shape recovery from multiple images from stereo images
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/70—Determining position or orientation of objects or cameras
  • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T7/00—Image analysis
  • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N17/00—Diagnosis, testing or measuring for television systems or their details
  • H04N17/002—Diagnosis, testing or measuring for television systems or their details for television cameras
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2200/00—Indexing scheme for image data processing or generation, in general
  • G06T2200/04—Indexing scheme for image data processing or generation, in general involving 3D image data
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/10—Image acquisition modality
  • G06T2207/10016—Video; Image sequence
  • G06T2207/10021—Stereoscopic video; Stereoscopic image sequence
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/20—Special algorithmic details
  • G06T2207/20212—Image combination
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30108—Industrial image inspection
  • G06T2207/30156—Vehicle coating
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30108—Industrial image inspection
  • G06T2207/30164—Workpiece; Machine component
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30244—Camera pose
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
  • G06T2207/00—Indexing scheme for image analysis or image enhancement
  • G06T2207/30—Subject of image; Context of image processing
  • G06T2207/30248—Vehicle exterior or interior

Definitions

• the object of the invention is a method for measuring the leveling and the separation of parts of a vehicle and a measuring tunnel equipped with the necessary means to carry out the measurement of the leveling and the separation of parts of a vehicle.
• the aim is to automate the process of measuring the leveling and the separation that the different parts of a vehicle present with respect to those that surround them.
• a vehicle door has a perimeter edge that has to be flush with the parts of the vehicle that surround the door, such as other doors, wings, etc.
• the door has to have a specific separation within very narrow margins so that the opening and closing movement of the door is correct.
• the technical field to which the present invention belongs is the field of measurement devices and methods applied to the surfaces of a vehicle without contact with it.
• the present invention discloses a method of measuring flush and separation of vehicle parts and a tunnel for measuring flush and separation of vehicle parts.
• the measurement tunnel for leveling and separation of vehicle parts.
• the measurement tunnel comprises: video cameras to take images of a vehicle; a conveyor that linearly moves the vehicle and longitudinally traverses the measuring tunnel; a position encoder that measures the displacement of the vehicle; a total station that measures fixed points of the structure of the measurement tunnel in 3D with precision; a calibration board on which a calibration standard is placed; at least two lights synchronized with the video cameras; and, processing and storage means that store at least some images taken by the video cameras, some Computer Aided Design - CAD - files of the vehicles and an endpoint recognition algorithm.
• the processing and storage means are connected to the lights, the video cameras, the conveyor and the position encoder.
• the processing and storage means are adapted to carry out the steps of the method of measurement of leveling and separation of parts of a vehicle that are defined later in the second aspect of the invention.
• the position encoder or "encoder” is a pulse generator, which is connected to the shaft of a motor that moves the conveyor and generates pulses while the motor is turning.
• the position encoder serves to measure the advancement of the vehicle along the transport as the pulses are translated into a measure of length.
• the calibration standard is made up of squares arranged in a staggered fashion. Additionally, the calibration standard comprises a data matrix code and a fiducial mark.
• the data matrix code and the fiducial mark contain information related to the calibration pattern such as number of rows and columns, location of the central square, size of the squares, colors of the squares, etc.
• the squares are black and white because they have better contrast when you have to determine their junction points.
• the measurement tunnel additionally comprises an inverted "U" shaped support structure and a front support structure to support the lights, the vision cameras inside the measurement tunnel.
• These light and video camera mounts have the advantage of positioning the video cameras in such a way that a full scan of the vehicle within the measurement tunnel can be performed.
• the lights have a minimum length of 400mm. Additionally or optionally, the lights have LED technology.
• the method of measuring the leveling and separation of parts of a vehicle associated with the measuring tunnel of the first aspect of the invention comprises the following steps:
• SCV Inverse (MR) x SCE
• SCV is a matrix that defines the C, U, Z coordinates referenced to the vehicle reference system -SCV-
• SCE is a matrix that defines the C, U, Z coordinates referenced to the common reference system -SCE-
• MR is the relationship matrix between both reference systems and that defines the translation, rotation and scale necessary to go from a system to another reference;
• the video camera calibration process described in the video camera calibration step involves calculating the intrinsic and extrinsic parameters.
• To calculate the intrinsic parameters the following sub-steps are carried out:
• the measurement method for leveling and separation of vehicle parts comprises the following sub-steps:
• the next step is to calculate the 3D coordinates by stereovision of four reference points. of a vehicle based on the common reference system -SCE- obtaining the coordinates C, U, Z of each reference point.
• the following steps are carried out:
• recognition patterns can be generated for the recognition of subsequent identical vehicles by means of a vector search algorithm by contrast.
• Figure 1 shows the measurement tunnel for leveling and separation of parts of a vehicle and a vehicle inside.
• Figure 2 shows the measurement tunnel of the present invention where the calibration board has been located internally.
• Figure 3 shows the calibration standard on the calibration board.
• Figure 4 shows the total station taking 3D coordinates of four fixed points of the measurement tunnel.
• Figure 5 shows the calculation of four vehicle reference points using video cameras.
• Figure 6 shows a vehicle in perspective where four reference points are indicated.
• FIG. 7 shows the common reference system SCE and the vehicle reference system SCV.
• Figure 8 shows a vehicle on which it is desired to measure the flush and the distance between two parts of it.
• Figure 9 schematizes a sweep of the surface of two parts of a vehicle and a discontinuity in said surface defined between two extremes.
• Figure 10 shows a 2D image of a discontinuity between two parts of a vehicle and the position of the ends in 2D by X, Y coordinates of the ends.
• Figure 11 shows a 3D image of a discontinuity between two parts of a vehicle and the position of the ends in 3D by C, U, Z coordinates of the ends.
• Vehicle reference system -SCV- 18. 2D XY coordinates of one end;
• FIG 1 the measurement tunnel 1 of the present invention is shown to perform a measurement of the flush and the separation between any two parts of the body of a vehicle.
• Figure 1 shows the measuring tunnel 1 and, inside it, the chassis of the vehicle 7 on the conveyor 8.
• the purpose of the conveyor 8 is to move the vehicle 7 through the interior of the measuring tunnel 1.
• the measuring tunnel 1 is mainly composed of video cameras 2 and close to them, LED lights 22, all of them (2,22) are supported by the support structure 5 in the shape of an inverted "U" and also by the structure front support 6. Additionally, the measuring tunnel 1 has the vehicle conveyor 8, the position encoder 9 and the processing and storage means 10.
• the processing and storage means 10 are processors and memories configured to execute the steps of the method.
• the position encoder 9 serves so that the measurement tunnel 1 can know the position of the vehicle at all times. This allows synchronized images to be taken as will be described later.
• the calibration of the video cameras 2 consists of calculating the intrinsic and extrinsic parameters of the video cameras.
• a calibration board 3 is placed on the inside the measuring tunnel 1 as shown in figure 2.
• the calibration standard 4 On the surface of the calibration table 3 is located the calibration standard 4 whose shape is shown in figure 3.
• the calibration standard 4 is made up of squares 4c in black and white that alternate in a staggered fashion, similar to a chessboard.
• the calibration pattern 4 comprises the data matrix code 4a and the fiducial mark 4b arranged in different white squares.
• the processing and storage means 10 carry out the following steps to calculate the intrinsic parameters: they take at least two images of the calibration board 3 with the calibration standard 4 by the video cameras 2; decode the data matrix code 4a to obtain the size of the square 4c, the central square 4d, the number of rows and the number of columns of the calibration board 3.
• the processing and storage means 10 calculate all the unions of the squares from the central square, and with the unions of the squares, the size of the optics included in the video cameras and the cell size of the camera's CCD, calculate the intrinsic parameters 13 which are: the optical center, the focal length, at least six Radial distortion parameters (K1-K6) and at least two tangential distortion parameters (P1, P2).
• the total station 11 is used as shown in figure 4.
• the calibration board 3 is placed inside the measuring tunnel 1 in a position where is visible by at least one video camera 2.
• a measurement of the calibration board 3 is made by the total station 11. This involves creating the common reference system - SCE-15, for which, iterative measurements are made of four points of the structure of the measurement tunnel 1 and twelve points located on the calibration table 3 by means of the total station 11. That is, the same four points of the measurement tunnel 1 and twelve points located on the calibration table 3 are They measure from different positions of the total station 11 with respect to the measurement tunnel 1.
• the different positions are, preferably, the positions that a vehicle would travel on the conveyor 8.
• the relationship between the measurements taken from the four fixed points 12 of the measurement tunnel 1 and the twelve points located on the calibration board 3 allows creating the common reference system - SCE-15.
• each video camera 2 must be referenced with respect to the common reference system - SCE-15 in order to subsequently determine the 3D coordinates from one end of a part of the vehicle.
• the relationship between the common reference system -SCE- and the calibration board is calculated by transformation and estimation of rigid ones.
• at least one image of the calibration board 3 is saved for each video camera 2, the local coordinate system of each video camera 2 is calculated and, finally, the transformation from the local coordinate system to the reference system is calculated common -SCE-.
• the next step is applied consisting of calculating the 3D coordinates by stereovision of four reference points 15 of a vehicle based on the common reference system -SCE- obtaining the coordinates C, U, Z of each reference point as shown in figures 5 and 6.
• two video cameras 2 take images of the reference point 15 and obtain the 3D coordinates of the reference point 15 with respect to the common reference system - SCE - 16. Therefore, the 3D coordinates of two reference points are obtained. reference 15, one for each side of the vehicle.
• the 3D coordinates of two other reference points 15 are also calculated on both sides of the vehicle. It can be done simultaneously if there are video cameras 2 that can take images of the other two reference points 15 or sequentially moving the vehicle 7 through the conveyor 8 until the two video cameras 2 can have access to the others.
• the 3D coordinates of the reference points 15 have a correction factor to eliminate the offset, for the sequential form, which is known from the position encoder or "encoder" 9 located on the conveyor 8.
• the processing and storage means 10 can generate recognition patterns by means of a contrast vector search algorithm.
• the surface of the vehicle 7 is then analyzed by scanning the surface 25 (FIG. 9) to detect the separation zones (or sections) 23 to be measured (FIG. 8).
• the method of the present invention calculates the 3D coordinates of the ends 24 (figure 9) of the discontinuity that is generated between the different adjacent parts of the vehicle.
• light shots are fired through lights 22, which are synchronized with the video cameras 2.
• the light shots generate light reflection in the parts that make up the vehicle and darkness (absence of light reflection - see detail enlarged figure 10) in the separation (space between the ends 24 in figures 9 and 10) between said parts of the vehicle.
• each 2D synchronized image 20 is applied an end recognition algorithm with which the processing and storage means can calculate the X, Y coordinates 18 of each end 24 based on the common reference system -SCE-, associate it with the identifier - ID - and store it for later treatment.
• the 2D synchronized images 20 of the ends 18 are taken, the 2D synchronized images are combined into 3D images 21 to obtain 3D images where the ends in the 3D images have coordinates C, U, Z 19 referenced to the common reference system -SCE-. Since it is a matter of calculating the distance between two parts of the vehicle, that is, the distance between the extremes 24 on the vehicle itself, a transformation of the coordinates C, U, Z of the ends in the 3D images of the common reference system -SCE- to the vehicle reference system -SCV- through the relation equation:
• SCV Inverse (MR) x SCE
• SCV is a matrix that defines the C, U, Z coordinates referenced to the vehicle reference system -SCV-
• SCE is a matrix that defines the C, U, Z coordinates referenced to the reference system common -SCE-
• MR is the relationship matrix that defines the translation, rotation and scale necessary to go from the -SCV- to -SCE- reference system.

Landscapes

• Engineering & Computer Science (AREA)
• Physics & Mathematics (AREA)
• General Physics & Mathematics (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Theoretical Computer Science (AREA)
• Multimedia (AREA)
• Chemical & Material Sciences (AREA)
• Mechanical Engineering (AREA)
• Transportation (AREA)
• Combustion & Propulsion (AREA)
• Manufacturing & Machinery (AREA)
• Signal Processing (AREA)
• Quality & Reliability (AREA)
• General Health & Medical Sciences (AREA)
• Biomedical Technology (AREA)
• Health & Medical Sciences (AREA)
• Optics & Photonics (AREA)
• Length Measuring Devices By Optical Means (AREA)

Priority Applications (5)

Applications Claiming Priority (2)

Publications (1)

Family

ID=75538890

Family Applications (1)

Country Status (8)

Citations (4)

Family Cites Families (9)

• 2019
  • 2019-10-23 ES ES201930936A patent/ES2821104B2/es active Active
• 2020
  • 2020-07-28 EP EP20879248.1A patent/EP4049920A4/en active Pending
  • 2020-07-28 JP JP2022506341A patent/JP7373053B2/ja active Active
  • 2020-07-28 US US17/764,333 patent/US11953310B2/en active Active
  • 2020-07-28 WO PCT/ES2020/070488 patent/WO2021079018A1/es unknown
  • 2020-07-28 CN CN202080068189.1A patent/CN114502456A/zh active Pending
  • 2020-07-28 KR KR1020227006606A patent/KR102639910B1/ko active IP Right Grant
  • 2020-08-18 TW TW109128023A patent/TW202134098A/zh unknown

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events