CN106934345B - Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system - Google Patents
Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system Download PDFInfo
- Publication number
- CN106934345B CN106934345B CN201710056624.9A CN201710056624A CN106934345B CN 106934345 B CN106934345 B CN 106934345B CN 201710056624 A CN201710056624 A CN 201710056624A CN 106934345 B CN106934345 B CN 106934345B
- Authority
- CN
- China
- Prior art keywords
- vehicle
- flaw
- vehicle body
- information
- scar
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 72
- 238000010276 construction Methods 0.000 title abstract description 9
- 231100000241 scar Toxicity 0.000 claims abstract description 149
- 208000032544 Cicatrix Diseases 0.000 claims abstract description 54
- 230000037387 scars Effects 0.000 claims abstract description 54
- 238000013507 mapping Methods 0.000 claims description 22
- 230000000875 corresponding effect Effects 0.000 description 84
- 230000002596 correlated effect Effects 0.000 description 4
- 230000000977 initiatory effect Effects 0.000 description 3
- 230000003902 lesion Effects 0.000 description 3
- 150000001732 carboxylic acid derivatives Chemical class 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000007689 inspection Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000007795 chemical reaction product Substances 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/58—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V20/584—Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads of vehicle lights or traffic lights
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
The invention relates to a vehicle flaw library and a construction method thereof, a vehicle flaw information display method and a system, wherein a vehicle body is comprehensively shot according to a preset rule, the vehicle body is divided into 5 curved surfaces including a front curved surface, a rear curved surface, a left curved surface, a right curved surface and a top curved surface, possible flaws on the 5 curved surfaces are orthographically projected onto corresponding projection surfaces, and then coordinates of the flaws on the corresponding projection surfaces are obtained. In the vehicle flaw library of the present invention, only the vehicle number, the vehicle type, and the flaw position information are stored. Compared with the prior art for storing image information, the method has the advantages that the flaw data uploading and downloading speed is increased, the flaw data calling efficiency is improved, and hardware resources required by database storage are saved; compared with the prior art only storing the character information, the description of the scars is more intuitive and accurate.
Description
Technical Field
The invention relates to the field of image recognition, in particular to a vehicle flaw library and a construction method thereof, and a vehicle flaw information display method and system.
Background
At present, in order to facilitate the life of drivers, many new business types are emerging continuously, such as passenger parking, passenger driving, energy supplement by the passenger, and the like, and the rubbing and collision of vehicles during driving or parking in such services are frequently encountered problems, and the problem of responsibility judgment of vehicle scars becomes one of important problems seriously influencing the smooth development of such services. Therefore, in such service, it is necessary to inspect the surface of the vehicle body before opening the user's vehicle, and compare the inspected flaw with the vehicle body flaw recorded at the time of the previous service.
In order to realize the comparison of the scars, a relatively universal mode is that in the process of each inspection by service personnel, the scars are recorded in a cloud terminal in a text or image mode. And in next service inspection, calling out the record. This approach is very problematic in terms of both efficiency and effectiveness. For example, the same lesion may be repeatedly entered in different service patrols; the images and characters are not intuitive, thereby affecting the comparison efficiency.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a vehicle scar library, a construction method thereof, a vehicle scar information display method and a vehicle scar information display system, which can accelerate the uploading and downloading speed of scar data, further improve the efficiency of invoking the scar data and save the hardware resources required by the storage of the database.
The invention provides a vehicle scar library, which comprises vehicle codes of vehicles and position information corresponding to all scars in the vehicles; the vehicle code is an identity code of the vehicle; each vehicle code correlates to the location information of all the lesions in its corresponding vehicle.
Preferably, the position information of the flaw includes a number of a vehicle body portion where the flaw is located and coordinate information of the corresponding flaw.
Preferably, the coordinate information of the scar is: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a reference plane of a three-dimensional coordinate system of the vehicle, the flaw is subjected to coordinate information on a corresponding projection plane.
Preferably, the method of orthographically projecting the curved surface of the body part with the flaw onto the reference plane of the three-dimensional coordinate system of the vehicle includes:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, and selecting the reference plane with the larger orthographic projection area as the projection plane corresponding to the vehicle body part; orthographically projecting the curved surface of the front part of the vehicle body to the projection surface; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
Preferably, the position information of the flaw is coordinate information of the flaw, and the method includes: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the flaw is subjected to coordinate information on a corresponding projection plane.
Preferably, the method of orthographically projecting the curved surface of the body part with the flaw onto the two-dimensional coordinate plane includes:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
Preferably, the position information of the scar is: mapping the three-dimensional space coordinate position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
Preferably, the coordinate information of the scar on the corresponding projection surface is: and the pixel point coordinates of the scars on the corresponding projection surfaces.
Preferably, the vehicle body parts are numbered as follows: the vehicle body part is divided into 5 curved surfaces of front, rear, left, right and top, and the 5 curved surfaces are respectively numbered as the numbers of the corresponding vehicle body parts.
Preferably, the vehicle scar library further comprises vehicle type information associated with a vehicle code.
The invention also provides a vehicle scar library construction method, which comprises the following steps:
step A1, acquiring vehicle codes and vehicle type information of vehicles;
step A2, shooting a car body photo, and numbering the shot photo;
step A3, identifying the flaw in the car body photo, and acquiring the number of the photo where the flaw is located;
step A4, determining the position information of the flaw according to the vehicle type information and the number of the photo where the flaw is located;
step A5, the vehicle code and the vehicle type of the vehicle are correlated with the position information of all the flaws in the vehicle to form a vehicle flaw library.
Preferably, step a2 includes:
step A21, dividing the vehicle body into different shooting areas according to the preset size aiming at the specific vehicle type and the camera parameters;
and step A22, performing uniform horizontal annular motion on the camera around the vehicle body according to the preset camera motion speed, shooting the local part of the vehicle body according to the preset shooting frequency, and numbering the shot pictures of the local part of the vehicle body.
Preferably, the shooting area is divided into one or more groups with different heights; if the shooting area is more than one group with different heights, when the camera horizontally moves for a circle to return to the starting point, the shooting area is moved to the shooting area with another height by adjusting the height or the shooting angle of the camera, and the step A22 is repeated until all the shooting areas are traversed.
Preferably, the position information of the flaw in step a4 includes the number of the vehicle body part where the flaw is located and the coordinate information of the flaw;
the serial numbers of the vehicle body parts are as follows: dividing the vehicle body part into 5 curved surfaces of front, back, left, right and top, numbering the 5 curved surfaces respectively as the number of the corresponding vehicle body part;
the coordinate information of the scar is as follows: and (3) orthographically projecting the curved surface of the body part where the flaw is located to a reference plane of a three-dimensional coordinate system of the vehicle, and then obtaining pixel point coordinates of the flaw on a corresponding projection plane, namely coordinate information of the corresponding flaw.
Preferably, the method of orthographically projecting the curved surface of the body part with the flaw onto the reference plane of the three-dimensional coordinate system of the vehicle includes:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, selecting the reference plane with the larger orthographic projection area as a projection plane corresponding to the vehicle body part, and orthographically projecting the curved surface of the front part of the vehicle body to the projection plane; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
Preferably, the position information of the scar in step a4 is:
after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the pixel point coordinates of the flaw on the corresponding projection plane are the position information of the corresponding flaw.
Preferably, the method of orthographically projecting the curved surface of the body part with the flaw onto the two-dimensional coordinate plane includes:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
Preferably, the position information of the scar in step a4 is: mapping the position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
Preferably, the vehicle code information is a license plate number; in the step a1, the method for acquiring the vehicle code and the vehicle type information of the vehicle includes:
acquiring license plate number information in a mode of information input window or by a method of image recognition of the shot vehicle body picture;
the vehicle type information is obtained through an information input window or through a method of carrying out image recognition on the shot vehicle body picture, or the pre-stored vehicle type information is called through inquiring the license plate number.
Preferably, the vehicle scar bank building method further includes a step of updating the vehicle scar bank, and the step includes:
adopting steps A1-A4 to obtain the vehicle code, the vehicle type and the current position information of all the scars of the vehicle;
comparing the acquired position information of all the current scars with the position information of all the scars stored before, if the position information of new scars exists, increasing the position information of the scars by adopting the method of the step A5, and if the scars disappear, deleting the corresponding position information of the scars.
The invention also provides a vehicle scar information display method, based on the vehicle scar library, according to the vehicle code information of the input vehicle, acquiring the position information of all the scars of the vehicle; back projecting the coordinates of the scars on a 3D model of a vehicle type corresponding to the vehicle; the 3D model and the flaw coordinate information in the vehicle flaw library adopt the same coordinate system.
The invention also provides a vehicle scar information display system, comprising: the system comprises a vehicle scar management system and a vehicle scar terminal display system;
the vehicle scar library management system is used for creating, adding and deleting scar information in a vehicle scar library; receiving a query request sent by a vehicle scar terminal display system, and querying corresponding scar information according to a vehicle code;
and the vehicle scar terminal display system is used for initiating a request for inquiring vehicle scar information to the vehicle scar management system and displaying the received scar information on a 3D model of a vehicle type corresponding to the vehicle.
In the vehicle flaw library of the present invention, only the vehicle code, the vehicle type, and the flaw position information are stored. Compared with the prior art for storing image information, the method has the advantages that the flaw data uploading and downloading speed is increased, the flaw data calling efficiency is improved, and hardware resources required by database storage are saved; compared with the prior art only storing character information, the method is more visual and accurate in scar tracing.
Scheme 1, a vehicle scar library, characterized by comprising vehicle codes, position information corresponding to all scars in a vehicle; the vehicle code is an identity code of the vehicle;
each vehicle code correlates to the location information of all the lesions in its corresponding vehicle.
The vehicle scar bank according to claim 2 or 1 is characterized in that the position information of the scar includes a serial number of a vehicle body part where the scar is located and coordinate information of the corresponding scar.
The vehicle scar bank according to claim 3 and claim 2, wherein the coordinate information of the scars is: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a reference plane of a three-dimensional coordinate system of the vehicle, the flaw is subjected to coordinate information on a corresponding projection plane.
The vehicle flaw library according to claim 4 and claim 3 is characterized in that the curved surface of the vehicle body part where the flaw is located is orthographically projected to a vehicle three-dimensional coordinate system reference plane, and the method comprises the following steps:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, and selecting the reference plane with the larger orthographic projection area as the projection plane corresponding to the vehicle body part; orthographically projecting the curved surface of the front part of the vehicle body to the projection surface; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
The vehicle scar bank according to claim 5 and claim 1, wherein the position information of the scar is coordinate information of the scar, and the method includes: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the flaw is subjected to coordinate information on a corresponding projection plane.
Scheme 6, according to scheme 5 vehicle scar storehouse, characterized by, with the curved surface orthographic projection of scar place automobile body position to two-dimensional coordinate plane, include:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
The vehicle scar bank according to claim 7 and claim 1, wherein the positional information of the scars is: mapping the position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
The vehicle scar bank according to claim 8 or 3 or 5, wherein the coordinate information of the scars on the corresponding projection surfaces is: and the pixel point coordinates of the scars on the corresponding projection surfaces.
The vehicle scar bank according to any one of claims 9 and 2 to 4, wherein the vehicle body parts are numbered as follows: the vehicle body part is divided into 5 curved surfaces of front, rear, left, right and top, and the 5 curved surfaces are respectively numbered as the numbers of the corresponding vehicle body parts.
The vehicle scar bank according to any of claims 1 to 7, characterized by further including vehicle type information associated with a vehicle code.
Scheme 11, a method for constructing a vehicle scar bank, comprising:
step A1, acquiring vehicle codes and vehicle type information of vehicles;
step A2, shooting a car body photo, and numbering the shot photo;
step A3, identifying the flaw in the car body photo, and acquiring the number of the photo where the flaw is located;
step A4, determining the position information of the flaw according to the vehicle type information and the number of the photo where the flaw is located;
step A5, the vehicle code and the vehicle type of the vehicle are correlated with the position information of all the flaws in the vehicle to form a vehicle flaw library.
The method according to claim 12 or 11, wherein step a2 includes:
step A21, dividing the vehicle body into different shooting areas according to the preset size aiming at the specific vehicle type and the camera parameters;
and step A22, performing uniform horizontal annular motion on the camera around the vehicle body according to the preset camera motion speed, shooting the local part of the vehicle body according to the preset shooting frequency, and numbering the shot pictures of the local part of the vehicle body.
The method according to claim 13 or 12, wherein the shooting area is divided into one or more groups with different heights;
if the shooting area is more than one group with different heights, when the camera horizontally moves for a circle to return to the starting point, the shooting area is moved to the shooting area with another height by adjusting the height or the shooting angle of the camera, and the step A22 is repeated until all the shooting areas are traversed.
The method according to claim 14 or 11, wherein the positional information of the flaw in step a4 includes a number of the vehicle body part where the flaw is located and coordinate information of the flaw;
the serial numbers of the vehicle body parts are as follows: dividing the vehicle body part into 5 curved surfaces of front, back, left, right and top, numbering the 5 curved surfaces respectively as the number of the corresponding vehicle body part;
the coordinate information of the scar is as follows: and (3) orthographically projecting the curved surface of the body part where the flaw is located to a reference plane of a three-dimensional coordinate system of the vehicle, and then obtaining pixel point coordinates of the flaw on a corresponding projection plane, namely coordinate information of the corresponding flaw.
The method according to claim 15 or 14, wherein the method of orthographically projecting the curved surface of the body part with the flaw to the reference plane of the three-dimensional coordinate system of the vehicle comprises the following steps:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, selecting the reference plane with the larger orthographic projection area as a projection plane corresponding to the vehicle body part, and orthographically projecting the curved surface of the front part of the vehicle body to the projection plane; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
The method according to claim 16 or 11, wherein the positional information of the flaw in step a4 is: after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the pixel point coordinates of the flaw on the corresponding projection plane are the position information of the corresponding flaw.
The method according to claim 17 or 16, wherein the curved surface of the vehicle body part where the flaw is located is orthographically projected onto a two-dimensional coordinate plane, and the method comprises:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
The method according to claim 18 or 11, wherein the positional information of the flaw in step a4 is: mapping the position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
The method according to any one of aspects 19 to 11, wherein the reaction solution is a solution containing a reaction product of a carboxylic acid and a carboxylic acid,
the vehicle code information is a license plate number;
in the step a1, the method for acquiring the vehicle code and the vehicle type information of the vehicle includes:
acquiring license plate number information in a mode of information input window or by a method of image recognition of the shot vehicle body picture;
the vehicle type information is obtained through an information input window or through a method of carrying out image recognition on the shot vehicle body picture, or the pre-stored vehicle type information is called through inquiring the license plate number.
The method according to any one of claims 11 to 18, further comprising a step of updating the vehicle scar bank, the step including:
adopting steps A1-A4 to obtain the vehicle code, the vehicle type and the current position information of all the scars of the vehicle;
comparing the acquired position information of all the current scars with the position information of all the scars stored before, if the position information of new scars exists, increasing the position information of the scars by adopting the method of the step A5, and if the scars disappear, deleting the corresponding position information of the scars.
The method for displaying the vehicle scar information is characterized in that the position information of all scars of the vehicle is acquired according to the vehicle code information of the input vehicle based on the vehicle scar library of any one of the schemes 1 to 7; back projecting the coordinates of the scars on a 3D model of a vehicle type corresponding to the vehicle; the 3D model and the flaw coordinate information in the vehicle flaw library adopt the same coordinate system.
A vehicle scar information display system according to claim 22, characterized by comprising: the system comprises a vehicle scar management system and a vehicle scar terminal display system;
the vehicle scar library management system is used for creating, adding and deleting scar information in a vehicle scar library; receiving a query request sent by a vehicle scar terminal display system, and querying corresponding scar information according to a vehicle code;
and the vehicle scar terminal display system is used for initiating a request for inquiring vehicle scar information to the vehicle scar management system and displaying the received scar information on a 3D model of a vehicle type corresponding to the vehicle.
Drawings
FIG. 1 is a vehicle coordinate system employed in the present embodiment;
fig. 2 is a schematic flow chart of the construction of the vehicle scar bank in the embodiment.
Detailed Description
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only for explaining the technical principle of the present invention, and are not intended to limit the scope of the present invention.
The invention provides a method for detecting, recording and displaying vehicle scars, which aims to solve the problem of responsibility judgment of vehicle scars related to the driving of a driver in the vehicle service when a passenger parks, drives and carries out related services such as energy supplement.
The invention relates to a vehicle flaw library, which comprises license plate numbers of vehicles and position information corresponding to all flaws in the vehicles; each license plate number is correlated with the position information of all scars in the corresponding vehicle; because there may be multiple flaws in the same vehicle, each license plate number may be associated with location information for one or more flaws.
In this embodiment, the position information of the flaw includes a number of a vehicle body portion where the flaw is located, and coordinate information of the corresponding flaw.
In this embodiment, the coordinate information of the scar is: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a reference plane of a three-dimensional coordinate system of the vehicle, the flaw is subjected to coordinate information on a corresponding projection plane.
In this embodiment, as shown in fig. 1, an automobile coordinate system in ISO4130-1978 may be adopted, and the orthographic projection of the curved surface of the body part where the flaw is located on the reference plane of the three-dimensional coordinate system of the vehicle specifically includes:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes (an X reference plane and a Y reference plane) in the vertical direction, and selecting the reference plane (the X reference plane) with the larger orthographic projection area as a projection plane corresponding to the vehicle body part; orthographically projecting the curved surface of the front part of the vehicle body to the projection surface; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces (the projection surface corresponding to the rear part of the vehicle body is an X reference plane, and the projection surfaces corresponding to the left and right vehicle body parts are Y reference planes) by the same method;
for the top of the vehicle body, a horizontal direction reference plane (Z reference plane) is selected as a corresponding projection plane, and the curved surface of the top of the vehicle body is orthographically projected to the corresponding projection plane.
In this embodiment, the position information of the flaw is coordinate information of the flaw, and specifically includes: and (4) after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the flaw is subjected to coordinate information on a corresponding projection plane.
In this embodiment, the method for orthographically projecting the curved surface of the body part where the flaw is located to the two-dimensional coordinate plane includes:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
In this embodiment, the position information of the flaw is: mapping the three-dimensional space coordinate position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
The said unijective function, let f be the mapping from set a to set B, if all the unequal elements in set a are mapped to set B to obtain unequal values, for example, x, y ∈ a, and x ≠ y, obtain f (x) ≠ f (y), then it is called f as the unijective function from a to B.
In this embodiment, the coordinate information of the scar on the corresponding projection surface is: and the pixel point coordinates of the scars on the corresponding projection surfaces.
In this embodiment, the vehicle body part is numbered as follows: the vehicle body part is divided into 5 curved surfaces of front, rear, left, right and top, and the 5 curved surfaces are respectively numbered as the numbers of the corresponding vehicle body parts.
In this embodiment, the vehicle scratch library further includes vehicle type information associated with a license plate number.
The invention also provides a vehicle scar library construction method, wherein the surface of the vehicle body is divided into a plurality of small areas according to the parameters or preset sizes of the camera, and each small area is exactly corresponding to one picture when the camera rotates around the vehicle body; according to the coordinates of the scars in the corresponding pictures and the numbers of the corresponding pictures, the specific positions of the scars on the car body can be obtained; and then orthographically projecting the position onto the selected projection plane to obtain the coordinate value of the scar on the projection plane.
The mode that adopts the subregion to divide in this embodiment to shoot is in order to obtain high-definition automobile body position picture and shoot the automobile body position in limited space as far as possible, if the definition of shooing, and shoot the space and can satisfy the demand, also can carry out whole shooting to each automobile body position.
The specific steps are shown in fig. 2, and include:
step A1, acquiring license plate number and model information of a vehicle;
step A2, shooting a car body photo, and numbering the shot photo;
step A3, identifying the flaw in the car body photo, and acquiring the number of the photo where the flaw is located;
step A4, determining the position information of the flaw according to the vehicle type information and the number of the photo where the flaw is located;
step A5, the license plate number and the vehicle type of the vehicle are correlated with the position information of all the flaws in the vehicle to form a vehicle flaw library.
In this embodiment, step a2 specifically includes:
step A21, dividing the vehicle body into different shooting areas according to the preset size aiming at the specific vehicle type and the camera parameters;
and step A22, performing uniform horizontal annular motion on the camera around the vehicle body according to the preset camera motion speed, shooting the local part of the vehicle body according to the preset shooting frequency, and numbering the shot pictures of the local part of the vehicle body.
In this embodiment, the shooting area is divided into one or more groups with different heights; if the shooting area is more than one group with different heights, when the camera horizontally moves for a circle to return to the starting point, the shooting area is moved to the shooting area with another height by adjusting the height or the shooting angle of the camera, and the step A22 is repeated until all the shooting areas are traversed.
In this embodiment, the position information of the flaw in step a4 includes the number of the vehicle body part where the flaw is located and the coordinate information of the flaw;
the serial numbers of the vehicle body parts are as follows: dividing the vehicle body part into 5 curved surfaces of front, back, left, right and top, numbering the 5 curved surfaces respectively as the number of the corresponding vehicle body part;
the coordinate information of the scar is specifically as follows: and (3) orthographically projecting the curved surface of the body part where the flaw is located to a reference plane of a three-dimensional coordinate system of the vehicle, and then obtaining pixel point coordinates of the flaw on a corresponding projection plane, namely coordinate information of the corresponding flaw.
In this embodiment, the method for orthographically projecting the curved surface of the body part where the flaw is located to the reference plane of the three-dimensional coordinate system of the vehicle specifically includes:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, selecting the reference plane with the larger orthographic projection area as a projection plane corresponding to the vehicle body part, and orthographically projecting the curved surface of the front part of the vehicle body to the projection plane; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
In this embodiment, the position information of the scar in step a4 specifically includes:
after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the pixel point coordinates of the flaw on the corresponding projection plane are the position information of the corresponding flaw.
In this embodiment, the method for orthographically projecting the curved surface of the body part where the flaw is located to the two-dimensional coordinate plane includes:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
In this embodiment, the position information of the flaw in step a4 is: mapping the position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
In this embodiment, the method for acquiring the license plate number and the model information of the vehicle in step a1 includes:
acquiring license plate number information in a mode of information input window or by a method of image recognition of the shot vehicle body picture;
the vehicle type information is obtained through an information input window or through a method of carrying out image recognition on the shot vehicle body picture, or the pre-stored vehicle type information is called through inquiring the license plate number.
The information input window is a conventional window input mode such as a character input window or a voice input window.
In this embodiment, the vehicle scar bank construction method further includes a step of updating the vehicle scar bank, and specifically includes:
adopting steps A1-A4 to obtain the license plate number and the model of the vehicle and the position information of all current scars;
comparing the acquired position information of all the current scars with the position information of all the scars stored before, if the position information of new scars exists, increasing the position information of the scars by adopting the method of the step A5, and if the scars disappear, deleting the corresponding position information of the scars.
In this embodiment, if a flaw of the vehicle is not detected, the number plate and the model information of the vehicle are stored in the flaw library, and only the related flaw position information is empty.
The invention also provides a vehicle flaw information display method, based on the vehicle flaw library, according to the license plate number information of the input vehicle, the position information of all flaws of the vehicle is obtained; back projecting the coordinates of the scars on a 3D model of a vehicle type corresponding to the vehicle; the 3D model and the flaw coordinate information in the vehicle flaw library adopt the same coordinate system.
And the back projection is to project the flaw coordinates from the corresponding projection plane to the corresponding vehicle body part on the 3D model in a direction perpendicular to the corresponding projection plane.
The invention also provides a vehicle scar information display system, comprising: the system comprises a vehicle scar management system and a vehicle scar terminal display system;
the vehicle scar library management system is used for creating, adding and deleting scar information in a vehicle scar library; receiving an inquiry request sent by a vehicle scar terminal display system, and inquiring corresponding scar information according to a license plate number;
and the vehicle scar terminal display system is used for initiating a request for inquiring vehicle scar information to the vehicle scar management system and displaying the received scar information on a 3D model of a vehicle type corresponding to the vehicle.
In the above embodiments, the license plate number of the vehicle is used as the vehicle code to perform the unique identification of the vehicle, but it is also possible to use other forms of vehicle codes to perform the unique identification of the vehicle, such as a code in the form of a number, or a letter, or a combination of a number and a letter, which uniquely corresponds to the license plate number of the vehicle, or other coding forms for vehicle identification; since the vehicle identification and vehicle identification coding technology is a mature technology in the field of vehicle identification, the vehicle coding forms and the corresponding vehicle identification methods that can be adopted are not listed one by one here, and the technical implementation thereof is not explained.
Those of skill in the art will appreciate that the method steps of the examples described in connection with the embodiments disclosed herein may be embodied in electronic hardware, computer software, or combinations of both, and that the components and steps of the examples have been described above generally in terms of their functionality in order to clearly illustrate the interchangeability of electronic hardware and software. Whether such functionality is implemented as electronic hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.
Claims (8)
1. A method of vehicle scar information display, comprising:
step A1, acquiring vehicle codes and vehicle type information of vehicles;
step A2, shooting a car body photo, and numbering the shot photo;
step A3, identifying the flaw in the car body photo, and acquiring the number of the photo where the flaw is located;
step A4, determining the position information of the flaw according to the vehicle type information and the number of the photo where the flaw is located;
step A5, associating the vehicle code and the vehicle type of the vehicle with the position information of all the scars in the vehicle to form a vehicle scar library;
based on the vehicle scar library, acquiring position information of all scars of the vehicle according to the vehicle coding information of the input vehicle; back projecting the coordinates of the scars on a 3D model of a vehicle type corresponding to the vehicle; the 3D model and the flaw coordinate information in the vehicle flaw library adopt the identical coordinate system;
wherein,
the position information of the flaw comprises the number of the vehicle body part where the flaw is located and the coordinate information of the flaw; the coordinate information of the scar is as follows: the method comprises the steps that after a curved surface of a vehicle body part where a flaw is located is orthographically projected to a vehicle three-dimensional coordinate system reference plane, pixel point coordinates of the flaw on a corresponding projection plane are obtained, and the pixel point coordinates are coordinate information of the corresponding flaw; or
The position information of the scar is as follows: after the curved surface of the vehicle body part where the flaw is located is orthographically projected to a two-dimensional coordinate plane, the pixel point coordinate of the flaw on the corresponding projection plane is the position information of the corresponding flaw; or
The position information of the scar is as follows: mapping the position of the flaw to the same two-dimensional coordinate plane to obtain a two-dimensional pixel point coordinate; the mapping function used in the mapping is a injective function.
2. The method of vehicle scar information display of claim 1, wherein step a2 includes:
step A21, dividing the vehicle body into different shooting areas according to the preset size aiming at the specific vehicle type and the camera parameters;
and step A22, performing uniform horizontal annular motion on the camera around the vehicle body according to the preset camera motion speed, shooting the local part of the vehicle body according to the preset shooting frequency, and numbering the shot pictures of the local part of the vehicle body.
3. The method for displaying information on vehicle scars according to claim 2, wherein the shot areas are divided into one or more groups with different heights;
if the shooting area is more than one group with different heights, when the camera horizontally moves for a circle to return to the starting point, the shooting area is moved to the shooting area with another height by adjusting the height or the shooting angle of the camera, and the step A22 is repeated until all the shooting areas are traversed.
4. The method of vehicle scar information display of claim 1, characterized by,
the serial numbers of the vehicle body parts are as follows: the vehicle body part is divided into 5 curved surfaces of front, rear, left, right and top, and the 5 curved surfaces are respectively numbered as the numbers of the corresponding vehicle body parts.
5. The method for displaying the vehicle flaw information according to claim 4, wherein the method for orthographically projecting the curved surface of the vehicle body part where the flaw is located to the reference plane of the vehicle three-dimensional coordinate system comprises the following steps:
for the front part of the vehicle body, comparing the orthographic projection areas of the curved surface of the vehicle body part on two reference planes in the vertical direction, selecting the reference plane with the larger orthographic projection area as a projection plane corresponding to the vehicle body part, and orthographically projecting the curved surface of the front part of the vehicle body to the projection plane; orthographically projecting the curved surfaces of the rear, left and right vehicle body parts to the corresponding projection surfaces by the same method;
and selecting a horizontal reference plane as a corresponding projection plane for the top of the vehicle body, and orthographically projecting the curved surface of the top of the vehicle body to the corresponding projection plane.
6. The method for displaying information on vehicle flaws according to claim 1, wherein the method for orthographically projecting the curved surface of the vehicle body part with flaws onto a two-dimensional coordinate plane comprises:
the curved surfaces of the front, rear, left and right 4 vehicle body parts of the vehicle body are unfolded along the horizontal direction; orthographic projection is carried out on the front, rear, left and right 4 curved surfaces of the unfolded vehicle body to the same two-dimensional coordinate plane in the vertical direction;
orthographic projection is carried out on the top curved surface of the vehicle body to a two-dimensional coordinate plane in the horizontal direction.
7. The method of vehicle scar information display according to any one of claims 1 to 6, characterized in that,
the vehicle code information is a license plate number;
in the step a1, the method for acquiring the vehicle code and the vehicle type information of the vehicle includes:
acquiring license plate number information in a mode of information input window or by a method of image recognition of the shot vehicle body picture;
the vehicle type information is obtained through an information input window or through a method of carrying out image recognition on the shot vehicle body picture, or the pre-stored vehicle type information is called through inquiring the license plate number.
8. The method of displaying vehicle scar information according to any one of claims 1 to 6, further including the step of updating a vehicle scar library, including:
adopting steps A1-A4 to obtain the vehicle code, the vehicle type and the current position information of all the scars of the vehicle;
comparing the acquired position information of all the current scars with the position information of all the scars stored before, if the position information of new scars exists, increasing the position information of the scars by adopting the method of the step A5, and if the scars disappear, deleting the corresponding position information of the scars.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056624.9A CN106934345B (en) | 2017-01-25 | 2017-01-25 | Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710056624.9A CN106934345B (en) | 2017-01-25 | 2017-01-25 | Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106934345A CN106934345A (en) | 2017-07-07 |
| CN106934345B true CN106934345B (en) | 2020-03-27 |
Family
ID=59422927
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710056624.9A Active CN106934345B (en) | 2017-01-25 | 2017-01-25 | Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106934345B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110503067B (en) * | 2019-08-28 | 2022-10-25 | 南阳理工学院 | Device for detecting automobile paint surface scars |
| CN112004010B (en) * | 2020-08-27 | 2021-12-10 | 北京中都星徽物流有限公司 | Finished vehicle chassis detection system |
| CN113343992B (en) * | 2021-08-06 | 2021-11-12 | 长沙海信智能系统研究院有限公司 | Vehicle attribute identification method, device, equipment and medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201016935Y (en) * | 2007-02-28 | 2008-02-06 | 鞍钢集团矿业公司 | Belt scar on-line automatic checkout gear |
| CN102130030A (en) * | 2010-01-18 | 2011-07-20 | 上海华虹Nec电子有限公司 | Method for detecting mechanical scratching condition of silicon wafers |
| CN102151984A (en) * | 2011-03-01 | 2011-08-17 | 华中科技大学 | Laser machining method and device applicable for complicated curved surface |
| CN102236908A (en) * | 2011-07-18 | 2011-11-09 | 长安大学 | Vehicle iterative collision accident analysis, calculation, simulation and reconstruction system |
| CN102435606A (en) * | 2011-11-16 | 2012-05-02 | 马建春 | Method for supporting inspection and identification of line trace by utilizing three-dimensional characteristic data plot |
| CN104517100A (en) * | 2014-12-15 | 2015-04-15 | 中国科学院深圳先进技术研究院 | Gesture pre-judging method and system |
| CN106096740A (en) * | 2016-06-03 | 2016-11-09 | 深圳开思时代科技有限公司 | Automobile 3D ring car test checking method and system |
-
2017
- 2017-01-25 CN CN201710056624.9A patent/CN106934345B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN201016935Y (en) * | 2007-02-28 | 2008-02-06 | 鞍钢集团矿业公司 | Belt scar on-line automatic checkout gear |
| CN102130030A (en) * | 2010-01-18 | 2011-07-20 | 上海华虹Nec电子有限公司 | Method for detecting mechanical scratching condition of silicon wafers |
| CN102151984A (en) * | 2011-03-01 | 2011-08-17 | 华中科技大学 | Laser machining method and device applicable for complicated curved surface |
| CN102236908A (en) * | 2011-07-18 | 2011-11-09 | 长安大学 | Vehicle iterative collision accident analysis, calculation, simulation and reconstruction system |
| CN102435606A (en) * | 2011-11-16 | 2012-05-02 | 马建春 | Method for supporting inspection and identification of line trace by utilizing three-dimensional characteristic data plot |
| CN104517100A (en) * | 2014-12-15 | 2015-04-15 | 中国科学院深圳先进技术研究院 | Gesture pre-judging method and system |
| CN106096740A (en) * | 2016-06-03 | 2016-11-09 | 深圳开思时代科技有限公司 | Automobile 3D ring car test checking method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106934345A (en) | 2017-07-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106934345B (en) | Vehicle flaw library and construction method thereof, and vehicle flaw information display method and system | |
| US7502509B2 (en) | Systems and methods for digital pen stroke correction | |
| CN105320952B (en) | A kind of driving license information identifying method based on OCR | |
| US20130265429A1 (en) | System and method for recognizing parking space line markings for vehicle | |
| CN106096740B (en) | Automobile 3D ring car test checking method and system | |
| CN109002820A (en) | A kind of licence plate recognition method, device and relevant device | |
| GB2559196A (en) | Determining a position of a vehicle on a track | |
| JP5275059B2 (en) | Vehicle detection device, vehicle detection system, vehicle detection method for vehicle detection device, and vehicle detection program | |
| CN103716687A (en) | Method and system for using fingerprints to track moving objects in video | |
| JP2019132664A (en) | Vehicle position estimating device, vehicle position estimating method, and vehicle position estimating program | |
| CN111742344A (en) | Image semantic segmentation method, movable platform and storage medium | |
| CN110751012B (en) | Target detection evaluation method and device, electronic equipment and storage medium | |
| US10235576B2 (en) | Analysis method of lane stripe images, image analysis device, and non-transitory computer readable medium thereof | |
| CN110555402B (en) | Congestion car following method, system, terminal and storage medium based on look-around | |
| CN110084230B (en) | Image-based vehicle body direction detection method and device | |
| CN111814752A (en) | Indoor positioning implementation method, server, intelligent mobile device and storage medium | |
| CN112115939A (en) | Vehicle license plate recognition method and device | |
| CN111444810A (en) | Traffic light information identification method, device, equipment and storage medium | |
| CN111354018B (en) | Object identification method, device and system based on image | |
| WO2022073461A1 (en) | Parking process display method and device, and vehicle | |
| CN113515143B (en) | Robot navigation method, robot and computer readable storage medium | |
| CN112489240B (en) | Commodity display inspection method, inspection robot and storage medium | |
| CN113436279A (en) | Image processing method, device and equipment | |
| CN110539748B (en) | Congestion car following system and terminal based on look-around | |
| CN111401423B (en) | Data processing method and device for automatic driving vehicle |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |