WO2021000489A1 - Vehicle image classification method and apparatus, and computer device and storage medium - Google Patents

Vehicle image classification method and apparatus, and computer device and storage medium Download PDF

Info

Publication number
WO2021000489A1
WO2021000489A1 PCT/CN2019/117730 CN2019117730W WO2021000489A1 WO 2021000489 A1 WO2021000489 A1 WO 2021000489A1 CN 2019117730 W CN2019117730 W CN 2019117730W WO 2021000489 A1 WO2021000489 A1 WO 2021000489A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
image
classification
loss
damage
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/117730
Other languages
French (fr)
Chinese (zh)
Inventor
刁春艳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Publication of WO2021000489A1 publication Critical patent/WO2021000489A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/08Insurance
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02TCLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO TRANSPORTATION
    • Y02T10/00Road transport of goods or passengers
    • Y02T10/10Internal combustion engine [ICE] based vehicles
    • Y02T10/40Engine management systems

Definitions

  • This application relates to the field of image processing, and in particular to a vehicle image classification method, device, computer equipment and storage medium.
  • the damage assessor will use image acquisition tools to capture the damage of the vehicle, and the number of images related to the damage assessment of the vehicle collected every day is very large. Because of the need to classify the collected images of different traffic accidents. Manual classification by the loss assessor will take a lot of time. Moreover, the manual classification method is easily affected by various subjective factors and cannot guarantee the accuracy of vehicle image classification.
  • the embodiments of the present application provide a vehicle image classification method, device, computer equipment, and storage medium to solve the problem of low vehicle image classification efficiency.
  • a vehicle image classification method includes:
  • vehicle loss assessment data set includes at least two vehicle loss assessment images
  • a vehicle image classification device including:
  • the first data set acquisition module is configured to acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images;
  • the first image recognition module is used for recognizing each vehicle's loss-fixing image in the vehicle's loss-fixing data set to obtain attribute information and damaged point information of each vehicle's loss-fixing image;
  • the first image classification module is configured to classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set;
  • the first classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the vehicle damage data set according to the initial clusters to obtain different Vehicle classification set;
  • the first image elimination module is used to calculate the image similarity of the vehicle classification images in each vehicle classification set, and eliminate the repeated vehicle classification images according to the image similarity.
  • a vehicle image classification method includes:
  • the vehicle loss assessment data set including a global image and a local image
  • a vehicle image classification device including:
  • the second data set acquisition module is configured to acquire a vehicle loss assessment data set, the vehicle loss assessment data set including global images and partial images;
  • the second image classification module is used to classify the vehicle loss assessment data set to obtain a global image set and a local image set;
  • the second image recognition module is used to recognize each vehicle damage image in the vehicle damage data set by using a preset recognition model to obtain attribute information and damage point information of each vehicle damage image;
  • the second classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the local image sets according to the initial clusters to obtain different vehicles Classification set
  • the second image elimination module is used to calculate the vehicle similarity of the vehicle images in each vehicle classification set, and eliminate the repeated vehicle images according to the vehicle similarity.
  • a computer device comprising a memory, a processor, and computer readable instructions stored in the memory and capable of running on the processor, and the processor implements the above vehicle image classification method when the computer readable instructions are executed .
  • One or more readable storage media storing computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors execute the aforementioned vehicle image classification method.
  • FIG. 1 is a schematic diagram of an application environment of a vehicle image classification method in an embodiment of the present application
  • Fig. 2 is a flowchart of a vehicle image classification method in an embodiment of the present application
  • FIG. 3 is another flowchart of a method for classifying vehicle images in an embodiment of the present application
  • FIG. 4 is another flowchart of a vehicle image classification method in an embodiment of the present application.
  • FIG. 5 is another flowchart of a method for classifying vehicle images in an embodiment of the present application.
  • Fig. 6 is another flowchart of a vehicle image classification method in an embodiment of the present application.
  • Fig. 7 is a functional block diagram of a vehicle image classification device in an embodiment of the present application.
  • FIG. 8 is another principle block diagram of the vehicle image classification device in an embodiment of the present application.
  • FIG. 9 is another principle block diagram of the vehicle image classification device in an embodiment of the present application.
  • Fig. 10 is a schematic diagram of a computer device in an embodiment of the present application.
  • the vehicle image classification method provided by the embodiments of the present application can be applied in an application environment as shown in FIG. 1, in which a client (computer device) communicates with a server through a network.
  • the server obtains a vehicle loss assessment data set, which includes at least two vehicle loss assessment images; recognizes each vehicle loss assessment image in the vehicle loss assessment data set to obtain the attributes of each vehicle loss assessment image Information and damaged point information; classify the vehicle damage-related images according to the attribute information to obtain a global image set and a partial image set; set initial clustering according to the attribute information and damaged point information of each global image Clusters, perform cluster analysis on the vehicle damage data set according to the initial cluster clusters to obtain different vehicle classification sets; perform image similarity calculations on the vehicle classification images in each vehicle classification set, and calculate the repeated Vehicle classification images are eliminated.
  • the client computer equipment
  • the server can be implemented as an independent server or a server cluster composed of multiple servers.
  • a vehicle image classification method is provided, and the method is applied to the server in FIG. 1 as an example for description, including the following steps:
  • S10 Acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images.
  • the vehicle loss assessment data set is an image set composed of a large number of vehicle loss assessment images.
  • Vehicle damage determination is when the insured vehicle has a traffic accident, the relevant unit conducts on-site inspection and determination of the damage.
  • the vehicle damage determination involves many aspects such as maintenance, manufacturing, and loss of the owner.
  • the vehicle damage assessment image is image information related to the damage assessment vehicle, which can include vehicle information (license plate number), images of damaged areas of the vehicle, and the environment in which the vehicle is located. Understandably, there are usually at least two vehicle damage images of a vehicle.
  • the vehicle damage data set can be all images collected by the same image collection tool, or all images collected by the same image collection tool within a predetermined time (for example, one day), or all images collected by at least two image collection tools. Or all images collected by at least two image collection tools within a predetermined time (for example, one day).
  • An image collection tool may be a client, or at least two image collection tools both upload the vehicle's loss-specific images to the server through the corresponding client or the same client.
  • the upload timing of the vehicle's fixed-loss images can be real-time or scheduled.
  • S20 Recognizing each vehicle loss-fixing image in the vehicle loss-fixing data set to obtain attribute information and damaged point information of each vehicle loss-fixing image.
  • Attribute information refers to the information of the corresponding vehicle in the vehicle damage image, such as the license plate number, vehicle color, and/or vehicle model. Further, the attribute information may also include related information of the vehicle damage-assessment image, such as shooting time, shooting location, shooting equipment, etc. This part of the attribute information can be obtained by identifying the vehicle damage-assessment image itself. Specifically, this part of the attribute information can be integrated into the vehicle's loss-making image by means of watermarking, and this part of the attribute information can be obtained by performing text recognition on the vehicle's loss-making image.
  • Damaged point information refers to information indicating the specific damaged part or damaged type of the vehicle. Damaged parts can be divided according to different parts of the vehicle, such as: hood, headlights, bumpers, rearview mirrors, front doors, rear doors, or window glass. Furthermore, each part can be further divided according to actual accuracy requirements. For example, the front door of the car is divided into a left front door and a right front door, and the rear of the car is divided into a left rear door and a right rear door.
  • the identification of each vehicle loss-fixing image in the vehicle loss-fixing data set can be realized through a preset recognition model.
  • the attribute information includes license plate number information, vehicle color, vehicle model, etc.
  • not all of the above attribute information can be identified in every vehicle damage image. If a vehicle damage image is only a partial detail image, it may be possible The vehicle model in the damage image of the vehicle cannot be recognized. If a vehicle damage image does not capture the license plate number, the license plate number information in the vehicle damage image cannot be identified. The color of the vehicle can generally be identified. Therefore, a recognition model can be used to identify the vehicle damage image to obtain the attribute information of the vehicle damage image.
  • the specific information of the attribute information will be directly output, if the attribute information is recognized If it fails, the attribute information of the item is not output.
  • a license plate number recognition model, a vehicle color recognition model, and a vehicle model recognition model can be separately established in advance, and then each vehicle damage image is input into these three recognition models for recognition, and corresponding attribute information is obtained. If the identification of the attribute information fails, the attribute information can be left blank or represented by the same symbol, which will not be repeated here.
  • the license plate number recognition model, the vehicle color recognition model, and the vehicle model recognition model can all be established by machine learning, and will not be repeated here.
  • the damaged point information of the vehicle damage image can also be recognized by pre-setting a damaged point recognition model.
  • some damaged images of vehicles may not contain damaged parts. Therefore, the damaged point information may be specific damaged parts or none. Understandably, there may be at least two damaged point information.
  • S30 Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set.
  • the vehicle damage image is classified by attribute information, specifically, the vehicle damage image is classified according to the amount of attribute information, or the specific one or at least two attributes in the attribute information are classified.
  • the state of the information is used to classify the vehicle damage image. For example, if the number of attribute information is 5 items, the vehicle loss-making images with attribute information greater than or equal to 4 items can be classified into the global image set, and the vehicle loss-making images with attribute information less than 4 items can be classified into the local image set. Or, classify the vehicle loss-based images containing the two attribute information of the license plate number and the vehicle model into the global image set, and classify the remaining vehicle loss-based images into the local image set.
  • S40 Set an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and perform a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets.
  • the attribute information and damaged point information of each global image is converted into a feature vector, and then the feature vector corresponding to the global image is set as an initial cluster cluster.
  • the number of initial cluster clusters can be equal to the number of global images. equal.
  • a clustering algorithm can be used to perform clustering analysis on the vehicle damage data set.
  • S50 Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate the repeated vehicle classification images according to the image similarity.
  • the vehicle loss assessment data set includes at least two vehicle loss assessment images; identify each vehicle loss assessment image in the vehicle loss assessment data set, and obtain each vehicle Attribute information and damaged point information of the fixed-loss image; classify the vehicle fixed-loss image according to the attribute information to obtain a global image set and a partial image set; according to the attribute information and damaged point of each of the global images
  • the information sets the initial cluster cluster, and performs cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets; image similarity calculation is performed on the vehicle classification images in each vehicle classification set, according to the image The similarity eliminates duplicate vehicle classification images.
  • the intelligent classification of the vehicle loss-fixing images in the vehicle loss-fixing data set improves the efficiency of image classification and ensures the accuracy of image classification.
  • the vehicle damage assessment image includes a damaged area.
  • the damaged area is the area where the damaged part on the vehicle damage image is located.
  • the damaged part in the image can be marked when the vehicle damage image is collected, for example, a rectangular frame is added to the area where the damaged part is located.
  • the identification of each vehicle damage image in the vehicle damage data set to obtain the attribute information and damaged point information of each vehicle damage image includes:
  • S21 Use a preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, and obtain the damaged point information of each vehicle's damage assessment image.
  • the damaged point identification model is a model for identifying specific vehicle parts in the damaged area. A large number of vehicle images with damaged parts can be collected in advance to train the convolutional neural network to obtain the damaged point recognition model.
  • the damaged point information may be a specific damaged part. Understandably, the damaged point information may be at least two, that is, the damaged part may be at least two.
  • S22 Use the semantic segmentation model to process each vehicle's fixed-loss image to obtain image information of each vehicle's fixed-loss image.
  • the semantic segmentation model is used to process the vehicle's fixed-loss image to obtain the image information of each vehicle's fixed-loss image. Specifically, a semantic segmentation model is obtained through training in advance, and the segmentation model is used to determine whether there is a clearly recognizable license plate area in the vehicle damage image and whether there is a complete vehicle image available for vehicle model recognition to obtain image information.
  • the image information is used to indicate whether the vehicle license plate number can be recognized and whether the vehicle model can be recognized in the vehicle damage image.
  • a simple number can be used to identify whether the vehicle license plate number can be recognized and whether the vehicle model can be recognized in the corresponding vehicle damage image. For example, "00", "01", “10” and “11” are used to identify different situations respectively. Among them, 1 means available for identification, 0 means unidentifiable.
  • the two positions can be customized to indicate whether the license plate number can be recognized and whether the vehicle model can be recognized. There is no specific limitation here.
  • S23 Acquire a corresponding target recognition model according to the image information of each vehicle's damage-fixing image, and use the target recognition model to perform recognition processing on the vehicle's damage-fixing image to obtain attribute information of the vehicle's damage-fixing image.
  • the corresponding target recognition model is obtained according to the image information. Specifically, when the corresponding image information is recognizable, the corresponding recognition model is acquired. For example, license plate number recognition model, vehicle color recognition model and vehicle model recognition model. If the image information indicates that the license plate number can be recognized and the vehicle model can be recognized, then the license plate number recognition model and the vehicle model recognition model are acquired as the target recognition model, and the target recognition model is used to recognize the vehicle damage image , To obtain the attribute information of the vehicle damage image. Further, it can be assumed that each vehicle damage image can perform vehicle color recognition, that is, the target recognition model must include the vehicle color recognition model.
  • step S21 may be executed before steps S22-S23, or may be executed after steps S22-S23.
  • the damaged point information of each vehicle's damage assessment image is obtained; the semantic segmentation model is used for each Carrying out the processing of the vehicle's loss-fixing image to obtain the image information of each vehicle's loss-fixing image; finally obtain the corresponding target recognition model according to the image information of each vehicle's loss-fixing image, and use the target recognition model to assess the damage of the vehicle
  • the image is subjected to recognition processing to obtain the attribute information of the damage-oriented image of the vehicle.
  • the semantic segmentation model is used to recognize the vehicle damage image, and then the corresponding target recognition model is used to recognize the attribute information according to the recognition result, which avoids unnecessary recognition process and further improves the recognition efficiency.
  • the classification of the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set includes:
  • S31 Obtain preset classification information, and match the attribute information of each vehicle's loss-specific image according to the classification information.
  • the classification information can be embodied in different ways, and the classification information can be a specific value or a vector. If the classification information is a specific numerical value, then the vehicle damage image is classified by the number of attribute information. That is, matching the attribute information of each of the vehicle's damage-quality images according to the classification information is a match between the number of attribute information and the classification information. For example, if the number of attribute information is 5 items, and if the classification information is set to 4, then the vehicle loss-assessment images with attribute information greater than or equal to 4 items can be classified into the global image set, and the vehicles with attribute information less than 4 items can be classified The images are classified into local image sets.
  • the classification information is a vector
  • the one-hot vector conversion is performed in advance for the attribute information of each vehicle's damage image. If the corresponding attribute information exists, the value of the corresponding position in the one-hot vector is 1, otherwise it is 0.
  • the classification information and the one-hot vector of the attribute information of each vehicle's damage-related image can be calculated for the vector distance, and then the matching result can be obtained according to the calculation result.
  • a preset classification information is matched with the attribute information of each vehicle loss-making image, and the vehicle loss-making image is classified according to the matching result, which improves the flexibility and accuracy of image classification.
  • the initial clusters are set according to the attribute information and damaged point information of each of the global images, and the local image sets are clustered according to the initial clusters.
  • Get different vehicle classification sets including:
  • S41 Transform the attribute information and damaged point information of each vehicle's damage-fixing image into feature vector to obtain the feature vector of each vehicle's damage-fixing image.
  • the feature vector transformation of both the attribute information and the damaged point information in the vehicle damage image can be achieved by word vector.
  • the role of word vectors is to convert words in natural language into dense vectors that computers can understand.
  • the input text is first formed by the attribute information and damaged point information of all vehicle loss-specific images, and then a vocabulary is generated using the input text.
  • the word frequency of each word is counted, and the word frequency is sorted from high to low, and the most frequent V Words form a vocabulary.
  • There is a one-hot vector for each word and the dimension of the vector is V. If the word has appeared in the vocabulary, the corresponding position in the vocabulary in the vector is 1, and the other positions are all 0. If it does not appear in the vocabulary, the vector is all zeros.
  • the one-hot vector is expressed as a feature vector of an attribute, that is, there is only one activation point (not 0) at the same time, this vector has only one feature that is not 0, and the others are 0.
  • a word vector can be constructed separately for each attribute information and each damaged point information to better characterize the accuracy of each word vector. Then, each attribute information and the word vector of each damaged point information form the loss-fixing feature vector of the vehicle's loss-fixing image.
  • S42 Set the loss-fixing feature vector of each of the global images as initial clustering points, and perform a cluster analysis on the set of vehicle loss-fixing images according to the initial clustering points using a clustering algorithm to obtain different vehicles Cluster clusters.
  • the initial clustering points are set by the loss-based feature vector of the global image. Since the global image contains the most information, the initial clustering points can be set by the loss-based feature vector corresponding to the global image for subsequent Perform cluster analysis.
  • cluster analysis is also called cluster analysis, which is a statistical analysis method for studying (sample or index) classification problems, and it is also an important analysis method for data mining.
  • the clustering algorithm may be implemented by algorithms such as K-Means (K-means) clustering, mean shift clustering, density-based clustering method, or agglomerated hierarchical clustering.
  • a K-Means (K-means) clustering algorithm is used to perform cluster analysis on the partial image set to obtain the target center point.
  • the K value is set according to the number of global images, and the loss-constant feature vector of each global image is set as the initial cluster point.
  • recalculate for example, calculate the average value of all points in the cluster to obtain the new center point of the cluster.
  • the steps of assigning center points and updating the center points of the clusters are performed in an iterative manner until the center points of the clusters change very little or reach the specified number of iterations.
  • the cluster clusters meeting the preset number are regarded as the vehicle cluster clusters.
  • S43 Calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster cluster.
  • the distance algorithm can be used to calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster cluster, for example: Euclidean distance algorithm, Manhattan distance algorithm, Chebyshev distance algorithm, Minkov Skye distance algorithm, standardized Euclidean distance algorithm, Mahalanobis distance or Hamming distance algorithm.
  • different weights can be set for different information in the loss-based feature vector to better calculate the vector distance. For example, the weights of the license plate number information and damaged point information can be set higher, and the weight of other information can be set higher. The weight is appropriately lowered, or adjusted according to actual needs.
  • S44 Determine the vehicle's loss-specific image whose vector distance exceeds a preset vector threshold as an image to be determined.
  • the vector threshold is a preset value. According to the preset vector threshold, it can be judged whether a vehicle damage image belongs to the vehicle cluster.
  • the vector threshold can be obtained after testing with multiple samples, or it can be set based on empirical values. If the vector distance between a vehicle damage image and a vehicle cluster cluster exceeds the preset vector threshold, it means that the vehicle damage image may not belong to the vehicle cluster cluster, so the corresponding vehicle damage image is determined as the image to be determined .
  • S45 Send the to-be-determined image to the client, and obtain the classification information returned by the client.
  • the classification information is the information of the vehicle cluster cluster to which the corresponding to-be-determined image is allocated, which is fed back by the client. In this step, the image to be determined is sent to the client, and the classification information returned by the client is obtained.
  • S46 Assign each of the to-be-determined images to corresponding vehicle clusters according to the classification information.
  • the server assigns each to-be-determined image to the corresponding vehicle cluster.
  • each vehicle classification set represents a vehicle damage assessment image corresponding to a different vehicle damage assessment case.
  • the attribute information and damaged point information of each vehicle's loss-based image are transformed into feature vectors to obtain the loss-based feature vector of each vehicle's loss-based image;
  • the feature vector is set as the initial clustering point, and the clustering algorithm is used to perform cluster analysis on the set of vehicle damage image sets according to the initial clustering point to obtain different vehicle clusters; then each vehicle cluster is calculated The vector distance from the loss-fixing feature vector of each vehicle loss-fixing image to the cluster center; determining the loss-fixing image of the vehicle whose vector distance exceeds the preset vector threshold as the image to be determined; sending the image to be determined To the client, obtain the classification information returned by the client; assign each of the to-be-determined images to the corresponding vehicle cluster according to the classification information; finally, the vehicle in each vehicle cluster is assessed for damage
  • the images make up the vehicle classification set. It can intelligently classify the vehicle damage image, ensuring the efficiency and accuracy of image classification.
  • the embodiment of the present application also relates to a vehicle image classification method.
  • the application of the method to the server in FIG. 1 is taken as an example for description.
  • the vehicle image classification method includes:
  • S10' Acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes a global image and a partial image.
  • the vehicle loss assessment data set is an image set composed of a large number of vehicle loss assessment images.
  • Vehicle damage determination is when the insured vehicle has a traffic accident, the relevant unit conducts on-site inspection and determination of the damage.
  • the vehicle damage determination involves many aspects such as maintenance, manufacturing, and loss of the owner.
  • the vehicle damage assessment image is image information related to the damage assessment vehicle, which can include vehicle information (license plate number), images of damaged areas of the vehicle, and the environment in which the vehicle is located. Understandably, there are usually at least two vehicle damage images of a vehicle.
  • the vehicle damage data set can be all images collected by the same image collection tool, or all images collected by the same image collection tool within a predetermined time (for example, one day), or all images collected by at least two image collection tools. Or all images collected by at least two image collection tools within a predetermined time (for example, one day).
  • An image collection tool may be a client, or at least two image collection tools both upload the vehicle's loss-based image to the server through the corresponding client or the same client.
  • the upload timing of the vehicle's fixed-loss image can be real-time or regularly.
  • the vehicle damage data set includes a global image and a local image.
  • the global image is an image that reflects the global information of the corresponding vehicle
  • the local image is an image that reflects the local information of the corresponding vehicle.
  • each vehicle loss assessment image has a corresponding image label to indicate that the image is a global image or a partial image.
  • S20' Perform classification processing on the vehicle loss-fixing data set to obtain a global image set and a partial image set.
  • the vehicle loss-fixing data set is classified, the global image is divided into a global image set, and the local image is divided into a local image set to obtain a global image set and a local image set.
  • Image set the image label of each vehicle loss-fixing image
  • S30' Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image.
  • this step is the same as step S20 in the foregoing embodiment, and will not be repeated here.
  • S40' Set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the partial image sets according to the initial clusters to obtain different vehicle classification sets.
  • S50' Perform vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity.
  • different image labels are pre-configured for each image in the vehicle loss assessment data set to better classify the vehicle loss assessment data set, and to better improve the efficiency of vehicle classification.
  • a vehicle image classification device is provided, and the vehicle image classification device corresponds to the vehicle image classification method in the above-mentioned embodiment one-to-one.
  • the vehicle image classification device includes a first data set acquisition module 10, a first image recognition module 20, a first image classification module 30, a first classification set acquisition module 40 and a first image removal module 50.
  • the detailed description of each functional module is as follows:
  • the first data set acquisition module 10 is configured to acquire a vehicle loss assessment data set, the vehicle loss assessment data set including at least two vehicle loss assessment images.
  • the first image recognition module 20 is used to identify each vehicle damage image in the vehicle damage data set to obtain attribute information and damaged point information of each vehicle damage image.
  • the first image classification module 30 is configured to classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set.
  • the first classification set acquisition module 40 is configured to set an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the vehicle loss assessment data set according to the initial cluster cluster to obtain Different vehicle classification set.
  • the first image culling module 50 is used to perform image similarity calculation on the vehicle classification images in each vehicle classification set, and to eliminate duplicate vehicle classification images according to the image similarity.
  • the first classification set acquisition module 40 includes:
  • the vector conversion unit 41 is used to transform the attribute information and the damaged point information of each vehicle's damage assessment image into feature vector to obtain the damage feature vector of each vehicle's damage assessment image.
  • the cluster cluster acquisition unit 42 is configured to set the loss-specific feature vector of each global image as an initial clustering point, and use a clustering algorithm to cluster the set of vehicle loss-based images according to the initial clustering point. Class analysis to obtain different vehicle clusters.
  • the vector distance calculation unit 43 is used to calculate the vector distance from the loss-fixing feature vector of each vehicle loss-making image in each vehicle cluster to the center of the cluster cluster.
  • the image dividing unit 44 is configured to determine the vehicle's loss-of-loss image whose vector distance exceeds a preset vector threshold as the image to be determined.
  • the classification information obtaining unit 45 is configured to send the to-be-determined image to the client, and obtain the classification information returned by the client.
  • the image allocation unit 46 is configured to allocate each of the to-be-determined images to the corresponding vehicle cluster according to the classification information.
  • the classification set composing unit 47 is used to compose the vehicle classification set of the vehicle damage-related images in each vehicle cluster.
  • the vehicle damage assessment image includes a damaged area.
  • the first image recognition module 20 includes:
  • the damaged area recognition unit is used to recognize the damaged area of each vehicle's damage assessment image by using a preset damaged point recognition model to obtain the damaged point information of each vehicle's damage assessment image.
  • the image information acquisition unit is used to process each vehicle's fixed-loss image by using the semantic segmentation model to obtain image information of each vehicle's fixed-loss image.
  • the attribute information acquisition unit is configured to acquire the corresponding target recognition model according to the image information of each vehicle damage image, and use the target recognition model to identify the vehicle damage image to obtain the vehicle damage image Attribute information.
  • the first image classification module 30 includes:
  • the classification information acquisition unit is configured to acquire preset classification information, and match the attribute information of each vehicle's loss-based image according to the classification information.
  • the classification unit is configured to put the corresponding vehicle loss-specific image into the global image collection when the attribute information and the classification information match successfully; when the attribute information and the classification information fail to match, then the corresponding The vehicle's fixed-loss image is put into the partial image set.
  • a vehicle image classification device is provided, and the vehicle image classification device corresponds to the vehicle image classification method in the above-mentioned embodiment one-to-one.
  • the vehicle image classification device includes a second data set acquisition module 10', a second image classification module 20', a second image recognition module 30', a second classification set acquisition module 40', and a second image removal module. Module 50'.
  • the detailed description of each functional module is as follows:
  • the second data set acquisition module 10' is used to acquire a vehicle loss assessment data set.
  • the vehicle loss assessment data set includes global images and partial images.
  • the second image classification module 20' is used to classify the vehicle damage data set to obtain a global image set and a local image set.
  • the second image recognition module 30' is used to identify each vehicle damage image in the vehicle damage data set using a preset recognition model to obtain attribute information and damage point information of each vehicle damage image.
  • the second classification set acquisition module 40' is configured to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the local image sets according to the initial clusters to obtain different Set of vehicle classifications.
  • the second image rejection module 50' is used to calculate the vehicle similarity of the vehicle images in each vehicle classification set, and eliminate the repeated vehicle images according to the vehicle similarity.
  • each module in the above-mentioned vehicle image classification device can be implemented in whole or in part by software, hardware, and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • a computer device is provided.
  • the computer device may be a server, and its internal structure diagram may be as shown in FIG. 10.
  • the computer equipment includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, computer readable instructions, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the non-volatile storage medium.
  • the database of the computer equipment is used for the data used in the vehicle image classification method in the above embodiment.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer-readable instructions are executed by the processor to realize a vehicle image classification method.
  • a computer device including a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor.
  • the processor executes the computer-readable instructions, Vehicle image classification method.
  • one or more readable storage media storing computer readable instructions are provided, and when the computer readable instructions are executed by one or more processors, the one or more processors execute The vehicle image classification method in the above embodiment.
  • the readable storage medium includes a non-volatile readable storage medium and a volatile readable storage medium.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • ROM read only memory
  • PROM programmable ROM
  • EPROM electrically programmable ROM
  • EEPROM electrically erasable programmable ROM
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Finance (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Accounting & Taxation (AREA)
  • Evolutionary Biology (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Technology Law (AREA)
  • General Business, Economics & Management (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A vehicle image classification method and apparatus, and a computer device and a storage medium. The method comprises: acquiring a vehicle loss assessment data set, wherein the vehicle loss assessment data set comprises at least two vehicle loss assessment images (S10); identifying each vehicle loss assessment image in the vehicle loss assessment data set to obtain attribute information and damaged point information of each vehicle loss assessment image (S20); classifying, according to the attribute information, the vehicle loss assessment image to obtain a global image set and a local image set (S30); setting an initial clustering cluster according to attribute information and damaged point information of each global image, and performing, according to the initial clustering cluster, clustering analysis on the vehicle loss assessment data set to obtain different vehicle classification sets (S40); and performing an image similarity calculation on vehicle classification images in each vehicle classification set, and eliminating repeated vehicle classification images according to the image similarity (S50). By means of the method, vehicle loss assessment images in a vehicle loss assessment data set are intelligently classified, the image classification efficiency is improved, and the image classification accuracy is ensured.

Description

车辆图像分类方法、装置、计算机设备及存储介质Vehicle image classification method, device, computer equipment and storage medium

本申请以2019年07月03日提交的申请号为201910596017.0,名称为“车辆图像分类方法、装置、计算机设备及存储介质”的中国发明专利申请为基础,并要求其优先权。This application is based on the Chinese invention patent application filed on July 3, 2019 with the application number 201910596017.0, titled "Vehicle image classification method, device, computer equipment and storage medium", and claims its priority.

技术领域Technical field

本申请涉及图像处理领域,尤其涉及一种车辆图像分类方法、装置、计算机设备及存储介质。This application relates to the field of image processing, and in particular to a vehicle image classification method, device, computer equipment and storage medium.

背景技术Background technique

随着各种交通工具的日渐普及,在道路上行驶的车辆的比例越来越多。相应地,各种交通事故也偶有发生。当车辆发生交通事故时,往往需要对发生交通事故的车辆进行查勘定损。在车辆定损过程中需要对车辆受损情况进行图像采集。With the increasing popularity of various vehicles, the proportion of vehicles on the road is increasing. Correspondingly, various traffic accidents also happen occasionally. When a vehicle is involved in a traffic accident, it is often necessary to investigate and determine the damage of the vehicle in the traffic accident. In the process of vehicle damage assessment, image acquisition of vehicle damage is required.

现有的定损员在定损过程中,定损员会采用图像采集工具拍摄车辆受损情况,每天采集的和车辆定损相关的图像数量是非常庞大的。由于需要对不同交通事故的采集图像进行分类。通过定损员手动分类的方式会花费大量的时间。而且手动分类的方式容易收到各种主观因素的影响而无法保证对车辆图像分类的准确性。In the current damage assessment process, the damage assessor will use image acquisition tools to capture the damage of the vehicle, and the number of images related to the damage assessment of the vehicle collected every day is very large. Because of the need to classify the collected images of different traffic accidents. Manual classification by the loss assessor will take a lot of time. Moreover, the manual classification method is easily affected by various subjective factors and cannot guarantee the accuracy of vehicle image classification.

发明内容Summary of the invention

本申请实施例提供一种车辆图像分类方法、装置、计算机设备及存储介质,以解决车辆图像分类效率不高的问题。The embodiments of the present application provide a vehicle image classification method, device, computer equipment, and storage medium to solve the problem of low vehicle image classification efficiency.

一种车辆图像分类方法,包括:A vehicle image classification method includes:

获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;Acquiring a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images;

对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Recognize each vehicle damage assessment image in the vehicle damage assessment data set, and obtain the attribute information and damage point information of each vehicle damage assessment image;

根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set;

根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets;

对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate duplicate vehicle classification images based on the image similarity.

一种车辆图像分类装置,包括:A vehicle image classification device, including:

第一数据集获取模块,用于获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;The first data set acquisition module is configured to acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images;

第一图像识别模块,用于对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;The first image recognition module is used for recognizing each vehicle's loss-fixing image in the vehicle's loss-fixing data set to obtain attribute information and damaged point information of each vehicle's loss-fixing image;

第一图像分类模块,用于根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;The first image classification module is configured to classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set;

第一分类集获取模块,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;The first classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the vehicle damage data set according to the initial clusters to obtain different Vehicle classification set;

第一图像剔除模块,用于对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。The first image elimination module is used to calculate the image similarity of the vehicle classification images in each vehicle classification set, and eliminate the repeated vehicle classification images according to the image similarity.

一种车辆图像分类方法,包括:A vehicle image classification method includes:

获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;Acquiring a vehicle loss assessment data set, the vehicle loss assessment data set including a global image and a local image;

对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;Performing classification processing on the vehicle damage data set to obtain a global image set and a partial image set;

采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image;

根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing cluster analysis on a local image set according to the initial cluster cluster to obtain different vehicle classification sets;

对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。Carry out vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity.

一种车辆图像分类装置,包括:A vehicle image classification device, including:

第二数据集获取模块,用于获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;The second data set acquisition module is configured to acquire a vehicle loss assessment data set, the vehicle loss assessment data set including global images and partial images;

第二图像分类模块,用于对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;The second image classification module is used to classify the vehicle loss assessment data set to obtain a global image set and a local image set;

第二图像识别模块,用于采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;The second image recognition module is used to recognize each vehicle damage image in the vehicle damage data set by using a preset recognition model to obtain attribute information and damage point information of each vehicle damage image;

第二分类集获取模块,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;The second classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the local image sets according to the initial clusters to obtain different vehicles Classification set

第二图像剔除模块,用于对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。The second image elimination module is used to calculate the vehicle similarity of the vehicle images in each vehicle classification set, and eliminate the repeated vehicle images according to the vehicle similarity.

一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,所述处理器执行所述计算机可读指令时实现上述车辆图像分类方法。A computer device comprising a memory, a processor, and computer readable instructions stored in the memory and capable of running on the processor, and the processor implements the above vehicle image classification method when the computer readable instructions are executed .

一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行上述车辆图像分类方法。One or more readable storage media storing computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors execute the aforementioned vehicle image classification method.

本申请的一个或多个实施例的细节在下面的附图和描述中提出,本申请的其他特征和优点将从说明书、附图以及权利要求变得明显。The details of one or more embodiments of the present application are presented in the following drawings and description, and other features and advantages of the present application will become apparent from the description, drawings and claims.

附图说明Description of the drawings

为了更清楚地说明本申请实施例的技术方案,下面将对本申请实施例的描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

图1是本申请一实施例中车辆图像分类方法的一应用环境示意图;FIG. 1 is a schematic diagram of an application environment of a vehicle image classification method in an embodiment of the present application;

图2是本申请一实施例中车辆图像分类方法的一流程图;Fig. 2 is a flowchart of a vehicle image classification method in an embodiment of the present application;

图3是本申请一实施例中车辆图像分类方法的另一流程图;FIG. 3 is another flowchart of a method for classifying vehicle images in an embodiment of the present application;

图4是本申请一实施例中车辆图像分类方法的另一流程图;FIG. 4 is another flowchart of a vehicle image classification method in an embodiment of the present application;

图5是本申请一实施例中车辆图像分类方法的另一流程图;FIG. 5 is another flowchart of a method for classifying vehicle images in an embodiment of the present application;

图6是本申请一实施例中车辆图像分类方法的另一流程图;Fig. 6 is another flowchart of a vehicle image classification method in an embodiment of the present application;

图7是本申请一实施例中车辆图像分类装置的一原理框图;Fig. 7 is a functional block diagram of a vehicle image classification device in an embodiment of the present application;

图8是本申请一实施例中车辆图像分类装置的另一原理框图;FIG. 8 is another principle block diagram of the vehicle image classification device in an embodiment of the present application;

图9是本申请一实施例中车辆图像分类装置的另一原理框图;FIG. 9 is another principle block diagram of the vehicle image classification device in an embodiment of the present application;

图10是本申请一实施例中计算机设备的一示意图。Fig. 10 is a schematic diagram of a computer device in an embodiment of the present application.

具体实施方式Detailed ways

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请 中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

本申请实施例提供的车辆图像分类方法,可应用在如图1的应用环境中,其中,客户端(计算机设备)通过网络与服务端进行通信。服务端获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。其中,客户端(计算机设备)可以但不限于各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备。服务器可以用独立的服务器或者是多个服务器组成的服务器集群来实现。The vehicle image classification method provided by the embodiments of the present application can be applied in an application environment as shown in FIG. 1, in which a client (computer device) communicates with a server through a network. The server obtains a vehicle loss assessment data set, which includes at least two vehicle loss assessment images; recognizes each vehicle loss assessment image in the vehicle loss assessment data set to obtain the attributes of each vehicle loss assessment image Information and damaged point information; classify the vehicle damage-related images according to the attribute information to obtain a global image set and a partial image set; set initial clustering according to the attribute information and damaged point information of each global image Clusters, perform cluster analysis on the vehicle damage data set according to the initial cluster clusters to obtain different vehicle classification sets; perform image similarity calculations on the vehicle classification images in each vehicle classification set, and calculate the repeated Vehicle classification images are eliminated. Among them, the client (computer equipment) can be, but not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The server can be implemented as an independent server or a server cluster composed of multiple servers.

在一实施例中,如图2所示,提供一种车辆图像分类方法,以该方法应用在图1中的服务端为例进行说明,包括如下步骤:In one embodiment, as shown in FIG. 2, a vehicle image classification method is provided, and the method is applied to the server in FIG. 1 as an example for description, including the following steps:

S10:获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像。S10: Acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images.

其中,车辆定损数据集是由大量车辆定损图像组成的图像集。车辆定损是在当被保险的车辆发生交通事故时,相关单位进行现场查勘定损,车辆定损涉及到维修、制造和车主损失等多方面。而车辆定损图像是和定损车辆相关的图像信息,可以包括车辆信息(车牌号)、车辆受损区域图像以及车辆所处的环境情况等。可以理解地,一个车辆的车辆定损图像通常是至少两幅的。Among them, the vehicle loss assessment data set is an image set composed of a large number of vehicle loss assessment images. Vehicle damage determination is when the insured vehicle has a traffic accident, the relevant unit conducts on-site inspection and determination of the damage. The vehicle damage determination involves many aspects such as maintenance, manufacturing, and loss of the owner. The vehicle damage assessment image is image information related to the damage assessment vehicle, which can include vehicle information (license plate number), images of damaged areas of the vehicle, and the environment in which the vehicle is located. Understandably, there are usually at least two vehicle damage images of a vehicle.

车辆定损数据集可以是同一图像采集工具采集的所有图像,或者是同一图像采集工具在预定时间内(例如,一天)采集的所有图像,也可以为至少两个图像采集工具采集的所有图像,或者是至少两个图像采集工具在预定时间内(例如,一天)采集的所有图像。而一个图像采集工具可以就是一个客户端,或者至少两个图像采集工具都通过对应的客户端或者同一个客户端将车辆定损图像上传到服务端。而车辆定损图像的上传时机可以是实时的,也可以是定时进行上传。The vehicle damage data set can be all images collected by the same image collection tool, or all images collected by the same image collection tool within a predetermined time (for example, one day), or all images collected by at least two image collection tools. Or all images collected by at least two image collection tools within a predetermined time (for example, one day). An image collection tool may be a client, or at least two image collection tools both upload the vehicle's loss-specific images to the server through the corresponding client or the same client. The upload timing of the vehicle's fixed-loss images can be real-time or scheduled.

S20:对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息。S20: Recognizing each vehicle loss-fixing image in the vehicle loss-fixing data set to obtain attribute information and damaged point information of each vehicle loss-fixing image.

属性信息是指车辆定损图像中对应的车辆本身的信息,例如:车牌号、车辆颜色和/或车辆型号等。进一步地,属性信息还可以包括车辆定损图像的相关信息,例如拍摄时间、拍摄地点、拍摄设备等,这部分属性信息可以对车辆定损图像本身进行识别而得到。具体地,可以将这部分属性信息通过水印的方式集成在车辆定损图像中,而通过对车辆定损图像进行文字识别即可得到这部分属性信息。Attribute information refers to the information of the corresponding vehicle in the vehicle damage image, such as the license plate number, vehicle color, and/or vehicle model. Further, the attribute information may also include related information of the vehicle damage-assessment image, such as shooting time, shooting location, shooting equipment, etc. This part of the attribute information can be obtained by identifying the vehicle damage-assessment image itself. Specifically, this part of the attribute information can be integrated into the vehicle's loss-making image by means of watermarking, and this part of the attribute information can be obtained by performing text recognition on the vehicle's loss-making image.

受损点信息是指指示该车辆具体的受损部位或者受损类型的信息。受损部分可以根据车辆的不同部位来划分,例如:引擎盖、前头灯、保险杠、后视镜、车前门、车后门或者车窗玻璃等。进一步地,还可以根据实际精度需要将每个部位进行更进一步的划分,例如,将车前门分为左前车门和右前车门,将车后面分为左后车门和右后车门等。Damaged point information refers to information indicating the specific damaged part or damaged type of the vehicle. Damaged parts can be divided according to different parts of the vehicle, such as: hood, headlights, bumpers, rearview mirrors, front doors, rear doors, or window glass. Furthermore, each part can be further divided according to actual accuracy requirements. For example, the front door of the car is divided into a left front door and a right front door, and the rear of the car is divided into a left rear door and a right rear door.

在该步骤中,对车辆定损数据集中的每一车辆定损图像进行识别,可以通过预设的识别模型来实现。属性信息中包括车牌号信息、车辆颜色和车辆型号等,然而,不是每一车辆定损图像中均能识别出上述所有的属性信息,若一幅车辆定损图像只是局部细节图,则有可能无法识别出该车辆定损图像中的车辆型号。若一幅车辆定损图像没有拍摄到车牌号,则也无法识别出该车辆定损图像中的车牌号信息。而车辆颜色一般都可以识别出来。因此,可以通过一个识别模型对车辆定损图像进行识别,得到车辆定损图像的属性信息,若对一项属性信息识别成功,则直接输出该属性信息的具体信息,若对一项属性信息识别失败,则不输出该项属性信息。具体地,可以预先分别建立车牌号识别模型、车辆颜色识 别模型和车辆型号识别模型,然后将每一车辆定损图像分别输入到这三个识别模型中进行识别,得到对应的属性信息。若其中的属性信息识别失败,则可以将该项属性信息留空,或者用同一的符号表示,在此不再赘述。其中,车牌号识别模型、车辆颜色识别模型和车辆型号识别模型都可以机器学习的方式来建立,在此不再赘述。In this step, the identification of each vehicle loss-fixing image in the vehicle loss-fixing data set can be realized through a preset recognition model. The attribute information includes license plate number information, vehicle color, vehicle model, etc. However, not all of the above attribute information can be identified in every vehicle damage image. If a vehicle damage image is only a partial detail image, it may be possible The vehicle model in the damage image of the vehicle cannot be recognized. If a vehicle damage image does not capture the license plate number, the license plate number information in the vehicle damage image cannot be identified. The color of the vehicle can generally be identified. Therefore, a recognition model can be used to identify the vehicle damage image to obtain the attribute information of the vehicle damage image. If one item of attribute information is successfully recognized, the specific information of the attribute information will be directly output, if the attribute information is recognized If it fails, the attribute information of the item is not output. Specifically, a license plate number recognition model, a vehicle color recognition model, and a vehicle model recognition model can be separately established in advance, and then each vehicle damage image is input into these three recognition models for recognition, and corresponding attribute information is obtained. If the identification of the attribute information fails, the attribute information can be left blank or represented by the same symbol, which will not be repeated here. Among them, the license plate number recognition model, the vehicle color recognition model, and the vehicle model recognition model can all be established by machine learning, and will not be repeated here.

类似地,对于车辆定损图像的受损点信息也可以通过预先设置一个受损点识别模型的方式来识别。而部分车辆定损图像中可能不包含受损部位,因此,受损点信息可能为具体的受损部位,也可以为无。可以理解地,受损点信息可以为至少两个。Similarly, the damaged point information of the vehicle damage image can also be recognized by pre-setting a damaged point recognition model. However, some damaged images of vehicles may not contain damaged parts. Therefore, the damaged point information may be specific damaged parts or none. Understandably, there may be at least two damaged point information.

S30:根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集。S30: Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set.

在该步骤中,通过属性信息来对车辆定损图像进行分类,具体地,通过属性信息的数量的多少来对车辆定损图像进行分类,或者通过对属性信息中具体一项或者至少两项属性信息的状态来对车辆定损图像进行分类。例如,若属性信息的数量为5项,则可以将属性信息大于等于4项的车辆定损图像归类到全局图像集中,将属性信息小于4项的车辆定损图像归类到局部图像集中。或者,将包含车牌号和车辆型号这两项属性信息的车辆定损图像归类到全局图像集中,将其余车辆定损图像归类到局部图像集中。In this step, the vehicle damage image is classified by attribute information, specifically, the vehicle damage image is classified according to the amount of attribute information, or the specific one or at least two attributes in the attribute information are classified. The state of the information is used to classify the vehicle damage image. For example, if the number of attribute information is 5 items, the vehicle loss-making images with attribute information greater than or equal to 4 items can be classified into the global image set, and the vehicle loss-making images with attribute information less than 4 items can be classified into the local image set. Or, classify the vehicle loss-based images containing the two attribute information of the license plate number and the vehicle model into the global image set, and classify the remaining vehicle loss-based images into the local image set.

S40:根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集。S40: Set an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and perform a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets.

具体地,将每一所述全局图像的属性信息和受损点信息转化为特征向量,再将全局图像对应的特征向量设置为初始聚类簇,初始聚类簇的数量可以和全局图像的数量相等。再根据设置好的初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集。具体地,可以采用聚类算法对车辆定损数据集进行聚类分析。Specifically, the attribute information and damaged point information of each global image is converted into a feature vector, and then the feature vector corresponding to the global image is set as an initial cluster cluster. The number of initial cluster clusters can be equal to the number of global images. equal. Then perform cluster analysis on the vehicle damage data set according to the set initial cluster clusters to obtain different vehicle classification sets. Specifically, a clustering algorithm can be used to perform clustering analysis on the vehicle damage data set.

S50:对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。S50: Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate the repeated vehicle classification images according to the image similarity.

通过对同一个车辆分类集中的车辆分类图像进行图像相似度计算,若存在两幅车辆分类图像的图像相似度超过预设的相似度阈值,则对着两幅车辆分类图像中的任意一幅车辆分类图像进行剔除。By calculating the image similarity of the vehicle classification images in the same vehicle classification set, if the image similarity of two vehicle classification images exceeds the preset similarity threshold, it will face any vehicle in the two vehicle classification images Categorize the image to remove.

在本实施例中,先获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。对车辆定损数据集中的车辆定损图像进行智能的分类,提高了图像分类的效率,并且保证了图像分类的准确性。In this embodiment, first obtain a vehicle loss assessment data set, the vehicle loss assessment data set includes at least two vehicle loss assessment images; identify each vehicle loss assessment image in the vehicle loss assessment data set, and obtain each vehicle Attribute information and damaged point information of the fixed-loss image; classify the vehicle fixed-loss image according to the attribute information to obtain a global image set and a partial image set; according to the attribute information and damaged point of each of the global images The information sets the initial cluster cluster, and performs cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets; image similarity calculation is performed on the vehicle classification images in each vehicle classification set, according to the image The similarity eliminates duplicate vehicle classification images. The intelligent classification of the vehicle loss-fixing images in the vehicle loss-fixing data set improves the efficiency of image classification and ensures the accuracy of image classification.

在一个实施例中,所述车辆定损图像包括受损区域。In an embodiment, the vehicle damage assessment image includes a damaged area.

具体地,受损区域为车辆定损图像上受损部位所在的区域。可以在采集车辆定损图像时,对图像中的受损部位进行标注,例如:对受损部位所在的区域添加矩形框。Specifically, the damaged area is the area where the damaged part on the vehicle damage image is located. The damaged part in the image can be marked when the vehicle damage image is collected, for example, a rectangular frame is added to the area where the damaged part is located.

在本实施例中,如图3所示,所述对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息,包括:In this embodiment, as shown in FIG. 3, the identification of each vehicle damage image in the vehicle damage data set to obtain the attribute information and damaged point information of each vehicle damage image includes:

S21:采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息。S21: Use a preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, and obtain the damaged point information of each vehicle's damage assessment image.

该受损点识别模型为对受损区域进行具体的车辆部位进行识别的模型。可以预先采集大量带有受损部位的车辆图像对卷积神经网络进行训练,从而得到该受损点识别模型。受损点信息可以为具体的受损部位。可以理解地,该受损点信息可以为至少两个,即受损部位可以为至少两个。The damaged point identification model is a model for identifying specific vehicle parts in the damaged area. A large number of vehicle images with damaged parts can be collected in advance to train the convolutional neural network to obtain the damaged point recognition model. The damaged point information may be a specific damaged part. Understandably, the damaged point information may be at least two, that is, the damaged part may be at least two.

S22:采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息。S22: Use the semantic segmentation model to process each vehicle's fixed-loss image to obtain image information of each vehicle's fixed-loss image.

通过语义分割模型对车辆定损图像进行处理,得到每一车辆定损图像的图像信息。具体地,预先通过训练得到一个语义分割模型,通过该予以分割模型判断车辆定损图像中是否有可清晰识别的车牌区域以及是否有可供进行车辆型号识别的完整车辆图像,以得到图像信息。图像信息用以表明该车辆定损图像中是否可进行车牌号识别以及是否可供进行车辆型号识别。具体地,可以通过简单的数字来标识对应的车辆定损图像中是否可进行车牌号识别以及是否可供进行车辆型号识别。例如,通过“00”、“01”、“10”和“11”来分别标识不同的情况。其中,1表示可供识别,0表示不可识别。两个位置可以通过自定义设定来表示是否可进行车牌号识别以及是否可供进行车辆型号识别。在此不做具体限定。The semantic segmentation model is used to process the vehicle's fixed-loss image to obtain the image information of each vehicle's fixed-loss image. Specifically, a semantic segmentation model is obtained through training in advance, and the segmentation model is used to determine whether there is a clearly recognizable license plate area in the vehicle damage image and whether there is a complete vehicle image available for vehicle model recognition to obtain image information. The image information is used to indicate whether the vehicle license plate number can be recognized and whether the vehicle model can be recognized in the vehicle damage image. Specifically, a simple number can be used to identify whether the vehicle license plate number can be recognized and whether the vehicle model can be recognized in the corresponding vehicle damage image. For example, "00", "01", "10" and "11" are used to identify different situations respectively. Among them, 1 means available for identification, 0 means unidentifiable. The two positions can be customized to indicate whether the license plate number can be recognized and whether the vehicle model can be recognized. There is no specific limitation here.

S23:根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。S23: Acquire a corresponding target recognition model according to the image information of each vehicle's damage-fixing image, and use the target recognition model to perform recognition processing on the vehicle's damage-fixing image to obtain attribute information of the vehicle's damage-fixing image.

在得到图像信息之后,根据图像信息来获取对应的目标识别模型。具体地,当对应的图像信息为可识别时,才获取对应的识别模型。例如,车牌号识别模型、车辆颜色识别模型和车辆型号识别模型。若图像信息表明可进行车牌号识别以及可供进行车辆型号识别,则获取车牌号识别模型和车辆型号识别模型作为目标识别模型,并且采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。进一步地,可以默认每一车辆定损图像均可以进行车辆颜色识别,即目标识别模型中必然包括车辆颜色识别模型。After the image information is obtained, the corresponding target recognition model is obtained according to the image information. Specifically, when the corresponding image information is recognizable, the corresponding recognition model is acquired. For example, license plate number recognition model, vehicle color recognition model and vehicle model recognition model. If the image information indicates that the license plate number can be recognized and the vehicle model can be recognized, then the license plate number recognition model and the vehicle model recognition model are acquired as the target recognition model, and the target recognition model is used to recognize the vehicle damage image , To obtain the attribute information of the vehicle damage image. Further, it can be assumed that each vehicle damage image can perform vehicle color recognition, that is, the target recognition model must include the vehicle color recognition model.

在这个实施例中,步骤S21的顺序可以在步骤S22-S23之前执行,也可以在步骤S22-S23之后执行。In this embodiment, the sequence of step S21 may be executed before steps S22-S23, or may be executed after steps S22-S23.

在本实施例中,通过采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息;采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息;最后根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。通过语义分割模型对车辆定损图像进行识别,再根据识别结果采用对应的目标识别模型进行属性信息的识别,避免了不必要的识别过程,进一步提高了识别效率。In this embodiment, by using a preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, the damaged point information of each vehicle's damage assessment image is obtained; the semantic segmentation model is used for each Carrying out the processing of the vehicle's loss-fixing image to obtain the image information of each vehicle's loss-fixing image; finally obtain the corresponding target recognition model according to the image information of each vehicle's loss-fixing image, and use the target recognition model to assess the damage of the vehicle The image is subjected to recognition processing to obtain the attribute information of the damage-oriented image of the vehicle. The semantic segmentation model is used to recognize the vehicle damage image, and then the corresponding target recognition model is used to recognize the attribute information according to the recognition result, which avoids unnecessary recognition process and further improves the recognition efficiency.

在一个实施例中,如图4所示,所述根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集,包括:In one embodiment, as shown in FIG. 4, the classification of the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set includes:

S31:获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配。S31: Obtain preset classification information, and match the attribute information of each vehicle's loss-specific image according to the classification information.

具体地,分类信息可以通过不同的方式体现,分类信息可以为一个具体的数值,也可以为一个向量。若分类信息为一个具体的数值,则通过属性信息的数量来对车辆定损图像进行分类。即根据所述分类信息对每一车辆定损图像的属性信息进行匹配为对属性信息的数量和分类信息的匹配。例如,若属性信息的数量为5项,若设定分类信息为4,则可以将属性信息大于等于4项的车辆定损图像归类到全局图像集中,将属性信息小于4项的车辆定损图像归类到局部图像集中。Specifically, the classification information can be embodied in different ways, and the classification information can be a specific value or a vector. If the classification information is a specific numerical value, then the vehicle damage image is classified by the number of attribute information. That is, matching the attribute information of each of the vehicle's damage-quality images according to the classification information is a match between the number of attribute information and the classification information. For example, if the number of attribute information is 5 items, and if the classification information is set to 4, then the vehicle loss-assessment images with attribute information greater than or equal to 4 items can be classified into the global image set, and the vehicles with attribute information less than 4 items can be classified The images are classified into local image sets.

进一步地,若分类信息为一个向量,则预先为每一车辆定损图像的属性信息进行one-hot向量的转化。若对应的属性信息存在,则在one-hot向量中对应位置的值为1,否则为0。此时,分类信息中的向量即为根据属性信息中具体一项或者至少两项属性信息的状态来对车辆定损图像进行分类。例如,若分类信息为A=[1,1,0,0,0]。则表明属性信息中的第一项和第二项的属性值为1,则该车辆定损图像会归类到全局图像集中,否则该车辆定损图像会归类到局部图像集中。此时,可以将分类信息和每一车辆定损图像的属 性信息的one-hot向量进行向量距离的计算,然后根据计算结果来得到匹配结果。Further, if the classification information is a vector, the one-hot vector conversion is performed in advance for the attribute information of each vehicle's damage image. If the corresponding attribute information exists, the value of the corresponding position in the one-hot vector is 1, otherwise it is 0. At this time, the vector in the classification information is to classify the vehicle damage image according to the state of a specific item or at least two items of the attribute information in the attribute information. For example, if the classification information is A=[1, 1, 0, 0, 0]. It indicates that the attribute value of the first item and the second item in the attribute information is 1, and the vehicle loss-based image will be classified into the global image set, otherwise the vehicle loss-based image will be classified into the local image set. At this time, the classification information and the one-hot vector of the attribute information of each vehicle's damage-related image can be calculated for the vector distance, and then the matching result can be obtained according to the calculation result.

S32:若所述属性信息和所述分类信息匹配成功,则将对应的车辆定损图像放入全局图像集中。S32: If the attribute information and the classification information are matched successfully, put the corresponding vehicle lossy image into the global image set.

S33:若所述属性信息和所述分类信息匹配失败,则将对应的车辆定损图像放入局部图像集中。S33: If the attribute information and the classification information fail to match, put the corresponding vehicle damage image into the partial image set.

在本实施例中,通过一个预设的分类信息和每一车辆定损图像的属性信息进行匹配,并根据匹配结果来对车辆定损图像进行分类,提高了图像分类的灵活性和准确性。In this embodiment, a preset classification information is matched with the attribute information of each vehicle loss-making image, and the vehicle loss-making image is classified according to the matching result, which improves the flexibility and accuracy of image classification.

在一个实施例中,如图5所示,所述根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集,包括:In one embodiment, as shown in FIG. 5, the initial clusters are set according to the attribute information and damaged point information of each of the global images, and the local image sets are clustered according to the initial clusters. , Get different vehicle classification sets, including:

S41:将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量。S41: Transform the attribute information and damaged point information of each vehicle's damage-fixing image into feature vector to obtain the feature vector of each vehicle's damage-fixing image.

将车辆定损图像中的属性信息和受损点信息均进行特征向量转化可以通过词向量的方式实现。词向量的作用就是将自然语言中的字词转为计算机可以理解的稠密向量(Dense Vector)。具体地,先将所有车辆定损图像的属性信息和受损点信息形成输入文本,再利用输入文本生成一个词汇表,每个词统计词频,按照词频从高到低排序,取最频繁的V个词,构成一个词汇表。每个词存在一个one-hot向量,向量的维度是V,如果该词在词汇表中出现过,则向量中词汇表中对应的位置为1,其他位置全为0。如果词汇表中不出现,则向量为全0。one-hot向量表示为一项属性的特征向量,也就是同一时间只有一个激活点(不为0),这个向量只有一个特征是不为0的,其他都是0。The feature vector transformation of both the attribute information and the damaged point information in the vehicle damage image can be achieved by word vector. The role of word vectors is to convert words in natural language into dense vectors that computers can understand. Specifically, the input text is first formed by the attribute information and damaged point information of all vehicle loss-specific images, and then a vocabulary is generated using the input text. The word frequency of each word is counted, and the word frequency is sorted from high to low, and the most frequent V Words form a vocabulary. There is a one-hot vector for each word, and the dimension of the vector is V. If the word has appeared in the vocabulary, the corresponding position in the vocabulary in the vector is 1, and the other positions are all 0. If it does not appear in the vocabulary, the vector is all zeros. The one-hot vector is expressed as a feature vector of an attribute, that is, there is only one activation point (not 0) at the same time, this vector has only one feature that is not 0, and the others are 0.

在该步骤中,可以将每一属性信息和每一受损点信息都单独构建词向量,以更好地表征每一词向量的准确性。再将每一属性信息和每一受损点信息的词向量组成该车辆定损图像的定损特征向量。In this step, a word vector can be constructed separately for each attribute information and each damaged point information to better characterize the accuracy of each word vector. Then, each attribute information and the word vector of each damaged point information form the loss-fixing feature vector of the vehicle's loss-fixing image.

S42:将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇。S42: Set the loss-fixing feature vector of each of the global images as initial clustering points, and perform a cluster analysis on the set of vehicle loss-fixing images according to the initial clustering points using a clustering algorithm to obtain different vehicles Cluster clusters.

在该步骤中,通过全局图像的定损特征向量设置初始聚类点,由于全局图像包含的信息量是最多的,可以通过全局图像对应的定损特征向量来设置初始聚类点,以供后续进行聚类分析。In this step, the initial clustering points are set by the loss-based feature vector of the global image. Since the global image contains the most information, the initial clustering points can be set by the loss-based feature vector corresponding to the global image for subsequent Perform cluster analysis.

具体地,其中,聚类分析又称群分析,它是研究(样品或指标)分类问题的一种统计分析方法,同时也是数据挖掘的一个重要分析方法。可选地,聚类算法可以为K-Means(K均值)聚类、均值漂移聚类、基于密度的聚类方法或者凝聚层次聚类等算法实现。Specifically, among them, cluster analysis is also called cluster analysis, which is a statistical analysis method for studying (sample or index) classification problems, and it is also an important analysis method for data mining. Optionally, the clustering algorithm may be implemented by algorithms such as K-Means (K-means) clustering, mean shift clustering, density-based clustering method, or agglomerated hierarchical clustering.

优选地,采用K-Means(K均值)聚类算法对所述对局部图像集进行聚类分析,获取目标中心点。具体地,根据全局图像的数量设定K值,并设定每一所述全局图像的定损特征向量为初始聚类点。当所有点(车辆定损图像)都分配完毕后,对这个聚类簇中的所有点重新计算(例如计算平均值)得到该簇的新的中心点。然后再通过迭代的方式进行分配中心点和更新聚类簇的中心点的步骤,直至聚类簇的中心点的变化很小,或者达到指定的迭代次数。将符合预设数量的聚类簇作为车辆聚类簇。Preferably, a K-Means (K-means) clustering algorithm is used to perform cluster analysis on the partial image set to obtain the target center point. Specifically, the K value is set according to the number of global images, and the loss-constant feature vector of each global image is set as the initial cluster point. After all the points (vehicle damage image) have been allocated, recalculate (for example, calculate the average value) of all points in the cluster to obtain the new center point of the cluster. Then, the steps of assigning center points and updating the center points of the clusters are performed in an iterative manner until the center points of the clusters change very little or reach the specified number of iterations. The cluster clusters meeting the preset number are regarded as the vehicle cluster clusters.

S43:计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离。S43: Calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster cluster.

可以通过距离算法计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离,例如:欧氏距离算法、曼哈顿距离算法、切比雪夫距离算法、闵可夫斯基距离算法、标准化欧氏距离算法、马氏距离或者汉明距离算法。进一步地,可以在定损特征向量中,为不同的信息设置不同的权重,以更好地计算向量距离,例如,可以将车牌号信息、受损点信息的权重设置的更高,其他信息的权重适当下调,或者根据实际需要做对应的调整。The distance algorithm can be used to calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster cluster, for example: Euclidean distance algorithm, Manhattan distance algorithm, Chebyshev distance algorithm, Minkov Skye distance algorithm, standardized Euclidean distance algorithm, Mahalanobis distance or Hamming distance algorithm. Further, different weights can be set for different information in the loss-based feature vector to better calculate the vector distance. For example, the weights of the license plate number information and damaged point information can be set higher, and the weight of other information can be set higher. The weight is appropriately lowered, or adjusted according to actual needs.

S44:将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像。S44: Determine the vehicle's loss-specific image whose vector distance exceeds a preset vector threshold as an image to be determined.

向量阈值为一个预先设定的值,根据该预设的向量阈值,可以判断一个车辆定损图像是否属于该车辆聚类簇。该向量阈值可以通过多个样本进行测试之后获得,也可以根据经验值来设定。若一个车辆定损图像和车辆聚类簇的向量距离超过预设的向量阈值,则说明该车辆定损图像可能不属于该车辆聚类簇,因此将对应的车辆定损图像确定为待确定图像。The vector threshold is a preset value. According to the preset vector threshold, it can be judged whether a vehicle damage image belongs to the vehicle cluster. The vector threshold can be obtained after testing with multiple samples, or it can be set based on empirical values. If the vector distance between a vehicle damage image and a vehicle cluster cluster exceeds the preset vector threshold, it means that the vehicle damage image may not belong to the vehicle cluster cluster, so the corresponding vehicle damage image is determined as the image to be determined .

S45:将所述待确定图像发送至客户端,获取所述客户端返回的分类信息。S45: Send the to-be-determined image to the client, and obtain the classification information returned by the client.

分类信息为客户端反馈的该将对应的待确定图像分配至哪一车辆聚类簇的信息。在该步骤中,通过将将所述待确定图像发送至客户端,并获取所述客户端返回的分类信息。The classification information is the information of the vehicle cluster cluster to which the corresponding to-be-determined image is allocated, which is fed back by the client. In this step, the image to be determined is sent to the client, and the classification information returned by the client is obtained.

S46:根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中。S46: Assign each of the to-be-determined images to corresponding vehicle clusters according to the classification information.

借助分类信息,服务端将每一幅待确定图像分配到对应的车辆聚类簇中。With the help of classification information, the server assigns each to-be-determined image to the corresponding vehicle cluster.

S47:将每一车辆聚类簇中的车辆定损图像组成车辆分类集。S47: Combine the vehicle damage-related images in each vehicle cluster into a vehicle classification set.

最终将每一车辆聚类簇中的车辆定损图像组成车辆分类集,每一个车辆分类集就代表是不同的车辆定损案件对应的车辆定损图像。Finally, the vehicle damage assessment images in each vehicle cluster are formed into a vehicle classification set. Each vehicle classification set represents a vehicle damage assessment image corresponding to a different vehicle damage assessment case.

在本实施例中,先将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量;将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇;再计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离;将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像;将所述待确定图像发送至客户端,获取所述客户端返回的分类信息;根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中;最后将每一车辆聚类簇中的车辆定损图像组成车辆分类集。可以智能地对车辆定损图像进行分类,保证了图像分类的效率和准确性。In this embodiment, the attribute information and damaged point information of each vehicle's loss-based image are transformed into feature vectors to obtain the loss-based feature vector of each vehicle's loss-based image; The feature vector is set as the initial clustering point, and the clustering algorithm is used to perform cluster analysis on the set of vehicle damage image sets according to the initial clustering point to obtain different vehicle clusters; then each vehicle cluster is calculated The vector distance from the loss-fixing feature vector of each vehicle loss-fixing image to the cluster center; determining the loss-fixing image of the vehicle whose vector distance exceeds the preset vector threshold as the image to be determined; sending the image to be determined To the client, obtain the classification information returned by the client; assign each of the to-be-determined images to the corresponding vehicle cluster according to the classification information; finally, the vehicle in each vehicle cluster is assessed for damage The images make up the vehicle classification set. It can intelligently classify the vehicle damage image, ensuring the efficiency and accuracy of image classification.

本申请实施例还涉及一种车辆图像分类方法,以该方法应用在图1中的服务端为例进行说明,如图6所示,该车辆图像分类方法包括:The embodiment of the present application also relates to a vehicle image classification method. The application of the method to the server in FIG. 1 is taken as an example for description. As shown in FIG. 6, the vehicle image classification method includes:

S10’:获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像。S10': Acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes a global image and a partial image.

其中,车辆定损数据集是由大量车辆定损图像组成的图像集。车辆定损是在当被保险的车辆发生交通事故时,相关单位进行现场查勘定损,车辆定损涉及到维修、制造和车主损失等多方面。而车辆定损图像是和定损车辆相关的图像信息,可以包括车辆信息(车牌号)、车辆受损区域图像以及车辆所处的环境情况等。可以理解地,一个车辆的车辆定损图像通常是至少两幅的。Among them, the vehicle loss assessment data set is an image set composed of a large number of vehicle loss assessment images. Vehicle damage determination is when the insured vehicle has a traffic accident, the relevant unit conducts on-site inspection and determination of the damage. The vehicle damage determination involves many aspects such as maintenance, manufacturing, and loss of the owner. The vehicle damage assessment image is image information related to the damage assessment vehicle, which can include vehicle information (license plate number), images of damaged areas of the vehicle, and the environment in which the vehicle is located. Understandably, there are usually at least two vehicle damage images of a vehicle.

车辆定损数据集可以是同一图像采集工具采集的所有图像,或者是同一图像采集工具在预定时间内(例如,一天)采集的所有图像,也可以为至少两个图像采集工具采集的所有图像,或者是至少两个图像采集工具在预定时间内(例如,一天)采集的所有图像。而一个图像采集工具可以就是一个客户端,或者至少两个图像采集工具都通过对应的客户端或者同一个客户端将车辆定损图像上传到服务端。而车辆定损图像的上传时机可以是实时的,也可以是定时进行上传。The vehicle damage data set can be all images collected by the same image collection tool, or all images collected by the same image collection tool within a predetermined time (for example, one day), or all images collected by at least two image collection tools. Or all images collected by at least two image collection tools within a predetermined time (for example, one day). An image collection tool may be a client, or at least two image collection tools both upload the vehicle's loss-based image to the server through the corresponding client or the same client. The upload timing of the vehicle's fixed-loss image can be real-time or regularly.

具体地,车辆定损数据集包括全局图像和局部图像,全局图像为反映对应车辆全局信息的图像,而局部图像为反映对应车辆局部信息的图像。在车辆定损数据集中,每一车辆定损图像带有对应的图像标签,用以表明该图像为全局图像或局部图像。Specifically, the vehicle damage data set includes a global image and a local image. The global image is an image that reflects the global information of the corresponding vehicle, and the local image is an image that reflects the local information of the corresponding vehicle. In the vehicle loss assessment data set, each vehicle loss assessment image has a corresponding image label to indicate that the image is a global image or a partial image.

S20’:对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集。S20': Perform classification processing on the vehicle loss-fixing data set to obtain a global image set and a partial image set.

具体地,根据每一车辆定损图像的图像标签对对所述车辆定损数据集进行分类处理,将全局图像分到全局图像集中,将局部图像分到局部图像集中,得到全局图像集和局部图像集。Specifically, according to the image label of each vehicle loss-fixing image, the vehicle loss-fixing data set is classified, the global image is divided into a global image set, and the local image is divided into a local image set to obtain a global image set and a local image set. Image set.

S30’:采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得 到每一车辆定损图像的属性信息和受损点信息。S30': Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image.

具体地,该步骤和上述实施例中的步骤S20相同,在此不再赘述。Specifically, this step is the same as step S20 in the foregoing embodiment, and will not be repeated here.

S40’:根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集。S40': Set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the partial image sets according to the initial clusters to obtain different vehicle classification sets.

S50’:对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。S50': Perform vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity.

上述步骤S40’和S50’和上述实施例中的步骤S40和S50相同,在此不再赘述。The above steps S40' and S50' are the same as the steps S40 and S50 in the above embodiment, and will not be repeated here.

在本实施例中,在车辆定损数据集中预先为每一图像配置了不同的图像标签,以更好地对车辆定损数据集进行分类,更好地提高了车辆分类的效率。In this embodiment, different image labels are pre-configured for each image in the vehicle loss assessment data set to better classify the vehicle loss assessment data set, and to better improve the efficiency of vehicle classification.

应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the size of the sequence number of each step in the foregoing embodiment does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiment of the present application.

在一实施例中,提供一种车辆图像分类装置,该车辆图像分类装置与上述实施例中车辆图像分类方法一一对应。如图7所示,该车辆图像分类装置包括第一数据集获取模块10、第一图像识别模块20、第一图像分类模块30、第一分类集获取模块40和第一图像剔除模块50。各功能模块详细说明如下:In one embodiment, a vehicle image classification device is provided, and the vehicle image classification device corresponds to the vehicle image classification method in the above-mentioned embodiment one-to-one. As shown in FIG. 7, the vehicle image classification device includes a first data set acquisition module 10, a first image recognition module 20, a first image classification module 30, a first classification set acquisition module 40 and a first image removal module 50. The detailed description of each functional module is as follows:

第一数据集获取模块10,用于获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像。The first data set acquisition module 10 is configured to acquire a vehicle loss assessment data set, the vehicle loss assessment data set including at least two vehicle loss assessment images.

第一图像识别模块20,用于对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息。The first image recognition module 20 is used to identify each vehicle damage image in the vehicle damage data set to obtain attribute information and damaged point information of each vehicle damage image.

第一图像分类模块30,用于根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集。The first image classification module 30 is configured to classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set.

第一分类集获取模块40,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集。The first classification set acquisition module 40 is configured to set an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the vehicle loss assessment data set according to the initial cluster cluster to obtain Different vehicle classification set.

第一图像剔除模块50,用于对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。The first image culling module 50 is used to perform image similarity calculation on the vehicle classification images in each vehicle classification set, and to eliminate duplicate vehicle classification images according to the image similarity.

优选地,如图8所示,第一分类集获取模块40包括:Preferably, as shown in FIG. 8, the first classification set acquisition module 40 includes:

向量转化单元41,用于将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量。The vector conversion unit 41 is used to transform the attribute information and the damaged point information of each vehicle's damage assessment image into feature vector to obtain the damage feature vector of each vehicle's damage assessment image.

聚类簇获取单元42,用于将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇。The cluster cluster acquisition unit 42 is configured to set the loss-specific feature vector of each global image as an initial clustering point, and use a clustering algorithm to cluster the set of vehicle loss-based images according to the initial clustering point. Class analysis to obtain different vehicle clusters.

向量距离计算单元43,用于计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离。The vector distance calculation unit 43 is used to calculate the vector distance from the loss-fixing feature vector of each vehicle loss-making image in each vehicle cluster to the center of the cluster cluster.

图像划分单元44,用于将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像。The image dividing unit 44 is configured to determine the vehicle's loss-of-loss image whose vector distance exceeds a preset vector threshold as the image to be determined.

分类信息获取单元45,用于将所述待确定图像发送至客户端,获取所述客户端返回的分类信息。The classification information obtaining unit 45 is configured to send the to-be-determined image to the client, and obtain the classification information returned by the client.

图像分配单元46,用于根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中。The image allocation unit 46 is configured to allocate each of the to-be-determined images to the corresponding vehicle cluster according to the classification information.

分类集组成单元47,用于将每一车辆聚类簇中的车辆定损图像组成车辆分类集。The classification set composing unit 47 is used to compose the vehicle classification set of the vehicle damage-related images in each vehicle cluster.

优选地,所述车辆定损图像包括受损区域。所述第一图像识别模块20包括:Preferably, the vehicle damage assessment image includes a damaged area. The first image recognition module 20 includes:

受损区域识别单元,用于采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息。The damaged area recognition unit is used to recognize the damaged area of each vehicle's damage assessment image by using a preset damaged point recognition model to obtain the damaged point information of each vehicle's damage assessment image.

图像信息获取单元,用于采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息。The image information acquisition unit is used to process each vehicle's fixed-loss image by using the semantic segmentation model to obtain image information of each vehicle's fixed-loss image.

属性信息获取单元,用于根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。The attribute information acquisition unit is configured to acquire the corresponding target recognition model according to the image information of each vehicle damage image, and use the target recognition model to identify the vehicle damage image to obtain the vehicle damage image Attribute information.

优选地,第一图像分类模块30包括:Preferably, the first image classification module 30 includes:

分类信息获取单元,用于获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配。The classification information acquisition unit is configured to acquire preset classification information, and match the attribute information of each vehicle's loss-based image according to the classification information.

分类单元,用于在所述属性信息和所述分类信息匹配成功时,则将对应的车辆定损图像放入全局图像集中;在所述属性信息和所述分类信息匹配失败时,则将对应的车辆定损图像放入局部图像集中。The classification unit is configured to put the corresponding vehicle loss-specific image into the global image collection when the attribute information and the classification information match successfully; when the attribute information and the classification information fail to match, then the corresponding The vehicle's fixed-loss image is put into the partial image set.

在一实施例中,提供一种车辆图像分类装置,该车辆图像分类装置与上述实施例中车辆图像分类方法一一对应。如图9所示,该车辆图像分类装置包括第二数据集获取模块10’、第二图像分类模块20’、第二图像识别模块30’、第二分类集获取模块40’和第二图像剔除模块50’。各功能模块详细说明如下:In one embodiment, a vehicle image classification device is provided, and the vehicle image classification device corresponds to the vehicle image classification method in the above-mentioned embodiment one-to-one. As shown in FIG. 9, the vehicle image classification device includes a second data set acquisition module 10', a second image classification module 20', a second image recognition module 30', a second classification set acquisition module 40', and a second image removal module. Module 50'. The detailed description of each functional module is as follows:

第二数据集获取模块10’,用于获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像。The second data set acquisition module 10' is used to acquire a vehicle loss assessment data set. The vehicle loss assessment data set includes global images and partial images.

第二图像分类模块20’,用于对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集。The second image classification module 20' is used to classify the vehicle damage data set to obtain a global image set and a local image set.

第二图像识别模块30’,用于采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息。The second image recognition module 30' is used to identify each vehicle damage image in the vehicle damage data set using a preset recognition model to obtain attribute information and damage point information of each vehicle damage image.

第二分类集获取模块40’,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集。The second classification set acquisition module 40' is configured to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the local image sets according to the initial clusters to obtain different Set of vehicle classifications.

第二图像剔除模块50’,用于对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。The second image rejection module 50' is used to calculate the vehicle similarity of the vehicle images in each vehicle classification set, and eliminate the repeated vehicle images according to the vehicle similarity.

关于车辆图像分类装置装置的具体限定可以参见上文中对于车辆图像分类装置方法的限定,在此不再赘述。上述车辆图像分类装置装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中,也可以以软件形式存储于计算机设备中的存储器中,以便于处理器调用执行以上各个模块对应的操作。For the specific definition of the vehicle image classification device, please refer to the above definition of the vehicle image classification device method, which will not be repeated here. Each module in the above-mentioned vehicle image classification device can be implemented in whole or in part by software, hardware, and a combination thereof. The foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.

在一个实施例中,提供了一种计算机设备,该计算机设备可以是服务器,其内部结构图可以如图10所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口和数据库。其中,该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统、计算机可读指令和数据库。该内存储器为非易失性存储介质中的操作系统和计算机可读指令的运行提供环境。该计算机设备的数据库用于上述实施例中的车辆图像分类方法中所使用到的数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机可读指令被处理器执行时以实现一种车辆图像分类方法。In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 10. The computer equipment includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer readable instructions, and a database. The internal memory provides an environment for the operation of the operating system and computer-readable instructions in the non-volatile storage medium. The database of the computer equipment is used for the data used in the vehicle image classification method in the above embodiment. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer-readable instructions are executed by the processor to realize a vehicle image classification method.

在一个实施例中,提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机可读指令,处理器执行计算机可读指令时实现上述实施例中的车辆图像分类方法。In one embodiment, a computer device is provided, including a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor. When the processor executes the computer-readable instructions, Vehicle image classification method.

在一个实施例中,提供了一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行上述实施例中的车辆图像分类方法。其中,所述可读存储介质包括非易失性可读存储介质和易失性可读存储介质。In one embodiment, one or more readable storage media storing computer readable instructions are provided, and when the computer readable instructions are executed by one or more processors, the one or more processors execute The vehicle image classification method in the above embodiment. Wherein, the readable storage medium includes a non-volatile readable storage medium and a volatile readable storage medium.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,是可以通过计算机可读指令来指令相关的硬件来完成,所述的计算机可读指令可存储于一非易失性计 算机可读取存储介质中,该计算机可读指令在执行时,可包括如上述各方法的实施例的流程。其中,本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用,均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限,RAM以多种形式可得,诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through computer-readable instructions, which can be stored in a non-volatile computer. In a readable storage medium, when the computer-readable instructions are executed, they may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,仅以上述各功能单元、模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能单元、模块完成,即将所述装置的内部结构划分成不同的功能单元或模块,以完成以上描述的全部或者部分功能。Those skilled in the art can clearly understand that for the convenience and conciseness of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned functions can be allocated to different functional units and modules as required. Module completion means dividing the internal structure of the device into different functional units or modules to complete all or part of the functions described above.

以上所述实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围,均应包含在本申请的保护范围之内。The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that it can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims (20)

一种车辆图像分类方法,其特征在于,包括:A vehicle image classification method, characterized in that it includes: 获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;Acquiring a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images; 对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Recognize each vehicle damage assessment image in the vehicle damage assessment data set, and obtain the attribute information and damage point information of each vehicle damage assessment image; 根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate duplicate vehicle classification images based on the image similarity. 如权利要求1所述的车辆图像分类方法,其特征在于,所述车辆定损图像包括受损区域;3. The vehicle image classification method according to claim 1, wherein the vehicle damage assessment image includes a damaged area; 所述对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息,包括:The identification of each vehicle damage measurement image in the vehicle damage measurement data set to obtain the attribute information and damage point information of each vehicle damage measurement image includes: 采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息;Use the preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, and obtain the damaged point information of each vehicle's damage assessment image; 采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息;Use the semantic segmentation model to process each vehicle's fixed-loss image to obtain the image information of each vehicle's fixed-loss image; 根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。A corresponding target recognition model is acquired according to the image information of each vehicle's damage assessment image, and the target recognition model is used to perform recognition processing on the vehicle damage assessment image to obtain attribute information of the vehicle damage assessment image. 如权利要求1所述的车辆图像分类方法,其特征在于,所述根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集,包括:5. The vehicle image classification method according to claim 1, wherein the classification of the vehicle image with loss based on the attribute information to obtain a global image set and a partial image set comprises: 获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配;Acquiring preset classification information, and matching the attribute information of each vehicle's fixed-loss image according to the classification information; 若所述属性信息和所述分类信息匹配成功,则将对应的车辆定损图像放入全局图像集中;If the attribute information and the classification information are successfully matched, the corresponding vehicle loss-specific image is put into the global image collection; 若所述属性信息和所述分类信息匹配失败,则将对应的车辆定损图像放入局部图像集中。If the attribute information and the classification information fail to match, the corresponding vehicle loss-specific image is put into the partial image set. 如权利要求1所述的车辆图像分类方法,其特征在于,所述根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集,包括:The vehicle image classification method according to claim 1, wherein the initial cluster cluster is set according to the attribute information and damaged point information of each of the global images, and the partial image set is adjusted according to the initial cluster cluster. Perform cluster analysis to get different vehicle classification sets, including: 将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量;Convert the attribute information and damaged point information of each vehicle's damage-oriented image into feature vector to obtain the feature vector of each vehicle's damage-oriented image; 将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇;Set the loss-fixing feature vector of each of the global images as the initial clustering point, and use a clustering algorithm to perform cluster analysis on the set of vehicle loss-fixing images according to the initial clustering points to obtain different vehicle clusters cluster; 计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离;Calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster; 将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像;Determining a vehicle loss-based image whose vector distance exceeds a preset vector threshold as an image to be determined; 将所述待确定图像发送至客户端,获取所述客户端返回的分类信息;Sending the to-be-determined image to the client to obtain the classification information returned by the client; 根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中;Allocating each of the to-be-determined images to a corresponding vehicle cluster according to the classification information; 将每一车辆聚类簇中的车辆定损图像组成车辆分类集。The vehicle damage assessment images in each vehicle cluster are composed of vehicle classification sets. 一种车辆图像分类方法,其特征在于,包括:A vehicle image classification method, characterized in that it includes: 获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;Acquiring a vehicle loss assessment data set, the vehicle loss assessment data set including a global image and a local image; 对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;Performing classification processing on the vehicle damage data set to obtain a global image set and a partial image set; 采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing cluster analysis on a local image set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。Carry out vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity. 一种车辆图像分类装置,其特征在于,包括:A vehicle image classification device, characterized in that it comprises: 第一数据集获取模块,用于获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;The first data set acquisition module is configured to acquire a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images; 第一图像识别模块,用于对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;The first image recognition module is used for recognizing each vehicle's loss-fixing image in the vehicle's loss-fixing data set to obtain attribute information and damaged point information of each vehicle's loss-fixing image; 第一图像分类模块,用于根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;The first image classification module is configured to classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set; 第一分类集获取模块,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;The first classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the vehicle damage data set according to the initial clusters to obtain different Vehicle classification set; 第一图像剔除模块,用于对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。The first image elimination module is used to calculate the image similarity of the vehicle classification images in each vehicle classification set, and eliminate the repeated vehicle classification images according to the image similarity. 如权利要求6所述的车辆图像分类装置,其特征在于,所述分类集获取模块包括:The vehicle image classification device according to claim 6, wherein the classification set acquisition module comprises: 向量转化单元,用于将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量;The vector conversion unit is used to transform the attribute information and damaged point information of each vehicle's damage-oriented image into feature vector to obtain the feature vector of each vehicle's damage-oriented image; 聚类簇获取单元,用于将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇;The cluster cluster acquisition unit is configured to set the loss-specific feature vector of each global image as an initial clustering point, and cluster the vehicle loss-specific image set according to the initial clustering point using a clustering algorithm Analyze, get different vehicle clusters; 向量距离计算单元,用于计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离;The vector distance calculation unit is used to calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster cluster; 图像划分单元,用于将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像;An image dividing unit, configured to determine a vehicle loss-based image whose vector distance exceeds a preset vector threshold as a to-be-determined image; 分类信息获取单元,用于将所述待确定图像发送至客户端,获取所述客户端返回的分类信息;The classification information obtaining unit is configured to send the to-be-determined image to the client, and obtain the classification information returned by the client; 图像分配单元,用于根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中;An image allocation unit, configured to allocate each of the to-be-determined images to a corresponding vehicle cluster according to the classification information; 分类集组成单元,用于将每一车辆聚类簇中的车辆定损图像组成车辆分类集。The classification set composing unit is used to compose the vehicle classification set of the vehicle damage-related images in each vehicle cluster. 如权利要求6所述的车辆图像分类装置,其特征在于,所述车辆定损图像包括受损区域,所述第一图像识别模块包括:7. The vehicle image classification device according to claim 6, wherein the vehicle damage assessment image includes a damaged area, and the first image recognition module includes: 受损区域识别单元,用于采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息;The damaged area recognition unit is used to identify the damaged area of each vehicle's damage assessment image by using a preset damaged point recognition model to obtain the damaged point information of each vehicle's damage assessment image; 图像信息获取单元,用于采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息;The image information acquisition unit is used to process each vehicle's fixed-loss image by using a semantic segmentation model to obtain image information of each vehicle's fixed-loss image; 属性信息获取单元,用于根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。The attribute information acquisition unit is configured to acquire the corresponding target recognition model according to the image information of each vehicle damage image, and use the target recognition model to identify the vehicle damage image to obtain the vehicle damage image Attribute information. 如权利要求6所述的车辆图像分类装置,其特征在于,所述第一图像分类模块包括:The vehicle image classification device according to claim 6, wherein the first image classification module comprises: 分类信息获取单元,用于获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配;The classification information acquisition unit is configured to acquire preset classification information, and match the attribute information of each vehicle's fixed-loss image according to the classification information; 分类单元,用于在所述属性信息和所述分类信息匹配成功时,则将对应的车辆定损图像放入全局图像集中;在所述属性信息和所述分类信息匹配失败时,则将对应的车辆定损图像放入局部图像集中。The classification unit is configured to put the corresponding vehicle loss-specific image into the global image collection when the attribute information and the classification information match successfully; when the attribute information and the classification information fail to match, then the corresponding The vehicle's fixed-loss image is put into the partial image set. 一种车辆图像分类装置,其特征在于,包括:A vehicle image classification device, characterized in that it comprises: 第二数据集获取模块,用于获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;The second data set acquisition module is configured to acquire a vehicle loss assessment data set, the vehicle loss assessment data set including global images and partial images; 第二图像分类模块,用于对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;The second image classification module is used to classify the vehicle loss assessment data set to obtain a global image set and a local image set; 第二图像识别模块,用于采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;The second image recognition module is used to recognize each vehicle damage image in the vehicle damage data set by using a preset recognition model to obtain attribute information and damage point information of each vehicle damage image; 第二分类集获取模块,用于根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;The second classification set acquisition module is used to set initial clusters according to the attribute information and damaged point information of each of the global images, and perform cluster analysis on the local image sets according to the initial clusters to obtain different vehicles Classification set 第二图像剔除模块,用于对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。The second image elimination module is used to calculate the vehicle similarity of the vehicle images in each vehicle classification set, and eliminate the repeated vehicle images according to the vehicle similarity. 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:A computer device comprising a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor, wherein the processor executes the computer-readable instructions as follows step: 获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;Acquiring a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images; 对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Recognize each vehicle damage assessment image in the vehicle damage assessment data set, and obtain the attribute information and damage point information of each vehicle damage assessment image; 根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate duplicate vehicle classification images based on the image similarity. 如权利要求11所述的计算机设备,其特征在于,所述车辆定损图像包括受损区域;The computer device of claim 11, wherein the vehicle damage assessment image includes a damaged area; 所述对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息,包括:The identification of each vehicle damage measurement image in the vehicle damage measurement data set to obtain the attribute information and damage point information of each vehicle damage measurement image includes: 采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息;Use the preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, and obtain the damaged point information of each vehicle's damage assessment image; 采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息;Use the semantic segmentation model to process each vehicle's fixed-loss image to obtain the image information of each vehicle's fixed-loss image; 根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。A corresponding target recognition model is acquired according to the image information of each vehicle's damage assessment image, and the target recognition model is used to perform recognition processing on the vehicle damage assessment image to obtain attribute information of the vehicle damage assessment image. 如权利要求11所述的计算机设备,其特征在于,所述根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集,包括:The computer device according to claim 11, wherein said classifying said vehicle loss-specific image according to said attribute information to obtain a global image set and a partial image set comprises: 获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配;Acquiring preset classification information, and matching the attribute information of each vehicle's fixed-loss image according to the classification information; 若所述属性信息和所述分类信息匹配成功,则将对应的车辆定损图像放入全局图像集中;If the attribute information and the classification information are successfully matched, the corresponding vehicle loss-specific image is put into the global image collection; 若所述属性信息和所述分类信息匹配失败,则将对应的车辆定损图像放入局部图像集中。If the attribute information and the classification information fail to match, the corresponding vehicle loss-specific image is put into the partial image set. 如权利要求11所述的计算机设备,其特征在于,所述根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集,包括:The computer device according to claim 11, wherein the initial cluster cluster is set according to the attribute information and damaged point information of each of the global images, and the partial image sets are clustered according to the initial cluster clusters. Class analysis to obtain different vehicle classification sets, including: 将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量;Convert the attribute information and damaged point information of each vehicle's damage-oriented image into feature vector to obtain the feature vector of each vehicle's damage-oriented image; 将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇;Set the loss-fixing feature vector of each of the global images as the initial clustering point, and use a clustering algorithm to perform cluster analysis on the set of vehicle loss-fixing images according to the initial clustering points to obtain different vehicle clusters cluster; 计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离;Calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster; 将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像;Determining a vehicle loss-based image whose vector distance exceeds a preset vector threshold as an image to be determined; 将所述待确定图像发送至客户端,获取所述客户端返回的分类信息;Sending the to-be-determined image to the client to obtain the classification information returned by the client; 根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中;Allocating each of the to-be-determined images to a corresponding vehicle cluster according to the classification information; 将每一车辆聚类簇中的车辆定损图像组成车辆分类集。The vehicle damage assessment images in each vehicle cluster are composed of vehicle classification sets. 一种计算机设备,包括存储器、处理器以及存储在所述存储器中并可在所述处理器上运行的计算机可读指令,其特征在于,所述处理器执行所述计算机可读指令时实现如下步骤:A computer device comprising a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor, wherein the processor executes the computer-readable instructions as follows step: 获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;Acquiring a vehicle loss assessment data set, the vehicle loss assessment data set including a global image and a local image; 对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;Performing classification processing on the vehicle damage data set to obtain a global image set and a partial image set; 采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing cluster analysis on a local image set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。Carry out vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity. 一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:One or more readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps: 获取车辆定损数据集,所述车辆定损数据集包括至少两幅车辆定损图像;Acquiring a vehicle loss assessment data set, where the vehicle loss assessment data set includes at least two vehicle loss assessment images; 对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Recognize each vehicle damage assessment image in the vehicle damage assessment data set, and obtain the attribute information and damage point information of each vehicle damage assessment image; 根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集;Classify the vehicle loss-specific image according to the attribute information to obtain a global image set and a partial image set; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对车辆定损数据集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing a cluster analysis on the vehicle damage data set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆分类图像进行图像相似度计算,根据图像相似度对重复的车辆分类图像进行剔除。Perform image similarity calculation on the vehicle classification images in each vehicle classification set, and eliminate duplicate vehicle classification images based on the image similarity. 如权利要求16所述的可读存储介质,其特征在于,所述车辆定损图像包括受损区域;15. The readable storage medium of claim 16, wherein the vehicle damage-assessment image includes a damaged area; 所述对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息,包括:The identification of each vehicle damage measurement image in the vehicle damage measurement data set to obtain the attribute information and damage point information of each vehicle damage measurement image includes: 采用预设的受损点识别模型对每一车辆定损图像的受损区域进行识别,得到每一车辆定损图像的受损点信息;Use the preset damaged point recognition model to identify the damaged area of each vehicle's damage assessment image, and obtain the damaged point information of each vehicle's damage assessment image; 采用语义分割模型对每一车辆定损图像进行处理,得到每一车辆定损图像的图像信息;Use the semantic segmentation model to process each vehicle's fixed-loss image to obtain the image information of each vehicle's fixed-loss image; 根据每一车辆定损图像的所述图像信息获取对应的目标识别模型,采用所述目标识别模型对所述车辆定损图像进行识别处理,得到所述车辆定损图像的属性信息。A corresponding target recognition model is acquired according to the image information of each vehicle's damage assessment image, and the target recognition model is used to perform recognition processing on the vehicle damage assessment image to obtain attribute information of the vehicle damage assessment image. 如权利要求16所述的可读存储介质,其特征在于,所述根据所述属性信息对所述车辆定损图像进行分类,得到全局图像集和局部图像集,包括:The readable storage medium according to claim 16, wherein said classifying said vehicle loss-specific image according to said attribute information to obtain a global image set and a partial image set comprises: 获取预设的分类信息,根据所述分类信息对每一车辆定损图像的属性信息进行匹配;Acquiring preset classification information, and matching the attribute information of each vehicle's fixed-loss image according to the classification information; 若所述属性信息和所述分类信息匹配成功,则将对应的车辆定损图像放入全局图像集中;If the attribute information and the classification information are successfully matched, the corresponding vehicle loss-specific image is put into the global image collection; 若所述属性信息和所述分类信息匹配失败,则将对应的车辆定损图像放入局部图像集中。If the attribute information and the classification information fail to match, the corresponding vehicle loss-specific image is put into the partial image set. 如权利要求16所述的可读存储介质,其特征在于,所述根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分 析,得到不同的车辆分类集,包括:The readable storage medium according to claim 16, wherein the initial cluster cluster is set according to the attribute information and damaged point information of each of the global images, and the partial image set is adjusted according to the initial cluster cluster. Perform cluster analysis to get different vehicle classification sets, including: 将每一车辆定损图像的属性信息和受损点信息进行特征向量转化,得到每一车辆定损图像的定损特征向量;Convert the attribute information and damaged point information of each vehicle's damage-oriented image into feature vector to obtain the feature vector of each vehicle's damage-oriented image; 将每一所述全局图像的定损特征向量设置为初始聚类点,根据所述初始聚类点采用聚类算法对所述对车辆定损图像集进行聚类分析,得到不同的车辆聚类簇;Set the loss-fixing feature vector of each of the global images as the initial clustering point, and use a clustering algorithm to perform cluster analysis on the set of vehicle loss-fixing images according to the initial clustering points to obtain different vehicle clusters cluster; 计算每一车辆聚类簇中每一车辆定损图像的定损特征向量到聚类簇中心的向量距离;Calculate the vector distance from the loss-fixing feature vector of the loss-fixing image of each vehicle in each vehicle cluster to the center of the cluster; 将所述向量距离超过预设的向量阈值的车辆定损图像确定为待确定图像;Determining a vehicle loss-based image whose vector distance exceeds a preset vector threshold as an image to be determined; 将所述待确定图像发送至客户端,获取所述客户端返回的分类信息;Sending the to-be-determined image to the client to obtain the classification information returned by the client; 根据所述分类信息将每一所述待确定图像分配到对应的车辆聚类簇中;Allocating each of the to-be-determined images to a corresponding vehicle cluster according to the classification information; 将每一车辆聚类簇中的车辆定损图像组成车辆分类集。The vehicle damage assessment images in each vehicle cluster are composed of vehicle classification sets. 一个或多个存储有计算机可读指令的可读存储介质,所述计算机可读指令被一个或多个处理器执行时,使得所述一个或多个处理器执行如下步骤:One or more readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps: 获取车辆定损数据集,所述车辆定损数据集包括全局图像和局部图像;Acquiring a vehicle loss assessment data set, the vehicle loss assessment data set including a global image and a local image; 对所述车辆定损数据集进行分类处理,得到全局图像集和局部图像集;Performing classification processing on the vehicle damage data set to obtain a global image set and a partial image set; 采用预设的识别模型对车辆定损数据集中的每一车辆定损图像进行识别,得到每一车辆定损图像的属性信息和受损点信息;Use the preset recognition model to identify each vehicle damage image in the vehicle damage data set, and obtain the attribute information and damage point information of each vehicle damage image; 根据每一所述全局图像的属性信息和受损点信息设置初始聚类簇,根据所述初始聚类簇对局部图像集进行聚类分析,得到不同的车辆分类集;Setting an initial cluster cluster according to the attribute information and damaged point information of each of the global images, and performing cluster analysis on a local image set according to the initial cluster cluster to obtain different vehicle classification sets; 对每一车辆分类集中的车辆图像进行车辆相似度计算,根据车辆相似度对重复的车辆图像进行剔除。Carry out vehicle similarity calculation on the vehicle images in each vehicle classification set, and eliminate duplicate vehicle images according to the vehicle similarity.
PCT/CN2019/117730 2019-07-03 2019-11-13 Vehicle image classification method and apparatus, and computer device and storage medium Ceased WO2021000489A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910596017.0A CN110472656B (en) 2019-07-03 2019-07-03 Vehicle image classification method, device, computer equipment and storage medium
CN201910596017.0 2019-07-03

Publications (1)

Publication Number Publication Date
WO2021000489A1 true WO2021000489A1 (en) 2021-01-07

Family

ID=68507095

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/117730 Ceased WO2021000489A1 (en) 2019-07-03 2019-11-13 Vehicle image classification method and apparatus, and computer device and storage medium

Country Status (2)

Country Link
CN (1) CN110472656B (en)
WO (1) WO2021000489A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113850556A (en) * 2021-10-18 2021-12-28 丰图科技(深圳)有限公司 Waybill generation method and device, electronic equipment and readable storage medium
CN114357225A (en) * 2021-12-09 2022-04-15 之江实验室 Fraud risk identification method and system for auto insurance claims based on cross-case image comparison
CN114821140A (en) * 2022-04-20 2022-07-29 咪咕文化科技有限公司 Image clustering method, terminal device and storage medium based on Manhattan distance
CN117218357A (en) * 2022-06-02 2023-12-12 书行科技(北京)有限公司 Method and apparatus for unsupervised multi-level clustering of images

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110142345A1 (en) * 2009-12-14 2011-06-16 Electronics And Telecommunications Research Institute Apparatus and method for recognizing image
CN105956631A (en) * 2016-05-19 2016-09-21 南京大学 On-line progressive image classification method facing electronic image base
US20170293894A1 (en) * 2016-04-06 2017-10-12 American International Group, Inc. Automatic assessment of damage and repair costs in vehicles
CN107358596A (en) * 2017-04-11 2017-11-17 阿里巴巴集团控股有限公司 Method, device, electronic equipment and system for image-based vehicle damage assessment
CN108334892A (en) * 2017-12-26 2018-07-27 新智数字科技有限公司 A kind of model recognizing method, device and equipment based on convolutional neural networks
CN109389169A (en) * 2018-10-08 2019-02-26 百度在线网络技术(北京)有限公司 Method and apparatus for handling image

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11144889B2 (en) * 2016-04-06 2021-10-12 American International Group, Inc. Automatic assessment of damage and repair costs in vehicles
CN108229468B (en) * 2017-06-28 2020-02-21 北京市商汤科技开发有限公司 Vehicle appearance feature recognition and vehicle retrieval method and device, storage medium and electronic equipment
CN109784170B (en) * 2018-12-13 2023-11-17 平安科技(深圳)有限公司 Vehicle risk assessment method, device, equipment and storage medium based on image recognition

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110142345A1 (en) * 2009-12-14 2011-06-16 Electronics And Telecommunications Research Institute Apparatus and method for recognizing image
US20170293894A1 (en) * 2016-04-06 2017-10-12 American International Group, Inc. Automatic assessment of damage and repair costs in vehicles
CN105956631A (en) * 2016-05-19 2016-09-21 南京大学 On-line progressive image classification method facing electronic image base
CN107358596A (en) * 2017-04-11 2017-11-17 阿里巴巴集团控股有限公司 Method, device, electronic equipment and system for image-based vehicle damage assessment
CN108334892A (en) * 2017-12-26 2018-07-27 新智数字科技有限公司 A kind of model recognizing method, device and equipment based on convolutional neural networks
CN109389169A (en) * 2018-10-08 2019-02-26 百度在线网络技术(北京)有限公司 Method and apparatus for handling image

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113850556A (en) * 2021-10-18 2021-12-28 丰图科技(深圳)有限公司 Waybill generation method and device, electronic equipment and readable storage medium
CN114357225A (en) * 2021-12-09 2022-04-15 之江实验室 Fraud risk identification method and system for auto insurance claims based on cross-case image comparison
CN114357225B (en) * 2021-12-09 2024-05-24 之江实验室 Vehicle insurance claim fraud risk identification method and system based on cross-case image comparison
CN114821140A (en) * 2022-04-20 2022-07-29 咪咕文化科技有限公司 Image clustering method, terminal device and storage medium based on Manhattan distance
CN117218357A (en) * 2022-06-02 2023-12-12 书行科技(北京)有限公司 Method and apparatus for unsupervised multi-level clustering of images

Also Published As

Publication number Publication date
CN110472656B (en) 2023-09-05
CN110472656A (en) 2019-11-19

Similar Documents

Publication Publication Date Title
WO2021000489A1 (en) Vehicle image classification method and apparatus, and computer device and storage medium
US10885397B2 (en) Computer-executed method and apparatus for assessing vehicle damage
CN114359787B (en) Target attribute recognition method, device, computer equipment and storage medium
WO2021135499A1 (en) Damage detection model training and vehicle damage detection methods, device, apparatus, and medium
US20180181834A1 (en) Method and apparatus for security inspection
WO2020077895A1 (en) Signing intention determining method and apparatus, computer device, and storage medium
WO2020098074A1 (en) Face sample picture marking method and apparatus, computer device, and storage medium
WO2021003938A1 (en) Image classification method and apparatus, computer device and storage medium
CN110516712B (en) Insect pest image recognition method, insect pest monitoring method, insect pest image recognition device, insect pest monitoring equipment and insect pest image recognition medium
KR20180118596A (en) Semi-automatic labeling of data sets
WO2020190480A1 (en) Classifying an input data set within a data category using multiple data recognition tools
CN112668462B (en) Vehicle damage detection model training, vehicle damage detection method, device, equipment and medium
WO2021031704A1 (en) Object tracking method and apparatus, computer device, and storage medium
US20250080610A1 (en) Method and system for automatically annotating sensor data
CN114140025A (en) Multimodal data-oriented auto insurance fraud prediction system, method and device
CN110705489A (en) Training method and device of target recognition network, computer equipment and storage medium
CN113780131B (en) Text image orientation recognition method, text content recognition method, device and equipment
CN110674342B (en) Method and device for inquiring target image
CN113657180B (en) Vehicle identification method, server and computer-readable storage medium
WO2020228179A1 (en) Picture instance detection method and apparatus, computer device, and storage medium
CN117612206B (en) Pedestrian re-recognition network model generation method, device, computer equipment and medium
CN112861576B (en) Employee image detection method, device, computer equipment and storage medium
US10198613B2 (en) Latent fingerprint pattern estimation
US12189720B2 (en) Image analysis device and method, and method for generating image analysis model used for same
CN116823320A (en) A business environment data analysis and processing method, system, equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19936000

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19936000

Country of ref document: EP

Kind code of ref document: A1