WO2021114809A1 - Vehicle damage feature detection method and apparatus, computer device, and storage medium - Google Patents

Abstract

A vehicle damage feature detection method and apparatus, a computer device, and a storage medium, the method comprising: acquiring a vehicle damage image to be detected (S10) and inputting same into an unsupervised domain adaptive network model (S20); by means of a pytorch-based transfer learning model, extracting vehicle features and generating a local feature map and a global feature map (S30); on the basis of the vehicle features, outputting a transfer feature vector group and simultaneously acquiring a first adaptive feature vector group by means of a strong local feature adaptive model and acquiring a second adaptive feature vector group by means of a strong global feature adaptive model (S40); and performing regularisation processing on the transfer feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group to obtain a recognition result (S50). The present solution implements automatic recognition of damage types and damage areas in the vehicle damage image to be detected. The present solution also relates to blockchain technology; the unsupervised domain adaptive model can be stored in the blockchain.

Description

Vehicle damage feature detection method, device, computer equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on May 27, 2020, the application number is 202010462160.3, and the invention title is "Vehicle Damage Feature Detection Method, Device, Computer Equipment, and Storage Medium". The entire content is approved The reference is incorporated in this application.

Technical field

This application relates to the field of artificial intelligence image classification, and in particular to a vehicle damage feature detection method, device, computer equipment and storage medium.

Background technique

The inventor found that after a traffic accident occurs in a vehicle, some parts of the vehicle will leave traces of damage, such as damage, scratches, etc. At present, insurance companies generally manually identify the images taken by the owner or business personnel of the vehicle damage after the traffic accident , That is, to manually identify and determine the damage type and damaged area of the damaged part of the vehicle in the image. In this way, due to the influence of inconsistent standard understanding and insufficient observation experience, the artificially recognized damage type and damaged area may not match; for example: Because it is difficult to distinguish between dents and scratches through visual images, damage assessment personnel can easily determine the type of damage caused by the dent as the type of scratch damage. The miscalculation caused by the above conditions will greatly reduce the accuracy of the damage assessment; While it may cause cost losses for the insurance company, it will also reduce the satisfaction of car owners or customers; in addition, the manual loss determination workload is huge and the loss determination efficiency is low. When a certain loss determination accuracy needs to be met, Will further increase the workload and reduce work efficiency.

Summary of the invention

The present application provides a vehicle damage feature detection method, device, computer equipment, and storage medium, which realize the rapid and accurate automatic identification of the damage type and damage area corresponding to the damaged part of the vehicle in the damage image of the vehicle to be detected, which greatly reduces The process of model construction and model training have improved the accuracy and reliability of determining the type of loss and the area of the loss, and improved the efficiency of the loss.

A vehicle damage feature detection method, including:

After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.

A vehicle damage feature detection device, including:

The receiving module is configured to obtain the damage image of the vehicle to be detected after receiving the vehicle damage detection instruction; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

The input module is used to input the to-be-detected vehicle damage image into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, and a weak global feature automatic Adaptation model and regularization model;

An extraction module for extracting the vehicle features of the damage image of the vehicle to be detected through the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

The output module is configured to output a transfer feature vector set according to the vehicle characteristics through the pytorch-based transfer learning model, and at the same time obtain a first adaptive feature vector set through the strong local feature adaptive model, and use the weak global The feature adaptive model acquires a second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model acquired and output according to the first vehicle damage feature extracted from the local feature map; The second adaptive feature vector group is obtained and output by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map;

The recognition module is configured to input the migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group into the regularization model, and use the regularization model to compare the migration feature The vector group, the first adaptive feature vector group, and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result including the damage type and the damage area; the recognition result represents the damage of the vehicle to be detected The image contains the results of all damaged types and corresponding damaged areas.

A computer device includes a memory, a processor, and computer-readable instructions that are stored in the memory and can run on the processor, and the processor implements the following steps when the processor executes the computer-readable instructions:

After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.

One or more readable storage media storing computer readable instructions, when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps:

After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.

The vehicle damage feature detection method, device, computer equipment, and storage medium provided in the present application obtain the damage image of the vehicle to be detected; input the damage image of the vehicle to be detected into the unsupervised domain adaptive network model; the unsupervised domain is adaptive The network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and a regularization model; the pytorch-based migration learning model extracts the vehicle features of the damaged image of the vehicle to be detected, and all The pytorch-based transfer learning model generates a local feature map and a global feature map in the process of extracting the vehicle feature; the vehicle feature is the feature related to the vehicle after the transfer learning; the transfer learning model based on the pytorch Output the transfer feature vector group according to the vehicle characteristics, and at the same time obtain the first adaptive feature vector group through the strong local feature adaptive model, and acquire the second adaptive feature vector group through the weak global feature adaptive model; The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input to the regularization model, and the migration feature vector group and the second adaptive feature vector group are compared through the regularization model. An adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result including the damage type and the damage area. In this way, the transfer learning pytorch model and the strong local feature adaptive model are strengthened. A vehicle damage feature and weak global feature adaptive model extraction. The second vehicle damage feature framework is an unsupervised domain adaptive network model suitable for vehicle damage detection, which can quickly and accurately automatically identify the vehicle damage in the vehicle damage image to be detected The damage type and damage area corresponding to the position of, greatly reduce the process of model construction and model training, improve the accuracy and reliability of determining the type of damage and the area of damage, and improve the efficiency of damage.

The details of one or more embodiments of the present application are presented in the following drawings and description, and other features and advantages of the present application will become apparent from the description, drawings and claims.

Description of the drawings

In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments of the present application. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.

FIG. 1 is a schematic diagram of an application environment of a method for detecting a vehicle damage feature in an embodiment of the present application;

2 is a flowchart of a method for detecting damage characteristics of a vehicle in an embodiment of the present application;

3 is a flowchart of step S20 of the method for detecting damage features of a vehicle in an embodiment of the present application;

4 is a flowchart of step S20 of a method for detecting damage characteristics of a vehicle in another embodiment of the present application;

5 is a flowchart of step S40 of the method for detecting damage features of a vehicle in an embodiment of the present application;

6 is a flowchart of step S40 of the method for detecting damage features of a vehicle in another embodiment of the present application;

Fig. 7 is a schematic block diagram of a vehicle damage feature detection device in an embodiment of the present application;

FIG. 8 is a functional block diagram of the output module 14 of the vehicle damage feature detection device in an embodiment of the present application;

Fig. 9 is a schematic diagram of a computer device in an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of this application.

The vehicle damage feature detection method provided by the present application can be applied in the application environment as shown in Fig. 1, in which the client (computer equipment) communicates with the server through the network. Among them, the client (computer equipment) includes, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, cameras, and portable wearable devices. The server can be implemented as an independent server or a server cluster composed of multiple servers.

In an embodiment, as shown in FIG. 2, a vehicle damage feature detection method is provided, and the technical solution mainly includes the following steps S10-S50:

S10, after receiving the vehicle damage detection instruction, obtain a damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle.

Understandably, after the salesperson has taken the vehicle damage image of the vehicle to be detected, the vehicle damage detection instruction is triggered to obtain the vehicle damage image to be detected, and the vehicle damage image to be detected contains at least one damage to the vehicle. The image of the location, the damage includes 7 damage conditions such as scratches, scratches, dents, wrinkles, dead folds, tears, and missing. The acquisition method can be set according to requirements, for example, through the vehicle damage detection instruction The damage image of the vehicle to be detected contained in it is directly acquired, or the vehicle damage detection instruction contains a storage path for storing the damage image of the vehicle to be detected, and then it is obtained through the accessed storage path, and so on.

S20. Input the vehicle damage image to be detected into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and Regularization model.

Understandably, the unsupervised domain adaptive network model is a trained adaptive network model, and the unsupervised domain adaptive network model includes a pytorch-based transfer learning model, a strong local feature adaptive model, and a weak global feature self-adaptive model. Adaptation model and regularization model, the pytorch-based migration learning model is a neural network model that transfers a pytorch-based network structure and is trained (that is, the trained pytorch model), and the characteristics of the trained pytorch model The extraction can be selected according to requirements. For example, the trained pytorch model is a pytorch model applied to vehicle lamp brightness detection, or the trained pytorch model is a pytorch model applied to vehicle model detection, etc.; The local feature adaptive model is a trained neural network model used to strengthen the first vehicle damage feature; the weak global feature adaptive model is a trained neural network model used to extract the second vehicle damage feature; the regular The transformation model is a model that normalizes the received feature vector.

In an embodiment, as shown in FIG. 3, before step S20, that is, before inputting the damage image of the vehicle to be detected into an unsupervised domain adaptive network model, the method includes:

S201. Acquire a car damage sample set; the car damage sample set includes car damage sample images, one of the car damage sample images is associated with a damage label group; the damage label group includes at least one damage label type and at least one damage label area.

Understandably, the car damage sample set includes a plurality of the car damage sample images, the car damage sample set is a set of the car damage samples, and the car damage sample images are historically captured and contain at least one An image of the damaged location of a vehicle, one of the damaged sample images is associated with a damage label group, the damage label group includes damage label types and damage label areas, and the damage label types include scratches, scratches, dents, and wrinkles There are 7 types of damage, such as, dead-fold, tear, and missing. The damage label area is a coordinate area that can cover the damage location through a rectangular frame with a minimum area.

S202: Input the car damage sample image into an adaptive network model containing initial parameters.

Understandably, the car damage sample image is input into the adaptive network model, the adaptive network model is a deep convolutional neural network model including the initial parameters, and the initial parameters can be performed according to requirements Setting, for example, the initial parameter is a randomly preset parameter, or a preset fixed value, etc. Preferably, the initial parameter obtains all the parameters in the trained deep convolutional neural network model through migration learning.

In an embodiment, before step S202, that is, before inputting the car damage sample image into an adaptive network model containing initial parameters, the method includes:

S20201: Obtain all the migration parameters of the trained pytorch model through migration learning, and determine all the migration parameters as the initial parameters in the adaptive network model.

Understandably, the transfer learning (Transfer learning) is to transfer the model parameters that have been trained to a new model to help the new model training. Since most of the data or tasks are related, we can use transfer learning to transfer The learned model parameters are shared with the new model in a certain way to speed up and optimize the learning efficiency of the model. There is no need to start training and learning from scratch. In this way, the vehicle-related detection model can be optimized and accelerated through migration learning. The trained pytorch model selects a vehicle-related detection model according to requirements, for example: the trained pytorch model is a pytorch model applied to vehicle lamp brightness detection, or the trained pytorch model is applied to vehicle model detection The pytorch model of the pytorch model, etc., the pytorch model contains the migration parameters, the migration parameters are the parameters of the pytorch model, and all the migration parameters are determined as the initial parameters in the adaptive network model The characteristic of the pytorch model is the calculation of dynamic graphs and a simple model structure (that is, the progression from the data tensor to the abstraction level of the network), which can improve the extraction efficiency and recognition accuracy of the model.

The pytorch model completed through migration learning training in this application can quickly build the model, reduce the time for training the pytorch model, and reduce the cost.

S203: Perform training feature extraction on the car damage sample image through the adaptive network model, and obtain a training result corresponding to the car damage sample image output by the adaptive network model according to the training feature; the training feature Including the vehicle feature, the first vehicle damage feature, and the second vehicle damage feature; the training result includes at least one sample damage type and at least one sample damage area.

Understandably, the training feature includes the vehicle feature, the first vehicle damage feature, and the second vehicle damage feature, the vehicle feature is a feature related to the vehicle after migration learning, and the first vehicle The damage feature is the feature of the local texture and color depth in the image, the second vehicle damage feature is the feature of the common vector characteristics in all feature maps, and the training result includes the sample damage type and the sample damage area. One of the sample damage An area corresponds to one damage type of the sample, and one damage type of the sample can correspond to multiple damaged areas of the sample. The sample damage types include scratches, scratches, dents, folds, dead folds, tears, missing, etc. 7 A damage type, and the sample damage area is a damaged area range in the car damage sample image, that is, a rectangular coordinate range for identifying the damage position in the car damage sample image.

S204: Input all the damage label types, all the damage label regions, all the sample damage types, and all the sample damage regions corresponding to the car damage sample image into the loss model in the adaptive network model, And calculate the loss value through the loss function of the loss model.

Understandably, input all the damage label types, all the damage label areas, all the sample damage types, and all the sample damage areas corresponding to the car damage sample image into the loss in the loss model In the function, the loss value corresponding to the car damage sample image is calculated, the loss function can be set according to requirements, and the loss function is between all the damage label types and all the sample damage types The weighting function of the logarithm of the difference and the logarithm of the difference between all the damage label areas and all the sample damage areas, the loss value can be calculated through the loss function, and the loss value measures all The index of the sum of the gap between the damage label type and all the sample damage types and the gap between all the damage label areas and all the sample damage areas.

S205: When the loss value reaches a preset convergence condition, record the self-adaptive network model after convergence as an unsupervised domain self-adaptive network model, and store the unsupervised domain self-adaptive network model in a block Chain.

Understandably, the convergence condition may be a condition that the loss value is less than a set threshold, that is, when the loss value is less than a set threshold, the adaptive network model after convergence is recorded as unsupervised domain adaptation The network model, and the unsupervised domain adaptive network model is stored in the blockchain.

In an embodiment, as shown in FIG. 4, after the step S204, that is, after the loss value is calculated by the loss function of the loss model, the method further includes:

S206: When the loss value does not reach the preset convergence condition, iteratively update the initial parameters of the adaptive network model, until the loss value reaches the preset convergence condition, converge the auto The adaptive network model is recorded as an unsupervised domain adaptive network model, and the unsupervised domain adaptive network model is stored in the blockchain.

Understandably, the convergence condition may also be a condition that the value of the loss value is small and will not drop after 10,000 calculations, that is, the value of the loss value is small and does not decrease after 10,000 calculations. When it drops again, stop training, record the self-adaptive network model after convergence as an unsupervised domain-adaptive network model, and store the unsupervised domain-adaptive network model in the blockchain.

It should be emphasized that, in order to further ensure the privacy and security of the aforementioned unsupervised domain adaptive network model, the aforementioned unsupervised domain adaptive network model can also be stored in the nodes of the blockchain.

Among them, the blockchain referred to in this application is a new application mode of computer technology such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain, essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information for verification. The validity of the information (anti-counterfeiting) and the generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer. The decentralized and fully distributed DNS service provided by the blockchain can realize the query and resolution of domain names through the point-to-point data transmission service between various nodes in the network, which can be used to ensure that the operating system and firmware of an important infrastructure are not available. If it is tampered with, it can monitor the status and integrity of the software, find bad tampering, and ensure that the transmitted data has not been tampered with. Store the unsupervised domain adaptive network model in the blockchain, which can ensure the unsupervised domain The privacy and security of the adaptive network model.

In this way, when the loss value does not reach the preset convergence condition, the initial parameters of the iterative adaptive network model are continuously updated, which can continuously move closer to the accurate recognition result, and make the accuracy of the recognition result higher and higher.

This application obtains a car damage sample set; the car damage sample set includes car damage sample images, and one car damage sample image is associated with a damage label group; the damage label group includes at least one damage label type and at least one damage Label area; input the car damage sample image into an adaptive network model containing initial parameters; perform training feature extraction on the car damage sample image through the adaptive network model, and obtain the adaptive network model according to the training The training result corresponding to the car damage sample image output by the feature; the training feature includes the vehicle feature, the first vehicle damage feature, and the second vehicle damage feature; the training result includes at least one sample damage type And at least one sample damage area; input all the damage label types, all the damage label areas, all the sample damage types, and all the sample damage areas corresponding to the car damage sample image into the adaptive network model And calculate the loss value through the loss function of the loss model; when the loss value reaches the preset convergence condition, record the self-adaptive network model after convergence as an unsupervised domain self-adaptive network Model; when the loss value does not reach the preset convergence condition, iteratively update the initial parameters of the adaptive network model, until the loss value reaches the preset convergence condition, the auto after convergence The adaptive network model is recorded as an unsupervised domain adaptive network model.

In this way, it is realized that the vehicle damage sample image containing the damage label type and the damage label area is input into the adaptive network model, and the vehicle damage sample image is trained through the adaptive network model. Features (including the vehicle characteristics, the first vehicle The damage feature and the second vehicle damage feature) are extracted, the training result output by the adaptive network model is obtained, and all the damage label types and all the damage label types corresponding to the car damage sample image are obtained through the loss function in the loss model. The damage label area, all the sample damage types, and the loss value determined by all the sample damage areas are trained according to the loss value, and the adaptive network model after convergence is determined as an unsupervised domain adaptive network model, which provides A model training method for quickly identifying the damage in the car damage sample image, which improves the accuracy and reliability of determining the type of damage and the area of the damage, improves the efficiency of the damage, and shortens the training time. cost.

S30, extracting the vehicle features of the damage image of the vehicle to be detected through the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning.

Understandably, in the process of extracting the vehicle features of the vehicle damage image to be detected by the pytorch-based migration learning model, the local feature map and the global feature map are generated, and the local feature map is In the process of convolution and reduction of the vehicle damage image to be detected, a feature map output by a convolutional layer is taken as the local feature map. Preferably, a feature map output by a convolutional layer in the middle is selected as the local feature map. The feature map is because the convolutional layer in the middle range contains the feature vector of the first vehicle damage feature, that is, the local feature vector is extracted from the entire image. The global feature map is the input of the pytorch-based migration The feature map of the RPN model in the learning model, the global feature map is a feature map that convolves the to-be-detected vehicle damage image to a preset minimum size, which is convenient for extracting the second vehicle damage feature.

S40: Output a set of transfer feature vectors according to the vehicle characteristics through the pytorch-based transfer learning model, and at the same time obtain a first set of adaptive feature vectors through the strong local feature adaptive model, and adapt through the weak global feature The model acquires a second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model acquiring and outputting according to the first vehicle damage feature extracted from the local feature map; the first The second adaptive feature vector group is the weak global feature adaptive model obtained and output according to the second vehicle damage feature extracted from the global feature map.

Understandably, the first vehicle damage feature is a feature of local texture and color depth in the image, the second vehicle damage feature is a feature of a common vector characteristic in all feature maps, and the strong local feature adaptive model The function is to enhance the damage feature in the local feature map, generate useful adaptation information by extracting the first vehicle damage feature, and output the enhanced first feature vector, that is, extract the first adaptive feature vector Group; the function of the weak global feature adaptive model is to extract the second vehicle damage feature from the weaker feature vectors in all the global feature maps, prevent overfitting, and generate a second feature vector, namely The second adaptive feature vector group is extracted.

In an embodiment, as shown in FIG. 5, in the step S40, the strong local feature adaptive model extracts the first vehicle damage feature from the local feature map, and the strong local feature adaptive model Outputting a first adaptive feature vector group according to the first vehicle damage feature includes:

S401. Input the local feature map into a local convolution layer in the strong local feature adaptive model, and extract the first vehicle damage feature in the local feature map through the local convolution layer to obtain a local feature Vector illustration.

Understandably, the local convolutional layer includes a first convolutional layer, a second convolutional layer, and a third convolutional layer. Preferably, the first convolutional layer includes a 3×3×512 convolution kernel and The first convolution with a step size of 2, a first filling layer filled with 1, a first batch normalization module (batch normalization), a first activation module (ReLU) and a first dropout module (dropout), so The second convolutional layer includes a 3×3×128 convolution kernel and a second convolution with a step size of 2, a second filling layer filled with 1, a second batch of normalization modules (batch normalization), and a first Two activation modules and a second dropout module. The third convolutional layer includes a 3×3×128 convolution kernel and a third convolution with a step size of 2, and a third filling layer filled with 1 , A third batch of normalization module (batch normalization), a third activation module and a third dropout module (dropout).

Wherein, the first vehicle damage feature is a local texture and color depth feature in the image, and the first vehicle damage feature extraction is performed on the local feature map through the first convolutional layer, and the local The feature map is processed to reduce the dimensionality of the feature map and expand the number of channels of the feature map to obtain a first convolutional feature map, input the first convolutional feature map to the second convolutional layer, and pass the second convolution The layer performs the first vehicle damage feature extraction on the first convolution feature map, and performs processing on the first convolution feature map to reduce the dimension of the feature map and expand the number of channels of the feature map to obtain the second convolution A feature map, the second convolution feature map is input to the third convolution layer, and the first vehicle damage feature extraction is performed on the second convolution feature map through the third convolution layer, and The second convolution feature map is processed to reduce the dimension of the feature map and expand the number of channels of the feature map to obtain the local feature vector map. The dimension of the local feature vector map is less than the dimension of the local feature map, so The number of channels of the local feature vector map is more than the number of channels of the local feature map.

S402: Input the local feature vector graph to a pooling layer in the strong local feature adaptive model, and perform pooling processing on the local feature vector graph through the pooling layer to obtain a local pooling matrix.

Understandably, the method of pooling treatment can be set according to requirements. For example, the pooling treatment can be average pooling or maximum pooling, etc. The function of the pooling treatment is to affect the local characteristics. Vector graph dimensionality reduction processing, the local pooling matrix is a one-dimensional matrix array.

S403: Input the local pooling matrix into a fully connected layer in the strong local feature adaptive model, and perform feature connections on the local pooling matrix through the fully connected layer to obtain a local connected matrix.

Understandably, the feature connection is to map the obtained feature vector value to the position of the sample label space, and perform weighted summation, connect these feature vectors, and feature the local pooling matrix through the fully connected layer Connect to obtain the local connection matrix, and the local connection matrix is a sorted one-dimensional matrix array. For example: convolve through 300 1×1 convolution kernels and connect them into a one-dimensional group of 300 vectors.

S404. Input the local connection matrix to the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first adaptive feature corresponding to the local feature map Vector set.

Understandably, the regression processing is to perform a normalization operation after weighting the input to obtain the score of each category, and then through the process of softmax mapping to probability, the Softmax layer predicts and classifies the local connection matrix Obtain the first adaptive feature vector group.

In this application, the local feature map is input into the local convolutional layer, and the first vehicle damage feature in the local feature map is extracted through the local convolution layer to obtain a local feature vector map; The feature vector graph is input to the pooling layer, and the local feature vector graph is pooled by the pooling layer to obtain a local pooling matrix; the local pooling matrix is input to the fully connected layer, and the local pooling matrix is input to the fully connected layer. The fully connected layer performs feature connection on the local pooling matrix to obtain a local connection matrix; input the local connection matrix to the Softmax layer, and perform regression processing on the local connection matrix through the Softmax layer to obtain the The first adaptive feature vector group corresponding to the local feature map.

In this way, it is achieved to enhance the characteristics of damage in the local feature map, facilitate the extraction of useful first vehicle damage features, provide the function of the first adaptive feature vector group, and improve the determination of the type of damage and the area of the damage. The accuracy and reliability of the system improve the efficiency of loss determination.

In one embodiment, as shown in FIG. 6, in the step S40, the weak global feature adaptive model extracts the second vehicle damage feature from the global feature map, and the global feature adaptive model is based on The second vehicle damage feature outputting a second adaptive feature vector group includes:

S405. Input the global feature map to the first global convolutional layer in the weak global feature adaptive model, and extract the second vehicle damage feature of the global feature map through the first global convolution layer to obtain the global Feature vector diagram.

Understandably, the global convolutional layer includes a first global convolutional layer, a second global convolutional layer, and a third global convolutional layer. Preferably, the first global convolutional layer includes a 1×1×256 Convolution kernel and a first global convolution with a step size of 2, a first global filling layer filled with 0, and a first global activation module. The first global convolution layer includes a 1×1×128 convolution Kernel and a second global convolution with a step size of 2, a second global filling layer filled with 0, and a second global activation module. The third global convolution layer includes a 1×1×1 convolution kernel and A third global convolution with a step size of 1 and a third global filling layer filled with 0.

Wherein, the second vehicle damage feature is a feature of a common vector characteristic (also called a commonality) in all feature maps, and the second vehicle damage feature is performed on the global feature map through the first global convolution layer. Extraction, that is, extract the feature vector of the common vector feature from the global feature map to obtain the first global convolution feature map, input the first global convolution feature map to the second global convolution layer, and pass the The second global convolution layer performs the second vehicle damage feature extraction on the first global convolution feature map to obtain a second global convolution feature map, and inputting the second global convolution feature map to the first Three global convolutional layers, the second global convolution feature map is subjected to the second vehicle damage feature extraction through the third global convolutional layer to obtain the global feature vector map, and the second vehicle is extracted In the process of damaging features, the first global filling layer, the second global filling layer, and the third global filling layer are used to prevent interference by introducing common features, but can be filled to a preset size.

S406. Input the global feature vector graph to the Sigmoid activation layer in the weak global feature adaptive model, and perform activation processing on the global feature vector through the Sigmoid activation layer to obtain a second corresponding to the global feature map. Adaptive feature vector group.

Understandably, the Sigmoid activation layer uses a Sigmoid function as the last layer in the weak global feature adaptive model, and the Sigmoid function is a function that activates and classifies the global feature vector. The activation process is a process of mapping a vector with a value of (-∞, +∞) to a range of (0, 1) through the Sigmoid function, thereby obtaining the second adaptive feature vector group.

In the present application, the global feature map is input into the first global convolutional layer, and the second vehicle damage feature of the global feature map is extracted through the first global convolution layer to obtain a global feature vector map; The global feature vector map is input to the Sigmoid activation layer, and the global feature vector is activated through the Sigmoid activation layer to obtain a second adaptive feature vector group corresponding to the global feature map.

In this way, the second vehicle damage feature is extracted from the weaker feature vectors in all the global feature maps to prevent overfitting, extract high-quality second vehicle damage features, and provide second adaptation The function of the feature vector group improves the accuracy and reliability of recognition.

S50. Input the migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group into the regularization model, and use the regularization model to compare the migration feature vector group, The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result including the damage type and the damage area; the recognition result indicates that the damage image of the vehicle to be detected contains The result of all damaged types and corresponding damaged areas.

Understandably, the regularization process is regularization, that is, to increase rule restrictions, constrain optimization parameters, and prevent obvious features from being infinitely magnified to cause weakened features to be erased. The damage types include scratches, scratches, dents, and dents. There are 7 types of damage, including wrinkles, dead-folds, tears, and missing. The damage area is the area of the damaged position in the damaged image of the vehicle to be detected, that is, the distance of the damaged position relative to the damaged image of the vehicle to be detected. The full set of coordinate ranges. One damage area corresponds to one damage type, and one damage type can correspond to multiple damage areas. In this way, after inputting the damage image of the vehicle to be detected, all damaged areas can be automatically identified Type, and the range of the damaged area corresponding to the type of damage.

This application obtains the damage image of the vehicle to be detected; inputs the damage image of the vehicle to be detected into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model and a strong local feature adaptive model , Weak global feature adaptive model and regularization model; the pytorch-based migration learning model extracts the vehicle features of the vehicle damage image to be detected, and the pytorch-based migration learning model extracts the vehicle features in the process, A local feature map and a global feature map are generated; the vehicle feature is the feature related to the vehicle after the transfer learning; the transfer learning model based on pytorch outputs the transfer feature vector group according to the vehicle feature, and at the same time passes the strong The local feature adaptive model acquires the first adaptive feature vector group, and the second adaptive feature vector group is acquired through the weak global feature adaptive model; the transfer feature vector group and the first adaptive feature vector group are combined And the second adaptive feature vector group is input into the regularization model, and the migration feature vector group, the first adaptive feature vector group and the second adaptive feature vector group are The regularization process is performed to obtain the recognition result including the damage type and the damage area.

In this way, an unsupervised domain adaptive network model suitable for vehicle damage detection is realized through the transfer learning pytorch model, the strong local feature adaptive model to strengthen the first vehicle damage feature and the weak global feature adaptive model to extract the second vehicle damage feature framework , It can quickly and accurately automatically identify the damage type and damage area corresponding to the damaged part of the vehicle in the damage image of the vehicle to be detected, greatly reducing the process of model construction and model training, and improving the type and damage assessment The accuracy and reliability of the area determination improves the efficiency of loss determination.

In one embodiment, a vehicle damage feature detection device is provided, and the vehicle damage feature detection device corresponds to the vehicle damage feature detection method in the above-mentioned embodiment in a one-to-one correspondence. As shown in FIG. 7, the vehicle damage feature detection device includes a receiving module 11, an input module 12, an extraction module 13, an output module 14 and an identification module 15. The detailed description of each functional module is as follows:

The receiving module 11 is configured to obtain a damage image of the vehicle to be detected after receiving a vehicle damage detection instruction; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

The input module 12 is used to input the to-be-detected vehicle damage image into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, and a weak global feature Adaptive model and regularization model;

The extraction module 13 is used to extract the vehicle features of the damaged image of the vehicle to be detected through the pytorch-based migration learning model and generate a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning ；

The output module 14 is configured to output a transfer feature vector set according to the vehicle characteristics through the pytorch-based transfer learning model, and at the same time obtain a first adaptive feature vector set through the strong local feature adaptive model, and use the weak The global feature adaptive model acquires a second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model acquired and output according to the first vehicle damage feature extracted from the local feature map The second adaptive feature vector group is the weak global feature adaptive model obtained and output according to the second vehicle damage feature extracted from the global feature map;

The recognition module 15 is configured to input the migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group into the regularization model, and use the regularization model to analyze the migration The feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result including the damage type and the damage area; the recognition result represents the vehicle to be detected The damage image contains the results of all damaged types and corresponding damaged areas.

In an embodiment, as shown in FIG. 8, the output module 14 includes:

The convolution unit 41 is configured to input the local feature map into a local convolution layer in the strong local feature adaptive model, and extract the first vehicle damage in the local feature map through the local convolution layer Feature, get the local feature vector diagram;

The pooling unit 42 is configured to input the local feature vector map into the pooling layer in the strong local feature adaptive model, and perform pooling processing on the local feature vector map through the pooling layer to obtain a local pool Matrix

The fully connected unit 43 is configured to input the local pooling matrix into the fully connected layer in the strong local feature adaptive model, and perform feature connection on the local pooling matrix through the fully connected layer to obtain a local connected matrix ；

The regression unit 44 is configured to input the local connection matrix into the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first local feature map corresponding to the local feature map. An adaptive feature vector group.

For the specific definition of the vehicle damage feature detection device, please refer to the above definition of the vehicle damage feature detection method, which will not be repeated here. Each module in the above-mentioned vehicle damage feature detection device can be implemented in whole or in part by software, hardware, and a combination thereof. The above-mentioned modules may be embedded in the form of hardware or independent of the processor in the computer equipment, or may be stored in the memory of the computer equipment in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned modules.

In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. 9. The computer equipment includes a processor, a memory, a network interface, and a database connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a readable storage medium and an internal memory. The readable storage medium stores an operating system, computer readable instructions, and a database. The internal memory provides an environment for the operation of the operating system and computer readable instructions in the readable storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer-readable instruction is executed by the processor, a method for detecting damage characteristics of a vehicle is realized. The readable storage medium provided in this embodiment includes a non-volatile readable storage medium and a volatile readable storage medium.

In one embodiment, a computer device is provided, including a memory, a processor, and computer-readable instructions stored in the memory and capable of running on the processor. When the processor executes the computer-readable instructions, the vehicle in the foregoing embodiment is implemented. Damage feature detection method.

In one embodiment, one or more readable storage media storing computer readable instructions are provided. The readable storage media provided in this embodiment include non-volatile readable storage media and volatile readable storage. Medium; the readable storage medium stores computer readable instructions, and when the computer readable instructions are executed by one or more processors, the one or more processors implement the vehicle damage feature detection method in the foregoing embodiment.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage. In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database, or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

The blockchain referred to in this application is a new application mode of computer technology such as distributed data storage, point-to-point transmission, consensus mechanism, and encryption algorithm. Blockchain, essentially a decentralized database, is a series of data blocks associated with cryptographic methods. Each data block contains a batch of network transaction information for verification. The validity of the information (anti-counterfeiting) and the generation of the next block. The blockchain can include the underlying platform of the blockchain, the platform product service layer, and the application service layer.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the above functional units and modules is used as an example. In practical applications, the above functions can be allocated to different functional units and modules as needed. Module completion, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims (20)

1. A vehicle damage feature detection method, which includes:

   After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

   The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

   Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

   The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

   The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.
2. 5. The vehicle damage feature detection method according to claim 1, wherein before inputting the damage image of the vehicle to be detected into an unsupervised domain adaptive network model, the method comprises:

   Acquiring a car damage sample set; the car damage sample set includes car damage sample images, one of the car damage sample images is associated with a damage label group; the damage label group includes at least one damage label type and at least one damage label area;

   Input the car damage sample image into an adaptive network model containing initial parameters;

   Perform training feature extraction on the car damage sample image through the adaptive network model, and obtain the training result corresponding to the car damage sample image output by the adaptive network model according to the training feature; the training feature includes all The vehicle characteristics, the first vehicle damage feature, and the second vehicle damage feature; the training result includes at least one sample damage type and at least one sample damage area;

   Input all the damage label types, all the damage label areas, all the sample damage types, and all the sample damage areas corresponding to the car damage sample image into the loss model in the adaptive network model, and pass The loss function of the loss model calculates the loss value;

   When the loss value reaches a preset convergence condition, the self-adaptive network model after convergence is recorded as an unsupervised domain self-adaptive network model, and the unsupervised domain self-adaptive network model is stored in the blockchain .
3. 5. The vehicle damage feature detection method according to claim 2, wherein after calculating the loss value through the loss function of the loss model, the method further comprises:

   When the loss value does not reach the preset convergence condition, iteratively update the initial parameters of the adaptive network model, until the loss value reaches the preset convergence condition, the adaptive network after convergence The model is recorded as an unsupervised domain adaptive network model, and the unsupervised domain adaptive network model is stored in the blockchain.
4. 3. The vehicle damage feature detection method according to claim 2, wherein, before inputting the sample image of the vehicle damage into an adaptive network model containing initial parameters, the method comprises:

   Through migration learning, all migration parameters of the trained pytorch model are acquired, and all the migration parameters are determined as the initial parameters in the adaptive network model.
5. The vehicle damage feature detection method according to claim 1, wherein the strong local feature adaptive model extracts the first vehicle damage feature from the local feature map, and the strong local feature adaptive model is based on the first vehicle damage feature. A vehicle damage feature outputs the first adaptive feature vector group, including:

   The local feature map is input to the local convolution layer in the strong local feature adaptive model, and the first vehicle damage feature in the local feature map is extracted through the local convolution layer to obtain a local feature vector map ；

   Inputting the local feature vector graph to a pooling layer in the strong local feature adaptive model, and performing pooling processing on the local feature vector graph through the pooling layer to obtain a local pooling matrix;

   Inputting the local pooling matrix into a fully connected layer in the strong local feature adaptive model, and performing feature connections on the local pooling matrix through the fully connected layer to obtain a local connected matrix;

   Input the local connection matrix into the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first adaptive feature vector group corresponding to the local feature map .
6. The vehicle damage feature detection method according to claim 1, wherein the weak global feature adaptive model extracts a second vehicle damage feature from the global feature map, and the global feature adaptive model is based on the second The vehicle damage feature outputs the second adaptive feature vector group, including:

   The global feature map is input into the first global convolution layer in the weak global feature adaptive model, and the second vehicle damage feature of the global feature map is extracted through the first global convolution layer to obtain a global feature vector Figure;

   The global feature vector graph is input into the Sigmoid activation layer in the weak global feature adaptive model, and the global feature vector is activated through the Sigmoid activation layer to obtain the second adaptive corresponding to the global feature map Feature vector group.
7. A vehicle damage feature detection device, which includes:

   The receiving module is configured to obtain the damage image of the vehicle to be detected after receiving the vehicle damage detection instruction; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

   The input module is used to input the to-be-detected vehicle damage image into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, and a weak global feature automatic Adaptation model and regularization model;

   An extraction module for extracting the vehicle features of the damage image of the vehicle to be detected through the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

   The output module is configured to output a transfer feature vector set according to the vehicle characteristics through the pytorch-based transfer learning model, and at the same time obtain a first adaptive feature vector set through the strong local feature adaptive model, and use the weak global The feature adaptive model acquires a second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model acquired and output according to the first vehicle damage feature extracted from the local feature map; The second adaptive feature vector group is obtained and output by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map;

   The recognition module is configured to input the migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group into the regularization model, and use the regularization model to compare the migration feature The vector group, the first adaptive feature vector group, and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result including the damage type and the damage area; the recognition result represents the damage of the vehicle to be detected The image contains the results of all damaged types and corresponding damaged areas.
8. 8. The vehicle damage feature detection device according to claim 7, wherein the output module comprises:

   A convolution unit, configured to input the local feature map into a local convolution layer in the strong local feature adaptive model, and extract the first vehicle damage feature in the local feature map through the local convolution layer , Get the local feature vector diagram;

   The pooling unit is configured to input the local feature vector map into the pooling layer in the strong local feature adaptive model, and perform pooling processing on the local feature vector map through the pooling layer to obtain local pooling matrix;

   A fully connected unit, configured to input the local pooling matrix into a fully connected layer in the strong local feature adaptive model, and perform feature connection on the local pooling matrix through the fully connected layer to obtain a local connected matrix;

   The regression unit is configured to input the local connection matrix into the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first corresponding to the local feature map. Adaptive feature vector group.
9. A computer device includes a memory, a processor, and computer-readable instructions that are stored in the memory and can run on the processor, wherein the processor implements the following steps when the processor executes the computer-readable instructions:

   After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

   The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

   Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

   The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

   The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.
10. 9. The computer device according to claim 9, wherein before the input of the vehicle damage image to be detected into the unsupervised domain adaptive network model, the processor further implements the following steps when executing the computer readable instruction:

    Acquiring a car damage sample set; the car damage sample set includes car damage sample images, one of the car damage sample images is associated with a damage label group; the damage label group includes at least one damage label type and at least one damage label area;

    Input the car damage sample image into an adaptive network model containing initial parameters;

    Perform training feature extraction on the car damage sample image through the adaptive network model, and obtain the training result corresponding to the car damage sample image output by the adaptive network model according to the training feature; the training feature includes all The vehicle characteristics, the first vehicle damage feature, and the second vehicle damage feature; the training result includes at least one sample damage type and at least one sample damage area;

    Input all the damage label types, all the damage label areas, all the sample damage types, and all the sample damage areas corresponding to the car damage sample image into the loss model in the adaptive network model, and pass The loss function of the loss model calculates the loss value;

    When the loss value reaches a preset convergence condition, the self-adaptive network model after convergence is recorded as an unsupervised domain self-adaptive network model, and the unsupervised domain self-adaptive network model is stored in the blockchain .
11. 10. The computer device according to claim 10, wherein after the loss value is calculated by the loss function of the loss model, the processor further implements the following steps when executing the computer readable instruction:

    When the loss value does not reach the preset convergence condition, iteratively update the initial parameters of the adaptive network model, until the loss value reaches the preset convergence condition, the adaptive network after convergence The model is recorded as an unsupervised domain adaptive network model, and the unsupervised domain adaptive network model is stored in the blockchain.
12. The computer device according to claim 10, wherein, before the input of the car damage sample image into the adaptive network model containing initial parameters, the processor further implements the following steps when executing the computer-readable instructions:

    Through migration learning, all migration parameters of the trained pytorch model are acquired, and all the migration parameters are determined as the initial parameters in the adaptive network model.
13. The computer device according to claim 9, wherein the strong local feature adaptive model extracts the first vehicle damage feature from the local feature map, and the strong local feature adaptive model extracts the first vehicle damage feature according to the first vehicle damage The feature outputs the first adaptive feature vector group, including:

    The local feature map is input into the local convolution layer in the strong local feature adaptive model, and the first vehicle damage feature in the local feature map is extracted through the local convolution layer to obtain a local feature vector map ；

    Inputting the local feature vector graph to a pooling layer in the strong local feature adaptive model, and performing pooling processing on the local feature vector graph through the pooling layer to obtain a local pooling matrix;

    Inputting the local pooling matrix into a fully connected layer in the strong local feature adaptive model, and performing feature connections on the local pooling matrix through the fully connected layer to obtain a local connected matrix;

    Input the local connection matrix into the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first adaptive feature vector group corresponding to the local feature map .
14. The computer device according to claim 9, wherein the weak global feature adaptive model extracts a second vehicle damage feature from the global feature map, and the global feature adaptive model is based on the second vehicle damage feature Output the second adaptive feature vector group, including:

    The global feature map is input into the first global convolution layer in the weak global feature adaptive model, and the second vehicle damage feature of the global feature map is extracted through the first global convolution layer to obtain a global feature vector Figure;

    The global feature vector graph is input into the Sigmoid activation layer in the weak global feature adaptive model, and the global feature vector is activated through the Sigmoid activation layer to obtain the second adaptive corresponding to the global feature map Feature vector group.
15. One or more readable storage media storing computer readable instructions, where when the computer readable instructions are executed by one or more processors, the one or more processors execute the following steps:

    After receiving the vehicle damage detection instruction, obtain the damage image of the vehicle to be detected; the damage image of the vehicle to be detected includes at least one image of the damaged location of the vehicle;

    The vehicle damage image to be detected is input into an unsupervised domain adaptive network model; the unsupervised domain adaptive network model includes a pytorch-based migration learning model, a strong local feature adaptive model, a weak global feature adaptive model, and regularization model;

    Extracting the vehicle features of the damage image of the vehicle to be detected by the pytorch-based migration learning model and generating a local feature map and a global feature map; the vehicle features are features related to the vehicle after the migration learning;

    The pytorch-based migration learning model outputs a migration feature vector group according to the vehicle characteristics, and at the same time, a first adaptive feature vector group is acquired through the strong local feature adaptive model, and acquired through the weak global feature adaptive model The second adaptive feature vector group; the first adaptive feature vector group is the strong local feature adaptive model obtained and output according to the first vehicle damage feature extracted from the local feature map; the second self The adaptive feature vector group is obtained by the weak global feature adaptive model according to the second vehicle damage feature extracted from the global feature map and output;

    The migration feature vector group, the first adaptive feature vector group, and the second adaptive feature vector group are input into the regularization model, and the migration feature vector group, the The first adaptive feature vector group and the second adaptive feature vector group are subjected to regularization processing to obtain a recognition result that includes the damage type and the damage area; the recognition result represents that the damage image of the vehicle to be detected contains all the damaged images. The type of damage and the result of the corresponding damage area.
16. The readable storage medium according to claim 15, wherein, before the input of the vehicle damage image to be detected into the unsupervised domain adaptive network model, when the computer-readable instructions are executed by one or more processors, So that the one or more processors further execute the following steps:

    Acquiring a car damage sample set; the car damage sample set includes car damage sample images, one of the car damage sample images is associated with a damage label group; the damage label group includes at least one damage label type and at least one damage label area;

    Input the car damage sample image into an adaptive network model containing initial parameters;

    Perform training feature extraction on the car damage sample image through the adaptive network model, and obtain the training result corresponding to the car damage sample image output by the adaptive network model according to the training feature; the training feature includes all The vehicle characteristics, the first vehicle damage feature, and the second vehicle damage feature; the training result includes at least one sample damage type and at least one sample damage area;

    Input all the damage label types, all the damage label areas, all the sample damage types, and all the sample damage areas corresponding to the car damage sample image into the loss model in the adaptive network model, and pass The loss function of the loss model calculates the loss value;

    When the loss value reaches a preset convergence condition, the self-adaptive network model after convergence is recorded as an unsupervised domain self-adaptive network model, and the unsupervised domain self-adaptive network model is stored in the blockchain .
17. The readable storage medium according to claim 16, wherein after the loss value is calculated by the loss function of the loss model, when the computer readable instruction is executed by one or more processors, the one Or multiple processors also perform the following steps:

    When the loss value does not reach the preset convergence condition, iteratively update the initial parameters of the adaptive network model, until the loss value reaches the preset convergence condition, the adaptive network after convergence The model is recorded as an unsupervised domain adaptive network model, and the unsupervised domain adaptive network model is stored in the blockchain.
18. The readable storage medium according to claim 16, wherein, before the input of the car damage sample image into the adaptive network model containing initial parameters, when the computer-readable instructions are executed by one or more processors, So that the one or more processors further execute the following steps:

    Through migration learning, all migration parameters of the trained pytorch model are acquired, and all the migration parameters are determined as the initial parameters in the adaptive network model.
19. The readable storage medium of claim 15, wherein the strong local feature adaptive model extracts a first vehicle damage feature from the local feature map, and the strong local feature adaptive model is based on the first The vehicle damage feature outputs the first adaptive feature vector group, including:

    The local feature map is input into the local convolution layer in the strong local feature adaptive model, and the first vehicle damage feature in the local feature map is extracted through the local convolution layer to obtain a local feature vector map ；

    Inputting the local feature vector graph to a pooling layer in the strong local feature adaptive model, and performing pooling processing on the local feature vector graph through the pooling layer to obtain a local pooling matrix;

    Inputting the local pooling matrix into a fully connected layer in the strong local feature adaptive model, and performing feature connections on the local pooling matrix through the fully connected layer to obtain a local connected matrix;

    Input the local connection matrix into the Softmax layer in the strong local feature adaptive model, and perform regression processing on the local connection matrix through the Softmax layer to obtain the first adaptive feature vector group corresponding to the local feature map .
20. The readable storage medium of claim 15, wherein the weak global feature adaptive model extracts a second vehicle damage feature from the global feature map, and the global feature adaptive model is based on the second vehicle The damage feature outputs the second adaptive feature vector group, including:

    The global feature map is input into the first global convolution layer in the weak global feature adaptive model, and the second vehicle damage feature of the global feature map is extracted through the first global convolution layer to obtain a global feature vector Figure;

    The global feature vector graph is input into the Sigmoid activation layer in the weak global feature adaptive model, and the global feature vector is activated through the Sigmoid activation layer to obtain the second adaptive corresponding to the global feature map Feature vector group.

Images