WO2018166116A1 - Car damage recognition method, electronic apparatus and computer-readable storage medium - Google Patents

Car damage recognition method, electronic apparatus and computer-readable storage medium Download PDF

Info

Publication number
WO2018166116A1
WO2018166116A1 PCT/CN2017/091373 CN2017091373W WO2018166116A1 WO 2018166116 A1 WO2018166116 A1 WO 2018166116A1 CN 2017091373 W CN2017091373 W CN 2017091373W WO 2018166116 A1 WO2018166116 A1 WO 2018166116A1
Authority
WO
WIPO (PCT)
Prior art keywords
preset
vehicle damage
terminal
damage
car
Prior art date
Application number
PCT/CN2017/091373
Other languages
French (fr)
Chinese (zh)
Inventor
黄章成
马进
王健宗
肖京
Original Assignee
平安科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 平安科技(深圳)有限公司 filed Critical 平安科技(深圳)有限公司
Publication of WO2018166116A1 publication Critical patent/WO2018166116A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/08Insurance

Definitions

  • the present invention relates to the field of computer technologies, and in particular, to a vehicle damage recognition method, an electronic device, and a computer readable storage medium.
  • the main object of the present invention is to provide a vehicle damage recognition method, an electronic device and a computer readable storage medium, which aim to improve the accuracy and recall rate of vehicle damage recognition.
  • the first method of the present application provides a vehicle damage recognition method, and the method includes the following steps:
  • the server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
  • the first predetermined type model is used to analyze the determined loss photo again.
  • a second aspect of the present application provides a server, including a processing device and a storage device connected to the processing device, the storage device storing a vehicle damage recognition system, the vehicle damage recognition system including at least one computer readable instruction, the at least one Computer readable instructions are executable by the processing device to:
  • the server receives a fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the corresponding loss photo.
  • the first vehicle damage part classification information and returning the first vehicle damage part classification information to the first terminal for display;
  • the first predetermined type model is used to analyze the determined loss photo again.
  • a third aspect of the present application provides a computer readable storage medium having stored thereon at least one computer readable instruction executable by a processing device to:
  • the server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
  • the first predetermined type model is used to analyze the determined loss photo again.
  • the first loss type photo is analyzed by the preset first preset type model to obtain the first vehicle damage part classification information, and if the user denies the first vehicle damage part classification information, the preset first The preset type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, and if the user denies the second vehicle damage part classification information, sends the fixed loss photo to the predetermined second terminal.
  • Manual identification of the vehicle damage location to manually identify the vehicle damage location. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources.
  • the vehicle damage portion when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
  • FIG. 1 is a schematic diagram of an application environment of an embodiment of a vehicle damage recognition method according to the present invention
  • FIG. 2 is a schematic flow chart of a first embodiment of a vehicle damage recognition method according to the present invention
  • FIG. 3 is a schematic flow chart of a second embodiment of a vehicle damage recognition method according to the present invention.
  • FIG. 4 is a schematic diagram of functional modules of a first embodiment of a vehicle damage recognition system according to the present invention.
  • FIG. 5 is a schematic diagram of functional modules of a second embodiment of the vehicle damage recognition system of the present invention.
  • the invention provides a vehicle damage recognition method.
  • FIG. 1 it is a schematic diagram of an application environment of an embodiment of a vehicle damage recognition method according to the present invention.
  • the application environment diagram includes a server 1 and a terminal device 2.
  • the server 1 can perform data interaction with the terminal device 2 through a suitable technology such as a network or a near field communication technology.
  • the terminal device 2 includes, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, or an individual.
  • PDA Personal Digital Assistant
  • game console Internet Protocol Television (IPTV)
  • smart wearable device etc.
  • the server 1 is a device capable of automatically performing numerical calculation and/or information processing in accordance with an instruction set or stored in advance.
  • the server 1 may be a computer, a single network server, a server group composed of a plurality of network servers, or a cloud-based cloud composed of a large number of hosts or network servers, wherein the cloud computing is a kind of distributed computing, and is loosely distributed by a group.
  • a super virtual computer consisting of a set of coupled computers.
  • the server 1 includes, but is not limited to, a storage device 11, a processing device 12, and a network interface 13 that are communicably connected to each other through a system bus. It is pointed out that Figure 1 only shows the server 1 with the components 11-13, but it should be understood that not all illustrated components are required to be implemented, and more or fewer components may be implemented instead.
  • the storage device 11 includes a memory and at least one type of readable storage medium.
  • the memory provides a cache for the operation of the server 1;
  • the readable storage medium may be a non-volatile storage medium such as a flash memory, a hard disk, a multimedia card, a card type memory, or the like.
  • the readable storage medium may be an internal storage unit of the server 1, such as a hard disk of the server 1; in other embodiments, the non-volatile storage medium may also be an external storage device of the server 1, For example, a plug-in hard disk provided on the server 1, a smart memory card (SMC), a Secure Digital (SD) card, a flash card, and the like.
  • SMC smart memory card
  • SD Secure Digital
  • the readable storage medium of the storage device 11 is generally used to store an operating system installed on the server 1 and various types of application software, such as program codes of the vehicle damage recognition system 10 in an embodiment of the present application. Further, the storage device 11 can also be used to temporarily store various types of data that have been output or are to be output.
  • Processing device 12 may, in some embodiments, include one or more microprocessors, microcontrollers, Digital processor, etc.
  • the processing device 12 is typically used to control the operation of the server 1, such as performing control and processing related to data interaction or communication with the terminal device 2.
  • the processing device 12 is configured to run program code or process data stored in the storage device 11, such as running the vehicle damage recognition system 10 and the like.
  • the network interface 13 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the server 1 and other electronic devices.
  • the network interface 13 is mainly used to connect the server 1 with one or more terminal devices 2, and establish a data transmission channel and a communication connection between the server 1 and one or more terminal devices 2.
  • the vehicle damage recognition system 10 is stored in the storage device 11 and includes at least one computer readable instructions executable by the processing device 12 to implement the control response area display control method of various embodiments of the present application. As described later, the at least one computer readable instruction can be classified into different logic modules depending on the functions implemented by its various parts.
  • the vehicle damage recognition system 10 when executed by the processing device 12, the following operations are performed: receiving a loss request including a fixed loss photo sent by the user through the first terminal, using a preset first preset type model pair The determined loss photo is analyzed to obtain the first vehicle damage part classification information corresponding to the fixed loss photo, and the first vehicle damage part classification information is returned to the first terminal for display; if the user receives the user pass The rejecting instruction of the first vehicle damage part classification information sent by the first terminal is used to analyze the fixed loss photo by using a preset first preset type model to obtain a corresponding corresponding to the fixed loss photo.
  • FIG. 2 is a schematic flow chart of a first embodiment of a vehicle damage recognition method according to the present invention.
  • the vehicle damage recognition method includes:
  • Step S10 The vehicle damage recognition system receives a fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the fixed loss photo corresponding to The first vehicle damage part classification information, and returning the first vehicle damage part classification information to the first terminal for display.
  • the server receives, by the first terminal (for example, a mobile phone, a tablet computer, a handheld device, etc.), a fixed-loss photo including a user-supplied part including a to-be-damaged car damage location (for example, a close-up photo of a car damage part). ) The loss request.
  • the auto insurance claim application APP may be pre-installed in the first terminal, the user opens the auto insurance claim application APP and sends a loss request to the server through the auto insurance claim application APP; in another embodiment A browser system is pre-installed in the first terminal, and the user can access the server through the browser system, and send a loss request to the server through the browser system.
  • the server After receiving the loss request including the loss-receiving photo sent by the user, the server analyzes the acquired fixed-loss photo by using the pre-generated first preset type model to analyze the first vehicle damage corresponding to the fixed-loss photo.
  • Part classification information for example, front, side, rear, overall, etc.
  • the first vehicle damage part classification information is returned to the first terminal and displayed on a predetermined operation interface of the first terminal (for example, the analyzed first vehicle damage part classification information is returned to the first terminal
  • the auto insurance claim application APP is displayed on the operation interface generated by the auto insurance claim application APP).
  • Step S20 If receiving the rejection instruction of the first vehicle loss location classification information sent by the first terminal, the method further analyzes the fixed loss photo by using a preset first preset type model. The second vehicle damage part classification information corresponding to the fixed loss photograph is obtained, and the second vehicle damage part classification information is returned to the first terminal for display.
  • the server may receive an instruction sent by the user by using a button, a touch, a press, a shaking, a mobile phone, a fingerprint, or the like, such as displaying the first on a predetermined operation interface of the first terminal.
  • the user may send feedback information about the classification information of the first vehicle damage part to the server by long pressing the first terminal screen or short pressing the first terminal screen, such as a confirmation instruction or a rejection instruction.
  • the user sends the feedback information to the server in the manner that the user clicks the button on the first terminal.
  • the predetermined operation interface of the first terminal includes a vehicle damage part classification information display area, a vehicle damage part classification information confirmation button, and a vehicle damage part classification information rejection button; if the user confirms the vehicle by using the vehicle damage part classification information confirmation button If the first vehicle damage part classification information is described, the server ends the vehicle damage part identification process, or if the user rejects the first vehicle damage part classification information through the vehicle damage part classification information rejection button, the server reuses the generated information.
  • the first preset type model analyzes the acquired fixed loss photo to analyze the second vehicle damage part classification information corresponding to the fixed loss photo, and the second vehicle damage part classification information is the first preset type model pair
  • the obtained vehicle damage part classification information may be the same as the first vehicle damage part classification information, or may be different from the first vehicle damage part classification information.
  • the analyzed second vehicle damage part classification information is returned to the first terminal and displayed on a predetermined operation interface of the first terminal.
  • Step S30 if receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal The instructions to manually identify the damage location.
  • the server ends the vehicle damage part identification process, or if the user rejects the vehicle through the vehicle damage part classification information rejection button
  • the second vehicle damage part classification information is sent to the predetermined second terminal (for example, the terminal of the vehicle risk determination personnel) to send an instruction for manually identifying the vehicle damage part of the fixed loss photo to perform the vehicle damage part. Manual identification.
  • the first damage type photo is analyzed by using a preset first preset type model to obtain the first vehicle damage part classification information. If the user denies the first vehicle damage part classification information, the preset first preset is used again.
  • the type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, if When the user denies the second vehicle damage part classification information, the user sends a command for manually identifying the vehicle damage part to the predetermined second terminal to manually identify the vehicle damage part. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources.
  • the vehicle damage portion when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
  • a second embodiment of the present invention provides a vehicle damage recognition method.
  • the above step S20 is replaced by:
  • Step S201 If the user manually receives the instruction of the vehicle damage location issued by the first terminal, the first terminal generates an area selection of the preset size and shape in the preset position of the display area of the fixed loss photo. a frame, the area selection box is configured for the user to adjust the current area selection frame to the preset direction to select the damaged photo feature area; and send the fixed loss photo feature area to the server;
  • Step S202 The server receives the fixed loss photo feature area, and analyzes the fixed loss photo feature area to obtain corresponding second car damage part classification information.
  • the predetermined operation interface of the first terminal further includes a fixed photo display area and a vehicle frame manual button. If the user confirms the first vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the server ends the vehicle damage part identification process, or if the user receives the manual framed button through the vehicle damage part
  • the first terminal responds to the instruction by manually instructing or refusing the first vehicle damage part classification information through the vehicle damage part classification information rejection button (for example, the first terminal's automobile insurance claim application APP rings) It should be instructed to generate an area selection frame of a preset size and shape (for example, a rectangle of X*Y pixels) at a preset position (for example, a geometric center position) of the fixed-loss photo display area, the area selection box is used for The user manually adjusts the boundary line of the fixed-loss photo area included in the current area selection frame to the preset direction (for example, up, down, left, and right) to select the fixed-loss photo feature area selected by the user.
  • the first terminal receives, by the first terminal, a secondary identification instruction issued by the user that includes the fixed loss photo feature area selected based on the area selection box, the first terminal (eg, the first terminal's auto insurance claim application APP) rings
  • the instruction should be identified twice and the fixed loss photo feature area sent to the server.
  • the server After receiving the fixed-feature photo feature area, the server analyzes the fixed-loss photo feature area to analyze the second car-loss part classification information corresponding to the fixed-loss photo.
  • the user when the first car damage part classification information obtained by analyzing the fixed loss photo is rejected by the user as the misclassification information, the user is first analyzed by the user before re-analysing the fixed loss photo.
  • the identified feature area of the fixed loss photo is manually selected, and then the secondary damage analysis feature area is subjected to secondary analysis to obtain the corresponding second vehicle damage part classification information.
  • the secondary analysis it is an analysis of the feature area of the fixed loss photo that is confirmed by the user, which effectively improves the accuracy of the secondary recognition.
  • the generating step of the first preset type model includes: obtaining, according to a preset vehicle damage part classification, each preset vehicle damage part from a preset vehicle risk claim database.
  • the claim photo corresponding to the class is preprocessed for the claim photo corresponding to each preset car damage part classification, so as to convert the format of the claim photo into a preset format; and using the converted preset preset car damage part classification corresponding pre
  • a convolutional neural network model of the preset model structure is trained to generate a convolutional neural network model corresponding to each preset car damage location classification.
  • the first preset type model is a convolutional neural network (CNN) model
  • the first preset type model generating rule is: acquiring each preset car from a preset car insurance claim database according to a preset car damage part classification
  • the claim photo corresponding to the damage part is classified, and the obtained claim photo of the preset car damage part classification is preprocessed to convert the obtained claim photo format into a preset format (for example, leveldb format);
  • a preset format for example, leveldb format
  • Each of the preset car damage parts is classified into a preset format picture, and the CNN model of the preset model structure is trained to generate a CNN model corresponding to each preset car damage part classification.
  • the purpose of training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification and identification of vehicle damage parts in practical applications.
  • the specific training process is as follows: Before the training starts, the system randomly and uniformly generates the initial values of the weights in the CNN model (for example, -0.05 to 0.05).
  • the CNN model was trained using a stochastic gradient descent method. The entire training process can be divided into two stages: forward propagation and backward propagation. In the forward propagation phase, the system randomly samples the samples from the training data set, inputs them into the CNN network for calculation, and obtains the actual calculation results.
  • the training process is iterated several times (for example, 100 times), and the training ends when the overall effective error of the CNN model is less than a predetermined threshold (for example, plus or minus 0.01).
  • the method after receiving the confirmation instruction of the first vehicle damage part classification information or the second vehicle damage part classification information sent by the first terminal, the method further includes:
  • the server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
  • the server Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the server sends a manual identification or repair manner of the vehicle damage level to the fixed loss terminal to the predetermined second terminal. Manually identified instructions for manual identification of vehicle damage levels or repair methods.
  • the predetermined operation interface of the first terminal further includes a vehicle damage level information display area and a repair mode information display area, the vehicle damage part classification information display area, the vehicle damage level information display area, and the repair mode information.
  • the display areas correspond to one selection item.
  • the server pairs the fixed loss type image by using a second preset type model generated in advance. Perform an analysis to determine the vehicle damage level corresponding to the fixed loss photo, and find out the determined vehicle damage location and the vehicle damage level according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode.
  • the repair method should be applied (for example, for sheet metal parts, the repair method includes only full spray, light sheet metal, light sheet metal + full spray, heavy sheet metal + full spray, replacement, etc.), and the determined A vehicle damage part classification information and its corresponding vehicle damage level and repair method are returned to the first terminal and displayed on a predetermined operation interface of the first terminal, or the determined second vehicle damage part classification information and The corresponding vehicle damage level and repair mode are returned to the first terminal and displayed on a predetermined operation interface of the first terminal.
  • the server sends an instruction to identify the vehicle damage level to the predetermined loss photo to the predetermined second terminal (for example, the terminal of the car insurance loss person) to manually identify the vehicle damage level.
  • the server sends an instruction to identify the repair mode to the predetermined second terminal (for example, the terminal of the car insurance loss person) to manually identify the repair mode.
  • the determined vehicle damage level and the repair mode corresponding to the determined vehicle damage portion are further automatically recognized, and the identified When the vehicle damage level and repair method are wrong, manual identification can be carried out to more comprehensively identify the vehicle damage, so that the subsequent vehicle damage treatment can be carried out more conveniently and quickly.
  • the generating step of the second preset type model includes:
  • a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level.
  • the classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre-
  • the convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
  • the second preset type model is a convolutional neural network (CNN) model
  • the generating step of the second preset type model includes: the server classifies according to a preset vehicle loss level, for example, the pre- The classification of vehicle damage levels includes primary damage (for example, damage without deformation, no rupture), secondary damage (for example, 2 or less slight recoverable deformation, damage without rupture), and tertiary damage (1) More than one serious recoverable deformation or more than three minor recoverable deformations, no rupture damage), four-level damage (for example, damage that cannot be repaired manually), etc., from a preset auto insurance claim database (for example, The auto insurance claim database stores the mapping relationship or tag data of the preset car damage level classification, the car damage part and the fixed loss photo, and the fixed loss photo refers to the photo taken by the repair shop at the time of the loss).
  • a preset vehicle loss level for example, the pre- The classification of vehicle damage levels includes primary damage (for example, damage without deformation, no rupture), secondary damage (for example, 2 or less
  • the part corresponds to a preset number (for example, 100,000 sheets) of the predetermined preset vehicle damage level classification, for example, obtaining 100,000 corresponding left front doors, and is a fixed-loss photo of the first-level damage.
  • the server generates rules according to the preset model, and each of the obtained vehicle damage parts is corresponding to each a fixed-length photo of the preset car damage level classification, generating a second preset type model for analyzing the preset car damage level classification corresponding to the fixed-loss photo (for example, based on the car damage parts corresponding to the first-level damage)
  • the preset number of fixed loss photos is generated, and a second preset type model for analyzing the car damage level corresponding to the fixed loss photo is generated.
  • the preset model generation rule is:
  • the CNN model of the preset model structure is trained by using the preset preset image of each of the preset car damage levels corresponding to each car damage part to generate each car damage part corresponding to each The CNN model of the preset car damage level classification.
  • the purpose of the training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification of each car damage location corresponding to each preset car damage level in practical applications.
  • the CNN model can have seven layers, five convolutional layers, one downsampled layer, and one fully connected layer.
  • the convolutional layer is formed by a feature map constructed by a plurality of feature vectors, and the function of the feature map is to extract key features by using a convolution filter.
  • the function of the downsampling layer is to remove the feature points of repeated expression and reduce the number of feature extractions by sampling method, thereby improving the efficiency of data communication between network layers.
  • the available sampling methods include maximum sampling method, mean sampling method and random sampling method.
  • the role of the fully connected layer is to connect the previous convolutional layer with downsampling and calculate the weight matrix for subsequent actual classification. After entering the CNN model, each image undergoes two processes: forward iteration and backward iteration. Each iteration generates a probability distribution. The probability distributions after multiple iterations are superimposed, and the system selects the probability distribution to obtain the maximum value.
  • the category is the final classification result.
  • the present invention further provides a vehicle damage recognition system that operates in the server 1 described above.
  • FIG. 4 is a schematic diagram of functional modules of the first embodiment of the vehicle damage recognition system 10 of the present invention.
  • the vehicle damage recognition system 10 includes:
  • the first analysis module 01 is configured to receive a fixed loss request that is sent by the user through the first terminal, and use the preset first preset type model to analyze the fixed loss photo to obtain the fixed loss photo. Corresponding first vehicle damage part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
  • the first analysis module 01 receives a fixed-loss photo (for example, a vehicle damage) that is sent by the user through the first terminal (for example, a mobile phone, a tablet computer, a handheld device, etc.) and includes a user-supplied part including a to-be-determined damage. A close-up photo of the part) of the damage request.
  • a fixed-loss photo for example, a vehicle damage
  • the first terminal for example, a mobile phone, a tablet computer, a handheld device, etc.
  • the auto insurance claim application APP may be pre-installed in the first terminal, and the user opens the auto insurance claim application APP and sends a loss request to the first analysis module 01 through the auto insurance claim application APP;
  • a browser system is pre-installed in the first terminal, and the user can access the first analysis module 01 of the vehicle damage recognition system 10 through the browser system, and send the first analysis module 01 to the first analysis module 01 through the browser system. Fixed loss request.
  • the first analysis module 01 uses the pre-determination after receiving the request for the loss of the fixed-length photo sent by the user.
  • the first preset type model generated first analyzes the acquired fixed loss photo to analyze the first car damage part classification information corresponding to the fixed loss photo (for example, front, side, rear, overall, etc.) And returning the analyzed first vehicle damage part classification information to the first terminal and displaying it on a predetermined operation interface of the first terminal (for example, returning the analyzed first vehicle damage part classification information to the first
  • a terminal auto insurance claim application APP is displayed on the operation interface generated by the auto insurance claim application APP).
  • the second analysis module 02 is configured to: if the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, use the preset first preset type model to Performing analysis on the damage photo, obtaining the second vehicle damage part classification information corresponding to the fixed loss photograph, and returning the second vehicle damage part classification information to the first terminal for display;
  • the second analysis module 02 receives the feedback information of the first vehicle damage part classification information sent by the user through the first terminal, such as confirming that the first vehicle damage part classification information is correct or confirming the first Rejection instruction for classification information of vehicle damage parts. It should be noted that, in this embodiment, the second analysis module 02 can receive an instruction sent by the user by using a button, a touch, a press, a shaking mobile phone, a fingerprint, and the like, such as on a predetermined operation interface of the first terminal. After displaying the first vehicle damage part classification information, the user may send the classification information of the first vehicle damage part to the second analysis module 02 by long pressing the first terminal screen or short pressing the first terminal screen.
  • the feedback information such as the acknowledgment command, the refusal command, and the like, is not limited herein.
  • the predetermined operation interface of the first terminal includes a vehicle damage part classification information display area, a vehicle damage part classification information confirmation button, and a vehicle damage part classification information rejection button; if the user confirms the vehicle by using the vehicle damage part classification information confirmation button
  • the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user rejects the first vehicle damage part classification information by the vehicle damage part classification information rejection button
  • the second analysis module 02 analyzes the acquired fixed loss photo by using the generated first preset type model to analyze the second vehicle damage part classification information corresponding to the fixed loss photo, and the second vehicle damage part classification information is After the re-analysis of the obtained fixed-loss photo by using the first preset type model, the second vehicle-loss part classification information may be the same as the first vehicle-loss part classification information, or may be the first The classification information of the vehicle damage parts is different.
  • the analyzed second vehicle damage part classification information is
  • the manual identification module 03 is configured to: if the user receives the rejection instruction for the second vehicle damage part classification information sent by the first terminal, send the vehicle to the predetermined second terminal
  • the manual identification of the damage part is to manually identify the damage part.
  • the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user passes the vehicle damage part classification information
  • the reject button rejects the second vehicle damage part classification information
  • the manual identification module 03 sends a command for manually identifying the vehicle damage part to the fixed loss photo to the predetermined second terminal (for example, the terminal of the vehicle risk determination personnel). , to manually identify the car damage parts.
  • the first damage type photo is analyzed by using a preset first preset type model to obtain the first vehicle damage part classification information. If the user denies the first vehicle damage part classification information, the preset first preset is used again.
  • the type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, and if the user denies the second vehicle damage part classification information, sends the vehicle damage part to the fixed loss photo to the predetermined second terminal. Manually recognized instructions to manually identify the damage location. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources.
  • the vehicle damage portion when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
  • the foregoing second analysis module 02 is further configured to:
  • the fixed loss photo feature area is obtained by: Receiving, by the first terminal, a frame selection frame of a preset size and shape in a preset position of the display area of the fixed-loss photo, if the user manually receives a command for the vehicle damage location issued by the first terminal, The area selection box is used for the user to adjust the current area selection box to the preset direction to select the damaged photo feature area.
  • the predetermined operation interface of the first terminal further includes a fixed photo display area and a vehicle frame manual button. If the user confirms the first vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user receives the vehicle damage through the vehicle damage part
  • the first terminal responds to the instruction (for example, the first terminal's auto insurance claim) by manually instructing the vehicle damage portion issued by the frame button or rejecting the first vehicle damage portion classification information through the vehicle damage portion classification information rejection button.
  • the application APP responds to the instruction to generate an area selection frame of a preset size and shape (for example, a rectangle of X*Y pixels) at a preset position (for example, a geometric center position) of the fixed-loss photo display area, the area
  • the selection box is used for the user to manually adjust the boundary line of the fixed loss photo area included in the current area selection box to the preset direction (for example, up, down, left, and right) to select the selected loss photo feature selected by the user. region.
  • the first terminal receives, by the first terminal, a secondary identification instruction issued by the user that includes the fixed loss photo feature area selected based on the area selection box, the first terminal (eg, the first terminal's auto insurance claim application APP) rings
  • the instruction should be recognized twice, and the fixed loss photo feature area is sent to the second analysis module 02.
  • the second analysis module 02 analyzes the fixed loss photo feature area to analyze the second car damage part classification information corresponding to the fixed loss photo.
  • the user when the first car damage part classification information obtained by analyzing the fixed loss photo is rejected by the user as the misclassification information, the user is first analyzed by the user before re-analysing the fixed loss photo.
  • the identified feature area of the fixed loss photo is manually selected, and then the secondary damage analysis feature area is subjected to secondary analysis to obtain the corresponding second vehicle damage part classification information.
  • the secondary analysis it is an analysis of the feature area of the fixed loss photo that is confirmed by the user, which effectively improves the secondary knowledge. Other accuracy.
  • the generating step of the first preset type model includes: obtaining, according to a preset vehicle damage part classification, a claim photo corresponding to each preset car damage part classification from a preset car insurance claim database, Pre-processing the claim photo corresponding to each preset car damage part classification to convert the format of the claim photo into a preset format; using the preset preset format picture corresponding to each preset car damage part classification, training pre- A convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset car damage location classification.
  • the first preset type model is a convolutional neural network (CNN) model
  • the first preset type model generating rule is: acquiring each preset car from a preset car insurance claim database according to a preset car damage part classification
  • the claim photo corresponding to the damage part is classified, and the obtained claim photo of the preset car damage part classification is preprocessed to convert the obtained claim photo format into a preset format (for example, leveldb format);
  • a preset format for example, leveldb format
  • Each of the preset car damage parts is classified into a preset format picture, and the CNN model of the preset model structure is trained to generate a CNN model corresponding to each preset car damage part classification.
  • the purpose of training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification and identification of vehicle damage parts in practical applications.
  • the specific training process is as follows: Before the training starts, the system randomly and uniformly generates the initial values of the weights in the CNN model (for example, -0.05 to 0.05).
  • the CNN model was trained using a stochastic gradient descent method. The entire training process can be divided into two stages: forward propagation and backward propagation. In the forward propagation phase, the system randomly samples the samples from the training data set, inputs them into the CNN network for calculation, and obtains the actual calculation results.
  • the training process is iterated several times (for example, 100 times), and the training ends when the overall effective error of the CNN model is less than a predetermined threshold (for example, plus or minus 0.01).
  • a second embodiment of the present invention provides a vehicle damage recognition system 10. Based on the foregoing embodiments, the method further includes:
  • the third analysis module 04 is configured to: after receiving the confirmation instruction for the first vehicle damage part classification information or the second vehicle damage part classification information sent by the first terminal, the preset second preset The type model analyzes the fixed loss photo, determines the vehicle damage level corresponding to the fixed loss photo, and finds the determined vehicle damage location according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode. And the repairing method corresponding to the vehicle damage level, and returning the determined vehicle damage part, the vehicle damage level and the corresponding repairing manner to the first terminal for display;
  • the manual identification module 03 is further configured to: if receiving, by the first terminal, a rejection instruction for the vehicle damage level or the repair mode, send the determined loss photo to the predetermined second terminal.
  • the manual identification of the vehicle damage level or the manual identification of the repair method to manually identify the damage level or repair method.
  • the predetermined operation interface of the first terminal further includes a vehicle damage level information display area and a repair mode information display area, the vehicle damage part classification information display area, the vehicle damage level information display area, and the repair mode information.
  • the display areas correspond to one selection item.
  • the third analysis module 04 corrects the fixed loss by using a second preset type model generated in advance. The photo is analyzed to determine the vehicle damage level corresponding to the fixed loss photo, and the determined vehicle damage location and the vehicle damage level are determined according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode.
  • Repair method for example, for sheet metal parts, repair methods include only full spray, light sheet metal, light sheet metal + full spray, heavy sheet metal + full spray, replacement, etc.
  • the damage part classification information and its corresponding vehicle damage level and repair mode are returned to the first terminal and displayed on a predetermined operation interface of the first terminal, or the determined second vehicle damage part classification information and corresponding The vehicle damage level and repair mode are returned to the first terminal and displayed at a predetermined operational interface of the first terminal.
  • the manual identification module 03 sends a command for identifying the damage level of the fixed loss photo to the predetermined second terminal (for example, the terminal of the vehicle risk-determining person) to perform the vehicle damage level.
  • the manual identification module 03 sends an instruction to identify the repair mode of the fixed-loss photo to a predetermined second terminal (for example, the terminal of the car-losing person) to manually identify the repair mode.
  • the determined vehicle damage level and the repair mode corresponding to the determined vehicle damage portion are further automatically recognized, and the identified When the vehicle damage level and repair method are wrong, manual identification can be carried out to more comprehensively identify the vehicle damage, so that the subsequent vehicle damage treatment can be carried out more conveniently and quickly.
  • the generating step of the second preset type model includes:
  • a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level.
  • the classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre-
  • the convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
  • the second preset type model is a convolutional neural network (CNN) model
  • the generating step of the second preset type model includes: classifying according to a preset vehicle damage level, for example, the preset
  • the classification of vehicle damage levels includes primary damage (for example, damage without deformation, no rupture), secondary damage (for example, 2 or less slight recoverable deformation, damage without rupture), and tertiary damage (1
  • the claim database stores the preset car damage level classification, the car damage location and the fixed
  • the mapping relationship or label data of the photo loss, the photo of the fixed loss refers to the photo taken by the repair shop at the time of the loss determination) the preset number of each car damage location corresponding to each preset car damage level classification (for example, 10 10,000 sheets) Fixed loss photos, for example, 100,000
  • a second preset type model for analyzing the preset vehicle damage level classification corresponding to the fixed loss photo is generated based on the obtained fixed loss photos corresponding to the respective preset vehicle damage levels. (For example, based on a predetermined number of fixed-loss photos that have occurred in each vehicle damage portion corresponding to the first-level damage, a second preset type model for analyzing the vehicle damage level corresponding to the fixed-loss photo is generated).
  • the preset model generation rule is:
  • the CNN model of the preset model structure is trained by using the preset preset image of each of the preset car damage levels corresponding to each car damage part to generate each car damage part corresponding to each The CNN model of the preset car damage level classification.
  • the purpose of the training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification of each car damage location corresponding to each preset car damage level in practical applications.
  • the CNN model can have seven layers, five convolutional layers, one downsampled layer, and one fully connected layer.
  • the convolutional layer is formed by a feature map constructed by a plurality of feature vectors, and the function of the feature map is to extract key features by using a convolution filter.
  • the function of the downsampling layer is to remove the feature points of repeated expression and reduce the number of feature extractions by sampling method, thereby improving the efficiency of data communication between network layers.
  • the available sampling methods include maximum sampling method, mean sampling method and random sampling method.
  • the role of the fully connected layer is to connect the previous convolutional layer with downsampling and calculate the weight matrix for subsequent actual classification. After entering the CNN model, each image undergoes two processes: forward iteration and backward iteration. Each iteration generates a probability distribution. The probability distributions after multiple iterations are superimposed, and the system selects the probability distribution to obtain the maximum value.
  • the category is the final classification result.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Business, Economics & Management (AREA)
  • Evolutionary Computation (AREA)
  • Finance (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Accounting & Taxation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Software Systems (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Strategic Management (AREA)
  • Technology Law (AREA)
  • General Business, Economics & Management (AREA)
  • Financial Or Insurance-Related Operations Such As Payment And Settlement (AREA)

Abstract

Disclosed are a car damage recognition method, a server and a storage medium. The method comprises: receiving a loss assessment request sent by a user by means of a first terminal, using a pre-set first pre-set type model to analyse a loss assessment picture to obtain corresponding first car damage part classification information, and returning the first car damage part classification information to the first terminal for display (S10); if a rejection instruction, sent by the user by means of the first terminal, regarding the first car damage part classification information is received, re-using the pre-set first pre-set type model to analyse the loss assessment picture to obtain corresponding second car damage part classification information, and returning the second car damage part classification information to the first terminal for display (S20); and if a rejection instruction, sent by the user by means of the first terminal, regarding the second car damage part classification information is received, sending, to a pre-determined second terminal, an instruction to carry out manual car damage part recognition on the loss assessment picture (S30). The solution improves the precision and recall rate of car damage recognition.

Description

车损识别方法、电子装置及计算机可读存储介质Vehicle damage recognition method, electronic device and computer readable storage medium
优先权申明Priority claim
本申请基于巴黎公约申明享有2017年3月13日递交的申请号为CN201710147701.1、名称为“车损识别方法及服务器”中国专利申请的优先权,该中国专利申请的整体内容以参考的方式结合在本申请中。This application is based on the priority of the Paris Convention, which is entitled to the Chinese Patent Application No. CN201710147701.1, entitled "Car Damage Identification Method and Server", filed on March 13, 2017, the entire contents of which are hereby incorporated by reference. Combined in this application.
技术领域Technical field
本发明涉及计算机技术领域,尤其涉及一种车损识别方法、电子装置及计算机可读存储介质。The present invention relates to the field of computer technologies, and in particular, to a vehicle damage recognition method, an electronic device, and a computer readable storage medium.
背景技术Background technique
目前,车险业务的一个难点在于车险理赔环节需要投入大量的人力物力。为了有效降低车险理赔环节的人力、物力,目前有些保险公司利用图像检测和识别的技术自动对受损部位进行检测。然而,现有的这种自动检测方案有时比较容易对受损部位检测遗漏或者是识别错误,识别的准确率和查全率得不到保障。At present, one of the difficulties in the auto insurance business is that it requires a lot of manpower and resources to invest in the auto insurance claims. In order to effectively reduce the manpower and material resources of the auto insurance claims, some insurance companies currently use the technology of image detection and recognition to automatically detect damaged parts. However, the existing automatic detection scheme is sometimes easier to detect missing or identification errors of the damaged part, and the accuracy and recall of the identification are not guaranteed.
发明内容Summary of the invention
本发明的主要目的在于提供一种车损识别方法、电子装置及计算机可读存储介质,旨在提高车损识别的准确率和查全率。The main object of the present invention is to provide a vehicle damage recognition method, an electronic device and a computer readable storage medium, which aim to improve the accuracy and recall rate of vehicle damage recognition.
本申请第一方法提供一种车损识别方法,所述方法包括以下步骤:The first method of the present application provides a vehicle damage recognition method, and the method includes the following steps:
A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, the first predetermined type model is used to analyze the determined loss photo again. The second vehicle damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
本申请第二方面提供一种服务器,包括处理设备及与所述处理设备连接的存储设备,该存储设备存储有车损识别系统,该车损识别系统包括至少一个计算机可读指令,该至少一个计算机可读指令可被所述处理设备执行,以实现以下操作:A second aspect of the present application provides a server, including a processing device and a storage device connected to the processing device, the storage device storing a vehicle damage recognition system, the vehicle damage recognition system including at least one computer readable instruction, the at least one Computer readable instructions are executable by the processing device to:
A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应 的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives a fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the corresponding loss photo. The first vehicle damage part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, the first predetermined type model is used to analyze the determined loss photo again. The second vehicle damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
本申请第三方面提供一种计算机可读存储介质,其上存储有至少一个可被处理设备执行以实现以下操作的计算机可读指令:A third aspect of the present application provides a computer readable storage medium having stored thereon at least one computer readable instruction executable by a processing device to:
A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, the first predetermined type model is used to analyze the determined loss photo again. The second vehicle damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
本发明的技术方案,通过预设的第一预设类型模型对定损照片进行分析得到第一车损部位分类信息,若用户否定该第一车损部位分类信息,则再次利用预设的第一预设类型模型对所述定损照片进行分析得到第二车损部位分类信息,若用户否定该第二车损部位分类信息,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。由于在与用户进行车损自动识别时,利用第一预设类型模型对定损照片进行两次自动识别,提高了识别精度及通过率,节省了人力物力。而且,在两次自动识别均无法确认车损部位时,对定损照片进行车损部位人工识别,避免了因无法自动识别车损部位导致受损部位检测遗漏或者是识别错误的情况发生,提高了车损识别的准确率和查全率。According to the technical solution of the present invention, the first loss type photo is analyzed by the preset first preset type model to obtain the first vehicle damage part classification information, and if the user denies the first vehicle damage part classification information, the preset first The preset type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, and if the user denies the second vehicle damage part classification information, sends the fixed loss photo to the predetermined second terminal. Manual identification of the vehicle damage location to manually identify the vehicle damage location. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources. Moreover, when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
附图说明DRAWINGS
图1为本发明实现车损识别方法的一实施例的应用环境示意图;1 is a schematic diagram of an application environment of an embodiment of a vehicle damage recognition method according to the present invention;
图2为本发明车损识别方法第一实施例的流程示意图;2 is a schematic flow chart of a first embodiment of a vehicle damage recognition method according to the present invention;
图3为本发明车损识别方法第二实施例的流程示意图;3 is a schematic flow chart of a second embodiment of a vehicle damage recognition method according to the present invention;
图4为本发明车损识别系统第一实施例的功能模块示意图; 4 is a schematic diagram of functional modules of a first embodiment of a vehicle damage recognition system according to the present invention;
图5为本发明车损识别系统第二实施例的功能模块示意图。FIG. 5 is a schematic diagram of functional modules of a second embodiment of the vehicle damage recognition system of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.
具体实施方式detailed description
为了使本发明所要解决的技术问题、技术方案及有益效果更加清楚、明白,以下结合附图和实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments, in order to make the present invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
本发明提供一种车损识别方法。The invention provides a vehicle damage recognition method.
参阅图1所示,是本发明实现车损识别方法的一实施例的应用环境示意图。所述应用环境示意图包括服务器1、终端设备2。所述服务器1可以通过网络、近场通信技术等适合的技术与所述终端设备2进行数据交互。Referring to FIG. 1 , it is a schematic diagram of an application environment of an embodiment of a vehicle damage recognition method according to the present invention. The application environment diagram includes a server 1 and a terminal device 2. The server 1 can perform data interaction with the terminal device 2 through a suitable technology such as a network or a near field communication technology.
终端设备2包括,但不限于,任何一种可与用户通过键盘、鼠标、遥控器、触摸板或者声控设备等方式进行人机交互的电子产品,例如,个人计算机、平板电脑、智能手机、个人数字助理(Personal Digital Assistant,PDA),游戏机、交互式网络电视(Internet Protocol Television,IPTV)、智能式穿戴设备等。The terminal device 2 includes, but is not limited to, any electronic product that can interact with a user through a keyboard, a mouse, a remote controller, a touch pad, or a voice control device, for example, a personal computer, a tablet computer, a smart phone, or an individual. Personal Digital Assistant (PDA), game console, Internet Protocol Television (IPTV), smart wearable device, etc.
服务器1是一种能够按照事先设定或者存储的指令,自动进行数值计算和/或信息处理的设备。服务器1可以是计算机、也可以是单个网络服务器、多个网络服务器组成的服务器组或者基于云计算的由大量主机或者网络服务器构成的云,其中云计算是分布式计算的一种,由一群松散耦合的计算机集组成的一个超级虚拟计算机。The server 1 is a device capable of automatically performing numerical calculation and/or information processing in accordance with an instruction set or stored in advance. The server 1 may be a computer, a single network server, a server group composed of a plurality of network servers, or a cloud-based cloud composed of a large number of hosts or network servers, wherein the cloud computing is a kind of distributed computing, and is loosely distributed by a group. A super virtual computer consisting of a set of coupled computers.
在本实施例中,服务器1包括,但不仅限于,可通过系统总线相互通信连接的存储设备11、处理设备12、及网络接口13。需要指出的是,图1仅示出了具有组件11-13的服务器1,但是应理解的是,并不要求实施所有示出的组件,可以替代的实施更多或者更少的组件。In the present embodiment, the server 1 includes, but is not limited to, a storage device 11, a processing device 12, and a network interface 13 that are communicably connected to each other through a system bus. It is pointed out that Figure 1 only shows the server 1 with the components 11-13, but it should be understood that not all illustrated components are required to be implemented, and more or fewer components may be implemented instead.
其中,存储设备11包括内存及至少一种类型的可读存储介质。内存为服务器1的运行提供缓存;可读存储介质可为如闪存、硬盘、多媒体卡、卡型存储器等的非易失性存储介质。在一些实施例中,可读存储介质可以是服务器1的内部存储单元,例如该服务器1的硬盘;在另一些实施例中,该非易失性存储介质也可以是服务器1的外部存储设备,例如服务器1上配备的插接式硬盘,智能存储卡(Smart Media Card,SMC),安全数字(Secure Digital,SD)卡,闪存卡(Flash Card)等。本实施例中,存储设备11的可读存储介质通常用于存储安装于服务器1的操作系统和各类应用软件,例如本申请一实施例中的车损识别系统10的程序代码等。此外,存储设备11还可以用于暂时地存储已经输出或者将要输出的各类数据。The storage device 11 includes a memory and at least one type of readable storage medium. The memory provides a cache for the operation of the server 1; the readable storage medium may be a non-volatile storage medium such as a flash memory, a hard disk, a multimedia card, a card type memory, or the like. In some embodiments, the readable storage medium may be an internal storage unit of the server 1, such as a hard disk of the server 1; in other embodiments, the non-volatile storage medium may also be an external storage device of the server 1, For example, a plug-in hard disk provided on the server 1, a smart memory card (SMC), a Secure Digital (SD) card, a flash card, and the like. In this embodiment, the readable storage medium of the storage device 11 is generally used to store an operating system installed on the server 1 and various types of application software, such as program codes of the vehicle damage recognition system 10 in an embodiment of the present application. Further, the storage device 11 can also be used to temporarily store various types of data that have been output or are to be output.
处理设备12在一些实施例中可以包括一个或者多个微处理器、微控制器、 数字处理器等。该处理设备12通常用于控制服务器1的运行,例如执行与终端设备2进行数据交互或者通信相关的控制和处理等。在本实施例中,处理设备12用于运行存储设备11中存储的程序代码或者处理数据,例如运行车损识别系统10等。 Processing device 12 may, in some embodiments, include one or more microprocessors, microcontrollers, Digital processor, etc. The processing device 12 is typically used to control the operation of the server 1, such as performing control and processing related to data interaction or communication with the terminal device 2. In the present embodiment, the processing device 12 is configured to run program code or process data stored in the storage device 11, such as running the vehicle damage recognition system 10 and the like.
网络接口13可包括无线网络接口或有线网络接口,该网络接口13通常用于在服务器1与其他电子设备之间建立通信连接。本实施例中,网络接口13主要用于将服务器1与一个或多个终端设备2相连,在服务器1与一个或多个终端设备2之间建立数据传输通道和通信连接。The network interface 13 may comprise a wireless network interface or a wired network interface, which is typically used to establish a communication connection between the server 1 and other electronic devices. In this embodiment, the network interface 13 is mainly used to connect the server 1 with one or more terminal devices 2, and establish a data transmission channel and a communication connection between the server 1 and one or more terminal devices 2.
车损识别系统10存储在存储设备11中,包括至少一个计算机可读指令,该至少一个计算机可读指令可被处理设备12执行,以实现本申请各实施例的控件响应区域显示控制方法。如后续所述,该至少一个计算机可读指令依据其各部分所实现的功能不同,可被划为不同的逻辑模块。The vehicle damage recognition system 10 is stored in the storage device 11 and includes at least one computer readable instructions executable by the processing device 12 to implement the control response area display control method of various embodiments of the present application. As described later, the at least one computer readable instruction can be classified into different logic modules depending on the functions implemented by its various parts.
在一实施例中,车损识别系统10被处理设备12执行时,实现以下操作:接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。In an embodiment, when the vehicle damage recognition system 10 is executed by the processing device 12, the following operations are performed: receiving a loss request including a fixed loss photo sent by the user through the first terminal, using a preset first preset type model pair The determined loss photo is analyzed to obtain the first vehicle damage part classification information corresponding to the fixed loss photo, and the first vehicle damage part classification information is returned to the first terminal for display; if the user receives the user pass The rejecting instruction of the first vehicle damage part classification information sent by the first terminal is used to analyze the fixed loss photo by using a preset first preset type model to obtain a corresponding corresponding to the fixed loss photo. And classifying the second vehicle damage part classification information, and returning the second vehicle damage part classification information to the first terminal for display; if receiving the classification information of the second vehicle damage part issued by the user through the first terminal When the instruction is rejected, an instruction for manually identifying the damage location of the fixed-loss photo is sent to the predetermined second terminal to manually identify the vehicle damage location.
参照图2,图2为本发明车损识别方法第一实施例的流程示意图。Referring to FIG. 2, FIG. 2 is a schematic flow chart of a first embodiment of a vehicle damage recognition method according to the present invention.
在第一实施例中,该车损识别方法包括:In the first embodiment, the vehicle damage recognition method includes:
步骤S10,车损识别系统接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示。Step S10: The vehicle damage recognition system receives a fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the fixed loss photo corresponding to The first vehicle damage part classification information, and returning the first vehicle damage part classification information to the first terminal for display.
本实施例中,服务器接收用户通过第一终端(例如,手机、平板电脑、手持设备等)发出的一个包含用户上传的包括待定损车损部位的定损照片(例如,车损部位的特写照片)的定损请求。在一种实施方式中,可在第一终端中预先安装车险理赔应用程序APP,用户打开该车险理赔应用程序APP并通过该车险理赔应用程序APP向服务器发送定损请求;在另一种实施方式中,第一终端中预先安装有浏览器系统,用户可以通过该浏览器系统访问服务器,并通过该浏览器系统向服务器发送定损请求。In this embodiment, the server receives, by the first terminal (for example, a mobile phone, a tablet computer, a handheld device, etc.), a fixed-loss photo including a user-supplied part including a to-be-damaged car damage location (for example, a close-up photo of a car damage part). ) The loss request. In an embodiment, the auto insurance claim application APP may be pre-installed in the first terminal, the user opens the auto insurance claim application APP and sends a loss request to the server through the auto insurance claim application APP; in another embodiment A browser system is pre-installed in the first terminal, and the user can access the server through the browser system, and send a loss request to the server through the browser system.
服务器在收到用户发出的包含定损照片的定损请求后,利用预先生成的第一预设类型模型对获取的定损照片进行分析,以分析出所述定损照片对应的第一车损部位分类信息(例如,车前方、侧面、车尾、整体等),并将分析 出的第一车损部位分类信息返回给该第一终端并在该第一终端的预先确定的操作界面进行显示(例如,将分析出的第一车损部位分类信息返回给该第一终端的车险理赔应用程序APP并在该车险理赔应用程序APP生成的操作界面上进行显示)。After receiving the loss request including the loss-receiving photo sent by the user, the server analyzes the acquired fixed-loss photo by using the pre-generated first preset type model to analyze the first vehicle damage corresponding to the fixed-loss photo. Part classification information (for example, front, side, rear, overall, etc.) and analysis The first vehicle damage part classification information is returned to the first terminal and displayed on a predetermined operation interface of the first terminal (for example, the analyzed first vehicle damage part classification information is returned to the first terminal The auto insurance claim application APP is displayed on the operation interface generated by the auto insurance claim application APP).
步骤S20,若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示。Step S20: If receiving the rejection instruction of the first vehicle loss location classification information sent by the first terminal, the method further analyzes the fixed loss photo by using a preset first preset type model. The second vehicle damage part classification information corresponding to the fixed loss photograph is obtained, and the second vehicle damage part classification information is returned to the first terminal for display.
服务器接收该用户通过该第一终端发出的对所述第一车损部位分类信息的反馈信息,如确认所述第一车损部位分类信息无误的确认指令或否定所述第一车损部位分类信息的拒绝指令。需要说明的是,本实施例中,服务器可以接收用户通过按钮、触摸、按压、摇晃手机、指纹等多种方式发送的指令,如在该第一终端的预先确定的操作界面上显示所述第一车损部位分类信息后,用户可以通过长按该第一终端屏幕或短按该第一终端屏幕的方式向服务器发送对所述第一车损部位分类信息的反馈信息如确认指令、拒绝指令等,在此不做限定,本实施例中仅以用户通过该第一终端上点击按钮的方式向服务器发送反馈信息为例进行具体说明。该第一终端的预先确定的操作界面包括车损部位分类信息显示区域、车损部位分类信息确认按钮及车损部位分类信息拒绝按钮;若该用户通过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息,则服务器结束车损部位识别流程,或者,若该用户通过所述车损部位分类信息拒绝按钮拒绝所述第一车损部位分类信息,则服务器再次利用生成的第一预设类型模型对获取的定损照片进行分析,以分析出所述定损照片对应的第二车损部位分类信息,该第二车损部位分类信息为利用第一预设类型模型对获取的所述定损照片进行重新分析后得到的,该第二车损部位分类信息可与所述第一车损部位分类信息相同,也可与所述第一车损部位分类信息不同。将分析出的第二车损部位分类信息返回给该第一终端并在该第一终端的预先确定的操作界面进行显示。Receiving, by the server, feedback information of the first car damage part classification information sent by the first terminal, such as confirming that the first vehicle damage part classification information is correct, or negating the first vehicle damage part classification Rejection instruction for information. It should be noted that, in this embodiment, the server may receive an instruction sent by the user by using a button, a touch, a press, a shaking, a mobile phone, a fingerprint, or the like, such as displaying the first on a predetermined operation interface of the first terminal. After the vehicle damage part classification information, the user may send feedback information about the classification information of the first vehicle damage part to the server by long pressing the first terminal screen or short pressing the first terminal screen, such as a confirmation instruction or a rejection instruction. For example, in the embodiment, the user sends the feedback information to the server in the manner that the user clicks the button on the first terminal. The predetermined operation interface of the first terminal includes a vehicle damage part classification information display area, a vehicle damage part classification information confirmation button, and a vehicle damage part classification information rejection button; if the user confirms the vehicle by using the vehicle damage part classification information confirmation button If the first vehicle damage part classification information is described, the server ends the vehicle damage part identification process, or if the user rejects the first vehicle damage part classification information through the vehicle damage part classification information rejection button, the server reuses the generated information. The first preset type model analyzes the acquired fixed loss photo to analyze the second vehicle damage part classification information corresponding to the fixed loss photo, and the second vehicle damage part classification information is the first preset type model pair The obtained vehicle damage part classification information may be the same as the first vehicle damage part classification information, or may be different from the first vehicle damage part classification information. The analyzed second vehicle damage part classification information is returned to the first terminal and displayed on a predetermined operation interface of the first terminal.
步骤S30,若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。Step S30, if receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal The instructions to manually identify the damage location.
若该用户通过所述车损部位分类信息确认按钮确认所述第二车损部位分类信息,则服务器结束车损部位识别流程,或者,若该用户通过所述车损部位分类信息拒绝按钮拒绝所述第二车损部位分类信息,则服务器向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。If the user confirms the second vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the server ends the vehicle damage part identification process, or if the user rejects the vehicle through the vehicle damage part classification information rejection button The second vehicle damage part classification information is sent to the predetermined second terminal (for example, the terminal of the vehicle risk determination personnel) to send an instruction for manually identifying the vehicle damage part of the fixed loss photo to perform the vehicle damage part. Manual identification.
本实施例通过预设的第一预设类型模型对定损照片进行分析得到第一车损部位分类信息,若用户否定该第一车损部位分类信息,则再次利用预设的第一预设类型模型对所述定损照片进行分析得到第二车损部位分类信息,若 用户否定该第二车损部位分类信息,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。由于在与用户进行车损自动识别时,利用第一预设类型模型对定损照片进行两次自动识别,提高了识别精度及通过率,节省了人力物力。而且,在两次自动识别均无法确认车损部位时,对定损照片进行车损部位人工识别,避免了因无法自动识别车损部位导致受损部位检测遗漏或者是识别错误的情况发生,提高了车损识别的准确率和查全率。In this embodiment, the first damage type photo is analyzed by using a preset first preset type model to obtain the first vehicle damage part classification information. If the user denies the first vehicle damage part classification information, the preset first preset is used again. The type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, if When the user denies the second vehicle damage part classification information, the user sends a command for manually identifying the vehicle damage part to the predetermined second terminal to manually identify the vehicle damage part. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources. Moreover, when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
如图3所示,本发明第二实施例提出一种车损识别方法,在上述实施例的基础上,上述步骤S20替换为:As shown in FIG. 3, a second embodiment of the present invention provides a vehicle damage recognition method. On the basis of the foregoing embodiment, the above step S20 is replaced by:
步骤S201,若接收到该用户通过该第一终端发出的车损部位人工框定指令,则由该第一终端在所述定损照片的显示区域的预设位置生成预设尺寸和形状的区域选择框,该区域选择框用于供用户向预设方向调整当前区域选择框以框选定损照片特征区域;将所述定损照片特征区域发送给服务器;Step S201: If the user manually receives the instruction of the vehicle damage location issued by the first terminal, the first terminal generates an area selection of the preset size and shape in the preset position of the display area of the fixed loss photo. a frame, the area selection box is configured for the user to adjust the current area selection frame to the preset direction to select the damaged photo feature area; and send the fixed loss photo feature area to the server;
步骤S202,服务器接收所述定损照片特征区域,对所述定损照片特征区域进行分析,得到对应的第二车损部位分类信息。Step S202: The server receives the fixed loss photo feature area, and analyzes the fixed loss photo feature area to obtain corresponding second car damage part classification information.
本实施例中,该第一终端的预先确定的操作界面还包括定损照片显示区域及车损部位人工框定按钮。若该用户通过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息,则服务器结束车损部位识别流程,或者,若收到用户通过所述车损部位人工框定按钮发出的车损部位人工框定指令或通过所述车损部位分类信息拒绝按钮拒绝所述第一车损部位分类信息,则该第一终端响应该指令(例如,该第一终端的车险理赔应用程序APP响应该指令),在所述定损照片显示区域的预设位置(例如,几何中心位置)生成预设尺寸和形状(例如,X*Y像素的长方形)的区域选择框,该区域选择框用于供用户人工向预设方向(例如,上、下、左、右)动态调整当前区域选择框所包含的定损照片区域的边界线,以框选出用户选中的定损照片特征区域。该第一终端若收到用户发出的包含基于所述区域选择框选择的定损照片特征区域的二次识别指令,则该第一终端(例如,该第一终端的车险理赔应用程序APP)响应该二次识别指令,并将所述定损照片特征区域发送给服务器。服务器在收到所述定损照片特征区域后,对所述定损照片特征区域进行分析,以分析出所述定损照片对应的第二车损部位分类信息。In this embodiment, the predetermined operation interface of the first terminal further includes a fixed photo display area and a vehicle frame manual button. If the user confirms the first vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the server ends the vehicle damage part identification process, or if the user receives the manual framed button through the vehicle damage part The first terminal responds to the instruction by manually instructing or refusing the first vehicle damage part classification information through the vehicle damage part classification information rejection button (for example, the first terminal's automobile insurance claim application APP rings) It should be instructed to generate an area selection frame of a preset size and shape (for example, a rectangle of X*Y pixels) at a preset position (for example, a geometric center position) of the fixed-loss photo display area, the area selection box is used for The user manually adjusts the boundary line of the fixed-loss photo area included in the current area selection frame to the preset direction (for example, up, down, left, and right) to select the fixed-loss photo feature area selected by the user. Receiving, by the first terminal, a secondary identification instruction issued by the user that includes the fixed loss photo feature area selected based on the area selection box, the first terminal (eg, the first terminal's auto insurance claim application APP) rings The instruction should be identified twice and the fixed loss photo feature area sent to the server. After receiving the fixed-feature photo feature area, the server analyzes the fixed-loss photo feature area to analyze the second car-loss part classification information corresponding to the fixed-loss photo.
本实施例中,在初次对所述定损照片进行分析得到的第一车损部位分类信息被用户认定为错误分类信息而拒绝时,在对所述定损照片进行再次分析之前,先由用户人工框选其认定的定损照片特征区域,再对该定损照片特征区域进行二次分析得到对应的第二车损部位分类信息。由于在二次分析中,是对经用户确认更细化的定损照片特征区域进行分析,有效地提高了二次识别的准确性。In this embodiment, when the first car damage part classification information obtained by analyzing the fixed loss photo is rejected by the user as the misclassification information, the user is first analyzed by the user before re-analysing the fixed loss photo. The identified feature area of the fixed loss photo is manually selected, and then the secondary damage analysis feature area is subjected to secondary analysis to obtain the corresponding second vehicle damage part classification information. In the secondary analysis, it is an analysis of the feature area of the fixed loss photo that is confirmed by the user, which effectively improves the accuracy of the secondary recognition.
进一步地,在其他实施例中,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分 类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。Further, in other embodiments, the generating step of the first preset type model includes: obtaining, according to a preset vehicle damage part classification, each preset vehicle damage part from a preset vehicle risk claim database. The claim photo corresponding to the class is preprocessed for the claim photo corresponding to each preset car damage part classification, so as to convert the format of the claim photo into a preset format; and using the converted preset preset car damage part classification corresponding pre A convolutional neural network model of the preset model structure is trained to generate a convolutional neural network model corresponding to each preset car damage location classification.
所述第一预设类型模型为卷积神经网络(CNN)模型,所述第一预设类型模型生成规则为:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对获取的各个预设车损部位分类对应的理赔照片进行预处理,以将获取的理赔照片的格式转化为预设格式(例如,leveldb格式);利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的CNN模型,以生成各个预设车损部位分类对应的CNN模型。训练的目的是优化CNN模型内各权重的值,使得CNN模型作为整体在实际应用中可较好地适用于车损部位分类识别。具体的训练过程如下:训练开始前,系统随机且均匀地生成CNN模型内各权重的初始值(例如-0.05至0.05)。采用随机梯度下降法对CNN模型进行训练。整个训练过程可分为向前传播和向后传播两个阶段。在向前传播阶段,系统从训练数据集中随机提取样本,输入CNN网络进行计算,并得到实际计算结果。在向后传播过程中,计算实际结果与期望结果的差值,然后利用误差最小化定位方法反向调整各权重的值,同时计算该次调整产生的有效误差。训练过程反复迭代若干次(例如100次),当CNN模型整体有效误差小于预先设定的阈值(例如正负0.01)时,训练结束。The first preset type model is a convolutional neural network (CNN) model, and the first preset type model generating rule is: acquiring each preset car from a preset car insurance claim database according to a preset car damage part classification The claim photo corresponding to the damage part is classified, and the obtained claim photo of the preset car damage part classification is preprocessed to convert the obtained claim photo format into a preset format (for example, leveldb format); Each of the preset car damage parts is classified into a preset format picture, and the CNN model of the preset model structure is trained to generate a CNN model corresponding to each preset car damage part classification. The purpose of training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification and identification of vehicle damage parts in practical applications. The specific training process is as follows: Before the training starts, the system randomly and uniformly generates the initial values of the weights in the CNN model (for example, -0.05 to 0.05). The CNN model was trained using a stochastic gradient descent method. The entire training process can be divided into two stages: forward propagation and backward propagation. In the forward propagation phase, the system randomly samples the samples from the training data set, inputs them into the CNN network for calculation, and obtains the actual calculation results. In the backward propagation process, the difference between the actual result and the expected result is calculated, and then the value of each weight is inversely adjusted by the error minimization positioning method, and the effective error generated by the adjustment is calculated at the same time. The training process is iterated several times (for example, 100 times), and the training ends when the overall effective error of the CNN model is less than a predetermined threshold (for example, plus or minus 0.01).
进一步地,在其他实施例中,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,该方法还包括:Further, in other embodiments, after receiving the confirmation instruction of the first vehicle damage part classification information or the second vehicle damage part classification information sent by the first terminal, the method further includes:
服务器通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则服务器向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the server sends a manual identification or repair manner of the vehicle damage level to the fixed loss terminal to the predetermined second terminal. Manually identified instructions for manual identification of vehicle damage levels or repair methods.
本实施例中,该第一终端的预先确定的操作界面还包括车损级别信息显示区域和修理方式信息显示区域,所述车损部位分类信息显示区域、车损级别信息显示区域和修理方式信息显示区域分别对应一个选择项。在该用户通过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息或者第二车损部位分类信息后,服务器通过预先生成的第二预设类型模型对所述定损照片进行分析,以确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对 应的修理方式(例如,对于钣金件而言,修理方式包括仅全喷、轻度钣金、轻度钣金+全喷、重度钣金+全喷、更换等),并将确定的第一车损部位分类信息及其对应的车损级别和修理方式返回给该第一终端并在该第一终端的预先确定的操作界面进行显示,或者,将确定的第二车损部位分类信息及其对应的车损级别和修理方式返回给该第一终端并在该第一终端的预先确定的操作界面进行显示。In this embodiment, the predetermined operation interface of the first terminal further includes a vehicle damage level information display area and a repair mode information display area, the vehicle damage part classification information display area, the vehicle damage level information display area, and the repair mode information. The display areas correspond to one selection item. After the user confirms the first vehicle damage part classification information or the second vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the server pairs the fixed loss type image by using a second preset type model generated in advance. Perform an analysis to determine the vehicle damage level corresponding to the fixed loss photo, and find out the determined vehicle damage location and the vehicle damage level according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode. The repair method should be applied (for example, for sheet metal parts, the repair method includes only full spray, light sheet metal, light sheet metal + full spray, heavy sheet metal + full spray, replacement, etc.), and the determined A vehicle damage part classification information and its corresponding vehicle damage level and repair method are returned to the first terminal and displayed on a predetermined operation interface of the first terminal, or the determined second vehicle damage part classification information and The corresponding vehicle damage level and repair mode are returned to the first terminal and displayed on a predetermined operation interface of the first terminal.
若用户通过所述车损级别信息显示区域对应的选择项选中确定的车损级别,且该用户通过所述车损部位分类信息拒绝按钮拒绝选中的车损级别,则说明用户认为当前自动识别出的车损级别有误,则服务器向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行车损级别识别的指令,以对车损级别进行人工识别。If the user selects the determined vehicle damage level by the selection item corresponding to the vehicle damage level information display area, and the user rejects the selected vehicle damage level by using the vehicle loss part classification information rejection button, the user believes that the current automatic recognition is performed. If the vehicle damage level is incorrect, the server sends an instruction to identify the vehicle damage level to the predetermined loss photo to the predetermined second terminal (for example, the terminal of the car insurance loss person) to manually identify the vehicle damage level.
若用户通过所述修理方式信息显示区域对应的选择项选中确定的修理方式,且该用户通过所述车损部位分类信息拒绝按钮拒绝选中的修理方式,则说明用户认为当前自动识别出的修理方式有误,则服务器向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行修理方式识别的指令,以对修理方式进行人工识别。If the user selects the determined repair mode through the selection item corresponding to the repair mode information display area, and the user rejects the selected repair mode by using the vehicle damage part classification information rejection button, the user automatically believes that the repair method is currently recognized. If there is an error, the server sends an instruction to identify the repair mode to the predetermined second terminal (for example, the terminal of the car insurance loss person) to manually identify the repair mode.
本实施例中,在正确识别出所述定损照片对应的车损部位之后,进一步地,还能自动识别出确定的该车损部位所对应的车损级别及修理方式,并在识别出的车损级别及修理方式有误时,进行人工识别,能更加全面的进行车损识别,以更加方便、快捷的进行后续的车损处理。In this embodiment, after the vehicle damage portion corresponding to the fixed-loss photo is correctly recognized, the determined vehicle damage level and the repair mode corresponding to the determined vehicle damage portion are further automatically recognized, and the identified When the vehicle damage level and repair method are wrong, manual identification can be carried out to more comprehensively identify the vehicle damage, so that the subsequent vehicle damage treatment can be carried out more conveniently and quickly.
进一步地,在其他实施例中,所述第二预设类型模型的生成步骤包括:Further, in other embodiments, the generating step of the second preset type model includes:
根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
本实施例中,所述第二预设类型模型为卷积神经网络(CNN)模型,所述第二预设类型模型的生成步骤包括:服务器根据预设车损级别分类,例如,所述预设车损级别分类包括一级损伤(例如,未发生变形、未发生破裂的损伤)、二级损伤(例如,2个以下轻微的可恢复变形、未发生破裂的损伤)、三级损伤(1个以上严重的可恢复变形或者3个以上轻微的可恢复变形、未发生破裂的损伤)、四级损伤(例如,无法人工修复的损伤)等,从预设的车险理赔数据库(例如,所述车险理赔数据库存储有预设车损级别分类、车损部位和定损照片三者的映射关系或标签数据,所述定损照片指的是修理厂在定损时拍摄的照片)获取各个车损部位对应各个预设车损级别分类的预设数量(例如,10万张)定损照片,例如,获取10万张对应左前门,且是一级损伤的定损照片。服务器按照预设的模型生成规则,基于获取的各个车损部位对应各 个预设车损级别分类的定损照片,生成用于分析定损照片对应的预设车损级别分类的第二预设类型模型(例如,基于一级损伤对应的各车损部位已发生的预设数量定损照片,生成用于分析定损照片对应的车损级别的第二预设类型模型)。In this embodiment, the second preset type model is a convolutional neural network (CNN) model, and the generating step of the second preset type model includes: the server classifies according to a preset vehicle loss level, for example, the pre- The classification of vehicle damage levels includes primary damage (for example, damage without deformation, no rupture), secondary damage (for example, 2 or less slight recoverable deformation, damage without rupture), and tertiary damage (1) More than one serious recoverable deformation or more than three minor recoverable deformations, no rupture damage), four-level damage (for example, damage that cannot be repaired manually), etc., from a preset auto insurance claim database (for example, The auto insurance claim database stores the mapping relationship or tag data of the preset car damage level classification, the car damage part and the fixed loss photo, and the fixed loss photo refers to the photo taken by the repair shop at the time of the loss). The part corresponds to a preset number (for example, 100,000 sheets) of the predetermined preset vehicle damage level classification, for example, obtaining 100,000 corresponding left front doors, and is a fixed-loss photo of the first-level damage. The server generates rules according to the preset model, and each of the obtained vehicle damage parts is corresponding to each a fixed-length photo of the preset car damage level classification, generating a second preset type model for analyzing the preset car damage level classification corresponding to the fixed-loss photo (for example, based on the car damage parts corresponding to the first-level damage) The preset number of fixed loss photos is generated, and a second preset type model for analyzing the car damage level corresponding to the fixed loss photo is generated.
所述预设的模型生成规则为:The preset model generation rule is:
对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将获取的定损照片转化成预设尺寸,并将转化成预设尺寸的定损照片的格式转化为预设格式(例如,leveldb格式);利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的CNN模型,以生成各个车损部位对应各个预设车损级别分类的CNN模型。训练的目的是优化CNN模型内各权重的值,使得CNN模型作为整体在实际应用中能较好地适用于各个车损部位对应各个预设车损级别的分类。CNN模型可以有七层,分别是五个卷积层、一个降采样层和一个全连接层。其中,卷积层由很多个特征向量构造的特征图形成,而特征图的作用就是利用卷积滤波器提取关键特征。降采样层的作用是通过采样方法,去除重复表达的特征点,减少特征提取的数量,从而提高网络层间数据通信效率,可用的采样方法包括最大采样法、均值采样法、随机采样法。全连接层的作用是连接前面的卷积层与降采样,并计算权重矩阵,用于后续的实际分类。图片进入CNN模型后,在每一层均经过前向迭代与后向迭代两个过程,每一次迭代生成一个概率分布,多次迭代后的概率分布进行叠加,系统选取概率分布中取得最大值的类别作为最终的分类结果。Pre-processing the fixed loss photos of each of the obtained vehicle damage parts corresponding to each preset vehicle damage level to convert the obtained fixed loss photos into preset sizes, and convert the format of the fixed-length photos converted into preset sizes into For the preset format (for example, leveldb format), the CNN model of the preset model structure is trained by using the preset preset image of each of the preset car damage levels corresponding to each car damage part to generate each car damage part corresponding to each The CNN model of the preset car damage level classification. The purpose of the training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification of each car damage location corresponding to each preset car damage level in practical applications. The CNN model can have seven layers, five convolutional layers, one downsampled layer, and one fully connected layer. The convolutional layer is formed by a feature map constructed by a plurality of feature vectors, and the function of the feature map is to extract key features by using a convolution filter. The function of the downsampling layer is to remove the feature points of repeated expression and reduce the number of feature extractions by sampling method, thereby improving the efficiency of data communication between network layers. The available sampling methods include maximum sampling method, mean sampling method and random sampling method. The role of the fully connected layer is to connect the previous convolutional layer with downsampling and calculate the weight matrix for subsequent actual classification. After entering the CNN model, each image undergoes two processes: forward iteration and backward iteration. Each iteration generates a probability distribution. The probability distributions after multiple iterations are superimposed, and the system selects the probability distribution to obtain the maximum value. The category is the final classification result.
本发明进一步提供一种车损识别系统,该车损识别系统运行在上述服务器1中。The present invention further provides a vehicle damage recognition system that operates in the server 1 described above.
参照图4,图4为本发明车损识别系统10第一实施例的功能模块示意图。Referring to FIG. 4, FIG. 4 is a schematic diagram of functional modules of the first embodiment of the vehicle damage recognition system 10 of the present invention.
在第一实施例中,该车损识别系统10包括:In the first embodiment, the vehicle damage recognition system 10 includes:
第一分析模块01,用于接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;The first analysis module 01 is configured to receive a fixed loss request that is sent by the user through the first terminal, and use the preset first preset type model to analyze the fixed loss photo to obtain the fixed loss photo. Corresponding first vehicle damage part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
本实施例中,第一分析模块01接收用户通过第一终端(例如,手机、平板电脑、手持设备等)发出的一个包含用户上传的包括待定损车损部位的定损照片(例如,车损部位的特写照片)的定损请求。在一种实施方式中,可在第一终端中预先安装车险理赔应用程序APP,用户打开该车险理赔应用程序APP并通过该车险理赔应用程序APP向第一分析模块01发送定损请求;在另一种实施方式中,第一终端中预先安装有浏览器系统,用户可以通过该浏览器系统访问车损识别系统10的第一分析模块01,并通过该浏览器系统向第一分析模块01发送定损请求。In this embodiment, the first analysis module 01 receives a fixed-loss photo (for example, a vehicle damage) that is sent by the user through the first terminal (for example, a mobile phone, a tablet computer, a handheld device, etc.) and includes a user-supplied part including a to-be-determined damage. A close-up photo of the part) of the damage request. In an embodiment, the auto insurance claim application APP may be pre-installed in the first terminal, and the user opens the auto insurance claim application APP and sends a loss request to the first analysis module 01 through the auto insurance claim application APP; In an embodiment, a browser system is pre-installed in the first terminal, and the user can access the first analysis module 01 of the vehicle damage recognition system 10 through the browser system, and send the first analysis module 01 to the first analysis module 01 through the browser system. Fixed loss request.
第一分析模块01在收到用户发出的包含定损照片的定损请求后,利用预 先生成的第一预设类型模型对获取的定损照片进行分析,以分析出所述定损照片对应的第一车损部位分类信息(例如,车前方、侧面、车尾、整体等),并将分析出的第一车损部位分类信息返回给该第一终端并在该第一终端的预先确定的操作界面进行显示(例如,将分析出的第一车损部位分类信息返回给该第一终端的车险理赔应用程序APP并在该车险理赔应用程序APP生成的操作界面上进行显示)。The first analysis module 01 uses the pre-determination after receiving the request for the loss of the fixed-length photo sent by the user. The first preset type model generated first analyzes the acquired fixed loss photo to analyze the first car damage part classification information corresponding to the fixed loss photo (for example, front, side, rear, overall, etc.) And returning the analyzed first vehicle damage part classification information to the first terminal and displaying it on a predetermined operation interface of the first terminal (for example, returning the analyzed first vehicle damage part classification information to the first A terminal auto insurance claim application APP is displayed on the operation interface generated by the auto insurance claim application APP).
第二分析模块02,用于若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;The second analysis module 02 is configured to: if the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, use the preset first preset type model to Performing analysis on the damage photo, obtaining the second vehicle damage part classification information corresponding to the fixed loss photograph, and returning the second vehicle damage part classification information to the first terminal for display;
第二分析模块02接收该用户通过该第一终端发出的对所述第一车损部位分类信息的反馈信息,如确认所述第一车损部位分类信息无误的确认指令或否定所述第一车损部位分类信息的拒绝指令。需要说明的是,本实施例中,第二分析模块02可以接收用户通过按钮、触摸、按压、摇晃手机、指纹等多种方式发送的指令,如在该第一终端的预先确定的操作界面上显示所述第一车损部位分类信息后,用户可以通过长按该第一终端屏幕或短按该第一终端屏幕的方式向第二分析模块02发送对所述第一车损部位分类信息的反馈信息如确认指令、拒绝指令等,在此不做限定,本实施例中仅以用户通过该第一终端上点击按钮的方式向第二分析模块02发送反馈信息为例进行具体说明。该第一终端的预先确定的操作界面包括车损部位分类信息显示区域、车损部位分类信息确认按钮及车损部位分类信息拒绝按钮;若该用户通过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息,则车损识别系统10结束车损部位识别流程,或者,若该用户通过所述车损部位分类信息拒绝按钮拒绝所述第一车损部位分类信息,则第二分析模块02再次利用生成的第一预设类型模型对获取的定损照片进行分析,以分析出所述定损照片对应的第二车损部位分类信息,该第二车损部位分类信息为利用第一预设类型模型对获取的所述定损照片进行重新分析后得到的,该第二车损部位分类信息可与所述第一车损部位分类信息相同,也可与所述第一车损部位分类信息不同。将分析出的第二车损部位分类信息返回给该第一终端并在该第一终端的预先确定的操作界面进行显示。The second analysis module 02 receives the feedback information of the first vehicle damage part classification information sent by the user through the first terminal, such as confirming that the first vehicle damage part classification information is correct or confirming the first Rejection instruction for classification information of vehicle damage parts. It should be noted that, in this embodiment, the second analysis module 02 can receive an instruction sent by the user by using a button, a touch, a press, a shaking mobile phone, a fingerprint, and the like, such as on a predetermined operation interface of the first terminal. After displaying the first vehicle damage part classification information, the user may send the classification information of the first vehicle damage part to the second analysis module 02 by long pressing the first terminal screen or short pressing the first terminal screen. The feedback information, such as the acknowledgment command, the refusal command, and the like, is not limited herein. In this embodiment, only the user sends the feedback information to the second analysis module 02 by clicking the button on the first terminal. The predetermined operation interface of the first terminal includes a vehicle damage part classification information display area, a vehicle damage part classification information confirmation button, and a vehicle damage part classification information rejection button; if the user confirms the vehicle by using the vehicle damage part classification information confirmation button When the first vehicle damage part classification information is described, the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user rejects the first vehicle damage part classification information by the vehicle damage part classification information rejection button, The second analysis module 02 analyzes the acquired fixed loss photo by using the generated first preset type model to analyze the second vehicle damage part classification information corresponding to the fixed loss photo, and the second vehicle damage part classification information is After the re-analysis of the obtained fixed-loss photo by using the first preset type model, the second vehicle-loss part classification information may be the same as the first vehicle-loss part classification information, or may be the first The classification information of the vehicle damage parts is different. The analyzed second vehicle damage part classification information is returned to the first terminal and displayed on a predetermined operation interface of the first terminal.
人工识别模块03,用于若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。The manual identification module 03 is configured to: if the user receives the rejection instruction for the second vehicle damage part classification information sent by the first terminal, send the vehicle to the predetermined second terminal The manual identification of the damage part is to manually identify the damage part.
若该用户通过所述车损部位分类信息确认按钮确认所述第二车损部位分类信息,则车损识别系统10结束车损部位识别流程,或者,若该用户通过所述车损部位分类信息拒绝按钮拒绝所述第二车损部位分类信息,则人工识别模块03向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。 If the user confirms the second vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user passes the vehicle damage part classification information When the reject button rejects the second vehicle damage part classification information, the manual identification module 03 sends a command for manually identifying the vehicle damage part to the fixed loss photo to the predetermined second terminal (for example, the terminal of the vehicle risk determination personnel). , to manually identify the car damage parts.
本实施例通过预设的第一预设类型模型对定损照片进行分析得到第一车损部位分类信息,若用户否定该第一车损部位分类信息,则再次利用预设的第一预设类型模型对所述定损照片进行分析得到第二车损部位分类信息,若用户否定该第二车损部位分类信息,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。由于在与用户进行车损自动识别时,利用第一预设类型模型对定损照片进行两次自动识别,提高了识别精度及通过率,节省了人力物力。而且,在两次自动识别均无法确认车损部位时,对定损照片进行车损部位人工识别,避免了因无法自动识别车损部位导致受损部位检测遗漏或者是识别错误的情况发生,提高了车损识别的准确率和查全率。In this embodiment, the first damage type photo is analyzed by using a preset first preset type model to obtain the first vehicle damage part classification information. If the user denies the first vehicle damage part classification information, the preset first preset is used again. The type model analyzes the fixed loss photo to obtain the second vehicle damage part classification information, and if the user denies the second vehicle damage part classification information, sends the vehicle damage part to the fixed loss photo to the predetermined second terminal. Manually recognized instructions to manually identify the damage location. Because the automatic identification of the vehicle damage is carried out with the user, the first preset type model is used to automatically identify the fixed loss photo twice, which improves the recognition accuracy and the passing rate, and saves manpower and material resources. Moreover, when the vehicle damage portion cannot be confirmed by two automatic recognitions, the vehicle damage portion is manually recognized for the fixed-loss photograph, thereby avoiding the occurrence of the missing portion of the damaged portion or the recognition error due to the inability to automatically identify the vehicle damage portion, and improving The accuracy and recall rate of vehicle damage identification.
进一步地,在其他实施例中,上述第二分析模块02还用于:Further, in other embodiments, the foregoing second analysis module 02 is further configured to:
接收该第一终端发送的定损照片特征区域,对所述定损照片特征区域进行分析,得到对应的第二车损部位分类信息,其中,所述定损照片特征区域为通过如下方式得到:若接收到该用户通过该第一终端发出的车损部位人工框定指令,则由该第一终端在所述定损照片的显示区域的预设位置生成预设尺寸和形状的区域选择框,该区域选择框用于供用户向预设方向调整当前区域选择框以框选定损照片特征区域。And receiving the fixed loss photo feature area sent by the first terminal, and analyzing the fixed loss photo feature area to obtain corresponding second car damage part classification information, wherein the fixed loss photo feature area is obtained by: Receiving, by the first terminal, a frame selection frame of a preset size and shape in a preset position of the display area of the fixed-loss photo, if the user manually receives a command for the vehicle damage location issued by the first terminal, The area selection box is used for the user to adjust the current area selection box to the preset direction to select the damaged photo feature area.
本实施例中,该第一终端的预先确定的操作界面还包括定损照片显示区域及车损部位人工框定按钮。若该用户通过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息,则车损识别系统10结束车损部位识别流程,或者,若收到用户通过所述车损部位人工框定按钮发出的车损部位人工框定指令或通过所述车损部位分类信息拒绝按钮拒绝所述第一车损部位分类信息,则该第一终端响应该指令(例如,该第一终端的车险理赔应用程序APP响应该指令),在所述定损照片显示区域的预设位置(例如,几何中心位置)生成预设尺寸和形状(例如,X*Y像素的长方形)的区域选择框,该区域选择框用于供用户人工向预设方向(例如,上、下、左、右)动态调整当前区域选择框所包含的定损照片区域的边界线,以框选出用户选中的定损照片特征区域。该第一终端若收到用户发出的包含基于所述区域选择框选择的定损照片特征区域的二次识别指令,则该第一终端(例如,该第一终端的车险理赔应用程序APP)响应该二次识别指令,并将所述定损照片特征区域发送给第二分析模块02。第二分析模块02在收到所述定损照片特征区域后,对所述定损照片特征区域进行分析,以分析出所述定损照片对应的第二车损部位分类信息。In this embodiment, the predetermined operation interface of the first terminal further includes a fixed photo display area and a vehicle frame manual button. If the user confirms the first vehicle damage part classification information by using the vehicle damage part classification information confirmation button, the vehicle damage recognition system 10 ends the vehicle damage part identification process, or if the user receives the vehicle damage through the vehicle damage part The first terminal responds to the instruction (for example, the first terminal's auto insurance claim) by manually instructing the vehicle damage portion issued by the frame button or rejecting the first vehicle damage portion classification information through the vehicle damage portion classification information rejection button. The application APP responds to the instruction to generate an area selection frame of a preset size and shape (for example, a rectangle of X*Y pixels) at a preset position (for example, a geometric center position) of the fixed-loss photo display area, the area The selection box is used for the user to manually adjust the boundary line of the fixed loss photo area included in the current area selection box to the preset direction (for example, up, down, left, and right) to select the selected loss photo feature selected by the user. region. Receiving, by the first terminal, a secondary identification instruction issued by the user that includes the fixed loss photo feature area selected based on the area selection box, the first terminal (eg, the first terminal's auto insurance claim application APP) rings The instruction should be recognized twice, and the fixed loss photo feature area is sent to the second analysis module 02. After receiving the fixed loss photo feature area, the second analysis module 02 analyzes the fixed loss photo feature area to analyze the second car damage part classification information corresponding to the fixed loss photo.
本实施例中,在初次对所述定损照片进行分析得到的第一车损部位分类信息被用户认定为错误分类信息而拒绝时,在对所述定损照片进行再次分析之前,先由用户人工框选其认定的定损照片特征区域,再对该定损照片特征区域进行二次分析得到对应的第二车损部位分类信息。由于在二次分析中,是对经用户确认更细化的定损照片特征区域进行分析,有效地提高了二次识 别的准确性。In this embodiment, when the first car damage part classification information obtained by analyzing the fixed loss photo is rejected by the user as the misclassification information, the user is first analyzed by the user before re-analysing the fixed loss photo. The identified feature area of the fixed loss photo is manually selected, and then the secondary damage analysis feature area is subjected to secondary analysis to obtain the corresponding second vehicle damage part classification information. In the secondary analysis, it is an analysis of the feature area of the fixed loss photo that is confirmed by the user, which effectively improves the secondary knowledge. Other accuracy.
进一步地,在其他实施例中,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。Further, in other embodiments, the generating step of the first preset type model includes: obtaining, according to a preset vehicle damage part classification, a claim photo corresponding to each preset car damage part classification from a preset car insurance claim database, Pre-processing the claim photo corresponding to each preset car damage part classification to convert the format of the claim photo into a preset format; using the preset preset format picture corresponding to each preset car damage part classification, training pre- A convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset car damage location classification.
所述第一预设类型模型为卷积神经网络(CNN)模型,所述第一预设类型模型生成规则为:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对获取的各个预设车损部位分类对应的理赔照片进行预处理,以将获取的理赔照片的格式转化为预设格式(例如,leveldb格式);利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的CNN模型,以生成各个预设车损部位分类对应的CNN模型。训练的目的是优化CNN模型内各权重的值,使得CNN模型作为整体在实际应用中可较好地适用于车损部位分类识别。具体的训练过程如下:训练开始前,系统随机且均匀地生成CNN模型内各权重的初始值(例如-0.05至0.05)。采用随机梯度下降法对CNN模型进行训练。整个训练过程可分为向前传播和向后传播两个阶段。在向前传播阶段,系统从训练数据集中随机提取样本,输入CNN网络进行计算,并得到实际计算结果。在向后传播过程中,计算实际结果与期望结果的差值,然后利用误差最小化定位方法反向调整各权重的值,同时计算该次调整产生的有效误差。训练过程反复迭代若干次(例如100次),当CNN模型整体有效误差小于预先设定的阈值(例如正负0.01)时,训练结束。The first preset type model is a convolutional neural network (CNN) model, and the first preset type model generating rule is: acquiring each preset car from a preset car insurance claim database according to a preset car damage part classification The claim photo corresponding to the damage part is classified, and the obtained claim photo of the preset car damage part classification is preprocessed to convert the obtained claim photo format into a preset format (for example, leveldb format); Each of the preset car damage parts is classified into a preset format picture, and the CNN model of the preset model structure is trained to generate a CNN model corresponding to each preset car damage part classification. The purpose of training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification and identification of vehicle damage parts in practical applications. The specific training process is as follows: Before the training starts, the system randomly and uniformly generates the initial values of the weights in the CNN model (for example, -0.05 to 0.05). The CNN model was trained using a stochastic gradient descent method. The entire training process can be divided into two stages: forward propagation and backward propagation. In the forward propagation phase, the system randomly samples the samples from the training data set, inputs them into the CNN network for calculation, and obtains the actual calculation results. In the backward propagation process, the difference between the actual result and the expected result is calculated, and then the value of each weight is inversely adjusted by the error minimization positioning method, and the effective error generated by the adjustment is calculated at the same time. The training process is iterated several times (for example, 100 times), and the training ends when the overall effective error of the CNN model is less than a predetermined threshold (for example, plus or minus 0.01).
如图5所示,本发明第二实施例提出一种车损识别系统10,在上述实施例的基础上,还包括:As shown in FIG. 5, a second embodiment of the present invention provides a vehicle damage recognition system 10. Based on the foregoing embodiments, the method further includes:
第三分析模块04,用于在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The third analysis module 04 is configured to: after receiving the confirmation instruction for the first vehicle damage part classification information or the second vehicle damage part classification information sent by the first terminal, the preset second preset The type model analyzes the fixed loss photo, determines the vehicle damage level corresponding to the fixed loss photo, and finds the determined vehicle damage location according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode. And the repairing method corresponding to the vehicle damage level, and returning the determined vehicle damage part, the vehicle damage level and the corresponding repairing manner to the first terminal for display;
所述人工识别模块03还用于若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。The manual identification module 03 is further configured to: if receiving, by the first terminal, a rejection instruction for the vehicle damage level or the repair mode, send the determined loss photo to the predetermined second terminal. The manual identification of the vehicle damage level or the manual identification of the repair method to manually identify the damage level or repair method.
本实施例中,该第一终端的预先确定的操作界面还包括车损级别信息显示区域和修理方式信息显示区域,所述车损部位分类信息显示区域、车损级别信息显示区域和修理方式信息显示区域分别对应一个选择项。在该用户通 过所述车损部位分类信息确认按钮确认所述第一车损部位分类信息或者第二车损部位分类信息后,第三分析模块04通过预先生成的第二预设类型模型对所述定损照片进行分析,以确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式(例如,对于钣金件而言,修理方式包括仅全喷、轻度钣金、轻度钣金+全喷、重度钣金+全喷、更换等),并将确定的第一车损部位分类信息及其对应的车损级别和修理方式返回给该第一终端并在该第一终端的预先确定的操作界面进行显示,或者,将确定的第二车损部位分类信息及其对应的车损级别和修理方式返回给该第一终端并在该第一终端的预先确定的操作界面进行显示。In this embodiment, the predetermined operation interface of the first terminal further includes a vehicle damage level information display area and a repair mode information display area, the vehicle damage part classification information display area, the vehicle damage level information display area, and the repair mode information. The display areas correspond to one selection item. In the user pass After the vehicle damage part classification information confirmation button confirms the first vehicle damage part classification information or the second vehicle damage part classification information, the third analysis module 04 corrects the fixed loss by using a second preset type model generated in advance. The photo is analyzed to determine the vehicle damage level corresponding to the fixed loss photo, and the determined vehicle damage location and the vehicle damage level are determined according to the mapping relationship between the pre-stored vehicle damage location, the vehicle damage level and the repair mode. Repair method (for example, for sheet metal parts, repair methods include only full spray, light sheet metal, light sheet metal + full spray, heavy sheet metal + full spray, replacement, etc.), and the first car will be determined The damage part classification information and its corresponding vehicle damage level and repair mode are returned to the first terminal and displayed on a predetermined operation interface of the first terminal, or the determined second vehicle damage part classification information and corresponding The vehicle damage level and repair mode are returned to the first terminal and displayed at a predetermined operational interface of the first terminal.
若用户通过所述车损级别信息显示区域对应的选择项选中确定的车损级别,且该用户通过所述车损部位分类信息拒绝按钮拒绝选中的车损级别,则说明用户认为当前自动识别出的车损级别有误,则人工识别模块03向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行车损级别识别的指令,以对车损级别进行人工识别。If the user selects the determined vehicle damage level by the selection item corresponding to the vehicle damage level information display area, and the user rejects the selected vehicle damage level by using the vehicle loss part classification information rejection button, the user believes that the current automatic recognition is performed. If the vehicle damage level is incorrect, the manual identification module 03 sends a command for identifying the damage level of the fixed loss photo to the predetermined second terminal (for example, the terminal of the vehicle risk-determining person) to perform the vehicle damage level. Manual identification.
若用户通过所述修理方式信息显示区域对应的选择项选中确定的修理方式,且该用户通过所述车损部位分类信息拒绝按钮拒绝选中的修理方式,则说明用户认为当前自动识别出的修理方式有误,则人工识别模块03向预先确定的第二终端(例如,车险定损人员的终端)发送对所述定损照片进行修理方式识别的指令,以对修理方式进行人工识别。If the user selects the determined repair mode through the selection item corresponding to the repair mode information display area, and the user rejects the selected repair mode by using the vehicle damage part classification information rejection button, the user automatically believes that the repair method is currently recognized. If there is an error, the manual identification module 03 sends an instruction to identify the repair mode of the fixed-loss photo to a predetermined second terminal (for example, the terminal of the car-losing person) to manually identify the repair mode.
本实施例中,在正确识别出所述定损照片对应的车损部位之后,进一步地,还能自动识别出确定的该车损部位所对应的车损级别及修理方式,并在识别出的车损级别及修理方式有误时,进行人工识别,能更加全面的进行车损识别,以更加方便、快捷的进行后续的车损处理。In this embodiment, after the vehicle damage portion corresponding to the fixed-loss photo is correctly recognized, the determined vehicle damage level and the repair mode corresponding to the determined vehicle damage portion are further automatically recognized, and the identified When the vehicle damage level and repair method are wrong, manual identification can be carried out to more comprehensively identify the vehicle damage, so that the subsequent vehicle damage treatment can be carried out more conveniently and quickly.
进一步地,在其他实施例中,所述第二预设类型模型的生成步骤包括:Further, in other embodiments, the generating step of the second preset type model includes:
根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
本实施例中,所述第二预设类型模型为卷积神经网络(CNN)模型,所述第二预设类型模型的生成步骤包括:根据预设车损级别分类,例如,所述预设车损级别分类包括一级损伤(例如,未发生变形、未发生破裂的损伤)、二级损伤(例如,2个以下轻微的可恢复变形、未发生破裂的损伤)、三级损伤(1个以上严重的可恢复变形或者3个以上轻微的可恢复变形、未发生破裂的损伤)、四级损伤(例如,无法人工修复的损伤)等,从预设的车险理赔数据库(例如,所述车险理赔数据库存储有预设车损级别分类、车损部位和定 损照片三者的映射关系或标签数据,所述定损照片指的是修理厂在定损时拍摄的照片)获取各个车损部位对应各个预设车损级别分类的预设数量(例如,10万张)定损照片,例如,获取10万张对应左前门,且是一级损伤的定损照片。按照预设的模型生成规则,基于获取的各个车损部位对应各个预设车损级别分类的定损照片,生成用于分析定损照片对应的预设车损级别分类的第二预设类型模型(例如,基于一级损伤对应的各车损部位已发生的预设数量定损照片,生成用于分析定损照片对应的车损级别的第二预设类型模型)。In this embodiment, the second preset type model is a convolutional neural network (CNN) model, and the generating step of the second preset type model includes: classifying according to a preset vehicle damage level, for example, the preset The classification of vehicle damage levels includes primary damage (for example, damage without deformation, no rupture), secondary damage (for example, 2 or less slight recoverable deformation, damage without rupture), and tertiary damage (1 The above severe recoverable deformation or more than three minor recoverable deformations, no rupture damage), four-level damage (for example, damage that cannot be repaired manually), etc., from a preset auto insurance claim database (for example, the auto insurance) The claim database stores the preset car damage level classification, the car damage location and the fixed The mapping relationship or label data of the photo loss, the photo of the fixed loss refers to the photo taken by the repair shop at the time of the loss determination) the preset number of each car damage location corresponding to each preset car damage level classification (for example, 10 10,000 sheets) Fixed loss photos, for example, 100,000 corresponding left front doors, and are damage photos of the first level damage. According to the preset model generation rule, a second preset type model for analyzing the preset vehicle damage level classification corresponding to the fixed loss photo is generated based on the obtained fixed loss photos corresponding to the respective preset vehicle damage levels. (For example, based on a predetermined number of fixed-loss photos that have occurred in each vehicle damage portion corresponding to the first-level damage, a second preset type model for analyzing the vehicle damage level corresponding to the fixed-loss photo is generated).
所述预设的模型生成规则为:The preset model generation rule is:
对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将获取的定损照片转化成预设尺寸,并将转化成预设尺寸的定损照片的格式转化为预设格式(例如,leveldb格式);利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的CNN模型,以生成各个车损部位对应各个预设车损级别分类的CNN模型。训练的目的是优化CNN模型内各权重的值,使得CNN模型作为整体在实际应用中能较好地适用于各个车损部位对应各个预设车损级别的分类。CNN模型可以有七层,分别是五个卷积层、一个降采样层和一个全连接层。其中,卷积层由很多个特征向量构造的特征图形成,而特征图的作用就是利用卷积滤波器提取关键特征。降采样层的作用是通过采样方法,去除重复表达的特征点,减少特征提取的数量,从而提高网络层间数据通信效率,可用的采样方法包括最大采样法、均值采样法、随机采样法。全连接层的作用是连接前面的卷积层与降采样,并计算权重矩阵,用于后续的实际分类。图片进入CNN模型后,在每一层均经过前向迭代与后向迭代两个过程,每一次迭代生成一个概率分布,多次迭代后的概率分布进行叠加,系统选取概率分布中取得最大值的类别作为最终的分类结果。Pre-processing the fixed loss photos of each of the obtained vehicle damage parts corresponding to each preset vehicle damage level to convert the obtained fixed loss photos into preset sizes, and convert the format of the fixed-length photos converted into preset sizes into For the preset format (for example, leveldb format), the CNN model of the preset model structure is trained by using the preset preset image of each of the preset car damage levels corresponding to each car damage part to generate each car damage part corresponding to each The CNN model of the preset car damage level classification. The purpose of the training is to optimize the values of the weights in the CNN model, so that the CNN model as a whole can be well applied to the classification of each car damage location corresponding to each preset car damage level in practical applications. The CNN model can have seven layers, five convolutional layers, one downsampled layer, and one fully connected layer. The convolutional layer is formed by a feature map constructed by a plurality of feature vectors, and the function of the feature map is to extract key features by using a convolution filter. The function of the downsampling layer is to remove the feature points of repeated expression and reduce the number of feature extractions by sampling method, thereby improving the efficiency of data communication between network layers. The available sampling methods include maximum sampling method, mean sampling method and random sampling method. The role of the fully connected layer is to connect the previous convolutional layer with downsampling and calculate the weight matrix for subsequent actual classification. After entering the CNN model, each image undergoes two processes: forward iteration and backward iteration. Each iteration generates a probability distribution. The probability distributions after multiple iterations are superimposed, and the system selects the probability distribution to obtain the maximum value. The category is the final classification result.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
以上参照附图说明了本发明的优选实施例,并非因此局限本发明的权利范围。上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。另外,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以以不同于此处的顺序执行所示出或描述的步骤。The preferred embodiments of the present invention have been described above with reference to the drawings, and are not intended to limit the scope of the invention. The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments. Additionally, although logical sequences are shown in the flowcharts, in some cases the steps shown or described may be performed in a different order than the ones described herein.
本领域技术人员不脱离本发明的范围和实质,可以有多种变型方案实现本发明,比如作为一个实施例的特征可用于另一实施例而得到又一实施例。凡在运用本发明的技术构思之内所作的任何修改、等同替换和改进,均应在本发明的权利范围之内。 A person skilled in the art can implement the invention in various variants without departing from the scope and spirit of the invention. For example, the features of one embodiment can be used in another embodiment to obtain a further embodiment. Any modifications, equivalent substitutions and improvements made within the technical concept of the invention are intended to be included within the scope of the invention.

Claims (20)

  1. 一种车损识别方法,其特征在于,所述方法包括以下步骤:A vehicle damage recognition method, characterized in that the method comprises the following steps:
    A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
    B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, the first predetermined type model is used to analyze the determined loss photo again. The second vehicle damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
    C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
  2. 如权利要求1所述的车损识别方法,其特征在于,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。The vehicle damage recognition method according to claim 1, wherein the generating step of the first preset type model comprises: acquiring each preset vehicle damage from a preset car insurance claim database according to a preset car damage part classification; The claim photo corresponding to the part classification is pre-processed for the claim photo corresponding to each preset car damage part classification, so as to convert the format of the claim photo into a preset format; and the corresponding preset car damage part classification corresponding to the converted The preset format picture is used to train the convolutional neural network model of the preset model structure to generate a convolutional neural network model corresponding to each preset car damage part classification.
  3. 如权利要求1所述的车损识别方法,其特征在于,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,该方法还包括:The vehicle damage recognition method according to claim 1, wherein after receiving the confirmation command for the first vehicle damage part classification information or the second vehicle damage part classification information issued by the first terminal, The method also includes:
    服务器通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
    若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则服务器向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the server sends a manual identification or repair manner of the vehicle damage level to the fixed loss terminal to the predetermined second terminal. Manually identified instructions for manual identification of vehicle damage levels or repair methods.
  4. 如权利要求3所述的车损识别方法,其特征在于,所述第二预设类型模型的生成步骤包括:The vehicle damage recognition method according to claim 3, wherein the generating step of the second preset type model comprises:
    根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损 部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- Set the convolutional neural network model of the model structure to generate individual vehicle losses The convolutional neural network model corresponding to each preset car damage level is corresponding to the part.
  5. 如权利要求1所述的车损识别方法,其特征在于,所述步骤B替换为:The vehicle damage recognition method according to claim 1, wherein said step B is replaced by:
    B1、若接收到该用户通过该第一终端发出的车损部位人工框定指令,则由该第一终端在所述定损照片的显示区域的预设位置生成预设尺寸和形状的区域选择框,该区域选择框用于供用户向预设方向调整当前区域选择框以框选定损照片特征区域;将所述定损照片特征区域发送给服务器;B1. If the manual frame instruction is received by the user through the first terminal, the first terminal generates an area selection frame of a preset size and shape at a preset position of the display area of the fixed loss photo. The area selection box is used for the user to adjust the current area selection box to the preset direction to select the damaged photo feature area; and send the fixed loss photo feature area to the server;
    B2、服务器接收所述定损照片特征区域,对所述定损照片特征区域进行分析,得到对应的第二车损部位分类信息。B2. The server receives the fixed loss photo feature area, and analyzes the fixed loss photo feature area to obtain corresponding second car damage part classification information.
  6. 如权利要求5所述的车损识别方法,其特征在于,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。The vehicle damage recognition method according to claim 5, wherein the generating step of the first preset type model comprises: obtaining each preset vehicle damage from a preset car insurance claim database according to a preset car damage part classification The claim photo corresponding to the part classification is pre-processed for the claim photo corresponding to each preset car damage part classification, so as to convert the format of the claim photo into a preset format; and the corresponding preset car damage part classification corresponding to the converted The preset format picture is used to train the convolutional neural network model of the preset model structure to generate a convolutional neural network model corresponding to each preset car damage part classification.
  7. 如权利要求5所述的车损识别方法,其特征在于,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,该方法还包括:The vehicle damage recognition method according to claim 5, wherein after receiving the confirmation command for the first vehicle damage part classification information or the second vehicle damage part classification information issued by the first terminal, The method also includes:
    服务器通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
    若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则服务器向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the server sends a manual identification or repair manner of the vehicle damage level to the fixed loss terminal to the predetermined second terminal. Manually identified instructions for manual identification of vehicle damage levels or repair methods.
  8. 如权利要求7所述的车损识别方法,其特征在于,所述第二预设类型模型的生成步骤包括:The vehicle damage recognition method according to claim 7, wherein the generating step of the second preset type model comprises:
    根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
  9. 一种服务器,其特征在于,包括处理设备及与所述处理设备连接的存储设备,该存储设备存储有车损识别系统,该车损识别系统包括至少一个计算机可读指令,该至少一个计算机可读指令可被所述处理设备执行,以实现以下操作:A server, comprising: a processing device and a storage device connected to the processing device, the storage device storing a vehicle damage recognition system, the vehicle damage recognition system comprising at least one computer readable instruction, the at least one computer A read command can be executed by the processing device to:
    A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用 预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives the fixed loss request sent by the user through the first terminal and includes the fixed loss photo, and utilizes The preset first preset type model analyzes the fixed loss photo, obtains the first vehicle damage part classification information corresponding to the fixed loss photo, and returns the first vehicle damage part classification information to the first The terminal performs display;
    B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage location information sent by the first terminal, the first predetermined type model is used to analyze the determined loss photo again. The second vehicle damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
    C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
  10. 如权利要求9所述的服务器,其特征在于,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。The server according to claim 9, wherein the generating step of the first preset type model comprises: obtaining, according to a preset car damage part classification, a corresponding car damage part classification corresponding from a preset car insurance claim database The claim photo, pre-processing the claim photo corresponding to each preset car damage part classification, to convert the format of the claim photo into a preset format; using the preset preset format corresponding to each preset car damage part classification Picture, a convolutional neural network model of the preset model structure is trained to generate a convolutional neural network model corresponding to each of the preset vehicle loss parts.
  11. 如权利要求9所述的服务器,其特征在于,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,该至少一个计算机可读指令还可被所述处理设备执行,以实现以下步骤:The server according to claim 9, wherein after receiving the confirmation instruction for the first vehicle damage part classification information or the second vehicle damage part classification information issued by the first terminal, the at least one Computer readable instructions may also be executed by the processing device to implement the following steps:
    通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The fixed loss photo is analyzed by a preset second preset type model, and the car damage level corresponding to the fixed loss photo is determined, according to the mapping relationship between the pre-stored car damage part, the car damage level and the repair mode. Finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
    若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or the repair mode issued by the first terminal, transmitting, to the predetermined second terminal, the vehicle damage level manual identification or the repair method manually The identified instructions are manually identified for the level of damage or repair.
  12. 如权利要求11所述的服务器,其特征在于,所述第二预设类型模型的生成步骤包括:The server according to claim 11, wherein the generating step of the second preset type model comprises:
    根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
  13. 如权利要求9所述的服务器,其特征在于,所述步骤B替换为:The server of claim 9 wherein said step B is replaced by:
    B1、若接收到该用户通过该第一终端发出的车损部位人工框定指令,则由该第一终端在所述定损照片的显示区域的预设位置生成预设尺寸和形状的 区域选择框,该区域选择框用于供用户向预设方向调整当前区域选择框以框选定损照片特征区域;将所述定损照片特征区域发送给服务器;B1. If the user manually receives a command from the user to send a car damage location by the first terminal, the first terminal generates a preset size and shape in a preset position of the display area of the fixed loss photo. An area selection box, wherein the area selection box is used for the user to adjust the current area selection box to the preset direction to select the damaged photo feature area; and send the fixed loss photo feature area to the server;
    B2、服务器接收所述定损照片特征区域,对所述定损照片特征区域进行分析,得到对应的第二车损部位分类信息。B2. The server receives the fixed loss photo feature area, and analyzes the fixed loss photo feature area to obtain corresponding second car damage part classification information.
  14. 如权利要求13所述的服务器,其特征在于,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。The server according to claim 13, wherein the generating step of the first preset type model comprises: obtaining, according to a preset car damage part classification, a corresponding car damage part classification corresponding from a preset car insurance claim database The claim photo, pre-processing the claim photo corresponding to each preset car damage part classification, to convert the format of the claim photo into a preset format; using the preset preset format corresponding to each preset car damage part classification Picture, a convolutional neural network model of the preset model structure is trained to generate a convolutional neural network model corresponding to each of the preset vehicle loss parts.
  15. 如权利要求13所述的服务器,其特征在于,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,该至少一个计算机可读指令还可被所述处理设备执行,以实现以下步骤:The server according to claim 13, wherein the at least one after receiving the confirmation instruction of the first vehicle damage part classification information or the second vehicle loss part classification information sent by the user through the first terminal Computer readable instructions may also be executed by the processing device to implement the following steps:
    服务器通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
    若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则车损识别系统向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the vehicle damage recognition system sends a vehicle damage level manual identification to the fixed loss photo to the predetermined second terminal. Or manually identify the manual identification method to manually identify the damage level or repair method.
  16. 如权利要求15所述的服务器,其特征在于,所述第二预设类型模型的生成步骤包括:The server according to claim 15, wherein the generating step of the second preset type model comprises:
    根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
  17. 一种计算机可读存储介质,其上存储有至少一个可被处理设备执行以实现以下操作的计算机可读指令:A computer readable storage medium having stored thereon at least one computer readable instruction executable by a processing device to:
    A、服务器接收用户通过第一终端发出的包含定损照片的定损请求,利用预设的第一预设类型模型对所述定损照片进行分析,得到所述定损照片对应的第一车损部位分类信息,并将所述第一车损部位分类信息返回给该第一终端进行显示;A. The server receives the fixed loss request that is sent by the user through the first terminal, and uses the preset first preset type model to analyze the fixed loss photo to obtain the first car corresponding to the fixed loss photo. Losing the part classification information, and returning the first vehicle damage part classification information to the first terminal for display;
    B、若接收到该用户通过该第一终端发出的对所述第一车损部位分类信息的拒绝指令,则再次利用预设的第一预设类型模型对所述定损照片进行分析, 得到所述定损照片对应的第二车损部位分类信息,并将所述第二车损部位分类信息返回给该第一终端进行显示;B. If the user rejects the rejection instruction for the first vehicle damage part classification information sent by the first terminal, the preset first type type model is used to analyze the fixed loss photo again. Obtaining second car damage part classification information corresponding to the fixed loss photo, and returning the second vehicle damage part classification information to the first terminal for display;
    C、若接收到该用户通过该第一终端发出的对所述第二车损部位分类信息的拒绝指令,则向预先确定的第二终端发送对所述定损照片进行车损部位人工识别的指令,以对车损部位进行人工识别。C. If receiving a rejection instruction for the second vehicle damage part classification information sent by the first terminal, sending a manual identification of the vehicle damage location to the fixed loss photo to the predetermined second terminal Instructions to manually identify the damage location.
  18. 如权利要求17所述的存储介质,其特征在于,所述第一预设类型模型的生成步骤包括:根据预设车损部位分类,从预设的车险理赔数据库获取各个预设车损部位分类对应的理赔照片,对各个预设车损部位分类对应的理赔照片进行预处理,以将所述理赔照片的格式转化为预设格式;利用转化后的各个预设车损部位分类对应的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个预设车损部位分类对应的卷积神经网络模型。The storage medium according to claim 17, wherein the generating step of the first preset type model comprises: obtaining, according to a preset car damage part classification, obtaining a preset car damage part classification from a preset car insurance claim database. Corresponding claim photos, pre-processing the claim photos corresponding to each preset car damage part classification, to convert the format of the claim photo into a preset format; using the preset presets corresponding to the converted car damage parts The format picture, the convolutional neural network model of the preset model structure is trained to generate a convolutional neural network model corresponding to each preset car damage part classification.
  19. 如权利要求17所述的存储介质,其特征在于,在接收到该用户通过第一终端发出的对所述第一车损部位分类信息或第二车损部位分类信息的确认指令后,所述计算机可读指令还用于实现以下操作:The storage medium according to claim 17, wherein after receiving the confirmation instruction for the first vehicle damage part classification information or the second vehicle damage part classification information issued by the user through the first terminal, Computer readable instructions are also used to:
    服务器通过预设的第二预设类型模型对所述定损照片进行分析,确定所述定损照片对应的车损级别,根据预存的车损部位、车损级别及修理方式三者间的映射关系,找出确定的车损部位和车损级别对应的修理方式,并将确定的车损部位、车损级别以及对应的修理方式返回给该第一终端进行显示;The server analyzes the fixed loss photo by using a preset second preset type model, determines a car damage level corresponding to the fixed loss photo, and maps according to pre-stored car damage parts, vehicle damage levels and repair methods. Relationship, finding a repair method corresponding to the determined vehicle damage location and the vehicle damage level, and returning the determined vehicle damage location, the vehicle damage level, and the corresponding repair mode to the first terminal for display;
    若接收到该用户通过该第一终端发出的对所述车损级别或修理方式的拒绝指令,则车损识别系统向预先确定的第二终端发送对所述定损照片进行车损级别人工识别或修理方式人工识别的指令,以对车损级别或修理方式进行人工识别。Receiving, by the first terminal, a rejection instruction for the vehicle damage level or repair mode issued by the first terminal, the vehicle damage recognition system sends a vehicle damage level manual identification to the fixed loss photo to the predetermined second terminal. Or manually identify the manual identification method to manually identify the damage level or repair method.
  20. 如权利要求19所述的存储介质,其特征在于,所述第二预设类型模型的生成步骤包括:The storage medium according to claim 19, wherein the generating step of the second preset type model comprises:
    根据预设车损级别分类,从预设的车险理赔数据库获取各个车损部位对应各个预设车损级别分类的预设数量定损照片;对获取的各个车损部位对应各个预设车损级别分类的定损照片进行预处理,以将所述定损照片转化为预设尺寸及预设格式;利用转化后的各个车损部位对应各个预设车损级别分类的预设格式图片,训练预设模型结构的卷积神经网络模型,以生成各个车损部位对应各个预设车损级别分类的卷积神经网络模型。 According to the preset car damage level classification, a predetermined number of fixed loss photos corresponding to each preset car damage level are obtained from the preset car insurance claim database; each of the acquired car damage parts corresponds to each preset car damage level. The classified fixed loss photo is preprocessed to convert the fixed loss photo into a preset size and a preset format; and the preset pre-format image corresponding to each preset car damage level is converted by using each converted car damage part, and the training pre- The convolutional neural network model of the model structure is set to generate a convolutional neural network model corresponding to each preset vehicle damage level.
PCT/CN2017/091373 2017-03-13 2017-06-30 Car damage recognition method, electronic apparatus and computer-readable storage medium WO2018166116A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710147701.1 2017-03-13
CN201710147701.1A CN107092922B (en) 2017-03-13 2017-03-13 Vehicle damages recognition methods and server

Publications (1)

Publication Number Publication Date
WO2018166116A1 true WO2018166116A1 (en) 2018-09-20

Family

ID=59648872

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/091373 WO2018166116A1 (en) 2017-03-13 2017-06-30 Car damage recognition method, electronic apparatus and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN107092922B (en)
WO (1) WO2018166116A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109767346A (en) * 2018-12-17 2019-05-17 中国平安财产保险股份有限公司 CAR SERVICE processing method, device, computer equipment and storage medium
CN110660000A (en) * 2019-09-09 2020-01-07 平安科技(深圳)有限公司 Data prediction method, device, equipment and computer readable storage medium
CN111191400A (en) * 2019-12-31 2020-05-22 上海钧正网络科技有限公司 Vehicle part service life prediction method and system based on user fault reporting data
CN111291779A (en) * 2018-12-07 2020-06-16 深圳光启空间技术有限公司 Vehicle information identification method and system, memory and processor
CN114493903A (en) * 2022-02-17 2022-05-13 平安科技(深圳)有限公司 Damage assessment model optimization method in injury risk assessment and related equipment
EP3859592A4 (en) * 2018-09-26 2022-07-06 Advanced New Technologies Co., Ltd. Damage identification result optimization method and device
EP4044098A4 (en) * 2019-10-30 2023-10-04 PATEO CONNECT+ Technology (Shanghai) Corporation Method for generating insurance information, mobile device, and computer-readable storage medium

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108596047A (en) * 2018-03-30 2018-09-28 上海与德通讯技术有限公司 Vehicle damages recognition methods, intelligent terminal and computer readable storage medium
CN108734702A (en) * 2018-04-26 2018-11-02 平安科技(深圳)有限公司 Vehicle damages determination method, server and storage medium
CN108647712A (en) * 2018-05-08 2018-10-12 阿里巴巴集团控股有限公司 Processing method, processing equipment, client and the server of vehicle damage identification
CN108875648A (en) * 2018-06-22 2018-11-23 深源恒际科技有限公司 A method of real-time vehicle damage and component detection based on mobile video stream
CN110569837B (en) * 2018-08-31 2021-06-04 创新先进技术有限公司 Method and device for optimizing damage detection result
CN110570316A (en) * 2018-08-31 2019-12-13 阿里巴巴集团控股有限公司 method and device for training damage recognition model
CN109359542A (en) * 2018-09-18 2019-02-19 平安科技(深圳)有限公司 The determination method and terminal device of vehicle damage rank neural network based
CN109523405A (en) * 2018-10-30 2019-03-26 平安医疗健康管理股份有限公司 A kind of Claims Resolution reminding method, device, server and computer-readable medium
CN109670545B (en) * 2018-12-13 2023-08-11 北京深智恒际科技有限公司 Method for evaluating vehicle image from thick to thin
CN110110732B (en) * 2019-05-08 2020-04-28 杭州视在科技有限公司 Intelligent inspection method for catering kitchen
CN110363238A (en) * 2019-07-03 2019-10-22 中科软科技股份有限公司 Intelligent vehicle damage identification method, system, electronic equipment and storage medium
CN111193868B (en) * 2020-01-09 2021-03-16 中保车服科技服务股份有限公司 Photographing method and device for vehicle insurance survey, computer equipment and readable storage medium
CN112329596B (en) * 2020-11-02 2021-08-24 中国平安财产保险股份有限公司 Target damage assessment method and device, electronic equipment and computer-readable storage medium
CN113361457A (en) * 2021-06-29 2021-09-07 北京百度网讯科技有限公司 Vehicle loss assessment method, device and system based on image

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070052973A1 (en) * 2003-06-19 2007-03-08 Tsubasa System Co., Ltd. Damage analysis-supporting system
CN101242379A (en) * 2008-03-18 2008-08-13 北京中车检信息技术有限公司 Car damage identification method based on mobile communication terminal or network terminal
CN105678622A (en) * 2016-01-07 2016-06-15 平安科技(深圳)有限公司 Analysis method and system for vehicle insurance claim-settlement photos
CN105956667A (en) * 2016-04-14 2016-09-21 平安科技(深圳)有限公司 Automobile insurance loss assessment claim auditing method and automobile insurance loss assessment claim auditing system
CN106097103A (en) * 2016-06-01 2016-11-09 深圳市永兴元科技有限公司 Motor vehicles vehicle insurance reparation strategy determines method and apparatus
CN106231263A (en) * 2016-08-03 2016-12-14 深圳市永兴元科技有限公司 Car damage identification based on mobile network communication Claims Resolution method and device
CN106296118A (en) * 2016-08-03 2017-01-04 深圳市永兴元科技有限公司 Car damage identification method based on image recognition and device

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8996240B2 (en) * 2006-03-16 2015-03-31 Smartdrive Systems, Inc. Vehicle event recorders with integrated web server
US8086474B1 (en) * 2007-07-30 2011-12-27 Intuit Inc. Managing insurance claim data
US20130297353A1 (en) * 2008-01-18 2013-11-07 Mitek Systems Systems and methods for filing insurance claims using mobile imaging
CN103310223A (en) * 2013-03-13 2013-09-18 四川天翼网络服务有限公司 Vehicle loss assessment system based on image recognition and method thereof
CN104268783B (en) * 2014-05-30 2018-10-26 翱特信息系统(中国)有限公司 The method, apparatus and terminal device of car damage identification appraisal
CN105933289A (en) * 2016-04-08 2016-09-07 苏州花坞信息科技有限公司 Online broadcasting platform
CN106056142A (en) * 2016-05-27 2016-10-26 大连楼兰科技股份有限公司 System and method for establishing region division remote damage assessment of different vehicle types based on artificial intelligence energy model method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070052973A1 (en) * 2003-06-19 2007-03-08 Tsubasa System Co., Ltd. Damage analysis-supporting system
CN101242379A (en) * 2008-03-18 2008-08-13 北京中车检信息技术有限公司 Car damage identification method based on mobile communication terminal or network terminal
CN105678622A (en) * 2016-01-07 2016-06-15 平安科技(深圳)有限公司 Analysis method and system for vehicle insurance claim-settlement photos
CN105956667A (en) * 2016-04-14 2016-09-21 平安科技(深圳)有限公司 Automobile insurance loss assessment claim auditing method and automobile insurance loss assessment claim auditing system
CN106097103A (en) * 2016-06-01 2016-11-09 深圳市永兴元科技有限公司 Motor vehicles vehicle insurance reparation strategy determines method and apparatus
CN106231263A (en) * 2016-08-03 2016-12-14 深圳市永兴元科技有限公司 Car damage identification based on mobile network communication Claims Resolution method and device
CN106296118A (en) * 2016-08-03 2017-01-04 深圳市永兴元科技有限公司 Car damage identification method based on image recognition and device

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3859592A4 (en) * 2018-09-26 2022-07-06 Advanced New Technologies Co., Ltd. Damage identification result optimization method and device
CN111291779A (en) * 2018-12-07 2020-06-16 深圳光启空间技术有限公司 Vehicle information identification method and system, memory and processor
CN109767346A (en) * 2018-12-17 2019-05-17 中国平安财产保险股份有限公司 CAR SERVICE processing method, device, computer equipment and storage medium
CN110660000A (en) * 2019-09-09 2020-01-07 平安科技(深圳)有限公司 Data prediction method, device, equipment and computer readable storage medium
EP4044098A4 (en) * 2019-10-30 2023-10-04 PATEO CONNECT+ Technology (Shanghai) Corporation Method for generating insurance information, mobile device, and computer-readable storage medium
CN111191400A (en) * 2019-12-31 2020-05-22 上海钧正网络科技有限公司 Vehicle part service life prediction method and system based on user fault reporting data
CN111191400B (en) * 2019-12-31 2023-12-29 上海钧正网络科技有限公司 Vehicle part life prediction method and system based on user fault reporting data
CN114493903A (en) * 2022-02-17 2022-05-13 平安科技(深圳)有限公司 Damage assessment model optimization method in injury risk assessment and related equipment
CN114493903B (en) * 2022-02-17 2024-04-09 平安科技(深圳)有限公司 Loss model optimization method in human cold risk assessment and related equipment

Also Published As

Publication number Publication date
CN107092922A (en) 2017-08-25
CN107092922B (en) 2018-08-31

Similar Documents

Publication Publication Date Title
WO2018166116A1 (en) Car damage recognition method, electronic apparatus and computer-readable storage medium
US10885397B2 (en) Computer-executed method and apparatus for assessing vehicle damage
WO2019174130A1 (en) Bill recognition method, server, and computer readable storage medium
KR102138082B1 (en) Method, system, device and readable storage medium to realize insurance claim fraud prevention based on multiple image consistency
WO2019169688A1 (en) Vehicle loss assessment method and apparatus, electronic device, and storage medium
EP3844669A1 (en) Method and system for facilitating recognition of vehicle parts based on a neural network
WO2018205467A1 (en) Automobile damage part recognition method, system and electronic device and storage medium
US20200004815A1 (en) Text entity detection and recognition from images
CN110008909B (en) Real-name system business real-time auditing system based on AI
CN108491866B (en) Pornographic picture identification method, electronic device and readable storage medium
WO2020164278A1 (en) Image processing method and device, electronic equipment and readable storage medium
TWI712980B (en) Claim information extraction method and device, and electronic equipment
CN111626371A (en) Image classification method, device and equipment and readable storage medium
CN109598298B (en) Image object recognition method and system
CN110795714A (en) Identity authentication method and device, computer equipment and storage medium
CN116311214B (en) License plate recognition method and device
CN114067431A (en) Image processing method, image processing device, computer equipment and storage medium
CN112232336A (en) Certificate identification method, device, equipment and storage medium
CN114663871A (en) Image recognition method, training method, device, system and storage medium
CN110717407A (en) Human face recognition method, device and storage medium based on lip language password
CN114386013A (en) Automatic student status authentication method and device, computer equipment and storage medium
CN111353514A (en) Model training method, image recognition method, device and terminal equipment
CN111414889B (en) Financial statement identification method and device based on character identification
CN111652242B (en) Image processing method, device, electronic equipment and storage medium
CN115546813A (en) Document analysis method and device, storage medium and equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900321

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/12/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 17900321

Country of ref document: EP

Kind code of ref document: A1