CN108632530A

CN108632530A - A kind of data processing method of car damage identification, device, processing equipment and client

Info

Publication number: CN108632530A
Application number: CN201810432696.3A
Authority: CN
Inventors: 周凡
Original assignee: Alibaba Group Holding Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2018-05-08
Filing date: 2018-05-08
Publication date: 2018-10-09
Anticipated expiration: 2038-05-08
Also published as: CN113179368B; CN113179368A; CN108632530B; WO2019214319A1; TW201947452A

Abstract

This specification embodiment discloses a kind of data processing method of car damage identification, device, processing equipment and client.User can automatic identification vehicle damage position on the mobile apparatus, and the region for needing to shoot is identified with the mode easily identified in shooting picture, persistently guiding user shoots photo or video to the region, to allow user can be in the case where not needing professional knowledge, also it can complete to meet the shooting of setting loss processing requirement needed for setting loss, the treatment effeciency of car damage identification is improved, user's setting loss interactive experience is improved.

Description

A kind of data processing method of car damage identification, device, processing equipment and client

Technical field

This specification example scheme belongs to the technical field more particularly to one of terminal insurance business data processing Data processing method, device, processing equipment and the client of kind car damage identification.

Background technology

Automobile insurance, that is, car insurance (or abbreviation vehicle insurance) refers to motor vehicles due to natural calamity or unexpected thing Therefore caused personal injury or property loss bears a kind of business insurance of liability to pay compensation.With the development of economy, motor vehicles Quantity be continuously increased, currently, vehicle insurance has become one of maximum insurance kind in Chinese property insurance business.

In vehicle insurance industry, when car accident proposition Claims Resolution application occurs for car owner, insurance company needs the damage journey to vehicle Degree is assessed, to determine the project list for needing to repair, and the compensation amount of money etc..Current assessment mode includes mainly：It is logical Insurance company or the third party Gong Gu mechanism persons of surveying are crossed, the vehicle to accident occurs carries out site assessment, or is being insured by user It under the guidance of associate, takes pictures to accident vehicle, insurance company is passed to by network, then carried out by photo by setting loss person Long-range setting loss.Current this vehicle insurance setting loss obtains in the mode of setting loss image, and insurance company arranges vehicle and personnel to accident Scene is surveyed, and needs to spend higher cost；Car owner needs that more time waiting is spent to survey personnel's arrival scene, experience It is poor；When car owner voluntarily shoots photo, from want of experience, generally requires the personnel of surveying and pass through remote phone or video calling etc. Mode is instructed, time-consuming and laborious.Even if in the case where checking personnel's remote guide, part case is taken in this way There are a large amount of invalid photos in photo, when collecting invalid setting loss image, car owner user needs to re-shoot, or even has lost Right moment for camera is lost, setting loss treatment effeciency and user's setting loss service experience are seriously affected.

Therefore, there is an urgent need for one kind in the industry can eased, convenient, quick car damage identification processing scheme.

Invention content

This specification embodiment be designed to provide a kind of data processing method of car damage identification, device, processing equipment and Client, user can automatic identification vehicle damage position on the mobile apparatus, and with the side easily identified in shooting picture Formula identifies the region for needing to shoot, and persistently user is guided to shoot photo or video to the region, to allow user can be not In the case of needing professional knowledge, it can also complete to meet the shooting of setting loss processing requirement needed for setting loss, improve the place of car damage identification Efficiency is managed, user's setting loss interactive experience is improved.

Data processing method, device, processing equipment and the client for a kind of car damage identification that this specification embodiment provides It includes that following manner is realized to be：

A kind of data processing method of car damage identification, the method includes：

The shooting guidance information of displaying shooting the first affected area of vehicle；

If identifying, there are the first damages in current shooting form, it is determined that goes out the first damage zone of first damage Domain；

After carrying out notable mode rendering to first damage field, first damage of the virtual reality after it will render is utilized Region Overlapping display is in the current shooting form；

Displaying is directed to the shooting guidance information of first damage field.

A kind of data processing equipment of car damage identification, described device include：

First reminding module, the shooting guidance information for showing shooting the first affected area of vehicle；

Non-destructive tests object module, if there are the first damages in current shooting form for identifying, it is determined that go out described First damage field of the first damage；

Notable display module is existed after carrying out notable mode rendering to first damage field using virtual reality By the first damage field Overlapping display after rendering in the current shooting form；

Second reminding module, for showing the shooting guidance information for being directed to first damage field.

A kind of data processing equipment of car damage identification, including processor and for storing depositing for processor-executable instruction Reservoir, the processor are realized when executing described instruction：

A kind of client, including processor and the memory for storing processor-executable instruction, the processor It is realized when executing described instruction：

A kind of electronic equipment, including display screen, processor and the memory for storing processor-executable instruction, the place Reason device realizes the method and step described in any one embodiment of this specification when executing described instruction.

Data processing method, device, processing equipment and the client for a kind of car damage identification that this specification embodiment provides, User can automatic identification vehicle damage position on the mobile apparatus, and identified with the mode easily identified in shooting picture The region shot is needed, persistently user is guided to shoot photo or video to the region, to allow user that can not need profession In the case of knowledge, it can also complete to meet the shooting of setting loss processing requirement needed for setting loss, improve the treatment effeciency of car damage identification, carry High user's setting loss interactive experience.

Description of the drawings

In order to illustrate more clearly of this specification embodiment or technical solution in the prior art, below will to embodiment or Attached drawing needed to be used in the description of the prior art is briefly described, it should be apparent that, the accompanying drawings in the following description is only Some embodiments described in this specification, for those of ordinary skill in the art, in not making the creative labor property Under the premise of, other drawings may also be obtained based on these drawings.

Fig. 1 is a kind of flow diagram of the data processing method embodiment of car damage identification that this specification provides；

Fig. 2 is the deep neural network model schematic diagram that this specification the method embodiment uses；

Fig. 3 is that this specification provides a kind of rendered using dot point symbol to identify the schematic diagram of damage field；

Fig. 4 is the implement scene schematic diagram of shooting guiding embodiment in the method that this specification provides；

Fig. 5 is the implement scene schematic diagram of another embodiment of the method that this specification provides；

Fig. 6 is to apply the method for the present invention or a kind of hardware knot of the client of the interaction process of car damage identification of device embodiment Structure block diagram；

Fig. 7 is a kind of modular structure schematic diagram of the data processing equipment embodiment for car damage identification that this specification provides；

Fig. 8 is the structural schematic diagram of this kind of electronic equipment embodiment for illustrating to provide.

Specific implementation mode

In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described Embodiment be only a part of the embodiment in this specification, instead of all the embodiments.Base in this manual one A or multiple embodiments, the every other reality that those of ordinary skill in the art are obtained without creative efforts Example is applied, the range of this specification embodiment protection should be all belonged to.

A kind of embodiment that this specification provides can be applied in the system architecture of client/server.Described Client, which may include vehicle damage Field Force, (can be accident vehicle car owner user, can also be insurer officer or determined Damage the other staff of processing) terminal device with shooting function that uses, such as smart mobile phone, tablet computer, intelligence are dressed and set Standby, special setting loss terminal etc..The client can have communication module, can carry out communication link with long-range server It connects, realizes the data transmission with the server.The server may include the server or setting loss clothes of insurance company side The server of business side side, can also include the server of other service sides in other implement scenes, for example, with setting loss service The server of side has terminal, terminal of vehicle salvage shop of accessories supplier of communication linkage etc..The server can wrap Single computer unit is included, can also include the server cluster of multiple servers composition or the server of distributed system. In application scenes, the image data that acquisition is taken on site can be sent to server in real time by client-side, by servicing The result of the identification that device side is damaged, identification can feed back to client.The embodiment of the processing of server-side, damage Wound identification etc. reason server-side executes, and processing speed is usually above client-side, it is possible to reduce client process pressure Power improves non-destructive tests speed.Certainly, this specification is not excluded in other embodiments above-mentioned all or part of processing by client Side is held to realize, the real-time detection and identification damaged such as client-side.

When user voluntarily shoots vehicle damage photo or video, following problem can be usually faced：1, user not fully understands Which damage location is shot, and (such as one cut to pieces scratch mark mainly at front door, and back door is only a small amount of, is ignored by user； But back door also needs to paint, therefore to be shot to back door damage location)；2, user cannot identify all damages (such as slight recess is difficult to the naked eye identify for ordinary people)；3, user is difficult accurate grasp shooting distance, angle, damage The elements such as ratio of the traumatic part position in picture.For this purpose, the present invention provides a kind of car damage identification that can be applied on the mobile apparatus Data processing method, can be identified with the mode easily identified in shooting picture and need the region that shoots, it is lasting to guide User shoots photo or video to the region, and to allow user can be in the case where not needing professional knowledge, it be fixed also to complete Shooting needed for damage.

This specification embodiment is illustrated by taking a specific cell-phone customer terminal application scenarios as an example below.Specifically , Fig. 1 is a kind of flow diagram of the data processing method embodiment of car damage identification that this specification provides.Although this Specification is provided such as following embodiments or method operating procedure shown in the drawings or apparatus structure, but is based on routine or is not necessarily to Less operating procedure or module after performing creative labour may include more in the method or device or part merging Unit.In the step of there is no necessary causalities in logicality or structure, the execution sequence of these steps or the mould of device Block structure is not limited to this specification embodiment or execution shown in the drawings sequence or modular structure.The method or modular structure Device in practice, server or end product in application, can be according to embodiment or method shown in the drawings or mould The execution of block structure carry out sequence is either parallel to be executed (such as the environment of parallel processor or multiple threads, even include point Cloth processing, server cluster implementation environment).Certainly, the description of following embodiments is not to other based on this specification The technical solution extended to is construed as limiting.Such as in other implement scenes.A kind of specific embodiment is as shown in Figure 1, originally In a kind of a kind of embodiment of the data processing method for car damage identification that specification provides, the method may include：

S0：The shooting guidance information of displaying shooting the first affected area of vehicle；

S2：If identifying, there are the first damages in current shooting form, it is determined that goes out the first damage of first damage Region；

S4：After carrying out notable mode rendering to first damage field, using virtual reality after it will render first Damage field Overlapping display is in the current shooting form；

S6：Displaying is directed to the shooting guidance information of first damage field.

The client of user side can be smart mobile phone in the present embodiment, and the smart mobile phone can have shooting work( Energy.User can car accident scene open implement this specification embodiment mobile phone apply to car accident scene into Capable shooting of finding a view.After client opens application, shooting form can be shown on client display screen, obtained by shooting form Vehicle is shot.The shooting form can be video capture window, can be used for finding a view for terminal-pair vehicle damage scene (Image Acquisition), the image information that the filming apparatus integrated by client obtains can be illustrated in the shooting form.Institute The relevant information for stating the specific interfacial structure of shooting form and displaying customized can design.

The characteristic of vehicle can be obtained in vehicle shooting process.The characteristic can according to vehicle identification, The data processing needs such as Context awareness, image recognition are specifically arranged.In general, the characteristic may include knowing The data information of all parts for the vehicle not gone out can be used for building 3D coordinate informations, establish the augmented reality spatial mode of vehicle Type (AR spatial models, a kind of data characterization mode, the contour pattern of main body).Certainly, the characteristic can also include Other data informations such as the brand of vehicle, model, color, profile, unique identifier.

When client enables setting loss service, the guidance information shot to affected area can be shown.For ease of description, Affected area that is current or will initially shooting is known as the first affected area.Such as in an application example, user is starting When setting loss is served by, application program can prompt user in the distance that can see vehicle overall picture clearly, and alignment vehicle may be by The orientation of damage is shot.User can be prompted to be moved around vehicle body if necessary, do not find to damage when such as initially shooting, then carry Show that user counterclockwise shoots vehicle comprehensively.(it is properly termed as first at this time when identifying in current shooting form in the presence of damage Damage), then it can further calculate and determine to damage corresponding damage field.

In some embodiments of this specification, the processing of non-destructive tests can be implemented by client-side, can also be by taking Business device side is handled, and server at this time is properly termed as non-destructive tests server.In application scenes or computing capability In the case of permission, the image of client acquisition directly locally can carry out non-destructive tests in client, or and other Setting loss data processing, it is possible to reduce network transmission expense.Certainly, as previously mentioned, the computing capability of usually server-side is better than Client.Therefore, in another embodiment of the method that this specification provides, the processing of non-destructive tests can be by server Side is handled.Specifically, it is described identify in current shooting form there are first damage may include：

S20：The acquisition image that shooting obtains is sent to non-destructive tests server；

S22：The non-destructive tests that server returns are received as a result, the non-destructive tests result includes non-destructive tests server profit The handling result that non-destructive tests obtain is carried out to the acquisition image with deep neural network trained in advance.

It should be noted that the damage of identification first described in the present embodiment is for when previous non-destructive tests processing, institute First stated does not carry out non-destructive tests processing to the image of other damage acquisitions and is construed as limiting.

In above-described embodiment, client or server-side can utilize the depth nerve net that in advance or training is built in real time Network identifies the damage in image, such as damage position, defective component, type of impairment.

Deep neural network can be used in target detection and semantic segmentation, for the picture of input, find target in picture In position.Fig. 2 is the deep neural network model schematic diagram that specification the method embodiment uses.It is described in Fig. 2 It is a kind of than more typical deep neural network Faster R-CNN, can by having marked a large amount of pictures of damage field in advance, A deep neural network is trained, for the picture in each orientation of vehicle and illumination condition, provides the range of damage field.Separately Outside, in some embodiments of this specification, the network structure for mobile device customization can be used, such as based on typical MobileNet, SqueezeNet or its improved network structure so that the model can mobile device lower power consumption, it is less in It deposits, run in the environment of slower processor, such as the running of mobile terminal environment of client.

After determining the first damage field, notable mode rendering can be carried out to the region, by AR technologies in shooting picture Superposition, which renders, in face damages covered region.The notable mode renders, and is primarily referred to as using in shooting picture The rendering mode of feature marks damage field so that the damage field easily identifies, or more prominent.To specific in the present embodiment Rendering mode do not limit, the constraints or meet condition for reaching that notable mode renders can be specifically set.

In another embodiment of the method that this specification provides, the notable mode, which renders, may include：

S40：First damage field is gone out using default characterization symbol logo, the default characterization symbol include it is following it One：

Dot, guide line, regular figure frame, irregular figure frame, customized figure.

Fig. 3 is that this specification provides a kind of rendered using dot point symbol to identify the schematic diagram of damage field.Certainly, In other embodiments, the default characterization symbol can also include other forms, such as guide line, regular figure frame, no Regular figure frame, customized figure etc. can also use word, character, data etc. to identify damage in other embodiments Region guides user to shoot damage field.One or more default characterization symbols can be used when rendering.The present embodiment It is middle that damage field is identified using default characterization symbol, it can be where more obvious showing damages in shoot form The band of position, auxiliary user quickly positioning and guiding shooting.

In another embodiment of the method that this specification provides, it can also be identified using dynamic rendering effect Damage field guides user to shoot damage field in a manner of more obvious.Specifically, in another embodiment, institute State notable mode render including：

S400：It is dynamic at least one in the default characterization symbol progress colour switching, size conversion, rotation, bounce Picture display.

In some embodiments of this specification, can set AR superposition reality damage boundary, prompt user by view-finder The part of alignment variable cross-section is shot.The augmented reality AR typically refers to a kind of position calculating camera image in real time Set and angle and plus respective image, video, 3D models technic relization scheme, this scheme can be on the screen virtual generation Boundary is sleeved on real world and carries out interaction.The enhancement information spatial mode of characteristic structure is utilized in this specification embodiment Type can be the profile information of vehicle, model that specifically can be based on the vehicle of acquisition, shooting angle and vehicle tire Multiple characteristics such as position, ceiling position, preceding face position, headlight position, taillight position, front and back window locations construct institute State the profile of vehicle.The profile may include the data model established based on 3D coordinates, be carried in the profile corresponding 3D coordinate informations.It then can be by the shown in outline of structure in shooting form.Certainly, this specification is not excluded for other implementations Augmented reality spatial model described in example can also include other model forms or on the profile it is increased its His model information.

The AR models can be matched in the shooting duration of video with true vehicle location, the 3D that will such as build Profile is added to the outline positions of real vehicles, and completion is can consider when the two exactly matches or matching degree reaches threshold value Match.In specific matching treatment, can by guiding view direction, user by guiding follow shot direction or angle, The profile of structure is aligned with the profile of the real vehicles of shooting.This specification embodiment combination augmented reality, is not only opened up The vehicle real information of the practical client shooting of user is showed, and the augmented reality spatial model of the vehicle of structure has been believed It ceases while showing, two kinds of information are complementary to one another, are superimposed, and can provide better setting loss service experience.

Vehicle field condition can more intuitively be shown by combining the shooting form of AR spatial models, can effectively into The setting loss and shooting of driving damage position guide.Client can carry out non-destructive tests guiding, the damage under AR scenes Identification guiding may include specifically that will show the shooting guiding determined based on the image information obtained from the shooting form Information.Client can obtain in shooting window and obtain image information under AR scenes, can divide the image information of acquisition Analysis calculates, and determines which type of shooting guidance information needed to show in shooting form according to analysis result.Such as current shooting The position of the middle vehicle of form farther out, can prompt user close to shooting in shooting form.If camera site is to the left, can not clap Vehicle tail is taken the photograph, then can show shooting guidance information, prompts user by shooting angle to right translation.Non-destructive tests guiding tool The data information and which type of shows under the conditions of which type of shooting guidance information that body is handled, can preset corresponding Strategy or rule, the present embodiment no longer describe one by one.

In the present embodiment, the shooting guidance information for first damage field can be shown.It specifically can root Shooting guidance information that needs are shown is determined according to the location information of current photographing information and first damage field.Example Such as, if capturing vehicle rear fender, there are scratches, and scratch needs to carry out positive shooting and the shooting along scratch direction, but User at this time is calculated according to the position of current shooting and angle information and is that 45 degree sideling are shot, and apart from scratch position compared with Far.It can then prompt user close to scratch position at this time, prompt user front and shot along scratch direction.Shooting guiding Information can according to real-time adjustment of currently finding a view, if such as user meet photographing request close to scratch position, then carry at this time Show that shooting guidance information of the user close to scratch position can no longer be shown.The suspicious lesion can be by client or service Device side is identified.

Need the shooting guidance information shown and shooting condition etc. can be according to setting loss interaction design when specific shooting Or setting loss process demand is arranged accordingly.In one embodiment that this specification provides, the shooting guidance information can To include at least one of the following：

Adjust shooting direction；

Adjust shooting angle；

Adjust shooting distance；

Adjustment shooting light.

The example of one shooting guiding is as shown in Figure 4.User can be more convenient, high by shooting guidance information in real time The carry out setting loss processing of effect.User shoots according to shooting guidance information, may not need the shooting technical ability or cumbersome of profession Shooting operation, user experience are more preferable.Above embodiment described the shooting guidance information shown by word, expansible embodiments In, the shooting guidance information can also include the ways of presentation of image, voice, animation, vibrations etc., pass through arrow or voice Current shooting picture is directed at some region by prompt.Therefore, in another embodiment of the method, the shooting guidance information The current shooting form displaying form include at least one of symbol, word, voice, animation, video, vibrations.

In another embodiment scene of the method, when user shoots the camera alignment vehicle of mobile device When, it can be shot with certain frame per second (such as 15 frames/s), then the deep neural network of aforementioned training can be used to figure As being identified.If once detecting to damage, new shooting strategy can be started to damage field, such as accelerate shooting frame rate (such as 30 frames/s), obtain adjustment other parameters realize at faster speed, lower power consumption persistently obtains the region and regarded in current shooting Position in window.In this way, acquisition parameters can be adjusted according to different shooting areas, different shooting strategies, Ke Yiling are used It is living to adapt to different photographed scenes, reinforce key area shooting, corresponding non-key area can also reduce power consumption by frequency reducing.Cause This, in another embodiment of the method that this specification provides, when there is damage in identifying current shooting form, adopts Damage field is shot with the shooting strategy at least adjusting the parameter including shooting frame rate.

It is, of course, also possible to other parameters are adjusted, such as exposure, brightness.Specific shooting strategy can be customized It is set according to photographed scene.

Further, the photo or video of enough (reaching setting loss image acquisition request) are collected in the first damage field Afterwards, the shooting of next place's damage can be carried out with prompting and guiding user, until all damages shooting finishes.In this way when user shoots certain After a damage, the shooting that guiding user carries out next damage can be continued, damage shooting is reduced and omit, user is reduced and damage and know Other participation improves user experience.Therefore, in another embodiment of the method, as shown in figure 5, can also include：

S8：If it is determined that the first damage field shooting is completed, then the bat for shooting second affected area of vehicle is shown Guidance information is taken the photograph, until the damage shooting identified is completed.

The damage picture taken can be returned insurance company by client application, so as to carry out it is subsequent artificial or Automatic setting loss processing.User can also be avoided or reduced and forge the risk that setting loss image carries out insurance fraud.Therefore, this specification provides The method another embodiment in, the method further includes：

S10：By the image transmitting for meeting setting loss image acquisition request of shooting to setting loss server.

The setting loss server may include the server of insurance company side, can also include the service of setting loss service side Device.The setting loss server that is transmitted to may include being transferred directly to setting loss server by client, can also indirect communication To setting loss server.Certainly, the satisfactory setting loss image determined can also issue setting loss server and setting loss service simultaneously The server of side, such as the server end for the setting loss service that certain payment application provides.

It should be noted that described in above-described embodiment in real time may include obtain or determine some data information after At once it sends, receive or shows, it will be appreciated by persons skilled in the art that by caching or expected calculating, stand-by period Transmission, reception or displaying afterwards still may belong to the real-time range of definition.Image described in this specification embodiment can To include video, video can be considered as continuous image collection.

In addition, shooting the acquisition image of acquisition or satisfactory setting loss image in this specification example scheme can deposit It stores up local client or is uploaded to far-end server in real time.Some data of local client storage progress are anti-tamper or are uploaded to After server storage, setting loss data can be effectively prevent to be tampered, or usurp the data progress of other this non-accident images Insurance Fraud.Therefore, this specification embodiment can also improve the reliability of the Information Security and setting loss result of setting loss processing.

Above embodiment described user cell-phone customer terminal carry out car damage identification data processing method embodiment.It needs It is noted that this specification embodiment method described above can be in a variety of processing equipments, such as special setting loss terminal, with And in the implement scene including client and server architecture.

Each embodiment of the above method is described in a progressive manner in this specification, identical between each embodiment Just to refer each other for similar part, and each embodiment focuses on the differences from other embodiments.Correlation Place illustrates referring to the part of embodiment of the method.

The embodiment of the method that the embodiment of the present application is provided can be in mobile terminal, PC terminals, special setting loss terminal, service It is executed in device or similar arithmetic unit.For running on mobile terminals, Fig. 6 is real using the method for the present invention or device Apply a kind of hardware block diagram of the client of the interaction process of car damage identification of example.As shown in fig. 6, client 10 may include one (processor 102 can include but is not limited to Micro-processor MCV or can compile a or multiple (one is only shown in figure) processor 102 The processing unit of journey logical device FPGA etc.), memory 104 for storing data and the transmission mould for communication function Block 106.It will appreciated by the skilled person that structure shown in fig. 6 is only to illustrate, not to above-mentioned electronic device Structure causes to limit.For example, client 10 may also include more than shown in Fig. 6 or less component, such as can also wrap Include other processing hardware, such as GPU (Graphics Processing Unit, image processor), or with shown in Fig. 8 Different configurations.

Memory 104 can be used for storing the software program and module of application software, such as searching in this specification embodiment Corresponding program instruction/the modules of Suo Fangfa, processor 102 are stored in software program and mould in memory 104 by operation Block realizes the processing method of above-mentioned navigation interactive interface content displaying to perform various functions application and data processing. Memory 104 may include high speed random access memory, may also include nonvolatile memory, as one or more magnetic storage fills It sets, flash memory or other non-volatile solid state memories.In some instances, memory 104 can further comprise relative to place The remotely located memory of device 102 is managed, these remote memories can pass through network connection to client 10.The reality of above-mentioned network Example includes but not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.

Transmission module 106 is used to receive via a network or transmission data.Above-mentioned network specific example may include The wireless network that the communication providers of terminal 10 provide.In an example, transmission module 106 includes that a network is suitable Orchestration (Network Interface Controller, NIC), can be connected with other network equipments by base station so as to Internet is communicated.In an example, transmission module 106 can be radio frequency (Radio Frequency, RF) module, For wirelessly being communicated with internet.

Based on the method that image object described above positions, this specification also provides a kind of data processing of car damage identification Device.The device may include the system (including distributed system) for having used this specification embodiment the method, soft Part (application), module, component, server, client etc. simultaneously combine the necessary apparatus for implementing hardware.Based on same innovation Conceive, the processing unit in a kind of embodiment that this specification provides is as described in the following examples.Since device solves the problems, such as Implementation it is similar to method, therefore the implementation of the specific processing unit of this specification embodiment may refer to preceding method Implement, overlaps will not be repeated.Although device described in following embodiment is preferably realized with software, hardware, Or the realization of the combination of software and hardware is also that may and be contemplated.Specifically, as shown in fig. 7, Fig. 7 is this specification carries Supply a kind of car damage identification data processing equipment embodiment modular structure schematic diagram, may include specifically：

First reminding module 201 can be used for showing the shooting guidance information of shooting the first affected area of vehicle；

Non-destructive tests object module 202, if can be used for identifying, there are the first damages in current shooting form, it is determined that Go out the first damage field of first damage；

Notable display module 203, after can be used for carrying out notable mode rendering to first damage field, using virtual Reality is in the first damage field Overlapping display after rendering in the current shooting form；

Second reminding module 204 can be used for showing the shooting guidance information for being directed to first damage field.

It, can be with according to the description of related method embodiment it should be noted that the device that above-described embodiment is described above Including other embodiments, such as execute the rendering processing module rendered, the AR display modules of progress AR processing.It is specific real Existing mode is referred to the description of embodiment of the method, does not repeat one by one herein.

The unit type recognition methods that this specification embodiment provides can be executed by processor corresponding in a computer Program instruction is realized, is such as realized in PC ends/server end using the c++/java language of windows/Linux operating systems, Or the necessary hardware realization of the corresponding application design language set of other such as android, iOS system, or it is based on quantum Processing logic realization of computer etc..Specifically, a kind of data processing equipment for car damage identification that this specification provides is realized In the embodiment for stating method, the processing equipment may include processor and the storage for storing processor-executable instruction Device, the processor are realized when executing described instruction：

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the processor also executes：

If it is determined that the first damage field shooting is completed, then show that the shooting for shooting second affected area of vehicle is drawn Information is led, until the damage shooting identified is completed.

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the notable mode renders Including：

First damage field is gone out using default characterization symbol logo, the default characterization symbol includes one of the following：

At least one animation exhibition in colour switching, size conversion, rotation, bounce is carried out to the default characterization symbol Show.

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the shooting guidance information Including at least one of the following：

Adjust shooting direction；

Adjust shooting angle；

Adjust shooting distance；

Adjustment shooting light.

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the shooting guidance information The current shooting form displaying form include at least one of symbol, word, voice, animation, video, vibrations.

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the processor identifies There are the first damages in current shooting form includes：

The acquisition image that shooting obtains is sent to non-destructive tests server；

The non-destructive tests of server return are received as a result, the non-destructive tests result includes that non-destructive tests server by utilizing is pre- First trained deep neural network carries out the handling result that non-destructive tests obtain to the acquisition image.

It is described based on preceding method embodiment, in another embodiment of the processing equipment, the processor is identifying When going out in current shooting form to exist damage, execute using the shooting strategy at least adjusting the parameter including shooting frame rate come to damage Hinder region to be shot.

By the image transmitting for meeting setting loss image acquisition request of shooting to setting loss server.

It should be noted that the processing equipment that above-described embodiment is described above, also according to the description of related method embodiment May include other expansible embodiments.Concrete implementation mode is referred to the description of embodiment of the method, does not make herein It repeats one by one.

Above-mentioned instruction can be stored in a variety of computer readable storage mediums.The computer readable storage medium can To include the physical unit for storing information, can by after information digitalization again by the way of electricity, magnetic or optics etc. Media are stored.Computer readable storage medium described in the present embodiment, which has, may include：Information is stored in the way of electric energy Device such as, various memory, such as RAM, ROM；The device of information is stored in the way of magnetic energy such as, hard disk, floppy disk, tape, Core memory, magnetic bubble memory, USB flash disk；Using optical mode store information device such as, CD or DVD.Certainly, also other Readable storage medium storing program for executing of mode, such as quantum memory, graphene memory etc..Device described in this specification embodiment Or the instruction in server or client or system ibid describes.

The above method or device embodiment can be used for the client of user side, such as smart mobile phone.Therefore, this specification A kind of client, including processor and the memory for storing processor-executable instruction are provided, the processor executes It is realized when described instruction：

Based on aforementioned described, this specification embodiment also provides a kind of electronic equipment, including display screen, processor and deposits Store up the memory of processor-executable instruction.

Fig. 8 is the structural schematic diagram of this kind of electronic equipment embodiment for illustrating to provide, and the processor executes the finger The method and step described in this specification any one embodiment may be implemented when enabling.

Each embodiment of device, client, electronic equipment described in this specification etc. is described in a progressive manner, The same or similar parts between the embodiments can be referred to each other, the highlights of each of the examples are with other embodiment Difference.For hardware+program class embodiment, since it is substantially similar to the method embodiment, so description It is fairly simple, the relevent part can refer to the partial explaination of embodiments of method.

It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims It is interior.In some cases, the action recorded in detail in the claims or step can be come according to different from the sequence in embodiment It executes and desired result still may be implemented.In addition, the process described in the accompanying drawings not necessarily require show it is specific suitable Sequence or consecutive order could realize desired result.In some embodiments, multitasking and parallel processing be also can With or it may be advantageous.

Although this application provides the method operating procedure as described in embodiment or flow chart, based on conventional or noninvasive The labour for the property made may include more or less operating procedure.The step of being enumerated in embodiment sequence is only numerous steps A kind of mode in execution sequence does not represent and unique executes sequence.It, can when device or client production in practice executes With according to embodiment, either method shown in the drawings sequence is executed or parallel executed (such as at parallel processor or multithreading The environment of reason).

Although mentioning AR technologies in this specification embodiment content, the shooting that shooting guidance information shows, interacted with user Guiding is arranged using the data acquisition of the preliminary identification of damage position of deep neural network or the like, position, interaction, calculates, judges Deng operation and data description, still, this specification embodiment is not limited to meet industry communication standard, standard picture Situation described in data processing agreement, communication protocol and normal data model/template or this specification embodiment.Certain industries Embodiment modified slightly can also be realized in standard or the practice processes described using self-defined mode or embodiment Above-described embodiment is identical, after equivalent or close or deformation it is anticipated that implementation result.Using these modifications or deformed data The embodiment of the acquisitions such as acquisition, storage, judgement, processing mode still may belong to the optional embodiment range of this specification Within.

In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example, Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit. Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device (Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " patrols Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development, And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language (Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL (Advanced Boolean Expression Language)、AHDL(Altera Hardware Description Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL (Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby Hardware Description Language) etc., VHDL (Very-High-Speed are most generally used at present Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages, The hardware circuit for realizing the logical method flow can be readily available.

Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can Read medium, logic gate, switch, application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), the form of programmable logic controller (PLC) and embedded microcontroller, the example of controller includes but not limited to following microcontroller Device：ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320, are deposited Memory controller is also implemented as a part for the control logic of memory.It is also known in the art that in addition to Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic Controller is obtained in the form of logic gate, switch, application-specific integrated circuit, programmable logic controller (PLC) and embedded microcontroller etc. to come in fact Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions For either the software module of implementation method can be the structure in hardware component again.

System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity, Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used Think personal computer, laptop computer, vehicle-mounted human-computer interaction device, cellular phone, camera phone, smart phone, individual Digital assistants, media player, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or The combination of any equipment in these equipment of person.

Although this specification embodiment provides the method operating procedure as described in embodiment or flow chart, based on conventional May include either more or less operating procedure without creative means.The step of being enumerated in embodiment sequence be only A kind of mode in numerous step execution sequences does not represent and unique executes sequence.Device or end product in practice is held When row, can according to embodiment either method shown in the drawings sequence execute or it is parallel execute (such as parallel processor or The environment of multiple threads, even distributed data processing environment).The terms "include", "comprise" or its any other change Body is intended to non-exclusive inclusion, so that process, method, product or equipment including a series of elements are not only wrapped Those elements are included, but also include other elements that are not explicitly listed, or further include for this process, method, product Or the element that equipment is intrinsic.In the absence of more restrictions, being not precluded in the process including the element, side There is also other identical or equivalent elements in method, product or equipment.

For convenience of description, it is divided into various modules when description apparatus above with function to describe respectively.Certainly, implementing this The function of each module is realized can in the same or multiple software and or hardware when specification embodiment, it can also be by reality Show the module of same function by the combination realization etc. of multiple submodule or subelement.Device embodiment described above is only Schematically, for example, the division of the unit, only a kind of division of logic function, can there is other draw in actual implementation The mode of dividing, such as multiple units or component can be combined or can be integrated into another system, or some features can be ignored, Or it does not execute.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be by one The INDIRECT COUPLING of a little interfaces, device or unit or communication connection can be electrical, machinery or other forms.

It is also known in the art that other than realizing controller in a manner of pure computer readable program code, it is complete Entirely can by by method and step carry out programming in logic come so that controller with logic gate, switch, application-specific integrated circuit, programmable The form of logic controller and embedded microcontroller etc. realizes identical function.Therefore this controller is considered one kind Hardware component, and the structure that the device for realizing various functions that its inside includes can also be considered as in hardware component.Or Person even, can will be considered as either the software module of implementation method can be hardware again for realizing the device of various functions Structure in component.

The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that can be realized by computer program instructions every first-class in flowchart and/or the block diagram The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided Instruct the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine so that the instruction executed by computer or the processor of other programmable data processing devices is generated for real The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.

These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works so that instruction generation stored in the computer readable memory includes referring to Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or The function of being specified in multiple boxes.

These computer program instructions also can be loaded onto a computer or other programmable data processing device so that count Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, in computer or The instruction executed on other programmable devices is provided for realizing in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in a box or multiple boxes.

In a typical configuration, computing device includes one or more processors (CPU), input/output interface, net Network interface and memory.

Memory may include computer-readable medium in volatile memory, random access memory (RAM) and/or The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium Example.

Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method Or technology realizes information storage.Information can be computer-readable instruction, data structure, the module of program or other data. The example of the storage medium of computer includes, but are not limited to phase transition internal memory (PRAM), static RAM (SRAM), moves State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable Programmable read only memory (EEPROM), fast flash memory bank or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM), Digital versatile disc (DVD) or other optical storages, magnetic tape cassette, tape magnetic disk storage or other magnetic storage apparatus Or any other non-transmission medium, it can be used for storage and can be accessed by a computing device information.As defined in this article, it calculates Machine readable medium does not include temporary computer readable media (transitory media), such as data-signal and carrier wave of modulation.

It will be understood by those skilled in the art that the embodiment of this specification can be provided as method, system or computer program production Product.Therefore, in terms of this specification embodiment can be used complete hardware embodiment, complete software embodiment or combine software and hardware Embodiment form.Moreover, it wherein includes computer available programs that this specification embodiment, which can be used in one or more, Implement in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of code The form of computer program product.

This specification embodiment can describe in the general context of computer-executable instructions executed by a computer, Such as program module.Usually, program module includes routines performing specific tasks or implementing specific abstract data types, journey Sequence, object, component, data structure etc..This specification embodiment can also be put into practice in a distributed computing environment, in these points In cloth computing environment, by executing task by the connected remote processing devices of communication network.In Distributed Calculation ring In border, program module can be located in the local and remote computer storage media including storage device.

Each embodiment in this specification is described in a progressive manner, identical similar portion between each embodiment Point just to refer each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so description is fairly simple, related place is referring to embodiment of the method Part explanation.In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", The description of " specific example " or " some examples " etc. means specific features described in conjunction with this embodiment or example, structure, material Or feature is contained at least one embodiment or example of this specification embodiment.In the present specification, to above-mentioned term Schematic representation be necessarily directed to identical embodiment or example.Moreover, description specific features, structure, material or Person's feature may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, in not conflicting feelings Under condition, those skilled in the art by different embodiments or examples described in this specification and different embodiment or can show The feature of example is combined.

The foregoing is merely the embodiments of this specification embodiment, are not limited to this specification embodiment.It is right For those skilled in the art, this specification embodiment can have various modifications and variations.It is all in this specification embodiment Any modification, equivalent replacement, improvement and so within spirit and principle, the right that should be included in this specification embodiment are wanted Within the scope of asking.

Claims

1. a kind of data processing method of car damage identification, the method includes：

If identifying, there are the first damages in current shooting form, it is determined that goes out the first damage field of first damage；

After carrying out notable mode rendering to first damage field, first damage field of the virtual reality after it will render is utilized Overlapping display is in the current shooting form；

2. the method as described in claim 1, the method further include：

If it is determined that the first damage field shooting is completed, then the shooting guiding letter for shooting second affected area of vehicle is shown Breath, until the damage shooting identified is completed.

3. the method as described in claim 1, the notable mode render including：

4. method as claimed in claim 3, the notable mode render including：

At least one animated show in colour switching, size conversion, rotation, bounce is carried out to the default characterization symbol.

5. the method as described in claim 1, the shooting guidance information includes at least one of the following：

Adjust shooting direction；

Adjust shooting angle；

Adjust shooting distance；

Adjustment shooting light.

6. the method as described in claim 1, the form packet in current shooting form displaying of the shooting guidance information Include at least one of symbol, word, voice, animation, video, vibrations.

7. the method as described in claim 1 includes using at least adjustment when there is damage in identifying current shooting form The shooting strategy of the parameter of shooting frame rate shoots damage field.

It is described to identify in current shooting form that there are the first damages and include 8. the method as described in claim 1：

The non-destructive tests that server returns are received as a result, the non-destructive tests result includes non-destructive tests server by utilizing instructs in advance Experienced deep neural network carries out the acquisition image handling result that non-destructive tests obtain.

9. the method as described in claim 1, the method further include：

10. a kind of data processing equipment of car damage identification, described device include：

Non-destructive tests object module, if there are the first damages in current shooting form for identifying, it is determined that go out described first First damage field of damage；

Notable display module, after carrying out notable mode rendering to first damage field, using virtual reality by wash with watercolours The first damage field Overlapping display after dye is in the current shooting form；

11. a kind of data processing equipment of car damage identification, including processor and for storing depositing for processor-executable instruction Reservoir, the processor are realized when executing described instruction：

12. processing equipment as claimed in claim 11, the processor also executes：

13. processing equipment as claimed in claim 11, the notable mode render including：

14. processing equipment as claimed in claim 13, the notable mode render including：

15. processing equipment as claimed in claim 11, the shooting guidance information includes at least one of the following：

Adjust shooting direction；

Adjust shooting angle；

Adjust shooting distance；

Adjustment shooting light.

16. processing equipment as claimed in claim 11, the shooting guidance information in current shooting form displaying Form includes at least one of symbol, word, voice, animation, video, vibrations.

17. processing equipment as claimed in claim 11, the processor identifies that there are the first damages in current shooting form Including：

18. processing equipment as claimed in claim 11, the processor when there is damage in identifying current shooting form, Execution shoots damage field using the shooting strategy at least adjusting the parameter including shooting frame rate.

19. processing equipment as claimed in claim 11, the processor also executes：

20. a kind of client, including processor and the memory for storing processor-executable instruction, the processor are held It is realized when row described instruction：

21. a kind of electronic equipment, including display screen, processor and the memory for storing processor-executable instruction, the place Manage the method and step realized when device executes described instruction described in any one of claim 1-9.