CN108632530B

CN108632530B - Data processing method, device and equipment for vehicle damage assessment, client and electronic equipment

Info

Publication number: CN108632530B
Application number: CN201810432696.3A
Authority: CN
Inventors: 周凡
Original assignee: Advanced New Technologies Co Ltd
Current assignee: Advanced New Technologies Co Ltd; Advantageous New Technologies Co Ltd
Priority date: 2018-05-08
Filing date: 2018-05-08
Publication date: 2021-02-23
Anticipated expiration: 2038-05-08
Also published as: WO2019214319A1; CN113179368B; CN113179368A; TW201947452A; CN108632530A

Abstract

The embodiment of the specification discloses a data processing method, a data processing device, processing equipment and a client for vehicle damage assessment. The user can automatically identify the damaged part of the vehicle on the mobile device, the area needing to be shot is identified in an easily-identified mode in the shot picture, and the user is continuously guided to shoot the photo or the video in the area, so that the user can complete shooting meeting the damage assessment processing requirement required by damage assessment without professional knowledge, the vehicle damage assessment processing efficiency is improved, and the user damage assessment interaction experience is improved.

Description

Data processing method, device and equipment for vehicle damage assessment, client and electronic equipment

Technical Field

The embodiment scheme of the specification belongs to the technical field of computer terminal insurance service data processing, and particularly relates to a data processing method, a data processing device, processing equipment and a client for vehicle damage assessment.

Background

Motor vehicle insurance, i.e. automobile insurance (or simply vehicle insurance), refers to a commercial insurance for reimbursing the liability for personal casualties or property loss caused by natural disasters or accidents of motor vehicles. With the development of economy, the number of motor vehicles is increasing, and at present, vehicle insurance becomes one of the biggest risks in the property insurance business in China.

In the automobile insurance industry, when an automobile owner generates an automobile accident and applies for claim settlement, an insurance company needs to evaluate the damage degree of the automobile so as to determine an item list needing to be repaired, the claim amount and the like. The current evaluation methods mainly include: the accident vehicle is evaluated on site by an insurance company or a third-party public evaluation organization survey officer, or the accident vehicle is photographed by a user under the guidance of the insurance company officer, transmitted to the insurance company through a network, and then remotely damaged by a damage determiner through the photograph. In the current mode of obtaining damage assessment images of vehicle damage assessment, an insurance company arranges vehicles and personnel to an accident site for investigation, and higher cost is needed; the car owner needs to spend more time waiting for the survey staff to arrive at the site, and the experience is poor; when the car owner shoots the photo by himself, due to lack of experience, the checking personnel are often required to guide the photo through remote telephone or video call and other modes, which wastes time and labor. Even under the condition of remote guidance of the viewer, a large number of invalid photos exist in photos of part of cases shot in such a way, when invalid damage assessment images are collected, owner users need to shoot again, even shooting opportunities are lost, and damage assessment processing efficiency and user damage assessment service experience are seriously affected.

Therefore, there is a need for a vehicle damage assessment processing scheme that is easier, more convenient and faster.

Disclosure of Invention

The embodiment of the specification aims to provide a data processing method, a device, a processing device and a client for vehicle damage assessment, a user can automatically identify a damaged part of a vehicle on a mobile device, an area needing to be shot is identified in a shooting picture in an easily-identified mode, and the user is continuously guided to shoot a photo or a video for the area, so that the user can complete shooting meeting damage assessment processing requirements required by damage assessment without professional knowledge, the processing efficiency of vehicle damage assessment is improved, and the interactive experience of user damage assessment is improved.

The data processing method, device, processing equipment and client for vehicle damage assessment provided by the embodiment of the specification are realized in the following modes:

a method of data processing for vehicle damage assessment, the method comprising:

displaying shooting guide information for shooting a first damaged area of the vehicle;

if a first damage exists in the current shooting window, determining a first damage area of the first damage;

rendering the first damaged area in a significant mode, and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by using an enhancement implementation;

and displaying shooting guide information aiming at the first damage area.

A data processing apparatus for vehicle damage assessment, the apparatus comprising:

the first prompting module is used for displaying shooting guide information for shooting a first damaged area of the vehicle;

the damage identification result module is used for determining a first damage area of a first damage if the first damage is identified to exist in the current shooting window;

the obvious display module is used for rendering the first damaged area in an obvious mode and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by utilizing an enhancement mode;

and the second prompting module is used for displaying shooting guide information aiming at the first damage area.

A data processing apparatus for vehicle damage assessment comprising a processor and a memory for storing processor-executable instructions which, when executed by the processor, implement:

and displaying shooting guide information aiming at the first damage area.

A client comprising a processor and a memory for storing processor-executable instructions, the instructions when executed by the processor result in:

and displaying shooting guide information aiming at the first damage area.

An electronic device comprising a display screen, a processor and a memory storing processor-executable instructions that when executed by the processor perform the method steps of any one of the embodiments of the present description.

According to the data processing method, device, processing equipment and client for vehicle damage assessment provided by the embodiment of the specification, a user can automatically identify a damaged part of a vehicle on mobile equipment, an area needing to be shot is identified in an easily-identified mode in a shot picture, and the user is continuously guided to shoot a photo or a video in the area, so that the user can complete shooting meeting damage assessment processing requirements required by damage assessment without professional knowledge, the processing efficiency of vehicle damage assessment is improved, and the interactive experience of user damage assessment is improved.

Drawings

In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present specification, and for those skilled in the art, other drawings can be obtained according to the drawings without any creative effort.

FIG. 1 is a schematic flow chart diagram illustrating an embodiment of a data processing method for vehicle damage assessment provided herein;

FIG. 2 is a schematic diagram of a deep neural network model used in embodiments of the methods described herein;

FIG. 3 is a schematic diagram of the present specification providing a method for identifying a damaged area using small dot symbol rendering;

fig. 4 is a schematic view of an implementation scenario of a shooting guidance embodiment in the method provided in this specification;

FIG. 5 is a schematic diagram of an implementation scenario of another embodiment of the method provided in the present specification;

FIG. 6 is a block diagram of a hardware architecture of a client for interactive processing of vehicle damage assessment to which an embodiment of the method or apparatus of the present invention is applied;

FIG. 7 is a block diagram of an embodiment of a data processing apparatus for vehicle damage assessment provided in the present specification;

fig. 8 is a schematic structural diagram of an embodiment of an electronic device provided in this description.

Detailed Description

In order to make those skilled in the art better understand the technical solutions in the present specification, the technical solutions in the embodiments of the present specification will be clearly and completely described below with reference to the drawings in the embodiments of the present specification, and it is obvious that the described embodiments are only a part of the embodiments in the present specification, and not all of the embodiments. All other embodiments that can be obtained by a person skilled in the art on the basis of one or more embodiments of the present description without inventive step shall fall within the scope of protection of the embodiments of the present description.

One embodiment provided by the present description may be applied to a client/server system architecture. The client can include the terminal equipment that has the shooting function that car decreases the field personnel (can be accident car owner, also can be insurance company personnel or carry out the other personnel that the loss was handled), for example smart mobile phone, panel computer, intelligent wearing equipment, special loss assessment terminal etc.. The client can be provided with a communication module and can be in communication connection with a remote server to realize data transmission with the server. The server may include a server on the insurance company side or a server on the damage service side, and in other implementation scenarios, the server may include a server on another service side, such as a terminal of an accessory supplier having a communication link with the server on the damage service side, a terminal of a vehicle maintenance factory, and the like. The server may include a single computer device, or may include a server cluster composed of a plurality of servers, or a server of a distributed system. In some application scenes, one side of the client can send image data acquired by field shooting to the server in real time, damage identification is carried out by one side of the server, and an identification result can be fed back to the client. In the embodiment of the server-side processing, the processing such as the damage recognition is executed by the server side, and the processing speed is generally higher than that of the client side, so that the processing pressure of the client side can be reduced, and the damage recognition speed can be improved. Of course, this specification does not exclude other embodiments in which all or part of the above processing is implemented by the client side, such as real-time detection and identification of the impairment performed by the client side.

When a user takes a picture or a video of a damaged car by himself, the following problems are often encountered: 1. a user does not completely understand which damaged parts need to be shot (for example, a scratch is mainly on the front door, and the rear door only has a small amount and is ignored by the user; 2. the user cannot identify all lesions (e.g., a slight depression is difficult for the average person to identify with the naked eye); 3. it is difficult for the user to accurately grasp factors such as the shooting distance, the angle, and the ratio of the damaged portion in the screen. Therefore, the invention provides a data processing method of vehicle damage assessment, which can be applied to mobile equipment, can identify the area to be shot in an easily-identified mode in a shooting picture, and continuously guide a user to shoot photos or videos of the area, so that the user can complete shooting required by damage assessment without professional knowledge.

The following describes an embodiment of the present specification by taking a specific application scenario of a mobile phone client as an example. Specifically, fig. 1 is a schematic flow chart of an embodiment of the data processing method for vehicle damage assessment provided in this specification. Although the present specification provides the method steps or apparatus structures as shown in the following examples or figures, more or less steps or modules may be included in the method or apparatus structures based on conventional or non-inventive efforts. In the case of steps or structures which do not logically have the necessary cause and effect relationship, the execution order of the steps or the block structure of the apparatus is not limited to the execution order or the block structure shown in the embodiments or the drawings of the present specification. When the described method or module structure is applied to a device, a server or an end product in practice, the method or module structure according to the embodiment or the figures may be executed sequentially or in parallel (for example, in a parallel processor or multi-thread processing environment, or even in an implementation environment including distributed processing and server clustering). Of course, the following description of the embodiments does not limit other extensible solutions based on the present description. Such as in other implementation scenarios. In a specific embodiment, as shown in fig. 1, in an embodiment of a data processing method for vehicle damage assessment provided in this specification, the method may include:

s0: displaying shooting guide information for shooting a first damaged area of the vehicle;

s2: if a first damage exists in the current shooting window, determining a first damage area of the first damage;

s4: rendering the first damaged area in a significant mode, and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by using an enhancement implementation;

s6: and displaying shooting guide information aiming at the first damage area.

In this embodiment, the client at the user side may be a smart phone, and the smart phone may have a shooting function. The user can open the mobile phone application implementing the embodiment of the specification at the vehicle accident scene to carry out framing shooting on the vehicle accident scene. After the client opens the application, the shooting window can be displayed on the client display screen, and the vehicle can be shot through the shooting window. The shooting window can be a video shooting window and can be used for the terminal to find a view (image acquisition) of a car damage site, and image information acquired by the client-side integrated shooting device can be displayed in the shooting window. The specific interface structure of the shooting window and the displayed related information can be designed in a user-defined mode.

The characteristic data of the vehicle can be obtained in the vehicle shooting process. The characteristic data can be specifically set according to data processing requirements such as vehicle identification, environment identification, image identification and the like. In general, the feature data may include data information of each identified component of the vehicle, and may be used to construct 3D coordinate information and build an augmented reality space model (AR space model, a data representation, a contour map of the subject) of the vehicle. Of course, the characteristic data may also include other data information such as the make, model, color, contour, unique identification code, etc. of the vehicle.

When the client side starts the damage assessment service, the guide information for shooting the damaged area can be displayed. For convenience of description, a damaged area to be currently or initially photographed is referred to as a first damaged area. For example, in one application example, when a user launches the damage-assessment service application, the application may prompt the user to shoot at a location where the vehicle may be damaged at a distance that will allow the user to see the vehicle's general view. If necessary, the user can be prompted to move around the vehicle body, and if no damage is found during initial shooting, the user is prompted to shoot the vehicle in a full-scale mode in a reverse time mode. When the damage in the current shooting window is identified (which may be referred to as a first damage), a damage region corresponding to the damage may be further determined by calculation.

In some embodiments of the present description, the processing of the impairment recognition may be performed by the client side or the server side, and the server in this case may be referred to as an impairment recognition server. Under the condition that some application scenes or computing power allow, the images acquired by the client can be directly subjected to damage identification locally at the client, or other damage assessment data processing can be carried out, and network transmission overhead can be reduced. Of course, as previously mentioned, the server side is typically more computing power than the client. Therefore, in another embodiment of the method provided in the present specification, the process of damage identification may be performed by a server side. Specifically, the identifying that the first damage exists in the current shooting window may include:

s20: sending the acquired image obtained by shooting to a damage identification server;

s22: and receiving a damage identification result returned by the server, wherein the damage identification result comprises a processing result obtained by the damage identification server performing damage identification on the acquired image by using a pre-trained deep neural network.

In addition, the first lesion identification process described in this embodiment is performed on the current lesion identification process, and the first process does not limit the lesion identification process performed on the images acquired by the other lesions.

In the above embodiment, the client or server side may identify the lesion in the image, such as the lesion location, the lesion component, the lesion type, and the like, by using the deep neural network constructed by training in advance or in real time.

The deep neural network can be used for target detection and semantic segmentation, and for an input picture, the position of a target in the picture is found. FIG. 2 is a schematic diagram of a deep neural network model used in an embodiment of the method described herein. Fig. 2 illustrates a more typical deep neural network fast R-CNN, which can train a deep neural network by labeling a large number of pictures of a damaged area in advance, and give the range of the damaged area for pictures of various directions and illumination conditions of a vehicle. In addition, in some embodiments of the present description, a network structure customized for the mobile device, such as a network structure based on typical MobileNet, SqueezeNet or their modifications, can be used, so that the model can operate in an environment with lower power consumption, less memory, and slower processor of the mobile device, such as a mobile terminal operating environment of the client.

After the first damage area is determined, the area can be rendered in a significant mode, and the area covered by the damage can be overlaid and rendered in the shooting picture through an AR technology. The significant rendering mode mainly refers to marking a damaged area by using a rendering mode with certain characteristics in a shot picture, so that the damaged area is easy to identify or is more prominent. In this embodiment, a specific rendering manner is not limited, and a constraint condition for achieving rendering in a significant manner or a condition that is satisfied may be set specifically.

In another embodiment of the method provided in this specification, the rendering in a salient manner may include:

s40: identifying the first damage region by using a preset token, wherein the preset token comprises one of the following:

dots, guide lines, regular graphic frames, irregular graphic frames, custom graphics.

FIG. 3 is a schematic diagram of the specification providing a method for identifying a damaged area by using dot symbol rendering. Of course, in other embodiments, the preset token may also include other forms, such as a guiding line, a regular graphic frame, an irregular graphic frame, a customized graphic, and the like, and in other embodiments, the damaged area may also be identified by using characters, data, and the like, so as to guide the user to shoot the damaged area. One or more preset tokens may be used in rendering. In this embodiment, the damage area is identified by using the preset characterization symbol, so that the position area where the damage is located can be displayed more obviously in the shooting window, and the user can be assisted in quick positioning and shooting guidance.

In another embodiment of the method provided by this specification, a dynamic rendering effect may also be used to identify the damaged area, so as to guide the user to shoot the damaged area in a more obvious manner. Specifically, in another embodiment, the salient mode rendering includes:

s400: and performing at least one of color transformation, size transformation, rotation and jumping on the preset characterization symbol.

In some embodiments of the present description, the AR may be integrated to superimpose the boundary of the real lesion, prompting the user to shoot the frame at the portion of the variable cross-section. The augmented reality AR generally refers to a technical implementation scheme of calculating the position and angle of a camera image in real time and adding corresponding images, videos and 3D models, and this scheme can overlap a virtual world on a screen in the real world and perform interaction. The enhanced information space model constructed by using the feature data in the embodiment of the present specification may be contour information of a vehicle, and specifically, a contour of the vehicle may be constructed based on a plurality of feature data, such as a model number of the vehicle, a shooting angle, and a tire position, a ceiling position, a front face position, a headlamp position, a tail lamp position, and a front window position of the vehicle. The contour may comprise a data model built on the basis of 3D coordinates, with corresponding 3D coordinate information in the contour. The constructed outline may then be presented in a capture window. Of course, this description does not exclude that the augmented reality space model described in other embodiments may also include other model forms or other model information added on top of the outline.

The AR model may be matched with the real vehicle position in the shooting duration, for example, the constructed 3D contour is superimposed on the contour position of the real vehicle, and matching may be considered to be completed when the two are completely matched or the matching degree reaches a threshold value. In the specific matching process, the user can align the constructed contour with the photographed contour of the real vehicle by guiding the view finding direction and moving the photographing direction or angle. The embodiment of the specification is combined with an augmented reality technology, so that not only is the real information of the vehicle shot by an actual client of a user shown, but also the constructed augmented reality space model information of the vehicle is displayed simultaneously, and the two kinds of information are mutually supplemented and superposed, so that better loss assessment service experience can be provided.

The shooting window combined with the AR space model can more visually show the vehicle field condition, and can effectively determine the damage of the vehicle damage position and shoot the guide. The client may perform damage identification guidance in the AR scene, and the damage identification guidance may specifically include shooting guidance information determined based on image information acquired from the shooting window to be presented. The client can acquire the image information in the AR scene in the shooting window, can analyze and calculate the acquired image information, and determines what shooting guide information needs to be displayed in the shooting window according to the analysis result. For example, the vehicle in the current shooting window is far away, and the user can be prompted to approach the shooting window. If the shooting position is deviated to the left and the tail of the vehicle cannot be shot, shooting guide information can be displayed and a user is prompted to translate the shooting angle to the right. The data information for guiding the specific processing by the damage identification and what shooting guide information is displayed under what conditions may be preset with corresponding policies or rules, which are not described one by one in this embodiment.

In this embodiment, shooting guidance information for the first damaged area may be presented. Specifically, the shooting guide information to be displayed may be determined according to the current shooting information and the position information of the first damaged area. For example, if there is a scratch on the rear fender of the vehicle, the scratch needs to be shot in the front and along the direction of the scratch, but the 45-degree shot which is inclined by the user at the moment is calculated according to the position and angle information of the current shot, and the shot is far away from the scratch position. The user may be prompted at this point to approach the scratch location, prompting the user to take a photograph both frontally and in the direction of the scratch. The shooting guide information can be adjusted in real time according to the current view, for example, if the user is close to the scratch position and meets the shooting requirement, the shooting guide information which prompts the user to be close to the scratch position can not be displayed any more. The suspected damage may be identified by the client or server.

Shooting guide information and shooting conditions and the like which need to be displayed during specific shooting can be correspondingly set according to the loss assessment interactive design or loss assessment processing requirements. In an embodiment provided by the present specification, the shooting guidance information may include at least one of:

adjusting the shooting direction;

adjusting a shooting angle;

adjusting the shooting distance;

and adjusting the shooting light.

An example of a shooting guide is shown in fig. 4. The user can more conveniently and efficiently carry out damage assessment processing through real-time shooting of the guide information. The user shoots according to shooting guide information, professional shooting skills or complex shooting operation can be omitted, and user experience is better. In the above embodiment, the shooting guide information displayed by the text is described, but in an extensible embodiment, the shooting guide information may further include a display mode of an image, voice, animation, vibration, and the like, and the current shooting picture is aligned to a certain area through an arrow or a voice prompt. Therefore, in another embodiment of the method, the form of the shooting guide information shown in the current shooting window includes at least one of symbols, text, voice, animation, video and vibration.

In another embodiment of the method, when the user aims the camera of the mobile device at the vehicle for shooting, shooting may be performed at a certain frame rate (e.g. 15 frames/s), and then the images may be identified using the trained deep neural network. If the damage is detected, a new shooting strategy may be started for the damaged area, such as increasing the shooting frame rate (e.g., 30 frames/s), and acquiring and adjusting other parameters to continuously acquire the position of the area in the current shooting window at a faster speed and with lower power consumption. Therefore, shooting parameters can be adjusted according to different shooting areas, different shooting strategies are used, different shooting scenes can be flexibly adapted, shooting in key areas is enhanced, and power consumption can be reduced by reducing the frequency of corresponding non-key areas. Therefore, in another embodiment of the method provided by the present specification, when it is identified that there is a damage in the current shooting window, a shooting strategy that adjusts at least a parameter including a shooting frame rate is used to shoot the damaged area.

Of course, other parameters, such as exposure, brightness, etc., may also be adjusted. The specific shooting strategy can be set according to the shooting scene in a self-defined manner.

Further, after enough pictures or videos (meeting the requirement of collecting the damage assessment image) are collected in the first damage area, the user can be prompted to be guided to shoot the next damage until all the damages are shot. After a user shoots a certain damage, the user can be continuously guided to shoot the next damage, damage shooting omission is reduced, the participation degree of damage identification of the user is reduced, and user experience is improved. Therefore, in another embodiment of the method, as shown in fig. 5, the method may further include:

s8: and if the first damaged area is determined to be shot completely, displaying shooting guide information for shooting a second damaged area of the vehicle until the recognized damaged area is shot completely.

The client application program may return the captured damage picture to the insurance company for subsequent manual or automatic damage assessment processing. The risk of fraud and guarantee of the image of the fixed damage forged by the user can be avoided or reduced. Accordingly, in another embodiment of the method provided herein, the method further comprises:

s10: and transmitting the shot image which meets the requirement of collecting the loss assessment image to a loss assessment server.

The loss server can comprise a server on the insurance company side and also can comprise a server of a loss server side. The transmission to the loss assessment server may include direct transmission from the client to the loss assessment server, or indirect transmission to the loss assessment server. Of course, the determined damage assessment image meeting the requirement may also be sent to the damage assessment server and a server of the damage assessment service party, such as a server side of the damage assessment service provided by a certain payment application.

It should be noted that the real-time described in the above embodiments may include sending, receiving or displaying data information immediately after acquiring or determining certain data information, and those skilled in the art will understand that sending, receiving or displaying after caching or expected calculation and waiting time may still fall within the definition of the real-time. The images described in the embodiments of the present specification may include video, and the video may be regarded as a continuous set of images.

In addition, the acquired images or the loss assessment images meeting the requirements shot in the embodiment of the description can be stored in a local client or uploaded to a remote server in real time. After some data are stored in the local client side and are prevented from being tampered or uploaded to the server for storage, the situation that damage assessment data are tampered or insurance fraud is conducted by stealing other data which are not images of the accident can be effectively prevented. Therefore, the embodiment of the specification can also improve the data security of the damage assessment processing and the reliability of the damage assessment result.

The above embodiment describes an implementation of a data processing method for vehicle damage assessment performed by a user at a mobile phone client. It should be noted that the method described above in the embodiments of the present disclosure may be implemented in various processing devices, such as a dedicated loss assessment terminal, and an implementation scenario including a client and a server architecture.

In the present specification, each embodiment of the method is described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. Reference is made to the description of the method embodiments.

The method provided by the embodiment of the application can be executed in a mobile terminal, a PC terminal, a special loss assessment terminal, a server or a similar operation device. Taking the operation on the mobile terminal as an example, fig. 6 is a hardware structure block diagram of a client applying the interactive processing of the vehicle damage assessment according to the embodiment of the method or the device of the present invention. As shown in fig. 6, client 10 may include one or more (only one shown) processors 102 (processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 104 for storing data, and a transmission module 106 for communication functions. It will be understood by those skilled in the art that the structure shown in fig. 6 is only an illustration and is not intended to limit the structure of the electronic device. For example, the client 10 may also include more or fewer components than shown in fig. 6, and may also include other Processing hardware, such as a GPU (Graphics Processing Unit), for example, or have a different configuration than that shown in fig. 8.

The memory 104 may be configured to store software programs and modules of application software, such as program instructions/modules corresponding to the search method in the embodiments of the present specification, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, so as to implement the processing method for displaying the content of the navigation interactive interface. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, memory 104 may further include memory located remotely from processor 102, which may be connected to client 10 over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission module 106 is used to receive or transmit data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission module 106 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission module 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

Based on the image object positioning method, the specification further provides a data processing device for vehicle damage assessment. The apparatus may comprise a system (including a distributed system), software (applications), modules, components, servers, clients, etc. that utilize the methods described in the embodiments of the present specification in conjunction with any necessary equipment to implement the hardware. Based on the same innovative concept, the processing device in one embodiment provided in the present specification is as described in the following embodiment. Since the implementation scheme for solving the problem of the apparatus is similar to that of the method, the implementation of the specific processing apparatus in the embodiment of the present specification may refer to the implementation of the foregoing method, and repeated details are not repeated. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated. Specifically, as shown in fig. 7, fig. 7 is a schematic block diagram of an embodiment of a data processing device for vehicle damage assessment provided in this specification, and specifically includes:

the first prompting module 201 may be configured to display shooting guidance information for shooting a first damaged area of a vehicle;

the damage identification result module 202 may be configured to determine a first damage region of a first damage if the first damage is identified to exist in a current shooting window;

the significant display module 203 may be configured to perform significant rendering on the first damaged area, and then display the rendered first damaged area in the current shooting window in an overlapping manner by using an enhancement implementation;

the second prompting module 204 may be configured to present shooting guidance information for the first damaged area.

It should be noted that the apparatus described in the foregoing embodiment may also include other embodiments according to the description of the related method embodiment, such as a rendering processing module for performing rendering, an AR display module for performing AR processing, and the like. The specific implementation manner may refer to the description of the method embodiment, and is not described in detail herein.

The device model identification method provided in the embodiments of the present specification may be implemented in a computer by executing corresponding program instructions by a processor, for example, implemented at a PC/server side using a c + +/java language of a windows/Linux operating system, or implemented by other hardware necessary for an application design language set corresponding to, for example, android and iOS systems, or implemented by processing logic based on a quantum computer. In particular, in an embodiment of the method implemented by a data processing device for vehicle damage assessment provided in this specification, the processing device may include a processor and a memory for storing processor-executable instructions, and when the processor executes the instructions, the processor implements:

and displaying shooting guide information aiming at the first damage area.

Based on the foregoing description of the method embodiment, in another embodiment of the processing device, the processor further performs:

and if the first damaged area is determined to be shot completely, displaying shooting guide information for shooting a second damaged area of the vehicle until the recognized damaged area is shot completely.

In a further embodiment of the processing device, which is based on the description of the preceding method embodiment, the salient mode rendering comprises:

identifying the first damage region by using a preset token, wherein the preset token comprises one of the following:

and performing at least one of color transformation, size transformation, rotation and jumping on the preset characterization symbol.

Based on the foregoing description of the method embodiment, in another embodiment of the processing device, the shooting guidance information includes at least one of:

adjusting the shooting direction;

adjusting a shooting angle;

adjusting the shooting distance;

and adjusting the shooting light.

In another embodiment of the processing device, the shooting guidance information is displayed in the current shooting window in a form of at least one of a symbol, a text, a voice, an animation, a video, and a vibration.

In another embodiment of the processing device, which is described above with reference to the previous embodiment of the method, the identifying, by the processor, that the first damage exists in the current shooting window includes:

sending the acquired image obtained by shooting to a damage identification server;

and receiving a damage identification result returned by the server, wherein the damage identification result comprises a processing result obtained by the damage identification server performing damage identification on the acquired image by using a pre-trained deep neural network.

In another embodiment of the processing device, as described in the foregoing method embodiment, when recognizing that there is a damage in the current shooting window, the processor performs shooting of the damaged area using a shooting strategy that adjusts at least a parameter including a shooting frame rate.

and transmitting the shot image which meets the requirement of collecting the loss assessment image to a loss assessment server.

It should be noted that the processing device described in the foregoing embodiment may also include other extensible implementations according to the description of the related method embodiment. The specific implementation manner may refer to the description of the method embodiment, and is not described in detail herein.

The instructions described above may be stored in a variety of computer-readable storage media. The computer readable storage medium may include physical devices for storing information, which may be digitized and then stored using an electrical, magnetic, or optical media. The computer-readable storage medium according to this embodiment may include: devices that store information using electrical energy, such as various types of memory, e.g., RAM, ROM, etc.; devices that store information using magnetic energy, such as hard disks, floppy disks, tapes, core memories, bubble memories, and usb disks; devices that store information optically, such as CDs or DVDs. Of course, there are other ways of storing media that can be read, such as quantum memory, graphene memory, and so forth. The instructions in the devices or servers or clients or systems described in the embodiments of this specification are as described above.

The method or the device embodiment can be used for a client at the user side, such as a smart phone. Accordingly, the present specification provides a client comprising a processor and a memory for storing processor-executable instructions, the instructions when executed by the processor effecting:

and displaying shooting guide information aiming at the first damage area.

Based on the foregoing, embodiments of the present specification further provide an electronic device, which includes a display screen, a processor, and a memory storing processor-executable instructions.

Fig. 8 is a schematic structural diagram of an embodiment of an electronic device provided in this specification, where the processor executes the instructions to implement the method steps described in any one of the embodiments of this specification.

The embodiments of the apparatus, the client, the electronic device, and the like described in this specification are described in a progressive manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the hardware + program class embodiment, since it is substantially similar to the method embodiment, the description is simple, and the relevant points can be referred to the partial description of the method embodiment.

The foregoing description has been directed to specific embodiments of this disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

Although the present application provides method steps as described in an embodiment or flowchart, additional or fewer steps may be included based on conventional or non-inventive efforts. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or client product executes, it may execute sequentially or in parallel (e.g., in the context of parallel processors or multi-threaded processing) according to the embodiments or methods shown in the figures.

Although the content of the embodiments of the present specification refers to operations and data descriptions of AR technology, shooting guidance information presentation, shooting guidance for interaction with a user, data acquisition such as preliminary identification of a lesion location using a deep neural network, location arrangement, interaction, calculation, judgment, and the like, the embodiments of the present specification are not limited to those that necessarily conform to an industry communication standard, a standard image data processing protocol, a communication protocol, and a standard data model/template or those described in the embodiments of the present specification. Certain industry standards, or implementations modified slightly from those described using custom modes or examples, may also achieve the same, equivalent, or similar, or other, contemplated implementations of the above-described examples. The embodiments using these modified or transformed data acquisition, storage, judgment, processing, etc. may still fall within the scope of the alternative embodiments of the present description.

In the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate application-specific integrated circuit chips. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.

The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a vehicle-mounted human-computer interaction device, a cellular telephone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

Although embodiments of the present description provide method steps as described in embodiments or flowcharts, more or fewer steps may be included based on conventional or non-inventive means. The order of steps recited in the embodiments is merely one manner of performing the steps in a multitude of orders and does not represent the only order of execution. When an actual apparatus or end product executes, it may execute sequentially or in parallel (e.g., parallel processors or multi-threaded environments, or even distributed data processing environments) according to the method shown in the embodiment or the figures. The terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, the presence of additional identical or equivalent elements in a process, method, article, or apparatus that comprises the recited elements is not excluded.

For convenience of description, the above devices are described as being divided into various modules by functions, and are described separately. Of course, in implementing the embodiments of the present description, the functions of each module may be implemented in one or more software and/or hardware, or a module implementing the same function may be implemented by a combination of multiple sub-modules or sub-units, and the like. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may therefore be considered as a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

As will be appreciated by one skilled in the art, embodiments of the present description may be provided as a method, system, or computer program product. Accordingly, embodiments of the present description may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, embodiments of the present description may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and so forth) having computer-usable program code embodied therein.

The embodiments of this specification may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The described embodiments may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment. In the description herein, references to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of an embodiment of the specification. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.

The above description is only an example of the embodiments of the present disclosure, and is not intended to limit the embodiments of the present disclosure. Various modifications and variations to the embodiments described herein will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the embodiments of the present specification should be included in the scope of the claims of the embodiments of the present specification.

Claims

1. A method of data processing for vehicle damage assessment, the method comprising:

rendering the first damaged area in a significant mode, and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by using augmented reality; the salient mode rendering comprises adopting a preset token to identify a damaged area;

displaying shooting guide information for the first damage area;

the method further comprises the following steps: and when the damage exists in the current shooting window is identified, starting a new shooting strategy for the damaged area, wherein the new shooting strategy is determined after shooting parameters are adjusted according to different shooting areas.

2. The method of claim 1, further comprising:

3. The method of claim 1, the salient mode rendering comprising:

4. The method of claim 3, the salient mode rendering comprising:

5. The method of claim 1, the photograph guidance information comprising at least one of:

adjusting the shooting direction;

adjusting a shooting angle;

adjusting the shooting distance;

and adjusting the shooting light.

6. The method of claim 1, wherein the shooting guide information is displayed in the current shooting window in a form including at least one of a symbol, a text, a voice, an animation, a video, and a vibration.

7. The method of claim 1, the new photographing policy being a photographing policy that adjusts at least a parameter including a photographing frame rate.

8. The method of claim 1, wherein identifying the presence of the first lesion in the current capture window comprises:

and receiving a damage identification result returned by the damage identification server, wherein the damage identification result comprises a processing result obtained by the damage identification server performing damage identification on the acquired image by using a pre-trained deep neural network.

9. The method of claim 1, further comprising:

10. A data processing apparatus for vehicle damage assessment, the apparatus comprising:

the damage identification result module is used for determining a first damage area of a first damage if the first damage is identified to exist in the current shooting window; the system is also used for starting a new shooting strategy for the damaged area when the damage exists in the current shooting window is identified, and the new shooting strategy is determined after shooting parameters are adjusted according to different shooting areas;

the obvious display module is used for rendering the first damaged area in an obvious mode and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by utilizing augmented reality;

11. A data processing apparatus for vehicle damage assessment comprising a processor and a memory for storing processor-executable instructions which, when executed by the processor, implement:

displaying shooting guide information for the first damage area;

and when the damage exists in the current shooting window is identified, starting a new shooting strategy for the damaged area, wherein the new shooting strategy is determined after shooting parameters are adjusted according to different shooting areas.

12. The processing device of claim 11, the processor further to perform:

13. The processing device of claim 11, the preset token comprising one of:

14. The processing device of claim 13, the salient mode rendering comprising:

15. The processing device of claim 11, the photograph guidance information comprising at least one of:

adjusting the shooting direction;

adjusting a shooting angle;

adjusting the shooting distance;

and adjusting the shooting light.

16. The processing device of claim 11, wherein the form of the shooting guide information displayed in the current shooting window comprises at least one of a symbol, a text, a voice, an animation, a video, and a vibration.

17. The processing device of claim 11, the processor identifying that a first impairment exists in a current capture window comprising:

18. The processing device according to claim 11, wherein the new shooting policy is a shooting policy in which at least a parameter including a shooting frame rate is adjusted.

19. The processing device of claim 11, the processor further to perform:

20. A client comprising a processor and a memory for storing processor-executable instructions, the instructions when executed by the processor result in:

rendering the first damaged area in a significant mode, and then displaying the rendered first damaged area in the current shooting window in an overlapping mode by using augmented reality;

displaying shooting guide information for the first damage area;

21. An electronic device comprising a display screen, a processor and a memory storing processor-executable instructions that when executed by the processor implement the method steps of any of claims 1-9.