Specific embodiment
In order to make those skilled in the art more fully understand the technical solution in this specification, below in conjunction with this explanation
Attached drawing in book embodiment is clearly and completely described the technical solution in this specification embodiment, it is clear that described
Embodiment be only a part of the embodiment in this specification, instead of all the embodiments.Base in this manual one
A or multiple embodiments, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present application.
Current insurance industry is carried out using automatic technology in the implementation of vehicle damage identification, setting loss, side used
Formula is concentrated mainly on computer vision field.Such as some technical solutions based on image recognition, by identification picture
Damage characteristic carrys out setting loss;Or based on picture search compare technical solution, by searching vehicle damage picture library in setting loss picture
Similar case realizes loss identification.The mode damaged above by vehicle damage image recognition is more single, and there are some fields
The situation not accurate enough to partial injury type or damage extent identification result under scape.Such as can be for slight recess, deformation
Clearly reflect in photo, need shooting angle, illumination condition suitable, fine vehicle damage image obtains larger.If
User shoots undesirable, then usually needs to re-shoot, this brings inconvenient or even cumbersome use body to user
It tests.Even if damage can be found, accurate judgement (such as metal plate reparation needs how many working hour) is carried out to degree of injury, only according to photo
The mode judged is also not accurate enough in many cases.In reality scene, even veteran setting loss person encounters bat
The dissatisfactory photo of condition is taken the photograph, large error can generally also be had by estimating damage.In addition, car owner be also likely to be present fraud or
Person gangs up with inspection of the scene of a crime person or setting loss person, forges, exaggerates accident degree, usurps other vehicles damage image or to vehicle damage image
PS handles (refer to and edit using image processing softwares such as Photoshop to image), gains indemnity by cheating, takes advantage of there is also biggish
Cheat risk.
In one or more embodiments of this specification, it can be emitted based on the propagation characteristic of some sound waves using sound wave
Device emits sound wave, and the damage information of vehicle is obtained by the processing data information of the sound wave to reflection.It can be damaged in conjunction with vehicle
The information that the other modes such as the visual information of traumatic part position obtain, realizes the judgement more accurate to vehicle damage.Meanwhile being based on sound
More accurate, the damage information that automatically determines out that wave is realized, also reduce risk of fraud.It can be in specific treatment process
Including using sound wave reflective information to identify the damage of vehicle, or using the identification of sound wave reflective information damage information to being based on
The recognition result of vehicle damage image is compared or is corrected, or utilizes the damage combination depth mind of sound wave reflective information identification
Through network, study processing output non-destructive tests result etc., or the image information for combining depth of field camera, binocular camera to obtain
To assist being formed the three-dimensional structure figure etc. of search coverage.Embodiment specifically based on sound wave identification vehicle damage can be with
Corresponding data information is combined to obtain the damage information of vehicle according to different scene demands.
A kind of embodiment that this specification provides can be applied in test side/server system architecture.Described
System architecture in, may include the embodiment of the corresponding server in one or more test sides, also may include one
Or multiple test sides correspond to the embodiment party of multiple servers (such as non-destructive tests server, setting loss server, accessory server)
Formula.The test side may include the terminal device with acoustic detection unit, and the acoustic detection unit can be by one
Group or multiple groups pinger and receiving sensor composition, can be to detected vehicle emissions multi beam sound wave, and can receive
Detected surface and inside penetrate the sound wave being reflected back.Acoustic detection unit in some embodiments of this specification can use
The mode for being mounted on mobile terminal is irradiated sound wave to detection vehicle and receives data.The mobile terminal may include a variety of ends
End, such as mobile phone, notebook, mobile unit, wearable device or the dedicated mobile Claims Resolution equipment of vehicle insurance etc..Such as in Fig. 1 institute
That shows can install acoustic detection unit or other devices comprising acoustic detection unit on the mobile terminal of user, such as can
, according to one group of acoustic detection unit, or as shown in Figure 2 can be used as mobile unit on the mobile communication terminal of user
One or more groups of acoustic detection units are installed on automobile.Solid line indication device part is ultrasonic imaging, dotted line signal in Fig. 2
Device part is optical imagery.
As illustrated in fig. 1 or fig. 2 on customer mobile terminal or vehicle or dedicated handheld device etc. to vehicle carry out
The terminal device comprising acoustic detection unit of sonic detection is properly termed as mobile test side.It should be noted that this specification
Mobile test side as described in the examples typically refers to can to follow user or test side to carry out mobile detection device, such as with
Family side mobile communication terminal, the special hand-held detection device etc. that the special inspecting equipment being installed on vehicle, user use.Phase
It is corresponding, fixed test end is properly termed as by the equipment that maintenance factory or test point implement vehicle detection.In some of this specification
In embodiment, mobile test side can also include optical imaging device, such as binocular camera shooting in addition to it may include acoustic detection unit
Head, mobile test side are also provided with matched sliding groove or turning facilities, can make acoustic detection unit transformation angle or
Direction emits sound wave.
Mobile test side in some embodiments of this specification can have communication module, can be communicated with server
Connection is realized and is transmitted with the data of the server.The server may include one that insurance data is handled or
Multiple servers can be the server of insurance company side, or the Platform Server of insurance service be provided, such as certain branch
Pay the server for the vehicle insurance service that application provides.Also may include in other implement scenes above-mentioned example server combination or
The combination of part of module unit, such as have service interaction with insurance company server and the payment services of the automatic setting loss of vehicle are provided
The server of platform.The server may include single computer unit, also may include the clothes of multiple server compositions
The server architecture for device cluster or the distributed system of being engaged in.The server can have corresponding database or storage unit.
Below by one specifically customer mobile terminal carry out setting loss detection application scenarios for this specification reality
The scheme of applying is illustrated, and the mobile terminal is a kind of embodiment of mobile test side.The mobile test side of the present embodiment
Ultrasonic listening unit can be installed, using ultrasonic wave to the carry out fault localization of vehicle, obtain the damage information of vehicle.This
Specification sound wave as described in the examples is often referred to the propagation of the vibration of sounding body generation in air or other substances, with ray
Unlike equal electromagnetic waves, sound wave is a kind of mechanical wave, need to be propagated by medium, can be divided into ultrasonic wave, audio according to frequency
Sound wave, infrasound.The sound wave of 20000Hz or more is known as ultrasonic wave.Fault localization is carried out to detection vehicle in the present embodiment to adopt
Sound wave can be ultrasonic wave.Some embodiments of this specification are special in view of the metal material and vehicle structure of vehicle
Property, it can be applied to ultrasonic injury in the fault localization and identifying processing of vehicle, Damage identification can be greatly decreased to personnel
The requirement of experience improves non-destructive tests precision, provides just objective qualification result, improves the difficulty that fraud is faked, and reduces and protects
The cost that dangerous company scene is manually surveyed.
Specifically, Fig. 3 is a kind of process of the processing method embodiment of vehicle damage detection that this specification provides
Schematic diagram.Although present description provides as the following examples or method operating procedure shown in the drawings or apparatus structure, base
It may include less after more or partially merging in the method or device in routine or without creative labor
Operating procedure or modular unit.In the step of there is no necessary causalities in logicality or structure, the execution of these steps
Sequence or the modular structure of device are not limited to this specification embodiment or execution shown in the drawings sequence or modular structure.Described
Device in practice, server or the end product of method or modular structure are in application, can be according to embodiment or attached drawing
Shown in method or modular structure carry out sequence execution or parallel execute (such as the ring of parallel processor or multiple threads
Border, the even implementation environment including distributed treatment, server cluster).
A kind of specific embodiment is as shown in figure 3, the processing method of vehicle damage detection that this specification provides a kind of
In a kind of embodiment, the method may include:
S0: mobile test side emits sound wave, and receives the sound wave of detection vehicle reflection, generates reflected acoustic wave information;
S2: mobile test side determines the sound wave identification of damage information of the detection vehicle based on the reflected acoustic wave information;
S4: the sound wave identification of damage information is sent to server by the mobile test side;
S6: the server determines institute according to the sound wave identification of damage information and visual signature information of the detection vehicle
The non-destructive tests of detection vehicle are stated as a result, the visual signature information is obtained based on the damage image of the detection vehicle.
Sound wave probe unit has can be set in the mobile test side (mobile phone) of user in the present embodiment, and acoustic detection unit can
By one or more groups of pingers and receiving sensor.Receiving sensor can install same position with pinger,
Also it may be mounted at different positions, be such as distributed in around pinger, can specifically be reflected according to expected sound wave
Or penetrate the position of path setting receiving sensor.A kind of mobile test side as described in the examples can have certain data
Processing capacity generates reflected acoustic wave information as converted it into corresponding electric signal after receiving the sound wave reflected.Mobile test side
Can be with multi-wad join between pinger or receiving sensor, pinger, can be by moving to detection vehicle emissions sound wave
Dynamic test side sonicated unit handles sound wave.
In some embodiments of this specification, mobile test side (such as can receive reflected acoustic wave information anti-in real time
Uploaded at once after penetrating information of acoustic wave, or determine upload at once after the completion of vehicle detection) it is uploaded to insurance server, it is taken by insurance
Business device identifies sound wave identification of damage information, can also be to be uploaded after persistence.Including described in following multiple embodiments
Mobile test side, server, system, device, equipment for arriving etc. move test side based on described in reflected acoustic wave information determination
The processing for detecting the sound wave identification of damage information of vehicle can also be realized in other examples by server.
In a kind of embodiment that this specification provides, mobile test side can be handled reflected acoustic wave information, be generated
Sound wave identification of damage information, is then uploaded to server.For example, can be based on sound wave identification of damage information structuring at scheduled figure
Picture.In specific one embodiment, the sound wave identification of damage information may include detection described in following embodiments
Material arrangement view (the material arrangement view in the detected region of the construction view or detection vehicle in the detected region of vehicle
At least one of for a kind of form of expression of material distributed intelligence), or other data informations.Constructing view can be with
For plan view, or 3D view.Then, the sound wave identification of damage information that server can be uploaded according to mobile test side
The non-destructive tests result of detection vehicle is determined to further determine that the damage of vehicle or in conjunction with the processing of other vehicle damages.
After mobile test side receives reflected acoustic wave information, vehicle damage identification can be carried out based on the reflected acoustic wave information
Processing.Such as image (including video) information header that can be obtained in conjunction with depth of field camera, binocular camera shooting is given birth to assist realizing
It is detected surface and in-built view at vehicle, is then uploaded to server.Server can be known based on construction view
Not or confirm that some damage informations for detecting vehicle, or construction view can show operating personnel, is determined by operating personnel
The identification of damage of vehicle is detected out, or in conjunction with other to the common determining damage knot of the non-destructive tests processing for checking vehicle
Fruit.Certainly, in this specification others embodiment, the sound wave identification of damage information, can be in addition to above-mentioned construction view
Including other data modes, such as text information, 3D figure, the corresponding code of damage or number.
Visual signature information described in this specification can be obtained based on the damage image of the detection vehicle, can wrap
It includes, server is uploaded to after shooting damage image by mobile test side shooting damage image or by other terminals, by server
It is handled.It, can also be by the mobile test side or the damage figure of other terminal devices shooting vehicle in other embodiments
As after, by the mobile test side or other terminal device identifying processings and after obtaining visual signature information, it is then forwarded to described
Server.
Server can further combine the view of detection vehicle based on the sound wave damage information that mobile test side is identified
Characteristic information is felt to determine the non-destructive tests result of the vehicle jointly.Visual signature information described in the present embodiment is usual
Volume may include the damage information (non-destructive tests modes such as identified, detected, compared based on the image information to vehicle and determining
It afterwards), or may be the data information (non-destructive tests for characterizing vehicle one or more features determined from the image of vehicle
Before).Such as in the present embodiment application scenarios, the mobile test side of user can use and take the photograph when carrying out ultra sonic scanner processing
As equipment to detection vehicle shoot, obtain damage image, these damage images can be uploaded to insurance server.Insurance clothes
Business device can use image comparison or the neural network recognization of training goes out to damage the damage in image, determine the detection vehicle
Visual signature information.In another example, insurance server can carry out identifying processing to damage image, determine detection vehicle
One or more damage characteristics, then these damage characteristics are in conjunction with sound wave identification of damage information, common identifying processing, determine
Non-destructive tests result.
In some embodiments of this specification, the sound wave identification of damage information and visual signature information determine damage jointly
Hurt recognition result, concrete implementation mode may include the recognition result using sound wave identification of damage information to visual signature information
Carry out correct or as reference, supplement as a result, can also using sound wave identification of damage information as enter ginseng act on vision damage
Hurt in identifying processing algorithm or model, output includes the visual signature information of the sound wave identification of damage information factor.Alternatively, utilizing sound
Wave identification of damage information enters acquisition impaired vision information after ginseng is modified to impaired vision identifying processing.Above-mentioned mode is equal
It can be further improved the accuracy of the non-destructive tests result of view-based access control model feature.
In some embodiments of this specification, used sound wave source can ultrasound when to the carry out fault localization of vehicle
Wave.Therefore in above-mentioned implementation example, ultrasonic listening unit can be installed in mobile terminal, the unit is by one group of multiple groups ultrasound
Wave launcher and receiving sensor composition, can to detected vehicle emissions multi beam ultrasonic wave, and can receive be detected surface with
And the ultrasonic wave of internal reflection.
In some embodiments that this specification provides, mobile test side can be converted reflected sound wave, be turned
Change corresponding electrical signal data into.Certainly, these electrical signal datas can also include other data informations, such as ultrasonic listening
Intensity, timestamp etc. when the number of unit, ultrasonic wave emit.These electrical signal datas can be transferred to distal end server or
Imaging is carried out in locally mobile test side, is regarded using the construction of the different physical characteristic construction surface of vehicle of sound wave or inside
Figure, these construction views can be used for the non-destructive tests of server.
It may include a variety of data informations of sound wave in the reflected acoustic wave received, some embodiments of this specification are specific
Can use all or part of information therein to carry out the identifying processing of vehicle damage.Specifically, what this specification provided
In another embodiment of the method, the sound wave identification damage that the detection vehicle is determined based on the reflected acoustic wave information
Hurting information may include:
S40: utilizing the reflected acoustic wave information, calculates mobile test side to the distance of the detection vehicle, is based on described
Distance building regards view including at least one construct inside the surface for detecting the detected region of vehicle, detected region,
Determine to include the first kind sound wave identification of damage information for constructing view.
It can use the ultrasonic wave penetrated after transmitting by institute's searching surface and internal reflection in the present embodiment, calculate movement
Distance of the receiving sensor of test side to surface;Multiple units work together, and can learn the three-dimensional structure on surface, from
And it is bent with the presence or absence of fluctuations or surface to detect the surface surface of the component in detected region (surface of vehicle perhaps)
Rate change information, and then judge that surface whether there is the damage of depressed deformation class.It is also taken the photograph in combination with the depth of field in above-mentioned treatment process
It assists realizing as head, binocular camera.The vehicle that can will be calculated distance in the present embodiment using reflective information and then identify
Exist recess or protrusion etc. deformation damage be known as first kind sound wave identification of damage information.Vehicle can specifically be calculated to biography
The distance of sensor, can also calculate vehicle to pinger or receiver distance;The calculating of distance is realized, sound can be based on
The Parameters Calculations such as wave wavelength, transmission time, sonic transmissions speed obtain.
Such as ultrasonic distance measurement schematic illustration shown in Fig. 4, ultrasonic wave can be emitted by transmission unit, then passed through
Receiving unit receives reflection echo.Since the aerial spread speed V of ultrasonic wave is it is known that the time for receiving echo can be with
It measures, is based on speed V and propagation time T, transmission range L can be calculated and then derive actual range D.It is specific to calculate
In the process,
It is known that the centre distance H of receiving unit and transmission unit:
Actual range D:
Transmission range L:L=VT/2;(V is ultrasonic propagation velocity, and T is the propagation time);
Due to D > > H, approximation can be obtained: D ≈ L=VT/2.
This explanation also provides the another embodiment using sound wave identification of damage, except above-mentioned based on distance identification vehicle portion
It, can also be using reflected acoustic wave information acquisition by the material distributed intelligence of detector region surface, Jin Erneng outside part deformation of unevenness
It enough judges whether there is lacquer painting to fall off, if having dust covering, if having metal layer exposing, if there are abnormal materials (originally
There are other abnormal materials in the texture area of monolith, then there may be defects, damage), in addition identify damage be new wound or
Old wound etc..The damage sound wave identification of damage information obtained in this way can be further improved vehicle damage recognition result.This specification mentions
It is described to determine that the sound wave of the detection vehicle is known based on the reflected acoustic wave information in another embodiment of the method for confession
Other damage information may include:
S42: utilizing the reflected acoustic wave information, determines to include the material distributed intelligence for detecting vehicle and being detected region
The second class sound wave identification of damage information.
It is specific to implement, due to ultrasonic wave straightline propagation in uniform dielectric, but the meeting on the interface of different medium
Reflection (between the different material of acoustic impedance) is generated, therefore the material distributed intelligence on detected surface can be obtained, so as to judge
Surface falls off with the presence or absence of lacquer painting, if has dust covering, if has metal layer exposing etc..Some embodiments of this specification
In the material distributed intelligence identified based on received reflected acoustic wave information can be known as to the second class sound wave identification of damage information.
Such as ultrasonic wave material detection schematic illustration shown in fig. 5, in Fig. 5, ultrasonic wave straight-line transmitting in uniform dielectric
It broadcasts, but reflection can be generated on the interface of different medium (between the different material of acoustic impedance);And the amplitude height of reflective echo
It is influenced by the acoustic impedance difference of both sides material, therefore we can derive acoustic impedance difference (target materials according to echo amplitude difference
The anti-air-borne sound impedance of acoustic resistance), and then target materials acoustic impedance is calculated in the situation known to air acoustic impedance, final basis
Acoustic impedance table derives target materials.In specific calculating process, if f representative function is related
Distance D=f (V, T), V are the aerial speed of ultrasonic wave, and T is the propagation time;
Echo amplitude I=f (I0, D, R1, R2), I are echo amplitude, and I0 is original amplitude, and R1 is air acoustic impedance,
Then, target materials acoustic impedance R2=f (I, I0, D, R1)=f (I, I0, VT/2, R1);
R2 is target materials acoustic impedance, in which: I (echo amplitude), 0 (original amplitude), V (the aerial speed of ultrasonic wave
Degree), T (propagation time), R1 (air acoustic impedance) they are known quantity, can calculate the value of R2, and then can be according to acoustic impedance
Table extrapolates target materials.
In some embodiments, first kind sound wave identification of damage information and second are identified in S40~S42 described above
The processing of class sound wave identification of damage information can be completed in mobile test side processing, and the two can carry out data processing simultaneously,
Non-destructive tests can be carried out respectively.Camera and sound wave can be called to visit simultaneously in mobile test side development and application program
Unit is surveyed, is taken pictures to damage location, while obtaining the three-dimensional structure and its surfacing point of photo institute overlay area
Cloth.In this way, other than obtaining photo, surface undulation distribution map, surfacing distribution can also be obtained for captured region
Figure.
In specific identification first kind sound wave identification of damage information and the second class sound wave identification of damage information process,
Mobile device (such as mobile phone, Pad) installs ultrasonic listening unit, and the unit is by multiple groups ultrasonic transmitter and receiving sensor group
At, it can be to detected surface emitting multi beam ultrasonic wave, and the ultrasonic wave that detected surface reflection is returned can be received.By ultrasound
Wave converting unit can be to detected two class view of surface structure:
A, using after transmitting by the reflected ultrasonic wave of institute's searching surface, the distance of detection sensor to surface;It is multiple
Unit works together, and can learn the three-dimensional structure on surface, to detect surface with the presence or absence of fluctuations, and then sentences
Disconnected surface whether there is the first kind sound wave identification of damage information of depressed deformation class.As shown in fig. 6, obtained first kind sound wave is known
Other damage information can be the three-dimension surface in detected region.
B, since different materials are different from the acoustic impedance difference of air, the echo amplitude height of ultrasonic reflections is also different, moves
Dynamic test side can obtain the distributed intelligence of detected surface portion specific materials, so as to judge that surface is de- with the presence or absence of lacquer painting
It falls, if having dust covering, if having metal layer exposing etc..As shown in fig. 7, obtained first kind sound wave identification of damage information
It can be ultrasonic imaging figure.
In some embodiments, the application of mobile test side can call camera and ultrasonic listening unit at the same time, right
Damage location is taken pictures, while obtaining the three-dimensional structure and the distribution of its surfacing of photo institute overlay area.In this way, right
In captured region, other than obtaining photo, also while surface undulation distribution map, surfacing distribution map are obtained.
In the present embodiment, user can also shoot the damage image of corresponding vehicle when vehicle is in danger and detects.Damage figure
As that can be obtained by mobile test side shooting.Insurance server or other processing equipments can pass through some machine learning algorithm structures
Establishing network model, after learning to sample image, can the damage image to vehicle identify, obtain detection vehicle damage
Hurt information.It, can be by the damage information of the vehicle based on image information acquisition in some embodiments of this specification as described in aforementioned
Referred to as impaired vision information (one kind for belonging to visual signature information in this manual) may include utilizing convolutional neural networks etc.
The vehicle damage information that network model identifies also may include directly knowing to the subject detection of the damage image of vehicle, damage
The damage information not obtained etc. or even also may include that manual identified is based on image or field survey identifies in some embodiments
Damage information.
Specifically, server-side can be to collected damage location image, table in some embodiments of this specification
Face fluctuating distribution and/or surfacing distributed intelligence, pass through depth network, construct an automobile that can include to captured region
The model end to end that component, degree of injury are identified.Depth nerve net can be used in some embodiments of this specification
The form of network is convolutional neural networks (CNN), can be made of convolutional layer, pond layer, full articulamentum etc., CNN network shows
Model structure of anticipating can be as shown in Figure 8.Of course, it is possible to choose other models according to demand or become to the network model of Fig. 8
Shape, transformation and improvement etc..It should be noted that above-mentioned building network model to damage location image, surface undulation distribution and/or
The process that surfacing distributed intelligence is handled can also be realized in the mobile test side.
Under application scenes at present in the industry, by convolutional neural networks pure picture is identified there are some
Injury pattern.The non-destructive tests result accuracy for being based only upon the detection vehicle that visual signature information determines is lower, and there are certain
Limitation, or even the degree of injury on the surface that is taken can not be completely restored to.In some embodiments of this specification, sound can be introduced
The sound wave damage information that wave obtains, such as the surface undulation that is taken image, Facing material distribution after, can provide additional
Non-destructive tests feature, handled in conjunction with visual signature, more complete, accurate non-destructive tests output result can be provided.
In specific application example, may include:
A. the depth information and visual information of mating surface promotes the accuracy rate of recess, deformation class non-destructive tests;
B. material distributed intelligence and depth information are utilized, the visions disturbing factors such as reflective, inverted image, dust spot are repaired
Just, it is damage that deep neural network, which can be effectively prevented, by the interference wrong identification such as inverted image;
C. degree of injury is more accurately judged, it, can will be quasi- especially to subtle recess, peeling paint equivalent damage
True degree is promoted to the height being unable to reach only according to visual information.
It therefore, include first kind sound wave identification of damage information and/or the second class sound wave obtained in this specification embodiment
On the one hand identification of damage information etc. can supplement the recognition result of the visual signature information acquisition based on damage image etc.,
Correct etc., it on the other hand can directly participate in being applied in the non-destructive tests treatment process of view-based access control model characteristic information.Specifically
During realization, operating personnel can be set accordingly according to actual scene or the network model of selection, recognizer etc.
It sets.Therefore, in another embodiment of the method that this specification provides, the sound wave according to the detection vehicle is identified
Damage information and visual signature information determine the non-destructive tests of the detection vehicle as a result, may include:
S60: according to the sound wave damage information, the recognition result based on the visual signature information is calibrated, really
The non-destructive tests result of the fixed detection vehicle.
Calibration described above may include the further information supplement to recognition result, or to all or part of knowledge
Correction, corrigendum, the amendment etc. of other result, or when the recognition result of sound wave damage information and view-based access control model characteristic information is in the presence of poor
Different time is chosen one of as the damage effectively identified, naturally it is also possible to using sound wave damage information to view-based access control model spy
The recognition result of reference breath optimizes.
Based on described above, in another embodiment, the sound wave damage information of acquisition can be applied to based on vehicle damage
In the network model of image, the accuracy of network model output result is further increased.Therefore, the side that this specification provides
In another embodiment of method, after receiving or determining the sound wave identification of damage information, the method also includes:
S62: utilizing the sound wave damage information, to the depth nerve net for carrying out identifying processing to vehicle damage image
The parameter of network is modified;
Correspondingly, it is described according to it is described detection vehicle sound wave identification of damage information and visual signature information, determine described in
The non-destructive tests result for detecting vehicle includes: to be identified using the deep neural network after parameters revision to vehicle damage image
Processing obtains the non-destructive tests result of the detection vehicle.
A kind of processing method for vehicle damage detection that this specification embodiment provides can pass through sound in mobile test side
Wave probe unit, to detection vehicle emissions sound wave.Then it receives and is detected the sound wave that vehicle is reflected back, it is anti-by collecting, analyzing
The information of acoustic wave penetrated can be detected and be identified to the degree of impairment on the surface and inside of detecting vehicle, obtain detection vehicle
Degree of impairment.The vehicle sound wave identification of damage information that can use acoustic detection acquisition in some embodiments, as auxiliary
Supplementary information combines the damage information obtained based on vehicle image, determines the damage information of vehicle jointly, can be further
Improve the accuracy of non-destructive tests.This specification embodiment utilizes the sound impedance characteristic of some sound rangings and unlike material
Deng, can to the sound wave of reflection carry out specific dimension data processing, identify detection vehicle more accurate sound wave identification
Damage information, this sound wave identification of damage information can be used as the non-destructive tests of detection vehicle as a result, can also damage with secondary combined
Hurt identification method or non-destructive tests as a result, realizing the whole accuracy and reliability for improving vehicle damage recognition result, Jin Erti
High vehicle Claims Resolution setting loss result.
After server determines the damage information of vehicle, it can further carry out automatic setting loss, determine payout schedule, and
Carry out compensation processing etc..
In general, the server, such as the server of insurance server or halfpace, usually with mobile test side
It compares, there is better processing capacity, the vehicle damage identification based on acoustic detection can be handled in server-side.Therefore
By mobile test side transmitting sound wave and reflected acoustic wave information can also be received in some embodiments, reflected acoustic wave information is uploaded to
Server carry out non-destructive tests and may further automatic setting loss, determine the interaction process of payout schedule, reduce user terminal
Processing pressure, improve processing recognition efficiency.Under some implement scenes that this specification provides, mobile test side can also be docked
The reflected acoustic wave information of receipts is handled, and identifies the damage information of vehicle.Mobile test side obtains sound wave identification of damage information
After be then forwarded to server, the damage of vehicle is determined by server combination sound wave identification of damage information and view-based access control model characteristic information
Hurt recognition result.Mobile test side side Direct Recognition goes out sound wave identification of damage information, can reduce server load pressure.
Mobile test side based on above-mentioned some embodiment descriptions interacts the processing for realizing vehicle damage detection with server
Method, this specification also provide a kind of vehicle damage inspection of terminal device side that can be applied to for example described mobile test side
The processing method of survey.In specific one embodiment, shown in Fig. 9, another implementation of the method that Fig. 9 this specification provides
Example flow diagram, the method may include:
S100: to detection vehicle emissions sound wave (can by control acoustic detection unit to detection vehicle emissions sound wave),
And the sound wave of detection vehicle reflection is received, generate reflected acoustic wave information;
S102: the sound wave identification of damage information of the detection vehicle is determined based on the reflected acoustic wave information;
S104: being sent to server for the sound wave identification of damage information, so that the server is according to the detection vehicle
Sound wave identification of damage information and visual signature information determine it is described detection vehicle non-destructive tests as a result, the visual signature
Information is obtained based on the damage image of the detection vehicle.
The method concrete implementation that can be applicable to terminal device described above and treatment process are referred to aforementioned side
The description of method embodiment.
Based on aforementioned implementation describe, this specification also provide it is a kind of can be applied to such as server of vehicle insurance server or
The processing method of the vehicle damage detection of the Platform Server side of vehicle insurance server is provided.In specific one embodiment, figure
Shown in 10, the flow diagram of another embodiment of the method that Figure 10 this specification provides, the method may include:
S200: it receives the sound wave using the determining detection vehicle of the reflected acoustic wave information that mobile test side is sent and identifies damage
Hurt information, the reflected acoustic wave information is based on mobile test side to detection vehicle emissions sound wave and receives the detection vehicle reflection
Sound wave generate data information;
S202: according to the sound wave identification of damage information and visual signature information of the detection vehicle, the detection vehicle is determined
Non-destructive tests as a result, the visual signature information based on it is described detection vehicle damage image obtain.
It should be noted that the method for this specification embodiment terminal device side or server-side described above,
It can also include other embodiments according to the description of related more mutual embodiments of the method for top-cross, such as utilize the reflected acoustic wave
Information calculates mobile test side to the distance of the detection vehicle, constructs the detected of the detection vehicle based on the distance
The construction view in region determines that there are the first kind sound of deformation of unevenness according to the fluctuations information of component in the construction view
Wave identification of damage information;Alternatively, calculating the material point in the detected region of the detection vehicle using the reflected acoustic wave information
Cloth information determines the second class sound wave identification of damage information according to the material distributed intelligence;Believe alternatively, being damaged according to the sound wave
Breath, the recognition result based on the visual signature information is calibrated, determine it is described detection vehicle non-destructive tests as a result, or
Person, using the sound wave damage information, to the parameter of the deep neural network for carrying out identifying processing to vehicle damage image
It is modified.Concrete implementation mode is referred to the description of aforementioned related method embodiment, does not repeat one by one herein.
Various embodiments are described in a progressive manner for the above method in this specification, identical between each embodiment
Similar part may refer to each other, and each embodiment focuses on the differences from other embodiments.Correlation
Place illustrates referring to the part of embodiment of the method.
Embodiment of the method provided by the embodiment of the present application can be in fixed terminal, mobile terminal, server or similar
Arithmetic unit in execute.For running on mobile terminals, Figure 11 is damaged using a kind of vehicle of this specification embodiment
The mobile terminal hardware block diagram for the processing method that triage is surveyed, there is more or fewer hardware configurations.Specifically, such as Figure 11 institute
Show, mobile terminal 11 may include one or more (one is only shown in figure) processors 102 (processor 102 may include but
Be not limited to the processing unit of Micro-processor MCV or programmable logic device FPGA etc.), memory 104 for storing data, with
And the transmission module 106 for communication function.It will appreciated by the skilled person that structure shown in Figure 11 is only to show
Meaning, does not cause to limit to the structure of above-mentioned electronic device.For example, mobile terminal may also include it is more than shown in Figure 11 or
The less component of person, such as can also include other processing hardware, such as GPU (Graphics Processing Unit, image
Processor), or with the configuration different from shown in Figure 11.
Memory 104 can be used for storing the software program and module of application software, such as one of embodiment of the present invention
Corresponding program instruction/the module of processing method of vehicle damage detection, processor 102 are stored in memory 104 by operation
Software program and module, thereby executing various function application and data processing, i.e., the insuring of realization terminal screen insurance,
The processing such as Claims Resolution, examination, compensation.Memory 104 may include high speed random access memory, may also include nonvolatile memory, such as
One or more magnetic storage device, flash memory or other non-volatile solid state memories.In some instances, memory
104 can further comprise the memory remotely located relative to processor 102, these remote memories can pass through network connection
To terminal.The example of above-mentioned network include but is not limited to internet, intranet, local area network, mobile radio communication and
A combination thereof.
Transmission module 106 is used to that data to be received or sent via a network.Above-mentioned network specific example may include
The wireless network that the communication providers of terminal 10 provide.In an example, transmission module 106 includes that a network is suitable
Orchestration (Network Interface Controller, NIC), can be connected by base station with other network equipments so as to
Internet is communicated.In an example, transmission module 106 can be radio frequency (Radio Frequency, RF) module,
For wirelessly being communicated with internet.
Based on the processing method that vehicle damage described above detects, this specification also provides a kind of vehicle damage detection
Processing unit.The device may include system (including the distributed system for having used this specification embodiment the method
System), software (application), module, component, server, client etc. and the apparatus for combining necessary implementation hardware.Based on same
One innovation thinking, the processing unit in a kind of embodiment that this specification provides is as described in the following examples.Due to device solution
Certainly the implementation of problem is similar to method, thus the implementation of the specific processing unit of this specification embodiment may refer to it is aforementioned
The implementation of method, overlaps will not be repeated.Although device described in following embodiment is preferably realized with software,
The realization of the combination of hardware or software and hardware is also that may and be contemplated.Specifically, as shown in figure 12, Figure 12 is this
The modular structure for the processing device embodiment that a kind of vehicle damage that can be used for server-side that specification provides detects is shown
It is intended to, the server can be individual server or server cluster or distributed system etc., specifically can wrap
It includes:
Acoustic detection receiving module 200, can be used for receiving mobile test side transmission utilizes the reflected acoustic wave information
Determine that the sound wave identification of damage information of detection vehicle, the reflected acoustic wave information are based on mobile test side to detection vehicle emissions sound
The data information that wave and the sound wave for receiving the detection vehicle reflection generate;
Processing module 202 is damaged, can be used for sound wave identification of damage information and visual signature according to the detection vehicle
Information determines the non-destructive tests of the detection vehicle as a result, damage figure of the visual signature information based on the detection vehicle
As obtaining.
Visual signature information in the damage processing module 202, can be by the damage processing module 202 to vehicle
Damage image using preset algorithm or network model processing after obtain, also can receive and handled by other modular units
Obtained feedback result.
The associated description of processing method based on the detection of aforementioned server side vehicle damage, this specification provide described
In another embodiment of device, the sound wave identification of damage information may include at least one of following:
Using the reflected acoustic wave information, mobile test side is calculated to the distance of the detection vehicle, is based on the distance
Building includes at least one construction view view that the detection vehicle is detected the surface in region, is detected inside region, is determined
First kind sound wave identification of damage information including the construction view;
Using the reflected acoustic wave information, determine to include the of material distributed intelligence that the detection vehicle is detected region
Two class sound wave identification of damage information.
In another embodiment of described device, the damage processing module 202 may include:
As a result calibration unit 2020 can be used for according to the sound wave damage information, to based on the visual signature information
Recognition result calibrated, determine it is described detection vehicle non-destructive tests result.
In another embodiment, the damage processing module 202 may include:
Modifying model unit 2022, can be used for using the sound wave damage information, to for vehicle damage image into
The parameter of the deep neural network of row identifying processing is modified;
Correspondingly, damaged processing module 202 using the deep neural network after parameters revision to vehicle damage image into
Row identifying processing obtains the non-destructive tests result of the detection vehicle.
It, can be using at least one of following modes in the vehicle damage identifying processing of described device:
Sound wave used by being detected to the detection vehicle is ultrasonic wave;
The damage image of the detection vehicle is uploaded by the mobile test side shooting and is obtained.
As shown in figure 13, based on aforementioned related method embodiment describe, Figure 13 be this specification provide can be used for moving
A kind of modular structure schematic diagram of the processing device embodiment of vehicle damage detection of dynamic test side side.Described mobile detection
End can wrap may include mobile communications device, notebook, mobile unit, personal digital assistant etc. terminal device.Specifically,
In one embodiment of described device, may include:
Acoustic detection module 300 can be used for detection vehicle emissions sound wave, and receive the sound wave of detection vehicle reflection,
Generate reflected acoustic wave information;
Sound wave non-destructive tests module 302 can be used for determining the sound of the detection vehicle based on the reflected acoustic wave information
Wave identification of damage information;
Data uploading module 304 can be used for the sound wave identification of damage information being sent to server, so that the clothes
Business device determines that the damage of the detection vehicle is known according to the sound wave identification of damage information and visual signature information of the detection vehicle
Not as a result, the visual signature information is obtained based on the damage image of the detection vehicle.
In another embodiment of described device, the sound wave non-destructive tests module 302 may include:
First non-destructive tests unit 3020 can be used for calculating mobile test side to institute using the reflected acoustic wave information
The distance for stating detection vehicle includes that the detection vehicle is detected the surface in region, detected region based on the distance building
Internal at least one construction view view, determining includes the first kind sound wave identification of damage information of the construction view.
Device described in the present embodiment, can based on Acoustic Wave Propagation information technology object (can for mobile test side or
The a certain partial devices or other reference substances of mobile test side) arrive the surface and inside for detecting the detected region of vehicle
The distance of component forms construction view based on distance building.Construction view can be used for being the construction under faulted condition with vehicle
View compares, the abnormal fluctuations information in obtaining widget or structure, and then may determine that vehicle with the presence or absence of recess
Deform equivalent damage.
Correspondingly, it is detected to the wave impedance difference identification of different materials to be also based on sound wave in another embodiment
The material distribution situation in region.Therefore, in another embodiment of described device, the sound wave non-destructive tests module 302 can be with
Include:
Second non-destructive tests unit 3022 can be used for determining to include the detection vehicle using the reflected acoustic wave information
Second class sound wave identification of damage information of the material distributed intelligence in detected region.
The present embodiment device can obtain the material distributed intelligence on detected surface, so as to judge surface with the presence or absence of paint
Emaciated face is fallen, if has dust covering, if has metal layer exposing etc..The vehicle damage recognition result that can be further improved
Accuracy.
Figure 14 is the modular structure schematic diagram of another embodiment for the described device that this specification provides, in embodiment
In, the sound wave non-destructive tests module 302 of described device may include calculating the device unit for obtaining first kind sound wave identification of damage,
It also may include calculating the device unit for obtaining the second class sound wave identification of damage.Or may include above-mentioned the two, such as Figure 14 institute
Show, wherein the dotted line expression in Figure 10 can include the device unit simultaneously in some embodiments.
As described in preceding method embodiment, in the other embodiments of described device, the acoustic detection unit is to the inspection
Sound wave used by measuring car is detected is ultrasonic wave;
Alternatively, further include image capturing unit, for shooting the damage image for obtaining the detection vehicle, and by the damage
Hurt image and is sent to server.
It should be noted that the device that this specification embodiment is described above, also according to the description of related method embodiment
It may include other embodiments.Concrete implementation mode is referred to the description of embodiment of the method, does not go to live in the household of one's in-laws on getting married one by one herein
It states.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Since it is substantially similar
In embodiment of the method, so being described relatively simple, the relevent part can refer to the partial explaination of embodiments of method.
A kind of processing unit for vehicle damage detection that this specification embodiment provides, can be by being mounted on mobile detection
The acoustic detection unit at end, to detection vehicle emissions sound wave.Then it receives and is detected the sound wave that vehicle is reflected back, by collecting,
The information of acoustic wave of reflection is analyzed, the degree of impairment on the surface and inside of detecting vehicle can be detected and be identified, obtained
Detect the degree of impairment of vehicle.Server can use the vehicle damage information of acoustic detection acquisition in some embodiments, make
For auxiliary information or the damage information obtained based on vehicle image is combined, determines the damage information of vehicle, Ke Yijin jointly
The accuracy of one step raising non-destructive tests.This specification embodiment is special using the sound impedance of some sound rangings and unlike material
Property etc., the data processing of specific dimension can be carried out to the sound wave of reflection, identify that the more accurate sound wave of detection vehicle is known
Other damage information, this sound wave identification of damage information can be used as the non-destructive tests of detection vehicle as a result, can also be with secondary combined
Non-destructive tests mode or non-destructive tests are as a result, realize the whole accuracy and reliability for improving vehicle damage recognition result, in turn
Improve vehicle Claims Resolution setting loss result.
The treating method and apparatus for the vehicle damage detection that this specification embodiment provides can be in a computer by handling
Device executes corresponding program instruction to realize, such as using the c++ language of windows operating system in the realization of the end PC or other examples
As Linux, android, the corresponding application design language of iOS system combine necessary hardware realization, or based on distribution
The multiserver of system is handled, or realization of the processing logic based on quantum computer etc..Specifically, the one of this specification offer
Kind server realizes in the embodiment of the above method or device that the server may include processor and handle for storage
The memory of device executable instruction, the processor are realized when executing described instruction:
The sound wave identification of damage using the determining detection vehicle of the reflected acoustic wave information that mobile test side is sent is received to believe
Breath, the reflected acoustic wave information to detection vehicle emissions sound wave and receive the sound for detecting vehicle and reflecting based on mobile test side
The data information that wave generates;
According to the sound wave identification of damage information and visual signature information of the detection vehicle, the damage of the detection vehicle is determined
Hurt recognition result, the visual signature information is obtained based on the damage image of the detection vehicle.
A kind of terminal device that this specification provides is realized in the embodiment of the above method or device, such as mobile phone, described
Terminal device may include processor and the memory for storage processor executable instruction, described in the processor executes
It is realized when instruction:
To detection vehicle emissions sound wave, and the sound wave of detection vehicle reflection is received, generates reflected acoustic wave information;
The sound wave identification of damage information of the detection vehicle is determined based on the reflected acoustic wave information;
The sound wave identification of damage information is sent to server, so that sound of the server according to the detection vehicle
Wave identification of damage information and visual signature information determine the non-destructive tests of the detection vehicle as a result, the visual signature information base
It is obtained in the damage image of the detection vehicle.
Instruction described above can store in a variety of computer readable storage mediums.The computer-readable storage medium
Matter may include the physical unit for storing information, and the side such as electricity, magnetic or optics will can be utilized again after information digitalization
The media of formula are stored.It may include: to be stored in the way of electric energy that computer readable storage medium described in the present embodiment, which has,
The device of information such as, various memory, such as RAM, ROM;The device of information is stored in the way of magnetic energy such as, hard disk, floppy disk, magnetic
Band, core memory, magnetic bubble memory, USB flash disk;Using optical mode storage information device such as, CD or DVD.Certainly, there are also it
Readable storage medium storing program for executing of his mode, such as quantum memory, graphene memory etc..The following devices or server or
Instruction in client or system ibid describes.
According to aforementioned described, this specification also provides a kind of system of vehicle damage detection, and the system may include moving
Dynamic test side and server,
The mobile test side includes at least one processor and the memory for storage processor executable instruction,
The processor is realized when executing described instruction:
To detection vehicle emissions sound wave, and the sound wave of detection vehicle reflection is received, generates reflected acoustic wave information;Based on described
Reflected acoustic wave information determines the sound wave identification of damage information of the detection vehicle;Shooting obtains the damage figure of the detection vehicle
Picture;And the sound wave identification of damage information and the damage image are sent to server;
The server includes at least one processor and the memory for storage processor executable instruction, described
Processor is realized when executing described instruction:
The sound wave identification of damage information and damage image that mobile test side is sent are received, according to the sound wave of the detection vehicle
Identification of damage information and visual signature information determine the non-destructive tests of the detection vehicle as a result, the visual signature information base
It is obtained in the damage image of the detection vehicle.
In other system embodiments, sound wave used by being detected to the detection vehicle is ultrasonic wave, and/or,
The sound wave identification of damage information includes characterizing the detection vehicle and being detected region to show fluctuating distributed intelligence, the detection
Vehicle is detected at least one of the material distributed intelligence in region.
Figure 15 is a kind of implement scene schematic diagram using this specification system embodiment.
Mobile terminal described in above-described embodiment specifically can be mobile communication terminal, such as mobile phone.In this way, when needing
When carrying out vehicle damage detection, user can be used portable mobile communication terminal and carry out shooting acquisition damage picture
At the same time it can also detecting the associated injury information of depressed deformation or material distribution by ultrasonic wave, providing non-destructive tests and determining
Processing result precision is damaged, user experience is improved.Mobile communication terminal can combine and use the camera or velocity pick-up of itself
Device, direction sensor etc. provide the information of non-destructive tests processing.Therefore, a kind of implementation above method that this specification provides
Mobile communication terminal, the mobile communication terminal may include processor and the storage for storage processor executable instruction
Device, the processor are realized when executing described instruction:
To detection vehicle emissions sound wave, and the sound wave of detection vehicle reflection is received, generates reflected acoustic wave information;
The sound wave identification of damage information of the detection vehicle is determined based on the reflected acoustic wave information;
Shooting obtains the damage image of the detection vehicle;
The sound wave identification of damage information and damage image are sent to server, so that the server is according to the inspection
The sound wave identification of damage information and visual signature information of measuring car determine the non-destructive tests of the detection vehicle as a result, the vision
Characteristic information is obtained based on the damage image of the detection vehicle.
Mobile terminal described in above-described embodiment can be specifically mobile unit, and mobile unit can be according to various
On motor-driven or non power driven vehicle.In this way, user can be used mobile unit and shoot when needing to carry out vehicle damage detection
While obtaining damage picture, the associated injury information of depressed deformation or material distribution can also be detected by ultrasonic wave, is mentioned
For non-destructive tests and setting loss processing result precision, user experience is improved.Mobile unit can be with the automobile data recorder or speed of vehicle
Degree sensor, direction sensor etc. are connected, and provide the information of non-destructive tests processing or camera shooting and/or the sound of car owner's equipment
Wave probe unit can separate, and so as to user's use, carry out image taking or acoustic detection.Therefore, the one of this specification offer
Kind implements the mobile unit of the above method, and the mobile unit may include processor and finger can be performed for storage processor
The memory of order, the processor are realized when executing described instruction:
To detection vehicle emissions sound wave, and the sound wave of detection vehicle reflection is received, generates reflected acoustic wave information;
The sound wave identification of damage information of the detection vehicle is determined based on the reflected acoustic wave information;
Shooting obtains the damage image of the detection vehicle;
The sound wave identification of damage information and damage image are sent to server, so that the server is according to the inspection
The sound wave identification of damage information and visual signature information of measuring car determine the non-destructive tests of the detection vehicle as a result, the vision
Characteristic information is obtained based on the damage image of the detection vehicle.
It is right in the embodiment of the above method or device or server or system and mobile communication terminal, mobile unit etc.
Sound wave used by the detection vehicle is detected can be ultrasonic wave.The damage check application of setting loss is carried out in car insurance
In scene, the construction view of the detection surface of vehicle and inside that can be more clear using ultrasonic wave, the spy to material distribution
Survey is also more clear, and can be further improved the accuracy of non-destructive tests result.
It should be noted that this specification embodiment device described above, terminal device, server, system, mobile logical
Believe terminal, mobile unit etc., can also include other embodiments according to the description of correlation technique or Installation practice, such as
Sound wave used by the detection vehicle is detected is ultrasonic wave, and, the sound wave identification of damage information includes characterization institute
That states the detected region of detection vehicle shows that fluctuating distributed intelligence, the detection vehicle are detected in the material distributed intelligence in region
At least one.Concrete implementation mode is referred to the description of embodiment of the method, does not repeat one by one herein.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for hardware+
For program class embodiment, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to side
The part of method embodiment illustrates.
It is above-mentioned that this specification specific embodiment is described.Other embodiments are in the scope of the appended claims
It is interior.In some cases, the movement recorded in detail in the claims or step can be come according to the sequence being different from embodiment
It executes and desired result still may be implemented.In addition, process depicted in the drawing not necessarily require show it is specific suitable
Sequence or consecutive order are just able to achieve desired result.In some embodiments, multitasking and parallel processing be also can
With or may be advantageous.
A kind of processing method for vehicle damage detection that this specification embodiment provides device, equipment, server and is
System, can be by the acoustic detection unit of mobile test side, to detection vehicle emissions sound wave.Then it receives and is detected vehicle reflection
Return sound wave, by collecting, analyzing the information of acoustic wave of reflection, can to detection vehicle surface and inside degree of impairment into
Row detection and identification, obtain the degree of impairment of detection vehicle.It can use the vehicle of acoustic detection acquisition in some embodiments
Damage information as auxiliary information or is combined the damage information obtained based on vehicle image, determines the damage of vehicle jointly
Information can be further improved the accuracy of non-destructive tests.This specification embodiment utilizes some sound rangings and unlike material
Sound impedance characteristic etc., the data processing of specific dimension can be carried out to the sound wave of reflection, identify detection vehicle more
Accurate sound wave identification of damage information, this sound wave identification of damage information can be used as the non-destructive tests of detection vehicle as a result,
Can in a manner of secondary combined non-destructive tests or non-destructive tests as a result, realize the whole accuracy for improving vehicle damage recognition result and
Reliability, and then improve vehicle Claims Resolution setting loss result.
Although this application provides the method operating procedure as described in embodiment or flow chart, based on conventional or noninvasive
The labour for the property made may include more or less operating procedure.The step of enumerating in embodiment sequence is only numerous steps
One of execution sequence mode, does not represent and unique executes sequence.It, can when device or client production in practice executes
To execute or parallel execute (such as at parallel processor or multithreading according to embodiment or method shown in the drawings sequence
The environment of reason).
Although mentioned in this specification embodiment content using ultrasonic listening, using sound wave propagation characteristic calculate away from
From, determined using the sound impedance characteristic of different medium material distribution and mobile test side directly feed back sound wave reflective information or
It locally identifies and feeds back to the data acquisition of server, CNN network model processing visual signature information or the like after damaging, deposits
The operations such as storage, interaction, calculating, judgement and data description, still, this specification embodiment is not limited to meet industry
Communication standard, standard image data processing protocol, communication protocol and standard network model/template or this specification embodiment are retouched
The case where stating.Certain professional standards use reality modified slightly in customized mode or the practice processes of embodiment description
Apply scheme also and may be implemented above-described embodiment is identical, after equivalent or close or deformation it is anticipated that implementation result.It is repaired using these
Change or the embodiment of the acquisitions such as deformed data acquisition, storage, judgement, processing mode, still may belong to this specification
Within the scope of optional embodiment.
In the 1990s, the improvement of a technology can be distinguished clearly be on hardware improvement (for example,
Improvement to circuit structures such as diode, transistor, switches) or software on improvement (improvement for method flow).So
And with the development of technology, the improvement of current many method flows can be considered as directly improving for hardware circuit.
Designer nearly all obtains corresponding hardware circuit by the way that improved method flow to be programmed into hardware circuit.Cause
This, it cannot be said that the improvement of a method flow cannot be realized with hardware entities module.For example, programmable logic device
(Programmable Logic Device, PLD) (such as field programmable gate array (Field Programmable Gate
Array, FPGA)) it is exactly such a integrated circuit, logic function determines device programming by user.By designer
Voluntarily programming comes a digital display circuit " integrated " on a piece of PLD, designs and makes without asking chip maker
Dedicated IC chip.Moreover, nowadays, substitution manually makes IC chip, this programming is also used instead mostly " is patrolled
Volume compiler (logic compiler) " software realizes that software compiler used is similar when it writes with program development,
And the source code before compiling also write by handy specific programming language, this is referred to as hardware description language
(Hardware Description Language, HDL), and HDL is also not only a kind of, but there are many kind, such as ABEL
(Advanced Boolean Expression Language)、AHDL(Altera Hardware Description
Language)、Confluence、CUPL(Cornell University Programming Language)、HDCal、JHDL
(Java Hardware Description Language)、Lava、Lola、MyHDL、PALASM、RHDL(Ruby
Hardware Description Language) etc., VHDL (Very-High-Speed is most generally used at present
Integrated Circuit Hardware Description Language) and Verilog.Those skilled in the art also answer
This understands, it is only necessary to method flow slightly programming in logic and is programmed into integrated circuit with above-mentioned several hardware description languages,
The hardware circuit for realizing the logical method process can be readily available.
Controller can be implemented in any suitable manner, for example, controller can take such as microprocessor or processing
The computer for the computer readable program code (such as software or firmware) that device and storage can be executed by (micro-) processor can
Read medium, logic gate, switch, specific integrated circuit (Application Specific Integrated Circuit,
ASIC), the form of programmable logic controller (PLC) and insertion microcontroller, the example of controller includes but is not limited to following microcontroller
Device: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20 and Silicone Labs C8051F320 are deposited
Memory controller is also implemented as a part of the control logic of memory.It is also known in the art that in addition to
Pure computer readable program code mode is realized other than controller, can be made completely by the way that method and step is carried out programming in logic
Controller is obtained to come in fact in the form of logic gate, switch, specific integrated circuit, programmable logic controller (PLC) and insertion microcontroller etc.
Existing identical function.Therefore this controller is considered a kind of hardware component, and to including for realizing various in it
The device of function can also be considered as the structure in hardware component.Or even, it can will be regarded for realizing the device of various functions
For either the software module of implementation method can be the structure in hardware component again.
System, device, module or the unit that above-described embodiment illustrates can specifically realize by computer chip or entity,
Or it is realized by the product with certain function.It is a kind of typically to realize that equipment is computer.Specifically, computer for example may be used
Think personal computer, laptop computer, vehicle-mounted human-computer interaction device, cellular phone, camera phone, smart phone, individual
Digital assistants, media player, navigation equipment, electronic mail equipment, game console, tablet computer, wearable device or
The combination of any equipment in these equipment of person.
Although this specification embodiment provides the method operating procedure as described in embodiment or flow chart, based on conventional
It may include either more or less operating procedure without creative means.The step of being enumerated in embodiment sequence be only
One of numerous step execution sequence mode does not represent and unique executes sequence.Device or end product in practice is held
When row, can be executed according to embodiment or method shown in the drawings sequence or it is parallel execute (such as parallel processor or
The environment of multiple threads, even distributed data processing environment).The terms "include", "comprise" or its any other change
Body is intended to non-exclusive inclusion, so that process, method, product or equipment including a series of elements are not only wrapped
Those elements are included, but also including other elements that are not explicitly listed, or further includes for this process, method, product
Or the element that equipment is intrinsic.In the absence of more restrictions, being not precluded is including process, the side of the element
There is also other identical or equivalent elements in method, product or equipment.
For convenience of description, it is divided into various modules when description apparatus above with function to describe respectively.Certainly, implementing this
The function of each module can be realized in the same or multiple software and or hardware when specification embodiment, it can also be by reality
Show the module of same function by the combination realization etc. of multiple submodule or subelement.Installation practice described above is only
Schematically, for example, the division of the unit, only a kind of logical function partition, can there is other draw in actual implementation
The mode of dividing, such as multiple units or components can be combined or can be integrated into another system, or some features can be ignored,
Or it does not execute.Another point, shown or discussed mutual coupling, direct-coupling or communication connection can be by one
The indirect coupling or communication connection of a little interfaces, device or unit can be electrical property, mechanical or other forms.
It is also known in the art that other than realizing controller in a manner of pure computer readable program code, it is complete
Entirely can by by method and step carry out programming in logic come so that controller with logic gate, switch, specific integrated circuit, programmable
Logic controller realizes identical function with the form for being embedded in microcontroller etc..Therefore this controller is considered one kind
Hardware component, and the structure that the device for realizing various functions that its inside includes can also be considered as in hardware component.Or
Person even, can will be considered as realizing the device of various functions either the software module of implementation method can be hardware again
Structure in component.
The present invention be referring to according to the method for the embodiment of the present invention, the process of equipment (system) and computer program product
Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions
The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs
Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce
A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real
The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates,
Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or
The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting
Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or
The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one
The step of function of being specified in a box or multiple boxes.
In a typical configuration, calculating equipment includes one or more processors (CPU), input/output interface, net
Network interface and memory.
Memory may include the non-volatile memory in computer-readable medium, random access memory (RAM) and/or
The forms such as Nonvolatile memory, such as read-only memory (ROM) or flash memory (flash RAM).Memory is computer-readable medium
Example.
Computer-readable medium includes permanent and non-permanent, removable and non-removable media can be by any method
Or technology come realize information store.Information can be computer readable instructions, data structure, the module of program or other data.
The example of the storage medium of computer includes, but are not limited to phase change memory (PRAM), static random access memory (SRAM), moves
State random access memory (DRAM), other kinds of random access memory (RAM), read-only memory (ROM), electric erasable
Programmable read only memory (EEPROM), flash memory or other memory techniques, read-only disc read only memory (CD-ROM) (CD-ROM),
Digital versatile disc (DVD) or other optical storage, magnetic cassettes, tape magnetic disk storage or other magnetic storage devices
Or any other non-transmission medium, can be used for storage can be accessed by a computing device information.As defined in this article, it calculates
Machine readable medium does not include temporary computer readable media (transitory media), such as the data-signal and carrier wave of modulation.
It will be understood by those skilled in the art that the embodiment of this specification can provide as the production of method, system or computer program
Product.Therefore, in terms of this specification embodiment can be used complete hardware embodiment, complete software embodiment or combine software and hardware
Embodiment form.Moreover, it wherein includes computer available programs that this specification embodiment, which can be used in one or more,
Implement in the computer-usable storage medium (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) of code
The form of computer program product.
This specification embodiment can describe in the general context of computer-executable instructions executed by a computer,
Such as program module.Generally, program module includes routines performing specific tasks or implementing specific abstract data types, journey
Sequence, object, component, data structure etc..This specification embodiment can also be practiced in a distributed computing environment, in these points
Cloth calculates in environment, by executing task by the connected remote processing devices of communication network.In distributed computing ring
In border, program module can be located in the local and remote computer storage media including storage equipment.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality
For applying example, since it is substantially similar to the method embodiment, so being described relatively simple, related place is referring to embodiment of the method
Part explanation.In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ",
The description of " specific example " or " some examples " etc. means specific features described in conjunction with this embodiment or example, structure, material
Or feature is contained at least one embodiment or example of this specification embodiment.In the present specification, to above-mentioned term
Schematic representation be necessarily directed to identical embodiment or example.Moreover, description specific features, structure, material or
Person's feature may be combined in any suitable manner in any one or more of the embodiments or examples.In addition, in not conflicting feelings
Under condition, those skilled in the art by different embodiments or examples described in this specification and different embodiment or can show
The feature of example is combined.
The foregoing is merely the embodiments of this specification embodiment, are not limited to this specification embodiment.It is right
For those skilled in the art, this specification embodiment can have various modifications and variations.It is all in this specification embodiment
Any modification, equivalent replacement, improvement and so within spirit and principle, the right that should be included in this specification embodiment are wanted
Within the scope of asking.