Summary of the invention
Based on this, the invention proposes a kind of power equipment nameplate recognition methods, device, computer equipment and storages to be situated between
Matter, to solve the problems, such as conventional electric power equipment nameplate identification inaccuracy.
A kind of power equipment nameplate recognition methods, comprising steps of
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
Nameplate type in the identification nameplate image in one of the embodiments, comprising:
By nameplate disaggregated model, the characteristics of image in described image region is extracted from the nameplate image;
According to the characteristics of image in described image region, nameplate region is identified;The nameplate region be include nameplate feature
Image-region;
According to the nameplate region, the nameplate type is determined.
It is described according to the nameplate region in one of the embodiments, determine nameplate type, comprising:
According to the characteristics of image in the nameplate region, the nameplate region is evaluated, obtains nameplate region scoring;
It is scored according to the nameplate region, classifies to the nameplate region, obtain the nameplate type.
It is described by nameplate disaggregated model in one of the embodiments, identify the nameplate type in the nameplate image
Before, further includes:
Obtain a large amount of nameplate images;
Mark the nameplate region and the nameplate type in the nameplate image;
It will be trained in nameplate image input deep neural network model after mark, obtain the nameplate classification
Model.
It is described according to the nameplate type in one of the embodiments, determine corresponding Text region model, comprising:
Obtain multiple candidate identification models;Candidate's identification model has corresponding nameplate type;
In the multiple candidate identification model, candidate identification model corresponding with the nameplate type is extracted, as
The Text region model.
It is described in one of the embodiments, to identify nameplate text using Text region model, comprising:
Obtain text candidate frame;
Obtain the text confidence level of the text candidate frame;
The text candidate frame is filtered according to the text confidence level, obtains the Text region frame;
According to the Text region frame, the nameplate text is obtained.
It is described according to the Text region frame in one of the embodiments, obtain the nameplate text, comprising:
It identifies the Text region frame, obtains candidate character;
Obtain the matching degree of the candidate character Yu the nameplate text;
According to the matching degree, determine that the candidate character is the nameplate text.
A kind of power equipment nameplate identification device, described device include:
Image collection module, for obtaining nameplate image;
Type identification module, for identification the nameplate type of the nameplate image;
Text region module for determining corresponding Text region model according to the nameplate type, and utilizes the text
Word identification model identifies nameplate text.
A kind of computer equipment, including memory and processor, the memory are stored with computer program, the processing
Device performs the steps of when executing the computer program
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
A kind of computer readable storage medium, is stored thereon with computer program, and the computer program is held by processor
It is performed the steps of when row
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
Above-mentioned power equipment nameplate recognition methods, device, computer equipment and storage medium, are known by nameplate disaggregated model
Nameplate type in other nameplate image determines corresponding Text region mould according to nameplate type from candidate character identification model
Type, and nameplate text is identified using the Text region model, it avoids using same depth recognition network to variety classes
The problem that the nameplate of type is identified, and causes identification inaccurate, to improve power equipment nameplate recognition accuracy.
Specific embodiment
It is with reference to the accompanying drawings and embodiments, right in order to which the objects, technical solutions and advantages of the application are more clearly understood
The application is further elaborated.It should be appreciated that specific embodiment described herein is only used to explain the application, not
For limiting the application.
In one embodiment, as shown in Figure 1, providing a kind of power equipment nameplate recognition methods.It is provided by the present application
Power equipment nameplate recognition methods, can be applied in application environment as shown in Figure 2.
Application environment shown in Fig. 2 includes image collecting device 210, power equipment nameplate 220, nameplate identification server
230 and terminal 240, wherein after image collecting device 210 acquires the image of power equipment nameplate 220, by network by nameplate figure
Text region is carried out as being transmitted in nameplate identification server 230, the nameplate text after identification is shown by terminal 240, terminal
240 identify that server 230 is communicated with nameplate by network.Wherein, image collecting device 210 can be specially camera,
Nameplate identification server 230 can be realized with the server cluster of the either multiple server compositions of independent server, whole
End 240 can be, but not limited to be various personal computers, laptop, smart phone, tablet computer and portable wearable
Equipment.The power equipment nameplate recognition methods of the embodiment of the present application, may comprise steps of:
Step S110 obtains nameplate image.
Wherein, nameplate image can be the image shot for nameplate.Nameplate can be on power equipment, record
The label of the technical parameters such as manufacturer and nominal operation situation.
In the specific implementation, user acquires initial nameplate image by image collecting device 210, and by initial nameplate image into
The pretreatment such as row noise reduction, correction, obtains nameplate image, and nameplate image is input in nameplate identification server 230 and is handled.
Step S120 identifies the nameplate type in the nameplate image.
In the specific implementation, after nameplate identification server 230 gets nameplate image, by nameplate image input nameplate classification
The processing of convolution pondization is carried out in model, obtains the image-region of multiple scale calibrations, characteristics of image is extracted from image-region,
According to characteristics of image, image-region is filtered, so that it is determined that nameplate region;The characteristics of image of nameplate region is subjected to convolution
Pondization processing obtains nameplate region scoring, is scored according to nameplate region, classified to nameplate region, obtain nameplate type.
Step S130 determines corresponding Text region model according to the nameplate type, and utilizes the Text region mould
Type identifies nameplate text.
In the specific implementation, the nameplate type is sent in configuration file and is matched, is obtained after getting nameplate type
To corresponding Text region model;By nameplate region input Text region model, generate Text region frame, to Text region frame into
Row Text region obtains nameplate text information.
According to the technical solution of the embodiment of the present application, the nameplate type in nameplate image is identified by nameplate disaggregated model,
According to nameplate type, corresponding Text region model is determined from candidate character identification model, and know using Text region model
Not Chu nameplate text, avoid and the nameplate of different types identified using same depth recognition network, cause to identify
Inaccurate problem, to improve power equipment nameplate recognition accuracy.
In another embodiment, the nameplate image includes image-region, the nameplate in the identification nameplate image
Type, comprising:
By nameplate disaggregated model, the characteristics of image in described image region is extracted from the nameplate image;According to institute
The characteristics of image of image-region is stated, identifies nameplate region;The nameplate region is the image-region for including nameplate feature;According to
The nameplate region determines the nameplate type.
In the specific implementation, nameplate image is inputted convolutional Neural after nameplate identification server 230 gets nameplate image
Convolution algorithm is carried out in network layer, generates the image-region of multiple dimensional standards, and the image in interception image region obtains region
Image obtains the characteristics of image of area image by area image after the processing of convolution pondization.Characteristics of image is matrix, matrix
The pixel of element correspondence image characteristic area, by being filtered according to the pixel number of pixel to area image, thus really
Determine nameplate region.According to the nameplate region, nameplate type is determined.
The technical solution of the present embodiment, by extracting the characteristics of image of image-region, and by characteristics of image to image district
Domain is filtered, and determines nameplate region, so that identification range when nameplate identification server 230 identifies nameplate region is reduced,
And then improve power equipment nameplate recognition efficiency.
It is described according to the nameplate region in another embodiment, determine nameplate type, comprising:
According to the characteristics of image in the nameplate region, the nameplate region is evaluated, obtains nameplate region scoring;
It is scored according to the nameplate region, classifies to the nameplate region, obtain the nameplate type.
In the specific implementation, characteristics of image is carried out after nameplate identification server 230 gets the characteristics of image of nameplate region
Convolution algorithm obtains nameplate region scoring, nameplate scoring input decision function is judged, to obtain nameplate type.
For example, extracting the characteristics of image in nameplate region, such as nameplate material feature, nameplate color characteristic, nameplate size
Feature input neural network in handled, according in nameplate disaggregated model network weight and Node B threshold calculate network it is defeated
Out, network is exported and kind judging is carried out by decision function, to obtain nameplate type.
The technical solution of the present embodiment scores to the nameplate region by the characteristics of image in nameplate region, and
Classified according to scoring to nameplate region, obtain the nameplate type, so that nameplate identification server 230 can be accurate
It identifies nameplate classification, and then improves power equipment nameplate recognition accuracy.
It is described by nameplate disaggregated model in another embodiment, before identifying the nameplate type in the nameplate image,
Further include:
Obtain a large amount of nameplate images;Mark the nameplate region and the nameplate type in the nameplate image;It will mark
It is trained in nameplate image input deep neural network model after note, obtains the nameplate disaggregated model.
In the specific implementation, a sample (Ai, Bi) of selection nameplate sample set, Ai is data, Bi is label, is sent into mind
Through network, the reality output Y of network is calculated, is calculated D=Bi-Y (i.e. predicted value is differed with actual value), according to error D tune
Whole weight matrix W, repeats the above process each sample, and until for entire sample set, error is no more than prescribed limit, from
And obtain nameplate disaggregated model.
It is described according to the nameplate type in another embodiment, determine corresponding Text region model, comprising:
Obtain multiple candidate identification models;Candidate's identification model has corresponding nameplate type;In the multiple time
It selects in identification model, candidate identification model corresponding with the nameplate type is extracted, as the Text region model.
In the specific implementation, the type is inputted in configuration file and is matched, from nameplate type after obtaining nameplate type
Corresponding identification model is obtained in corresponding Text region relationship model table.
In practical application, configuration file can be initially set up, nameplate type is recorded in configuration file and corresponds to Text region
Relationship model table.
It is described to identify nameplate text using Text region model in another embodiment, comprising:
Obtain text candidate frame;Obtain the text confidence level of the text candidate frame;According to the text confidence level to institute
It states text candidate frame to be filtered, obtains the Text region frame;According to the Text region frame, the nameplate text is obtained.
Wherein, text confidence level can be the probability that index text selects frame to have nameplate character features.
It handles, obtains in the specific implementation, nameplate identifies that server 230 inputs nameplate region in Text region model
Text candidate frame is introduced into a two-way long short-term memory Recognition with Recurrent Neural Network layer and calculates by text candidate frame.Specifically,
Two-way long short-term memory Recognition with Recurrent Neural Network layer by two standards one layer of LSTM (Long Short-Term Memory, length
Memory network) module composition, coordinate central point and text candidate frame of one of LSTM module for predictive text candidate frame
Length and width drift correction value, another LSTM module is used to predict the text confidence level of the candidate frame.It is right according to text confidence level
All text candidate frames are filtered, and obtain the Text region frame with nameplate text information, according to Text region frame, obtain inscription
Board text.
The technical solution of the present embodiment, by obtaining the text candidate frame of nameplate region and the text confidence level of candidate frame,
Text candidate frame is filtered according to text confidence level, Text region frame is obtained, so that nameplate text be recognized accurately, improves electric power
Equipment nameplate recognition accuracy.
It is described according to the Text region frame in another embodiment, obtain the nameplate text, comprising:
It identifies the Text region frame, obtains candidate character;Obtain the matching of the candidate character Yu the nameplate text
Degree;According to the matching degree, determine that the candidate character is the nameplate text.
In the specific implementation, nameplate identification server is mentioned by calling corresponding Text region model to obtain Text region frame
The alphabetic character morphological feature in Text region frame is taken, initial text is obtained.The character features in Text region frame may at this time
Can because nameplate get rusty, the reasons such as nameplate image exposure, cause character features incomplete, therefore initial text at this time and be not allowed
Really.For example, " voltmeter " character features become " electricity soil table " text after there is the nameplate of " voltmeter " character features to get rusty
Word feature, the initial text that Text region model is got at this time are " electricity soil table ".Nameplate identification server 230 is pre-established with
Device name database, nameplate identify that server 230 obtains the candidate character with initial characters matching from device name database,
And the matching degree of candidate character Yu initial text is calculated, according to matching degree, determine that candidate character is nameplate text.
The technical solution of the present embodiment obtains initial text, passes through the acquisition pair of initial text by identifying Text region frame
The candidate character answered determines nameplate text, to improve identification by calculating the matching degree of candidate character and initial text
The order of accuarcy of power equipment nameplate text.
The embodiment of the present application is deeply understood for the ease of those skilled in the art, is said below with reference to specific example
It is bright.Fig. 3 is a kind of specific method flow diagram of power equipment nameplate identification of one embodiment.As shown, image is adopted
Collect electric power nameplate image, and nameplate image is transmitted in nameplate identification server 230, using nameplate disaggregated model to being transmitted to
Nameplate image in server carries out nameplate classification, and sorted nameplate image is transmitted to corresponding Text region model, text
Word identification model determines nameplate text by extracting nameplate character features.
The embodiment of the present application is deeply understood for the ease of those skilled in the art, is said below with reference to specific example
It is bright.Fig. 4 is a kind of specific method schematic diagram of power equipment nameplate identification of one embodiment.As shown, because different inscriptions
The text point of board and content difference, so needing to classify to nameplate region, initially set up nameplate disaggregated model, to collection
The various nameplate images arrived carry out nameplate signature, and the nameplate image input deep neural network after label is trained,
Obtain nameplate disaggregated model;Then the model for establishing word area detection and identification carries out text to the various nameplate images of collection
The frame of word field selects label, and frame is selected the nameplate marked because field difference needs frame choosing label respectively by different nameplate types
Image input deep neural network is trained, and obtains the model of word area detection and identification;Nameplate image to be measured is inputted
Nameplate classification and Detection is carried out in nameplate disaggregated model, obtains nameplate type, and the corresponding text of nameplate type is inquired according to configuration file
Word identification model, Text region model determine nameplate text by extracting nameplate character features.
It should be understood that although each step in the flow chart of Fig. 1 is successively shown according to the instruction of arrow, this
A little steps are not that the inevitable sequence according to arrow instruction successively executes.Unless expressly state otherwise herein, these steps
It executes there is no the limitation of stringent sequence, these steps can execute in other order.Moreover, at least part in Fig. 1
Step may include that perhaps these sub-steps of multiple stages or stage are executed in synchronization to multiple sub-steps
It completes, but can execute at different times, the execution sequence in these sub-steps or stage, which is also not necessarily, successively to be carried out,
But it can be executed in turn or alternately at least part of the sub-step or stage of other steps or other steps.
In one embodiment, as shown in figure 5, providing a kind of power equipment nameplate identification device, comprising:
Image collection module 510, for obtaining nameplate image;
Type identification module 520, for identification the nameplate type of the nameplate image;
Text region module 530 for determining corresponding Text region model according to the nameplate type, and utilizes institute
State Text region model identification nameplate text.
In one embodiment, the type identification module 520, comprising:
Image characteristics extraction submodule, for extracting characteristics of image from the image-region in the nameplate image;
Type determination module, for determining the nameplate type according to the nameplate region.
In one embodiment, the type determination module, comprising:
Score unit in region, for evaluating the nameplate region according to the characteristics of image in the nameplate region,
Obtain nameplate region scoring;
Territorial classification unit is classified to the nameplate region, is obtained described for being scored according to the nameplate region
Nameplate type.
In one embodiment, the power equipment nameplate identification device, further includes:
Nameplate image obtains module, for obtaining a large amount of nameplate images;
Labeling module, for marking the nameplate region in the nameplate image and the nameplate type;
Training module is obtained for will be trained in the nameplate image input deep neural network model after mark
To the nameplate disaggregated model.
In one embodiment, the Text region module 530, comprising:
Identification model acquisition submodule, for obtaining multiple candidate identification models;Candidate's identification model, which has, to be corresponded to
Nameplate type;
Text region model acquisition submodule, for extracting and the nameplate in the multiple candidate identification model
The corresponding candidate identification model of type, as the Text region model.
In one embodiment, the Text region model acquisition submodule, comprising:
Text candidate frame acquiring unit, for obtaining text candidate frame;
Text confidence computation unit, for obtaining the text confidence level of the text candidate frame;
Text region frame acquiring unit is obtained for being filtered according to the text confidence level to the text candidate frame
To the Text region frame;
Nameplate text acquiring unit, for obtaining the nameplate text according to the Text region frame.
Specific restriction about power equipment nameplate identification device may refer to identify above for power equipment nameplate
The restriction of method, details are not described herein.Modules in above-mentioned power equipment nameplate identification device can be fully or partially through
Software, hardware and combinations thereof are realized.Above-mentioned each module can be embedded in the form of hardware or independently of the place in computer equipment
It manages in device, can also be stored in a software form in the memory in computer equipment, in order to which processor calls execution or more
The corresponding operation of modules.
In one embodiment, a kind of computer equipment is provided, which can be terminal, internal structure
Figure can be as shown in Figure 6.The computer equipment includes processor, the memory, network interface, display connected by system bus
Screen and input unit.Wherein, the processor of the computer equipment is for providing calculating and control ability.The computer equipment is deposited
Reservoir includes non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system and computer journey
Sequence.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating
The network interface of machine equipment is used to communicate with external terminal by network connection.When the computer program is executed by processor with
Realize a kind of power equipment nameplate recognition methods.The display screen of the computer equipment can be liquid crystal display or electric ink
Display screen, the input unit of the computer equipment can be the touch layer covered on display screen, be also possible to outside computer equipment
Key, trace ball or the Trackpad being arranged on shell can also be external keyboard, Trackpad or mouse etc..
It will be understood by those skilled in the art that structure shown in Fig. 6, only part relevant to application scheme is tied
The block diagram of structure does not constitute the restriction for the computer equipment being applied thereon to application scheme, specific computer equipment
It may include perhaps combining certain components or with different component layouts than more or fewer components as shown in the figure.
In one embodiment, a kind of computer equipment, including memory and processor are provided, is stored in memory
Computer program, the processor perform the steps of when executing computer program
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
In one embodiment, it is also performed the steps of when processor executes computer program
By nameplate disaggregated model, the characteristics of image in described image region is extracted from the nameplate image;
According to the characteristics of image in described image region, nameplate region is identified;The nameplate region be include nameplate feature
Image-region;
According to the nameplate region, the nameplate type is determined.
In one embodiment, it is also performed the steps of when processor executes computer program
According to the characteristics of image in the nameplate region, the nameplate region is evaluated, obtains nameplate region scoring;
It is scored according to the nameplate region, classifies to the nameplate region, obtain the nameplate type.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain a large amount of nameplate images;
Mark the nameplate region and the nameplate type in the nameplate image;
It will be trained in nameplate image input deep neural network model after mark, obtain the nameplate classification
Model.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain multiple candidate identification models;Candidate's identification model has corresponding nameplate type;
In the multiple candidate identification model, candidate identification model corresponding with the nameplate type is extracted, as
The Text region model.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain text candidate frame;
Obtain the text confidence level of the text candidate frame;
The text candidate frame is filtered according to the text confidence level, obtains the Text region frame;
According to the Text region frame, the nameplate text is obtained.
In one embodiment, it is also performed the steps of when processor executes computer program
It identifies the Text region frame, obtains candidate character;
Obtain the matching degree of the candidate character Yu the nameplate text;
According to the matching degree, determine that the candidate character is the nameplate text.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated
Machine program performs the steps of when being executed by processor
Obtain nameplate image;
Identify the nameplate type in the nameplate image;
According to the nameplate type, corresponding Text region model is determined, and utilize Text region model identification inscription
Board text.
In one embodiment, it is also performed the steps of when processor executes computer program
By nameplate disaggregated model, the characteristics of image in described image region is extracted from the nameplate image;
According to the characteristics of image in described image region, nameplate region is identified;The nameplate region be include nameplate feature
Image-region;
According to the nameplate region, the nameplate type is determined.
In one embodiment, it is also performed the steps of when processor executes computer program
According to the characteristics of image in the nameplate region, the nameplate region is evaluated, obtains nameplate region scoring;
It is scored according to the nameplate region, classifies to the nameplate region, obtain the nameplate type.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain a large amount of nameplate images;
Mark the nameplate region and the nameplate type in the nameplate image;
It will be trained in nameplate image input deep neural network model after mark, obtain the nameplate classification
Model.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain multiple candidate identification models;Candidate's identification model has corresponding nameplate type;
In the multiple candidate identification model, candidate identification model corresponding with the nameplate type is extracted, as
The Text region model.
In one embodiment, it is also performed the steps of when processor executes computer program
Obtain text candidate frame;
Obtain the text confidence level of the text candidate frame;
The text candidate frame is filtered according to the text confidence level, obtains the Text region frame;
According to the Text region frame, the nameplate text is obtained.
In one embodiment, it is also performed the steps of when processor executes computer program
It identifies the Text region frame, obtains candidate character;
Obtain the matching degree of the candidate character Yu the nameplate text;
According to the matching degree, determine that the candidate character is the nameplate text.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer
In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein,
To any reference of memory, storage, database or other media used in each embodiment provided herein,
Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM
(PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include
Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms,
Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing
Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM
(RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
Each technical characteristic of above embodiments can be combined arbitrarily, for simplicity of description, not to above-described embodiment
In each technical characteristic it is all possible combination be all described, as long as however, the combination of these technical characteristics be not present lance
Shield all should be considered as described in this specification.
The several embodiments of the application above described embodiment only expresses, the description thereof is more specific and detailed, but simultaneously
It cannot therefore be construed as limiting the scope of the patent.It should be pointed out that coming for those of ordinary skill in the art
It says, without departing from the concept of this application, various modifications and improvements can be made, these belong to the protection of the application
Range.Therefore, the scope of protection shall be subject to the appended claims for the application patent.