CN106570436B - A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code - Google Patents
A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code Download PDFInfo
- Publication number
- CN106570436B CN106570436B CN201611001099.2A CN201611001099A CN106570436B CN 106570436 B CN106570436 B CN 106570436B CN 201611001099 A CN201611001099 A CN 201611001099A CN 106570436 B CN106570436 B CN 106570436B
- Authority
- CN
- China
- Prior art keywords
- image
- meter reading
- dimensional code
- code
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000012937 correction Methods 0.000 claims abstract description 55
- 230000000007 visual effect Effects 0.000 claims abstract description 21
- 230000003044 adaptive effect Effects 0.000 claims abstract description 10
- 238000002715 modification method Methods 0.000 claims abstract description 6
- 230000009466 transformation Effects 0.000 claims description 12
- 239000011159 matrix material Substances 0.000 claims description 11
- 238000005516 engineering process Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 claims description 4
- 238000012804 iterative process Methods 0.000 claims description 3
- 238000010295 mobile communication Methods 0.000 claims description 3
- 238000004321 preservation Methods 0.000 claims 3
- 230000007704 transition Effects 0.000 claims 1
- 238000012545 processing Methods 0.000 abstract description 4
- 238000001514 detection method Methods 0.000 description 6
- 238000007689 inspection Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000004927 fusion Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
- G06K7/10712—Fixed beam scanning
- G06K7/10722—Photodetector array or CCD scanning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10544—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum
- G06K7/10821—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation by scanning of the records by radiation in the optical part of the electromagnetic spectrum further details of bar or optical code scanning devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Electromagnetism (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Toxicology (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Image Analysis (AREA)
Abstract
The present invention relates to a kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code belongs to data acquisition and technical field of image processing, comprising: to need the facility information of meter reading that two dimensional code is added in substation；Acquisition two-dimensional barcode information, template image and 3 position sensing figures of the two dimensional code in template image and the center position of 1 correction graph are placed in the template library of server；Hand-hold meter reading terminal scans the two-dimensional code, and generates two-dimensional barcode information message, judges automatically and grab the image for meeting quality requirement；Image and two-dimensional barcode information are uploaded to server；Image Adjusting is positive angle image using the visual angle modification method with robustness；Reading and facility information are reached database by Meter recognition system identification meter reading.The invention can guarantee Instrument image acquisition quality, efficiently solve the problem of causing image identification system to fail because of unsharp image.Using adaptive visual angle modification method, make the present invention that there is robustness.
Description
Technical field
The invention belongs to data acquisition and technical field of image processing, and in particular to be a kind of change based on planar bar code technology
Power station equipment kilowatt meter reading-out system and its meter register method.
Background technique
For the safe operation for guaranteeing substation equipment, need to carry out substation equipment inspection periodically or non-periodically.It copies
Table work is one of the main contents of substation operation personnel inspection work.Traditional meter reading method is manual metering, substation
Operations staff must just arrive the display screen beside relevant device ontology, read and record relevant operating parameter, again return to collection
Related data is entered into operation data library and stores by middle control room.This mode is easy to be influenced by human factor, and process is numerous
The problems such as trivial, inefficiency, data cannot upload in real time, and there are missing inspection and erroneous detections.
There are mainly two types of existing substation equipment smart meter readings, and one is meter reading work is completed by robot inspection
Make, one is acquire equipment image, then the operating parameter for passing through image recognition apparatus by fixed camera.Both of which
It is first to acquire equipment Instrument image, then meter reading is identified by computer image processing technology.It can be seen that Image Acquisition
Quality directly affects the accuracy of computer identification meter reading.Due to the influence of substation field environment, the image meeting of shooting
It is influenced by factors such as light, shooting visual angles, image may be unintelligible, fuzzy, inclination, and then directly affects computer identifier
The precision of meter reading can not identify unsharp image.Existing SIFT, SURF, FLANN scheduling algorithm carry out characteristic point detection and
Matching calculates transformation matrix, then corrects inclined image.There are when Mismatching point in the match point that this algorithm obtains, shadow is understood
Seeking for transformation matrix is rung, and then influences the effect of image rectification, eventually leads to meter reading recognition failures.And these algorithms
To same object, the picture shot under different scenarios, obtained match point may be different, and then influence for not
The reliability of algorithm when searching matching characteristic point with image.Due to the instrument huge number in substation, actual photographed environment feelings
The complexity of condition, needs with robustness image tilt correction method.
Two dimensional code is with certain specific geometric figure according to certain rules in the chequered with black and white graphic recording of plane distribution
Data symbol information, by image input device or photoelectric scanning device automatically identifying and reading to realize automatic processing of information.Each
Two dimensional code has 3 identical position sensing figures, and position is all to be located at its upper left, upper right and lower-left existing for fixation
Angle.Each position sensing figure can regard the concentric squares being overlapped by 3 as and form, they are respectively 7 × 7 dark modules, 5
× 5 light modules and 3 × 3 dark modules.The midpoint of the lower edges of position sensing figure is linked to be straight line, left and right edges
Midpoint is linked to be straight line, intersection point, that is, position sensing figure central point of two straight lines.There is a school in the lower right position of two dimensional code
Positive figure, correction graph can regard that the concentric squares being overlapped by 3 form as, they are 5 × 5 dark modules and 3 × 3
Light module and a centrally located dark module composition.The isolated dark module, that is, correction chart in the center of correction graph
The central point of shape.
Existing close patent 201410141229.7, patent name are image recognition kilowatt meter reading-out system and method, which adopts
Scheme is: the image recognition kilowatt meter reading-out system of the patent includes: the instrument for being accompanied with bar code or two dimensional code, for obtaining this
The image collecting device of the picture and meter reading picture of bar code or two dimensional code, also includes genuinely convinced in image identification system
Business device, described image acquisition device are used to acquire the picture of bar code or two dimensional code, and image identification system for identification read by instrument
Number picture, described image acquisition device and central server are connected with each other.The meter register method includes passing through bar code or two dimensional code
Instrument is marked, bar code or two dimensional code are stored with the essential information of the instrument；Bar code or two is obtained by image collecting device
The picture of code is tieed up, and by identifying that the picture obtains the number and type parameter of corresponding instrument；By image collecting device to scheme
The form of piece obtains the reading of instrument, and sends the picture containing reading to central server；Pass through the image of central server
The essential information and reading of identifying system identification instrument.This method can not determine the instrument picture quality of intake.Due to shooting
The influence of site environment, image may be unintelligible, fuzzy.In subsequent progress image recognition, unsharp picture is detected
Less than instrument, meter reading can not be just carried out.
Summary of the invention
The technical problem to be solved by the present invention is to solve the above shortcomings of the prior art and to provide a kind of based on two dimensional code
Substation equipment kilowatt meter reading-out system and its meter register method guarantee the matter of Instrument image acquisition on the basis of being based on planar bar code technology
Amount solves the problems, such as characteristic that is subsequent because fogging image causes system identification to fail, and utilizing two dimensional code, and providing one kind has
The visual angle modification method of robustness overcomes the problems, such as error hiding present in the matching of traditional characteristic point, improves system identification reading
Accuracy rate.
In order to achieve the above object, the present invention takes following technical scheme:
A kind of substation equipment kilowatt meter reading-out system, which is characterized in that the system includes multiple two dimensional code icons, hand-held meter reading
Terminal and server；Wherein:
Each two dimensional code includes the information to kilowatt meter recorder, which is attached to corresponding attached to kilowatt meter recorder
Closely；Hand-held meter reading terminal includes the camera shooting module of camera and embedded two dimensional code recognizer, in the display screen of camera
In position be provided with the identification frame of two dimensional code icon；The meter reading terminal pass through scan the two-dimensional code and to kilowatt meter recorder meter reading
Each frame image of automatic shooting is differentiated, when two dimensional code identifies successfully, judges automatically the figure for meeting quality requirement by device
Picture, generates the two-dimensional barcode information of the frame image, and to naming the frame image and save, and by the frame image, respective two-dimensional code
Information is uploaded to server；
Server be built-in with template library, visual angle correction module, meter reading identification module, database computer,
The two-dimensional barcode information and template image of each substation equipment for needing meter reading are stored in middle template library, template image is existing
The front view shot to two dimensional code and instrument contains complete image in 2 D code and Instrument image in every template image；Often
The center point of a template image and 3 position sensing figures of image in 2 D code in corresponding two dimensional code icon, template image
The center position with 1 correction graph of image in 2 D code is set, three corresponds；Visual angle correction module was used for meter reading end
After the image aspects that end uploads are modified, according to the two-dimensional barcode information that meter reading terminal uploads, corresponding template image is searched；Instrument
Meter reading identification module meter reading in image after the corresponding amendment of template image for identification, database is for saving instrument reading
The location of the machine to be installed that includes in several and instrument two-dimensional barcode information, device coding, device name；
Connection between the server and meter reading terminal is realized by WIFI or mobile communication technology.
A kind of substation equipment meter register method using above-mentioned substation equipment kilowatt meter reading-out system, which is characterized in that including with
Lower step:
S1: according to needing the facility information of meter reading to construct two dimensional code in substation, and the two dimensional code is posted in the equipment
Meter reading areas adjacent；
S2: it is stored with the two-dimensional barcode information and template image of each substation equipment for needing meter reading, mould in the server
Plate image is the front view shot at the scene to two dimensional code and instrument, in every template image containing complete image in 2 D code and
Instrument image；3 position sensing figures of each template image and image in 2 D code in corresponding two dimensional code icon, template image
Center position and image in 2 D code 1 correction graph center position, three correspond；
S3: hand-held meter reading terminal scans the meter reading device and two dimensional code to kilowatt meter recorder, to each frame figure of automatic shooting
Two dimensional code is differentiated as in, when two dimensional code identifies successfully, is judged automatically the image for meeting quality requirement, is generated the frame image
Two-dimensional barcode information, and to the frame image name and save；
S4: image and two-dimensional barcode information are uploaded to server；
S5: use the visual angle modification method with robustness that Image Adjusting is positive in the visual angle correction module of server end
Angle image: 3 position sensing figures that image in 2 D code in images to be recognized is first found out using adaptive method are specifically included
Center position and 1 correction graph center position, further according to 3 position sensings of image in 2 D code in template image
The center position of the center position of figure and 1 correction graph obtains the transformation square between figure and template image to be identified
Battle array, faces angular image for be identified be corrected to；
S6: the meter reading faced in angular image after the meter reading identification module identification correction of server end, and
Reading and corresponding facility information are reached database to save.
Compared with prior art, advantages of the present invention:
(1) guarantee Image Acquisition quality in meter reading: the meter reading terminal of the system embeds two dimensional code recognizer, judges automatically
Whether the acquisition quality of Instrument image meets the requirements, and without manually finding a view, focusing, guarantees the Instrument image quality of intake, overcomes
The problem of causing system identification to fail because of invalid Instrument image, it ensure that meter reading quality.
(2) there are this method the image aspects of robustness to correct: by the two dimensional code in images to be recognized and template image
Image carries out visual angle amendment to Instrument image using adaptive method, system is made to have robustness, and improves system knowledge
Other accuracy rate.
Detailed description of the invention
Fig. 1 is substation equipment kilowatt meter reading-out system block diagram；
Fig. 2 is substation equipment meter register method flow chart；
Fig. 3 is the adaptive method flow diagram for searching two dimensional code position sensing centre of figure point；
Fig. 4 is the adaptive method flow diagram for searching two dimensional code correction graph central point.
Specific embodiment
The present invention is further elaborated with reference to the accompanying drawings and detailed description.
Substation equipment kilowatt meter reading-out system proposed by the present invention composition as shown in Figure 1, the system include multiple two dimensional code icons,
Hand-held meter reading terminal and server；Wherein:
Each two dimensional code includes the information to kilowatt meter recorder, which is attached to corresponding attached to kilowatt meter recorder
Closely；Hand-held meter reading terminal includes the camera shooting module of camera and embedded two dimensional code recognizer, in the display screen of camera
In position be provided with the identification frame of two dimensional code icon；The meter reading terminal pass through scan the two-dimensional code and to kilowatt meter recorder meter reading
Each frame image of automatic shooting is differentiated, when two dimensional code identifies successfully, judges automatically the figure for meeting quality requirement by device
Picture, generates the two-dimensional barcode information of the frame image, and to naming the frame image and save, and by the frame image, respective two-dimensional code
Information is uploaded to server；
Server be built-in with by programming technique generate template library, visual angle correction module, meter reading identification module,
The computer of database is wherein stored with the two-dimensional barcode information and Prototype drawing of each substation equipment for needing meter reading in template library
Picture, template image are the front views shot at the scene to two dimensional code and instrument, contain complete two dimensional code in every template image
Image and Instrument image；Each template image is visited with 3 positions of image in 2 D code in corresponding two dimensional code icon, template image
The center position of 1 correction graph of the center position and image in 2 D code of mapping shape, three correspond；Visual angle amendment
Module is for according to the two-dimensional barcode information that meter reading terminal uploads, searching after being modified the image aspects that meter reading terminal uploads
Corresponding template image；Meter reading identification module meter reading, number in image after the corresponding amendment of template image for identification
According to library for saving the location of the machine to be installed for including in meter reading and instrument two-dimensional barcode information, device coding, device name；
Connection between the server and meter reading terminal is realized by WIFI or mobile communication technology.
A kind of substation equipment meter register method process such as Fig. 2 based on two dimensional code proposed by the present invention using above system
It is shown, comprising the following steps:
S1: according to needing the facility information of meter reading to construct two dimensional code in substation, and the two dimensional code is posted in the equipment
Meter reading areas adjacent；
For the two dimensional code of the equipment making equipment for needing meter reading each in substation, the information which includes has:
Location of the machine to be installed, device coding, device name；Two dimensional code icon is posted near instrument；
S2: it is stored with the two-dimensional barcode information and template image of each substation equipment for needing meter reading, mould in the server
Plate image is the front view shot at the scene to two dimensional code and instrument, in every template image containing complete image in 2 D code and
Instrument image；3 position sensing figures of each template image and image in 2 D code in corresponding two dimensional code icon, template image
Center position and image in 2 D code 1 correction graph center position, three correspond；
Template library and database are established in the server: including the two of each substation equipment for needing meter reading in template library
Tie up code information and template image.Contain complete image in 2 D code and Instrument image in every template image.Wherein, template image
In image in 2 D code have the center position coordinates of corresponding 3 position sensing figures, the center position of 1 correction graph
Coordinate；The center point of 3 position sensing figures of image in 2 D code in two-dimensional barcode information, template image and template image
The center position coordinate with 1 correction graph is set, three corresponds；Database be used to store the meter reading identified and
The location of the machine to be installed that includes in instrument two-dimensional barcode information, device coding, device name；
The lookup and two of the center position of 3 position sensing figures of the image in 2 D code in every template image
Tie up the lookup of the center position of 1 correction graph of code image；The process only needs to carry out once, the central point that will be found
Coordinate is stored in template library, and the later period only needs to call the information in template library；Specifically includes the following steps:
S21: the lookup of 3 position sensing centre of figure point positions of the image in 2 D code in template image；
Each two dimensional code has 3 position sensing figures, is located at upper left, upper right, the lower-left of two dimensional code, each position
Detection figure can regard the concentric squares being overlapped by 3 as and form.Each position sensing figure is by fixed depth color
Module composition, module depth color sequences are that dark-light color-dark color-light color-is dark, and the ratio of each color width is 1:
1:3:1:1, (in practical applications, due to picture quality, the reasons such as two dimensional code size, the 1:1:3:1:1's of position sensing figure
Proportionate relationship is inaccurate, and the actual conditions of every picture are different, and proportionate relationship is also had any different.) according to two dimensional code more than
Proportionate relationship searches the center position of position sensing figure, and Fig. 2 is the characteristic ratio relationship according to position sensing figure
Flow chart；Comprising the following specific steps
S211: binary conversion treatment is carried out to template image, and the module width ratio of preliminary given position detection figure is such as
Following formula:
Wherein, L0, L1, L2, L3, L4For the line segment length at 5 black and white intervals of adjacent block, RT1, RT2, RT3, RT4For ratio
Relationship initial value, S1For the step-length of iteration；According to the sequence of modules of position sensing figure in the two dimensional code of standard and module width ratio
Example relationship, there is L0=L1=L3=L4, L2=3 × L0.In actual picture, according to the length of line segment, there are 10%~20% errors
Principle choose proportionate relationship upper and lower bound (due to using adaptive method in this method, below the step of in can root
According to actual conditions adjust automatically occurrence, choosing for initial value should be selected in the error principle according to 10%~20% in the error
Neighbouring value).Occurrence are as follows: S1=
0.03；
S212: scanning the every a line pixel of template image from left to right, finds out all proportionate relationships that meet in picture
Adjacent five black and white intervals line segment records the midpoint coordinates of the midium line segment of each adjacent five line segments, is stored in set M,
The length of line segment, is stored in set N where recording these points；Specific steps are as follows:
Image after binaryzation, gray value there are two types of, 0 or 255, record difference adjacent in the every one-row pixels of image
The distance between pixel of gray value li, i=0,1,2 ....It finds out and all in every one-row pixels in image meets proportionate relationship
Adjacent five line segments, record the width W of the midium line segment L2 of these adjacent five line segmentsk, it is stored in set N, and
The center point coordinate position P of the midium line segment L2 of adjacent five line segmentsk(xk,yk), it is stored in set M, k=0,1,2 ...；
S213: a minute group is carried out to the point in set M；
Finding out the minimum value in set N is Wmin, the mutual distance of each point in set M is Dj, meet Dj≤
Wmin.Specific steps are as follows: (1) first search first point A in set M, it is small to find out all distances to A point of remaining in set M
In or equal to WminPoint, then these points are a group, and delete all the points in set M in this group；(2) if set M is not empty
Collect, then return step (1), until completing to divide group to all the points in set M；
S214: the central point for choosing the point in each group is this group of fused points, specific steps are as follows:
Calculating the sum of abscissa of point in each group is X, and the sum of ordinate is Y, and the number of the point of this group is n；It calculates
The average value of abscissa and ordinate, respectively
It chooses in the group apart from coordinateNearest point is this group of fused points；
S215: from fused point set, the central point of position sensing figure is found out；
(in fused point set, although some points meet proportionate relationship, it is not necessarily the center of position sensing figure
Point has rotational invariance according to the characteristic ratio relationship of position sensing figure, i.e., after image in 2 D code rotation, position sensing
The module color sequence and width ratio of figure are also constant.The place of non-location detection figure is not inconsistent after rotating different angles
Close the proportionate relationship.According to the feature, the center position of position sensing figure is accurately filtered out.) specific step are as follows:
The rectangular area in set near each point delimited, which rotated clockwise, from 0 °~180 °, every time
15 ° of rotation carries out transversal scanning to postrotational rectangular area every time, finds out by the lateral line segment of the point and adjacent
Front and back two lines section, 5 line segments, judge whether this 5 adjacent line segment meets the proportionate relationship in step S212 altogether.If every
After secondary rotation, line segment and its front and back two lines section where the point, totally 5 line segments, meet the ratio in step S212 every time
Relationship, then the point is the central point of position sensing figure；
The delimitation of rectangular area: after fusion in point set, the coordinate of some point is (rx, ry), the length along path where the point
Degree is rw；The coordinate of point in rectangular area is (x, y), rectangular area are as follows:
S216: judge whether final qualified number is 3, if 3, illustrates 3 that can find two dimensional code
The central point of position sensing figure terminates iterative process, records the coordinate position of 3 points；
If more than 3 points, closer to standard value, i.e., proportionate relationship is arranged
If being less than 3 points, proportionate relationship setting is loose, i.e.,
Set M, set N are emptied, step S212~S216 is repeated, until finding 3 position sensing centre of figure points；
S22: 1 correction graph center position of image in 2 D code in template image is searched；
According to the 3 position sensing centre of figure point coordinates found out in step S21 and the two-dimension code pattern bottom right of standard
The regulation of angle correction graph position, Primary Location go out the place rectangular area of correction graph, then in the region using adaptive
The center point coordinate of induction method lookup correction graph.
(each correction graph is considered as the concentric squares composition of 3 overlappings.Each correction graph is by fixed deep
The module of light colour forms, and module depth color sequences are that dark-light color-dark color-light color-is dark, each element width
Ratio is 1:1:1:1:1.In practical applications, due to picture quality, the reasons such as two dimensional code size, the 1:1:1:1 of correction graph:
1 proportionate relationship is inaccurate.
According to the above proportionate relationship feature of correction graph, the adaptive lookup of the correction graph center position of two dimensional code
Method, as shown in Figure 3, the specific steps are as follows:
S221: according to the center position for 3 position sensing figures having been found, respectively in the upper left of image in 2 D code
The lower right corner rectangular area of image in 2 D code delimited out in angle, the upper right corner, the lower left corner, and 1 correction chart is searched in the rectangular area
The center position of shape；
The center position coordinate of the position sensing figure in the upper left corner, the upper right corner, the lower left corner found out is respectively
(x0, y0), (x1, y1), (x2, y2), rectangular centre point position is (px, py), bottom right corner location (x3, y3)
The rectangular area range of delimitation is:
S222: the module width ratio of preliminary given composition correction graph:
Wherein, L0, L1, L2, L3, L4For the line segment length at adjacent 5 black and white intervals, JZ1, JZ2, JZ3, JZ4For proportionate relationship
Initial value, S2For the step-length of iteration.It is closed according to the sequence of modules of position sensing figure in the two dimensional code of standard and module width ratio
, there is L in system0=L1=L3=L4, L2=3 × L0.In actual picture, according to the length of line segment, there are 10%~20% error principles
Choose the upper and lower bound of proportionate relationship.Due to using adaptive method in this method, below the step of in can be according to reality
Border situation adjust automatically occurrence, choosing for initial value should select near the error in the error principle according to 10%~20%
Value.Occurrence are as follows:S2=0.03；
S223: scanning the every a line pixel of template image from left to right, finds out all proportionate relationships that meet in picture
Adjacent five black and white intervals line segment records the midpoint coordinates of the midium line segment of each adjacent five line segments, is stored in set M,
The length of line segment, is stored in set N where recording these points；Specific steps are as follows:
Image after binaryzation, gray value there are two types of, 0 or 255, the adjacent different gray values of record every a line of image
The distance between pixel li, i=0,1,2 ....Find out all adjacent five lines for meeting proportionate relationship of every a line in image
Section, records the width W of the midium line segment L2 of these adjacent five line segmentsk, it is stored in set N and adjacent five line segments
Midium line segment L2 center point coordinate position Pk(xk,yk), it is stored in set M, k=0,1,2 ...；
S224: a point group is carried out to all the points in step S223；
Finding out the minimum value in set N is Wmin, the mutual distance of each point in set M is Dj, meet Dj≤
Wmin；Specific steps are as follows: (1) if set M is not empty set, first search first point A in set M, find out remaining in set M
All distances to A point are less than or equal to WminPoint, then these points are a group, and delete in set M owning in this group
Point；(2) if set M is not empty set, return step (1), until completing to divide group to all the points in set M；
S225: the central point for choosing the point in each group is this group of fused points, specific steps are as follows:
Calculating the sum of abscissa of point in each group is X, and the sum of ordinate is Y, and the number of the point of this group is n；It calculates
The average value of abscissa and ordinate, respectively
It chooses in group apart from coordinate pointsNearest point is this group of fused points；
S226: from fused point set, the point for meeting proportionate relationship is found out；
(in fused point set, although some points meet proportionate relationship, it is not necessarily the center of correcting detection figure
Point.There is rotational invariance according to the characteristic ratio relationship of position sensing figure, i.e., after image in 2 D code rotation, correction graph
Module color sequence and width ratio it is also constant.The place of non-correction graph after rotating different angles, does not meet the ratio
Relationship.According to the feature, the center position of position sensing figure is accurately filtered out.Specific step are as follows:
The rectangular area in set near each point delimited, which rotated clockwise, from 0 °~180 °, every time
15 ° of rotation carries out transversal scanning to postrotational rectangular area every time, finds out by the lateral line segment of the point and adjacent
Front and back two lines section, 5 line segments, judge whether this 5 adjacent line segment meets the proportionate relationship in step S222 altogether.If every
After secondary rotation, line segment and its front and back two lines section where the point, totally 5 line segments, meet the ratio in step S222 every time
Relationship, then the point is the central point of position sensing figure.
The demarcation method of rectangular area: after fusion in point set, the coordinate of some point is (rx, ry), the line where the point
Segment length is rw；The coordinate of point in rectangular area is (x, y), rectangular area are as follows:
S227: judge whether final qualified number is 1, and if 1, explanation can find correction graph center
Point terminates iterative process, records the coordinate position of the point；
If more than 1 point, closer to standard value, i.e., proportionate relationship is arranged
If being less than 1 point, proportionate relationship setting is loose, i.e.,
Set M, set N are emptied, S223~S227 is repeated, until finding correction graph central point；
S23: 1 will found out in found out in step S21 3 position sensing centre of figure point coordinates and step S22
A correction graph center point coordinate is stored in template library.
S3: hand-held meter reading terminal scans the meter reading device and two dimensional code to kilowatt meter recorder, to each frame figure of automatic shooting
Two dimensional code is differentiated as in, when two dimensional code identifies successfully, is judged automatically the image for meeting quality requirement, is generated the frame image
Two-dimensional barcode information, and to the frame image name and save；
Image quality requirements specifically: (1) include complete Instrument image and image in 2 D code in image；(2) image
Clearly.The camera shooting module of hand-held meter reading terminal embeds two dimensional code recognizer, and the identification frame of two dimensional code is in the aobvious of camera
Position in display screen curtain is fixed, since the relative position of two dimensional code and instrumentation is fixed, when image in 2 D code is in identification frame
When middle, instrumentation can be comprising in the picture.Intensity of illumination, focal length since two dimensional code is attached near instrument, when shooting
It is almost the same, therefore when the two dimensional code recognizer that hand-held meter reading terminal embeds correctly can identify two dimensional code, show two dimension
The clarity of code image is met the requirements, and the clarity of instrumentation can also be guaranteed in the image of candid photograph.
It judges automatically and grabs the specific steps for meeting quality requirement image are as follows:
S31: hand-held meter reading terminal scans the two-dimensional code, and will automatically snap and differentiates to each frame image；
S32: when two dimensional code identifies successfully, hand-held meter reading terminal generates the information that two dimensional code icon includes, and issues
Order is saved, to the name of this frame image, is saved, is realized image and automatically grab and ensure that image quality.
S4: image and two-dimensional barcode information are uploaded to server；
S5: use the visual angle modification method with robustness that Image Adjusting is positive in the visual angle correction module of server end
Angle image: 3 position sensing figures that the image in 2 D code in images to be recognized is first found out using adaptive method are specifically included
The center position of the center position of shape and 1 correction graph is visited further according to 3 positions of image in 2 D code in template image
The center position of the center position of mapping shape and 1 correction graph obtains the transformation between figure and template image to be identified
To be identified be corrected to is faced angular image by matrix；Specifically includes the following steps:
S51: according to the two-dimensional barcode information for being uploaded to server, available location of the machine to be installed, device coding, implementor name
Claim.In the template library of server, due in 3 position sensing figures of two-dimensional barcode information, template image and Prototype drawing
The center position coordinate of heart point position coordinates and 1 correction graph, three correspond.The letter that can include according to two dimensional code
Breath is found out in corresponding template image and Prototype drawing in 3 position sensing figures of image in 2 D code and 1 correction graph
Heart point position；
S52: 3 position sensing figures of image in 2 D code in figure to be identified are found out using the method in step S21；It adopts
The center position of 1 correction graph of image in 2 D code in figure to be identified is found out with the method in step S22；
S53: the center position of 3 position sensing figures of Prototype drawing and 1 correction graph is (x0,y0), (x1,y1),
(x2,y2), (x3,y3) and corresponding figure to be identified 3 position sensing figures and 1 correction graph center position
(u0,v0), u1,v1), (u2,v2), (u3,v3), there are 3 × 3 perspective transformation matrix M relationships between figure and Prototype drawing to be identified:
Wherein, aij(i=1,2,3；It j=1,2,3 is) occurrence of each element in perspective transformation matrix M.4 of Prototype drawing
Corresponding relationship between central point and 4 central points of figure to be identified may be expressed as:
Wherein i=0,1,2,3, w is parameter.
S54: it is obtained according to the transformation matrix M acquired by each pixel coordinate of figure to be identified according to the corresponding relationship
To corresponding coordinate position and pixel value at positive visual angle, figure to be identified is corrected to front view；
S6: the meter reading faced in angular image after the meter reading identification module identification correction of server end, and
Reading and corresponding facility information are reached database to save.
Claims (5)
1. a kind of substation equipment meter register method using substation equipment kilowatt meter reading-out system, which includes multiple two dimensional code figures
Mark, hand-held meter reading terminal and server；Characterized by comprising the following steps:
S1: according to needing the facility information of meter reading to construct two dimensional code in substation, and the two dimensional code is posted in the equipment meter reading
Areas adjacent；
S2: it is stored with the two-dimensional barcode information and template image of each substation equipment for needing meter reading, Prototype drawing in the server
Seem the front view shot at the scene to two dimensional code and instrument, contains complete image in 2 D code and instrument in every template image
Image；Each template image in 3 position sensing figures of image in 2 D code in corresponding two dimensional code icon, template image
The center position of 1 correction graph of heart point position and image in 2 D code, three correspond；
S3: hand-held meter reading terminal scans the meter reading device and two dimensional code to kilowatt meter recorder, in each frame image of automatic shooting
Two dimensional code is differentiated, when two dimensional code identifies successfully, is judged automatically the image for meeting quality requirement, is generated the two of the frame image
Code information is tieed up, and to frame image name and preservation；
S4: image and two-dimensional barcode information are uploaded to server；
S5: use the visual angle modification method with robustness that Image Adjusting is positive visual angle in the visual angle correction module of server end
Degree image: it specifically includes and is first found out in 3 position sensing figures of image in 2 D code in images to be recognized using adaptive method
The center position of the heart point position and 1 correction graph, further according to 3 position sensing figures of image in 2 D code in template image
Center position and 1 correction graph center position, obtain the transformation matrix between figure and template image to be identified,
To be identified be corrected to is faced into angular image；
S6: the meter reading faced in angular image after the meter reading identification module identification correction of server end, and will read
Several and corresponding facility information reaches database preservation；
The lookup of the center position of 3 position sensing figures of image in 2 D code, specific steps in the step S2 and S5 are as follows:
1) by image in 2 D code binaryzation, the module width ratio of the position sensing figure of preliminary given composition image in 2 D code is closed
System,Wherein, L0, L1, L2, L3, L4
For the line segment length at 5 black and white intervals of adjacent block, RT1, RT2, RT3, RT4For proportionate relationship initial value, the step-length of iteration is S1；
2) to image transversal scanning, all adjacent five black and white intervals line segments for meeting proportionate relationship in picture are found out, record is every
The midpoint coordinates of the midium line segment of a adjacent five line segments, is stored in set M, and the length of line segment, is deposited where recording these points
It is placed in set N；
3) a minute group is carried out to the point in set M；Finding out the minimum value in set N is Wmin, each point in group it is mutual away from
From for Dj, meet Dj≤Wmin；
4) central point for choosing the point in each group is this group of fused points；
5) from fused point set, the central point of position sensing figure is found out；
6) judge whether final qualified number is 3, if 3, then finds 3 position sensings of image in 2 D code
The central point of figure terminates iterative process, records the coordinate position of 3 points；
If more than 3 points, proportionate relationship is arranged closer to standard value, it may be assumed that
RT1=RT1+S1,RT2=RT2-S1,RT3=RT3+S1,RT4=RT4-S1
If being less than 3 points, proportionate relationship setting is loose, i.e.,
RT1=RT1-S1,RT2=RT2+S1,RT3=RT3-S1,RT4=RT4+S1
Set M, set N are emptied, step 2)~6 are repeated), until finding 3 position sensing centre of figure points.
2. according to the method described in claim 1, it is characterized by: step S3 image quality requirements specifically: 1) in image
Include complete meter reading device image and image in 2 D code；2) image clearly；
It is judged automatically in step S3 and grabs the specific steps for meeting quality requirement image are as follows:
S31: hand-held kilowatt meter recorder scans the two-dimensional code, and will automatically snap and differentiates to each frame image；
S32: when two dimensional code identifies successfully, hand-held meter reading terminal generates the information that two dimensional code icon includes, and issues preservation
Order to the name of this frame image, saves, realizes image and automatically grab and ensure that image quality.
3. according to the method described in claim 2, it is characterized by: 1 of image in 2 D code in the step S2 and step S5
The lookup of the center position of correction graph, specific steps are as follows:
1) according to the center position for 3 position sensing figures having been found, respectively in the upper left corner of image in 2 D code, upper right
The lower right corner rectangular area of image in 2 D code delimited out at angle, the lower left corner, searched in 1 correction graph in the rectangular area
Heart point position；
2) the module width proportionate relationship of preliminary given composition correction graph, Wherein, L0, L1, L2, L3, L4For the line segment length at adjacent 5 black and white intervals, JZ1,
JZ2, JZ3, JZ4For proportionate relationship initial value, the step-length of iteration is S2；
3) transversal scanning image, finds out all adjacent five black and white intervals line segments for meeting proportionate relationship in image, and record is each
The midpoint coordinates of the midium line segment of adjacent five line segments, is stored in set M, the length of line segment, storage where recording these points
In set N；
4) a minute group is carried out to the point in set M；Finding out the minimum value in set N is Wmin, each point in group it is mutual away from
From for Dj, D should be metj≤Wmin；
5) central point for choosing the point in each group is this group of fused points；
6) from fused point set, the central point of correction graph is found out；
7) judge whether final qualified number is 1, if 1, then find correction graph central point, terminate iteration
Process records the coordinate position of the point；
If more than 1 point, proportionate relationship is arranged closer to standard value, it may be assumed that
JZ1=JZ1+S2,JZ2=JZ2-S2,JZ3=JZ3+S2,JZ4=JZ4-S2
If being less than 1 point, proportionate relationship setting is loose, it may be assumed that
JZ1=JZ1-S2,JZ2=JZ2+S2,JZ3=JZ3-S2,JZ4=JZ4+S2
Set M, set N are emptied, step 3)~7 are repeated), until finding correction graph central point.
4., will according to the method described in claim 1, it is characterized by: form transition matrix in the step S2 and step S5
Image is converted into positive visual angle figure, comprising the following steps:
1) center position of 3 position sensing figures of template image and 1 correction graph is (x0,y0), (x1,y1), (x2,
y2), (x3,y3) and corresponding images to be recognized 3 position sensing figures and 1 correction graph center position
(u0,v0), u1,v1), (u2,v2), (u3,v3), there are 3 × 3 perspective transformation matrix M relationships between figure and Prototype drawing to be identified:
Wherein, aijFor the occurrence of each element in perspective transformation matrix M；I=1,2,3；J=1,2,3；
Corresponding relationship between 4 central points of Prototype drawing and 4 central points of figure to be identified may be expressed as:
Wherein i=0,1,2,3, w is parameter；
2) it is corresponded to according to the transformation matrix M acquired by each pixel coordinate of figure to be identified according to above-mentioned transformation relation
The coordinate position and pixel value at positive visual angle, figure to be identified is corrected to front view.
5. a kind of substation equipment kilowatt meter reading-out system using such as claim 1 method, which is characterized in that each two dimensional code includes one
Platform waits for the information of kilowatt meter recorder, the two dimensional code icon be attached to it is corresponding to kilowatt meter recorder near；Hand-held meter reading terminal includes phase
The camera shooting module of machine and embedded two dimensional code recognizer, the position in the display screen of camera are provided with two dimensional code icon
Identification frame；The meter reading terminal pass through scan the two-dimensional code and to kilowatt meter recorder meter reading device, by each frame image of automatic shooting
Differentiated, when two dimensional code identifies successfully, judge automatically the image for meeting quality requirement, generates the two dimensional code letter of the frame image
Breath, and give and the frame image is named and is saved, and by the frame image, respective two-dimensional code information, be uploaded to server；
Server be built-in with template library, visual angle correction module, meter reading identification module, database computer, wherein mould
The two-dimensional barcode information and template image of each substation equipment for needing meter reading are stored in plate library, template image is right at the scene
Two dimensional code and the front view of instrument shooting, complete image in 2 D code and Instrument image are contained in every template image；Each mould
Plate image and the center position of 3 position sensing figures of image in 2 D code in corresponding two dimensional code icon, template image and
The center position of 1 correction graph of image in 2 D code, three correspond；Visual angle correction module is used for meter reading terminal
After the image aspects of biography are modified, according to the two-dimensional barcode information that meter reading terminal uploads, corresponding template image is searched；Instrument is read
Number identification modules meter reading in image after the corresponding amendment of template image for identification, database for save meter reading and
The location of the machine to be installed that includes in instrument two-dimensional barcode information, device coding, device name；
Connection between the server and meter reading terminal is realized by WIFI or mobile communication technology.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001099.2A CN106570436B (en) | 2016-11-14 | 2016-11-14 | A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611001099.2A CN106570436B (en) | 2016-11-14 | 2016-11-14 | A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106570436A CN106570436A (en) | 2017-04-19 |
| CN106570436B true CN106570436B (en) | 2019-01-25 |
Family
ID=58542571
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611001099.2A Expired - Fee Related CN106570436B (en) | 2016-11-14 | 2016-11-14 | A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106570436B (en) |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108875471A (en) * | 2017-06-19 | 2018-11-23 | 北京旷视科技有限公司 | The method, apparatus and computer storage medium of facial image bottom library registration |
| CN107392068B (en) * | 2017-07-25 | 2021-01-15 | 朱宸 | Method and device for identifying metering data |
| CN107507174A (en) * | 2017-08-16 | 2017-12-22 | 杭州意能电力技术有限公司 | Power plant's instrument equipment drawing based on hand-held intelligent inspection is as recognition methods and system |
| CN108197634A (en) * | 2017-11-27 | 2018-06-22 | 广州供电局有限公司 | Automatic meter reading method, system, computer equipment and readable storage medium storing program for executing |
| CN108021839B (en) * | 2017-12-08 | 2020-10-23 | 博众精工科技股份有限公司 | Error correction reading method and system for QR (quick response) code |
| CN107905639A (en) * | 2017-12-23 | 2018-04-13 | 黎耀呀 | A kind of optical cement case |
| CN108629220A (en) * | 2018-03-23 | 2018-10-09 | 阿里巴巴集团控股有限公司 | A kind of two dimension code reading method, apparatus and equipment |
| CN110390375B (en) * | 2018-04-17 | 2022-12-13 | 银河联动信息技术（北京）有限公司 | Dynamic two-dimensional code and identification synthesis system and method and dynamic two-dimensional code display device |
| CN108960236B (en) * | 2018-06-27 | 2021-08-27 | 浙江理工大学 | Pointer instrument identification method based on two-dimensional code matching and image identification |
| CN109299758A (en) * | 2018-07-27 | 2019-02-01 | 深圳市中兴系统集成技术有限公司 | A kind of intelligent polling method, electronic equipment, intelligent inspection system and storage medium |
| CN109508709B (en) * | 2018-09-29 | 2021-09-21 | 中国南方电网有限责任公司超高压输电公司检修试验中心 | Single pointer instrument reading method based on machine vision |
| CN111507120A (en) * | 2019-01-31 | 2020-08-07 | 北京骑胜科技有限公司 | Two-dimensional code positioning frame identification method and device, electronic equipment and storage medium |
| CN110351610A (en) * | 2019-07-17 | 2019-10-18 | 广州物道水务科技有限公司 | A kind of data processing method, device and electronic equipment |
| CN110659638B (en) * | 2019-09-24 | 2023-04-07 | 北京精英路通科技有限公司 | License plate recognition method and device, computer equipment and storage medium |
| CN111898395B (en) * | 2020-07-28 | 2024-05-17 | 拉扎斯网络科技（上海）有限公司 | Data processing method and device |
| CN113095104A (en) * | 2021-05-08 | 2021-07-09 | 山东新一代信息产业技术研究院有限公司 | Defective two-dimensional code positioning method |
| CN113762239B (en) * | 2021-08-10 | 2024-07-19 | 国网河北省电力有限公司保定供电分公司 | Meter light reflection identification method based on inspection robot |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008234160A (en) * | 2007-03-19 | 2008-10-02 | Meiyu Techno Co Ltd | Meter reader for meter inspection, handy terminal, and meter inspection system |
| JP2011130652A (en) * | 2009-02-19 | 2011-06-30 | Hitachinaka Techno Center:Kk | Cable connection check system, identification tag manufacturing method, and related device |
| CN103955694A (en) * | 2014-04-09 | 2014-07-30 | 广州邦讯信息系统有限公司 | Image recognition meter reading system and method |
| CN104504490A (en) * | 2014-11-25 | 2015-04-08 | 新天科技股份有限公司 | High-intelligent photographing and meter reading system and method |
| CN104517109A (en) * | 2013-09-29 | 2015-04-15 | 北大方正集团有限公司 | QR code image correction method and system |
| CN104766037A (en) * | 2015-03-20 | 2015-07-08 | 中国联合网络通信集团有限公司 | Two-dimension code recognition method and device |
-
2016
- 2016-11-14 CN CN201611001099.2A patent/CN106570436B/en not_active Expired - Fee Related
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008234160A (en) * | 2007-03-19 | 2008-10-02 | Meiyu Techno Co Ltd | Meter reader for meter inspection, handy terminal, and meter inspection system |
| JP2011130652A (en) * | 2009-02-19 | 2011-06-30 | Hitachinaka Techno Center:Kk | Cable connection check system, identification tag manufacturing method, and related device |
| CN104517109A (en) * | 2013-09-29 | 2015-04-15 | 北大方正集团有限公司 | QR code image correction method and system |
| CN103955694A (en) * | 2014-04-09 | 2014-07-30 | 广州邦讯信息系统有限公司 | Image recognition meter reading system and method |
| CN104504490A (en) * | 2014-11-25 | 2015-04-08 | 新天科技股份有限公司 | High-intelligent photographing and meter reading system and method |
| CN104766037A (en) * | 2015-03-20 | 2015-07-08 | 中国联合网络通信集团有限公司 | Two-dimension code recognition method and device |
Non-Patent Citations (1)
| Title |
|---|
| 一种低复杂度的QR码解码器的图像预处理方法;罗小丽等;《湖南工程学院学报》;20121231;第22卷(第4期);正文引言，第1-2章 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106570436A (en) | 2017-04-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106570436B (en) | A kind of substation equipment kilowatt meter reading-out system and its meter register method based on two dimensional code | |
| CN104484648B (en) | Robot variable visual angle obstacle detection method based on outline identification | |
| US6917702B2 (en) | Calibration of multiple cameras for a turntable-based 3D scanner | |
| Boltes et al. | Automatic extraction of pedestrian trajectories from video recordings | |
| CN107609451A (en) | A kind of high-precision vision localization method and system based on Quick Response Code | |
| CN109583324A (en) | A kind of pointer meters reading automatic identifying method based on the more box detectors of single-point | |
| CN107689061A (en) | Rule schema shape code and localization method for indoor mobile robot positioning | |
| CN107369183A (en) | Towards the MAR Tracing Registration method and system based on figure optimization SLAM | |
| CN107657639A (en) | A kind of method and apparatus of quickly positioning target | |
| CN110967014B (en) | Machine room indoor navigation and equipment tracking method based on augmented reality technology | |
| JP2004518105A (en) | Method and apparatus for measuring orientation and distance | |
| CN106951930A (en) | A kind of instrument localization method suitable for Intelligent Mobile Robot | |
| CN105740856A (en) | Method for reading readings of pointer instrument based on machine vision | |
| CN102930251B (en) | Bidimensional collectibles data acquisition and the apparatus and method of examination | |
| CN112801094B (en) | Pointer instrument image inclination correction method | |
| CN108334955A (en) | Copy of ID Card detection method based on Faster-RCNN | |
| CN112163588A (en) | Intelligent evolution-based heterogeneous image target detection method, storage medium and equipment | |
| CN105423975B (en) | The calibration system and method for a kind of large-scale workpiece | |
| CN109242787A (en) | It paints in a kind of assessment of middle and primary schools' art input method | |
| Kersten et al. | Automatic interior orientation of digital aerial images | |
| CN107610097A (en) | Instrument localization method, device and terminal device | |
| CN107966100A (en) | Measuring method and measuring system based on camera array | |
| CN109870106A (en) | A kind of building volume measurement method based on unmanned plane picture | |
| CN111861866A (en) | Panoramic reconstruction method for substation equipment inspection image | |
| CN115471573A (en) | Method for correcting presetting bit offset of transformer substation cloud deck camera based on three-dimensional reconstruction |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20190125 Termination date: 20191114 |