CN111507186B - Method for recognizing reading of pointer instrument of transformer substation - Google Patents
Method for recognizing reading of pointer instrument of transformer substation Download PDFInfo
- Publication number
- CN111507186B CN111507186B CN202010176351.3A CN202010176351A CN111507186B CN 111507186 B CN111507186 B CN 111507186B CN 202010176351 A CN202010176351 A CN 202010176351A CN 111507186 B CN111507186 B CN 111507186B
- Authority
- CN
- China
- Prior art keywords
- pointer
- scale
- reading
- area
- digital
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 77
- 238000001514 detection method Methods 0.000 claims abstract description 59
- 238000004364 calculation method Methods 0.000 claims abstract description 13
- 230000008569 process Effects 0.000 claims abstract description 13
- 238000012937 correction Methods 0.000 claims description 11
- 238000003708 edge detection Methods 0.000 claims description 7
- 238000000605 extraction Methods 0.000 claims description 6
- 238000007781 pre-processing Methods 0.000 claims description 6
- 125000004122 cyclic group Chemical group 0.000 claims description 3
- 102100029469 WD repeat and HMG-box DNA-binding protein 1 Human genes 0.000 claims description 2
- 101710097421 WD repeat and HMG-box DNA-binding protein 1 Proteins 0.000 claims description 2
- 230000008859 change Effects 0.000 claims description 2
- 230000001502 supplementing effect Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 238000007689 inspection Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 230000008030 elimination Effects 0.000 description 2
- 238000003379 elimination reaction Methods 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003709 image segmentation Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
- G06V30/14—Image acquisition
- G06V30/148—Segmentation of character regions
- G06V30/153—Segmentation of character regions using recognition of characters or words
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
- G06V30/10—Character recognition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Image Analysis (AREA)
Abstract
The invention relates to a method for recognizing the reading of a pointer instrument of a transformer substation, which comprises dial plate scale area detection, digit position detection, digit recognition, pointer detection and reading recognition, wherein the instrument reading recognition is carried out on the basis of the digit recognition and pointer detection results, the correctness of the scale area detection can be verified by carrying out the processes of inclination and alignment recognition on the recognized digit, and a distance calculation method based on the scale digit is adopted in the reading recognition process, so that the recognition precision is ensured, and the reading recognition method has good reliability.
Description
Technical Field
The invention relates to the field of pattern recognition, in particular to scale and pointer reading recognition and application of a pointer instrument image.
Background
A transformer substation needs a large number of instruments to monitor the working state of transformer equipment, and due to factors such as a complex electromagnetic environment, the instruments in the transformer substation basically adopt analog instruments and a pointer reading mode; the pointer type instrument needs manual reading, so a large amount of labor is consumed, and the reading precision is interfered by subjective factors and weather factors; in order to improve the automation management degree of the transformer substation, the research on automatic identification and reading of the pointer instrument has important application value.
The pointer type instrument automatic reading system generally takes an inspection robot as a platform, the platform is provided with various sensors such as a visible light camera, an infrared sensor and the like, corresponding instrument images are collected according to a planned path and an inspection shooting point, and image data are transmitted through wireless transmission equipment; the automatic reading identification system of the instrument identifies and stores the reading of the transmitted image for equipment monitoring and data analysis; the inspection robot carries out reasonable path planning, can obtain an instrument front-view image with better size and definition, and the automatic reading identification process of the instrument can be divided into the steps of image preprocessing, dial plate detection, pointer reading calculation and the like; the image preprocessing generally comprises distortion elimination, denoising, enhancement, graying and other conventional processing operations; after the image is preprocessed, the current mainstream method is to detect the dial and the meter pointer, then calculate the included angle between the pointer and the zero reticle of the meter, and then obtain the reading of the current meter through the conversion of equal proportion according to the angle range and the reading range of the meter.
The dial detection generally adopts a round contour detection algorithm based on Hough transform, and the round contour in an image is detected by Hough transform as a dial detection result by setting a proper radius threshold; in addition, researchers also provide a plurality of Hough transform improvement methods for detecting the outline of the instrument, and the detection efficiency and the detection precision are improved.
According to the shape structure characteristics of the instrument pointer, hough transform can also be used for detecting a straight line as an instrument pointer detection result; and the instrument pointer detection method based on image segmentation extracts a pointer area larger than a certain length threshold value as a pointer extraction result. In addition, the instrument pointer detection method also comprises a least square method, a silhouette method, a visual saliency feature identification method and the like. Based on the visual saliency feature recognition method, the pointer region of the instrument image is extracted by using the prior knowledge of the visual saliency region detection such as region contrast, spatial relationship, central prior and the like.
The most common pointer reading calculation methods include an angle method and a distance method; the angle method is a method which is commonly applied at present, and the slope of the pointer is calculated according to the pointer straight line detected in the front, so that the inclination angle of the straight line where the pointer is located is obtained; the method directly utilizes the geometric relation of straight lines to calculate, is simple and widely applied, but the measurement error of the included angle in the angle method can cause larger reading error and can only be applied to the reading of instruments with uniform scales; the distance method comprises the steps of firstly detecting all scale marks, then finding two nearest scale marks on the left side and the right side of a pointer straight line, and calculating the pointer reading by calculating the ratio of the distance sum of pixel points on the two scale marks to the pointer straight line according to the meter reading value represented by the scale marks; the distance method requires a large amount of calculation, and if the scale lines are detected accurately, the obtained angle value is also accurate.
In the existing pointer reading identification, the methods are mostly based on the method of the included angle between the pointer and the zero scale line, the methods rely on the accurate positioning of the zero scale line, if the zero scale line is positioned wrongly, the subsequent accuracy cannot be guaranteed, and the methods usually need the prior knowledge of the zero scale line and the measuring range of the instrument, so that the relative position can be calculated through the included angle to obtain the reading of the instrument.
Disclosure of Invention
Aiming at the defects of the prior art, the invention provides a reading identification method for a pointer instrument of a transformer substation, which starts from the identification of numbers on scale marks, adopts a mutual verification mode of the numbers and the scale marks to identify the pointer reading, and improves the stability and the accuracy of the automatic reading of the pointer instrument of the transformer substation.
In order to achieve the purpose, the invention adopts the technical scheme that: a reading identification method for a pointer instrument of a transformer substation comprises the following steps:
(1) Detecting an initial circumference where a scale mark in an instrument image is located by adopting a circumference detection method based on Hough transform, and detecting a group of concentric circles in and outside the initial circumference to verify the correctness of the detection of the initial circumference and realize the detection of a scale area with a certain width;
(2) Detecting the digital position at the scale mark in a scanning mode in an image space based on the circle center and the radius of the concentric circle, and carrying out image extraction on the detected digital region;
(3) Calculating the inclination angle of each digital original position relative to the ordinate axis of the instrument image according to the position information of the digital area image on the scale mark, performing correction rotation at the same angle to realize the correction of the corresponding digital inclination, and then identifying the rotated digital by adopting a template matching method;
(4) Analyzing and calculating the recognized number, and verifying the correctness of the detection of the scale area by the inclination and correction recognition process; after the number is identified, recording the coordinates of the intersection point of the number center and the concentric circle center from the connection line of the number center and the concentric circle center, and marking the scale value at the intersection point as the digital value;
(5) On the basis of scale area detection and digital identification, extracting a pointer area image of a dial plate according to the circle center and the radius of a concentric circle, detecting a straight line in a specific area by adopting Hough transform, and taking a detection result as an instrument pointer identification result;
(6) Calculating the pointer reading of the meter from the identified number and pointer position: if the two sides of the pointer have recognized numbers, reading calculation is carried out by adopting a halving method; if no number is recognized on one side, corresponding numbers are supplemented on the initial circumference by adopting a distance method according to the existing scale numbers, and then pointer reading calculation is carried out by adopting a halving method.
The step (1) specifically comprises the following steps: firstly, carrying out edge detection on an instrument image by adopting a Canny operator, then setting an angle parameter range to be [0, pi ], setting an angle step length to be 0.01, setting a radius parameter range to be 1/1 to 3/4 of the image height, setting a radius increasing step length to be 1, and carrying out Hough transform to obtain a circle center O and a radius R of an initial circumference; and meanwhile, taking O as a circle center, taking the radius R as an initial value, respectively carrying out cyclic search by using the step length of +1 and-1, determining the change range of R according to the height of the scale mark of the instrument, finding out concentric circles which meet the requirement that the accumulated value is 1/6 to 1/2 of the maximum value and the difference value of the accumulated value is within 20%, wherein the area formed by arcs on the concentric circles is the scale area of the instrument, the number of the concentric circles represents the width of the scale area, and if the concentric circles are in the direction of the step length of R and is in the direction of +1, the scale area is outside the initial circumference, otherwise, the concentric circles are inside the initial circumference.
The step (2) is specifically as follows: on the basis of the detection of the scale area, the digital position scanning search is carried out on the digital area and the scale area in the same side direction of the initial circumference according to the transverse interval distribution characteristic of the numbers: firstly, calculating the height of a number by scanning, taking the circle center O of an initial circumference as the circle center in an image space, taking a radius larger than a scale area as an initial value and taking the step length as 1, assuming that the number is outside the initial circumference, scanning from a left edge point of the scale area to a right edge by an angle step length of 0.01, and simultaneously recording the number of edge points on an arc line passed by a radius terminal; when the number of edge points generated after one-time scanning is not more than 5, considering that the edge points reach the top end of the digital area, stopping scanning and recording a scanning radius value, wherein the height of the number is the scanning frequency; then, scanning to obtain a left boundary and a right boundary of a number, scanning from a left edge point of a scale area to a right edge by an angle step length of 0.01 by taking O as a center of a circle in an image space, and in each angle, taking a radius larger than the scale area as an initial value, taking a final value to the top end of the digital area and taking the step length as 1, assuming that the number is outside an initial circumference, performing radial scanning, and simultaneously recording the number of edge points which pass through the radius terminal in the image space; according to the number of the recorded edge points and the size proportion of the numbers in the image, continuous non-edge point descriptions are blank areas between the numbers, continuous edge point descriptions are digital areas, and therefore left and right boundaries of the numbers are obtained; the left and right boundaries of the number are combined with the height of the number obtained in the front, so that each number position on the scale mark can be obtained, and each number area is scratched in the original image.
The specific process of the step (3) is as follows: after detecting and picking up the digital position, according to the position information of the number on the scale mark, calculating the inclination angle of each number, namely the included angle between the connecting line from the position point to the center of the concentric circle and the vertical line in the image space, carrying out the correction of the corresponding digital inclination by rotating the picked-up digital area image at the same included angle, carrying out binarization and standardization on the rotated digital image, and adopting a template matching method to identify the number.
The step (5) specifically comprises the following steps: selecting a pointer detection area based on the initial circumference of the circle center O and the radius R, performing graying and binarization preprocessing operations again, performing edge detection by using a Laplace operator, detecting by using Hough transform, finding a straight line which passes through the circle center O and is in the scale area range, and if two similar pointer straight lines are detected, combining by using a least square method to obtain a straight line as a final pointer detection result.
The half-folding method in the step (6) specifically comprises the following steps:
a) On the basis of pointer detection, a pointer straight line intersects with an initial circumference, the coordinates C (x, y) of an intersection point are recorded, if C is the same as the coordinates of a recognized digit or within a certain threshold range, the pointer reading N is the digital value, reading recognition is finished, and the process goes to f); otherwise, searching the marked scale reading in the left and right directions of the straight line of the pointer, and setting the coordinate of the reading N1 at the left side as (x 1, y 1) and the coordinate of the reading N2 at the right side as (x 2, y 2);
b) Taking the coordinate mean value of N1 and N2, namely the midpoint as M ((x 1+ x 2)/2, (y 1+ y 2)/2);
c) If the mean value M is equal to the cross point C, the pointer reading is N = (N1 + N2)/2, the reading identification is finished, and the flow goes to f);
d) If the calculated coordinate mean value M is on the left side of the intersection C, N1= (N1 + N2)/2, the coordinate at the position of N1 is reassigned to be the coordinate of the intersection point of the straight line formed by the M and the center of the dial and the circle, and b is executed in a circulating mode;
e) If the calculated coordinate mean value M is on the right side of the intersection C, N2= (N1 + N2)/2, and the coordinate at the position of N2 is reassigned to be the coordinate of the intersection of the straight line of M and the center of the dial and the circle, and b is executed in a circulating mode;
f) And outputting a pointer reading N.
The distance method in the step (6) specifically comprises the following steps: selecting numbers at the left end and the right end of the identified scale area, calculating the difference between the two numbers, and calculating the arc length of the initial circumference between the scales at the two numbers to obtain the corresponding relation between the scale value and the arc length; according to the corresponding relation between the arc length and the scale value, based on the position information of the recognized number, measuring a corresponding arc segment along the initial circumference in the direction of the non-scale number to obtain the missing number scale value and the coordinate position thereof, wherein the arc segment length should be limited in the scale area, and then supplementing the missing scale value.
Has the beneficial effects that: compared with other pointer instrument reading identification technologies, the invention can identify the inclined numbers distributed on the circumference of the scale mark, mutually verify the identified numbers and the scale mark, and calculate the pointer reading based on the distance, thereby ensuring the reliability and the precision of the instrument reading. The method mainly comprises two aspects:
firstly, after a scale area is detected, a digital area is detected near the circumference, the digital area image is correspondingly rotated, the inclined number on the circumference is corrected and then recognized, the normal number is recognized, meanwhile, the correctness of the detection of the scale area is verified, and the reliability of the recognition is ensured.
Secondly, in the pointer reading calculation process, the scale reading at the intersection point of the pointer straight line and the circumference is calculated in a distance mode based on the detected number position of the scale.
Drawings
FIG. 1 is a graph of the gauge scale area test results of the present invention;
FIG. 2 is a test result of the invention after verification of the gauge scale area;
FIG. 3 is a digital position detection result of the present invention;
FIG. 4 is a result of digit extraction and recognition according to the present invention;
FIG. 5 is a diagram of the pointer region image edge detection and pointer extraction results of the present invention;
FIG. 6 is a broken half pointer reading identification of the present invention;
fig. 7 is a scale numerical complement of the present invention.
Detailed Description
The invention is described in further detail below with reference to the figures and specific examples.
The invention provides a reading identification method for a pointer instrument of a transformer substation, which comprises the following implementation steps of:
(1) Detecting an initial circumference where a scale mark in an instrument image is located based on Hough transform, and simultaneously detecting a group of concentric circles in and outside the initial circumference to verify the correctness of the detection of the initial circumference and realize scale area detection with a certain width;
(2) Detecting the digital position at the scale mark in a scanning mode in an image space based on the circle center and the radius of the concentric circle, and carrying out image extraction on the detected digital region;
(3) Calculating the inclination angle of each digital original position relative to the ordinate axis of the instrument image according to the position information of the digital regional image on the scale mark, performing correction rotation of the same angle on the digital regional image to realize correction of corresponding digital inclination, and then identifying the rotated digital by adopting a template matching method;
(4) Analyzing and calculating the recognized numbers, wherein the requirements on the quantity, numerical value and other instrument scale value characteristics are met, and meanwhile, the accuracy of the detection of the scale area is verified through the inclination and alignment recognition processes; after the number is identified, the coordinates of the intersection point with the initial circumference are recorded from the line connecting the center of the number and the center of the concentric circle, and the scale value at the intersection point is marked as the digital value.
(5) On the basis of scale area detection and digital identification, extracting a pointer area image of the dial according to the circle center and the radius of a concentric circle, detecting a straight line in a specific area by adopting Hough transform, and taking a detection result as an instrument pointer identification result;
(6) Calculating the pointer reading of the meter based on the identified number and pointer position: if the two sides of the pointer have recognized numbers, reading calculation is carried out by adopting a halving method; if no number is recognized on one side, corresponding numbers are supplemented on the initial circumference, and then pointer reading calculation is carried out by adopting a halving method.
Examples
Based on a visible light image acquired by the transformer substation inspection robot platform, the background is relatively simple and the target position is relatively fixed, so that the pointer instrument image target to be processed is supposed to be extracted, and preprocessing operations such as distortion elimination, denoising, enhancement, graying, binaryzation and the like are performed, and the process of reading and identifying the pointer instrument image by using the method disclosed by the invention is as follows.
(1) Dial scale zone detection
Because the dial scale area of the pointer instrument has the characteristics of a circular shape, a circle detection method based on Hough transform is adopted, and based on the principle of Hough transform circle detection, an image pixel space is corresponding to a parameter space by using the parameter equations x = a + rcos theta and y = b + r sin theta (theta belongs to [0,2 pi ]) of a circle, wherein (a, b) is the coordinates of the center of the circle, r is the radius of the circle, theta is a parameter, and (x, y) is the coordinates of a passing point of the circle; setting the variation range and step length of the angle theta and the radius r, calculating the values of a and b, counting and accumulating the positions if the values of a and b are in a reasonable range, and finally finding the coordinates and the radius of the circle center according to the maximum value.
Firstly, carrying out edge detection on an instrument image by adopting a Canny operator, then setting an angle parameter range as [0, pi ], an angle step length as 0.01, a radius parameter range as 1/1 to 3/4 of the image height and a radius increasing step length as 1, and carrying out Hough transformation to obtain a circle center O and a radius R of an initial circumference; meanwhile, with O as a circle center and R as an initial value, carrying out cyclic search respectively by step length +1 and step length-1, determining the variation range of R according to the height of the scale mark of the instrument, finding out concentric circles which meet the requirement that the accumulated value is 1/6 to 1/2 of the maximum value and the difference value of the accumulated value is within 20%, wherein the area formed by arcs on the concentric circles is the instrument scale area, the number of the concentric circles represents the width of the scale area, as shown in a red area in FIG. 1, the detected instrument scale area displays a result on an original image, the circle with the maximum accumulated value detected in FIG. 2 cannot meet the condition of the concentric circles and is excluded, and the finally obtained red area meeting the condition of the concentric circles is used as a scale area detection result; if the concentric circles are in the step +1 direction of R, it means that the scale region is outside the initial circumference, otherwise inside.
(2) Digital position detection
In order to ensure the correctness of the scale area detected in the instrument image, the number is further detected and recognized near the scale area, and the scale area detection reliability can be improved by mutually verifying the scale area and the number. On the basis of the detection of the scale area, the digital position scanning search is carried out on the digital area and the scale area in the same side direction of the initial circumference according to the transverse interval distribution characteristic of the numbers. Firstly, the height of the number is calculated by scanning, the radius is larger than the scale area as an initial value and the step length is 1 (assuming that the number is outside the initial circumference) by taking O as the center of a circle in the image space, the left edge point of the scale area is scanned to the right edge by the angle step length of 0.01, and meanwhile, the number of the edge points on the arc line passing through the radius terminal is recorded. When the number of edge points generated after one-time scanning is not more than 5, considering that the edge points reach the top end of the digital area, stopping scanning and recording a scanning radius value, wherein the height of the number is the scanning frequency; then, the left and right boundaries of the number are obtained by scanning, and the left and right boundaries are scanned from the left edge point of the scale area to the right edge in angular steps of 0.01 around the center O in the image space, and radial scanning is performed at each angle with the radius larger than the scale area as the initial value and the final value to the top of the digital area and the step size of 1 (assuming that the number is outside the initial circumference), and the number of edge points passed by the radius end in the image space is recorded. According to the number of recorded edge points and the size proportion of the numbers in the image, continuous non-edge point descriptions are blank areas between the numbers, and continuous edge point descriptions are digital areas, so that left and right boundaries of the numbers are obtained. The left and right boundaries of the number are combined with the previously obtained height of the number, so that each number position on the scale mark can be obtained, and each number area is scratched in the original image (gray image). The red area is the numerical position marked on the original meter image as shown in fig. 3.
(3) Identification number
After detecting and picking the positions of the numbers, calculating the inclination angle of each number according to the position information of the numbers on the scale mark, namely the included angle between the connecting line from the position point to the circle center O and the vertical line in the image space; the extracted digital region image is rotated back and forth at the same included angle to realize the correction of the inclination of the corresponding number; and (4) carrying out binarization and standardization on the rotated digital image, and identifying the digital image by adopting a template matching method.
Fig. 4 shows the detected numbers in fig. 3, in which the first action is the original instrument image number region matting, and the second action is the binarized image after the number region is rotated back by 37 °, 15 ° and-10 ° respectively. In the template matching method, a digital template is established based on typical numbers in an image of a transformer substation instrument, and in order to improve matching accuracy, the digital template which is inclined and then aligned is added into the template so as to adapt to tiny deformation generated in the rotation process.
The number of recognized digits should be at least 2, and the left-hand value is smaller than the right-hand value, according to the numeric characteristics on the scale of the meter. The template matching number identification method based on the rotating image can assist reading of the instrument scale numerical value on one hand, and on the other hand, the rotating readable number also shows the existence of the scale arc line accompanied with the instrument scale numerical value, so that the accuracy of detection on the scale area can be verified. Based on the position of each identified number, connecting a line between the center of the number and the center of the concentric circle, calculating the coordinates of the intersection point of the line and the initial circle, and recording the scale values at the intersection point as the identified digital values 0, 1 and 2 respectively.
(4) Pointer detection
The straight line is detected in the identified dial plate area, the detection range is reduced, and the pointer detection becomes simple and the detection efficiency and accuracy are improved due to the circle center limiting condition of the dial plate. And selecting a pointer detection area based on the initial circumference of the circle center O and the radius R, performing graying and binarization preprocessing again, and performing edge detection by using a Laplace operator, as shown in FIG. 5. And finally, detecting by adopting Hough transform and finding a straight line which passes through the circle center O and is in the scale area range, if two similar pointer straight lines are detected in the graph 5, combining by adopting a least square method to obtain a straight line as a final pointer detection result, as shown by a red straight line segment in the graph 5.
(5) Reading identification
The meter reading identification is carried out on the basis of the digital identification and the pointer detection results, and the two conditions are divided. Firstly, if the scale areas on both sides of the straight line of the pointer have recognized scale numbers, the reading is calculated by adopting a 'halving method'. Secondly, if no number is recognized in the scale area on one side of the pointer, the other side is supplemented by adopting a distance method according to the existing scale numbers, the coordinate record and the corresponding numerical value of the corresponding position on the circumference are recorded, and then the reading recognition is carried out by adopting a halving method.
Folding method
On the basis of the pointer detection, a pointer straight line intersects with the initial circle, and the coordinates C (x, y) of the intersection point are recorded, as shown in FIG. 6, if C is the same as the coordinate at which a certain number is recognized (or within a certain threshold value range), the pointer reading N is the digital value, the reading recognition is finished, and the step goes to f); otherwise, searching the marked scale reading in the left and right directions of the straight line of the pointer, and setting the coordinate of the reading N1 at the left side as (x 1, y 1) and the coordinate of the reading N2 at the right side as (x 2, y 2);
taking the coordinate mean (midpoint) of N1 and N2 as M ((x 1+ x 2)/2, (y 1+ y 2)/2);
if the mean value M is equal to the cross point C, the pointer reading is N = (N1 + N2)/2, the reading identification is finished, and go to f);
if the calculated coordinate mean value (midpoint) M is on the left side of the intersection C, then N1= (N1 + N2)/2, the coordinate at the position of N1 is reassigned to be the coordinate of the intersection of the straight line of M and the center of the dial and the circle, and b is executed in a circulating mode;
if the calculated coordinate mean value (midpoint) M is on the right side of the intersection C, N2= (N1 + N2)/2, and the coordinate at the position of N2 is reassigned to be the coordinate of the intersection of the straight line formed by M and the center of the dial and the circle, and b is executed in a circulating mode;
outputting a pointer reading N.
The pointer reading is calculated by adopting the halving method, and after 4 iterations of the halving method, the calculation result of the final pointer reading is 0.03 as shown in fig. 6.
Distance method
And selecting the numbers at the left end and the right end of the identified scale area, calculating the difference between the two numbers, and calculating the arc length of the initial circumference between the scales at the two numbers to obtain the corresponding relation between the scale value and the arc length. According to the corresponding relation between the arc length and the scale numerical value, based on the position information of the recognized number, measuring a corresponding arc segment along the initial circumference in the direction of the non-scale number to obtain the missing number scale value and the coordinate position thereof, wherein the arc segment length is limited in the scale area. If the pointer is on the right side of the scale 2, as shown in fig. 3 where the figure number 3 is not detected, it is necessary to calculate the relationship between the arc length and the scale position from the existing figures 0 and 2, and then supplement the scale value missing on the right side, as shown in fig. 7.
The pointer reading identification in the invention adopts a distance calculation method based on scale numbers, which not only ensures the identification precision, but also has good reliability.
Claims (7)
1. A reading identification method for a pointer instrument of a transformer substation is characterized by comprising the following steps:
(1) Detecting an initial circumference where a scale mark in an instrument image is located by adopting a circumference detection method based on Hough transform, and detecting a group of concentric circles in and outside the initial circumference to verify the correctness of the detection of the initial circumference and realize the detection of a scale area with a certain width;
(2) Detecting the digital position at the scale mark in a scanning mode in an image space based on the circle center and the radius of the concentric circle, and carrying out image extraction on the detected digital region;
(3) Calculating the inclination angle of each digital original position relative to the ordinate axis of the instrument image according to the position information of the digital area image on the scale mark, performing correction rotation at the same angle to realize the correction of the corresponding digital inclination, and then identifying the rotated digital by adopting a template matching method;
(4) Analyzing and calculating the recognized number, and verifying the correctness of the detection of the scale area by the inclination and correction recognition process; after the number is identified, recording the coordinates of the intersection point of the number center and the concentric circle center from the connection line of the number center and the concentric circle center, and marking the scale value at the intersection point as the digital value;
(5) On the basis of scale area detection and digital identification, extracting a pointer area image of the dial according to the circle center and the radius of a concentric circle, detecting a straight line in a specific area by adopting Hough transform, and taking a detection result as an instrument pointer identification result;
(6) Calculating the pointer reading of the meter from the identified number and pointer position: if the two sides of the pointer have recognized numbers, reading calculation is carried out by adopting a halving method; if no number is recognized on one side, corresponding numbers are supplemented on the initial circumference by adopting a distance method according to the existing scale numbers, and then pointer reading calculation is carried out by adopting a halving method.
2. The substation pointer instrument reading identification method of claim 1, wherein the step (1) specifically comprises the following steps: firstly, carrying out edge detection on an instrument image by adopting a Canny operator, then setting an angle parameter range as [0, pi ], an angle step length as 0.01, a radius parameter range as 1/1 to 3/4 of the image height and a radius increasing step length as 1, and carrying out Hough transformation to obtain a circle center O and a radius R of an initial circumference; and meanwhile, taking O as a circle center, taking the radius R as an initial value, respectively carrying out cyclic search by using the step length of +1 and-1, determining the change range of R according to the height of the scale mark of the instrument, finding out concentric circles which meet the requirement that the accumulated value is 1/6 to 1/2 of the maximum value and the difference value of the accumulated value is within 20%, wherein the area formed by arcs on the concentric circles is the scale area of the instrument, the number of the concentric circles represents the width of the scale area, and if the concentric circles are in the direction of the step length of R and is in the direction of +1, the scale area is outside the initial circumference, otherwise, the concentric circles are inside the initial circumference.
3. The method for identifying the reading of the pointer instrument of the substation according to claim 1, wherein the step (2) is specifically as follows: on the basis of the detection of the scale area, the digital position scanning search is carried out on the digital area and the scale area in the same side direction of the initial circumference according to the transverse interval distribution characteristic of the numbers: firstly, calculating the height of a number by scanning, taking the circle center O of an initial circumference as the circle center in an image space, taking a radius larger than a scale area as an initial value and taking the step length as 1, assuming that the number is outside the initial circumference, scanning from a left edge point of the scale area to a right edge by an angle step length of 0.01, and simultaneously recording the number of edge points on an arc line passed by a radius terminal; when the number of edge points generated after one-time scanning is not more than 5, considering that the edge points reach the top end of the digital area, stopping scanning and recording a scanning radius value, wherein the height of the number is the scanning frequency; then, scanning to obtain a left boundary and a right boundary of a number, scanning from a left edge point of a scale area to a right edge by an angle step length of 0.01 by taking O as a center of a circle in an image space, and in each angle, taking a radius larger than the scale area as an initial value, taking a final value to the top end of the digital area and taking the step length as 1, assuming that the number is outside an initial circumference, performing radial scanning, and simultaneously recording the number of edge points which pass through the radius terminal in the image space; according to the number of the recorded edge points and the size proportion of the numbers in the image, continuous non-edge point descriptions are blank areas between the numbers, continuous edge point descriptions are digital areas, and therefore left and right boundaries of the numbers are obtained; the left and right boundaries of the number are combined with the height of the number obtained in the front, so that each number position on the scale mark can be obtained, and each number area is scratched in the original image.
4. The substation pointer instrument reading identification method of claim 1, wherein the specific process of the step (3) is as follows: after detecting and picking up the digital position, calculating the inclination angle of each digit according to the position information of the digit on the scale mark, namely the included angle between the connecting line from the position point to the concentric circle center and the vertical line in the image space, performing the reversal rotation of the same included angle on the picked digital area image to realize the correction of the corresponding digital inclination, performing binaryzation and standardization on the rotated digital image, and identifying the digit by adopting a template matching method.
5. The method for identifying the reading of the substation pointer instrument as claimed in claim 1, wherein the step (5) specifically comprises: selecting a pointer detection area based on the initial circumference of the circle center O and the radius R, carrying out graying and binarization preprocessing again, carrying out edge detection by adopting a Laplacian operator, finally adopting Hough transform detection and finding a straight line which passes through the circle center O and is in the scale area range, and if two similar pointer straight lines are detected, combining by adopting a least square method to obtain a straight line as a final pointer detection result.
6. The substation pointer instrument reading identification method of claim 1, characterized in that: the half-folding method in the step (6) specifically comprises the following steps:
a) On the basis of pointer detection, a pointer straight line intersects with an initial circumference, the coordinates C (x, y) of an intersection point are recorded, if C is the same as the coordinates of a recognized digit or within a certain threshold range, the pointer reading N is the digital value, reading recognition is finished, and the process goes to f); otherwise, searching the marked scale reading in the left and right directions of the straight line of the pointer, and setting the coordinate of the reading N1 at the left side as (x 1, y 1) and the coordinate of the reading N2 at the right side as (x 2, y 2);
b) Taking the mean value of the coordinates of N1 and N2 as the midpoint as M ((x 1+ x 2)/2, (y 1+ y 2)/2);
c) If the mean value M is equal to the intersection point C, the pointer reading is N = (N1 + N2)/2, the reading identification is finished, and the operation is switched to f);
d) If the calculated coordinate mean value M is on the left side of the intersection C, N1= (N1 + N2)/2, the coordinate at the position of N1 is reassigned to be the coordinate of the intersection of the straight line of M and the center of the dial and the circle, and b is executed in a circulating mode;
e) If the calculated coordinate mean value M is on the right side of the intersection C, N2= (N1 + N2)/2, and the coordinate at the position of N2 is reassigned to be the coordinate of the intersection of the straight line of M and the center of the dial and the circle, and b is executed in a circulating mode;
f) And outputting a pointer reading N.
7. The method for identifying the reading of the substation pointer instrument as claimed in claim 1, wherein the distance method in the step (6) is specifically as follows: selecting numbers at the left end and the right end of the identified scale area, calculating the difference between the two numbers, and then calculating the arc length of the initial circumference between the scales at the two numbers to obtain the corresponding relation between the scale value and the arc length; according to the corresponding relation between the arc length and the scale value, based on the position information of the recognized number, measuring a corresponding arc segment along the initial circumference in the direction of the non-scale number to obtain the missing number scale value and the coordinate position thereof, wherein the arc segment length should be limited in the scale area, and then supplementing the missing scale value.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010176351.3A CN111507186B (en) | 2020-03-13 | 2020-03-13 | Method for recognizing reading of pointer instrument of transformer substation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010176351.3A CN111507186B (en) | 2020-03-13 | 2020-03-13 | Method for recognizing reading of pointer instrument of transformer substation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111507186A CN111507186A (en) | 2020-08-07 |
| CN111507186B true CN111507186B (en) | 2023-03-10 |
Family
ID=71868999
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010176351.3A Active CN111507186B (en) | 2020-03-13 | 2020-03-13 | Method for recognizing reading of pointer instrument of transformer substation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111507186B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112115896B (en) * | 2020-09-24 | 2023-12-22 | 深圳市赛为智能股份有限公司 | Instrument panel pointer reading prediction method and device, computer equipment and storage medium |
| CN112488928A (en) * | 2020-10-12 | 2021-03-12 | 国网河南省电力公司济源供电公司 | Transformer oil conservator oil level online monitoring device and method based on image recognition technology |
| CN113610041B (en) * | 2021-08-18 | 2024-07-23 | 山东信通电子股份有限公司 | Reading identification method and device for pointer instrument |
| CN114037993B (en) * | 2021-09-26 | 2023-06-23 | 佛山中科云图智能科技有限公司 | Substation pointer instrument reading method and device, storage medium and electronic equipment |
| CN115471650A (en) * | 2022-08-26 | 2022-12-13 | 中国长江三峡集团有限公司 | Gas pressure instrument reading method, device, equipment and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2330947A1 (en) * | 2000-02-01 | 2001-08-01 | Ming-Yee Chiu | Method and apparatus for monitoring an analog meter |
| CN110580480A (en) * | 2019-07-21 | 2019-12-17 | 天津大学 | Meter reading identification method based on image processing |
-
2020
- 2020-03-13 CN CN202010176351.3A patent/CN111507186B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CA2330947A1 (en) * | 2000-02-01 | 2001-08-01 | Ming-Yee Chiu | Method and apparatus for monitoring an analog meter |
| CN110580480A (en) * | 2019-07-21 | 2019-12-17 | 天津大学 | Meter reading identification method based on image processing |
Non-Patent Citations (2)
| Title |
|---|
| 压力表图像自动识别系统研究;张道德等;《湖北工业大学学报》;20170215(第01期);全文 * |
| 基于深度学习的指针式仪表检测与识别研究;徐发兵等;《高技术通讯》;20191215(第12期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111507186A (en) | 2020-08-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111507186B (en) | Method for recognizing reading of pointer instrument of transformer substation | |
| CN112906694B (en) | Reading correction system and method for transformer substation inclined pointer instrument image | |
| CN103207987B (en) | A kind of registration recognition methods of pointer instrument | |
| CN108918526B (en) | Notch defect detection method for flexible IC packaging substrate circuit | |
| CN112818988B (en) | Automatic identification reading method and system for pointer instrument | |
| CN103759758B (en) | A kind of method for detecting position of the automobile meter pointer based on mechanical angle and scale identification | |
| CN103994786B (en) | Image detecting method for arc ruler lines of pointer instrument scale | |
| CN108764234B (en) | Liquid level meter reading identification method based on inspection robot | |
| CN114549835B (en) | Pointer instrument correction identification method and device based on deep learning | |
| CN110874596B (en) | Intelligent recognition early warning method and system for instrument | |
| CN101660932A (en) | Automatic calibration method of pointer type automobile meter | |
| CN111368906B (en) | Pointer type oil level meter reading identification method based on deep learning | |
| CN108960237B (en) | Reading identification method for pointer type oil level indicator | |
| CN109558871B (en) | Pointer instrument reading identification method and device | |
| CN110211178B (en) | Pointer instrument identification method using projection calculation | |
| CN107301412B (en) | Pointer instrument reading method based on image processing | |
| CN111476246B (en) | Robust and efficient intelligent reading method for pointer instrument applied to complex environment | |
| CN112613429A (en) | Machine vision-based reading method suitable for multi-view image pointer instrument | |
| CN118247331B (en) | Automatic part size detection method and system based on image recognition | |
| CN108921153A (en) | Pointer temperature and humidity instrument detection based on machine vision | |
| CN114663744A (en) | Instrument automatic identification method and system based on machine learning | |
| CN114898198A (en) | Image processing method for automatic reading of pointer type pressure gauge | |
| CN115308222A (en) | System and method for identifying bad chip appearance based on machine vision | |
| CN113902894B (en) | Automatic reading identification method for strip level based on image processing | |
| CN112036391B (en) | Electronic inspection method and system based on shale gas field production station |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |