JP2021012665A - Indicated value reading system and method and program - Google Patents

Abstract

To make it easily possible to read an indicated value of a measuring instrument which suppresses an increase in an introduction cost in an indicated value reading system, method and program.SOLUTION: An indicated value reading system is comprised of: a camera 11 capable of photographing indicator needles 61, 62, 63, 64, 65, 66 of measuring instruments 51, 52, 53, 54, 55, 56; an image processing device 12 which is connected to the camera 11, and processes image data of the indicator needles 61, 62, 63, 64, 65, 66 photographed by the camera 11 to obtain indicated values of the indicator needles 61, 62, 63, 64, 65, 66; and a transmission device 13 which transmits data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 obtained by the image processing device 12.SELECTED DRAWING: Figure 1

Description

The present invention relates to an instruction value reading system, a method, and a program for reading the instruction value of various measuring instruments.

For example, in various plants, the operating states of various devices are measured by measuring instruments, and the operating states of various devices are monitored based on the measured indicated values. In this case, the operator goes to the place where the equipment is installed and reads the indicated value of the measuring instrument installed in the equipment installed at the place of installation. Then, the operator monitors the device and controls the operation based on the indicated value read from the measuring instrument. Considering workability, it is considered to read the reading of the measuring instrument remotely. As such an indicated value reading system, for example, there is one described in Patent Document 1 below. In the device condition monitoring system described in Patent Document 1, a camera photographs a controlled device, a sensor collects information on the controlled device, and the captured image and the collected information are transmitted to a distant monitoring and control device for a distance. The monitoring and control device determines the status of the controlled device and displays a warning.

Japanese Unexamined Patent Publication No. 2006-134063

In the device condition monitoring system of Patent Document 1, the image of the controlled device taken by the camera and the information of the controlled device collected by the sensor are transmitted to the remote monitoring control device, and the remote monitoring control device determines the state of the controlled device. To do. In this case, the image or information of the controlled device is a large amount of data, and the image or information of the controlled device, which is a large amount of data, is transmitted to the remote monitoring control device, and the transmission for transmitting the large amount of data is performed. Equipment is required. Therefore, there is a problem that the remote monitoring system becomes complicated and large in size, a large number of devices and wiring need to be added in order to introduce the system, and the introduction cost increases.

An object of the present invention is to solve the above-mentioned problems, and to provide an instruction value reading system, a method, and a program capable of suppressing an increase in introduction cost and easily reading an instruction value of a measuring instrument. ..

The instruction value reading system of the present invention for achieving the above object processes an image data of a camera capable of photographing the indicator needle of the measuring instrument and the indicator needle connected to the camera and photographed by the camera. It is characterized by including an image processing device for obtaining an instruction value of the instruction needle and a transmission device for transmitting data of the instruction value of the instruction needle obtained by the image processing device.

Therefore, the camera photographs the indicator needle of the measuring instrument, the image processing device processes the image data of the indicator needle to obtain the indicated value of the indicator needle, and the transmitting device transmits the data of the indicated value of the indicator needle. Here, since the data of the indicated value of the indicator needle transmitted by the transmitting device is a numerical value as digital data, it becomes low-capacity data, and a transmitting device that transmits a large-capacity data at high speed becomes unnecessary. As a result, the increase in the introduction cost can be suppressed and the indicated value of the measuring instrument can be easily read.

The indicated value reading system of the present invention is characterized in that the camera and the image processing device are connected by wire.

Therefore, since the camera and the image processing device are connected by wire, the device can be simplified by eliminating the need for a wireless device.

In the instruction value reading system of the present invention, the image processing device is characterized in that the image data of the instruction needle is deleted after processing the image data of the instruction needle to obtain the instruction value of the instruction needle.

Therefore, since the image processing device processes the image data of the indicator needle to obtain the indicated value and then deletes the image data of the indicator needle, it is not necessary to save the image data of the indicator needle, which is a large amount of data. The device can be simplified by eliminating the need for a large storage device.

In the instruction value reading system of the present invention, the operating range and unit of the instruction needle are assigned to the measuring instrument, and the image processing device processes the image data of the instruction needle to indicate the instruction value of the instruction needle. It is characterized by finding the numerical value as.

Therefore, since the operating range and the unit of the indicator needle are assigned, the image processing device can easily obtain the numerical value as the indicator value of the indicator needle by processing the image data of the indicator needle.

The instruction value reading system of the present invention is characterized in that a storage unit for storing the instruction value of the instruction needle obtained by the image processing apparatus is provided.

Therefore, since the indicated value of the indicator needle obtained by the image processing device is stored in the storage unit, the data of the indicated value of the indicator needle can be continuously acquired even if there is a data transmission failure by the transmitting device. ..

In the indicated value reading system of the present invention, the image processing device obtains the likelihood of the indicated value of the indicated needle obtained by processing the image data of the indicated needle, and the likelihood is lower than a preset threshold value. Occasionally, the image data of the indicator needle is stored in the storage unit.

Therefore, when the likelihood of the indicated value of the indicator needle is low, the image data of the indicator needle for which the indicated value having a low likelihood is obtained is stored in the storage unit, and therefore, based on the image data of the indicator needle stored in the storage unit. It is possible to identify the cause of the low likelihood of the indicated value.

In the instruction value reading system of the present invention, the image processing device obtains the instruction value of the instruction needle at a predetermined processing cycle, and the transmission device obtains the instruction value data of the instruction needle at each predetermined transmission cycle. When the data is transmitted and the likelihood is lower than the threshold value, the transmitting device is characterized in that the data of the indicated value of the indicating needle previously obtained by the image processing apparatus is transmitted.

Therefore, when the likelihood of the indicated value of the indicator needle is low, the transmitting device transmits the data of the indicated value of the indicator needle obtained last time, so that the data of the indicated value of the indicator needle can be continuously acquired.

In the indicated value reading system of the present invention, the image processing device obtains the likelihood of the indicated value of the indicated needle obtained by processing the image data of the indicated needle, and the likelihood is set to a preset first threshold value. If it is the above, while the data of the instruction value of the instruction needle is transmitted by the transmission device, if the likelihood is lower than the first threshold value and is equal to or more than the second threshold value smaller than the first threshold value, the instruction needle It is characterized in that the indicated value of is corrected by a similar value of image collation or a previous value and transmitted by the transmitting device.

Therefore, if the likelihood is lower than the first threshold value and is equal to or higher than the second threshold value, the indicated value of the indicator needle is corrected by a similar value or the previous value and transmitted. Therefore, the accuracy of the indicated value of the indicator needle to be transmitted is transmitted. Can be improved.

In the indicated value reading system of the present invention, the image processing apparatus has the likelihood lower than the first threshold value and equal to or higher than the second threshold value, and the absolute value of the indicated value of the indicator needle and the similar value is predetermined. When it is equal to or less than the set deviation threshold value, the indicated value of the indicating needle is corrected by the similar value and transmitted by the transmitting device.

Therefore, if the absolute value of the indicated value of the indicator needle and the similar value is equal to or less than the deviation threshold value, the indicated value of the indicator needle is corrected by the similar value and transmitted, so that the accuracy of the indicated value of the indicated needle to be transmitted is improved. can do.

In the indicated value reading system of the present invention, in the image processing apparatus, the absolute value of the indicated value of the indicator needle and the similar value is higher than the deviation threshold value, and the similarity of the similar values is equal to or higher than the third threshold value. When the absolute value of the indicated value of the indicating needle and the similar value is equal to or less than the absolute value of the previous value and the similar value, the indicated value of the indicating needle is corrected by the similar value and transmitted by the transmitting device. It is characterized by doing.

Therefore, if the degree of similarity is equal to or higher than the third threshold value and the absolute value of the indicated value of the indicator needle and the similar value is equal to or less than the absolute value of the previous value and the similar value, the indicated value of the indicator needle is corrected by the similarity value. Therefore, it is possible to improve the accuracy of the indicated value of the indicating needle to be transmitted.

In the indicated value reading system of the present invention, in the image processing apparatus, the absolute value of the indicated value of the indicator needle and the similar value is higher than the deviation threshold value, and the similarity of the similar values is equal to or higher than the third threshold value. When the absolute value of the indicated value of the indicator needle and the similar value is higher than the absolute value of the previous value and the similar value, the indicated value of the indicator needle is corrected by the previous value and transmitted by the transmitting device. It is characterized by that.

Therefore, if the similarity is equal to or higher than the third threshold value and the absolute value of the indicated value of the indicator needle and the similar value is higher than the absolute value of the previous value and the similar value, the indicated value of the indicator needle is corrected by the previous value. Since the transmission is performed, the accuracy of the indicated value of the indicating needle to be transmitted can be improved.

In the instruction value reading system of the present invention, the camera can photograph a plurality of instruction needles of the measuring instrument, and the image processing device sequentially processes image data of the plurality of instruction needles taken by the camera. It is characterized in that the indicated value of the indicator needle is obtained.

Therefore, since the image processing device sequentially processes the image data of the plurality of indicator needles to obtain the indicated value of the indicator needles, the apparatus can be simplified by eliminating the need for a plurality of cameras.

In the indicated value reading system of the present invention, the image processing device processes image data taken by the camera to create image data of the measuring instrument, and the image data of the measuring instrument is subjected to deep learning to the measuring instrument. The feature is to obtain the indicated value of the indicator needle in the above.

Therefore, since the image data of the indicator needle is deep-learned to obtain the indicated value of the indicator needle, the indicated value of the indicator needle can be quickly obtained with high accuracy.

In the indicated value reading system of the present invention, a monitor can be connected to the image processing device, and the image data of the camera and the image data of the measuring instrument processed by the image processing device can be displayed on the monitor. It is characterized by being.

Therefore, since the image data of the camera and the image data of the measuring instrument processed by the image processing device are displayed on the monitor, the operator can confirm the viewing angle of the camera and the specified measuring instrument.

In the indicated value reading system of the present invention, the image processing apparatus can display the setting data required for processing and the indicated value data of the indicator needle obtained by the image processing apparatus on the monitor. It is a feature.

Therefore, since the setting data required for the processing and the data of the indicated value of the indicator needle obtained by the image processing device are displayed on the monitor, the operator can check the processing contents and easily make a mistake in the processing. You can check.

The instruction value reading method of the present invention includes a step of photographing the instruction needle of the measuring instrument, a step of processing the photographed image data of the instruction needle to obtain the instruction value of the instruction needle, and image data of the instruction needle. It is characterized by having a step of transmitting data of the indicated value of the indicator needle obtained at the same time as deleting the indicator.

Therefore, since the data of the indicated value of the indicator needle transmitted by the transmitting device is a numerical value as digital data, it becomes low-capacity data, and a transmitting device that transmits a large-capacity data at high speed becomes unnecessary. As a result, the increase in the introduction cost can be suppressed and the indicated value of the measuring instrument can be easily read.

The instruction value reading program of the present invention performs a process of photographing the instruction needle of the measuring instrument, a process of processing the image data of the photographed instruction needle to obtain the instruction value of the instruction needle, and the image data of the instruction needle. It is characterized in that a computer is made to execute a process of transmitting data of an instruction value of the instruction needle obtained together with deletion.

Therefore, since the data of the indicated value of the indicator needle transmitted by the transmitting device is a numerical value as digital data, it becomes low-capacity data, and a large-sized transmitting device for transmitting a large-capacity data becomes unnecessary. As a result, the increase in the introduction cost can be suppressed and the indicated value of the measuring instrument can be easily read.

According to the indicated value reading system, method and program of the present invention, it is possible to suppress an increase in introduction cost and easily read the indicated value of the measuring instrument.

FIG. 1 is a schematic configuration diagram showing an indicated value reading system of the present embodiment. FIG. 2 is a schematic view showing a monitor screen in the indicated value reading system. FIG. 3 is a flowchart showing the indicated value reading method. FIG. 4 is a flowchart showing the indicated value estimation method. FIG. 5 is a graph for explaining the degree of similarity. FIG. 6 is a schematic view for explaining a method of correcting the indicated value.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the present invention is not limited to this embodiment, and when there are a plurality of embodiments, the present invention also includes a combination of the respective embodiments.

FIG. 1 is a schematic configuration diagram showing the indicated value reading system of the present embodiment, and FIG. 2 is a schematic schematic view showing a monitor image in the indicated value reading system.

In the present embodiment, as shown in FIG. 1, the indicated value reading system 10 is arranged at the site 100 where various devices (not shown) are installed. The indicated value reading system 10 includes at least a camera 11, an image processing device 12, and a transmitting device 13. The indicated value reading system 10 has a plurality of (six in this embodiment) measuring instruments 51, 52, 53, 54, 55, and 56, which are indicated needles 61, 62, 63, of various devices arranged at the site 100. The indicated values of 64, 65, and 66 are read and transmitted to the monitoring system 20 in the management center 200. The management center 200 is separated from the site 100 and monitors various devices arranged at the site 100 by the monitoring system 20. The number of measuring instruments is not limited to six.

Here, the measuring instruments 51, 52, 53, 54, 55, 56 are a thermometer, a pressure gauge, a flow meter, and the like. In the measuring instruments 51, 52, 53, 54, 55, 56, the instrument panel has a circular shape, the indicator needles 61, 62, 63, 64, 65, 66 are rotatably supported at the center position, and the scale 71 is around. , 72, 73, 74, 75, 76 are attached and configured. The indicator needles 61, 62, 63, 64, 65, 66 rotate according to the measured value, and the tip portion points to the scales 71, 72, 73, 74, 75, 76 to display the indicated value.

The indicated value reading system 10 is arranged at the site 100, and specifically, the camera 11, the image processing device 12, the transmitting device 13, the storage unit 14, the operation unit 15, the monitor 16, and the power supply unit 17. And. The monitoring system 20 is arranged in the management center 200 and includes a control device 21, a receiving device 22, and a monitor 23.

The camera 11 can photograph the indicator needles 61, 62, 63, 64, 65, 66 of the plurality of measuring instruments 51, 52, 53, 54, 55, 56. The camera 11 can capture a predetermined area including each measuring instrument 51, 52, 53, 54, 55, 56. Therefore, the measuring instruments 51, 52, 53, 54, 55, 56 are specified by designating the area in which the measuring instruments 51, 52, 53, 54, 55, 56 are arranged in the photographing area of the camera 11. To do. In this case, the operator can specify only a specific measuring instrument among the plurality of measuring instruments 51, 52, 53, 54, 55, 56 by the program stored in the operation unit 15 or the storage unit 14.

Although the image processing device 12 is connected to the camera 11 by wire, the image processing device 12 and the camera 11 may be wirelessly connected. The image processing device 12 includes an image processing unit 12a, an image recognition unit 12b, and a display creation unit 12c. Here, the image processing device 12 is, for example, a CPU (Central Processing Unit) and a memory. The image processing unit 12a preprocesses the image data of each of the indicator needles 61, 62, 63, 64, 65, 66 taken by the camera 11. Specifically, the image processing unit 12a performs data creation processing and learning processing for teachers, filtering processing of image data captured by the camera 11, and binarization processing of image data captured by the camera 11.

As will be described later, the image processing unit 12a recognizes the image by deep learning and obtains the indicated values of the indicating needles 61, 62, 63, 64, 65, 66. For example, a large amount of sample data of a plurality of indicator needles 61, 62, 63, 64, 65, 66 to be processed is acquired in advance, and data for a teacher is created by learning the sample data. The image recognition unit 12b collates the image data of the indicator needles 61, 62, 63, 64, 65, 66 captured by the camera 11 and image-processed with the data for the teacher.

Further, the image data captured by the camera 11 is image data of a predetermined region including each measuring instrument 51, 52, 53, 54, 55, 56. The image processing unit 12a performs a process of extracting only the image data of each measuring instrument 51, 52, 53, 54, 55, 56 from the image data captured by the camera 11. Further, the image processing unit 12a binarizes the image data of the indicator needles 61, 62, 63, 64, 65, 66 taken by the camera 11, and the indicator needles 61, 62, 63, 64, 65, 66. Is black, and the instrument panel of the measuring instruments 51, 52, 53, 54, 55, 56 is white. The image processing of each indicator needle 61, 62, 63, 64, 65, 66 is not limited to the binarization process, and the binarization process may be omitted even if it is another process.

As described above, the image recognition unit 12b collates the image data of the indicator needles 61, 62, 63, 64, 65, 66 taken by the camera 11 and image-processed by the image processing unit 12a with the data for the teacher. To do. By collating the image data, the shapes of the indicator needles 61, 62, 63, 64, 65, 66 are specified, the position pointed by the tip is specified, and the indicated value is obtained. In the present embodiment, the indicated values of the indicating needles 61, 62, 63, 64, 65, 66 in the measuring instruments 51, 52, 53, 54, 55, 56 are obtained by deep learning.

The kernel (filter) B, which is numerical data in a grid pattern, is prepared in advance, and the image data A of each measuring instrument 51, 52, 53, 54, 55, 56 processed and binarized by the image processing unit 12a and this kernel. Image processing is performed using B. First, the numerical data of the kernel B and the partial image (window) in the image data A having the same size as the kernel B are multiplied by the elements in pixel units and then added and summed up. Calculate the value of. Next, the range of the partial image in the image data A is shifted by several pixels, and the product-sum calculation is performed in the same manner as described above to calculate the second numerical value. Subsequently, by performing folding in which this process is repeated until the range covering the image data A is performed, reduced grid-like data smaller than the image data A, that is, the feature map C is obtained. Then, deep learning (learning by a neural network) is performed using the feature map C as an input, the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 are estimated, and the likelihood is calculated. Although the deep learning in which the convolution operation is introduced into the neural network is used here, for example, the deep learning in which the pooling operation is introduced into the neural network may be used. Further, the image processing by the image processing device 12 is not limited to deep learning, and other machine learning or other analysis method may be used.

The camera 11 acquires a plurality of measuring instruments 51, 52, 53, 54, 55, 56 as moving images, and the image processing device 12 captures a still image from the moving image acquired by the camera 11 at a predetermined timing. The still images of the indicator needles 61, 62, 63, 64, 65, 66 are processed to obtain the indicated values of the indicator needles 61, 62, 63, 64, 65, 66. In this case, the image processing device 12 sets the operating range (scale 71, scale 71,) of each indicator needle 61, 62, 63, 64, 65, 66 as the initial setting value in the measuring instruments 51, 52, 53, 54, 55, 56. It is necessary to assign the unit of the attached range of 72, 73, 74, 75, 76), the numerical value of the scale 71, 72, 73, 74, 75, 76, and the measured value. The timing at which the image processing device 12 captures a still image depends on the processing capacity of the image processing device 12.

Therefore, the image processing device 12 processes the image data of each indicator needle 61, 62, 63, 64, 65, 66 taken by the camera 11 to process each indicator needle 61, 62, 63, 64, 65, 66. Based on the position of and the initial set value, the numerical value as the indicated value of each indicator needle 61, 62, 63, 64, 65, 66 is obtained.

The image recognition unit 12b estimates the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 and calculates the likelihood by deep learning. At this time, the plurality of indicated values and the likelihood for the indicated values are calculated. Is obtained, and the indicated value with the highest likelihood is adopted. Then, the image recognition unit 12b processes the image data of each indicator needle 61, 62, 63, 64, 65, 66 to obtain the indicated value adopted by each indicator needle 61, 62, 63, 64, 65, 66. The likelihood in is compared with a preset threshold. Here, the image recognition unit 12b has a low likelihood of each indicator needle 61, 62, when the likelihood of the indicated value of each indicator needle 61, 62, 63, 64, 65, 66 is lower than a preset threshold value. The image data obtained from the indicated values of 63, 64, 65, and 66 is stored in the storage unit 14. Here, the likelihood of the indicated value is an image collation rate by deep learning, and the threshold value is, for example, 90%, but the numerical value of the threshold value may be appropriately set.

Further, the image processing device 12 has a storage unit (internal storage) (not shown), and is, for example, a RAM (Random Access Memory). In the storage unit of the image processing device 12, an instruction value reading program for the image processing device 12 to process the image data of each instruction needle 61, 62, 63, 64, 65, 66 to obtain an instruction value is stored. .. That is, data for the image processing device 12 to perform deep learning of image data is stored. The instruction value reading program includes a process of photographing the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56 and the photographed indicator needles 61, 62, 63, 64. , 65, 66 is processed to obtain the indicated value of the indicator needle, and the image data of the indicator needles 61, 62, 63, 64, 65, 66 is deleted, and the obtained indicator needle 61, 62, The image processing apparatus (computer) 12 is made to execute the process of transmitting the data of the indicated values of 63, 64, 65, and 66.

The image processing device 12 obtains the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 at predetermined cycles, and the transmission device 13 obtains the indicated values of the indicator needles 61, 62, 63, 64, at predetermined cycles. Data of the indicated values of 65 and 66 are transmitted. The predetermined cycle of transmission by the transmission device 13 depends on the transmission capacity. Here, it is not necessary to match the predetermined cycle in which the image processing device 12 processes the image with the predetermined cycle in which the transmitting device 13 transmits the data of the indicated value. Then, when the image recognition unit 12b determines that the likelihood of the image data of each indicator needle 61, 62, 63, 64, 65, 66 is low, the transmission device 13 determines that the indicator needle 61 previously obtained by the image processing apparatus 12 , 62, 63, 64, 65, 66 are transmitted again.

The display creation unit 12c creates an image to be displayed on the monitor 16. The image created by the display creation unit 12c and displayed on the monitor 16 will be described later.

When the camera 11 photographs the indicator needles 61, 62, 63, 64, 65, 66 of the plurality of measuring instruments 51, 52, 53, 54, 55, 56, the image processing device 12 uses the indicator needles 61. , 62, 63, 64, 65, 66 are processed in a preset order to obtain the indicated values of the respective indicator needles 61, 62, 63, 64, 65, 66.

The transmission device 13 transmits data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 obtained by the image processing apparatus 12. The data transmitted by the transmission device 13 is a date and time, an indicated value (numerical value), and a likelihood. At this time, when the image processing device 12 processes the image data of each indicator needle 61, 62, 63, 64, 65, 66 to obtain the instruction value of each indicator needle 61, 62, 63, 64, 65, 66. , The image data of each of the following indicator needles 61, 62, 63, 64, 65, 66 is taken in and updated. That is, the image processing device 12 does not store the image data of the indicator needles 61, 62, 63, 64, 65, 66, and the transmission device 13 does not store the image data of the indicator needles 61, 62, 63, 64, 65, 66. , 63, 64, 65, 66 image data is not transmitted, and only the data of the indicated values of the obtained indicator needles 61, 62, 63, 64, 65, 66 is transmitted. Here, the data of the indicated values of the indicated hands 61, 62, 63, 64, 65, 66 are the date and time of processing, the numerical values of the measuring instruments 51, 52, 53, 54, 55, 56, and the indicated hands 61. , 62, 63, 64, 65, 66, such as the likelihood of the indicated values.

The storage unit 14 is connected to the image processing device 12. The storage unit 14 is, for example, a ROM (Read Only Memory). When the image processing device 12 obtains the indicated values of the indicating needles 61, 62, 63, 64, 65, 66, the storage unit 14 stores the data of the indicated values transmitted by the transmitting device 13. Further, as described above, the storage unit 14 stores in the storage unit 14 the image data obtained by obtaining the indicated values of the indicating needles 61, 62, 63, 64, 65, 66 having low likelihoods by the image recognition unit 12b. ..

The operation unit 15 is for an operator to input various setting data to the image processing device 12. Here, the various setting data include the date and time, the photographing area in the camera 11, the measuring instruments 51, 52, 53, 54, 55, 56 for image processing, the data storage destination, and the like.

As shown in FIG. 2, the monitor 16 is provided with a plurality of (four in this embodiment) display units 31, 32, 33, and 34. The first display unit 31 displays all the image data of the area captured by the camera 11. The second display unit 32 displays an image of the measuring instruments 51, 53, 54 of the specific indicator needles 61, 63, 64 for which the indicated value is to be read, among the plurality of measuring instruments 51, 52, 53, 54, 55, 56. indicate. The third display unit 33 displays setting data and the like required for processing by the image processing device 12. The set data includes the above-mentioned date and time, the shooting area in the camera 11, the measuring instruments 51, 52, 53, 54, 55, 56 for image processing, the data storage destination, and the processing state by the image processing device 12. indicate. The fourth display unit 34 displays a binarized image of the measuring instrument 51 of the indicator needle 61 obtained by the image processing device 12 and an indicated value (numerical value) of the indicator needle 61.

The power supply unit 17 supplies electric power to the camera 11, the transmission device 13, the storage unit 14, the operation unit 15, the monitor 16, and the like via the image processing device 12.

On the other hand, in the monitoring system 20, the receiving device 22 can be connected to the transmitting device 13 of the indicated value reading system 10 by a wireless network capable of transmitting and receiving low-capacity data. The receiving device 22 receives the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 transmitted by the transmitting device 13 of the indicated value reading system 10. The control device 21 receives the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 received by the receiving device 22, and displays them on the monitor 23. The control device 21 is connected to, for example, a monitoring device (not shown), and monitors various devices based on the indicated values of the indicating needles 61, 62, 63, 64, 65, 66.

Here, the indicated value reading method of the present embodiment will be specifically described. FIG. 3 is a flowchart showing the indicated value reading method.

The instruction value reading method of the present embodiment includes a step of photographing the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56 and the photographed indicator needles 61, 62. , 63, 64, 65, 66 to process the image data to obtain the indicated value of the indicator needles 61, 62, 63, 64, 65, 66, and the indicator needles 61, 62, 63, 64, 65, 66. It has a step of deleting the image data and transmitting the data of the indicated values of the indicated needles 61, 62, 63, 64, 65, 66 obtained.

More specifically, as shown in FIGS. 1 and 3, in step S11, the image processing device 12 indicates each of the plurality of measuring instruments 51, 52, 53, 54, 55, 56 taken by the camera 11. The image data of the needles 61, 62, 63, 64, 65, 66 is acquired. In this case, if only a specific measuring instrument is designated among the plurality of measuring instruments 51, 52, 53, 54, 55, 56, only the image data of the designated indicator needle is acquired. In step S12, the image processing device 12 performs image processing on the image data of the acquired indicator needles 61, 62, 63, 64, 65, 66 of the plurality of measuring instruments 51, 52, 53, 54, 55, 56. ..

In step S13, the image processing device 12 performs deep learning of the image data of the indicator needles 61, 62, 63, 64, 65, 66 of the image-processed measuring instruments 51, 52, 53, 54, 55, 56. To do. In step S14, the indicated values and likelihoods of the indicator needles 61, 62, 63, 64, 65, 66 are obtained. Then, in step S15, the image processing device 12 determines whether or not the likelihood of the obtained indicated values of the indicating needles 61, 62, 63, 64, 65, 66 is higher than the threshold value after performing deep learning. .. Here, if the likelihood is higher than the threshold value (Yes), the process proceeds to step S16.

Then, in step S16, the data of the indicated values (numerical values) of the indicator needles 61, 62, 63, 64, 65, 66 are stored in the storage unit 14. In step S17, the image data of the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56 is updated and deleted. In step S18, the transmission device 13 transmits the data of the indicated values (numerical values) of the indicator needles 61, 62, 63, 64, 65, 66 to the monitoring system 20. On the other hand, when the likelihood of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 obtained in step S15 is lower than the threshold value (No), each indicator needle 61 having a low likelihood in step S19 , 62, 63, 64, 65, 66, and the image data obtained by obtaining the indicated values are stored in the storage unit 14.

In the above process, when it is determined in step S15 that the likelihood is lower than the threshold value, the image data obtained which the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 with low likelihood are obtained. Was stored in the storage unit 14, but the processing is not limited to this. FIG. 4 is a flowchart showing the indicated value estimation method, FIG. 5 is a graph for explaining the similarity, and FIG. 6 is a schematic diagram for explaining the indicated value correction method.

As shown in FIG. 4, in step S21, it is determined whether or not the likelihood s at the indicated value x of the indicating needles 61, 62, 63, 64, 65, 66 is equal to or greater than the first threshold value α1 (for example, 0.8). To do. Here, when the likelihood s is equal to or higher than the first threshold value α1 (Yes), the indicated values x of the indicator needles 61, 62, 63, 64, 65, 66 calculated in step S22 are output. On the other hand, if the likelihood s is lower than the first threshold value α1 (No), it is determined in step S23 whether the likelihood s is equal to or higher than the second threshold value α2 (for example, 0.5). The second threshold value α2 is a value lower than the first threshold value α1.

Here, when the likelihood s is equal to or greater than the second threshold value α2 (Yes), it is determined in step S24 whether the absolute value of the deviation between the indicated value x and the similar value z is equal to or less than the preset deviation threshold value β1. judge. Here, the similarity value z is the most collation probability (similarity) when the image data of the indicator needles 61, 62, 63, 64, 65, 66 photographed and image-processed by the camera 11 is collated with the data for the teacher. It is a high value of degree u). As shown in FIG. 5, for example, as a result of collating the image data of the indicator needles 61, 62, 63, 64, 65, 66 with the data for the teacher, the probability (similarity) when the indicated value (similar value) is z1. Since u) is the highest, this is set as a similar value z.

Then, when the absolute value of the deviation between the indicated value x and the similar value z is the deviation threshold value β1 or less (Yes), the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 calculated in step S25. The correction value F (x, z, s, u) corrected for x is output. Here, a method of correcting the indicated value x will be described. As shown in FIG. 6, when two estimated values a and b (for example, indicated value x and similarity value z) are obtained, correction values are obtained according to the magnitudes of the likelihood s and the constant t (similarity u). F (a, b, s, t) is calculated. Specifically, the indicated value F (a, b, c, d) corrected by the following mathematical formula is calculated.
F (a, b, c, d) = a-{(ab) * d / (c + d)}
Here, a and b are estimated values, and c and d are coefficients. That is, as the correction value F (x, z, s, u) obtained in step S25, the indicated value x and the similarity value z are used for a and b, and the likelihood s and similarity u for c and d. Is used.

On the other hand, in step S25, the absolute value of the deviation between the indicated value x and the similar value z is larger than the deviation threshold β1 (No), and in step S26, the similarity u with respect to the similar value z is the third threshold value α3 (for example,). , 0.5) or more. The third threshold value α3 is preferably the same value as the second threshold value α2, but may be a different value.

Here, when the similarity u is the third threshold value α3 (for example, 0.5) or more (Yes), the deviation between the indicated value x and the similarity value z in step S27 is the previous indicated value (hereinafter, the previous time). It is determined whether the value) y is equal to or less than the deviation between the similar value z. Here, if the deviation between the indicated value x and the similar value z is less than or equal to the deviation between the previous value y and the similar value z (Yes), the indicator needles 61, 62, 63, 64, 65 calculated in step S25. , 66 is corrected and the indicated value F (x, z, s, u) is output. On the other hand, if the deviation between the indicated value x and the similar value z is larger than the deviation between the previous value y and the similar value z (No), the indicator needles 61, 62, 63, 64, 65 calculated in step S28 The correction value F (y, z, t, u) corrected by the indicated value x of 66 is output. t is a constant (set value). The indicated value F (y, z, t, u) is calculated by the above formula, the previous value y and the similarity value z are used for a and b, and the constant t and the similarity u are used for c and d. Is used.

Further, in step S26, when the similarity u is lower than the third threshold value α3 (No), the previous value y is output as an indicated value in step S30. Further, in step S23, when the likelihood s is lower than the second threshold value α2 (No), it is determined in step S29 whether the similarity u is equal to or higher than the fourth threshold value α4 (for example, 0.5). The fourth threshold value α4 is preferably the same value as the second threshold value α2, but may be a different value. Here, when the similarity u is the fourth threshold value α4 or more (Yes), the correction value F (Yes) corrected in the instruction value x of the instruction needles 61, 62, 63, 64, 65, 66 calculated in step S28. , Z, t, u) is output. On the other hand, when the similarity u is lower than the fourth threshold value α4 (No), the previous value y is output as an indicated value in step S30.

As described above, the indicated value reading system of the present embodiment includes a camera 11 capable of photographing the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56, and the camera 11. An image processing device that processes the image data of the indicator needles 61, 62, 63, 64, 65, 66 and obtains the indicated values of the indicator needles 61, 62, 63, 64, 65, 66, which are connected to the camera 11. A transmission device 13 for transmitting data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 obtained by the image processing apparatus 12 is provided.

Therefore, the camera 11 photographs the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56, and the image processing device 12 photographs the indicator needles 61, 62, 63, 64. , 65, 66 is processed to obtain the indicated value of the indicator needles 61, 62, 63, 64, 65, 66, and the transmitting device 13 obtains the indicated value of the indicator needles 61, 62, 63, 64, 65, 66. Send the data of. Here, the data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 transmitted by the transmitting device 13 is a numerical value as digital data, so that it is low-capacity data, and a large-capacity data is transmitted at high speed. No transmitter is required. As a result, the increase in the introduction cost can be suppressed, and the indicated value of the measuring instrument can be easily read.

In the indicated value reading system of the present embodiment, the camera 11 and the image processing device 12 are connected by wire. Therefore, the wireless device is not required and the device can be simplified.

In the instruction value reading system of the present embodiment, the image processing device 12 processes the image data of the instruction needles 61, 62, 63, 64, 65, 66 and of the instruction needles 61, 62, 63, 64, 65, 66. After obtaining the indicated value, the image data of the indicator needles 61, 62, 63, 64, 65, 66 is deleted. Therefore, it is not necessary to store the image data of the indicator needles 61, 62, 63, 64, 65, 66, which is a large amount of data, and the device can be simplified by eliminating the need for a large storage device.

In the indicated value reading system of the present embodiment, the operating ranges and units of the indicator needles 61, 62, 63, 64, 65, 66 are assigned to the measuring instruments 51, 52, 53, 54, 55, 56, and an image is obtained. The processing device 12 processes the image data of the indicator needles 61, 62, 63, 64, 65, 66 to obtain a numerical value as an instruction value of the indicator needles 61, 62, 63, 64, 65, 66. Therefore, the image processing device 12 processes the image data of the indicator needles 61, 62, 63, 64, 65, 66 and easily sets the numerical value as the indicator value of the indicator needles 61, 62, 63, 64, 65, 66. You can ask.

In the instruction value reading system of the present embodiment, a storage unit 14 for storing the instruction values of the instruction needles 61, 62, 63, 64, 65, 66 obtained by the image processing device 12 is provided. Therefore, since the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 obtained by the image processing device 12 are stored in the storage unit 14, even if there is a data transmission failure by the transmitter 13, the indicator needles The data of the indicated values of 61, 62, 63, 64, 65, 66 can be continuously acquired.

In the instruction value reading system of the present embodiment, the image processing device 12 processes the image data of the instruction needles 61, 62, 63, 64, 65, 66 to obtain the instruction needles 61, 62, 63, 64, 65, The indicator needle 61, for which the likelihood at the indicated value of 66 was obtained, and when the likelihood was lower than the preset threshold value, the indicated value of the indicator needles 61, 62, 63, 64, 65, 66 with low likelihood was obtained. The image data of 62, 63, 64, 65, 66 is stored in the storage unit 14. Therefore, it is possible to identify the cause of the low likelihood of the indicated value based on the image data of the indicator needles 61, 62, 63, 64, 65, 66 stored in the storage unit 14.

In the instruction value reading system of the present embodiment, the image processing device 12 obtains the instruction values of the instruction needles 61, 62, 63, 64, 65, 66 at predetermined cycles, and the transmission device 13 obtains the instruction needles at predetermined cycles. The data of the indicated values of 61, 62, 63, 64, 65, 66 is transmitted, and the image recognition unit 12b has the likelihood of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 lower than the threshold value. Occasionally, the transmission device 13 transmits data of the instruction values of the instruction needles 61, 62, 63, 64, 65, 66 previously obtained by the image processing device 12. Therefore, the data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 can be continuously acquired.

In the indicated value reading system of the present embodiment, the image processing device 12 obtains the likelihood s at the indicated value x of the indicator needles 61, 62, 63, 64, 65, 66, and the likelihood s is set in advance. When the threshold value is α1 or more, the data of the indicated value x of the indicator needles 61, 62, 63, 64, 65, 66 is transmitted, while the likelihood s is lower than the first threshold value α1 and equal to or higher than the second threshold value α2. , The indicated value x of the indicating needles 61, 62, 63, 64, 65, 66 is corrected by the similar value z or the previous value y and transmitted. Therefore, the accuracy of the indicated values of the indicating needles 61, 62, 63, 64, 65, 66 to be transmitted can be improved.

In the indicated value reading system according to the embodiment, the image processing apparatus 12 has a likelihood s lower than the first threshold value α1 and equal to or higher than the second threshold value α2, and is indicated by the indicating needles 61, 62, 63, 64, 65, 66. When the absolute value of the value x and the similarity value z is equal to or less than the preset deviation threshold value β1, the indication value x of the indicator needles 61, 62, 63, 64, 65, 66 is corrected by the similarity value z and transmitted. .. Therefore, the accuracy of the indicated value of the indicator needle to be transmitted can be improved.

In the indicated value reading system of the present embodiment, in the image processing device 12, the absolute value of the indicated value x and the similar value z of the indicator needles 61, 62, 63, 64, 65, 66 is higher than the deviation threshold value β1, and the similarity u Is equal to or higher than the third threshold value α3, and the absolute value of the indicated value x and the similar value z of the indicator needles 61, 62, 63, 64, 65, 66 is equal to or less than the absolute value of the previous value y and the similar value z. , The indicated value x of the indicator needles 61, 62, 63, 64, 65, 66 is corrected by the similar value z and transmitted. Therefore, the accuracy of the indicated value of the indicator needle to be transmitted can be improved.

In the indicated value reading system of the present embodiment, in the image processing device 12, the absolute value of the indicated value x and the similar value z of the indicator needles 61, 62, 63, 64, 65, 66 is higher than the deviation threshold value β1, and the degree of similarity is high. When u is equal to or higher than the third threshold value α3, and the absolute value of the indicated value x and the similar value z of the indicator needles 61, 62, 63, 64, 65, 66 is higher than the absolute value of the previous value y and the similar value z. , The indicated value x of the indicator needles 61, 62, 63, 64, 65, 66 is corrected by the previous value y and transmitted. Therefore, the accuracy of the indicated value of the indicator needle to be transmitted can be improved.

In the instruction value reading system of the present embodiment, the camera 11 can photograph the instruction needles 61, 62, 63, 64, 65, 66 of a plurality of measuring instruments 51, 52, 53, 54, and the image processing device 12 , The image data of the plurality of indicator needles 61, 62, 63, 64, 65, 66 taken by the camera 11 is sequentially processed to obtain the indicated values of the indicator needles 61, 62, 63, 64, 65, 66. Therefore, the device can be simplified by eliminating the need for a plurality of cameras 11.

In the indicated value reading system of the present embodiment, the image processing device 12 processes the image data taken by the camera 11 to create the image data of the measuring instruments 51, 52, 53, 54, 55, 56, and the measuring instrument Obtain the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 in the measuring instruments 51, 52, 53, 54, 55, 56 by deep learning the image data of 51, 52, 53, 54, 55, 56. .. Therefore, the indicated values of the highly accurate indicator needles 61, 62, 63, 64, 65, 66 can be quickly obtained.

In the indicated value reading system of the present embodiment, the image processing device 12 is connected to the monitor 16, and the image data of the camera 11 and the measuring instruments 51, 52, 53, 54, 55, 56 processed by the image processing device 12 The image data can be displayed on the monitor 16. Therefore, the operator can check the viewing angle of the camera 11 and the specified measuring instruments 51, 52, 53, 54, 55, 56.

In the instruction value reading system of the present embodiment, the image processing device 12 has the setting data required for processing and the instruction value data of the instruction needles 61, 62, 63, 64, 65, 66 obtained by the image processing device 12. Can be displayed on the monitor 16. Therefore, the operator can confirm the processing content and can easily confirm the processing error.

The instruction value reading method of the present embodiment includes a step of photographing the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56 and the photographed indicator needles 61, 62. , 63, 64, 65, 66 to process the image data to obtain the indicated value of the indicator needles 61, 62, 63, 64, 65, 66, and the indicator needles 61, 62, 63, 64, 65, 66. It has a step of deleting the image data and transmitting the data of the indicated values of the indicated needles 61, 62, 63, 64, 65, 66 obtained. Therefore, the data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 transmitted by the transmitting device 13 is low-capacity data because it is a numerical value as digital data, and the large-capacity data is transmitted at high speed. No equipment is required. As a result, the increase in the introduction cost can be suppressed, and the indicated value of the measuring instrument can be easily read.

The instruction value reading program of this embodiment includes a process of photographing the indicator needles 61, 62, 63, 64, 65, 66 of the measuring instruments 51, 52, 53, 54, 55, 56 and the photographed indicator needles 61, 62. , 63, 64, 65, 66 to process the image data to obtain the indicated value of the indicator needles 61, 62, 63, 64, 65, 66, and the indicator needles 61, 62, 63, 64, 65, 66. The image processing device (computer) 12 is made to execute the process of deleting the image data and transmitting the data of the indicated values of the indicated needles 61, 62, 63, 64, 65, 66 obtained. Therefore, the data of the indicated values of the indicator needles 61, 62, 63, 64, 65, 66 transmitted by the transmitting device 13 is low-capacity data because it is a numerical value as digital data, and the large-capacity data is transmitted at high speed. No equipment is required. As a result, the increase in the introduction cost can be suppressed, and the indicated value of the measuring instrument can be easily read.

In the above-described embodiment, the image processing device 12 processes the image data of the indicator needles 61, 62, 63, 64, 65, 66 taken by the camera 11 at a predetermined cycle to obtain the indicated value, and the transmitting device 13 obtains the indicated value. Is configured to transmit the indicated value data, but is not limited to this configuration. For example, the instruction value reading system 10 may be configured to operate when an operator inputs an operation command to the image processing device 12.

Further, in the above-described embodiment, the instruction values of the indicator needles 61, 62, 63, 64, 65, 66 of the six measuring instruments 51, 52, 53, 54, 55, 56 are obtained. The number of can be any number. Further, the measuring instruments 51, 52, 53, 54, 55, 56 are circular, and the indicator needles 61, 62, 63, 64, 65, 66 are rotatably supported at the center position. It is not limited to. For example, the measuring instrument may be rectangular, and the indicator needle may be slidably supported in a straight line or an arc shape.

10 Indicated value reading system 11 Camera 12 Image processing device 12a Image processing unit 12b Image recognition unit 12c Display creation unit 13 Transmission device 14 Storage unit 15 Operation unit 16 Monitor 17 Power supply unit 20 Monitoring system 21 Control device 22 Receiver device 23 Monitor 31 1 Display 32 2nd Display 33 3rd Display 34 4th Display 51, 52, 53, 54, 55, 56 Measuring Instruments 61, 62, 63, 64, 65, 66 Indicator Needles 71, 72, 73, 74,75,76 Scale 100 Site 200 Management Center

Claims (17)

A camera that can shoot the indicator needle of the measuring instrument,
An image processing device connected to the camera and processing image data of the indicator needle taken by the camera to obtain an instruction value of the indicator needle.
A transmission device that transmits data of the indicated value of the indicator needle obtained by the image processing apparatus, and
An indicated value reading system comprising. The indicated value reading system according to claim 1, wherein the camera and the image processing device are connected by wire. The first or second aspect of the present invention, wherein the image processing apparatus processes the image data of the indicator needle to obtain the indicated value of the indicator needle, and then deletes the image data of the indicator needle. Indicator reading system. An operation range and a unit of the indicator needle are assigned to the measuring instrument, and the image processing device processes the image data of the indicator needle to obtain a numerical value as an instruction value of the indicator needle. The indicated value reading system according to any one of claims 1 to 3. The instruction value reading system according to any one of claims 1 to 4, wherein a storage unit for storing the instruction value of the instruction needle obtained by the image processing device is provided. The image processing device obtains the likelihood of the indicated value of the indicator needle obtained by processing the image data of the indicator needle, and when the likelihood is lower than a preset threshold value, the image data of the indicator needle is obtained. The indicated value reading system according to claim 5, wherein the data is stored in the storage unit. The image processing device obtains the indicated value of the indicator needle at a predetermined processing cycle, and the transmitting device transmits data of the indicated value of the indicator needle at a predetermined transmission cycle, and the likelihood is high. The instruction value reading system according to claim 6, wherein when the threshold value is lower than the threshold value, the transmission device transmits data of the instruction value of the instruction needle previously obtained by the image processing device. The image processing device obtains the likelihood of the indicated value of the indicator needle obtained by processing the image data of the indicator needle, and when the likelihood is equal to or higher than a preset first threshold value, the indicator needle When the indicated value data is transmitted by the transmitting device and the likelihood is lower than the first threshold value and greater than or equal to the second threshold value smaller than the first threshold value, the indicated value of the indicated needle is set to a similar value for image matching. The indicated value reading system according to any one of claims 1 to 5, wherein the data is corrected by the previous value and transmitted by the transmitting device. In the image processing apparatus, the likelihood is lower than the first threshold value and equal to or higher than the second threshold value, and the absolute value of the difference between the indicated value of the indicating needle and the similar value is equal to or less than a preset deviation threshold value. The instruction value reading system according to claim 8, wherein if there is, the instruction value of the instruction needle is corrected by the similar value and transmitted by the transmission device. In the image processing device, the absolute value of the difference between the indicated value of the indicating needle and the similar value is higher than the deviation threshold value, the similarity of the similar values is equal to or higher than the third threshold value, and the indicated value of the indicating needle When the absolute value of the difference from the similar value is equal to or less than the absolute value of the difference between the previous value and the similar value, the indicated value of the indicating needle is corrected by the similar value and transmitted by the transmitting device. The indicated value reading system according to claim 9. In the image processing apparatus, the absolute value of the difference between the indicated value of the indicating needle and the similar value is higher than the deviation threshold value, the similarity of the similar values is equal to or higher than the third threshold value, and the indicated value of the indicating needle When the absolute value of the difference from the similar value is higher than the absolute value of the difference between the previous value and the similar value, the indicated value of the indicating needle is corrected by the previous value and transmitted by the transmitting device. The indicated value reading system according to claim 9 or 10. The camera can take a picture of a plurality of indicator needles of the measuring instrument, and the image processing device sequentially processes image data of the plurality of the indicator needles taken by the camera to obtain an instruction value of the indicator needle. The indicated value reading system according to any one of claims 1 to 11, characterized in that. The image processing device creates image data of the measuring instrument by image processing the image data taken by the camera, and obtains the indicated value of the indicating needle in the measuring instrument by deep learning of the image data of the measuring instrument. The indicated value reading system according to any one of claims 1 to 12, characterized in that. The image processing device is characterized in that a monitor can be connected and the image data of the camera and the image data of the measuring instrument processed by the image processing device can be displayed on the monitor. The indicated value reading system according to any one of claims 13. The 14th aspect of the present invention, wherein the image processing apparatus can display the setting data required for processing and the data of the indicated value of the indicating needle obtained by the image processing apparatus on the monitor. Indicator reading system. The process of photographing the indicator needle of the measuring instrument and
A process of processing the captured image data of the indicator needle to obtain an indicated value of the indicator needle, and
A step of deleting the image data of the indicator needle and transmitting the obtained indicated value data of the indicator needle, and
A method for reading an indicated value, which comprises. The process of photographing the indicator needle of the measuring instrument and
Processing to obtain the indicated value of the indicator needle by processing the captured image data of the indicator needle, and
A process of deleting the image data of the indicator needle and transmitting the obtained indicated value data of the indicator needle, and
An instruction value reading program characterized by having a computer execute.

Images