WO2017057780A1

WO2017057780A1 - Data collection device, method, and program for display panel or control panel

Info

Publication number: WO2017057780A1
Application number: PCT/JP2016/079878
Authority: WO
Inventors: 英志只野
Original assignee: 株式会社ソフィックス
Priority date: 2015-09-30
Filing date: 2016-09-30
Publication date: 2017-04-06
Also published as: JP2017069963A

Abstract

The purpose of the present invention is to allow a variety of displays that are displayed on the control panel or display panel of conventional equipment lacking in digital information acquisition functions or network connection functions, and that are verified only visually in the prior art, to be acquired as digital data with minimal modifications to the equipment, and to be transmitted to the Internet of Things. To achieve this purpose, the control panel (10) of a conventional machine tool (1) is retrofitted with a digital camera (20) for forming an image of the control panel (10), an image of the control panel (10) is formed by the digital camera (20), the image obtained by the digital camera (20) is analyzed and converted to data by an image analysis processor (2) to which the digital camera (20) is connected, and the current value is acquired.

Description

Data collection device, method and program for display panel and operation panel

The present invention relates to a data collection apparatus, method and program for a display panel and an operation panel that can monitor in real time various types of old machines that do not have a network connection function.

In recent years, the so-called Internet of Things (IoT), in which various machines are connected to the Internet to collect and analyze a large amount of information, has become widespread. The Internet serves as an information transmission path for all things to communicate, and this makes it possible to collect enormous digital information from various sensors and measuring instruments provided in machinery. For example, in a plant monitoring apparatus, numerical data such as voltage and current displayed on a display panel or operation panel is transmitted through an information transmission path.
In addition to this, video of the monitoring area on the display panel or operation panel is transmitted as it is, and the display panel or operation panel is visually confirmed and confirmed.

However, in order to convert the operating status into data, the function of separately acquiring numerical data such as voltage and current displayed on the display panel and operation panel and transmitting this numerical data has not been built into the device from the beginning. Must not. Therefore, it is impossible to connect these to the Internet of Things in old-style plant monitoring devices, old-style production lines, old-fashioned machine tools, etc. that do not have numerical information acquisition functions and network connection functions. .
On the other hand, if the video on the display panel or operation panel is simply checked as it is, the video cannot be used further.
In view of this, the present invention provides various displays displayed on the display panel and operation panel of old-style devices that do not have a numerical information acquisition function and a network connection function. It is an object to make it possible to obtain digital data without changing as much as possible.

Therefore, as a result of earnest research, the present inventor obtained the idea that it is only necessary to acquire the current values of voltage, current, etc., from the images taken from the outside of the display panels and operation panels of old-style devices. .
That is, a digital camera for photographing a photographing object such as a display panel or an operation panel of a machine tool or the like is installed, and the photographing object is photographed by the digital camera, and an image analysis processing device converts the image of the digital camera. Analyze the data and convert it into data to get the current value. In terms of the display panel and operation panel of the old-style devices, the digital camera is installed outside the device, and there is no electrical connection relationship between them. Therefore, the present invention may be applied to any apparatus. Further, by providing the image analysis processing device, it is possible to extract numerical data from the image of the external camera. In this respect, an unprecedented feature of the present invention is recognized.
As described above, an old-style machine tool or the like is photographed by a camera that can be retrofitted with digital processing, and an image of the camera is applied to an image analysis processing device to obtain the current value. This is connected to a network such as the Internet so that the current value obtained from the image analysis processing device can be remotely monitored and processed from a PC, a tablet personal computer, a smartphone or the like. It should be noted that an image photographed by this digital camera can be designed so that it can be handled by the image analysis processing apparatus, whether it is a still image or a moving image.
The digital camera and the image analysis processing apparatus are connected by wire or wirelessly. The image analysis processing apparatus can be connected to the Internet by itself or connected to the Internet via Ethernet. When there are multiple digital cameras, these can be designed to be processed by a single image analysis processing device, or can be designed so that one image analysis processing device is assigned to each camera. is there. In the latter case, it is possible to connect to the Internet via an information collection management server that integrates numerical data obtained from a plurality of image analysis processing devices. That is, for example, digital cameras and image analysis processing devices scattered in a factory are managed under the server.
In analyzing the image of the camera by the image analysis processing device, it is preferable that the brightness of the image can be automatically corrected. In the case of various meters having pointers, processing is performed such that the background such as the scale is erased and only the pointers are left, or the bright part, dark part, dirt, etc. of the background are binarized by adaptive threshold processing. For the knobs on the operation panel, color clustering processing is performed, and the outline of the arrow is extracted by binarization. In addition, in the case where ON / OFF is indicated by lighting / extinguishing of the lamp, a threshold value is provided based on a color, in particular, a luminance value, and a state where the brightness is above a certain level is regarded as the ON state.
Preferably, a reference image is registered in advance for each of the CRT, meter, knob, and lamp collected on the operation panel surface, and the current value is obtained by comparing the captured image with the reference image every time the camera is used for shooting. Like that. It is better to perform the above correction for this comparison.
Next, when the image of the digital camera is a character display screen of a display such as a CRT or a liquid crystal, the character recognition processing unit of the image analysis processing device performs optical character recognition processing of the display image to obtain character information as a current value. I can do it. The present invention is applicable not only to numerical values such as voltage and current displayed on the display panel and operation panel of old-style devices but also to characters displayed on the display of old-style devices. The character information is character data.
Next, when a geometric distortion is generated in the image of the digital camera, the current value can be acquired by correcting the geometric distortion of the image by the geometric distortion correction processing means of the image analysis processing device. For example, considering the installation position of the digital camera in consideration of the operator sitting or standing in front of the display panel or operation panel, the digital camera can be directly facing the object to be photographed so as not to interfere with this work. There may be no. In such a case, geometric distortion occurs in the image of the digital camera. This is corrected by the geometric distortion correction processing means of the image analysis processing device, and the current value is acquired by the image analysis processing device after correcting the image as if the subject was shot from the front. is there.
If the position of the digital camera is set to be taken from the diagonal direction, shifted in the horizontal or vertical direction from the front of the display panel or operation panel, trapezoidal distortion will occur as geometric distortion of the image. It becomes. In such a case, the geometric distortion correction processing means may be an image correction processing unit that performs trapezoidal correction of an image.
Similarly, when a trapezoidal distortion is generated as a geometric distortion, the geometric distortion correction processing means can be an optical lens provided in the optical system of the digital camera so that the posture can be controlled. In this case, if the lens itself is appropriately distorted in accordance with the displacement of the digital camera, it is possible to refract the light passing through the lens and obtain a square image in which the trapezoidal distortion is corrected. In addition, you may design so that the attitude | position of an optical lens can be adjusted.
The geometric distortion includes spherical distortion caused by taking a picture through a fisheye lens or a spherical mirror, and the spherical distortion of an image caused by the distortion may be appropriately corrected. Since the mechanism itself for correcting such geometric distortion is a general technique, it will be omitted in order to avoid complicated description.
Next, when the image analysis processing apparatus captures a specific change in the image, the image at the time of the change or a specific image related to the change is captured by another digital camera. Then, it is possible to perform a process of cutting out from that portion by going back a predetermined time before the time when the change occurred. The digital camera takes a picture of a subject such as a display panel or an operation panel of a machine tool or the like. For this reason, for example, when a red error lamp is lit on the display panel or the operation panel, and a character string such as “opening error” is displayed on the CRT, the image analysis processing apparatus will detect this change if determined in advance. It can be seen as a specific change. In this case, if an error operation is performed on the display panel or operation panel, the image analysis processing device will generate an error if the error lamp is turned on on the same display panel or operation panel. At the same time, it is possible to capture an erroneous operation performed on the display panel or the operation panel as an image.
On the other hand, even if an error lamp is turned on, for example, on the display panel or the operation panel, there may be a case where a predetermined event occurs in a place that does not appear in the digital camera. In this case, a digital camera other than the above digital camera may be installed and photographed. Therefore, another digital camera can be installed in a separate room or in a separate building, and can be freely designed as necessary.
Such an image for retroactive reproduction may be recorded in a storage device. Moreover, the following can be realized by introducing such a mechanism. For example, in a machine tool, even when the procedure for opening the door after pressing the stop button when accessing the inside of the machine is strictly determined, the door can be opened without pressing the stop button. It can happen to open. In such a case, if you know where you made a mistake and why you made such a mistake, you can easily take necessary measures. Therefore, if the image analysis processing apparatus holds the photographed image and captures a change such as lighting of the red error lamp at a predetermined position, for example, 30 seconds or 1 minute from the lighting time. The time required for the situation at the site is determined, and the time is traced back to that time, and the image from the time of going back to the above-mentioned lighting or the further image is recorded in the storage unit.
Next, the image analysis processing apparatus may reduce the number of frames attached to an image cut out from a portion that is a predetermined time before the time when the change occurs. In other words, the number of frames is reduced and played back, or a moving image with a reduced number of frames is generated and recorded in the storage device. Digital cameras can take still images and moving images, but in the case of moving images, for example, 30 seconds are held back from the time when the specific change occurred. There are cases where it is said that it is inefficient in terms of time if it is checked by reproducing this 30 seconds as it is for identification. Therefore, efficiency can be improved by checking by reducing the number of frames and playing back, or by checking later what was recorded in the storage device as a moving image with the reduced number of frames. For example, if the digital camera is designed to capture 30 frames per second, the number of frames is reduced to 1/30 frames per second. It should be noted that the intervals of the frames remaining in this reduction process may be equal intervals, or may be, for example, unequal intervals such that the intervals become narrower as the error occurs. Such a thing can be designed arbitrarily.
In the above description, the lighting of the red error lamp and the display of the “opening error” of the CRT are raised according to a specific change, but the present invention is not particularly limited thereto. These are data that can be handled by the digital camera and the image analysis processing device. In addition, a microphone for picking up an alarm sound of a speaker, a temperature sensor for monitoring a temperature change, and data from these By providing an analysis processing device, a wider range of errors can be handled.
The data collection method for the display panel and operation panel can be provided as a program for causing a computer to execute the method.

In the present invention, a digital camera for photographing a photographing object such as a display panel is installed, the photographing object is photographed by the digital camera, the photographed image is analyzed by the image analysis processing device, and converted into data, and the current value is obtained. It is characterized in that This allows computer processing to display numerical values such as character display and voltage and current that were displayed on the display panel and operation panel of older devices that do not have numerical information acquisition function or network connection function. It became easy to obtain as possible digital data. The current value acquired in this way can be transmitted to the network.

FIG. 1 is an explanatory diagram schematically illustrating a system according to the first embodiment.
FIG. 2 is an explanatory diagram illustrating the image analysis processing apparatus according to the first embodiment in a block diagram.
FIG. 3 is an explanatory diagram schematically illustrating the operation panel according to the first embodiment.
FIG. 4 is an explanatory diagram illustrating processing steps at the time of initial setting according to the first embodiment.
FIG. 5 is an explanatory diagram illustrating processing steps of the image analysis processing apparatus according to the first embodiment.
FIG. 6 is an explanatory diagram illustrating processing steps of the information collection management server according to the first embodiment.
FIG. 7 is an explanatory diagram showing data obtained by the image analysis processing of the first embodiment.
FIG. 8 is an explanatory diagram illustrating character recognition processing steps according to the second embodiment.
FIG. 9 is an explanatory diagram schematically illustrating the trapezoid correction process according to the third embodiment.
FIG. 10 is an explanatory diagram illustrating processing steps for keystone correction according to the third embodiment.
FIG. 11 is an explanatory diagram schematically illustrating the trapezoidal correction process according to the fourth embodiment.
FIG. 12 is an explanatory diagram illustrating processing steps of meter pointer extraction correction according to the fifth embodiment.
FIG. 13 is an explanatory diagram illustrating processing steps of retroactive reproduction according to the sixth embodiment.
FIG. 14 is an explanatory diagram illustrating processing steps of retroactive reproduction according to the seventh embodiment.

Hereinafter, seven embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to these embodiments. It is possible to design freely within the scope of the idea of the present invention, and these are also within the scope of the right of the present invention.

This embodiment will be described with reference to FIGS. In the data collection system of this embodiment, as shown in the schematic diagram of FIG. 1, an operation panel 10 of an old-style machine tool 1 having no network connection function is replaced with an operation panel 10 by a digital camera 20 that can be retrofitted with digital processing. A moving image is acquired by shooting from diagonally above. This moving image is analyzed by the image analysis processing device 2 to which the digital camera 20 is connected to obtain various digital data represented in the data table 5 of FIG. A plurality of such image analysis processing apparatuses 2 connected to the digital camera 20 are connected to the information collection management server 3 via the Ethernet 30. The data table 5 is stored in the information collection management server 3, and various digital data are disclosed on the information collection management server 3 so as to be browsed over the Internet N from the smartphone S or the like. The digital camera 22 and the display 23 will be described later.
In the image analysis processing apparatus 2, various programs necessary for image analysis processing are installed on a general PC from a CD-ROM 21 (which is a recording medium) via a CD-DVD drive (not shown). That is, in addition to the operating system, the image analysis processing apparatus 2 has an image shooting program for operating the digital camera 20, an image analysis processing program for converting the image of the digital camera 20 into data, and acquiring a current value. A data transmission program for transmitting the analysis result digital data to the Ethernet 30 is recorded. The hard disk is also provided with a comparative image information storage unit that records images serving as reference images for the CRT, meter, and lamp of the operation panel 10. The image analysis processing device 4 shown in FIG. 2 is realized by operating these programs on the CPU. That is, the image analysis processing device 4 includes an image capturing unit 40, an image analysis processing unit 41, a comparison information storage unit 42, and a data transmission unit 43. A required storage unit can be provided on the hard disk. The image photographing unit 44 and the image display unit 45 will be described later.
Now, FIG. 3 schematically shows the operation panel 10 of the old machine tool 1 having no network connection function. A is a CRT character display area, B1 to B4 are lamp ON / OFF display areas, and C1 and C2 are meter indication areas. D1 is an ON / OFF display area of an error display lamp described in the sixth embodiment and thereafter. A retrofitting digital camera 20 for photographing from an oblique upper side is installed on the operation panel 10, and first, a reference image is photographed and registered as an initial setting, and an area and its attributes are set. This will be described with reference to the processing flow of FIG. The image analysis processing unit 41 captures the operation panel 10 with the digital camera 20 (step S1), registers the captured image as a reference image (step S2), and turns on the character display area A in the captured image and the ON. / OFF display areas B1, B2, B3, B4 and meter instruction areas C1, C2 are set as monitoring areas (step S3), and attributes are set for each monitoring area (step S4). For the attribute setting, character recognition processing is performed for the character display area A, light / dark threshold processing is performed for the ON / OFF display area B, and background removal processing is performed for the meter instruction area C. This is to specify the type of information to be acquired. Each display area in FIG. 3 schematically shows a display example in the normal operation, not in the initial setting. That is, the G code is displayed in the character display area A, the lamps are lit in B1 and B3 in the ON / OFF display area, and the meter indication area C is in a state indicating different scales in C1 and C2. ing.
Next, it will be described with reference to FIGS. 5 and 6 in connection with the stage of collecting and operating digital data with this data collection system. At a predetermined time, the operation panel 10 of the old machine tool 1 is photographed with the digital camera 20 to obtain a digital image (step S5), and the image analysis processing unit 41 compares the photographed image with the registered reference image. A monitoring area is cut out from the image, and an appropriate correction process is performed on the image of each monitoring area (step S6). As described above, the brightness of the image is corrected in the character display area A, and the background removal process is performed in the meter instruction area C. Following this correction processing, the image analysis processing unit 41 analyzes each monitoring area and acquires each digital data (step S7). That is, character recognition processing is performed for the character display area A, threshold processing is performed by color (HSV) in the ON / OFF display area B, and a line segment of a certain length or more is extracted for the meter indication area C and its inclination Try to measure the corners. Following this analysis processing, these digital data are recorded on the hard disk and uploaded to the information collection management server 3 via the Ethernet 30 (step S8). Step S5 does not represent a step following step S4.
Then, the information collection management server 3 collects the digital data from each image analysis processing device 2 (step S9), registers these in a database (not shown) (step S10), and makes these as browsing data. Processing is performed (step S11). An example of the browsing data is shown in the data table 5 of FIG. The type item indicates the monitoring areas A, B1, B2, B3, B4, C1, C2, and D1, and the name item is the type of information to be acquired. The recognition term displays whether or not image analysis processing is possible in each monitoring area, and the acquired digital data is displayed in the status term. These represent the current values of the image analysis processing apparatus 2, and the data table 5 is disclosed on the WWW in this embodiment only to authorized personnel.

This embodiment will be described with reference to FIG. 8. This embodiment relates to the character recognition processing in the monitoring area A in FIG. The operation panel 10 is photographed by the digital camera 20 to obtain a digital image (step S12). The image analysis processing unit 41 cuts out the CRT area, that is, the monitoring area A from this captured image (step S13). A character recognition process is performed on the image in this area to acquire character data, and a keyword is acquired through a morphological analysis process of the character data (step S14). Character data and keywords are uploaded to the information collection management server 3 (step S15). Character data and keywords will later be used for big data.

This embodiment will be described with reference to FIGS. This embodiment relates to trapezoid correction processing. In the above-described first embodiment, the retrofitting digital camera 20 for photographing from the oblique upper side with respect to the operation panel 10 is installed. The photographed image a that has trapezoidal distortion as a geometric distortion as shown in FIG. 9 with respect to the square area A when the operation panel 10 is photographed from the front is caused by photographing from obliquely above. It has become. Therefore, it is desirable to perform character recognition processing after correcting this to a square image.
Therefore, in this embodiment, the following processing is performed. That is, the image analysis processing unit 41 obtains a digital image of the operation panel 10 that can be processed by a computer and is photographed by a digital camera (step S16). Since this captured image is distorted, a keystone correction process is performed (step S17). The CRT area, that is, the monitoring area A is cut out from the image after the keystone correction process (step S18). Character data that can be handled by a computer is obtained by performing character recognition processing in this monitoring area A (step S19). In addition, using the digital camera having the same correction processing function as the above in the digital camera itself, the above correction processing is performed in the digital camera, and the processing after the surveillance area is cut out is executed using the result. You may design.

Although this embodiment will be described with reference to FIG. 11, the geometric distortion processing in the third embodiment is executed in a computer, whereas in this embodiment, a motor-driven optical lens (not shown) is attached to the optical axis. It is characterized in that a process for correcting geometric distortion is performed by controlling the posture.
The operation panel 10 is photographed with a digital camera to obtain a digital image (step S20). The image analysis processing unit 41 determines whether or not the captured image is distorted by comparing the captured image with the registered reference image (step S21). If the distortion is within the allowable range, the CRT area, that is, the monitoring area A is cut out from the captured image (step S22). Character data is acquired by performing the character recognition processing of the monitoring area A (step S23). On the other hand, when it is determined that the distortion is out of the allowable range, for example, as shown in FIG. 9, when a trapezoidal distortion such as the photographed image a occurs, the square shape when the operation panel 10 is photographed from the front is shown. The captured image is corrected so as to be in area A. In this correction process, a required correction amount is determined, and the electric motor is operated to change the position of the optical lens (step S24). In this way, after correcting the attitude of the optical lens, the operation panel 10 is photographed to obtain a digital image (step S20). The above routine is repeated until the distortion falls within the allowable range.

This embodiment will be described with reference to FIG. In this embodiment, meter pointer extraction correction processing is performed for various meters having pointers, leaving background such as scales and leaving only the pointers in the image. The operation panel 10 is photographed with a camera to obtain a digital image, and the image analysis processing unit 41 cuts out the meter instruction areas C1 and C2 (step S25). Each line segment having a certain length or less is determined as a scale, and a correction process is performed for detecting the line segment having a certain length or more as a meter pointer (step S26). The angle data of the meter pointer detected in this way is acquired (step S27).

This embodiment will be described with reference to FIG. In this embodiment, in addition to the digital camera 20 that captures a digital image by photographing the operation panel 10 raised in the first embodiment, a different part of the machine tool 1 is photographed and monitored from a position different from the digital camera 20. The digital camera 22 which acquires an image, and the display 23 which displays this monitoring image are provided. In this embodiment, in addition to the image photographing unit 40, the image analysis processing unit 41, the comparison information storage unit 42, and the data transmitting unit 43 which are raised in the first embodiment, the image photographing unit 44 And an image display unit 45. The image capturing unit 40 controls the digital camera 20 to capture the image, whereas the image capturing unit 44 controls the digital camera 22 to capture a monitoring image. There may be a design in which the image capturing unit 40 and the image capturing unit 44 are combined. The hard disk can be provided with a required storage unit. The image display unit 45 can display the monitor image of the digital camera 22 on the display 23.
The image analysis processing unit 41 acquires a digital image of the operation panel 10 photographed by the digital camera 20, cuts out a monitoring area from the photographed image in comparison with a registered reference image, and images of the respective monitoring areas. After performing an appropriate correction process, the necessary digital data is collected. Of these, an important point in this embodiment is that threshold processing based on color (HSV) is performed in the ON / OFF display area D1, and digital data that D1 is turned on as a result of this analysis processing is obtained. Executes the processing step of retroactive reproduction shown in FIG. By the way, the digital camera 22 monitors a door (not shown) of a machine tool from a position different from the digital camera 20, and sequentially records and erases the monitoring image in the first-in first-out form on the standard hard disk. is doing.
Therefore, when D1 is turned on as described above (step S28), the image analysis processing unit 41 uses this as a trigger to control the digital camera 22 to shoot and temporarily record it on the hard disk. The monitoring image around the door is attached and acquired from the hard disk (step S29). An image is cut out from the time when D1 is turned on to a past time point 15 seconds later (step S30). The cut image is stored in the hard disk so that the image display unit 45 can display it on the display 23 (step S31). By watching the surveillance image cut back to the past with the eyes of the supervisor, it is possible to observe and confirm the actual situation at the site. Note that this monitoring image can be uploaded to the information collection management server 3 via the Ethernet 30. The setting of 15 seconds described above can be changed as appropriate.

Next, this embodiment will be described with reference to FIG. If D1 is turned on (step S32), using this as a trigger, the image analysis processing unit 41 acquires a monitoring image around the door that has been temporarily recorded on the hard disk (step S33). Then, the monitoring image from the time when D1 is turned ON to the time point that is back by 15 seconds is cut out (step S34). This cut-out image is composed of 30 frames per second, and one frame is taken out every 15 seconds from the 15-second image so that it becomes 1 frame per second. The remaining 29 frames following one frame are thinned out, and the whole is reduced to 1/15 of 15 frames (step S35). The reduced image is recorded on the hard disk so as to be displayed on the display 23 by the image display unit 45 (step S36). It has been found that the reproduction of the surveillance image cut back to the past, that is, the retro-reproduction, seems to see a so-called flip book, but is often sufficient to confirm the cause of the error.

The present invention can also be used, for example, to make the subject to be photographed a whiteboard so that data that changes from moment to moment can be handwritten on the whiteboard by an operator. It can also be applied to cameras such as robots designed to be movable in the factory. There is a possibility of using this invention even in ordinary households. These are also within the scope of the present invention.

1: Machine tool 10: Operation panel 2: Image analysis processing device 20: Digital camera 21: CD-ROM
22: Digital camera 23: Display 3: Information collection management server 30: Ethernet 4: Image analysis processing device 40: Image photographing unit 41: Image analysis processing unit 42: Comparison information storage unit 43: Data transmission unit 44: Image photographing unit 45 : Image display section 5: Data table

Claims

It consists of a digital camera installed toward the object to be imaged and an image analysis processing device that converts the image of this digital camera into data and obtains the current value, and the image analysis processing device performs character recognition processing of the image and A data collection device for a display panel or operation panel, comprising a character recognition processing unit for obtaining character information as a value.
The display panel or operation panel data collection device according to claim 1, wherein the digital camera or the image analysis processing device further includes geometric distortion correction processing means for correcting geometric distortion of the image.
3. The data collection device for a display panel or operation panel according to claim 2, wherein the geometric distortion is a trapezoidal distortion, and the geometric distortion correction processing means is an image correction processing unit that performs a keystone correction of the image.
The data collection of the display panel and operation panel according to claim 2, wherein the geometric distortion is a trapezoidal distortion, and the geometric distortion correction processing means is an optical lens provided in the optical system of the digital camera so as to be capable of posture control. apparatus.
A digital camera installed toward a subject to be imaged, and an image analysis processing device that obtains a current value by converting an image of the digital camera into data, and the digital camera or the image analysis processing device has a geometric distortion of the image A data collection device for a display panel or operation panel, comprising geometric distortion correction processing means for correcting the above.
6. The data collection device for a display panel or operation panel according to claim 5, wherein the geometric distortion is a trapezoidal distortion, and the geometric distortion correction processing means is an image correction processing unit that performs a keystone correction of the image.
6. The data collection of the display panel and operation panel according to claim 5, wherein the geometric distortion is a trapezoidal distortion, and the geometric distortion correction processing means is an optical lens provided in the optical system of the digital camera so as to be capable of posture control. apparatus.
When the image analysis processing device captures a specific change in the image, the image analysis processing device attaches the image when the change occurs or a monitoring image obtained by capturing a specific portion related to the change with another digital camera. 6. The data collection device for a display panel or operation panel according to claim 5, wherein a process of cutting out from a portion that is a predetermined time before the time when the change occurs is performed.
9. The display panel or operation panel according to claim 8, wherein the image analysis processing device subtracts the number of frames from an image cut out from a portion that is a predetermined time before the time when the change occurs. Data collection device.
A character recognition processing unit is provided, and character recognition processing is performed on the corrected image after the image is corrected by the geometric distortion correction processing means to obtain character information as a current value. 9. A data collection device for a display panel or operation panel according to any one of 9 above.
A digital camera for photographing the photographing object is installed, the step of photographing the photographing object with the digital camera, and the character recognition processing of the photographed image is performed by the character recognition processing unit of the image analysis processing device to obtain data. And obtaining character information as a current value, and a method for collecting data on a display panel and an operation panel.
The digital camera or the image analysis processing device further includes a geometric distortion correction processing unit, and includes correcting the geometric distortion of the photographed image by the geometric distortion correction processing unit. The data collection method of the display panel and operation panel as described in 11.
13. The data collection method for a display panel and an operation panel according to claim 12, wherein the geometric distortion is a trapezoidal distortion and includes a step of performing a keystone correction by the image correction processing unit as the geometric distortion correction processing means.
The display panel according to claim 12, wherein the geometric distortion is a trapezoidal distortion, and includes a step of performing a keystone correction by controlling an attitude of an optical lens provided in an optical system of the digital camera as the geometric distortion correction processing unit. And data collection method for operation panels.
Including a step of photographing the photographing target with a digital camera installed toward the photographing target, and an image analysis processing step of obtaining an actual value by converting an image of the digital camera into data, or the step of photographing with the digital camera The image analysis processing step is a data collection method for a display panel or an operation panel, including geometric distortion correction processing for correcting geometric distortion of the image.
16. The data collection method for a display panel and an operation panel according to claim 15, wherein the geometric distortion is a trapezoidal distortion, and the image correction processing unit as the geometric distortion correction processing means performs a keystone correction.
The display panel according to claim 15, wherein the geometric distortion is a trapezoidal distortion, and includes a step of performing a keystone correction by controlling an attitude of an optical lens provided in an optical system of the digital camera as the geometric distortion correction processing unit. And data collection method for operation panels.
In the image analysis processing step, when a specific change is captured in the image, the image at the time of the change or a specific portion related to the change is attached to a monitoring image taken by another digital camera. The data collection method for a display panel or operation panel according to claim 15, further comprising a step of cutting out from a portion that is a predetermined time before the time at which the change occurred.
19. The display panel or operation panel according to claim 18, wherein the image analysis processing step includes a step of reducing the number of frames attached to an image cut out from a portion that is a predetermined time before the time when the change occurs. Data collection method.
20. The method according to claim 15, further comprising a step of performing a character recognition process in a character recognition processing unit on a corrected image after the image is corrected by the geometric distortion correction processing unit. Data collection method for the display panel and operation panel described in 1.
A program for causing a computer to execute the data collection method for the display panel or operation panel according to any one of claims 11 to 20.