JP5831069B2 - Program, information processing apparatus and abnormality determination method - Google Patents

Description

  The present invention relates to a program, an information processing apparatus, and an abnormality determination method for processing an image obtained by capturing values represented by a plurality of segments.

  Conventionally, there is a display method called 7-segment display that represents a single-digit number with seven line segments, like a display unit of a calculator. Each line segment is also called a segment. For example, there is a device such as a radiation dosimeter that does not have an interface that only displays a measurement value in seven segments and outputs the measurement value as a digital value.

  On the other hand, if the value displayed in 7 segments can be acquired and output as a digital value, the digital value can be used in a subsequent system, and convenience is improved. In view of this, research has been conducted on a technique for acquiring a number represented by 7 segments as a digital value.

  For example, based on a captured image obtained by capturing a segment structure print pattern, based on the relative relationship of the brightness state of each segment corresponding to a character pattern assumed in advance, a technique for determining whether or not the print is good or bad by determining a match / mismatch There is.

  A technique for determining the presence / absence of black pixels at a plurality of positions in one segment from an image read by a scanner, and determining the presence / absence of a line segment in the segment in consideration of at which position black pixels are present There is.

JP 2000-339472 A Japanese Patent Laid-Open No. 2-91789

  Liquid crystal is generally used for the display area of the 7-segment display. Due to the characteristics of the liquid crystal, when the display is switched from one character to another, both characters are temporarily overlapped.

  This principle is as follows. By applying a voltage to the liquid crystal and changing the direction of the liquid crystal, the light from the backlight is transmitted through or blocked by the display surface. When the first character is displayed, the voltage is applied to the segment portion forming the first character. Further, when the display is switched from the first character to the second character, the voltage application to the segment of the first character is stopped and the voltage is applied to the segment part forming the second character.

  The orientation of the liquid crystal molecules gradually changes between the segment where the voltage application is stopped and the segment where the voltage application is applied, depending on the properties of the liquid crystal. In some liquid crystal display methods, a voltage is applied to a portion that is not illuminated.

  Here, in the 7-segment display, in the state of switching between two characters, the displayed combination of ON segments does not make sense. Since this segment combination does not exist in the dictionary that holds the pattern representing the characters of the segment, it is determined as an error.

  In addition, as another case indicating an error, when a combination of segments indicates an error code indicating a failure of a 7-segment display, the combination of segments is a combination of segments that do not exist in the dictionary and is determined to be an error. Is done.

  Regarding the two states described above, a character switching state and a state indicating an error code should be distinguished from each other.

  However, the conventional technique has a problem that these two states cannot be determined, and an abnormal state cannot be appropriately determined.

  Therefore, it is an object of the disclosed technology to provide a program, an information processing apparatus, and an abnormality determination method that can appropriately determine an abnormal state.

  The program according to one aspect of the disclosure extracts each segment in which at least one of the values represented by using a plurality of segments is ON from each image captured every predetermined time, and the extracted each segment , Comparing with a dictionary including a combination of segments stored in advance in the storage unit, measuring the time when a combination of segments that do not exist in the dictionary is extracted, and by comparing the measured time with a predetermined value, Causes the computer to execute processing for determining whether the value is switched or a failure.

  According to the disclosed technology, an abnormal state can be appropriately determined.

FIG. 2 is a block diagram illustrating an example of hardware of the information processing apparatus according to the first embodiment. FIG. 2 is a block diagram illustrating an example of functions of the information processing apparatus according to the first embodiment. FIG. 3 is a block diagram illustrating an example of a function of a segment extraction unit according to the first embodiment. The figure which shows an example of an area | region image. The figure for demonstrating each segment and a closed region. The figure which shows the example which divides | segments the area | region A into a partial area. The figure which shows an example of the partial image which imaged the number displayed by 7 segments in the dark environment. The figure which shows the measured value of the partial image shown in FIG. The figure which shows an example of the partial image which imaged the number displayed by 7 segments in the bright environment. The figure which shows the measured value of the partial image shown in FIG. The figure which shows an example of ON / OFF of each segment. The figure which shows an example of a segment dictionary. The figure which shows an example of luminance value abnormality. The figure which shows an example of the change of a luminance value. The figure for demonstrating abnormality determination. 3 is a flowchart illustrating an example of processing of the information processing apparatus according to the first embodiment. The flowchart which shows an example of the segment extraction process of S106. The flowchart which shows an example of the dictionary comparison process of S108. FIG. 10 is a block diagram illustrating an example of a function of a segment extraction unit according to the second embodiment. The figure which shows the threshold value used for determining the luminance value abnormality for every segment. The figure for demonstrating the brightness | luminance difference at the time of ON / OFF of a segment. 9 is a flowchart illustrating an example of processing of an information processing device according to a second embodiment.

  Each embodiment will be described below with reference to the accompanying drawings.

[Example 1]
<Hardware>
FIG. 1 is a block diagram illustrating an example of hardware of the information processing apparatus 10 according to the first embodiment. In the example illustrated in FIG. 1, the information processing apparatus 10 is connected to an imaging unit 12 and a display unit 13. The imaging unit 12 is an imaging device having an imaging element, for example, a camera. The imaging unit 12 images the segment structure values displayed on the display 11 at predetermined intervals. An image captured by the imaging unit 12 (also referred to as a captured image) is output to the information processing apparatus 10. When a plurality of segment structure values are displayed on the display 11, the imaging unit 12 captures an image so as to include at least one value.

  The display 11 displays values represented by a plurality of segments. The indicator 11 is a meter such as a radiation dosimeter, a thermometer, or a calculator, for example, and represents a value by 7 segments.

  The information processing apparatus 10 performs a segment extraction process on the captured image acquired from the imaging unit 12, and acquires a digital value corresponding to the segment display value. The information processing apparatus 10 may control to display the digital value on the display unit 13.

  The display unit 13 is, for example, a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), or the like, and displays a digital value acquired from the information processing apparatus 10.

  The information processing apparatus 10 includes a control unit 101, a main storage unit 102, an auxiliary storage unit 103, a communication unit 104, and a drive device 105. Each unit is connected via a bus so that data can be transmitted / received to / from each other.

  The control unit 101 is a CPU (Central Processing Unit) that performs control of each device, calculation of data, and processing in a computer. The control unit 101 is an arithmetic device that executes a program stored in the main storage unit 102 or the auxiliary storage unit 103. The control unit 101 receives data from the input device or the storage device, calculates, processes the output device, the storage device, and the like. Output to the device.

  The main storage unit 102 is, for example, a ROM (Read Only Memory) or a RAM (Random Access Memory). The main storage unit 102 is a storage device that stores or temporarily stores programs and data such as an OS and application software that are basic software executed by the control unit 101.

  The auxiliary storage unit 103 is, for example, an HDD (Hard Disk Drive) or the like, and is a storage device that stores data related to application software. For example, the auxiliary storage unit 103 stores an image acquired from the imaging unit 12.

  The communication unit 104 performs data communication with peripheral devices by wire or wireless. The communication unit 104 acquires an image including characters via a network, for example, and stores it in the auxiliary storage unit 103.

  The drive device 105 reads a predetermined program from the recording medium 106, for example, a flexible disk or a CD (Compact Disc), and installs it in the storage device.

  A predetermined program is stored in the recording medium 106, and the program stored in the recording medium 106 is installed in the information processing apparatus 10 via the drive device 105. The installed predetermined program can be executed by the information processing apparatus 10.

  The information processing apparatus 10 has the imaging unit 12 and the display unit 13 separately configured, but may be configured to include either one or both.

<Function>
FIG. 2 is a block diagram illustrating an example of functions of the information processing apparatus 10 according to the first embodiment. In the example illustrated in FIG. 2, the information processing apparatus 10 includes an image acquisition unit 200, an extraction unit 201, a storage unit 206, a comparison unit 207, a measurement unit 208, a determination unit 209, and an output unit 210.

  The storage unit 206 can be realized by the main storage unit 102 or the auxiliary storage unit 103, for example. The image acquisition unit 200, the extraction unit 201, the comparison unit 207, the measurement unit 208, the determination unit 209, and the output unit 210 can be realized by, for example, the control unit 101 and the main storage unit 102 as a work memory.

  The image acquisition unit 200 sequentially acquires captured images stored in the storage unit 206 at predetermined intervals or captured images captured by the imaging unit 12 at predetermined intervals. The image acquisition unit 200 outputs the captured images acquired in order to the extraction unit 201.

  The extraction unit 201 extracts each segment that is ON for each value from the captured image. The ON segment refers to a segment that forms a part of a character, and the OFF segment refers to a segment that forms a background, not a part of a character.

  Here, if the display 11 is a 7-segment display, the 7-segment display has a black background with white, green, red, etc. segments that indicate values, or a calculator with black numbers on a white background. There are various types, such as what to display. Therefore, there is a need to acquire a 7-segment display value as a digital value regardless of the type of the 7-segment display.

  In order to obtain a digital value, it is necessary to determine which segment is ON. Depending on the environment in which the display device 11 is installed, the external light for the display area may not be uniform. In this case, even if the segments form the same value, the position on the image depends on the position of the segment. There may be cases where the brightness is different. For example, the upper horizontal segment and the lower horizontal segment of 8 may have different luminance values.

  Therefore, the segment extraction method described below can appropriately determine ON / OFF of each segment regardless of the type of the display 11 and the situation of external light. In addition, about extraction of a segment, it is not restricted to the method shown below, You may extract a segment by another well-known method.

  The extraction unit 201 includes an area image acquisition unit 202, a straight line / line segment extraction unit 203, a detection unit 204, and a segment extraction unit 205.

  The area image acquisition unit 202 stores in advance the position of a rectangular area that includes, for example, all the numbers displayed in 7 segments in the captured image. The position of this rectangular area is set in advance by the user or the like. This rectangular area is an area including the display area of the display 11.

  When the captured image is acquired, the region image acquisition unit 202 acquires a rectangular region image (also referred to as a region image) at a preset position. The area image acquisition unit 202 outputs the acquired area image to the straight line / line segment extraction unit 203.

  The straight line / line segment extraction unit 203 performs, for example, a Hough transform on the acquired region image to extract a straight line and a line segment component. The straight line / line segment extraction unit 203 outputs the extracted straight line and line segment component to the detection unit 204.

  The detection unit 204 determines whether or not there is a shielding object in the display area of the display 11 based on the acquired number of straight lines and line segment components and the number of pixels. For example, when the detection unit 204 knows that the display area is a three-digit display area, the minimum number of line segments having a single-digit value is two and the maximum number is seven. It is determined whether the number of is 6 or more and 21 or less.

  When this condition is not satisfied, the detection unit 204 detects an error such as the presence of a blocking object or a clouded display area, and performs control to display an error on the display unit 13. Here, how many digits the display area is set in the detection unit 204 in advance.

  In addition, the detection unit 204 may determine whether there is an error by counting the number of black pixels in the acquired line segment or background, and comparing this count number with the number of pixels in the region image. . If the size of the area image is known in advance, it is possible to calculate at least how many black pixels are in the area image. As a result, the detection unit 204 detects an error such as the presence of a shielding object or a clouded display region when the number of black pixels in the region image is less than a predetermined value, and displays an error on the display unit 13. Request to do.

  When the detection unit 204 determines that there is no shielding object, the detection unit 204 notifies the segment extraction unit 205 to that effect. The straight line / line segment extraction unit 203 and the detection unit 204 are not necessarily functions necessary for the segment extraction process.

  The segment extraction unit 205 determines ON / OFF of the extracted segment for each digit from the region image. Details of the segment extraction unit 205 will be described with reference to FIG.

  FIG. 3 is a block diagram illustrating an example of the function of the segment extraction unit 205 according to the first embodiment. The segment extraction unit 205 illustrated in FIG. 3 includes a luminance value acquisition unit 301 and a segment determination unit 304.

  The luminance value acquisition unit 301 acquires a luminance value in an image of a predetermined area set in advance for each digit. The predetermined area set in advance is, for example, an always OFF area adjacent to the segment. The luminance value acquisition unit 301 illustrated in FIG. 3 includes a first luminance value acquisition unit 302 and a second luminance value acquisition unit 303.

  The first luminance value acquisition unit 302 acquires a luminance value of an image of a predetermined region adjacent to each segment, for example, a closed region above the seven segments. A closed region is a region surrounded by segments. This brightness value is, for example, the average brightness value of the image in the closed region.

  The second luminance value acquisition unit 303 acquires the luminance value of an image of a predetermined region adjacent to each segment, for example, a closed region below the seven segments.

  The areas where the luminance values are acquired by the first luminance value acquisition unit 302 and the second luminance value acquisition unit 303 are set in advance.

  The first luminance value acquisition unit 302 and the second luminance value acquisition unit 303 acquire a luminance value for each digit in the area image and output it to the segment determination unit 304.

  The segment determination unit 304 determines whether each segment is ON based on the luminance value acquired from the luminance value acquisition unit 301 and the luminance value of each segment. A segment being ON means that the segment is valid as part of a character.

  The segment brightness value may be an average brightness value of the segment or a brightness value at a predetermined position in the segment. Since the position of each segment is set in advance, the segment determination unit 304 acquires the luminance value of each segment according to the set position.

  The segment determination unit 304 illustrated in FIG. 3 includes a first segment determination unit 305, a second segment determination unit 306, and a third segment determination unit 307.

  The first segment determination unit 305 calculates a difference value between the luminance value of the center segment of the seven segments and the average luminance value of the first area and the second area. A center segment means the horizontal segment of the center of 7 segments, for example. The first segment determination unit 305 determines whether or not the center segment is ON by comparing the difference value with the first threshold value. The difference value of the luminance value is obtained by, for example, equation (1).

Ｖ：輝度値の差分値
Ｒ１，Ｇ１，Ｂ１：セグメントの画素値
Ｒ２，Ｇ２、Ｂ２：領域の平均画素値
第１セグメント判定部３０５は、式（１）のＲ２，Ｇ２，Ｂ２に対し、第１領域及び第２領域の平均画素値を代入する。

V: luminance value difference values R1, G1, B1: segment pixel values R2, G2, B2: area average pixel value The first segment determination unit 305 determines the second segment R2, G2, B2 in equation (1) The average pixel values of the first area and the second area are substituted.

The luminance value may be Y after color difference conversion. In this case, the difference value of the luminance value is obtained by Expression (2).
V = Y1-Y2 Formula (2)
Y1: Segment brightness value Y2: Area average brightness value The first segment determination unit 305 substitutes the average brightness values of the first area and the second area for Y2 in Expression (2).

  The first segment determination unit 305 determines that the segment is ON when the absolute value of the difference value is greater than the first threshold value, and the segment is OFF when the absolute value of the difference value is equal to or less than the first threshold value. Judge that there is.

  The second segment determination unit 306 calculates a difference value between the luminance value of each segment above the seven segments and the luminance value of the first region. Each of the upper segments refers to, for example, three segments including an uppermost segment, an upper left segment, and an upper right segment. The second segment determination unit 306 determines whether each upper segment is ON by comparing the difference value with the second threshold value.

  The second segment determination unit 306 determines that the segment is ON when the absolute value of the difference value is greater than the second threshold, and the segment is OFF when the absolute value of the difference value is equal to or less than the second threshold. Judge that there is.

  The third segment determination unit 307 calculates a difference value between the luminance value of each segment below the seven segments and the luminance value of the second region. Each of the lower segments refers to, for example, three segments including a lowermost segment, a lower left segment, and a lower right segment. The third segment determination unit 307 determines whether or not each lower segment is ON by comparing the difference value with the third threshold value.

  The third segment determination unit 307 determines that the segment is ON when the absolute value of the difference value is greater than the third threshold, and the segment is OFF when the absolute value of the difference value is equal to or less than the third threshold. Judge that there is.

  The segment determination unit 304 stores information indicating ON / OFF of each segment in the storage unit 206. In addition, the segment determination unit 304 may store in the storage unit 206 the luminance value of each segment and / or the difference value of the luminance value between the segment and the region used for the determination.

  Thus, by using the difference value between the brightness value of the segment and the brightness value of the area that is always OFF, it is possible to determine the ON / OFF state of the segment regardless of the type of the display 11. Further, since the comparison is performed using the luminance value of the always OFF region adjacent to each segment, the influence of external light can be reduced and ON / OFF can be appropriately determined for each segment. Therefore, according to the segment extraction method described above, each segment that is ON can be appropriately extracted.

  Returning to FIG. 2, the storage unit 206 stores a captured image, a dictionary including a character pattern based on a combination of segments (also referred to as a segment dictionary), a threshold for determining ON / OFF of a segment, and information indicating ON / OFF of each segment. In addition, information on ON / OFF brightness values of each segment is stored. The characters here include numbers, and will be described below by taking numbers as examples. The storage unit 206 may store each data in a plurality of storage areas, and may store each data in a plurality of storage devices.

  The comparison unit 207 acquires information indicating ON / OFF of each segment for each digit from the storage unit 206, and whether the combination of ON segments matches the number included in the segment dictionary stored in the storage unit 206. Compare When the comparison results match, the comparison unit 207 notifies the measurement unit 208 of the match, and outputs the matched numbers to the output unit 210. The comparison unit 207 performs this process for all the digits.

  If the comparison result does not match in at least one digit, the comparison unit 207 determines that a number that is not in the dictionary is displayed, and notifies the measurement unit 208 that there is a mismatch.

  In addition, when the display 11 has a liquid crystal display area, when the number is switched, the number after switching is displayed after the number before switching disappears. In this case, if the imaging unit 12 captures an image while switching numbers, the image is captured in a state different from a normal ON state. It is necessary to detect such a luminance value error.

  Therefore, the comparison unit 207, for example, if the difference between the luminance value of the ON segment to be compared and the average luminance value at the ON time of the segment stored in the storage unit 206 is greater than or equal to a predetermined threshold value, The imaging unit 12 is requested to perform re-imaging, assuming that the luminance value of the segment to be compared is a luminance value at the time of abnormality (when switching). Thereby, it is possible to detect an abnormality in the luminance value of the segment accompanying the switching of numbers.

  Further, the comparison unit 207 can provide a predetermined range for the luminance difference used for ON / OFF determination of each segment, and can detect that the luminance value of the segment is abnormal if the luminance difference exceeds the predetermined range. . Since the luminance value of the first area or the second area is substantially constant, if the luminance value of the segment is abnormal, this difference value is affected. Therefore, if the difference value when the segment is ON or OFF is not within the predetermined range, the comparison unit 207 can determine that the luminance value of the segment is abnormal.

  The measurement unit 208 measures the time from when the comparison unit 207 receives the mismatch notification until the match notification is received. This time is also called duration and represents the time when each extracted segment does not exist in the dictionary. The measurement unit 208 outputs the measured duration time to the determination unit 209.

  The measuring unit 208 may record the imaging cycle of the image, and automatically adjust the imaging cycle captured by the imaging unit 12 based on the cycle of the time when a number not in the dictionary is recognized. For example, the measurement unit 208 makes the imaging interval longer than the period of time when a number not in the dictionary is recognized, and shifts the imaging period. The measurement unit 208 notifies the imaging unit 12 of the adjusted imaging interval.

  Thereby, when imaging, the possibility that the combination of each segment does not exist in a dictionary is reduced, and the process accompanying reimaging can be reduced.

  In addition, the measurement unit 208 may measure the duration when the combination of segments that do not exist in the dictionary is the same as the combination of segments extracted last time. This is because combinations of segments indicating error codes are continuously displayed. On the other hand, even if the combination of the extracted segments does not exist in the dictionary twice consecutively, for example, if the segments are different combinations, there is a high possibility that the switching state between two different characters has been imaged.

  Thereby, the measurement unit 208 may measure the duration when the extracted segment combination does not exist in the dictionary and is the same as the previously extracted segment combination. The measurement unit 208 may acquire the extracted segment combination from the comparison unit 207 or may be input from the comparison unit 208 together with the notification.

  Further, the measurement unit 208 may measure the duration when the same combination of segments is displayed with a plurality of extracted digits and the combination of segments does not exist in the dictionary. This is because, for example, the same code may be displayed in all digits.

  The determination unit 209 compares the time measured by the measurement unit 208 with a predetermined value (for example, 3 seconds). If the measured time exceeds a predetermined value, the determination unit 209 determines that an error code indicating a failure is displayed.

  In addition, when the measured time is equal to or less than the predetermined value, the determination unit 209 determines that the number is in a state of switching, and requests the imaging unit 12 to perform re-imaging. Thereby, the segment extraction process can be performed again at another time. Further, this retry process may be performed a predetermined number of times. If the determination unit 209 determines that an error code is displayed, the determination unit 209 notifies the output unit 210 accordingly.

  The output unit 210 stores the digits of each digit acquired from the comparison unit 207 in association with the imaging time, and outputs the numbers in, for example, a CSV file format. Further, the output unit 210 may output each digit number and imaging time to the display unit 13.

  When the output unit 210 is notified from the determination unit 209 that an error code is displayed, the output unit 210 requests the display unit 13 to display that the display unit 11 has failed. Thereby, the display part 13 can perform a failure display and can notify a user that the indicator 11 failed.

<Summary of segment extraction processing>
Next, an outline of segment extraction processing in the first embodiment will be described using a specific example. The display 11 is assumed to be a meter that displays numbers in, for example, 7 segments.

  FIG. 4 is a diagram illustrating an example of a region image. The region image 401 illustrated in FIG. 4 is acquired by the region image acquisition unit 202 by cutting a preset position from the captured image. The area image acquisition unit 202 sets in advance the position in the captured image of the display area displayed as 7 segments. This pre-setting can be set by a user or the like.

  In addition, the position of each digit in the area image 401, the position of the segment, the position of the closed area in the segment, and the like are set in advance.

FIG. 5 is a diagram for explaining each segment and the closed region. Region A shown in FIG. 5 represents the closed region at the top of the seven segments and corresponds to the first region. Region B shown in FIG. 5 represents a closed region at the bottom of 7 segments and corresponds to the second region.
Segment (1) represents the middle horizontal segment of the seven segments.
Segment (2) represents the upper left vertical segment of 7 segments.
Segment (3) represents the top horizontal segment of 7 segments.
Segment (4) represents the upper right vertical segment of 7 segments.
Segment (5) represents the lower right vertical segment of 7 segments.
Segment (6) represents the bottom horizontal segment of 7 segments.
Segment (7) represents the lower left vertical segment of 7 segments.

  In the case of the positional relationship as shown in FIG. 5, the first luminance value acquisition unit 302 acquires the luminance value of the area A shown in FIG. 5 from the area image. This luminance value is, for example, the average luminance value of the region A.

  The second luminance value acquisition unit 303 acquires the luminance value of the region B illustrated in FIG. 5 from the region image. This luminance value is, for example, the average luminance value of the region B.

  The first segment determination unit 305 calculates a difference value between the luminance value of the segment (1) and the average luminance value of the region A and the region B, and compares the difference value with the first threshold value to thereby calculate the segment ( It is determined whether 1) is ON.

  The second segment determination unit 306 calculates a difference value between the brightness value of each segment above the segments (2) to (4) and the brightness value of the region A, and compares this difference value with the second threshold value. Thus, it is determined whether each upper segment is ON.

  The third segment determination unit 307 calculates a difference value between the luminance value of each segment below the segments (5) to (7) and the luminance value of the region B, and compares this difference value with the third threshold value. Thus, it is determined whether each lower segment is ON.

  The luminance value acquisition unit 301 divides the regions A and B into partial regions in the horizontal direction or the vertical direction, and acquires a luminance value of each partial region when there is a predetermined difference in luminance value between the partial regions. May be.

  FIG. 6 is a diagram illustrating an example in which the area A is divided into partial areas. FIG. 6A shows an example in which the area A is divided vertically and divided into two partial areas. It is assumed that there is a luminance value difference of a predetermined value or more in these two partial areas. In this case, the second segment determination unit 306 performs determination by calculating a difference value between the luminance value of the segment (2) and the luminance value of the partial region 501.

  In addition, the second segment determination unit 306 performs determination by calculating a difference value between the luminance value of the segment (4) and the luminance value of the partial region 502. In addition, regarding the segment (3) in this case, a difference from the luminance value of the region A may be taken, or a difference from the luminance value of the partial region 503 described below may be taken.

  FIG. 6B shows an example in which the area A is divided horizontally and divided into two partial areas. It is assumed that there is a luminance value difference of a predetermined value or more in these two partial areas. In this case, the third segment determination unit 307 performs determination by calculating a difference value between the luminance value of the segment (3) and the luminance value of the partial region 503.

  In addition, the first segment determination unit 305 performs determination by calculating a difference value between the luminance value of the segment (1) and the average luminance value of the partial images in the upper part of the partial area 504 and the area B.

  Thereby, the influence of external light can be further subdivided and ON / OFF of each segment can be determined more appropriately. Further, not only the area A but also the area B may be divided into partial areas.

  Next, examples of the first to third threshold values will be described. In the following, the first to third threshold values are set based on the measured values of the captured images in a bright environment and a dark environment.

  FIG. 7 is a diagram illustrating an example of a partial image obtained by capturing numbers displayed in seven segments in a dark environment. Here, the partial image is an image including a one-digit segment display value. The segment extraction unit 205 acquires the luminance value of each segment and regions A and B based on the partial image of FIG. In the example shown in FIG. 7, it is assumed that numbers are represented by black segments.

  FIG. 8 is a diagram showing measured values of the partial images shown in FIG. FIG. 8A shows the luminance value of the region A acquired by the first luminance value acquisition unit 302 and the luminance value of the region B acquired by the second luminance value acquisition unit 302. In the example shown in FIG. 8A, the luminance value of the region A is 41 and the luminance value of the region B is 48.

  FIG. 8B shows the luminance value when each segment is ON and OFF. Since the black segment represents a number, the luminance value when ON is smaller than the luminance value when OFF. FIG. 8C shows the absolute value of the difference value at ON / OFF.

  FIG. 9 is a diagram illustrating an example of a partial image obtained by capturing numbers displayed in seven segments in a bright environment. The segment extraction unit 205 acquires the luminance values of the segments and regions A and B based on the partial image in FIG. In the example shown in FIG. 9, it is assumed that numbers are represented by black segments.

  FIG. 10 is a diagram showing measured values of the partial images shown in FIG. FIG. 10A shows the luminance value of the region A acquired by the first luminance value acquisition unit 302 and the luminance value of the region B acquired by the second luminance value acquisition unit 302. In the example shown in FIG. 10A, the luminance value of region A is 100, and the luminance value of region B is 113.

  FIG. 10B shows the luminance value when each segment is ON and OFF. Since the black segment represents a number, the luminance value when ON is smaller than the luminance value when OFF. FIG. 10C shows the absolute value of the difference value at ON / OFF.

  In the measurement examples shown in FIGS. 8 and 10, since the maximum difference value at the time of OFF is 6 in both the dark environment and the bright environment, if a value larger than 6 is set as the first to third threshold values, the ON is performed. / OFF separation becomes possible. Therefore, for example, the segment determination unit 304 sets the first to third thresholds to 7. The first to third threshold values may be set to different values.

  FIG. 11 is a diagram illustrating an example of ON / OFF of each segment. In the example shown in FIG. 11, the segment determination unit 304 determines that the segment (4) and the segment (5) are ON, and the segments (1) to (3) and the segments (6) and (7) are OFF. The case where it is determined that there is present is shown.

  At this time, the segment determination unit 304 stores information indicating ON for the segments (4) and (5), and stores information indicating OFF for the segments (1) to (3) and the segments (6) and (7). To remember.

<Dictionary comparison process overview>
Next, an outline of the dictionary comparison process in the first embodiment will be described using a specific example. FIG. 12 is a diagram illustrating an example of a segment dictionary. The segment dictionary shown in FIG. 12 is stored in the storage unit 206 and holds numbers based on the ON / OFF combinations of the segments.

  The comparison unit 207 compares information indicating ON / OFF of each segment stored in the storage unit 306 with the segment dictionary. When the combination of ON segments indicates a number included in the segment dictionary, the comparison unit 207 outputs the number to the output unit 210.

FIG. 13 is a diagram illustrating an example of a luminance value abnormality. The example shown in FIG. 13 shows an example in which the number of 7-segment display is switched from 8 to 1. The comparison unit 207 detects an abnormality in the luminance value between t _{2 and} t ₄ where the numbers become lighter.

In order to detect a luminance value abnormality, the comparison unit 207 has, for each segment, a threshold value TH ₁ of the segment luminance value at normal ON and a threshold value TH ₂ of the segment luminance value at normal OFF. The threshold value TH ₁ and the threshold value TH ₂ may be stored in the storage unit 306 and may be appropriately read out by the comparison unit 207. Comparing unit 207, the luminance value of the segment, if included between the threshold TH ₁ and the threshold TH ₂ determines that the luminance abnormalities.

  Therefore, the comparison unit 207 determines that the digit having a segment with an abnormal luminance value does not match the dictionary.

  FIG. 14 is a diagram illustrating an example of a change in luminance value. In the example shown in FIG. 14A, an example of a luminance value change when the number is switched in the display 11 that represents a segment in black, such as a calculator, is shown.

In the example shown in FIG. 14A, the luminance value changes so that the segment changes from the ON state to the OFF state. In this case, TH ₁ represents a threshold at the time ON. The comparison unit 207 determines that the luminance value equal to or lower than TH ₁ is the normal luminance value of the segment when ON, and determines that the luminance value higher than TH ₁ is abnormal in luminance value.

TH ₂ represents a threshold value when OFF. The comparison unit 207 determines that the luminance value equal to or higher than TH ₂ is the normal luminance value of the segment at OFF, and determines that the luminance value lower than TH ₂ is abnormal in luminance value.

Therefore, it is determined that if the brightness value is captured by the imaging unit 12 between the larger TH ₂ smaller period T than TH _1, the comparison unit 207, a luminance abnormalities.

  FIG. 14B shows an example of a change in luminance value when a number is switched in a display 11 that turns on a segment by emitting white or the like on a black background as in a display unit of an AV device, for example.

In the example shown in FIG. 14B, the luminance value changes so as to decrease even when the segment changes from the ON state to the OFF state. In this case, TH ₁ represents a threshold at the time ON. The comparison unit 207 determines that the luminance value equal to or higher than TH ₁ is a normal luminance value of the segment when ON, and determines that the luminance value lower than TH ₁ is abnormal in luminance value.

TH ₂ represents a threshold value when OFF. The comparison unit 207 determines that the luminance value equal to or lower than TH ₂ is the normal luminance value of the segment at OFF, and determines that the luminance value higher than TH ₂ is abnormal in luminance value.

Therefore, when the imaging unit 12 captures an image during the period T in which the luminance value is smaller than TH _{1 and} larger than TH ₂ , the comparing unit 207 determines that the luminance value is abnormal. Thereby, dictionary comparison can be performed by ON / OFF of a segment having a normal luminance value.

<Outline of abnormality determination processing>
Next, an outline of the abnormality determination process in the first embodiment will be described using a specific example. FIG. 15 is a diagram for explaining abnormality determination. FIG. 15A shows a character switching state. In the example shown in FIG. 15A, a combination of segments existing in the dictionary is extracted at timings t ₁₁ , t ₁₂ , and t ₁₄ , and a combination of segments not existing in the dictionary is extracted at timing t ₁₃ .

In the example shown in FIG. 15 (A), the measuring unit 208, for example, measures the time _{T 11} from _{t 13} to _{t 14,} and outputs a time _{T 11} measured in the determination unit 209. Determination unit 209 determines whether time _{T 11} is the predetermined value TH ₃ (e.g. 3 seconds) or greater. Time _{T 11,} when a is TH ₃ or less, determination unit _209, a combination of segments extracted with _{t 13} determines that the character of the switching state.

FIG. 15B shows a state where an error code is displayed. In the example shown in FIG. 15 (B), and extracts a combination of segments that exist in the dictionary at the timing t _21, the timing of the _~ t _22, extracts a combination of segments that do not exist in the dictionary.

In the example shown in FIG. 15 (B), the measuring unit 208, for example, measures the _{t 22} after the time _at the timing of t _{23, t 24,} and outputs the measured time _{T 21} to the determination unit 209. Measurement unit 208 determines when the time T ₂₁ exceeds a predetermined value TH _3, an error code is displayed.

  As a result, the measurement unit 208 measures the time during which a combination of segments that does not exist in the dictionary is extracted, and compares the time measured by the determination unit 209 with a predetermined value to appropriately determine the abnormal state. be able to.

Further, as shown in FIG. 15B, the measurement unit 208 may measure the duration when the combinations of segments that do not exist in the dictionary are the same. For example, at timing t _23, does not exist in the dictionary, if a combination of the other segments, the measuring unit 208 resets the duration has been measured, resume measured from t _23.

  As a result, the error code determination probability can be improved. This is because the same character is often displayed continuously as the error code.

Also, combinations of segments as shown by t ₂₂ shown in FIG. 15 (B) it is, if it is displayed by a plurality of digits, the measuring unit 208 may be measured duration. This is because the same error code is often displayed in a plurality of digits.

<Operation>
Next, the operation of the information processing apparatus 10 in the first embodiment will be described. FIG. 16 is a flowchart illustrating an example of processing of the information processing apparatus 10 according to the first embodiment. The process of the information processing apparatus 10 includes a segment extraction process.

  In step S <b> 101, the image acquisition unit 200 sequentially acquires captured images in which the display area of the display unit 11 is captured at a predetermined interval by the imaging unit 12.

  In step S102, the area image acquisition unit 202 acquires an area image of an area including a value to be displayed in 7 segments. The position of the region image is set in advance.

  In step S103, the straight line / line segment extraction unit 203 extracts straight lines and line segments from the region image by Hough transform.

  In step S104, the detection unit 204 determines whether a shielding object has been detected based on the number of extracted straight lines / line segments and the number of pixels. When a shielding object is detected (step S104-YES), it progresses to step S105, and when a shielding object is not detected (step S104-NO), it progresses to S106.

  In step S105, the detection unit 204 requests the display unit 13 to perform error display, assuming that there is a shielding object. In addition, the detection unit 204 requests the imaging unit 12 to perform imaging in order to perform segment extraction processing again.

  In step S106, the segment extraction unit 205 compares the brightness value of the always OFF region adjacent to the segment with the brightness value of each segment, and extracts each segment that is ON. The extraction method is as described above. The segment extraction unit 205 performs segment extraction for each digit.

  Steps S101 to S106 are segment extraction processing. By this segment extraction process, it is possible to appropriately determine the ON / OFF of each extracted segment and extract the ON segment regardless of the type of the display 11 or the influence of external light. Note that steps S103 to S105 are not necessarily processing. Moreover, in an Example, it is not limited to the segment extraction process mentioned above, You may use another well-known segment extraction process.

  In step S107, the comparison unit 207 compares the determined ON segment with the segment dictionary (see FIG. 12). The comparison unit 207 may determine the above-described luminance value abnormality.

  In step S108, the comparison unit 207 determines whether the combination (value) of the ON segment matches the segment pattern of the dictionary. If the segment combination exists in the segment dictionary (step S108—YES), the process proceeds to step S109. If the segment combination does not exist in the segment dictionary (step S108—NO), the process proceeds to step S110.

  In step S109, the comparison unit 207 outputs the values existing in the dictionary to the output unit 210. As a result, the value displayed in 7 segments can be acquired as a digital value, and can be used in a system at a later stage. For example, the output unit 210 can continuously hold the value acquired from the comparison unit 207 and output it as a CSV file.

  In step S110, the measurement unit 208 measures the time during which a segment that does not exist in the dictionary is extracted. The measurement unit 208 can measure this time by acquiring the comparison result from the comparison unit 207.

In step S111, the determination unit 209 compares the time measured with a predetermined value TH _3, determines whether the error code. Judging unit 209 determines that the measured time is larger than the predetermined value TH ₃ is determined error code, the measured time is the state switching if it is less than the predetermined value TH _3.

  When it is determined that it is an error code (step S111—YES), the process proceeds to step S112, and when it is determined that it is not an error code (step S111—NO), the process proceeds to step S113.

  In step S112, the output unit 210 causes the display unit 13 to display a display indicating that a failure has occurred in the display unit 11.

  In step S113, the determination unit 209 requests the imaging unit 12 to perform imaging in order to perform another analysis on another image.

  Thereby, when the extracted combination of segments does not exist in the dictionary, it is possible to appropriately determine whether the character is switched or the error code is displayed.

  Next, a segment extraction process for improving the accuracy of abnormality determination will be described. FIG. 17 is a flowchart illustrating an example of the segment extraction process in S106. In step S201 illustrated in FIG. 17, the segment extraction unit 205 sets n representing a digit number to 1.

  In step S202, the first luminance value acquisition unit 302 acquires the average luminance value of the closed region A corresponding to the first region.

  In step S203, the second luminance value acquisition unit 303 acquires the average luminance value of the closed region B corresponding to the second region.

  In step S204, the segment determination unit 304 sets s indicating the segment number to 1.

  In step S205, the segment determination unit 304 determines whether the segment number is 1, 2-4, or 5-7. Segment numbers 1 to 7 correspond to segments (1) to (7), respectively.

  If the segment number is 1, the process proceeds to step S206. If the segment number is 2-4, the process proceeds to step S207. If the segment number is 5-7, the process proceeds to step S208.

  In step S206, the first segment determination unit 305 calculates a difference value between the luminance value of the segment (1) and the average of the luminance values of the first area and the second area, and the absolute value of the difference value is the first value. It is determined whether it is larger than the threshold value. If the absolute value of the difference value is greater than the first threshold, the first segment determination unit 305 determines that this segment is ON. When the absolute value of the difference value is equal to or smaller than the first threshold, the first segment determination unit 305 determines that this segment is OFF.

  In step S207, the second segment determination unit 306 calculates a difference value between the luminance value of each segment (2) to (4) and the luminance value of the first region, and the absolute value of the difference value is the second threshold value. Determine if greater than. When the absolute value of the difference value is larger than the second threshold, the second segment determination unit 306 determines that this segment is ON. When the absolute value of the difference value is equal to or smaller than the second threshold value, the second segment determination unit 306 determines that this segment is OFF.

  In step S208, the third segment determination unit 307 calculates a difference value between the luminance values of the segments (5) to (7) and the luminance value of the second region, and the absolute value of the difference value is the third threshold value. Determine if greater than. If the absolute value of the difference value is larger than the third threshold value, the third segment determination unit 307 determines that this segment is ON. When the absolute value of the difference value is equal to or smaller than the third threshold value, the third segment determination unit 307 determines that this segment is OFF.

  In step S209, the segment determination unit 304 determines whether the segment number s = 7. If the segment number s is 7 (step S209—YES), the process proceeds to step S211. If the segment number s is not 7 (step S209—NO), the process proceeds to step S210.

  In step S210, the segment determination unit 304 adds 1 to the segment number s. After the process of step S210, the process returns to step S205.

  In step S211, the segment extraction unit 205 determines whether the digit number n is N. N represents the maximum number of digits and is set in advance. If the digit number n is N (step S211—YES), this extraction process is terminated. If the digit number n is not N (step S211—NO), the segment extraction unit 205 adds 1 to n. After step S212, the process returns to step S202.

  Thereby, ON / OFF determination of each segment can be appropriately performed for each digit of the display area.

  FIG. 18 is a flowchart illustrating an example of the dictionary comparison process in S108. In step S301 illustrated in FIG. 18, the comparison unit 207 determines whether the combination of segments determined to be ON exists in the segment dictionary. When it exists in the dictionary (step S301—YES), the process proceeds to step S302, and when it does not exist in the dictionary (step S302—NO), the process proceeds to step S110.

In step S302, the comparison unit 207 sets the segment number s to 1. In step S303, comparison unit 207 compares the luminance value of the segment is determined to ON / OFF, and a threshold value TH ₂ thresholds TH ₁ and OFF is ON.

In step S304, the comparison unit 207 determines the luminance value of the segment, the larger or the threshold value TH ₂ smaller than the threshold value TH _1. The comparison unit 207 determines the luminance value of the segment, the larger or the threshold value TH ₁ is smaller than the threshold TH _2. This is because these two determinations correspond to the type of the display 11 (see FIG. 14).

  If the luminance value of the segment satisfies the threshold condition (step S304—YES), the process proceeds to step S110. If the luminance value of the segment does not satisfy the threshold condition (step S304—NO), the process proceeds to S305.

  In step S305, the comparison unit 207 determines whether the segment number s is 7. When the segment number s is 7 (step S305—YES), the process proceeds to step S307, and when the segment number s is not 7 (step S305—NO), the process proceeds to step S306.

  In step S306, the comparison unit 207 adds 1 to the segment number. After step S306, the process returns to step S303.

  In step S307, the comparison unit 207 stores the luminance value in the storage unit 306 for each segment, for example.

  Thereby, abnormality of the luminance value of a segment can be detected, and dictionary comparison can be performed based on a segment having a normal luminance value.

  As described above, according to the first embodiment, the abnormal state can be appropriately determined. Further, according to the first embodiment, it is possible to determine an abnormal state using appropriately extracted ON segments regardless of the type of the display 11 and the external light condition.

[Example 2]
Next, an information processing apparatus according to the second embodiment will be described. In the second embodiment, the threshold value for determining the abnormality of the luminance value of the segment is updated for each segment using the measured value of the luminance value of the segment. Thereby, abnormality determination can be performed using a more appropriate ON segment.

<Hardware>
Since the hardware of the information processing apparatus in the second embodiment is the same as that in the first embodiment, description thereof is omitted.

<Function>
The functions of the information processing apparatus according to the second embodiment are the same as the functions illustrated in FIG. 2 except for the function of the segment extraction unit, and thus the description thereof is omitted.

  FIG. 19 is a block diagram illustrating an example of functions of the segment extraction unit 601 according to the second embodiment. Regarding the function of the segment extraction unit 601 in the second embodiment, the same functions as those shown in FIG.

  The update unit 602 of the segment extraction unit 601 updates the threshold value used to determine the abnormality of the luminance value of the segment.

  For example, for each segment, the update unit 602 averages the difference value between the luminance value when determined to be ON or OFF and the luminance value of the region, and updates the threshold using the average value.

  FIG. 20 is a diagram illustrating threshold values used to determine an abnormality in luminance value for each segment. In the example illustrated in FIG. 20, the average brightness difference between ON and OFF, the latest brightness difference, and the upper limit value (+) and lower limit value (−) of the allowed average brightness difference are associated with each segment. ing. A luminance difference represents a difference value of luminance values.

  As shown in FIG. 20, when the average luminance difference when segment number 1 is ON is 20, the difference value of the normal luminance value of segment number 1 is between 20−4 and 20 + 20. That is, if there is a luminance difference between 16 and 40, the comparison unit 207 determines that the luminance value of the segment is normal.

  For example, the comparison unit 207 determines that the segment of segment number 1 is a normal luminance value because the latest luminance difference of segment number 1 is 22 and this value is in the normal range of 16 to 40.

  As shown in FIG. 20, when the average luminance difference when segment number 1 is OFF is 3, the difference value of the normal luminance value of segment number 1 is between 3-4 and 3 + 4. That is, if there is a luminance difference between 0 and 7, the comparison unit 207 determines that the luminance value of the segment is normal. If the threshold value is negative, it is rounded to zero.

  For example, the comparison unit 207 determines that the segment with the segment number 1 has a normal luminance value because the latest luminance difference with the segment number 1 is 3 and this value is between the normal ranges 0 to 7.

  It should be noted that there is a difference in the “+” portion depending on the difference between the average luminance differences allowed between ON and OFF. A larger value is set at the ON time than at the OFF time. The reason for this will be described.

  FIG. 21 is a diagram for explaining a luminance difference when a segment is ON / OFF. FIG. 21A shows the luminance difference when the segment is ON. As shown in FIG. 21A, when the segment is ON, the luminance difference from the region A or the region B becomes large. However, the brightness difference at the time of ON with the region A or the region B varies depending on illumination conditions such as ambient external light.

  Therefore, when the segment is ON, the comparison unit 207 determines whether or not the latest input value can be allowed within a larger allowable value range. Therefore, “+” of the difference from the average luminance difference allowed at the time of ON is set to 20. The latest input value is a difference value between the luminance value of the latest segment and the luminance value of region A or region B.

  FIG. 21B shows the luminance difference when the segment is OFF. As shown in FIG. 21B, since the comparison is always made with the OFF region, when the segment is OFF, the luminance difference with the region A or region B is small regardless of the surrounding illumination conditions.

  Therefore, when the segment is OFF, the comparison unit 207 determines whether or not the latest input value can be permitted within the range of the smaller allowable value. Therefore, “+” of the difference from the average luminance difference allowed at the OFF time is set to 4.

  As described above, when the average luminance difference of each segment varies, the normal luminance difference range also varies for each segment. The value obtained by adding the (+) value to the average luminance difference becomes the upper limit threshold value of the normal luminance difference, and the value obtained by subtracting the (−) value from the average luminance difference becomes the lower limit threshold value of the normal luminance difference. .

  The updating unit 601 updates the threshold used for determining the abnormality of the luminance value by calculating the average of the luminance differences of the segments at the time of ON and OFF. Thereby, it is possible to detect an abnormality in luminance value using an appropriate threshold value corresponding to each segment.

Incidentally, the update unit 602 may update the threshold value TH ₁ and the threshold TH ₂ described in the first embodiment. In this case, the update unit 602 calculates the average value of the luminance values when each segment is ON / OFF. In the case shown in FIG. 14A, the updating unit 602 uses a threshold TH ₁ as a value obtained by adding a predetermined value to the average value of luminance values at the time of ON, and a value obtained by subtracting the predetermined value from the average value of luminance values at the time of OFF. as TH _2, it may be updated threshold.

<Operation>
Next, the operation of the information processing apparatus according to the second embodiment will be described. FIG. 22 is a flowchart illustrating an example of processing performed by the information processing apparatus according to the second embodiment.

  The processes in steps S401 to S406 shown in FIG. 22 are the same as the processes in steps S101 to S106 shown in FIG.

  In step S407, the update unit 602 calculates the average of the ON / OFF luminance difference values of each segment, and updates the threshold value used for the luminance value abnormality determination using the average value. This threshold value is used by the comparison unit 207 to determine whether the luminance value is abnormal.

  The processing in steps S408 to S414 is the same as the processing in steps S107 to S113 shown in FIG.

  As described above, according to the second embodiment, the threshold value for determining an abnormality in the luminance value of the segment is updated for each segment using the measured value of the luminance value of the segment. OFF can be determined. Therefore, it is possible to perform an abnormality determination using the appropriate ON segment and increase the determination accuracy.

[Modification]
Note that by recording a program for realizing the processing described in each of the above-described embodiments on a recording medium, the processing in each of the embodiments can be performed by a computer. For example, it is possible to record the program on a recording medium and cause the computer to read the recording medium on which the program is recorded, thereby realizing the processing described above.

  The recording medium is a recording medium that records information optically, electrically, or magnetically, such as a CD-ROM, flexible disk, magneto-optical disk, etc., and information is electrically recorded such as ROM, flash memory, etc. Various types of recording media such as a semiconductor memory can be used. This recording medium does not include a carrier wave.

  Although the embodiments have been described in detail above, the invention is not limited to the specific embodiments, and various modifications and changes can be made within the scope described in the claims. It is also possible to combine all or a plurality of the constituent elements of the above-described embodiments.

In addition, the following additional notes are disclosed regarding each of the above embodiments.
(Appendix 1)
Extracting each segment in which at least one of the values represented using a plurality of segments is ON from each image captured at predetermined time intervals,
Comparing each extracted segment with a dictionary containing a combination of segments pre-stored in the storage unit;
Measure the time when the combination of segments that do not exist in the dictionary is extracted,
A program for causing a computer to execute a process of determining whether a value is switched or a failure based on a comparison result between a measured time and a predetermined value.
(Appendix 2)
The process of measuring the time is:
The program according to appendix 1, wherein the time is measured when the extracted segments are combinations of segments not existing in the dictionary and are the same as the previously extracted segments.
(Appendix 3)
The process of extracting the segment is:
Extracting each segment that is ON for each value from an image in which a plurality of the values are captured,
The process of comparing with the dictionary is as follows:
Compare with the dictionary for each value,
The process of measuring the time is:
The program according to claim 1, wherein the time is measured when the extracted segments are combinations of segments that do not exist in the dictionary with a plurality of values, and the combinations of the segments are the same.
(Appendix 4)
The process of extracting each segment is as follows:
An area image including the value is acquired from the image,
For each value in the region image, obtain a luminance value of the first region and the second region surrounded by the segment,
One of supplementary notes 1 to 3, further comprising a process for determining whether or not each segment is ON based on a luminance value of each segment in the plurality of segments and a luminance value of the first region or the second region. The program according to one item.
(Appendix 5)
The plurality of segments is 7 segments,
The process of acquiring the luminance values of the first area and the second area is as follows:
The program according to claim 4, wherein a closed area above the 7 segments is the first area, and a closed area below the 7 segments is the second area.
(Appendix 6)
The determination process is as follows.
The difference value between the brightness value of each segment above the 7 segment and the brightness value of the first area, the difference value between the brightness value of each segment below the 7 segment and the brightness value of the second area, or The program according to appendix 5, wherein it is determined whether or not each segment is ON based on a difference value between a luminance value of a central segment of seven segments and an average value of the luminance values of the first area and the second area.
(Appendix 7)
An extraction unit that extracts each segment in which at least one of the values represented by using a plurality of segments is ON from each image captured at a predetermined time;
A comparison unit that compares each extracted segment with a dictionary that includes a combination of segments stored in advance in the storage unit;
A measuring unit for measuring a time during which a combination of segments not existing in the dictionary is extracted;
A determination unit that determines whether the value is switched or malfunctioned based on a comparison result between the measured time and the predetermined value;
An information processing apparatus comprising:
(Appendix 8)
Extracting each segment in which at least one of the values represented using a plurality of segments is ON from each image captured at predetermined time intervals,
Comparing each extracted segment with a dictionary containing a combination of segments pre-stored in the storage unit;
Measure the time when the combination of segments that do not exist in the dictionary is extracted,
An abnormality determination method in which a computer executes a process of determining whether a value is switched or a failure based on a comparison result between a measured time and a predetermined value.

DESCRIPTION OF SYMBOLS 10 Information processing apparatus 11 Display 12 Image pick-up part 13 Display part 101 Control part 102 Main storage part 103 Auxiliary storage part 104 Communication part 105 Drive apparatus 200 Image acquisition part 201 Extraction part 202 Area image acquisition part 203 Straight line and line segment extraction part 204 Detection unit 205 Segment extraction unit 206 Storage unit 207 Comparison unit 208 Measurement unit 209 Determination unit 210 Output unit 301 Luminance value acquisition unit 302 First luminance value acquisition unit 303 Second luminance value acquisition unit 304 Segment determination unit 305 First segment determination unit 306 Second segment determination unit 307 Third segment determination unit

Claims (7)

Extracting each segment in which at least one of the values represented using a plurality of segments is ON from each image captured at predetermined time intervals,
Comparing each extracted segment with a dictionary containing a combination of segments pre-stored in the storage unit;
Measure the time when the combination of segments that do not exist in the dictionary is extracted,
A program for causing a computer to execute a process of determining whether a value is switched or a failure based on a comparison result between a measured time and a predetermined value. The process of measuring the time is:
The program according to claim 1, wherein the time is measured when each of the extracted segments is a combination of segments not existing in the dictionary and is the same as each of the previously extracted segments. The process of extracting the segment is:
Extracting each segment that is ON for each value from an image in which a plurality of the values are captured,
The process of comparing with the dictionary is as follows:
Compare with the dictionary for each value,
The process of measuring the time is:
The program according to claim 1, wherein the time is measured when the extracted segments are combinations of segments that do not exist in the dictionary with a plurality of values, and the combinations of the segments are all the same. The process of extracting each segment is as follows:
An area image including the value is acquired from the image,
For each value in the region image, obtain a luminance value of the first region and the second region surrounded by the segment,
4. The method according to claim 1, further comprising: determining whether each segment is ON based on a luminance value of each segment in the plurality of segments and a luminance value of the first area or the second area. A program according to any one of the above.   Extracting each segment in which at least one of the values represented using a plurality of segments is ON from each image captured at predetermined time intervals,
  Comparing each extracted segment with a dictionary containing a combination of segments pre-stored in the storage unit;
  Measure the time when the combination of segments that do not exist in the dictionary is extracted,
  According to the comparison result between the measured time and the predetermined value, the computer is caused to execute a process of determining whether the value is switched or a failure,
  The process of extracting each segment is as follows:
  An area image including the value is acquired from the image,
  For each value in the region image, obtain a luminance value of the first region and the second region surrounded by the segment,
  Based on the luminance value of each segment in the plurality of segments and the luminance value of the first region or the second region, it is determined whether or not each segment is ON,
  The plurality of segments is 7 segments,
  The process of acquiring the luminance values of the first area and the second area is as follows:
  A program in which the closed area above the 7 segments is the first area and the closed area below the 7 segments is the second area. An extraction unit that extracts each segment in which at least one of the values represented by using a plurality of segments is ON from each image captured at a predetermined time;
A comparison unit that compares each extracted segment with a dictionary that includes a combination of segments stored in advance in the storage unit;
A measuring unit for measuring a time during which a combination of segments not existing in the dictionary is extracted;
A determination unit that determines whether the value is switched or malfunctioned based on a comparison result between the measured time and the predetermined value;
An information processing apparatus comprising: Extracting each segment in which at least one of the values represented using a plurality of segments is ON from each image captured at predetermined time intervals,
Comparing each extracted segment with a dictionary containing a combination of segments pre-stored in the storage unit;
Measure the time when the combination of segments that do not exist in the dictionary is extracted,
An abnormality determination method in which a computer executes a process of determining whether a value is switched or a failure based on a comparison result between a measured time and a predetermined value.

Images