JP2023039282A - Determination apparatus, program, and determination method - Google Patents

Abstract

To provide a determination apparatus, a program, and a determination method.SOLUTION: In a system including a determination apparatus which communicates with a camera over a network to acquire a captured image, the determination apparatus 100 includes: an image storage unit which stores a reference image captured in advance; a threshold storage unit which stores a difference threshold determined in advance; a designated region acquisition unit which acquires multiple designated regions designated by a user of the determination apparatus with respect to the reference image; an image acquisition nit which acquires an analysis target image which is to be subjected to image analysis; a difference value acquisition unit which acquires a difference value between each pixel in each of the designated regions in the reference image with each pixel in each corresponding region which corresponds to each designated region in the reference image, of the analysis target image; and a status determination unit which determines a status of each of the corresponding regions of the analysis target images, on the basis of a ratio of the number of non-similar pixels, which is the number of pixels in the corresponding region of which the difference value is higher than the difference threshold, with respect to the number of corresponding region pixels, which is the number of pixels in the corresponding region.SELECTED DRAWING: Figure 11

Description

The present invention relates to a determination device, program, and determination method.

Patent Document 1 describes a technique for identifying products on product shelves by registering thousands of product images as training data and using a trained model trained using a deep learning algorithm. ing.
[Prior art documents]
[Patent Literature]
[Patent Document 1] JP 2021-047747 A

According to one embodiment of the present invention, a determination device is provided. The determination device may comprise an image storage unit for storing pre-captured reference images. The determination device may include a threshold storage unit that stores a predetermined difference threshold. The determination device may include a specified region acquisition unit that acquires a plurality of specified regions specified by the user of the determination device with respect to the reference image. The determination device may include an image acquisition unit that acquires an analysis target image that is the target of image analysis. The determination device acquires a difference value between each pixel in each of the plurality of specified regions of the reference image and each pixel in each corresponding region of the analysis target image corresponding to each of the specified regions in the reference image. A value acquisition unit may be provided. For each corresponding region of the image to be analyzed, the determination device determines the ratio of the number of dissimilar pixels, which is the number of pixels in the corresponding region whose difference value is higher than the difference threshold, to the number of pixels in the corresponding region, which is the number of pixels in the corresponding region. A situation determination unit may be provided that determines the situation of the corresponding area based on.

The threshold storage unit may store each of the plurality of difference thresholds in association with each of the plurality of specified regions. The situation determination unit determines, based on the ratio of the number of dissimilar pixels higher than the difference threshold stored in the threshold storage unit in which the difference value is associated with the designated area, to the number of pixels in the corresponding area, the The status of the corresponding area may be determined. The image storage unit may store the reference image including a plurality of display areas, each of which is an area for displaying one or more types of products. The threshold storage unit may further store a predetermined shortage threshold. The specified area acquiring unit may acquire the plurality of specified areas specified by the user for the plurality of display areas. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the shortage threshold, the situation determination unit determines that the product in the corresponding area corresponding to the specified area specified for the display area is in a shortage state. It can be determined that

The specified area acquiring unit may acquire the plurality of specified areas specified by the user for the plurality of display areas each displaying one type of product. The threshold storage unit may store each of the plurality of difference thresholds in association with identification information of a product displayed in each of the plurality of designated areas and each of the plurality of corresponding areas. The situation determination unit determines the non-similar pixels whose difference value with respect to the number of pixels in the corresponding area is higher than the difference threshold stored in the threshold storage unit in association with the identification information of the specified area and the product. If the percentage of the number is lower than the shortage threshold, it may be determined that the product in the corresponding area is in a shortage state. The image storage section may further store an image of the product. The difference value acquisition unit may acquire an average difference value, which is a difference value between an average value of pixels in the specified region and an average value of pixels in the product image. The above determination device
The apparatus may further include a threshold setting unit that sets the difference threshold based on the average difference value.

The specified area acquisition unit may acquire the two specified areas specified by the user for each of a first partial area and a second partial area of the one display area. The situation determination unit determines a ratio of the number of dissimilar pixels to the number of pixels of the corresponding region in the corresponding region corresponding to the designated region designated for the first partial region, and and the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area of the corresponding area corresponding to the specified area specified for the product in the two corresponding areas corresponding to the two specified areas status may be determined. The first partial area may be a front area of the one display area. The second partial area may be a rear area of the one display area. The situation determination unit determines that a ratio of the number of dissimilar pixels to the number of pixels of the corresponding region in the corresponding region corresponding to the designated region designated for the first partial region is lower than the shortage threshold, and , if the ratio of the number of dissimilar pixels to the number of corresponding region pixels of the corresponding region corresponding to the designated region designated for the second partial region is higher than the shortage threshold, the second portion The product in the corresponding area corresponding to the specified area specified for the area can be advanced to the corresponding area corresponding to the specified area specified for the first partial area. can be determined.

The image storage section may store the reference image including a plurality of manufacturing areas, which are areas for manufacturing products. The threshold storage unit may further store a predetermined work threshold. The designated area obtaining unit may obtain the plurality of designated areas designated by the user for the plurality of manufacturing areas. If the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is higher than the work threshold during a predetermined period, the situation determination unit determines whether the correspondence corresponding to the designated region designated for the manufacturing region It may be determined that production of the product is stalled in the region. The image storage may store the reference image including a plurality of seat areas. The threshold storage unit may further store a predetermined usage threshold. The specified area acquisition unit may acquire the plurality of specified areas specified by the user for the plurality of seat areas. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the utilization threshold, the situation determination unit determines that the seat in the corresponding area corresponding to the designated area designated for the seat area is in a occupied state. It can be determined that there is

According to one embodiment of the present invention, there is provided a program for causing a computer to function as the determination device.

According to one embodiment of the present invention, a computer-implemented method of determination is provided. The determination method may comprise a designated region obtaining step of obtaining a plurality of designated regions designated by a user of the computer with respect to a pre-captured reference image. The determination method may comprise an image acquisition step of acquiring an analysis target image that is the target of image analysis. The determination method is a difference that acquires a difference value between each pixel in each specified area of the plurality of specified areas of the reference image and each pixel in each corresponding area of the analysis target image corresponding to each specified area in the reference image. A value acquisition stage may be provided. For each corresponding region of the image to be analyzed, the determination method is to determine dissimilarity, which is the number of pixels in the corresponding region whose difference value is higher than a predetermined difference threshold with respect to the number of pixels in the corresponding region, which is the number of pixels in the corresponding region. A condition determination step may be provided for determining the condition of the corresponding region based on the percentage of the number of pixels.

It should be noted that the above summary of the invention does not list all the necessary features of the invention. Subcombinations of these feature groups can also be inventions.

An example system 10 is shown schematically. An example of a reference image 400 is shown schematically. An example of an analysis target image 500 is shown schematically. Another example of the reference image 400 is shown schematically. Another example of the analysis target image 500 is schematically shown. Another example of the reference image 400 is shown schematically. Another example of the analysis target image 500 is schematically shown. An example of a graph representing the situation of corresponding area 635, corresponding area 645, and corresponding area 655 is schematically shown. Another example of the reference image 400 is shown schematically. Another example of the analysis target image 500 is schematically shown. An example of the functional configuration of the determination device 100 is shown schematically. An example of the flow of processing by the determination device 100 is shown schematically. 1 schematically shows an example of a hardware configuration of a computer 1200 functioning as the determination device 100. FIG.

Product detection using conventional deep learning requires sequential image collection, which is inefficient and costly. For example, when trying to use conventional technology to detect product shortages in retail stores, there are many types of products in retail stores and there are many manufacturers, so the load of advance preparation becomes extremely high. very difficult to use. The determination device according to the present embodiment provides technology capable of reducing the load of such advance preparation.

Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. Also, not all combinations of features described in the embodiments are essential for the solution of the invention.

FIG. 1 schematically illustrates an example system 10 . The system 10 has a determination device 100 . System 10 may include camera 200 . System 10 may include multiple cameras 200 . FIG. 1 shows an example in which system 10 includes one camera 200 .

The determination device 100 acquires a captured image. The determination device 100 acquires, for example, a captured image of an area in which a detection target is arranged. For example, if the detection target is a product, the area may be a product shelf. The determination device 100 acquires, for example, a reference image. A reference image is a captured image in which there is no detection target. The determination device 100 acquires, for example, a captured image (sometimes referred to as an analysis target image) for determining whether or not a detection target actually exists.

The determination device 100 acquires a captured image captured by the camera 200, for example. The determination device 100 acquires a captured image from the camera 200 by communicating with the camera 200 via the network 20, for example. Network 20 includes, for example, the Internet. The network 20 includes, for example, a LAN (Local Area Network). Network 20 may include a mobile communication network. The mobile communication network, for example, conforms to any of the 3G (3rd Generation) communication method, the LTE (Long Term Evolution) communication method, the 5G (5th Generation) communication method, and the 6G (6th Generation) communication method and later communication methods. may

The determination device 100 may acquire the captured image from the camera 200 by communicating directly with the camera 200 . The determination device 100 acquires a captured image from the camera 200 by wirelessly communicating with the camera 200, for example. Examples of wireless communication systems include Wi-Fi (registered trademark), Bluetooth (registered trademark), ZigBee (registered trademark), and the like. The determination device 100 may acquire the captured image from the camera 200 by wire communication with the camera 200 . Note that the determination device 100 may acquire a captured image captured by a camera incorporated in the determination device 100 .

A captured image is, for example, a still image. The captured image may be a moving image.

The determination device 100 acquires a specified region specified by the user of the determination device 100 with respect to the reference image. The user of the determination device 100 may be a person who directly uses the determination device 100 or a person who uses the service provided by the determination device 100 .

The determination device 100 acquires a difference value between each pixel in the specified area of the reference image and each pixel in the corresponding area of the analysis target image corresponding to the specified area of the reference image. Based on the ratio of the number of dissimilar pixels, which is the number of pixels in the corresponding region whose difference value is higher than a predetermined difference threshold, to the number of pixels in the corresponding region, the determination device 100 Determine the status of the corresponding area.

Camera 200 may be any imaging device. Camera 200 is, for example, a network camera. Camera 200 may be a web camera.

Conventionally, the state of the region of the image to be analyzed has been determined using a large amount of images to be detected that have been collected in advance, but this has been inefficient and costly. In particular, when there are multiple types of detection targets, it is necessary to collect a large number of images in advance for each type of detection target, which is even more inefficient and costly. In contrast, the determination apparatus 100 according to the present embodiment simply prepares in advance a reference image in which no detection target exists, and roughly approximates the corresponding region of the analysis target image regardless of the type of detection target. situation can be determined. As a result, the determination device 100 according to the present embodiment can efficiently determine the rough situation of the corresponding region at low cost.

FIG. 2 schematically shows an example of a reference image 400. As shown in FIG. A reference image 400 in FIG. 2 is a captured image of the product shelf 300 in which no products are displayed.

FIG. 2 illustrates a case where the user of the determination device 100 designates a designated area 330 , a designated area 340 , and a designated area 350 on the reference image 400 . In the example shown in FIG. 2, the designated area 330 is a display area for displaying one type of product, and the designated areas 340 and 350 are display areas for displaying a plurality of types of products.

FIG. 3 schematically shows an example of an image 500 to be analyzed. An analysis target image 500 in FIG. 3 is a captured image of the product shelf 300 corresponding to the reference image 400 in FIG. Corresponding area 335, corresponding area 345, and corresponding area 355 in FIG. 3 correspond to designated area 330, designated area 340, and designated area 350 in FIG. 2, respectively.

The determination device 100 obtains a difference value between each pixel in the designated area 330 and each pixel in the corresponding area 335 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 335 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 340 and each pixel in the corresponding area 345 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 345 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 350 and each pixel in the corresponding area 355 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 355 from the acquired difference value.

The determination device 100 determines whether the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 335, 345, and 355 is lower than a predetermined shortage threshold. Here, it is assumed that the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 335 is lower than the shortage threshold, and the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 345 and 355 is higher than the shortage threshold. continue the explanation.

The determination device 100 determines that the product displayed in the corresponding area 335 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the shortage threshold is in a shortage state. The determination device 100 determines that the products displayed in each of the corresponding areas 345 and 355 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the shortage threshold is sufficient. In this way, by allowing a plurality of specified areas to be specified for the reference image 400, it is possible to grasp the state of the product in more detail.

FIG. 4 schematically shows another example of the reference image 400. As shown in FIG. A reference image 400 in FIG. 4 is a captured image of the product shelf 300 in which no products are displayed.

FIG. 4 illustrates a case where the user of the determination device 100 designates a designated area 330 , a designated area 340 , a designated area 350 , a designated area 360 , and a designated area 370 with respect to the reference image 400 . In the example shown in FIG. 4, the designated area 330, the designated area 340, the designated area 350, the designated area 360, and the designated area 370 are display areas for displaying one type of product.

FIG. 5 schematically shows another example of an image 500 to be analyzed. An analysis target image 500 in FIG. 5 is a captured image of the product shelf 300 corresponding to the reference image 400 in FIG. Corresponding area 335, corresponding area 345, corresponding area 355, corresponding area 365, and corresponding area 375 in FIG. corresponds to

The determination device 100 obtains a difference value between each pixel in the designated area 330 and each pixel in the corresponding area 335 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 335 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 340 and each pixel in the corresponding area 345 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 345 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 350 and each pixel in the corresponding area 355 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 355 from the acquired difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 360 and each pixel in the corresponding area 365 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 365 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 370 and each pixel in the corresponding area 375 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 375 from the obtained difference value.

The determination device 100 determines whether the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 335, the corresponding region 345, the corresponding region 355, the corresponding region 365, and the corresponding region 375 is lower than a predetermined shortage threshold. judge. Here, the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 335 and 375 is lower than the shortage threshold, and the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 345, 355, and 365 is is higher than the deficient threshold.

The determination device 100 determines that there is a shortage of products displayed in each of the corresponding areas 335 and 375 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the shortage threshold. The determination device 100 determines that the products displayed in each of the corresponding regions 345, 355, and 365 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is higher than the shortage threshold is in a sufficient state. do. By making it possible to specify a plurality of specified areas for the reference image 400, it is possible to set a specified area for each product type as illustrated in FIGS. It is possible to determine whether

FIG. 6 schematically shows another example of the reference image 400. As shown in FIG. A reference image 400 in FIG. 6 is a captured image of a workbench 600 of a manufacturing line on which no object is placed.

FIG. 6 illustrates a case where the user of the determination device 100 designates a designated area 630 , a designated area 640 , and a designated area 650 on the reference image 400 . In the example shown in FIG. 6, designated area 630, designated area 640, and designated area 650 are manufacturing areas for manufacturing products.

FIG. 7 schematically shows another example of the image 500 to be analyzed. An analysis target image 500 in FIG. 7 is a captured image of the workbench 600 corresponding to the reference image 400 in FIG. Corresponding area 635, corresponding area 645, and corresponding area 655 in FIG. 7 correspond to designated area 630, designated area 640, and designated area 650 in FIG. 6, respectively. Here, the explanation will be continued assuming that the manufacturing line is the manufacturing process of the corresponding region 635, the corresponding region 645, and the corresponding region 655 in that order.

The determination device 100 acquires a difference value between each pixel in the designated area 630 and each pixel in the corresponding area 635 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 635 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 640 and each pixel in the corresponding area 645 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 645 from the obtained difference value.

The determination device 100 obtains a difference value between each pixel in the designated area 650 and each pixel in the corresponding area 655 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 655 from the obtained difference value.

The determination device 100 determines whether the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 635, 645, and 655 is higher than a predetermined work threshold. Here, it is assumed that the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 645 and 655 is higher than the work threshold, and the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 635 is lower than the work threshold. continue the explanation.

The determination device 100 determines that the worker is working in each of the corresponding regions 645 and 655 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is higher than the work threshold. The determination device 100 determines that the worker is not working in the corresponding area 635 determined that the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the work threshold.

FIG. 8 schematically shows an example of a graph representing the situation of corresponding area 635, corresponding area 645, and corresponding area 655. As shown in FIG. The graph in FIG. 8A is a graph showing the ratio of the number of dissimilar pixels to the number of pixels in the corresponding regions in the corresponding regions 635, 645, and 655. FIG. The horizontal axis of the graph in (A) of FIG. 8 is time. The vertical axis of the graph in FIG. 8A is the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region.

Graph (B) of FIG. 8 is a graph showing the result of binarization processing of the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region in the corresponding region 635 by the determination device 100, and the graph of (C) of FIG. is a graph showing the result of binarization processing of the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region in the corresponding region 645 by the determination device 100, and the graph of (D) in FIG. 10 is a graph showing the result of binarizing the ratio of the number of dissimilar pixels to the number of corresponding region pixels in 655; In the binarization process here, when the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is higher than the working threshold, the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is set to 1, and the dissimilar pixels to the number of pixels in the corresponding region are This is a process of setting the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region to 0 when the ratio of the number is lower than the working threshold.

The horizontal axis of the graph of (B) of FIG. 8, the graph of (C) of FIG. 8, and the graph of (D) of FIG. 8 is time. 0 on the vertical axis of the graph in FIG. 8B, the graph in FIG. 8C, and the graph in FIG. 1 on the vertical axis of the graph of FIG. 8B, the graph of FIG. 8C, and the graph of FIG. 8D represents the state in which the worker is working.

From the graph of (B) of FIG. 8, the graph of (C) of FIG. 8, and the graph of (D) of FIG. It can be seen that the work started after 20 minutes in the corresponding area 645 has not finished even after 100 minutes, and that the work has not been performed in the corresponding area 655 since about 70 minutes. As a result, it can be seen that the production of products is delayed in the corresponding region 645 .

FIG. 9 schematically shows another example of the reference image 400. As shown in FIG. A reference image 400 in FIG. 9 is a captured image of the desk 700 on which no object is placed, captured from above.

FIG. 9 illustrates a case where the user of the determination device 100 designates a designated area 730 and a designated area 740 on the reference image 400 . Designated area 730 and designated area 740 are seating areas.

FIG. 10 schematically shows another example of the image 500 to be analyzed. An analysis target image 500 in FIG. 10 is a captured image of the desk 700 captured from above, corresponding to the reference image 400 in FIG. Corresponding regions 735 and 745 in FIG. 10 correspond to designated regions 730 and 740 in FIG. 9, respectively.

The determination device 100 obtains a difference value between each pixel in the designated area 730 and each pixel in the corresponding area 735 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 735 from the obtained difference value.

The determination device 100 acquires a difference value between each pixel in the designated area 740 and each pixel in the corresponding area 745 . The determination device 100 derives the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 745 from the obtained difference value.

The determination device 100 determines whether each ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding regions 735 and 745 is higher than a predetermined usage threshold. Here, the description is continued assuming that the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 735 is higher than the usage threshold, and the ratio of the number of dissimilar pixels to the number of corresponding region pixels in the corresponding region 745 is lower than the usage threshold.

The determination device 100 determines that the seat in the corresponding area 735 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the usage threshold is in the occupied state. The state of use may be a state in which a person is sitting on a seat, or a state in which luggage, books, or the like are placed on the desk 700 . The determination device 100 determines that the seat in the corresponding area 745 for which the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the usage threshold is vacant.

FIG. 11 schematically shows an example of the functional configuration of the determination device 100. As shown in FIG. The determination device 100 includes an image storage unit 102, an image acquisition unit 104, a display control unit 106, a specified area acquisition unit 108, a difference value acquisition unit 110, a threshold storage unit 112, a threshold setting unit 113, a situation determination unit 114, and a situation notification unit. 116 , an image analysis unit 120 , a candidate area determination unit 122 , and a candidate area presentation unit 124 . It should be noted that it is not essential for the determination device 100 to have all of these configurations.

The image storage unit 102 stores captured images. The image storage unit 102 stores, for example, multiple images. The image storage unit 102 stores the reference image 400, for example. The image storage unit 102 stores an analysis target image 500, for example. The image storage unit 102 may store images of products. The image storage unit 102 may store images of products.

The reference image 400 includes, for example, multiple display areas, each of which is an area for displaying one or more types of products. Reference image 400 includes a plurality of manufacturing areas, which are, for example, areas where products are manufactured. Reference image 400 includes, for example, a plurality of seat regions.

The image acquisition unit 104 acquires a captured image. The image acquisition unit 104 acquires a captured image from the camera 200, for example. The image acquisition unit 104 may acquire a captured image captured by an imaging unit included in the determination device 100 . The image acquisition unit 104 stores the acquired captured image in the image storage unit 102 .

The image acquisition unit 104 acquires the reference image 400, for example. The image acquisition unit 104 acquires the analysis target image 500, for example. The image acquisition unit 104 may acquire an image of the product. The image acquisition unit 104 may acquire an image of the product.

The display control unit 106 controls display on the display unit. The display control unit 106 controls the display of the display unit so as to display the captured image stored in the image storage unit 102, for example. The display control unit 106 controls display of a display unit included in the determination device 100, for example. The display control unit 106 may control the display of the display unit of the communication terminal owned by the user of the determination device 100 . In this case, the display control unit 106 may transmit the captured image to the communication terminal owned by the user of the determination device 100 . The display unit displays the captured image under the control of the display control unit 106 .

The specified area acquisition unit 108 acquires a specified area specified by the user of the determination device 100 with respect to the reference image 400 stored in the image storage unit 102 . The designated area obtaining unit 108 obtains, for example, a plurality of designated areas designated by the user of the determination device 100 with respect to the reference image 400 .

The designated area acquisition unit 108 acquires the designated area by, for example, receiving input from the user of the determination device 100 using an input device included in the determination device 100 . The specified area acquiring unit 108 may acquire the specified area by receiving the specified area from the communication terminal owned by the user of the determination device 100 .

The designated area obtaining unit 108 obtains, for example, a plurality of designated areas designated by the user of the determination device 100 for a plurality of display areas included in the reference image 400 . For example, the specified area acquisition unit 108 acquires two specified areas specified by the user of the determination device 100 for each of the first partial area and the second partial area of one display area included in the reference image 400. to get For example, the first partial area and the second partial area are the front area and the rear area of one display area. The first partial area and the second partial area may be the right side area and the left side area of one display area.

The designated area obtaining unit 108 may obtain a plurality of designated areas designated by the user of the designated area obtaining unit 108 for a plurality of manufacturing areas included in the reference image 400 . The designated area acquisition unit 108 may acquire a plurality of designated areas designated by the user of the determination device 100 for a plurality of seat areas included in the reference image 400 .

The designated area may be an area of any shape. The designated area is, for example, a polygonal area. The designated area is, for example, a rectangular area. The designated area may be a circular area. The designated area may be an elliptical area.

The difference value acquiring unit 110 extracts each pixel in the designated area of the reference image 400 stored in the image storage unit 102 and the analysis object image 500 stored in the image storage unit 102 into the designated area in the reference image 400. Get the difference value with each pixel in the corresponding corresponding region. For example, the difference value acquiring unit 110 obtains each pixel in each of the plurality of specified regions of the reference image 400 and each pixel in each corresponding region of the analysis target image 500 corresponding to each specified region in the reference image 400. Get the difference value with

The difference value acquisition unit 110 may acquire an average difference value, which is a difference value between the average value of each pixel in the designated area and the average value of each pixel in the product image. The difference value acquisition unit 110 may acquire an average difference value, which is a difference value between the average value of each pixel in the designated area and the average value of each pixel in the image of the product.

The threshold storage unit 112 stores a predetermined threshold. The threshold storage unit 112 stores, for example, a plurality of predetermined thresholds.

The threshold storage unit 112 stores, for example, a difference threshold. The threshold storage unit 112 stores, for example, an insufficient threshold. The threshold storage unit 112 stores, for example, work thresholds. The threshold storage unit 112 stores, for example, usage thresholds.

The threshold storage unit 112 may store, for example, each of a plurality of difference thresholds in association with each of a plurality of designated regions. The threshold storage unit 112 may store each of the plurality of difference thresholds in association with the identification information of the product displayed in each of the plurality of designated areas and each of the plurality of corresponding areas.

The threshold setting unit 113 sets a threshold. The threshold setting unit 113 sets the threshold by, for example, receiving input from the user of the determination device 100 using an input device included in the determination device 100 . The threshold setting unit 113 may set the threshold by receiving information for setting the threshold from the communication terminal owned by the user of the determination device 100 . The threshold setting unit 113 stores the set threshold in the threshold storage unit 112 .

The threshold setting unit 113 sets, for example, a difference threshold. The threshold setting unit 113 sets, for example, a shortage threshold. The threshold setting unit 113 sets, for example, a work threshold. The threshold setting unit 113 sets, for example, a usage threshold.

For example, when the reference image 400 includes a plurality of display areas, the threshold setting unit 113 sets the threshold based on the average difference value, which is the difference between the average value of each pixel in the specified area and the average value of each pixel in the product image. to set the difference threshold. For example, the threshold value setting unit 113 sets a lower difference threshold value as the average difference value is smaller.

For example, when the reference image 400 includes a plurality of manufacturing regions, the threshold value setting unit 113 is based on the average difference value, which is the difference value between the average value of each pixel in the designated region and the average value of each pixel in the image of the product. to set the difference threshold. For example, the threshold value setting unit 113 sets a lower difference threshold value as the average difference value is smaller.

The status determination unit 114 determines the status of the corresponding area. The status determination unit 114 determines the status of the corresponding region based on, for example, the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region. For example, the situation determination unit 114 determines the number of pixels in the corresponding region based on the ratio of the number of dissimilar pixels higher than the difference threshold stored in the threshold storage unit 112 with the difference value associated with the specified region, to the number of pixels in the corresponding region. determine the situation.

For example, when the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is lower than the shortage threshold, the situation determination unit 114 determines that the product in the corresponding region corresponding to the specified region specified for the display region is in a shortage state. judge. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the shortage threshold, the situation determination unit 114 determines that the products in the corresponding area corresponding to the specified area specified for the display area are in a sufficient state. .

For example, when the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is the same as the shortage threshold, the situation determination unit 114 determines that the product in the corresponding region corresponding to the specified region specified for the display region is in a shortage state. Determine that there is. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is the same as the shortage threshold, the situation determination unit 114 determines that the product in the corresponding region corresponding to the specified region specified for the display region is in a sufficient state. You can judge.

For example, the situation determination unit 114 determines that the ratio of the number of dissimilar pixels with respect to the number of pixels in the corresponding region that is higher than the difference threshold stored in the threshold storage unit 112 in association with the identification information of the specified region and product is If it is lower than the shortage threshold, it is determined that the product in the corresponding area is in a shortage state. The situation determination unit 114 determines that the ratio of the number of dissimilar pixels with respect to the number of pixels in the corresponding region, whose difference value is higher than the difference threshold stored in the threshold storage unit 112 in association with the identification information of the designated region and product, is the insufficient threshold. If it is higher, it is determined that the product in the corresponding area is in a sufficient state.

For example, the situation determination unit 114 determines the ratio of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area corresponding to the specified area specified for the first partial area of one display area, and the number of pixels of the one display area. For each of the first partial area and the second partial area, based on the ratio of the number of dissimilar pixels to the number of corresponding area pixels in the corresponding area corresponding to the specified area specified for the second partial area The state of the product in the two corresponding areas corresponding to the two specified areas specified by the user of the determination device 100 is determined. For example, the situation determination unit 114 determines the ratio of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area corresponding to the specified area specified for the first partial area and the number of dissimilar pixels specified for the second partial area. If both the ratios of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area corresponding to the designated area are lower than the shortage threshold, it is determined that the products in the two corresponding areas are in the shortage state. The situation determination unit 114 determines the ratio of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area corresponding to the specified area specified for the first partial area and the specified area specified for the second partial area. If both ratios of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area are higher than the shortage threshold, it is determined that the products in the two corresponding areas are in the sufficient state.

The situation determination unit 114 determines the ratio of the number of dissimilar pixels to the number of pixels in the corresponding area of the corresponding area corresponding to the specified area specified for the first partial area and the specified area specified for the second partial area. If either one of the ratios of the number of dissimilar pixels to the number of pixels in the corresponding region of the corresponding region is lower than the shortage threshold, the state of the product in the two corresponding regions is between the state of shortage and the state of sufficiency is determined to be an intermediate state. When the first partial area is the front area of one display area and the second partial area is the rear area of the one display area, the situation determination unit 114 determines the The ratio of the number of dissimilar pixels to the number of corresponding area pixels of the corresponding area corresponding to the specified area is lower than the shortage threshold, and the corresponding area pixels of the corresponding area corresponding to the specified area specified for the second partial area If the ratio of the number of dissimilar pixels to the number of pixels is higher than the shortage threshold, the product in the corresponding region corresponding to the specified region specified for the second partial region is replaced with the product specified for the first partial region. It may be determined that the corresponding area corresponding to the area can be advanced.

For example, if the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is higher than the work threshold, the situation determination unit 114 determines that the worker is working in the corresponding region corresponding to the designated region designated for the manufacturing region. state. For example, if the ratio of the number of dissimilar pixels to the number of pixels in the corresponding region is higher than the work threshold during a predetermined period, the situation determination unit 114 , the production of the product is determined to be in a stagnant state. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is lower than the work threshold, the situation determination unit 114 determines that the worker is not working in the corresponding region corresponding to the designated region designated for the manufacturing region. Determine that there is.

For example, when the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is the same as the work threshold, the situation determination unit 114 determines whether the worker is working in the corresponding region corresponding to the designated region designated for the manufacturing region. It is determined that the If the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is the same as the work threshold, the situation determination unit 114 determines that the worker is not working in the corresponding region corresponding to the designated region designated for the manufacturing region. state may be determined.

For example, when the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the utilization threshold, the situation determination unit 114 determines that the seats in the corresponding area corresponding to the designated area designated for the seat area are in the occupied state. judge. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the utilization threshold, the situation determination unit 114 determines that the seats in the corresponding area corresponding to the designated area designated for the seat area are in an empty state. .

For example, when the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is the same as the utilization threshold, the situation determination unit 114 determines that the seats in the corresponding area corresponding to the designated area designated for the seat area are in the occupied state. I judge. When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is the same as the utilization threshold, the situation determination unit 114 determines that the seat in the corresponding area corresponding to the designated area designated for the seat area is in an empty state. You may

The status notification unit 116 notifies the status of the corresponding area determined by the status determination unit 114 . The status notification unit 116 notifies the status of the corresponding area by, for example, displaying the status of the corresponding area on the display unit included in the determination device 100 . The status notification unit 116 may notify the status of the corresponding area by transmitting the status of the corresponding area to the communication terminal owned by the user of the determination device 100 .

The image analysis unit 120 analyzes captured images stored in the image storage unit 102 . The image analysis unit 120 analyzes a plurality of analysis target images 500 stored in the image storage unit 102, for example.

For example, when the analysis target image 500 is a captured image including a plurality of manufacturing regions, the image analysis unit 120 analyzes each of the plurality of past analysis target images 500, and determines whether an object that is not a product in the analysis target image 500 is Identify regions that are detected at a frequency greater than or equal to a specified frequency. A non-product object is, for example, a worker's hand. A non-product object may be a tool.

The candidate area determination unit 122 determines candidate areas that are candidates for the specified area. For example, the candidate area determination unit 122 determines, as candidate areas, areas excluding areas in which non-product objects are detected at a frequency equal to or higher than a predetermined frequency, among the plurality of manufacturing areas.

Candidate area presentation section 124 presents the candidate area determined by candidate area determination section 122 to the user of determination device 100 . The candidate area presenting unit 124 presents the candidate area to the user of the determination device 100 by, for example, superimposing the candidate area on the reference image 400 displayed by the display unit.

FIG. 12 schematically shows an example of the flow of processing by the determination device 100. As shown in FIG. In FIG. 12, a state in which the image acquisition unit 104 has not acquired the reference image 400 will be described as a start state.

In step (the step may be abbreviated as S) 102 , the image acquisition unit 104 acquires the reference image 400 . In S<b>104 , the specified area acquisition unit 108 acquires a plurality of specified areas specified by the user of the determination device 100 with respect to the reference image 400 . The user of the determination device 100 designates a plurality of designated regions while confirming the reference image 400, for example.

In S<b>106 , the image acquisition unit 104 acquires the analysis target image 500 . In S108, the status determination unit 114 determines the status of the corresponding area based on the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area in the corresponding area corresponding to the specified area. In S110, the status determination unit 114 determines whether or not the status of all corresponding areas has been determined. If all corresponding areas have been determined, the process proceeds to S112. If all corresponding areas have not been determined, the process returns to S108.

In S<b>112 , the status notification unit 116 notifies the status of the plurality of corresponding regions determined by the status determination unit 114 . After that, the process ends.

FIG. 13 schematically shows an example of a hardware configuration of a computer 1200 functioning as the determination device 100. As shown in FIG. Programs installed on the computer 1200 cause the computer 1200 to act as one or more "parts" of the apparatus of the above embodiments, or cause the computer 1200 to operate or perform operations associated with the apparatus of the above embodiments. Multiple "units" can be executed and/or the computer 1200 can be caused to execute the processes or steps of the processes according to the above embodiments. Such programs may be executed by CPU 1212 to cause computer 1200 to perform certain operations associated with some or all of the blocks in the flowcharts and block diagrams described herein.

Computer 1200 according to this embodiment includes CPU 1212 , RAM 1214 , and graphics controller 1216 , which are interconnected by host controller 1210 . Computer 1200 also includes input/output units such as communication interface 1222 , storage device 1224 , DVD drive 1226 , and IC card drive, which are connected to host controller 1210 via input/output controller 1220 . DVD drive 1226 may be a DVD-ROM drive, a DVD-RAM drive, and the like. Storage devices 1224 may be hard disk drives, solid state drives, and the like. Computer 1200 also includes legacy input/output units, such as ROM 1230 and keyboard 1242 , which are connected to input/output controller 1220 via input/output chip 1240 .

The CPU 1212 operates according to programs stored in the ROM 1230 and RAM 1214, thereby controlling each unit. Graphics controller 1216 retrieves image data generated by CPU 1212 into a frame buffer or the like provided in RAM 1214 or itself, and causes the image data to be displayed on display device 1218 .

Communication interface 1222 communicates with other electronic devices over a network. Storage device 1224 stores programs and data used by CPU 1212 within computer 1200 . DVD drive 1226 reads programs or data from DVD-ROM 1227 or the like and provides them to storage device 1224 . The IC card drive reads programs and data from IC cards and/or writes programs and data to IC cards.

ROM 1230 stores therein programs that are dependent on the hardware of computer 1200, such as a boot program that is executed by computer 1200 upon activation. Input/output chip 1240 may also connect various input/output units to input/output controller 1220 via USB ports, parallel ports, serial ports, keyboard ports, mouse ports, and the like.

The program is provided by a computer-readable storage medium such as DVD-ROM 1227 or IC card. The program is read from a computer-readable storage medium, installed in storage device 1224 , RAM 1214 , or ROM 1230 , which are also examples of computer-readable storage media, and executed by CPU 1212 . The information processing described within these programs is read by computer 1200 to provide coordination between the programs and the various types of hardware resources described above. An apparatus or method may be configured by implementing information operations or processing according to the use of computer 1200 .

For example, when communication is performed between the computer 1200 and an external device, the CPU 1212 executes a communication program loaded into the RAM 1214 and sends communication processing to the communication interface 1222 based on the processing described in the communication program. you can command. Under the control of the CPU 1212, the communication interface 1222 reads transmission data stored in a transmission buffer area provided in a recording medium such as a RAM 1214, a storage device 1224, a DVD-ROM 1227, or an IC card, and transmits the read transmission data. Data is transmitted to the network, or received data received from the network is written in a receive buffer area or the like provided on the recording medium.

In addition, the CPU 1212 causes the RAM 1214 to read all or necessary portions of files or databases stored in external recording media such as the storage device 1224, DVD drive 1226 (DVD-ROM 1227), IC card, etc. Various types of processing may be performed on the data. CPU 1212 may then write back the processed data to an external recording medium.

Various types of information, such as various types of programs, data, tables, and databases, may be stored on recording media and subjected to information processing. CPU 1212 performs various types of operations on data read from RAM 1214, information processing, conditional decisions, conditional branching, unconditional branching, and information retrieval, which are described throughout this disclosure and are specified by instruction sequences of programs. Various types of processing may be performed, including /replace, etc., and the results written back to RAM 1214 . In addition, the CPU 1212 may search for information in a file in a recording medium, a database, or the like. For example, when a plurality of entries each having an attribute value of a first attribute associated with an attribute value of a second attribute are stored in the recording medium, the CPU 1212 selects the first attribute from among the plurality of entries. search for an entry that matches the specified condition of the attribute value of the attribute, read the attribute value of the second attribute stored in the entry, and thereby determine the first attribute that satisfies the predetermined condition An attribute value of the associated second attribute may be obtained.

The programs or software modules described above may be stored in a computer-readable storage medium on or near computer 1200 . Also, a recording medium such as a hard disk or RAM provided in a server system connected to a dedicated communication network or the Internet can be used as a computer-readable storage medium, whereby the program can be transferred to the computer 1200 via the network. offer.

The blocks in the flowcharts and block diagrams in this embodiment may represent steps in the process in which the operations are performed or "parts" of the apparatus responsible for performing the operations. Certain steps and "sections" may be provided with dedicated circuitry, programmable circuitry provided with computer readable instructions stored on a computer readable storage medium, and/or computer readable instructions provided with computer readable instructions stored on a computer readable storage medium. It may be implemented by a processor. Dedicated circuitry may include digital and/or analog hardware circuitry, and may include integrated circuits (ICs) and/or discrete circuitry. Programmable circuits, such as Field Programmable Gate Arrays (FPGAs), Programmable Logic Arrays (PLAs), etc., perform AND, OR, EXCLUSIVE OR, NOT AND, NOT OR, and other logical operations. , flip-flops, registers, and memory elements.

A computer-readable storage medium may comprise any tangible device capable of storing instructions to be executed by a suitable device, such that a computer-readable storage medium having instructions stored thereon may be illustrated in flowchart or block diagram form. It will comprise an article of manufacture containing instructions that can be executed to create means for performing specified operations. Examples of computer-readable storage media may include electronic storage media, magnetic storage media, optical storage media, electromagnetic storage media, semiconductor storage media, and the like. More specific examples of computer readable storage media include floppy disks, diskettes, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory) , electrically erasable programmable read only memory (EEPROM), static random access memory (SRAM), compact disc read only memory (CD-ROM), digital versatile disc (DVD), Blu-ray disc, memory stick , integrated circuit cards, and the like.

The computer readable instructions may be assembler instructions, Instruction Set Architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state configuration data, or instructions such as Smalltalk, JAVA, C++, etc. any source or object code written in any combination of one or more programming languages, including object-oriented programming languages, and conventional procedural programming languages such as the "C" programming language or similar programming languages; may include

Computer readable instructions are used to produce means for a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus, or programmable circuits to perform the operations specified in the flowchart or block diagrams. A general purpose computer, special purpose computer, or other programmable data processor, locally or over a wide area network (WAN) such as the Internet, etc., to execute such computer readable instructions. It may be provided in the processor of the device or in a programmable circuit. Examples of processors include computer processors, processing units, microprocessors, digital signal processors, controllers, microcontrollers, and the like.

Although the invention according to the present disclosure has been described above using the embodiments, the technical scope of the invention according to the present disclosure is not limited to the scope described in the above embodiments. It is obvious to those skilled in the art that various modifications or improvements can be made to the above embodiments. It is clear from the description of the scope of the claims that forms with such modifications or improvements can also be included in the technical scope of the present invention.

The execution order of each process such as actions, procedures, steps, and stages in the devices, systems, programs, and methods shown in the claims, the specification, and the drawings is etc., and it should be noted that they can be implemented in any order unless the output of the previous process is used in the subsequent process. Regarding the operation flow in the claims, the specification, and the drawings, even if the description is made using "first," "next," etc. for convenience, it means that it is essential to carry out in this order. not a thing

10 system, 20 network, 100 determination device, 102 image storage unit, 104 image acquisition unit, 106 display control unit, 108 specified area acquisition unit, 110 difference value acquisition unit, 112 threshold storage unit, 113 threshold setting unit, 114 situation determination Unit 116 Status notification unit 120 Image analysis unit 122 Candidate area determination unit 124 Candidate area presentation unit 200 Camera 300 Product shelf 330 Designated area 335 Corresponding area 340 Designated area 345 Corresponding area 350 Designated area , 355 corresponding area, 360 designated area, 365 corresponding area, 370 designated area, 375 corresponding area, 400 reference image, 500 analysis target image, 600 workbench, 630 designated area, 635 corresponding area, 640 designated area, 645 corresponding area, 650 designated area, 655 corresponding area, 700 desk, 730 designated area, 735 corresponding area, 740 designated area, 745 corresponding area, 1200 computer, 1210 host controller, 1212 CPU, 1214 RAM, 1216 graphic controller, 1218 display device, 1220 input Output controller, 1222 communication interface, 1224 storage device, 1226 DVD drive, 1227 DVD-ROM, 1230 ROM, 1240 input/output chip

Claims (11)

A determination device,
an image storage unit that stores a pre-captured reference image;
a threshold storage unit that stores a predetermined difference threshold;
a specified area acquiring unit that acquires a plurality of specified areas specified by a user of the determination device with respect to the reference image;
an image acquisition unit that acquires an analysis target image that is the target of image analysis;
Obtaining a difference value between each pixel in each of the plurality of specified regions of the reference image and each pixel in each corresponding region of the analysis target image corresponding to each of the specified regions in the reference image. a difference value acquisition unit;
For each of the corresponding regions of the image to be analyzed, the number of dissimilar pixels, which is the number of pixels in the corresponding region in which the difference value is higher than the difference threshold, relative to the number of pixels in the corresponding region, which is the number of pixels in the corresponding region A determination device comprising: a situation determination unit that determines the situation of the corresponding area based on the ratio. The threshold storage unit stores each of the plurality of difference thresholds in association with each of the plurality of specified regions,
The situation determination unit determines, based on the ratio of the number of dissimilar pixels higher than the difference threshold stored in the threshold storage unit that the difference value is associated with the designated area, to the number of pixels in the corresponding area, determine the status of the corresponding area;
The determination device according to claim 1. The image storage unit stores the reference image including a plurality of display areas, each of which is an area for displaying one or more types of products;
The threshold storage unit further stores a predetermined shortage threshold,
The specified area acquisition unit acquires the plurality of specified areas specified by the user for the plurality of display areas,
When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is lower than the shortage threshold, the situation determination unit determines that the product in the corresponding area corresponding to the specified area specified for the display area is in a shortage state. determine that
The determination device according to claim 1 or 2. The specified area acquisition unit acquires the plurality of specified areas specified by the user for the plurality of display areas each displaying one type of product,
The threshold storage unit stores each of the plurality of difference thresholds in association with identification information of products displayed in each of the plurality of designated areas and each of the plurality of corresponding areas;
The situation determination unit determines the number of pixels in the corresponding region, the dissimilar pixels whose difference value is higher than the difference threshold stored in the threshold storage unit in association with the identification information of the specified region and the product. If the ratio of the number is lower than the shortage threshold, determine that the product in the corresponding area is in a shortage state;
The determination device according to claim 3. The image storage unit further stores an image of the product,
The difference value acquisition unit acquires an average difference value, which is a difference value between the average value of each pixel in the specified area and the average value of each pixel in the image of the product,
The determination device is
The determination device according to claim 4, further comprising a threshold setting unit that sets the difference threshold based on the average difference value. The specified area acquiring unit acquires the two specified areas specified by the user for each of a first partial area and a second partial area of the one display area,
The situation determination unit determines a ratio of the number of dissimilar pixels to the number of pixels of the corresponding region of the corresponding region corresponding to the designated region designated for the first partial region, and and the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area of the corresponding area corresponding to the specified area specified for the product in the two corresponding areas corresponding to the two specified areas determine the state of
The determination device according to any one of claims 3 to 5. The first partial area is a front area of the one display area,
the second partial area is a rear area of the one display area;
The situation determination unit determines that a ratio of the number of dissimilar pixels to the number of pixels of the corresponding region in the corresponding region corresponding to the designated region designated for the first partial region is lower than the shortage threshold, and , if the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region of the corresponding region corresponding to the designated region designated for the second partial region is higher than the shortage threshold, the second portion The product in the corresponding area corresponding to the specified area specified for the area can be advanced to the corresponding area corresponding to the specified area specified for the first partial area. determine that
The determination device according to claim 6. The image storage unit stores the reference image including a plurality of manufacturing areas that are areas for manufacturing products,
The threshold storage unit further stores a predetermined work threshold,
The specified area acquiring unit acquires the plurality of specified areas specified by the user for the plurality of manufacturing areas,
If the ratio of the number of dissimilar pixels to the number of pixels of the corresponding region is higher than the work threshold during a predetermined period, the situation determination unit determines whether the correspondence corresponding to the designated region designated for the manufacturing region determining that production of the product is stalled in a region;
The determination device according to any one of claims 1 to 7. the image storage unit stores the reference image including a plurality of seat areas;
The threshold storage unit further stores a predetermined usage threshold,
The specified area acquisition unit acquires the plurality of specified areas specified by the user for the plurality of seat areas,
When the ratio of the number of dissimilar pixels to the number of pixels of the corresponding area is higher than the utilization threshold, the situation determination unit determines that the seat in the corresponding area corresponding to the designated area designated for the seat area is in a occupied state. determine that there is
The determination device according to any one of claims 1 to 8. A program for causing a computer to function as the determination device according to any one of claims 1 to 9. A computer-implemented determination method comprising:
a specified area acquisition step of acquiring a plurality of specified areas specified by a user of the computer with respect to a pre-captured reference image;
an image acquisition step of acquiring an image to be analyzed, which is the target of image analysis;
Obtaining a difference value between each pixel in each of the plurality of specified regions of the reference image and each pixel in each corresponding region of the analysis target image corresponding to each of the specified regions in the reference image. a differential value acquisition step;
For each of the corresponding regions of the image to be analyzed, dissimilarity is the number of pixels in the corresponding region where the difference value is higher than a predetermined difference threshold with respect to the number of pixels in the corresponding region, which is the number of pixels in the corresponding region. and determining the status of the corresponding area based on the ratio of the number of pixels.

Images