JP2015176265A - Commodity shelf monitoring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a commodity shelf monitoring method for monitoring that, in a shop, frozen commodities or refrigerated commodities are left on a room temperature commodity shelf on which commodities which can be stored in room temperature are displayed.SOLUTION: In a commodity shelf monitoring system including a temperature sensor A001, a store server A002 and a notification receiver A005, the temperature sensor A001 monitors that frozen commodities or refrigerated commodities X001 are left on a room temperature commodity shelf A004, and temperature distribution data acquired with the temperature sensor A001 is analyzed by the store server A002. Then, when it is determined that the frozen commodities or the refrigerated commodities are left on the room temperature commodity shelf A004 by the store server A002, by notifying the notification receiver A005 of information about the commodities being left as to the frozen commodities or refrigerated commodities X001 being left on the room temperature commodity shelf A004, notification is given to a clerk that the commodities are left on the room temperature commodity shelf.

Description

  The present invention relates to a product shelf monitoring method for monitoring whether a frozen product or a refrigerated product is left on a room temperature product shelf in which a product that can be stored at room temperature is left in a store such as a supermarket or a convenience store.

  As a conventional merchandise shelf monitoring method, there is a method in which a merchandise shelf is monitored by an image recognition technique disclosed in Patent Document 1 and inventory management is performed.

  This merchandise shelf monitoring method applies image processing to images captured by a plurality of cameras for merchandise displayed on the merchandise shelf, contour feature data such as the contour shape of the product, and a pre-registered contour feature data file The quantity of individual commodities is counted based on the contour feature data of the same shape.

JP 2001-88912 A

  In recent years, in stores such as supermarkets and convenience stores, when a customer purchases frozen or refrigerated products once in a shopping cart, the frozen or refrigerated products are displayed in the original frozen state. There is a problem that the product is not returned to the product shelf or the refrigerated product shelf, but left in the room temperature product shelf on which products stored at room temperature are displayed. However, the prior art disclosed in Patent Document 1 is to extract the contour shape of a product with a camera and count the number of individual products. From the contour feature data, there are products that are left on the room temperature product shelf. It is not possible to determine whether the product is frozen or refrigerated, and there is a problem that the frozen or refrigerated product left on the shelf at room temperature is left for a long time and the frozen or refrigerated product is discarded. It was.

  This invention solves the said subject, and it aims at notifying a store clerk when frozen goods or refrigerated goods are left in the normal temperature goods shelf.

  It is another object of the present invention to reduce the number of frozen or refrigerated merchandise discarded due to the frozen or refrigerated merchandise being left at room temperature.

  In order to solve the above-mentioned problem, the product shelf monitoring method of the present invention is a product shelf monitoring method in a product shelf monitoring system that monitors the state of the product shelf in the store, using a temperature sensor, Whether the temperature distribution of a plurality of room temperature product shelves displaying products stored at room temperature is acquired, and whether frozen products or refrigerated products are left for each of the plurality of room temperature product shelves based on the acquired temperature distribution data If it is determined that a frozen product or a refrigerated product is left in at least one of the plurality of normal temperature product shelves, the frozen product or the refrigerated product is determined to be left. Based on the product shelf ID added to the room temperature product shelf, the room temperature product shelf in which the frozen product or the refrigerated product is left out of the plurality of room temperature product shelves in the store is notified. It is characterized in.

  With this configuration, when the frozen product or the refrigerated product is left on the room temperature product shelf, the store clerk can be notified that the frozen product or the refrigerated product is left on the room temperature product shelf.

  In addition, according to this configuration, the number of discarded products of the frozen product or the refrigerated product when the frozen product or the refrigerated product is left at room temperature can be reduced.

  Further, in the product shelf monitoring method of the present invention, the method for determining whether or not a frozen product or a refrigerated product is left on the room temperature product shelf is a temperature lower than the room temperature in the room temperature product shelf, When a low temperature region having a temperature difference greater than a predetermined value is detected, it is determined that a frozen product or a refrigerated product is left on the room temperature product shelf.

  Further, in the product shelf monitoring method of the present invention, the neglect determination method holds the passage area and the room temperature product shelf area as region information in advance within the angle of view of the temperature sensor, and the low temperature region is the passage. If it is present in the region, it is not determined that the frozen product or the refrigerated product is left on the room temperature product shelf, and if the low temperature region exists in the room temperature product shelf region, the room temperature product shelf It is determined that a frozen product or a refrigerated product is left unattended.

  According to this configuration, it is possible to distinguish between the state where the customer is moving through the passage with a frozen product or a refrigerated product, and the state where the frozen product or the refrigerated product is left on the room temperature product shelf, thereby improving the accuracy of leaving determination. Can do.

  In addition, when the low temperature region is detected within the angle of view of the temperature sensor, the neglect determination method refers to the temperature distribution data in time series, and when the temperature region is moving, It is not determined that a frozen product or a refrigerated product is left on the shelf, and it is determined that a frozen product or a refrigerated product is left on the room temperature product shelf when the low temperature region is not moved. To do.

  According to this configuration, it is possible to distinguish between the state where the customer is moving through the passage with a frozen product or a refrigerated product, and the state where the frozen product or the refrigerated product is left on the room temperature product shelf, thereby improving the accuracy of leaving determination. Can do.

  Further, by combining the method for determining the region where the frozen product or the refrigerated product is present and the method for determining the movement of the frozen product or the refrigerated product, it is possible to further increase the accuracy of leaving determination.

  In the product shelf monitoring method of the present invention, the notification method for notifying the store clerk of the room temperature product shelf where the frozen product or the refrigerated product is left unattended is the room temperature product shelf installed in the store. A floor plan is displayed on the display terminal, and based on the product shelf ID, among the room temperature product shelves displayed on the floor plan, it is determined that the frozen product or the refrigerated product is left in the leaving determination method. The display form of the position corresponding to the normal room temperature shelf is visually notified by making it different from the position corresponding to the other room temperature room shelf.

  According to this configuration, the store clerk can visually recognize simultaneously that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room product shelf is left.

  Further, in the case where it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf, the notification method includes a time from the determination to the present time and a temperature in a low temperature region detected by the leaving determination method. It is characterized by notifying store staff of changes in distribution.

  According to this configuration, the store clerk can leave the frozen or refrigerated product left on the room temperature product shelf back to the original frozen product shelf or refrigerated product shelf, or leave it as a material for determining whether to discard it. Changes in time and temperature distribution in the low temperature region can be used.

  In the notification method, when it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf, the position of the room temperature product shelf where the product is left and the frozen product or the refrigerated product are left. This is characterized in that the store clerk is notified by in-store broadcast using a secret word that only the store clerk can understand.

  According to this configuration, the customer who left the frozen product or the refrigerated product on the room temperature product shelf does not feel that the customer has been accused of leaving the frozen product or the refrigerated product. When it is determined that the product has been left on the room temperature shelf, a customer who was accidentally near the room temperature shelf is suspected by the person who left the frozen product or refrigerated product on the room temperature shelf and the surrounding people. Without feeling that this is the case, it is possible to notify the store clerk of information that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room temperature product shelf is left.

  In addition, when it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf, the notification method is configured to generate a sound from a sound reproducing device installed in the room temperature product shelf in which the frozen product or the refrigerated product is left. The notification of the position of the room temperature product shelf and the information indicating that the frozen product or the refrigerated product is left unattended is made.

  According to this configuration, the store clerk who does not have the display terminal is notified of the information that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room temperature product shelf is left. Can do.

  Further, according to this configuration, even if the store clerk is away from the room temperature product shelf where the frozen product or the refrigerated product is left, the store clerk is informed that the frozen product or the refrigerated product is left on the room temperature product shelf. , Information on which room temperature shelf is left unattended can be notified.

  Further, in the notification method, when it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf, the light installed in the room temperature product shelf in which the frozen product or the refrigerated product is left is informed of the abnormality. By lighting in the mode, the position of the room temperature product shelf and information that the frozen product or the refrigerated product is left are notified.

  According to this configuration, the store clerk who does not have the display terminal is notified of the information that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room temperature product shelf is left. Can do.

  Furthermore, according to this configuration, in order to improve the appearance of the product, the light installed on the room temperature product shelf or the light installed on the ceiling is diverted to store the frozen product or refrigerated product to the room temperature product shelf. It is possible to notify information indicating that the product is left and information indicating which room temperature shelf is left.

  Further, in the product shelf monitoring method of the present invention, the product shelf monitoring system includes a cloud server that integrally manages information notified by the notification method, and the cloud server leaves a frozen product or a refrigerated product at each store. If it is determined that the frozen product or the refrigerated product is left, the location information of the room temperature product shelf where the frozen product or the refrigerated product is left is received as log information from each store, and the frozen product or the refrigerated product is left as it is from the log information of each store. It is characterized by learning the location of a room-temperature product shelf that is easily handled, and notifying each store of the learning information.

  According to this configuration, the tendency of frozen products or refrigerated products to be left unattended, the day of the week, the time zone, etc. can be understood from various cases of neglected at each store, and measures to make it difficult to leave frozen or refrigerated products in advance are taken. Can do.

  Further, the learning information is notified by an inter-store SNS capable of exchanging information between stores.

  According to this configuration, it is possible to easily collect not only information on whether or not the frozen product or the refrigerated product of the own store is stored, but also information on how to leave or store the stored information of other stores.

  Further, the product shelf monitoring system of the present invention is a product shelf monitoring system for monitoring the state of the product shelf in the store, and each of the plurality of room temperature product shelves displaying products stored at room temperature in the store. The product shelf when it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf by the leaving determination unit that determines whether the frozen product or the refrigerated product is left. Based on the ID, among the plurality of room temperature product shelves in the store, a room temperature product shelf in which the frozen product or the refrigerated product is left is specified, and the content of notification is determined and transmitted. And a notification receiving device that receives the notification content.

  According to the product shelf monitoring method of the present invention, when a frozen product or a refrigerated product is left on the room temperature product shelf, the store clerk can be notified.

  Moreover, according to the merchandise shelf monitoring method of the present invention, it is possible to reduce the number of discarded merchandise of frozen or refrigerated goods when the frozen or refrigerated goods are left at room temperature.

It is a conceptual diagram of the goods shelf monitoring method in Embodiment 1 of this invention. It is a block diagram of the goods shelf monitoring system in Embodiment 1 of the present invention. It is a sequence diagram which shows the relationship between the temperature sensor which comprises the goods shelf monitoring system in Embodiment 1 of this invention, a shop server, and a notification receiving apparatus. It is explanatory drawing of goods shelf monitoring by the temperature sensor in Embodiment 1 of this invention. It is a figure which shows an example of the temperature distribution data acquired from the temperature sensor in Embodiment 1 of this invention. It is a figure which shows an example at the time of carrying out thermal imaging of the temperature distribution data in Embodiment 1 of this invention. It is a flowchart of the leaving determination method which determines whether the frozen goods or refrigerated goods in Embodiment 1 of this invention are left in the normal temperature goods shelf. It is a flowchart of the goods shelf ID determination method which determines the goods shelf ID in which the frozen goods or refrigerated goods in Embodiment 1 of this invention are left. It is a figure which shows an example of the goods shelf ID database in Embodiment 1 of this invention. It is a figure which shows an example of the shop floor plan displayed on the display terminal in Embodiment 1 of this invention. It is a figure which shows an example at the time of displaying a shop floor plan on the display terminal in Embodiment 1 of this invention. When it is determined that the frozen product or the refrigerated product is left untreated in Embodiment 1 of the present invention, the display form of the position corresponding to the room temperature product shelf determined that the frozen product or the refrigerated product is left unattended, It is a figure which shows an example at the time of displaying differently from the position applicable to another normal temperature goods shelf. It is a figure which shows an example which notifies neglected information to a store clerk by in-store broadcasting, when it determines with the frozen goods or refrigerated goods in Embodiment 1 of this invention having been neglected. When it is determined that the frozen product or the refrigerated product is left untreated in Embodiment 1 of the present invention, the clerk makes a sound from the sound reproduction device installed on the room temperature product shelf where the frozen product or the refrigerated product is left. It is a figure which shows an example which notifies neglected information to. When it is determined that the frozen product or the refrigerated product is left untreated in Embodiment 1 of the present invention, the store clerk is made to turn on the lights installed on the room temperature product shelf where the frozen product or the refrigerated product is left untreated. It is a figure which shows an example which notifies neglected information. It is a flowchart of the notification content determination method which determines the content of the leaving information that the frozen goods or refrigerated goods are left in the normal temperature goods shelf in Embodiment 1 of this invention. It is explanatory drawing of the monitoring of the channel | path area | region and normal temperature goods shelf area | region by the temperature sensor in Embodiment 2 of this invention. It is a figure which shows the range of the channel | path area | region and normal temperature goods shelf area | region in Embodiment 2 of this invention. It is a figure which shows the range of the channel | path area | region on the thermal image in the Embodiment 2 of this invention, and a normal temperature goods shelf area | region. The present invention is a flowchart of an abandonment determination method for determining whether a frozen product or a refrigerated product is left on a room temperature product shelf using information on a passage area and a room temperature product shelf area in the second embodiment. It is a figure which shows an example when the customer with the frozen goods or the refrigerated goods in Embodiment 3 of this invention passes a passage area | region. It is a figure which shows an example of the temperature distribution change on a thermal image when the customer with the frozen goods or the refrigerated goods in Embodiment 3 of this invention passes a passage area | region. In the third embodiment of the present invention, a flowchart of an abandonment determination method for determining whether a frozen product or a refrigerated product is left on a room temperature product shelf using information indicating whether the frozen product or a refrigerated product is moving. It is. A combination of the leaving determination method for determining whether the frozen product or the refrigerated product in the third embodiment of the present invention is left on the room temperature product shelf and the leaving determination method in the first and second embodiments. It is a flowchart of the leaving determination method which determines whether the frozen goods or the refrigerated goods are left in the normal temperature goods shelf. It is a conceptual diagram explaining the measurement of the time after determining with the frozen goods or the refrigerated goods being left untreated in Embodiment 4 of this invention. It is a conceptual diagram explaining the measurement of the change of the temperature distribution of the low-temperature area | region after it determines with the frozen goods or refrigerated goods being left untreated in Embodiment 4 of this invention. It is a figure which shows an example at the time of displaying on the display terminal after determining with the frozen goods or refrigerated goods being left untreated in Embodiment 4 of this invention. It is a figure which shows an example at the time of displaying the change of the temperature distribution of the low-temperature area | region after it determines with the frozen goods or refrigerated goods in Embodiment 4 of this invention being left unattended. It is a conceptual diagram which shows notifying each store where the cloud server in Embodiment 5 of this invention collects neglected information from each store, and the frozen goods or refrigerated goods learned in the cloud server are easy to be neglected. It is a block diagram which comprises the cloud server in Embodiment 5 of this invention. It is a figure which shows an example of the SNS between stores in Embodiment 5 of this invention. It is a figure which shows an example which shows the information of the place where it is easy to be neglected learned with the cloud server in Embodiment 5 of this invention on SNS between stores.

  Hereinafter, an embodiment of a commodity shelf monitoring method of the present invention will be described with reference to the drawings. Each of the following embodiments shows a specific example of the present invention, and the numerical value, shape, component, arrangement position of component, connection form, and the like are examples and limit the present invention. It is not a thing.

(Embodiment 1)
FIG. 1 is a schematic diagram of a merchandise shelf monitoring method according to Embodiment 1 of the present invention.

  As shown in FIG. 1, the product shelf monitoring method according to Embodiment 1 of the present invention is a frozen product obtained from a frozen / refrigerated product shelf A003 that is once put in a shopping basket by a customer in a store such as a supermarket or a convenience store. When the purchase of the refrigerated product X001 is canceled in the middle of shopping, the frozen product or the refrigerated product X001 is not returned to the original display of the frozen / refrigerated product shelf A003, and the room temperature storage product X002 is displayed. This is a product shelf monitoring method for dealing with what is left in the product shelf A004.

  As shown in FIG. 1, the product shelf monitoring system in the product shelf monitoring method includes a temperature sensor A001, a store server A002, and a notification receiving device A005.

  Information communication between the temperature sensor A001 and the store server A002 and between the store server A002 and the notification receiving device A005 is performed through a wired or wireless network.

  FIG. 2 is a block diagram of the commodity shelf monitoring system according to Embodiment 1 of the present invention.

  As shown in FIG. 2, in the merchandise shelf monitoring system according to Embodiment 1 of the present invention, the store server A221 includes an abandonment determination unit A222, a product shelf ID determination unit A223, and a notification content determination unit A225.

  Further, as shown in FIG. 2, the product shelf ID determination unit A223 includes a product shelf ID database A224.

  2, in the product shelf monitoring system according to Embodiment 1 of the present invention, the temperature sensor A211 constantly monitors the temperature distribution of the room temperature product shelf A231 in the store, and the temperature distribution data acquired from the temperature sensor A211 and the temperature sensor A211. Is sent to the store server A221.

  In the store server A221, the abandonment determination unit A222 determines whether the frozen product or the refrigerated product is left on the room temperature product shelf based on the temperature distribution data received from the temperature sensor A211. Information on whether or not the product is left on the room temperature product shelf is transmitted to the product shelf ID determination unit A223 and the notification content determination unit A225.

  Further, the product shelf ID determination unit sets the product shelf ID of the room temperature product shelf in which the frozen product or the refrigerated product is left based on the leaving determination information from the leaving determination unit A222 and the sensor ID received from the temperature sensor A211. The shelf ID database A224 is inquired, and the obtained product shelf ID is transmitted to the notification content determination unit A225.

  Further, the notification content determination unit A225 determines the content to be notified to the notification receiving device A241 based on the neglect determination information received from the abandonment determination unit A222 and the product shelf ID received from the product shelf ID determination unit A223. The notification content is transmitted to the notification receiving device A241.

  The notification receiving device A241 receives the notification content.

  FIG. 3 is a sequence diagram showing the relationship among the temperature sensor, the store server, and the notification receiving device that constitute the product shelf monitoring system according to Embodiment 1 of the present invention.

  In FIG. 3, as shown in the temperature sensor sequence U001, the store server sequence U002, and the notification receiving device sequence, first, in the product shelf monitoring system according to the first embodiment of the present invention, the temperature sensor is always the temperature of the room temperature product shelf in the store. The distribution is monitored, and the temperature distribution data acquired by the temperature sensor is transmitted to the store server. Next, the store server receives the temperature distribution data from the temperature sensor and analyzes the temperature distribution data to determine whether the frozen product or the refrigerated product is left on the room temperature product shelf. When it is determined that the product is left on the room temperature product shelf, the store server inquires of the temperature sensor that has transmitted the temperature distribution data about the temperature sensor ID. Next, the temperature sensor that has received the inquiry transmits its temperature sensor ID to the store server. Next, the store server determines the product shelf ID of the room temperature product shelf in which the frozen product or the refrigerated product is left based on the received temperature sensor ID. Then, based on the product shelf ID obtained in the determination, information indicating that the frozen product or the refrigerated product is left and information on which room temperature product shelf the frozen product or the refrigerated product is left are received. Send to. Next, the notification receiving device receives the information from the store server.

  According to such a configuration, when a frozen product or a refrigerated product is left in the room temperature product shelf, the store clerk is informed that the frozen product or the refrigerated product is left in the room temperature product shelf and in which room temperature product shelf the frozen product or the refrigerated product. Can be notified of whether or not

  Next, temperature sensor A001 used in the commodity shelf monitoring system according to Embodiment 1 of the present invention will be described.

  4, 5, and 6 are explanatory diagrams of the operation of the temperature sensor according to the first embodiment of the present invention. FIG. 4 is an explanatory diagram of product shelf monitoring by the temperature sensor. FIG. 5 is an example of temperature distribution data acquired from the temperature sensor. FIG. 6 is an example diagram when the temperature distribution data is converted into a thermal image.

  As shown in FIG. 4, the temperature sensor A001 can acquire the temperature distribution of all the stages of the room temperature product shelf B001, and the temperature sensor A001 can acquire the temperature distribution of all the stages of the room temperature product shelf B001. Installed.

  Note that the installation position of the temperature sensor A001 may be a store wall surface, a room temperature product shelf, or a floor surface as long as the temperature distribution of all stages of the room temperature product shelf B001 can be acquired.

  In FIG. 4, the temperature sensor A001 is an example of a non-contact type temperature sensor such as a thermography that measures the temperature in front of the temperature sensor. However, the temperature sensor A001 is not limited to this, and any sensor that can measure temperature is used. A contact-type temperature sensor or a non-contact-type temperature sensor may be used.

  Further, the temperature sensor A001 is more preferably a sensor capable of measuring a temperature from a temperature range in which frozen products are stored, for example, minus 20 degrees to a temperature range in which hot beverages are stored, for example, 90 degrees, but at least a refrigerated product. Can be used as long as the sensor can measure a temperature range from 0 degrees to, for example, 0 degrees to at least room temperature, for example, 30 degrees.

  As shown in FIG. 5, the temperature distribution data acquisition method of the temperature sensor divides the field angle area of the temperature sensor into a grid pattern with a predetermined division number, and acquires the temperature of each area as temperature distribution data C001.

  In FIG. 5, 8 × 8 is used as an example of the predetermined number of divisions. However, the predetermined number of divisions can be changed according to the performance of the temperature sensor, and the number of vertical and horizontal divisions may be different.

  6 is a thermal image of FIG. 5, and a thermal image C011 of FIG. 6 is a thermal image of the temperature distribution data C001 of FIG. The temperature sensor may generate a thermal image as shown in FIG. 6 as temperature distribution data, and transmit this to the store server as temperature distribution data.

  The thermal image C011 is displayed by changing the state of the pixels in accordance with a predetermined temperature, with the region divided in the grid pattern in the temperature sensor as one pixel of the thermal image. For example, in FIG. 6, the pixels of the thermal image are displayed in three stages of black, diagonal lines, and white. Here, in the thermal image shown in FIG. 6, the low temperature region D001 is displayed as a black pixel in the region of less than 10 degrees, and the region D002 higher than the temperature of the low temperature region and lower than the room temperature is hatched in the region of 10 degrees to less than 20 degrees. It is displayed as a pattern pixel, and the other area is a normal temperature area of 20 degrees or more, and is displayed in white.

  Next, an abandonment determination method in the abandonment determination unit A222 in the store server A002 used in the product shelf monitoring system according to Embodiment 1 of the present invention will be described.

  FIG. 7 is a flowchart of the leaving determination method for determining whether the frozen product or the refrigerated product is left in the room temperature product shelf in the first embodiment of the present invention.

  In the abandonment determination method in the abandonment determination unit A222, as shown in FIG. 7, first, temperature distribution data of the room temperature product shelf A231 is acquired from the temperature sensor A211 in the abandonment determination process T101. Next, in the neglect determination process T102, it is determined whether a temperature lower than the normal temperature from the temperature distribution data and a temperature greater than a predetermined value is measured. For example, if the temperature distribution data is a thermal image as shown in FIG. 6, it is determined whether or not the low-temperature region D001 having a temperature lower than the normal temperature and a temperature difference from the normal temperature larger than a predetermined value exists in the thermal image C011. When it is determined in the neglect determination process T102 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is greater than a predetermined value, for example, it is determined that the low-temperature region D001 exists in the thermal image C011. In this case, it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf A231 in the leaving determination process T103. When it is determined in the neglect determination process T102 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is not greater than a predetermined value, for example, it is determined that the low-temperature region D001 does not exist in the thermal image C011. In this case, it is determined that the frozen product or the refrigerated product is not left in the room temperature product shelf A231 in the leaving determination process T104.

  According to such a configuration, since the neglect determination process is performed based on the temperature distribution data, it is determined whether a frozen product or a refrigerated product that is not possible with the prior art using the product outline feature is left on the room temperature product shelf. Can be determined.

  In FIG. 6, as an example, the normal temperature is 20 degrees and the threshold value of the temperature difference from the normal temperature is 10 degrees. However, the threshold value of the temperature difference can be freely changed by a store clerk.

  Next, a product shelf ID determination method in the product shelf ID determination unit A223 in the store server A002 used in the product shelf monitoring system according to Embodiment 1 of the present invention will be described.

  FIG. 8 is a flowchart of the product shelf ID determination method for determining the product shelf ID of the product shelf in which the frozen product or the refrigerated product is left untreated in Embodiment 1 of the present invention, and FIG. 9 is an embodiment of the present invention. 2 is an example of a product shelf ID database in FIG.

  The product shelf ID determination unit A223 includes a product shelf ID database A224.

  As shown in FIG. 8, the product shelf ID determination method in the product shelf ID determination unit first determines whether the frozen product or the refrigerated product is based on the abandonment determination information determined by the abandonment determination unit A222 in the product shelf ID determination process T201. It is determined whether or not the product is left on the room temperature product shelf A231. When it is determined that the frozen product or the refrigerated product is not left in the room temperature product shelf A231, the product shelf ID determination process is terminated. When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf A231, the product shelf ID determination processing T202 acquires the sensor ID from the temperature sensor A211 and then the product shelf ID determination processing T203. The product shelf ID database A224 is referred to based on the acquired sensor ID. Then, the product shelf ID is acquired in the product shelf ID determination process T204.

  Here, the product shelf ID database A224 is a product shelf ID database in which one product shelf ID corresponds to one sensor ID, for example, as shown in FIG.

  According to such a configuration, when the frozen product or the refrigerated product is left in the room temperature product shelf A231, the product shelf ID of the room temperature product shelf A231 can be determined.

  The product shelf ID database S001 may be a database in which a plurality of product shelf IDs are associated with one sensor ID. In this case, the product shelf ID database S001 associates the relationship between the plurality of regions where the room temperature product shelf is installed and the product shelf ID of the room temperature product shelf with the sensor ID. It is a saved database. In this case, the product shelf monitoring system according to the first embodiment of the present invention uses the product shelf ID based on the position information of the frozen product or the refrigerated product included in the sensor ID and the neglected determination information in the product shelf ID determination process T203. The product shelf ID is acquired in the product shelf ID determination process T204 with reference to the database.

  Next, the notification receiving device A005 used in the product shelf monitoring system according to Embodiment 1 of the present invention will be described.

  10, 11, and 12 are left information notification diagrams when the notification receiving device A005 is a notification display terminal such as a tablet terminal.

  FIG. 10 is a floor plan of a store and shows where a room temperature product shelf having which product shelf ID is installed. In FIG. 10, a product shelf with a white mark means a refrigerated product shelf, and a product shelf with a black mark means a frozen product shelf.

  FIG. 11 shows a state in which a store floor plan as shown in FIG. 10 is displayed on the display unit G011 of the notification display terminal H001.

  FIG. 12 shows a case where the frozen product or the refrigerated product is determined to be left on the room temperature product shelf in the first embodiment of the present invention at the position corresponding to the room temperature product shelf where the frozen product or the refrigerated product is left. It is a figure which shows an example at the time of displaying a display form differently from the position applicable to another normal temperature goods shelf.

  As shown in FIG. 12, for example, when it is determined that a frozen product or a refrigerated product is left in a room temperature product shelf with a product shelf ID 18, the product shelf ID 18 is displayed on the display unit G011 of the notification display terminal H001. The display of the position I001 corresponding to the position of the room temperature product shelf is displayed differently from the position corresponding to the other room temperature product shelf.

  According to such a configuration, the store clerk can visually recognize simultaneously that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room product shelf is left.

  In FIG. 12, an example of a tablet terminal is shown as a notification display terminal that receives neglected information. However, the present invention is not limited to this, and for example, a device having a monitor such as a smartphone, a PC monitor, or a TV is notified of these. It may be a display terminal.

  FIG. 13 is a diagram showing an example of notifying the store clerk of neglected information by in-store broadcasting in Embodiment 1 of the present invention, and the notification receiving device A005 may be a speaker for in-store broadcasting.

  As shown in FIG. 13, when it is determined that the frozen product or the refrigerated product X001 is left in the room temperature product shelf B001, the in-store broadcasting speaker M001 installed for in-store broadcasting is diverted to the frozen product. Further, the store clerk is notified by in-store broadcast with a secret word that only the store clerk knows the position of the room temperature product shelf B001 where the refrigerated product X001 is left and the frozen product or the refrigerated product left.

  The secret word that only the store clerk can understand may be, for example, “Please help the store clerk at Z18”, and can be freely set for each store.

  FIG. 14 shows the case where the frozen product or the refrigerated product is determined to be left on the room temperature product shelf in the first embodiment of the present invention, and the frozen product or the refrigerated product is installed on the room temperature product shelf. It is a figure which shows the example which notifies abandonment information to a store clerk by sounding the sound reproducing apparatus.

  Note that the notification receiving device A005 may be an audio playback device installed in a room temperature product shelf.

  When it is determined that the frozen product or the refrigerated product X001 is left in the room temperature product shelf B001, for example, as shown in FIG. 14, the sound reproduction device N001 installed in the room temperature product shelf B001 is sounded to freeze the product. The store clerk is notified of the position of the room temperature product shelf B001 where the product or refrigerated product X001 is left and that the frozen product or refrigerated product is left.

  According to such a configuration, the store clerk who does not have the notification display terminal H001 is notified of the information that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room temperature product shelf is left. can do.

  Note that the sound reproducing device N001 may be a device that produces sound, such as a buzzer or a small speaker, as long as it can be installed on a room temperature product shelf.

  FIG. 15 shows the case where the frozen product or the refrigerated product is determined to be left on the room temperature product shelf in the first embodiment of the present invention, and the frozen product or the refrigerated product is installed on the room temperature product shelf. It is a figure which shows the example which lights the light which can be light-modulated or color-tuned in the mode which notifies abnormality, and notifies neglected information to a store clerk.

  Note that the notification receiving device A005 may be a light that can be dimmed or toned, installed on the ceiling.

  As shown in FIG. 15, when it is determined that the frozen product or the refrigerated product X001 is left in the room temperature product shelf B001, the light O001 installed in the room temperature product shelf B001 is turned on in a mode for notifying abnormality. The store clerk is notified of the position of the room temperature product shelf B001 where the frozen product or the refrigerated product X001 is left and that the frozen product or the refrigerated product is left.

  According to such a configuration, a store clerk who does not have the notification display terminal H001 is also notified of the information that the frozen product or the refrigerated product is left on the room temperature product shelf and the information on which room temperature product shelf is left. be able to.

  Moreover, according to this structure, in order to improve the appearance of goods, the light installed in the room temperature goods shelf can be diverted, and it can notify neglected information to a store clerk.

  In FIG. 15, the example of the light O001 installed in the room temperature product shelf B001 as the notification receiving device A005 is shown. However, the present invention is not limited to this, and for example, dimming such as lighting installed on the ceiling Alternatively, if the light can be toned, such a light may be used as the notification receiving device.

  Next, a notification content determination method in the notification content determination unit A225 in the store server A002 used in the product shelf monitoring system according to Embodiment 1 of the present invention will be described.

  FIG. 16 shows a notification content determination method for determining the notification content for sending to the notification receiving device the content of the abandonment information that the frozen product or the refrigerated product is left on the room temperature product shelf in Embodiment 1 of the present invention. It is a flowchart.

  As shown in FIG. 16, in the notification content determination method, first, in the notification content determination processing T301 and the notification content determination processing T302, the neglect determination information determined by the neglect determination unit A222 and the product shelf ID determination unit A223 respectively determine Obtained merchandise shelf ID is acquired. Next, in notification content determination processing T303, it is determined whether or not the notification receiving device is a notification display terminal. When the notification receiving device is a notification display terminal, it is determined in the notification content determination process T304 that the frozen product or the refrigerated product X001 is left on the floor plan of the store displayed on the display unit G011 of the notification display terminal H001. The control instruction of the notification display terminal H001 to make the display form of the position of the room temperature product shelf B001 thus made different from other room temperature product shelves is determined as the notification content, and the notification content is notified to the notification display terminal H001. If the notification receiving device is not a notification display terminal, it is determined in notification content determination processing T305 whether or not the notification receiving device is a speaker for in-store broadcasting. When the notification receiving device is a speaker for in-store broadcasting, the position of the room temperature product shelf B001 and the frozen product or refrigerated product X001 determined that the frozen product or refrigerated product X001 is left unattended in the notification content determination process T306. A secret including information that it is left unattended is determined as the notification content, and the secret is broadcast in-store from the speaker M001. If the notification receiving device is not an in-store broadcast speaker, it is determined in notification content determination processing T307 whether the notification receiving device is an audio reproduction device. When the notification receiving device is an audio reproduction device, in the notification content determination process T308, the audio reproduction device N001 that rings the audio reproduction device N001 installed in the room temperature product shelf B001 in which the frozen product or the refrigerated product X001 is left unattended. The control instruction is determined as the notification content, and the notification content is notified to the audio reproduction device N001. If the notification receiving device is not an audio playback device, it is determined in notification content determination processing T309 whether the notification receiving device is a light. When the notification receiving device is a light, in the notification content determination process T310, the light O001 installed in the room temperature product shelf B001 in which it is determined that the frozen product or the refrigerated product X001 is left unlit is turned on in a mode for notifying abnormality. The control instruction of the write O001 is determined as the notification content, and the notification content is notified to the write O001. When the notification receiving device is not a light or after the notification content determination processing T304, T306, T308, T310, in the notification content determination processing T311, the frozen product is displayed on the floor plan of the store displayed on the monitor installed in the store server A221. Alternatively, the control instruction of the store server A 221 to change the display form of the position of the determined room temperature product shelf B001 where the refrigerated product X001 is left to be different from other room temperature product shelves is determined as the notification content and displayed on the monitor. The display form of the portion corresponding to the position of the room temperature product shelf B001 in the floor plan is changed.

(Embodiment 2)
Hereinafter, a method for determining whether to leave a frozen product or a refrigerated product in the product shelf monitoring system according to the second embodiment will be described with reference to the drawings. The configuration of the merchandise shelf monitoring system according to the second embodiment is the same as that in FIG. 2, and the abandonment determination unit A222 is different from that in the first embodiment. Since other configurations are the same as those of the first embodiment, the second embodiment will be described only with respect to differences from the first embodiment, and description of the other parts will be omitted.

  In the merchandise shelf monitoring system according to Embodiment 2 of the present invention, the method for determining whether to leave frozen or refrigerated products is that the customer is moving or staying in the passage with the frozen or refrigerated product in the shopping basket. This is a neglect determination method for distinguishing between a frozen state and a state where a frozen product or a refrigerated product is left on a room-temperature product shelf.

  FIG. 17 is an explanatory diagram for monitoring the passage area and the room temperature commodity shelf area by the temperature sensor A001.

  As shown in FIG. 17, the temperature sensor A001 constantly monitors the temperature distribution in the passage area and the room temperature commodity shelf area, and transmits the acquired temperature distribution data to the store server.

  Moreover, FIG. 18 is a figure which shows the range of the channel | path area | region and normal temperature goods shelf area | region in Embodiment 2 of this invention.

  As shown in FIG. 18, the neglect determination method in the merchandise shelf monitoring system according to the second embodiment determines the ranges of the space E001 corresponding to the passage area and the space corresponding to the room temperature merchandise shelf, for example, the space F001 and the space F002. Keep it.

  FIG. 19 shows that when the temperature distribution measured by the temperature sensor A001 is expressed as the thermal image C011, the temperature sensor A001 measured the temperature distribution in the region as shown in FIG. It is a figure which shows the range of the channel | path area | region E011 on the thermal image C011, and the normal temperature merchandise shelf area | regions F011 and F012.

  FIG. 19 shows whether each pixel of the thermal image C011 is a pixel displaying the temperature of the passage area or the room temperature product shelf area. Here, in FIG. 19, pixels surrounded by a thick black frame mean a room temperature product shelf area, and the other pixels mean a passage area.

  FIG. 20 is a flowchart of the leaving determination method for determining whether the frozen product or the refrigerated product is left in the room temperature product shelf in the second embodiment of the present invention.

  As shown in FIG. 20, the abandonment determination method in the abandonment determination unit A222 used in the commodity shelf monitoring system according to Embodiment 2 of the present invention is a normal temperature commodity from the temperature sensor A211 in the abandonment determination process T401 as shown in FIG. The temperature distribution data of the shelf A231 is acquired. Next, in the leave determination process T402, based on the temperature distribution data, it is determined whether or not a temperature lower than the normal temperature and a temperature difference from the normal temperature is greater than a predetermined value is measured. When it is determined in the neglect determination process T402 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is greater than a predetermined value, the measured temperature is determined in the neglect determination process T403. It is determined whether or not the temperature is measured from the room temperature product shelf area. If it is determined in the abandonment determination process T403 that the measured temperature is measured from the room temperature product shelf area, it is determined in the abandonment determination process T404 that the frozen product or the refrigerated product is left on the room temperature product shelf. . Further, when it is determined in the leaving determination process T402 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is not greater than a predetermined value, or the measured temperature is determined in the leaving determination process T403. Is determined not to be a temperature measured from the room temperature product shelf area but to a temperature measured from the passage area, it is determined that the frozen product or the refrigerated product is not left on the room temperature product shelf in the leaving determination process T405. To do.

  According to such a configuration, the state where the customer moves or stays in the passage with the frozen product or the refrigerated product in the shopping cart and the state where the frozen product or the refrigerated product is left on the room temperature shelf. Since the distinction can be made, it is possible to improve the leaving determination accuracy of a frozen product or a refrigerated product compared to the leaving determination method in the first embodiment.

  In addition, although the example which monitors both a passage area | region and a normal temperature goods shelf area | region simultaneously was shown in FIG. 17, it is not limited to this, The temperature sensor which monitors a passage area | region and the temperature sensor which monitors a normal temperature goods shelf It is also possible to prepare a plurality of each and determine whether the frozen product or the refrigerated product is in the passage area or the room temperature product shelf area based on the temperature distribution data obtained from these.

  In the second embodiment, the temperature distribution data is described using a thermal image as shown in FIG. 19, but the present invention is not limited to this, and the temperature distribution data may be a certain temperature. In this case, the region determination method for determining whether the frozen product or the refrigerated product in the passage determination region or the room-temperature product shelf region in the neglect determination method in the second embodiment is based on only one temperature distribution data. By using a plurality of temperature sensors to be acquired and associating in advance information on whether the temperature sensor and the point at which the temperature sensor acquires the temperature are included in the passage area or the room temperature commodity shelf area, From the sensor that detects the temperature in the temperature zone of the refrigerated product, it is determined whether the point where the frozen product or the refrigerated product exists is the passage region or the room temperature product shelf region.

(Embodiment 3)
Hereinafter, a method for determining whether to leave a frozen product or a refrigerated product in the product shelf monitoring system according to the third embodiment will be described with reference to the drawings. The configuration of the merchandise shelf monitoring system according to the third embodiment is the same as that in FIG. 2, and the neglect determination unit A222 is different from the first and second embodiments. Since other configurations are the same as those in the first and second embodiments, in the third embodiment, only differences from the first and second embodiments will be described, and the description of other components will be omitted.

  FIG. 21 is a diagram illustrating an example of a case where a customer having a frozen product or a refrigerated product X011 according to Embodiment 3 of the present invention passes through a passage area.

  In the merchandise shelf monitoring system according to Embodiment 3 of the present invention, the method for determining whether to leave frozen or refrigerated goods is as follows. As shown in FIG. 21, the customer moves the passage while the frozen or refrigerated goods are in the shopping basket. This is a neglect determination method for distinguishing between a frozen state and a state where a frozen product or a refrigerated product is left on a room-temperature product shelf.

  FIG. 22 is a diagram showing a change in temperature distribution on the thermal image when a customer having a frozen product or a refrigerated product passes through the passage area when the temperature distribution measured by the temperature sensor A001 is expressed by a thermal image. It is.

  As shown in FIG. 22, the neglect determination method in the neglect determination unit A222 according to Embodiment 3 of the present invention refers to the thermal images C111, C112, C113 and the temperature distribution data in time series, and in each thermal image. Depending on whether the position of the existing low temperature areas D011, D012, and D013 has moved, the customer who has frozen or refrigerated goods is passing through the aisle, and the frozen or refrigerated goods are left on the room temperature shelf. It is determined whether or not it has been done.

  According to such a configuration, it is possible to distinguish between a state in which a customer with a frozen product or a refrigerated product is moving in the aisle and a state in which the frozen product or the refrigerated product is left on the room temperature product shelf. It is possible to improve the accuracy of determining whether a refrigerated product is left as compared with the method for determining whether to leave a refrigerated product.

  In the third embodiment, the thermal image as shown in FIG. 22 is described as the temperature distribution data. However, the present invention is not limited to this, and the temperature distribution data may be a certain temperature. In this case, the neglect determination method in the third embodiment refers to the temperature measured by the plurality of temperature sensors in time series, and whether the frozen product or the refrigerated product is moved in the order in which the frozen product or the refrigerated product is detected. It may be determined whether or not.

  FIG. 23 is a flowchart of an abandonment determination method for determining whether a frozen product or a refrigerated product is left on the room-temperature product shelf in the third embodiment.

  As shown in FIG. 23, the abandonment determination method in the abandonment determination unit A222 in the store server A221 used in the commodity shelf monitoring system according to the third embodiment of the present invention is first a room temperature product from the temperature sensor A211 in the abandonment determination process T501. The temperature distribution data of the shelf A231 is acquired. Next, in the leave determination process T502, based on the temperature distribution data, it is determined whether a temperature lower than the normal temperature and a temperature difference from the normal temperature is greater than a predetermined value is measured. When it is determined that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is greater than a predetermined value in the neglect determination process T502, the measured temperature distribution data is determined in the neglect determination process T503. To determine whether or not the observation position of the low temperature has moved. If it is determined in the abandonment determination process T503 that the observed position of the measured low temperature has not moved, it is determined in the abandonment determination process T504 that the frozen product or the refrigerated product is left on the room temperature product shelf. . Further, when it is determined in the leaving determination process T502 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is not greater than a predetermined value, the measured temperature is determined in the leaving determination process T503. When it is determined that the observation position is moved, it is determined in the leaving determination process T505 that the frozen product or the refrigerated product is not left on the room temperature product shelf.

  Further, when the abandonment determination method according to the third embodiment of the present invention is used in combination with the abandonment determination method using the region information according to the second embodiment, it is determined which region the frozen or refrigerated product is moving. Can do.

  According to such a configuration, by using together with the leaving determination method in the second embodiment, it is possible to improve the leaving determination accuracy of a frozen product or a refrigerated product compared to the leaving determination method in the second embodiment.

  FIG. 24 is a flowchart of an abandonment determination method for determining whether a frozen product or a refrigerated product in Embodiment 3 is left on a room temperature product shelf when used together with the abandonment determination method in Embodiment 2.

  As shown in FIG. 24, the abandonment determination method in the abandonment determination unit A222 in the store server A221 used in the commodity shelf monitoring system according to Embodiment 3 of the present invention is first a room temperature product from the temperature sensor A211 in the abandonment determination process T601. The temperature distribution data of the shelf A231 is acquired. Next, in a leave determination process T602, based on the temperature distribution data, it is determined whether or not a temperature lower than the normal temperature and a temperature difference from the normal temperature is greater than a predetermined value is measured. When it is determined in the neglect determination process T602 that the temperature is lower than normal temperature and the temperature difference from the normal temperature is greater than a predetermined value, the measured temperature is determined in the neglect determination process T603. It is determined whether or not the temperature is measured from the room temperature product shelf area. When it is determined in the neglect determination process T603 that the measured temperature is measured from the room temperature product shelf area instead of the passage area, the observation position of the measured temperature is moved in the neglect determination process T604. It is determined whether or not. If it is determined in the abandonment determination process T604 that the observed position of the measured temperature has not moved, it is determined in the abandonment determination process T605 that the frozen product or the refrigerated product is left on the room temperature product shelf. Further, when it is determined in the leaving determination process T602 that the temperature is lower than the normal temperature and the temperature difference from the normal temperature is not greater than a predetermined value, or the measured temperature is determined in the leaving determination process T603. However, when it is determined that the temperature is measured from the passage area rather than from the room temperature product shelf area, or when the observation position of the measured temperature is determined to have moved in the neglect determination process T604, In the leaving determination process T606, it is determined that the frozen product or the refrigerated product is not left on the room temperature product shelf.

(Embodiment 4)
Hereinafter, in the merchandise shelf monitoring system according to the fourth embodiment, with reference to the drawings, when the notification receiving device is a monitor-equipped device, if the frozen product or the refrigerated product is left in the room temperature product shelf, The content of notification notified to the store clerk when the determination is made will be described. The configuration of the commodity shelf monitoring system according to the fourth embodiment is the same as that in FIG. 2, and only the notification content determined by the notification content determination method in the notification content determination unit A225 is different from the first, second, and third embodiments. Since other configurations are the same as those of the first, second, and third embodiments, the difference from the notification contents shown in the first, second, and third embodiments will be described in the fourth embodiment.

  FIG. 25 shows the measurement of the time elapsed from when it is determined that the frozen product or the refrigerated product is left on the room temperature product shelf in Embodiment 4 of the present invention until the frozen product or the refrigerated product is removed from the room temperature product shelf. It is a conceptual diagram to explain.

  In the product shelf monitoring system according to Embodiment 4 of the present invention, as shown in FIG. 25, after the customer leaves the frozen product or refrigerated product X001 in the room temperature product shelf A004, the product shelf monitoring system performs the frozen product or refrigerated product. The time J001 at which it is determined that X001 is left in the room temperature product shelf A004 is recorded. In the product shelf monitoring system according to the fourth embodiment of the present invention, the store clerk who has received the notification that the frozen product or the refrigerated product X001 is left in the room temperature product shelf A004 reaches the room temperature product shelf A004, The time J002 when the frozen product or the refrigerated product is removed from the room temperature product shelf is recorded. Furthermore, the merchandise shelf monitoring system according to Embodiment 4 of the present invention calculates and records the time that the frozen product or the refrigerated product is left on the room temperature product shelf from the times J001 and J002.

  In the merchandise shelf monitoring system according to the fourth embodiment, the removal determination method for determining whether or not the frozen product or the refrigerated product left by the store clerk is removed from the room temperature product shelf is, for example, temperature distribution data measured by a temperature sensor. When the temperature is lower than the normal temperature and the temperature difference from the normal temperature is no longer observed, it may be determined that the frozen or refrigerated product left by the store clerk is removed from the normal temperature product shelf. .

  The removal determination method may determine that the frozen product or the refrigerated product left by the store clerk is removed from the room temperature product shelf by pressing a notification stop button or the like installed on the notification receiving device.

  FIG. 26 is a conceptual diagram illustrating the measurement of the change in temperature distribution in the low temperature region from the time when it is determined that the frozen product or the refrigerated product is left on the room temperature product shelf in the fourth embodiment of the present invention. It is.

  In the product shelf monitoring system according to Embodiment 4 of the present invention, as shown in FIG. 26, after the customer leaves the frozen product or refrigerated product X001 in the room temperature product shelf A004, the product shelf monitoring system performs the frozen product or refrigerated product. The observed temperature of the frozen product or the refrigerated product X001 when it is determined that X001 is left in the room temperature product shelf A004 is recorded. Then, in the product shelf monitoring system according to Embodiment 4 of the present invention, the store clerk who has received notification that the frozen product or the refrigerated product X001 is left in the room temperature product shelf A004 reaches the room temperature product shelf A004, The observation temperature of the frozen product or refrigerated product X001 is continuously recorded until the left frozen product or refrigerated product is removed from the room temperature product shelf.

  FIG. 27 shows that when a notification display terminal having a monitor is used as a notification receiving device, the store clerk starts from the time when it is determined that the frozen product or the refrigerated product in the fourth embodiment of the present invention is left unattended. It is a figure which shows an example at the time of displaying the time passage to the time which removed from the normal temperature goods shelf on the notification display terminal.

  Further, FIG. 28 shows a case where the frozen display product from the determination that the frozen product or the refrigerated product in the fourth embodiment of the present invention is left unattended when the notification display terminal having the monitor is the notification receiving device. It is a figure which shows an example at the time of displaying the transition of the observation temperature of refrigerated goods on the notification display terminal.

  In the merchandise shelf monitoring system according to the fourth embodiment of the present invention, as shown in FIG. 27, the leaving time display K004 on the display unit K001 of the notification display terminal H001 indicates that the frozen product or the refrigerated product is left on the room temperature product shelf. From the time when it is determined that the store has received a room temperature shelf where frozen or refrigerated products have been left after receiving notification, and the elapsed time from when the product was removed from the room temperature shelf is displayed. It is a display. Until the clerk removes the frozen product or the refrigerated product from the room temperature product shelf, the elapsed time up to the current time is displayed.

  According to this configuration, the store clerk determines whether to discard the left frozen product or refrigerated product according to the leaving time when the store clerk arrives at the room temperature product shelf where the frozen product or refrigerated product is left. be able to. For example, if a store clerk reaches a room temperature product shelf where frozen or refrigerated products are left unattended, and the storage time has exceeded 10 minutes, the store clerk will replace the left frozen product or refrigerated product with the original frozen product shelf. Or discard instead of returning to the refrigerated product shelf.

  In the above example, the threshold for the leaving time is 10 minutes. However, the threshold is not limited to this, and the threshold for the leaving time can be freely set for each store, each store clerk, or each product.

  Moreover, in the merchandise shelf monitoring system according to Embodiment 4 of the present invention, as shown in FIG. 28, the temperature transition diagram L002 in the display unit L001 of the notification display terminal H001 indicates that frozen products or refrigerated products are left unattended. From the determined time, the store clerk is notified and reaches the room temperature shelf where the frozen product or refrigerated product is left, and the observation temperature of the frozen product or refrigerated product up to the time when the product is removed from the room temperature product shelf. It is the temperature transition diagram which displayed transition. Until the clerk removes the frozen product or the refrigerated product from the room temperature product shelf, the change in the observation temperature of the frozen product or the refrigerated product up to the current time is displayed.

  In FIG. 28, a temperature distribution L003 is an observed temperature at a certain time.

  In FIG. 28, the product discarding temperature threshold L004 is a temperature threshold used when the store clerk determines whether to discard the frozen product or the refrigerated product left on the room temperature product shelf.

  In addition, as shown in FIG. 28, the merchandise discarding temperature threshold L004 is not limited to a specific temperature, and can be set by a store clerk for each store or each product.

  According to this configuration, depending on the observation temperature of the frozen product or the refrigerated product when the store clerk reaches the room temperature product shelf where the frozen product or the refrigerated product is left, the frozen product or the refrigerated product left by the store clerk is discarded. It can be determined whether or not. For example, when a store clerk reaches a room temperature product shelf where frozen or refrigerated products are left unattended, if the observation temperature of the frozen product or refrigerated product is 10 degrees Celsius or more, the store clerk selects the left frozen product or refrigerated product. Discard instead of returning to the original frozen or refrigerated product shelf.

  Note that the display of the standing time and the transition diagram of the temperature distribution has shown an example in which a different page screen as shown in FIG. 28 is displayed using this link by providing a link like the link K005 in FIG. However, the present invention is not limited to this, and may be displayed on the same page screen.

  Further, as shown in FIG. 27, the display of the leaving time and the transition diagram of the temperature distribution may be displayed on the same page screen as the leaving position information K002 and the log information K003.

  Here, as shown in FIG. 27 as an example, the abandoned position information K002 is displayed on the store floor plan as to which room temperature product shelf the frozen product or the refrigerated product in the first embodiment is left.

  Further, as shown in FIG. 27, the log information K003 is a log displaying the room temperature product shelf where the frozen product or the refrigerated product is left and the time when it is determined that the frozen product or the refrigerated product is left on the room temperature product shelf. Information is displayed as text as an example.

(Embodiment 5)
Hereinafter, with reference to the drawings, in the product shelf monitoring system according to the fifth embodiment, the cloud server performs integrated management by collecting neglected information on frozen products or refrigerated products from each store, and based on the collected neglected information. A process for learning where a frozen product or a refrigerated product is likely to be left unattended and notifying each store of the learning content will be described.

  FIG. 29 shows a concept that the cloud server according to the fifth embodiment of the present invention collects neglected information from each store and notifies each store of a place where a frozen product or a refrigerated product learned by the cloud server is likely to be neglected. FIG.

  As shown in FIG. 29, the cloud server P001 collects, as log information, information on when and where frozen or refrigerated goods were left from stores Q001, Q002, Q003, and the like, and integrates and manages the log information. The cloud server P001 analyzes the log information, learns when and where the frozen product or the refrigerated product is easily left, and notifies each store of the learning content.

  FIG. 30 is a block diagram showing the configuration of the cloud server according to Embodiment 5 of the present invention.

  As shown in FIG. 30, the cloud server P011 includes an abandoned information receiving unit P012, an abandoned information database P013, an abandoned location learning unit P014, a notification content determining unit P015, and an inter-store SNS management unit P016.

  In FIG. 30, in the product shelf monitoring system according to the fifth embodiment of the present invention, cloud information is stored as information on when and where frozen products or refrigerated products are left from store servers Q011, Q012, Q013, etc. Send to server P011. In the cloud server P011, the neglected information receiving unit P012 receives the log information from stores Q011, Q012, Q013, etc., and stores the log information in the abandoned information database P013, thereby managing the log information in an integrated manner.

  Further, as shown in FIG. 30, the abandoned position learning unit P014 learns when and where a frozen product or a refrigerated product is easily left based on the log information accumulated in the abandoned information database P013. The learned neglected position information is transmitted to the notification content determination unit P015.

  The notification content determination unit P015 determines the content of learning information to be transmitted to the inter-store SNS management unit P016 based on the learned neglected position information received from the abandoned position learning unit P014, and transmits the content to the inter-store SNS management unit P016. .

  The inter-store SNS management unit P016 enables the learning information received from the notification content determination unit P015 to be browsed from each store, and notifies the learning information to each store.

  According to such a configuration, the log information can be integratedly managed by the cloud server P011 collecting information on when and where the frozen or refrigerated product is left from each store as log information. Further, according to this configuration, it is possible to learn when and where a frozen product or a refrigerated product is easily left based on the log information. Moreover, according to this structure, the store SNS management part manages so that the said learning information can be browsed from each store, and the salesclerk of each store can browse the said learning information through SNS between stores.

  FIG. 31 is a diagram showing an example of a page screen of the inter-store SNS in the fifth embodiment of the present invention.

  As an example, in FIG. 31, the inter-store SNS page screen displays, on the display screen R001 of the notification display terminal H001, neglected information K001 related to a case in which a frozen product or a refrigerated product generated at the store is neglected.

  Further, in FIG. 31, on the page screen of the inter-store SNS, a link picture R002 to the page picture on which the self-store profile picture R002 and the neglected information on other shops are posted, and a link R004 to the page picture on which the learning information is gathered. Etc. are displayed.

  According to such a configuration, regarding the case of leaving frozen or refrigerated products in the store in the past, browsing the page screen of the inter-store SNS when the frozen product or refrigerated product is left in which room temperature product shelf The store clerk can visually grasp.

  Note that the inter-store SNS page screen illustrated in FIG. 31 is an example, and the present invention is not limited to this, and the page layout and display content may be freely changed for each store.

  FIG. 32 is a diagram illustrating an example of a page screen that displays a time zone and a place where a frozen product or a refrigerated product learned by the cloud server is easily left in the inter-store SNS according to the fifth embodiment of the present invention.

  The store clerk can browse information on when and where the frozen product or the refrigerated product learned by the cloud server is easily left in the room temperature product shelf on the inter-store SNS as shown in FIG.

  As a page screen displaying learning information, FIG. 32 shows, as an example, an abandoned place statistics R006, a number of left abandoned times R007, a number of left abandoned days R008, and abandoned tendency information R009.

  In FIG. 32, a link R005 for browsing neglected information is a link for returning to the inter-store SNS page screen shown in FIG.

  The neglected place statistics R006 is statistics of places where frozen products or refrigerated products that have been aggregated based on neglected information collected by the cloud server are neglected.

  Also, the number of left time slots R007 is a statistic of a time period when frozen or refrigerated goods are left alone, which are tabulated based on the left information collected by the cloud server.

  Also, the number of days left by day R008 is a statistic of the day of the week on which frozen or refrigerated goods were tabulated based on the abandoned information collected by the cloud server.

  The neglected tendency information R009 is a text explaining, as an example, when and where a frozen product or a refrigerated product learned based on neglected information collected by the cloud server is likely to be neglected.

  According to such a configuration, it is possible to know the tendency of the store clerk when it is likely to be left on the room temperature product shelf in the own store and other stores. In addition, based on the above tendency, there is a frozen product or a refrigerated product that can take measures to make it difficult for a frozen product or a refrigerated product to be left in a room temperature shelf or a time zone where the frozen product or the refrigerated product is easily left. It is possible to reduce the number of merchandise discarded as frozen or refrigerated goods due to being left on the room temperature merchandise shelf.

  In addition, the page screen regarding the learning information in the SNS between stores shown in FIG. 32 is an example, and is not limited thereto, and the display layout of the learning information may be freely changed for each store.

  In addition, the learning information shown in FIG. 32 shows, as an example, a neglected place statistics R006, a time zone abandoned number R007, a day-by-day number abandoned number R008, and abandonment tendency information R009, but is not limited thereto. Information such as meteorological information on the day the frozen or refrigerated product is left may be displayed.

  In FIG. 32, the learning information displayed on the page screen R001 is four. However, the learning information is not limited to this. If one or more learning information is displayed, the learning information displayed is not limited to this. The number may be set freely for each store.

  In addition, the abandoned place statistics R006, the number of left abandoned times R007, the number of left abandoned days R008, and the abandoned tendency information R009 shown in FIG. 32 are written in graphs or characters, but are not limited thereto. May be expressed using other notation methods, such as a table.

  As mentioned above, although the merchandise shelf monitoring method and one or more aspects according to the embodiment have been described based on the embodiment, the present invention is not limited to this embodiment. Unless it deviates from the gist of the present invention, various modifications conceived by those skilled in the art have been made in this embodiment, and forms constructed by combining components in different embodiments are also within the scope of one or more aspects. May be included.

  For example, a comprehensive or specific aspect of the present invention may be realized by a recording medium such as an apparatus, an integrated circuit, a computer program, or a computer-readable CD-ROM. The comprehensive or specific aspect of the present invention may be realized by any combination of an apparatus, a method, an integrated circuit, a computer program, or a recording medium.

  In each of the above embodiments, each component may be configured by dedicated hardware or may be realized by executing a software program suitable for each component. Each component may be realized by a program execution unit such as a CPU or a processor reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory.

  The product shelf monitoring method according to the present invention is useful as a method for monitoring whether a frozen product or a refrigerated product in a store is left on a room temperature product shelf.

A001, A211 Temperature sensor A002, A221, Q011, Q012, Q013 Store server A003 Refrigerated / refrigerated product shelf A004, A231, B001, B002, B003, B004 Room temperature product shelf A005, A241 Notification receiving device A222 Unused determination unit A223 Product shelf Judgment unit A224 Product shelf ID database A225 Notification content determination unit C001 Temperature distribution data C011, C111, C112, C113 Thermal image D001, D011, D012, D013 Low temperature region D002 High temperature lower than normal temperature E001 Corresponds to passage region E011 Pixels corresponding to the passage area on the thermal image F001, F002 Spaces corresponding to the room temperature product shelf area F011, F012 Pixels corresponding to the room temperature product shelf on the thermal image G001 Figure G002 Refrigerated product shelf G003 Frozen product shelf G011, K001, L001, R001 Notification display terminal display unit H001 Notification display terminal I001 Position corresponding to the position of the room temperature product shelf J001 Time when frozen product or refrigerated product was left unattended J002 Current time K002 Standing position information K003 Log information K004 Standing time display section K005 Link L002 Temperature transition diagram L003 Temperature distribution L004 Product discard temperature threshold M001 In-store broadcasting speaker N001 Sound playback device O001 Light that can be adjusted or toned P001, P011 Cloud server P012 Abandoned information receiving part P013 Abandoned information database P014 Abandoned position learning part P015 Notification content determining part P016 Inter-store SNS management part Q001, Q002, Q003 Store R002 Self Profile Photo R003 Link to Other Store Abandoned Information Page Screen R004 Link to Learning Information Page Screen R005 Link to Own Store Abandoned Information Page Screen R006 Abandoned Location Statistics R007 Number of Abandoned Time Zones R008 Number of Abandoned Days of Week R009 Abandoned Trend Information S001 Product shelf ID database U001 Temperature server sequence U002 Store server sequence U003 Notification receiving device sequence X001, X011 Frozen or refrigerated product X002 Product stored at room temperature

Claims (12)

A product shelf monitoring method in a product shelf monitoring system for monitoring the state of product shelves in a store,
Using temperature sensors, in the store, obtain the temperature distribution of multiple room temperature product shelves where products stored at room temperature are displayed,
Based on the acquired temperature distribution data, it is determined whether a frozen product or a refrigerated product is left for each of the plurality of room temperature product shelves, and at least one room temperature product shelf among the plurality of room temperature product shelves. When it is determined that the frozen product or the refrigerated product is left unattended, a plurality of items in the store are based on the product shelf ID added to the room temperature product shelf that is determined that the frozen product or the refrigerated product is left unattended. Notify which room temperature shelf where frozen or refrigerated products are left unattended,
A product shelf monitoring method characterized by the above. The neglected determination method of whether frozen goods or refrigerated goods are left in the room temperature commodity shelf,
In the room temperature product shelf, when a low temperature region where the temperature is lower than the room temperature and the temperature difference from the room temperature is larger than a predetermined value is detected, it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf. ,
The merchandise shelf monitoring method according to claim 1, wherein: The neglect determination method is:
Within the angle of view of the temperature sensor, the passage area and the room temperature product shelf area are held in advance as area information,
If the low temperature region is present in the passage region, it is not determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
When the low temperature region exists in the room temperature product shelf region, it is determined that a frozen product or a refrigerated product is left in the room temperature product shelf.
The product shelf monitoring method according to claim 2, wherein: The neglect determination method is:
When detecting the low temperature region within the angle of view of the temperature sensor, refer to the temperature distribution data in time series,
When the low temperature region is moving, it is not determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
When the low temperature region has not moved, it is determined that a frozen product or a refrigerated product is left in the room temperature product shelf.
The merchandise shelf monitoring method according to claim 2 or claim 3, wherein The notification method to notify the store clerk which room-temperature product shelves where frozen or refrigerated products are left is
Display the floor plan of the room temperature product shelf installed in the store on a display terminal,
Based on the product shelf ID, out of the room temperature product shelves displayed on the floor plan, the position corresponding to the room temperature product shelf in which the frozen product or the refrigerated product is determined to be left in the leaving determination method. Visually notify the display form by making it different from the position corresponding to other room temperature product shelves,
The merchandise shelf monitoring method according to any one of claims 1 to 4, wherein the merchandise shelf monitoring method is provided. When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
Notifying the store clerk of the time from the determination until the present and the change in the temperature distribution in the low temperature region detected by the neglect determination method,
The merchandise shelf monitoring method according to any one of claims 1 to 5, wherein When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
Notifying the store clerk by in-store broadcast using a secret word that only the store clerk knows the location of the room temperature shelf where the product is left and the frozen or refrigerated product left.
The merchandise shelf monitoring method according to any one of claims 1 to 6, characterized in that: When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
Notifying that the room temperature shelf and the frozen product or refrigerated product are left by sounding from a sound reproduction device installed on the room temperature product shelf where the frozen product or refrigerated product is left,
The product shelf monitoring method according to any one of claims 1 to 7, wherein When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf,
The lights installed on the room temperature shelf where frozen or refrigerated goods are left are lit in a mode to notify the abnormality, thereby notifying the position of the room temperature shelf and that the frozen or refrigerated goods are left unattended. ,
The product shelf monitoring method according to any one of claims 1 to 8, wherein The commodity shelf monitoring system includes a cloud server that integrally manages information notified by the notification method,
When it is determined that the frozen product or the refrigerated product is left at each store, the cloud server receives the location information of the room temperature product shelf where the frozen product or the refrigerated product is left as log information from each store,
From the log information of each store, learn the location of the room temperature product shelf where frozen products or refrigerated products are easily left, and notify the learning information to each store,
The merchandise shelf monitoring method according to any one of claims 1 to 9, wherein The notification of the learning information is performed by an inter-store SNS capable of exchanging information between stores.
The product shelf monitoring method according to claim 10. A product shelf monitoring system for monitoring the state of product shelves in a store,
In the store, a temperature sensor that acquires the temperature distribution of a plurality of room temperature product shelves on which products stored at room temperature are displayed,
Based on the acquired temperature distribution data, a leaving determination unit that determines whether a frozen product or a refrigerated product is left for each of the plurality of room temperature product shelves;
When it is determined that the frozen product or the refrigerated product is left in the room temperature product shelf in the abandonment determination unit, based on the product shelf ID, a frozen product or a plurality of room temperature product shelves in the store A store server with a notification content determination unit that identifies which room temperature product shelf the refrigerated product is left unattended, determines the notification content and sends it;
A notification receiving device for receiving the notification content,
Product shelf monitoring system characterized by that.

Images