JP2019152934A - Stock monitoring system - Google Patents

Abstract

To provide stock monitoring in consideration of commodity provision preparation and sales opportunity.SOLUTION: A stock monitoring system 1 comprises: a monitoring camera 4 which captures ingredients of an oden display part 10; and a tablet terminal 2 which has analysis means 40 which analyzes a captured image captured by the monitoring camera 4 and discriminates the loaded state of the ingredients and notification means 42 which notifies a store clerk that the ingredients should be supplied according to the discrimination result of the loaded state.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an inventory monitoring system, which is suitable for application to an inventory monitoring system that analyzes image data obtained by photographing a product display unit with a camera and monitors the inventory of the product.

  Conventionally, a POS terminal device operated by a store staff reads a product code of a product purchased by a customer by a bar code scanner and inputs sales data including a sales quantity, and stores it in a database as sales data for each sales item. A system has been proposed (see, for example, Patent Document 1).

  In addition, by providing a system that enables inventory monitoring, ordering, and settlement of standard products in the refrigerators of each household, what kind of market share each household has for each product sold, etc. There has also been proposed a method for obtaining detailed data, which is more accurate than an analysis using a large amount of POS data, and that performs product renewal and target strategy more effectively (for example, see Patent Document 2). .

JP-A-8-22576 JP 2017-68812 A

  Techniques for simply monitoring inventory as described above have been known. However, in the case of oden and hot snacks (fried dishes such as croquettes) in stores such as convenience stores, they are sold after preparations for providing products such as warming in the store. However, there has been a problem that inventory monitoring in consideration of product provision preparation and sales opportunities cannot be performed.

  The present invention has been made in consideration of the above points, and an object of the present invention is to propose an inventory monitoring system capable of performing inventory monitoring in consideration of product provision preparation and sales opportunities.

  In order to solve such a problem, in the inventory monitoring system of the present invention, an imaging unit that images a monitoring target, an analysis unit that analyzes a captured image captured by the imaging unit and determines a loading state of the monitoring target, and a determination of the loading state Notification means for notifying the user that the monitoring target should be replenished according to the result is provided.

  As a result, the present invention automatically notifies the user that the product should be replenished based on the captured image of the product without any user operation, and notifies the user of the product at the timing of selling the product. Can be replenished to prepare for provision.

  ADVANTAGE OF THE INVENTION According to this invention, the inventory monitoring system which can perform inventory monitoring in consideration of goods provision preparation and a sales opportunity is realizable.

It is a figure which shows the structure of an inventory monitoring system. It is a perspective view which shows the structure of an oden sales part. It is a block diagram which shows the structure of a tablet terminal. It is a block diagram which shows the function structure of a tablet terminal. It is a flowchart which shows a loading state analysis processing procedure. It is a flowchart which shows the replenishment notification process procedure. It is a flowchart which shows a loading state notification process procedure. It is a figure which shows a display goods imaging screen. It is a figure which shows the last display goods imaging screen. It is a figure which shows an egg image. It is a figure which shows the display goods imaging screen of the state in which the supplement number notification part was displayed. It is a figure which shows the display goods imaging screen of the state where the supplement notification part was displayed. It is a figure which shows the display goods imaging screen of the state in which the material was selected. It is a figure which shows the display goods imaging screen of the state in which the loading quantity satisfaction notification part was displayed. It is a figure which shows the number-of-sales table according to an egg day. It is a figure which shows the sales amount table according to egg time.

  Hereinafter, modes for carrying out the invention (hereinafter referred to as embodiments) will be described with reference to the drawings.

[1. Embodiment]
[1-1. Inventory monitoring system configuration]
As shown in FIG. 1, the inventory monitoring system 1 is composed of a tablet terminal 2, a monitoring camera 4, a server 6, a wireless antenna 8, an oden display unit 10 and a lunch box display unit 12, for example, in a store ST such as a convenience store. Is installed.

  The tablet terminal 2 as an information processing terminal is arranged in the oden sales unit 10S shown in FIG. 2, and is operated by a salesperson, that is, a store clerk, and the control unit 20 controls the whole as shown in FIG. The control unit 20 is configured around a CPU (Central Processing Unit), and reads a predetermined program from a storage unit 24 including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, a flash memory, and the like. To execute the inventory monitoring operation.

  The control unit 20 includes a height monitoring processing unit, a height management processing unit, a camera switching processing unit, and an operation display processing unit (not shown). The presence / absence monitoring processing unit performs image analysis on the image data of a product such as oden received from the monitoring camera 4 and monitors the presence / absence state of the product. The high / high management processing unit manages high / low. The camera switching processing unit switches the subject of the monitoring camera 4. The operation display processing unit processes the screen display of the operation display unit 22. The operation display unit 22 includes an LCD (Liquid Crystal Display) that displays a screen for performing various instructions and operation guidance, a display product imaging screen, which will be described later, and a touch panel for selecting various instructions and inputting various information. It has become.

  The storage unit 24 stores an image of each ingredient IG (FIG. 2) of oden, an image of the oden display / selling case 10A, and a loading area 10B (in which each ingredient IG in the oden display / selling case 10A is loaded) The position in FIG. 2) is learned and stored in advance. In addition, the storage unit 24 stores the current loading number for each oden ingredient IG as the loading quantity information for each ingredient, and also counts the sales quantity for each oden ingredient IG in a time series to count the sales quantity for each ingredient. Store as information. The camera communication unit 26 is an interface for a LAN (Local Area Network) cable, for example, and performs data communication with the monitoring camera 4. The server communication unit 28 is an interface for wireless LAN, for example, and performs data communication with the server 6.

  The monitoring camera 4 (FIG. 1) is connected to the tablet terminal 2 by, for example, a LAN cable, and images, for example, the oden display unit 10 and transmits the image data to the tablet terminal 2. The monitoring camera 4 is disposed at a position where the height of the ingredients such as oden can be determined, and has a resolution capable of determining the height of the ingredients. In addition, the surveillance camera 4 has a resolution capable of enlarging the lunch box and the like when the lunch box with the barcode attached is present. Further, when there are a plurality of subjects, the monitoring camera 4 switches the subjects automatically or based on an instruction from the control unit 20.

  The server 6 is connected to the tablet terminal 2 via a wireless LAN such as Wi-Fi (registered trademark), and performs wireless communication with the tablet terminal 2 and is connected to a predetermined base outside the store ST via a network. Various types of information received from the tablet terminal 2 are accumulated and the information is analyzed. The server 6 holds an egg sales unit table TB1 shown in FIG. 15 and an egg sales unit table TB2 shown in FIG. 16 in the storage unit, and sales forecast data according to a request from the tablet terminal 2 Is transmitted to the tablet terminal 2.

  As shown in FIG. 2, the oden display unit 10 includes oden ingredients IG such as eggs and bamboo rings for each loading area 10B in the oden display / selling case 10A in which the loading area 10B is divided for each type of ingredients IG. Is stored. The lunch box display section 12 is arranged so that a plurality of lunch boxes LB overlap each other, and the container CL of the lunch box LB has a unique two-dimensional code TDC, barcode BC and RFID (for each type of lunch box LB). Radio Frequency Identifier) tag TG is attached. As described above, in the lunch box display unit 12, a plurality of tagged products with the RFID tag TG are arranged for each type of lunch box LB.

  The wireless antenna 8 is a highly directional RFID reader and can read, for example, an RFID tag TG of a lunch box LB that is a product with a tag in the lunch box display section 12. The control unit 20 of the tablet terminal 2 analyzes the image data of the lunch box display unit 12 received from the monitoring camera 4 to detect the arrangement relationship of the lunch box LB, and the RFID tag TG of the lunch box LB by the beam forming function of the wireless antenna 8. By reading, it is possible to specify a display state indicating how many types of lunch boxes LB are displayed.

[1-2. Composition of Oden Sales Department]
In the convenience store, an oden sales section 10S for selling oden is provided behind the cashier counter, which is the side away from the store clerk. Below, in the oden sales department 10S, the side facing the store clerk is the front side, and the opposite, that is, the side facing the customer is the back side, and the left, right, top, and bottom viewed from the store clerk facing the front side The left side, right side, upper side, and lower side will be described.

  The oden sales unit 10S includes a table 10T, a heat retaining device 10H, an oden display / sale case 10A, a lid 10C, a tablet terminal 2, and a heat shield panel 10HS. The heat retaining device 10H has a box shape having a predetermined thickness, is mounted on the table 10T side by side in the left-right direction, and is connected to a commercial power source, and heats the oden display / selling case 10A by a heater.

  The oden display / selling case 10A is placed on the upper surface of the heat retaining device 10H on the rear side away from the store clerk standing at the checkout counter, and stores various oden ingredients IG. The oden display / selling case 10A is formed to have a shorter length in the front-rear direction than the heat retaining device 10H. Therefore, an empty space exists in front of the oden display / sale case 10A on the upper surface of the heat retaining device 10H.

  The lid portion 10C is a lid configured to cover the oden display / sale case 10A, and is placed on top of the oden display / sale case 10A, so that the ingredients of the oden stored in the oden display / sale case 10A are externally provided. On the other hand, when the oden ingredients are taken by the customer or when the ingredients are replenished by the store clerk, they are removed from the oden display / selling case 10A. The surveillance camera 4 captures an image of oden when the lid 10C is removed from the oden display / sale case 10A.

  The tablet terminal 2 is placed with the operation display unit 22 facing slightly upward from the front so that the operation display unit 22 faces the store clerk on the upper surface of the heat retaining device 10H on the front side close to the store clerk at the checkout counter. For example, it is connected to the heat retaining device 10H by a USB (Universal Serial Bus) cable 10U and supplied with power.

  The heat shut-off panel 10HS is a plate-like member made of, for example, aluminum or the like, and the length in the left-right direction is longer than the width in the left-right direction of the tablet terminal 2, and the tablet terminal 2 and the oden display sales case 10A It is arranged so as to extend vertically and horizontally. Thereby, the heat shut-off panel 10HS prevents the heat generated by the heat retaining device 10H and the oden display / sales case 10A from being transmitted to the tablet terminal 2, and prevents the tablet terminal 2 from malfunctioning.

[1-3. Functional configuration of tablet terminal]
Here, FIG. 4 is a functional block diagram illustrating basic functions related to a loading state analysis process, a replenishment notification process, and a loading state notification process, which will be described later, in the tablet terminal 2. In FIG. 4, the control unit 20 implements the functional blocks of the analysis unit 40 and the notification unit 42 by executing a predetermined loading state analysis program, replenishment notification program, and loading state notification program. The analysis unit 40 analyzes the captured image captured by the monitoring camera 4 and determines the loading state of the ingredients. The notification means 42 notifies the store clerk that the ingredients should be replenished according to the determination result of the loaded state.

[1-4. Loading state analysis processing procedure]
Next, a specific processing procedure of the loading state analysis processing by the tablet terminal 2 will be described using the flowchart of FIG. The control unit 20 reads the loading state analysis processing program from the ROM and executes it to start the loading state analysis processing procedure RT1, and proceeds to step SP1. In step SP1, the control unit 20 starts tracking the change in the captured image, thereby tracking the change in the captured image at a constant cycle or constantly, and proceeds to step SP2.

  In step SP2, the control unit 20 receives image data indicating an image captured by the oden display unit 10 from the monitoring camera 4, and proceeds to step SP3. In step SP3, the control unit 20 displays on the operation display unit 22 the display product imaging screen DIP shown in FIG. 8, which is an image of the oden display unit 10, based on the image data received in step SP2, and then proceeds to step SP4. Move. In the display product imaging screen DIP, although the oden display / selling case 10A is shown, the table 10T, the heat retaining device 10H, the heat shut-off panel 10HS, and the tablet terminal 2 are not shown and are omitted.

  In step SP4, the control unit 20 compares and analyzes the current image data and the previous image data to determine which oden ingredients have been sold to the customer and the number of loaded items has decreased, or has been replenished by the store clerk. It is detected whether the number has increased, and the process proceeds to step SP5. Here, it is assumed that the current image data is the display product imaging screen DIP shown in FIG. 8, and the previous image data is the display product imaging screen DIP shown in FIG. At this time, based on the egg shape image IGE shown in FIG. 10 learned in advance in the storage unit 24 and the position of the loading area 10B in which the egg is loaded in the oden display / sales case 10A, the control unit 20, for example, It is automatically determined by image analysis that “4 sold.” Incidentally, when processing step SP4 for the first time, since the previous image data does not exist, the control unit 20 skips step SP4.

  In addition, the control unit 20 displays the oden when the current number of the loaded materials IG cannot be determined in detail by image analysis due to factors such as the resolution of the monitoring camera 4 being low or the photographing direction being inappropriate. By determining to some extent how much egg is loaded in, for example, the egg loading area 10B of the sales case 10A, it is detected in two stages whether replenishment is necessary or not. Similarly, when the clerk replenishes the ingredients IG and the resolution of the monitoring camera 4 is high, the control unit 20 can accurately determine the current number of loadings by image analysis, while the resolution of the monitoring camera 4 is low. Although the current loading number cannot be accurately determined by image analysis, it can be determined as long as it is replenished to a state where no further replenishment is necessary.

  In step SP5, the control unit 20 reflects the change in the loading number for each material detected in step SP4 in the loading number information for each material stored in the storage unit 24, thereby obtaining the loading number information for each material. Update and go to step SP6. In step SP6, for example, the control unit 20 counts the number of sales for each ingredient such as how many ingredients (products) called eggs are sold, and sells each ingredient stored in the storage unit 24. By reflecting in the number information, the sales number information for each ingredient is updated, and the process returns to step SP2.

  In this manner, the tablet terminal 2 periodically determines that the inventory of the ingredients has decreased due to the sale of the oden ingredients to the customer based on the change in the image on the display product imaging screen DIP. The number of units sold has been tabulated in time series. Thus, the tablet terminal 2 prevents the store staff from manually recording that the inventory of the ingredients has decreased from the oden display / sale case 10A each time the oden ingredients are sold. Can be improved.

  In addition, the tablet terminal 2 periodically determines that the inventory of the ingredients has increased as the oden ingredients are replenished by the store clerk based on the change in the image on the display product imaging screen DIP. The number of units sold has been tabulated in time series. This prevents the tablet terminal 2 from performing the cumbersome task of manually recording that the inventory of the ingredients has increased in the oden display / sale case 10A each time the oden ingredients are replenished. , Can improve usability.

[1-5. Replenishment notification processing procedure]
Next, a specific processing procedure of the supplement notification process by the tablet terminal 2 will be described with reference to the flowchart of FIG. The control unit 20 reads the replenishment notification processing program from the ROM and executes it to start the replenishment notification processing procedure RT2, and proceeds to step SP11.

  In step SP11, the control unit 20 determines whether there is an ingredient that needs to be replenished based on the detection result in the above-described loading state analysis processing procedure RT1 (FIG. 5). If an affirmative result is obtained here, this means that there is a material that needs to be replenished (hereinafter also referred to as a material that needs replenishment). At this time, the control unit 20 proceeds to step SP12. Hereinafter, a case where the replenishment-necessary material is an egg will be described as an example. On the other hand, if a negative result is obtained in step SP11, this means that the number of all the ingredients loaded is sufficient at present, and it is not necessary to perform replenishment. At this time, the control unit 20 returns to step SP11 and replenishes. Wait until the necessary ingredients appear.

  In step SP12, the control unit 20 determines whether or not the necessary replenishment quantity of the replenishment necessary material can be recognized. If a positive result is obtained here, the control unit 20 proceeds to step SP13 at this time. In step SP13, as shown in FIG. 11, the control unit 20 replenishes four eggs by displaying the replenishment number notifying unit 50 superimposed on the image of the egg loading area 10B that is a replenishment necessary ingredient. The store clerk is encouraged to move to step SP14. The replenishment number notifying unit 50 displays the type of the material to be replenished and the number to be replenished in words, is displayed in a translucent manner, and transmits the image of the replenishment necessary material loading area 10 </ b> B through the store clerk. To make it visible.

  In step SP14, the control unit 20 determines that the material to be replenished has been replenished based on the detection result in the loading state analysis processing procedure RT1 (FIG. 5). If a negative result is obtained here, this means that the replenishment-required material has not yet been replenished by the store clerk, and at this time, the control unit 20 displays the replenishment number notification unit 50 on the display product imaging screen DIP. The process returns to step SP11. On the other hand, if an affirmative result is obtained in step SP14, this indicates that the replenishment-required material has been replenished by the store clerk, and at this time, the control unit 20 proceeds to step SP15. In step SP15, the control unit 20 erases the display of the replenishment number notification unit 50, and returns to step SP11.

  On the other hand, if a negative result is obtained in step SP12, this may be recognized up to the number to be replenished, although it can be recognized that the replenishment of the necessary replenishment material is necessary due to factors such as the resolution of the surveillance camera 4 being low. In this case, the control unit 20 proceeds to step SP16. In step SP16, as shown in FIG. 12, the control unit 20 displays the replenishment notification unit 52 on the image of the egg loading area 10B, which is a replenishment necessary material, to indicate that replenishment is necessary. The store clerk is urged and the process proceeds to step SP17. Although this replenishment notification unit 52 does not display the number to be replenished, it displays the type of the material to be replenished and the fact that it should be replenished, is displayed in a translucent manner, and the replenishment necessary material The image of the loading area 10B is transmitted to the store clerk so as to be visually recognized.

  In step SP17, the control unit 20 determines that the material to be replenished has been replenished based on the detection result in the loading state analysis processing procedure RT1 (FIG. 5). If a negative result is obtained here, this means that the replenishment-required material has not yet been replenished by the store clerk. At this time, the control unit 20 keeps the replenishment notification unit 52 displayed on the display product imaging screen DIP. Return to step SP11. On the other hand, if an affirmative result is obtained in step SP17, this indicates that the replenishment-necessary material has been replenished by the store clerk, and at this time, the control unit 20 proceeds to step SP18. In step SP18, the control unit 20 erases the display of the replenishment notification unit 52 and returns to step SP11.

  As described above, when there is an ingredient whose loading number is not sufficient, the tablet terminal 2 displays the number that needs to be replenished as the replenishment quantity notifying unit 50 on the image of the loading area 10B of the ingredient. . As a result, the tablet terminal 2 can display the currently recognized loading state and allow the store clerk to check, point out the product that needs to be replenished, and prompt the replenishment.

  In addition, although there are ingredients whose number of loadings is not sufficient, the tablet terminal 2 needs to be replenished by superimposing it on the image of the loading area 10B of the ingredients when the specific number to be loaded cannot be determined. It is made to display as a replenishment notification part 52. Thereby, the tablet terminal 2 can point out the product which needs replenishment, and can make a salesclerk recognize that at least replenishment itself is necessary.

  Furthermore, since the tablet terminal 2 displays the replenishment number notification unit 50 or the replenishment notification unit 52 over the image of the loading area 10B of the material that needs replenishment, for example, a word such as “Replenish 4 eggs” is displayed. Compared with the case where the product is displayed at the corner inside the display product imaging screen DIP, the store clerk can recognize at a glance which ingredients should be replenished.

[1-6. Loading status notification procedure]
Next, a specific processing procedure of the loading state notification processing by the tablet terminal 2 will be described using the flowchart of FIG. The control unit 20 reads the loading state notification processing program from the ROM and executes it to start the loading state notification processing procedure RT3, and proceeds to step SP21.

  In step SP21, the control unit 20 waits until the image of the loading area 10B of the predetermined oden IG on the display product imaging screen DIP is pressed by the store clerk as shown in FIG. Move.

  In step SP22, as in step SP11 (FIG. 6), the control unit 20 is in a state where the material selected by the store clerk in step SP21 (hereinafter also referred to as a height confirmation selection material) needs to be replenished. It is determined based on the detection result in the above-described loading state analysis processing procedure RT1 (FIG. 5). Below, an egg is demonstrated as an example as a height confirmation selection tool material. If an affirmative result is obtained here, this means that the number of high / low confirmation selection materials is currently insufficient, so that replenishment is necessary. At this time, the control unit 20 proceeds to step SP23. Incidentally, since actually four eggs are loaded as shown in FIG. 13, the control unit 20 obtains a negative result in step SP22.

  In step SP23, as in step SP12 (FIG. 6), the control unit 20 determines whether or not the necessary replenishment number of the height confirmation selection tool material is recognizable. If a positive result is obtained here, the control unit 20 proceeds to step SP24 at this time. In step SP24, similarly to step SP13 (FIG. 6), as shown in FIG. 11, the control unit 20 sets the replenishment number notifying unit 50 on the image of the egg loading area 10B which is the height confirmation selection material. By displaying them repeatedly, the store clerk is urged to replenish four eggs, and the process proceeds to step SP25.

  In step SP25, as in step SP14 (FIG. 6), the control unit 20 determines that the material to be replenished has been replenished based on the detection result in the loading state analysis processing procedure RT1 (FIG. 5). Here, if a negative result is obtained, this means that the selected item for height confirmation has not yet been replenished by the store clerk. At this time, the control unit 20 displays the replenishment number notification unit 50 on the display product imaging screen DIP. The process returns to step SP21. On the other hand, if an affirmative result is obtained in step SP25, this means that the high / low confirmation selecting material has been replenished by the store clerk, and at this time, the control unit 20 proceeds to step SP26. In step SP26, similarly to step SP15 (FIG. 6), the control unit 20 deletes the display of the replenishment number notification unit 50 and returns to step SP21.

  On the other hand, if a negative result is obtained in step SP23, this means that the number of items to be replenished can be recognized although it can be recognized that replenishment of the height confirmation selection material is necessary due to factors such as the resolution of the surveillance camera 4 being low. Represents that it cannot be recognized. At this time, the control unit 20 proceeds to step SP27. In step SP27, as in step SP16 (FIG. 6), as shown in FIG. 12, the control unit 20 superimposes the replenishment notification unit 52 on the image of the egg loading area 10B, which is the height confirmation selection tool. Display, prompts the store clerk that replenishment is necessary, and proceeds to step SP28.

  In step SP28, as in step SP17 (FIG. 6), the control unit 20 determines that the material to be replenished has been replenished based on the detection result in the loading state analysis processing procedure RT1 (FIG. 5). Here, if a negative result is obtained, this means that the selected item for height confirmation has not yet been replenished by the store clerk. At this time, the control unit 20 displays the replenishment notification unit 52 on the display product imaging screen DIP. The process returns to step SP21. On the other hand, if an affirmative result is obtained in step SP28, this means that the high / low confirmation selection material has been replenished by the store clerk, and at this time, the control unit 20 proceeds to step SP29. In step SP29, similarly to step SP18 (FIG. 6), the control unit 20 erases the display of the replenishment notification unit 52 and returns to step SP21.

  On the other hand, when a negative result is obtained in step SP22, this indicates that the number of loaded high / low confirmation selection materials is currently sufficient, so that replenishment is not necessary, and at this time, the control unit 20 proceeds to step SP30. Move. In step SP30, the control unit 20 displays the loaded quantity satisfaction notification unit 54 as shown in FIG. 14 so as to overlap the display product imaging screen DIP, and proceeds to step SP31. The loading number satisfaction notification unit 54 displays the name of the height confirmation selection material, the current loading number, and the wording that the loading number is sufficient. In step SP31, the control unit 20 deletes the display of the loaded quantity satisfaction notification unit 54 after a predetermined time has elapsed after displaying the loaded number satisfaction notification part 54, returns to step SP21, and the image of the predetermined oden ingredients is displayed in the store clerk. Wait until it is pressed.

  As described above, when the image is pressed by the store clerk and the number of selected ingredients is not sufficient, the tablet terminal 2 overlaps the image of the ingredient loading area 10B and displays the quantity that needs to be replenished in the supplement number notification unit 50. Displayed as. As a result, the tablet terminal 2 can display the currently recognized loading state and allow the store clerk to check, point out the product that needs to be replenished, and prompt the replenishment.

  The tablet terminal 2 displays the replenishment number notification unit 50 or the replenishment notification unit 52 over the image of the loading area 10B of the material that needs replenishment. Can be made to recognize at a glance which ingredients should be replenished as compared with the case where it is displayed in the corner inside the display product imaging screen DIP.

  In addition, the tablet terminal 2 automatically deletes the display of the loading number satisfaction notification unit 54 when a predetermined time has elapsed after displaying the loading number satisfaction notification unit 54. As a result, the tablet terminal 2 can improve the usability by preventing the clerk from manually removing the loading number satisfaction notification unit 54 manually.

[1-7. Replenishment prediction method]
Here, there are two types of sales forecasts performed by the server 6, that is, total sales on the day, which is total sales on the current day, and total sales on hour, which is total sales on a daily basis. When the store is open 24 hours, the total sales for each hour is totaled for one day, which is the total sales for one day. The server 6 predicts total sales on the day and total sales by hour using a statistical method with reference to the number of sales before the previous year. Further, the server 6 transmits sales forecast information, which is information on the predicted sales, to the tablet terminal 2.

[1-7-1. Forecast method for total sales on the day]
The daily sales number table TB1 in FIG. 15 shows the daily sales numbers in the case of eggs. In this egg daily sales table TB1, for example, 70 items sold on January 1, 2015 were sold in a total of 70 eggs from 0:00 to 23:59 on January 1, 2015. Represents that. Based on the past sales data of January 1, 2015, 2016, and 2017, which are 70, 60, and 70, the server 6 uses a general statistical method such as the Holt Winters method. The number of eggs sold on January 1, 2018 is predicted to be 62. Similarly, the server 6 predicts other dates such as January 2 and January 3 in 2018 based on the data of the same date in the past year.

[1-7-2. Forecasting method for total sales by hour]
FIG. 16 shows the number of sales by hour in the case of eggs, in the sales number table TB2 by egg in FIG. In this sales amount table TB2 by egg time, for example, five sales numbers from 0:00 to 0:59 in 2015 are 0: 00 to 0: 0 from January 1 to December 31, 2015. The average value per day of the number of eggs sold in 59 is shown. For example, when the server 6 predicts the sales of eggs from 0:00 to 0:59 in 2018, it is the number of sales from 0:00 to 0:59 in 2015, 2016 and 2017, which are past data. Based on the five, the one, and the four, for example, the number is predicted to be five in the prediction column PD using a general statistical method such as the Holt Winters method. Similarly, the server 6 also predicts other time zones such as 1:00 to 1:59 and 2:00 to 2:59 in 2018 based on data in the same time zone in the past year.

[1-8. About judgment and prediction of whether supplementation is necessary]
For example, suppose that 2 hours are required for the penetration of the soup taste and the heat retention time until the egg is taken out of the refrigerator and can be provided to the customer. And if the current time is 21:00 on December 31, 2017, it has been found that two pieces will be sold based on the prediction column PD at 2:00 on January 1, 2018, two hours later. Therefore, it is necessary to secure five or more loaded stocks at 22:00 on December 31, 2017. If the number of loaded items is less than 5 at 22:00, or if the surveillance camera 4 has a low resolution and can only determine the approximate amount of eggs, the tablet terminal 2 is set to 7 that are full of eggs. Encourage clerk to refill. Thereby, the tablet terminal 2 can be completed so that a necessary and sufficient number of eggs can be provided to the customer at 0:00 on January 1, 2018.

[1-9. Effect]
In the above configuration, the inventory monitoring system 1 installs the tablet terminal 2 at a place where the store clerk can reach, displays an image of the displayed product on the tablet terminal 2, and the image of the oden display unit 10 captured by the monitoring camera 4. Analyzing the data one by one, calculating the timing when replenishment is necessary, taking into account the preparation time that requires warming etc. in advance, and if it is determined that the number of loaded materials that are in stock of the product is small, The store clerk is automatically notified even if it is not operated by the store clerk. Accordingly, the inventory monitoring system 1 can appropriately prepare for provision of products in advance, and can prevent the missed sales opportunity of products.

  In addition, the inventory monitoring system 1 counts the number of sales for each ingredient in time series based on the image analysis result. For this reason, the inventory monitoring system 1 can manage the sales quantity for each ingredient with high accuracy while preventing an erroneous input of the sales quantity by the store clerk.

  Further, the inventory monitoring system 1 displays the replenishment number notification unit 50 and the replenishment notification unit 52 so as to be superimposed on the image of the loading area 10 </ b> B of the material that needs replenishment on the display product imaging screen DIP. did. Thereby, the inventory monitoring system 1 can make a store clerk recognize the kind of the material which should be replenished at a glance.

  Further, the inventory monitoring system 1 detects an increase or decrease in the number of products loaded by analyzing the image data of the oden display unit 10 captured by the monitoring camera 4. As a result, the inventory monitoring system 1 can eliminate the need for the store clerk to manually input whether the product has been replenished or sold, and can eliminate complicated operations.

  Here, for example, when selling oden at a convenience store, it takes a certain time (such as 2 hours) to soak the ingredients in the juice. When the sales of oden reaches a peak during a certain period of time, if the inventory of ingredients is not sufficiently replenished before the peak, shortage will occur and opportunity loss will occur.

  On the other hand, the inventory monitoring system 1 automatically manages the sales of ingredients by image processing, warns the ingredients that are likely to be out of stock at the peak time, and prompts the clerk to replenish. For this reason, the inventory monitoring system 1 can be in a state where the ingredients are completed by the peak time, and can prevent occurrence of opportunity loss. In addition, the inventory monitoring system 1 does not prompt replenishment for commodities that do not require replenishment. For this reason, the inventory monitoring system 1 can prevent the juice from excessively penetrating into the ingredients or the ingredients being deteriorated due to heat insulation for a long time.

  Sales of ingredients can be managed at the POS cash register as before, but since oden ingredients are ordered in batches of frozen foods on a weekly basis, it is possible to determine in advance how much sales will be in that week. Prediction is necessary. For this reason, if an appropriate prediction without grounds is made, the balance between purchasing and sales is lost, and shortages and inventory occur, resulting in loss.

  On the other hand, the inventory monitoring system 1 automatically calculates the material balance. For this reason, the inventory monitoring system 1 can accumulate the number of sales on that day. In addition, the inventory monitoring system 1 can predict the number of orders placed on a weekly basis using the Holt Winters method or the like by using data before the previous year. Thus, the inventory monitoring system 1 can perform accurate prediction by performing automatic prediction based on past results, and can prevent shortage and inventory.

  Furthermore, the inventory monitoring system 1 arranges the tablet terminal 2 in an empty space in front of the oden display / sale case 10A on the upper surface of the heat retaining device 10H. For this reason, the inventory monitoring system 1 is located in front of the oden display sales case 10A on the upper surface of the heat retaining device 10H, which is a place where the store clerk can easily see and is inconspicuous to the customer in the limited space ST. Free space can be used effectively.

  In particular, during lunch time, which is the so-called earning time, for example, although a large amount of bento LB is stored in the backyard of a convenience store store, the store clerk can return to the bento display unit 12 from the backyard. Since the lunch box LB is not replenished, the lunch box LB may not be displayed on the lunch box display portion 12 or only a small number of boxes may be displayed. In such a case, the customer cannot purchase the type of lunch box LB that is not displayed, and the customer tends to psychologically cancel the purchase of the lunch box LB that is only displayed in a small number. For this reason, if the lunch box LB is not properly replenished to the lunch box display unit 12 in real time during a short lunch time, an extremely large opportunity loss occurs.

  On the other hand, the inventory monitoring system 1 monitors the lunch box LB of the lunch box display unit 12, and when there is a type of lunch box LB whose number of displayed stocks is reduced, the inventory monitoring system 1 should replenish the image of the lunch box display unit 12. Opportunity loss can be prevented by causing the operation display unit 22 to immediately display on the operation display unit 22 that it should be replenished over the image of the type lunch box LB.

  According to the above configuration, the inventory monitoring system 1 analyzes the monitoring camera 4 that images the ingredient IG of the oden display unit 10 to be monitored and the captured image captured by the monitoring camera 4 to determine the loading state of the ingredient IG. The analyzing means 40 for determining and the notifying means 42 for notifying the store clerk as a user that the ingredient IG should be replenished according to the determination result of the loading state are provided.

  As a result, the inventory monitoring system 1 automatically notifies the store clerk that the ingredients should be replenished based on the captured image of the oden display unit 10 without any operation by the store clerk, and matches the timing of selling the ingredients. The store clerk can be replenished with ingredients and prepared for provision.

[2. Other Embodiments]
In the above-described embodiment, when the number of materials to be loaded is insufficient at present and the necessary number of materials to be replenished can be recognized, the replenishment number notification unit 50 displays the replenishment number. Said. The present invention is not limited to this, and it is possible to simply display that replenishment is necessary without displaying the number of replenishments. Further, the loading area 10B for the material that needs to be replenished may be displayed flicked (flashing).

  In the embodiment described above, the case where the replenishment number notification unit 50 and the replenishment notification unit 52 are displayed so as to be aligned with the image of the loading area 10B of the material that needs replenishment has been described. The present invention is not limited to this. For example, a balloon may be displayed and a wording may be displayed inside the balloon so as to indicate an image of the loading area 10B of the material that needs to be replenished. In short, any display form that allows the store clerk to recognize at a glance the type of ingredients to be replenished may be used. Further, the replenishment number notification unit 50 and the replenishment notification unit 52 are displayed at various positions such as corners inside the display product imaging screen DIP, for example, without aligning with the image of the loading area 10B of the material that needs replenishment. May be.

  Furthermore, in the above-described embodiment, the case where the replenishment number notification unit 50 is displayed on the operation display unit 22 has been described. The present invention is not limited to this, and the type of material to be replenished and the number to be replenished may be output by voice. Similarly, the replenishment notification unit 52 may output the type of the material to be replenished and the fact that it should be replenished by voice. Further, either the type of the material to be replenished or the number to be replenished may be displayed on the operation display unit 22, and the other may be output by voice. The same applies to the replenishment notification unit 52. In addition, when a predetermined time has elapsed since the replenishment number notification unit 50 or the replenishment notification unit 52 is displayed on the operation display unit 22, a sound may be output to notify the store clerk.

  Further, in the above-described embodiment, the case where the type of material to be replenished and the number to be replenished are displayed on the replenishment number notifying unit 50 has been described. The present invention is not limited to this, and after aligning the position with the loading area 10B of the material to be replenished, the type of the material to be replenished is not displayed, and only the number to be replenished is displayed in the replenishment number notification unit 50. It may be displayed. Similarly, the replenishment notification unit 52 may display only that it should be replenished.

  Furthermore, in the above-described embodiment, a case has been described in which the type of material to be replenished and the number to be replenished are displayed on the replenishment number notifying unit 50 in words. The present invention is not limited to this. For example, both the type and the number of ingredients to be replenished or only the type may be displayed as an image such as a photograph instead of words. The same applies to the replenishment notification unit 52.

  Further, in the above-described embodiment, the tablet terminal 2 performs image analysis, receives sales forecast information from the server 6, and based on the sales forecast information and the image analysis result, the replenishment number notification unit 50 or the replenishment notification unit 52. The case where the display is displayed and the loaded state is discriminated is described. The present invention is not limited to this, the tablet terminal 2 transmits the captured image to the server 6, the server 6 analyzes the image and determines the loaded state, and transmits the identification result to the tablet terminal 2, or the control unit of the tablet terminal 2 The processing may be arbitrarily shared between the tablet terminal 2 and the server 6 such that the server 6 assists complicated image analysis that cannot be performed by 20 alone. That is, the analysis means 40 may be included only in the tablet terminal 2 as described above, or only the server 6 or both the tablet terminal 2 and the server 6 may be included.

  Further, in the embodiment described above, it is determined by image analysis whether the egg has increased or decreased based on the egg shape image IGE and the position of the loading area 10B where the egg is loaded in the oden display sales case 10A. Said. The present invention is not limited to this. For example, the entire image of the oden display / selling case 10A may be compared one by one to determine whether each material is present or not.

  Further, in the above-described embodiment, the case where the analysis is performed based on the image data obtained by imaging the oden display unit 10 has been described. The present invention is not limited to this, and is an image obtained by imaging various products capable of discriminating the number by analyzing the image of the actual product itself such as a meat bun display shelf, a vegetable display shelf, a fried display shelf, a vegetable display shelf and a fruit display shelf. Analysis may be performed based on the data.

  In addition, when the resolution of the surveillance camera 4 is high, image analysis of the two-dimensional code TDC or barcode BC attached to the lunch box is specified instead of performing image analysis of the entire lunch box, and inventory is managed. May be. In this case, the product can be specified without having to learn the image of the lunch box itself in advance. In that case, in the case of a product wrapped in a predetermined wrapping paper such as confectionery or bread, or a product stored in a predetermined container such as a lunch box, a two-dimensional code or barcode is attached to the wrapping paper or container. It ’s fine.

  Further, in the above-described embodiment, the case where two oden display / selling cases 10A are monitored has been described. The present invention is not limited to this, and any number of oden display / selling cases 10A, such as one or three or more, for example, one oden display / selling case 10A and one fried food display shelf, etc. are combined, and a plurality of locations are simultaneously displayed. You may monitor.

  Furthermore, in the above-described embodiment, the case where the image data captured by the monitoring camera 4 is analyzed and the replenishment number notification unit 50 and the replenishment notification unit 52 are displayed over the display product imaging screen DIP based on the image data will be described. It was. The present invention is not limited to this. The image data captured by the camera unit by the tablet terminal 2 itself is analyzed, and the replenishment number notification unit 50 and the replenishment notification unit 52 are displayed on the display product imaging screen DIP based on the image data. May be.

  Furthermore, the heat retaining device 10H may measure the weight of the object placed on the upper surface. In that case, since the weight of the oden display sales case 10A and the ingredients can be measured, the increase / decrease accuracy of the number of loads can be improved by comparing the increase / decrease in the number of loads determined by image analysis with the increase / decrease in the measured weight. In addition, it is possible to improve the calculation accuracy of the number sold for each ingredient.

  Furthermore, in the above-described embodiment, the case where the heat shield panel 10HS is made of aluminum has been described. The present invention is not limited to this, and the heat shut-off panel 10HS may be composed of other various materials.

  Furthermore, in embodiment mentioned above, the case where the thermal-insulation panel 10HS was arrange | positioned between the tablet terminal 2 and the oden display sale case 10A was described. The present invention is not limited to this, and when the heat generated by the heat retaining device 10H and the oden display / selling case 10A does not affect the operation of the tablet terminal 2, the heat shut-off panel 10HS may be omitted.

  Furthermore, in embodiment mentioned above, the case where the tablet terminal 2 with which the control part, the operation part, and the display part were integrated was provided was described. The present invention is not limited to this, and a control unit, an operation unit, and a display unit are provided separately. For example, a personal computer, a mouse, and a display are provided, and the display is disposed on the front side of the upper surface of the heat retaining device 10H. A mouse may be placed around the cashier counter.

  Furthermore, in embodiment mentioned above, the case where the tablet terminal 2 was arrange | positioned in the front side in the upper surface of the heat retention apparatus 10H was described. The present invention is not limited to this, and the tablet terminal 2 may be arranged in various other places such as a cashier counter. In that case, it is preferable that the tablet terminal 2 is arrange | positioned in the position where the salesclerk who stood in front of the cashier counter is easy to visually recognize.

  Furthermore, in embodiment mentioned above, the case where the one surveillance camera 4 was arrange | positioned in store ST was described. The present invention is not limited to this, and an arbitrary number of surveillance cameras 4 of two or more may be arranged in the store ST. In that case, the tablet terminal 2 may display the image data received from the plurality of monitoring cameras 4 on the operation display unit 22 while switching at predetermined time intervals. A plurality of tablet terminals 2 may be provided.

  Furthermore, in embodiment mentioned above, the case where the server 6 was arrange | positioned inside the shop ST was described. The present invention is not limited to this, and the server 6 may be arranged outside the store ST. In that case, the server 6 may collect information of the tablet terminals 2 at a plurality of locations in a lump.

  Further, in the above-described embodiment, the case where the server 6 and the tablet terminal 2 are connected by the wireless LAN has been described. The present invention is not limited to this, and the server 6 and the tablet terminal 2 may be connected by various communication means such as a wired LAN cable.

  Furthermore, in the above-described embodiment, the case where the monitoring camera 4 and the tablet terminal 2 are connected by a LAN cable has been described. The present invention is not limited to this, and the monitoring camera 4 and the tablet terminal 2 may be connected by various communication means such as a USB cable and a wireless LAN.

  Furthermore, in the above-described embodiment, the inventory monitoring system 1 as the inventory monitoring system is configured by the monitoring camera 4 as the imaging means, the analysis means 40 as the analysis means, and the notification means 42 as the notification means. Said. However, the present invention is not limited to this, and an inventory monitoring system may be configured by imaging means, analysis means, and notification means having various other configurations.

  The present invention can also be used in various systems that perform analysis based on image data obtained by capturing various products that can be captured by a camera.

  1 ... inventory monitoring system, 2 ... tablet terminal, 4 ... surveillance camera, 6 ... server, 8 ... wireless antenna, 10 ... oden display department, 10S ... oden sales department, 10A ... oden display sales Case, 10B ... Loading area, 10T ... Table, 10H ... Insulation device, 10C ... Lid, 10HS ... Thermal shut-off panel, 10U ... USB cable, 12 ... Lunch display part, 20 ... Control part , 22... Operation display unit, 24... Storage unit, 26... Camera communication unit, 28 .. server communication unit, 40... Analysis unit, 42. ... Replenishment notification section, 54 ... Load quantity satisfaction notification section, ST ... Store, DIP ... Display product imaging screen, IGE ... Egg shape image, LB ... Lunch box, CL ... Container, TDC ... Two-dimensional code , BC ... Barcode TG ...... RFID tag, TB1 ...... egg Daily sales quantity table, TB2 ...... egg Hourly sales quantity table, PD ...... prediction column.

Claims (12)

An imaging means for imaging a monitoring target;
Analyzing means for analyzing a captured image captured by the imaging means and determining a loading state of the monitoring target;
An inventory monitoring system comprising: notification means for notifying a user that the monitoring target should be replenished according to a determination result of the loading state. The inventory monitoring system according to claim 1, wherein the notifying unit displays the captured image and superimposes and displays on the captured image that the monitoring target should be supplemented. The inventory monitoring system according to claim 2, wherein the notification unit clearly indicates a position of the monitoring target to be supplemented in the captured image and displays that the monitoring target is to be supplemented. The inventory monitoring system according to claim 3, wherein the notification unit displays that the monitoring target should be replenished at a position of the monitoring target to be replenished in the captured image. The inventory monitoring system according to claim 1, wherein the notification unit notifies the user of the number to be replenished with the monitoring target. The inventory monitoring system according to claim 1, wherein the notification unit notifies the user that the monitoring target should be replenished regardless of the operation of the user. The notification means notifies the user in advance of the preparation time from the time to be provided according to the preparation time required until the product to be monitored can be provided. Inventory monitoring system. The inventory monitoring system according to claim 1, wherein the notification unit immediately notifies the user when a preparation time required until the product to be monitored can be provided is not required. The inventory monitoring system according to claim 1, wherein the monitoring target is a product arranged in a store. The inventory monitoring system according to claim 9, wherein the monitoring target is a product that is distinguished and arranged for each type of product in a store. The inventory monitoring system according to claim 1, wherein the analysis unit and the notification unit are arranged in an information processing terminal. The analyzing means is arranged in a server;
The inventory monitoring system according to claim 1, wherein the notification unit is disposed in an information processing terminal.

Images