JP2019192095A - Product movement detection device, and product movement detection method - Google Patents

Abstract

To provide a product movement detection device and product movement detection method in an unmanned register reducing a working burden of a shop user by using a mobile terminal upon purchasing products, and accurately identifying the product selected by the shop user.SOLUTION: A product movement detection device of one embodiment has: a display area that is composed of one individual area segmented by a rail or a plurality of individual areas, and displays products; a first sensing unit and second sensing unit that are arranged in the individual area; a third sensing unit that is arranged in the display area; and a server that collects sensing results of the first sensing unit, the second sensing unit and the third sensing unit, and controls the sensing units, in which the server is configured to determine that a user based on a third notification removes the product based on a first notification and second notification from the individual area.SELECTED DRAWING: Figure 1A

Description

  One embodiment relates to a commodity movement detection device and a commodity movement detection method.

  The introduction of an unattended cash register where a purchaser who purchases a product in a store checks the purchased product himself and pays it is proceeding. Unmanned cash registers are expected to be introduced more and more in the future because it is expected to improve the efficiency of store operations and shorten the time required for payment when purchasing products.

JP, 2006-532932, A

  The unmanned cash register described above may cause the store user to perform work necessary for purchasing the product, such as causing the store user to check the purchased product when paying for the product to be purchased.

  There is also a system that eliminates the check of purchased products when making a settlement by determining the products selected by the store user as purchased products by image recognition. However, this system may not correctly determine the product selected by the store user by image recognition depending on the positional relationship between the product and the store user when selecting the product.

  On the other hand, portable terminals such as smartphones and tablets are always carried anywhere, and for example, a membership number acquired to use a store is managed by an application installed on the portable terminal. There are many cases.

  Therefore, in this embodiment, the product movement detection device and the product in the unmanned cash register that reduces the work load of the store user and correctly determines the product selected by the store user by using the mobile terminal when purchasing the product. It is an object to provide a movement detection method.

  The product movement detection device according to an embodiment includes a display area for displaying products, a first sensing unit arranged in the individual area, and one or more individual areas divided by rails. A second sensing unit disposed; a third sensing unit disposed in the display area; a sensing result of the first sensing unit; a sensing result of the second sensing unit; and a sensing result of the third sensing unit. A server that collects and controls the server, and the first sensing unit notifies the server of a result of detecting that the product displayed in the individual area has been moved by a user as a first notification. The second sensing unit detects the result of detecting that the product displayed in the individual area has been moved by the user as a second notification. To the server, the third sensing unit notifies the server that the user has moved the product as a third notification, the server based on the third notification, the user, It is a goods movement detection device which judges that the goods based on the 1st notice and the 2nd notice were removed from the individual area.

FIG. 1A is an overall view of a commodity movement detection apparatus according to an embodiment. FIG. 1B is a diagram illustrating an example of a store entry confirmation operation panel. FIG. 1C is a diagram illustrating an example of an arrangement of rails arranged on the display area. FIG. 1D is a diagram illustrating an example of a store exit confirmation operation panel. FIG. 2 shows the behavior of a store user including the product movement detection apparatus of the present embodiment from the prior registration for using the store until the actual purchase of the product and the exit from the store, and in that case It is the figure which showed the relationship with the device used. FIG. 3 is a diagram showing the pre-registration procedure of S1 of FIG. FIG. 4A is a diagram showing a state of store entry confirmation in S2 of FIG. FIG. 4B is a diagram illustrating a process flow for entering a store. FIG. 5A is a diagram showing a state of browsing of products in the product selection in S3 of FIG. FIG. 5B is a view of the user A viewing the product displayed in the display area of the shelf freely and viewing it from the top. FIG. 6A is a diagram illustrating an example of the arrangement of distance sensors and weight sensors arranged in an individual area in order to recognize that a user has taken out a product from the individual area. FIG. 6B is a diagram illustrating an example of an operation outline sequence of a user, a reader (entry confirmation operation panel), a reader (shelf), and a server when the user takes out a product from an individual area. FIG. 6C is a diagram illustrating another example of an operation outline sequence of a user, a reader (entry check operation panel), a reader (shelf), and a server when the user takes out a product from an individual area. FIG. 6D is a diagram illustrating another example of an operation outline sequence of a user, a reader (entry check operation panel), a reader (shelf), and a server when a user takes out a product from an individual area. FIG. 6E is a diagram showing a processing flow of a distance sensor and a weight sensor for sensing (measuring) a taken-out product, which is the processing of S606 in FIG. 6B. FIG. 6F shows the process of S608 and S609 in FIG. 6B, the identification of the extracted commodity A, the identification of the user A who has extracted the commodity A, and the identification of the commodity A specified in the basket A of the identified user A. It is the figure which showed the processing flow of the server to input. FIG. 7 is a diagram showing a state of the store exit confirmation in S5 of FIG. FIG. 8 is a diagram showing an example of another form of a shelf for displaying products. FIG. 9A is a diagram illustrating an example of a screen transition of the user's mobile terminal when the user returns the product to the individual area. FIG. 9B shows an example of an operation outline sequence of the user, reader (entry confirmation operation panel), reader (shelf), and server when the user returns the product to the individual area according to the screen transition shown in FIG. 9A. FIG. FIG. 9C is a diagram illustrating a processing flow of the return identification processing (server). FIG. 9D shows the screen transition of the user's mobile terminal when the product to be returned to the individual area is identified using only the sensing results of the distance sensor and the weight sensor in the individual area. It is an example. FIG. 9E is an example of screen transition of the user's mobile terminal when the distance sensor and the weight sensor are not used when returning the product to the individual area. FIG. 9F is an example of the screen transition of the user's mobile terminal when the distance sensor and the weight sensor are not used when returning the product to the individual area.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1A is an overall view of a commodity movement detection apparatus according to an embodiment.

  1 is a store 1 provided with the goods movement detection apparatus concerning one Embodiment.

  Reference numeral 100 denotes a store entrance gate of the store 1. When the store 1 visits the store 1, the store visitor confirms that the store 1 is qualified to use the store 1. As a result of the confirmation, if it is determined that the owner is qualified to use the store 1, the store visitor can enter the store 1 through the store entrance gate 100. The entrance gate 100 is, for example, a speaker (not shown) that emits a notification sound or an LED (Light Emitting Diode, not shown) that emits a notification lamp as means for notifying the visitor that entry is permitted or not permitted. ) May be provided.

  Reference numeral 110 denotes a store entry confirmation operation panel for performing store entry confirmation indicating that the store visitor is a qualified holder of using the store 1. As shown in FIG. 1B, the store entry confirmation operation panel 110 displays a membership number issued to a holder who is qualified to use the store 1 and a terminal identification number of a portable terminal carried by the store visitor. A reader (reader (also referred to as a store entry operation panel)) 110-1 for reading and a camera 110-2 for photographing a face portion of the store visitor are provided. The membership number and terminal identification number read by the reader (reader (entry confirmation operation panel)) 110-1 and the image of the face portion photographed by the camera 110-2 are sent to the server 200 via the network 201. The server 200 confirms that the store visitor is a qualified person using the store 1 by using the sent membership number and the image of the face portion.

  The membership number is managed by a specific application installed on the mobile terminal owned by the visitor. This specific application is an application provided from the store 1, pre-registration for becoming a member who is qualified to use the store 1, selection of products after entering the store 1, purchase of products This is an application used in various situations such as (settlement).

  The membership number is readable by the reader 110-1 by being displayed on the display screen of the mobile terminal by a specific application together with the terminal identification number of the mobile terminal owned by the visitor, for example, by QR code (registered trademark). Also good. Alternatively, the membership number can be received by the reader 110-1 through short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal by a specific application together with the terminal identification number of the mobile terminal owned by the visitor. It may be. The portable terminal may be any electronic device that can be carried by the user of the store 1, such as a smartphone, a tablet, or a PC (personal computer).

  When the member number is displayed on the display screen of the portable terminal by a specific application, for example, the displayed QR code is valid for a certain period of time from the viewpoint of security. A new QR code may be displayed again by exchanging.

  Further, the store entry confirmation operation panel 110 may be provided with a help button 110-3 for calling a store clerk in the store 1 when the operation method of the store entry confirmation operation panel 110 is not known or when an operation trouble occurs. Good.

  As a result of confirmation of entrance by face authentication of the membership number and the face portion, if the visitor of the store 1 is determined to be a holder of the qualification to use the store 1, the visitor passes through the entrance gate 100. Can enter the store 1. In order for a visitor to obtain the qualification to use the store 1, prior registration is required. The pre-registration procedure will be described with reference to FIG.

  Reference numeral 120 denotes a shelf having a size in the horizontal, depth, and height directions for displaying the products in the store 1.

  Reference numeral 121 denotes a display area that the shelf 120 has and spreads in a plate shape for displaying each product. The display area 121 may be composed of one stage or a plurality of stacked stages. In the example of the shelf 120 in FIG. 1, the display area 121 is the first display area 121-1, the second display area 121-2, the third display area 121-3, and the fourth display area 121. -4 is an example of a display area that is stacked in five stages, which is the fifth-stage display area 121-5.

  A partition plate 122 partitions the display area 121 in the height direction of the shelf 120 with an appropriate width. It is desirable that the interval between the adjacent partition plates 122 be a sufficient interval necessary for one user to view or pick up the products displayed in the display area 121. The interval is, for example, about 1 meter.

  123 is a rail arrange | positioned on the display area 121 which spreads in plate shape. The rail 123 has a height that is perpendicular to the plate-shaped display area 121, and extends in the depth direction of the shelf 120 along the partition plate 122 when viewed from the user standing in front of the shelf 120. Are arranged on the display area 121. The display area 121 is divided into a plurality of individual areas 124 by the rails 123. An example of the arrangement of the rails 123 arranged on the display area 121 will be described with reference to FIG. 1C.

  An individual area 124 is configured by dividing the display area 121 by the rail 123. The individual area 124 is an area for arranging products in a line. In one individual area 124, one type of product is displayed in the same direction. Therefore, the interval between the adjacent rails 123 constituting one individual area 124 can be changed to match the size of the displayed product. As described above, the display area 121 includes one or more individual areas 124. The individual area 124 is uniquely assigned with an individual area identification number. By specifying the individual area identification number, the location of the individual area 124 to which the number is assigned can be specified.

  One distance sensor 131 and one weight sensor 132 are arranged in one individual area 124. The distance sensor 131 and the weight sensor 132 can communicate with the server 200 via the network 201.

  Reference numeral 111 denotes a store exit confirmation operation panel for performing store exit confirmation for confirming that the user of the store 1 has completed the settlement of the product input to the basket shown in FIG. The store exit confirmation operation panel 111 includes a reader (also referred to as a reader (store exit confirmation operation panel)) 111-1 that reads a settlement completion notice.

  The payment completion notification means that the payment sent from the server 200 of the store 1 to the user's mobile terminal is completed when payment is made to purchase the product input in the basket described with reference to FIG. It is a notification. The payment completion notification may include information on a product for which payment has been completed.

  The payment completion notice is read by the reader (reader (exit confirmation operation panel)) 111-1 by being displayed on the display screen of the mobile terminal by, for example, a QR code by a specific application installed on the user's mobile terminal. It may be possible. Alternatively, the payment completion notification may be received by the reader 111-1 via short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal by a specific application.

  The settlement process will be described with reference to FIGS. The configuration of the store exit confirmation operation panel 111 will be described with reference to FIG. 1D.

  101 is a store exit gate of the store 1. The user causes the reader 111-1 of the store exit confirmation operation panel 111 to read the settlement completion notice, and when the confirmation of the completion of the settlement of the purchased product is completed, the user passes through the store exit gate 101 and stores 1. You can leave the store. The exit gate 101 includes, for example, a speaker (not shown) that emits a notification sound and an LED (not shown) that illuminates a notification lamp as means for notifying the user that the store is permitted or not permitted. Also good.

  Reference numeral 130 denotes a reader (also referred to as a reader (shelf)) that is installed on the shelf 120 and reads the terminal identification number of the mobile terminal owned by the user in order to identify the user. Between the adjacent partition plates 122, at least one reader 130 is installed at an arbitrary position. The reader (reader (shelf)) 130 is connected to the server 200 via the network 201, and the user is identified in the server 200 by sequentially sending the read terminal identification number to the server 200.

  The reader 130 may further include a speaker (not shown) and a display screen (not shown) for providing various information to the user.

  The terminal identification number of the mobile terminal owned by the user may be readable by the reader 130 by being displayed on the display screen of the mobile terminal by a specific application provided by the store 1, for example, with a QR code. Further, the terminal identification number of the mobile terminal owned by the user may be readable by the reader 130 by being displayed on the display screen of the mobile terminal together with the member number managed by the specific application, for example, with a QR code.

  Alternatively, the terminal identification number of the mobile terminal owned by the user may be receivable by the reader 130 via near field communication such as NFC (Near Field Communication) provided in the mobile terminal by a specific application. The terminal identification number of the mobile terminal owned by the user can be read by the reader 130 through short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal together with the membership number managed by the specific application. It may be.

  Processing for specifying the user from the terminal identification number sent from the reader 130 performed by the server 200 will be described with reference to FIGS. 6B, 6C, and 6D.

  Reference numeral 200 denotes a server of the store 1. The server 200 can communicate with the store entry confirmation operation panel 110, the store exit confirmation operation panel 111, the distance sensor 131, the weight sensor 132, and the reader 130 via the network 201.

  The server 200 determines that the product has been removed from the display area 121 based on the detection results sent from the distance sensor 131 and the weight sensor 132. The server 200 also performs store entry confirmation processing by operating the store visit confirmation operation panel 110 of the store visitor, store exit confirmation processing by operation of the store exit operation panel 111, and terminal identification sent from the reader 130. It also performs user specific processing by number. The server 200 also performs a settlement process described with reference to FIGS.

  Furthermore, the server 200 also communicates with a specific application installed on its own mobile terminal by the user of the store 1 who performed the pre-registration described in FIG.

  The server 200 may be referred to as a control unit. Further, the place where the server 200 is placed is not limited. For example, the server 200 may be installed for each shelf 120 or may be installed for each display area 121. Alternatively, the server 200 may be in a place different from the store 1 connected via the network 201.

  FIG. 1B is a diagram illustrating an example of the store entry confirmation operation panel 110. The entrance confirmation operation panel 110 includes a reader 110-1 that reads a membership number issued to a holder qualified to use the store 1 and a terminal identification number of a portable terminal carried by the visitor when visiting the store. The camera 110-2 which image | photographs a person's face part is provided. Further, the store entry confirmation operation panel 110 may include a help button 110-3 for calling a store clerk in the store 1 when the operation method is not known or when a trouble occurs in operation.

  FIG. 1C is a diagram showing an example of the arrangement of the rails 123 arranged on the display area 121. The rail 123 has a height that is perpendicular to the plate-shaped spreading display area 121, and extends in the depth direction of the shelf 120 along the partition plate 122 when viewed from the user standing in front of the shelf 120. Are arranged on the display area 121. The example of FIG. 1C is an example in which the width from the rail 123-1 to the rail 123-2 is different from the width from the rail 123-2 to the rail 123-3. It is desirable that the products are displayed in a line in the same direction. The rail 123 may be linear or any shape, but is preferably linear.

  FIG. 1D is a diagram illustrating an example of the store exit confirmation operation panel 111. The store exit confirmation operation panel 111 includes a reader 111-1 that reads a payment completion notice. Further, the store exit confirmation operation panel 111 may include a display screen 111-2 so that the contents of the completed payment can be confirmed again. Further, the store leaving confirmation operation panel 111 may include a help button 111-3 for calling a store clerk in the store 1 when an operation method is not known or when an operation trouble occurs. The display screen 111-2 may display not only the details of the completed payment but also the future sale information of the store 1, etc., or recommend purchase at the next visit from the purchase history of the user so far. A list of products may be displayed.

  FIG. 2 shows a behavior pattern from a pre-registration for using the store 1 until a user of the store 1 having the product movement detecting apparatus of the present embodiment actually purchases the product and leaves the store. It is the figure which showed the relationship with the device required for.

  S1 is pre-registration (before visiting the store).

  A user who wishes to use the store 1 including the commodity movement detection apparatus according to the present embodiment needs to perform pre-registration in order to use the store 1 (S1).

  Pre-registration is a registration operation in which a person who wants to use the store 1 registers his / her personal information in order to obtain the qualification to use the store 1. Pre-registration is performed by a user who desires to use the store 1 by installing a specific application provided by the store 1 in his / her mobile terminal and using the installed specific application. The personal information to be registered is, for example, the name, gender, e-mail address, photograph including the face portion of the applicant, a password for starting a specific application and communicating with the server 200, and the like. Such personal information is stored as individual member information in the server 200 for each individual. A person who wishes to use the store 1 can obtain a membership number, which is a qualification for use of the store 1, by performing pre-registration.

  The membership number is managed by a specific application installed on the mobile terminal of the person who wants to use the store 1. The specific application can read the terminal identification number of the installed mobile terminal in addition to the member number. The membership number is managed by a specific application and the terminal identification number can be read. Specifically, the specific application is installed on the store entry confirmation operation panel in the above-described store entry confirmation, for example. Control is performed so that the reader 110-1 can acquire the membership number and the terminal identification number, and control is performed so that the reader 130 installed on the shelf 120 can acquire the terminal identification number when taking out the product. The pre-registration procedure will be described with reference to FIG.

  S2 is a store entry confirmation.

  A visitor of the store 1 performs a store entry confirmation when visiting the store 1 (S2). The entrance confirmation is a confirmation operation performed by a visitor of the store 1 to confirm that the user has the use qualification of the store 1.

  The visitor causes the reader 110-1 of the store entry confirmation operation panel 110 to acquire the member number and the terminal identification number of his / her portable terminal, and the face portion of the customer is photographed by the camera 110-2.

  The specific application uses, for example, a QR code that expresses numerical values and characters by an image in which the managed membership number and the terminal identification number of the mobile terminal that has been read are arranged in a one-dimensional direction or a two-dimensional direction. You may display on the display screen of a portable terminal so that reading is possible. Alternatively, the specific application sends the managed member number and the terminal identification number of the read mobile terminal to the reader 110-1 via short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal. Transmission may be possible.

  The reader 110-1 installed in the store entry confirmation operation panel 110 transmits the acquired member number and terminal identification number to the server 200 of the store 1. In addition, the camera 110-2 installed on the store entry confirmation operation panel 110 transmits the captured image of the face portion of the visitor to the server 200 of the store 1.

  When the server 200 receives the membership number sent from the reader 110-1 and the face part video sent from the camera 110-2, the server 200 receives the member number and the face part video information and pre-registration. Comparison with the individual member information registered in (S1) is performed, and it is determined whether or not the store visitor is a qualified holder of using the store 1.

  When the server 200 confirms that the visitor is a holder of the qualification for using the store 1, the server 200 uses the terminal identification number of the mobile terminal of the visitor sent from the reader 110-1 as the qualification for using the store 1. It is updated as member individual information of the store visitor who has been confirmed as the owner of.

  In this way, the server 200 constantly updates the member individual information of the visitor with the terminal identification number of the visitor's mobile terminal read in the store entry confirmation. As a result, when the store visitor enters the store 1 and purchases a product, the server 200 touches the reader 130 to read the terminal identification number by using the mobile terminal used in the store entry confirmation, thereby purchasing the product. It is possible to specify.

  Note that the face image registered in the member individual information may be sequentially updated with the face image captured by the camera 110-2 at the time of entry confirmation.

  The flow of the store entry confirmation (S2) process will be described with reference to FIG.

  As a result of the store entry confirmation (S2), the store 1 visitor enters the store 1 through the store entrance gate 100 when it is confirmed that the user A is qualified to use the store 1. I can do it.

  S3 is product selection.

  The user A who enters the store 1 can freely view and select the products displayed in the display area 121 of the shelf 120 (S3). When the user A takes out the product A from the display area 121 in order to purchase the product displayed on the shelf 120, the distance sensor 131 and the weight sensor 132 arranged in the individual area 124 from which the product A is taken out. , It is specified that the commodity A has been taken out. Further, the user A himself / herself who selects the product A causes the reader 130 installed on the shelf 120 to acquire the terminal identification number of the portable terminal by deceiving his / her portable terminal.

  As described above, the specific application can read the information of the terminal identification number of the installed mobile terminal.

  The specific application displays the mobile terminal display screen so that the reader 130 can read the terminal identification number of the mobile terminal read by, for example, a QR code that expresses a numerical value or a character by an image arranged in a one-dimensional direction or a two-dimensional direction. May be displayed.

  Alternatively, the specific application may enable the terminal identification number of the read mobile terminal to be transmitted to the reader 130 via near field communication such as NFC (Near Field Communication) provided in the mobile terminal.

  The reader 130 sends the acquired terminal identification number of the mobile terminal to the server 200 via the network 201. The server 200 compares the terminal identification number of the portable terminal sent from the reader 130 with the terminal identification number acquired together with the member number via the reader 110-1 in the store entry confirmation (S2), thereby obtaining the product A The person who selected is identified as the user A.

  In this way, the distance sensor 131 and the weight sensor 132 arranged on the shelf 120 identify which product is selected, and who selects the product based on the terminal identification number acquired by the reader 130 arranged on the shelf 120. Identified. Information on the identified user A and the product A taken out by the user A is stored in the user A's basket in the server 200.

  The basket is a storage area for each user for the user A to input information on the product A taken out from the individual area 124 in S3 to the server 200. The basket is managed as one piece of member individual information created during pre-registration (S1). Each time the user A takes out the product from the individual area 124 in S3, the information of the taken-out product is additionally input to the basket A of the user A.

  The user can refer to the product information input to the basket at any time using a specific application installed in his / her mobile terminal.

  S4 is merchandise purchase (settlement).

  The user can make a payment using a specific application when purchasing a product input to the basket. When user A uses a specific application to make a payment for a product input in his / her basket A (S4), server 200 in store 1 transmits a payment completion notification to mobile terminal A of user A.

  The settlement completion notification includes information such as purchase date and time, a list of purchased products, a payment amount, and fishing.

  S5 is a store exit confirmation.

  When user A completes the settlement (S4) of the merchandise entered in basket A, he / she can exit the store 1 by operating the store confirmation operation panel 111 to confirm the exit (S5). .

  The confirmation operation of the store exit confirmation is performed by causing the reader 111-1 of the store exit confirmation operation panel 111 to acquire a settlement completion notification sent to its own mobile terminal.

  The specific application displays the received payment completion notice on the display screen of the portable terminal so that the reader 111-1 can read the numerical value and characters by, for example, a QR code that expresses numerical values and characters by an image arranged in a one-dimensional direction or a two-dimensional direction. It may be displayed. Alternatively, the specific application may enable the received payment completion notification to be transmitted to the reader 111-1 via short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal.

  When the reader 111-1 acquires the payment completion notification, the reader 111-1 notifies the server 200 of the acquired payment completion notification via the network 201. Receiving the notification, the server 200 confirms whether the user A has completed the settlement. When the settlement is completed, the server 200 notifies the store exit confirmation operation panel 111 to that effect, and the confirmation operation panel 111 that has received the notification exits the store exit gate 101 so that the user A can exit the store 1. Is released.

  User A can also return the selected product after selecting the product in S3 (S6). Return of goods will be described with reference to FIGS. 9A, 9B, 9C, 9D, 9E, and 9F.

  FIG. 3 is a diagram showing the pre-registration procedure of S1 of FIG. A person who wants to use the store 1 needs to install a specific application provided by the store 1 in his / her mobile terminal 301 in order to perform pre-registration for using the store 1. The portable terminal 301 may be any electronic device that can be carried by the user of the store 1, such as a smartphone, a tablet, or a PC.

  FIG. 3A is an example of input information necessary for a user who wants to use the store 1 to pre-register in accordance with an instruction of a specific application displayed on the display screen 310 of the mobile terminal 301.

  The user who wishes to use the store 1 follows the instruction of the specific application, and includes the image 310-1, the name 310-2, the gender 310-3, and the destination address 310-4 of the notification from the store 1, including the face portion of the user who wants to use. Enter.

  It is desirable to input a plurality of types of images 310-1 including the face portion of the user who wants to use. In addition, it is desirable that the image 310-1 including a plurality of types of face portions have different face orientations, facial expressions, poses, and the like. The example of FIG. 3A is an example in which a photograph 310-1 including five types of faces is registered.

    The transmission destination address may be any address of communication means used by the store 1, for example, an e-mail address or an SNS (Social Networking Service) address. A plurality of transmission destination addresses may be input.

  When the user who wants to use the store 1 completes the input of information necessary for pre-registration, the user presses the button 310-5 managed by the specific application. When the specific application recognizes that the registration button 310-5 has been pressed, the specific application transmits information necessary for pre-registration that has been input to the server 200.

  When the server 200 receives information necessary for pre-registration sent from the mobile terminal 301, the server 200 stores the received information as individual member information in the storage area of the server 200, and issues a member number to use the store 1 This is transmitted to the portable terminal 301 of the applicant. The issued member number is also stored in the server 200 as one piece of member individual information.

  FIG. 3B is an example of a display when the membership number sent from the server 200 is displayed on the display screen 310 of the mobile terminal 301.

  When the specific application installed in the portable terminal 301 receives the notification of the membership number from the server 200, the notified membership number can be displayed on the display screen 310. The member number may be displayed, for example, as a combination of numerical values or characters, or may be displayed, for example, as a QR code. The example of FIG. 3B is an example in which the membership number is displayed on the display screen 310 with the QR code 311.

  FIG. 4A is a diagram showing a state of store entry confirmation in S2 of FIG. A visitor 10 of the store 1 stands in front of the store entry operation panel 110 and performs store entry confirmation for entering the store 1.

  FIG. 4B is a diagram illustrating a process flow for entering a store.

  When the visitor 10 places his / her mobile terminal over the reader 110-1 of the store entry confirmation operation panel 110, the store entry confirmation operation panel 110 starts a store entry confirmation process (S400). The reader 110-1 of the store entry confirmation operation panel 110 acquires the membership number managed by the specific application and the terminal identification number read by the specific application (S401).

  When the acquisition of the member number and the terminal identification number is completed, the store entry operation panel 110 captures the face portion of the store visitor 10 using the camera 110-2 (S402). The entrance confirmation operation panel 110 sends the membership number and terminal identification number acquired by the reader 110-1 and the image of the face image captured by the camera 110-2 to the server 200 (S403).

  The server 200 compares the member individual information registered during the pre-registration (S2) with the member number and the face image information sent from the store entry confirmation operation panel 110 (S404).

  As a result of the comparison (S404), if there is member individual information that matches the member number sent from the store entry operation panel 110 and the video information of the face portion (Yes in S405), the server 200 The visitor 10 is determined to be a qualified person using the store 1, and the terminal identification number sent from the reader 110-1 is stored (S406).

  The server 200 notifies the store entry operation panel 110 that the store visitor 10 is permitted to enter the store (S407). The store entry confirmation operation panel 110 that has received a message that the store visitor 10 is permitted to enter the store performs a process for permitting the store visitor 10 to enter the store 1 (S408), and ends the store entry confirmation process (S409). ).

  The process for permitting entry is, for example, a process of opening the door of the entrance gate 100, announcing “Please enter the store” by voice, or flashing the notification lamp of the entrance gate 100 in blue.

  As a result of the comparison (S404), if there is no member individual information that matches at least one of the member number sent from the store entry confirmation operation panel 110 or the image information of the face portion (No in S405), the server 200 determines that the store visitor 10 is a non-holder who is qualified to use the store 1 (S410).

  The server 200 notifies the store entry operation panel 110 that the store visitor 10 is not permitted to enter the store (S411).

  The store entry confirmation operation panel 110 that has received the message that the store visitor 10 is not permitted to enter the store performs a process that does not permit the store visitor 10 to enter the store 1 (S412), and ends the store entry confirmation process (S409). ).

  The process that does not permit entry is, for example, a process in which the door of the entrance gate 100 is closed and an announcement is made by voice that “cannot enter the store” or the notification lamp of the entrance gate 100 is lit in red. In order to guide users who are not permitted to enter the store, for example, a process of announcing “please talk to a staff member by pressing the button” may be added.

  FIG. 5A is a diagram showing a state of browsing of products in the product selection in S3 of FIG.

  If the visitor 10 is determined to be a user A who is a qualified person to use the store 1, the visitor 10 can enter the store 1 through the entrance gate 100.

  User A can freely view and select the products displayed in the display area 121 of the shelf 120.

  FIG. 5B is a view of the state where the user A freely views and selects the products displayed in the display area 121 of the shelf 120 as viewed from directly above. As shown in FIG. 5B (A), it is desirable that the partition plate 122 constituting the shelf 120 protrudes from the display area 121 toward the position where the user stands. As shown in FIG. 5B (B), a partition 122-P separate from the partition plate 122 may be disposed.

  As described above, the number of users standing in front of the display area 121 delimited by the partition plate 122 can be reduced by taking out the partition plate 122 of the shelf 120 in the direction of the position where the user stands from the display area 121. It becomes possible. Accordingly, it is ensured that the user identifies the user who has taken out the merchandise displayed in the individual area 124 by putting his / her portable terminal on the reader 130.

  FIG. 6A to FIG. 6F are diagrams for explaining the extraction of products in the product selection in S3 of FIG.

  FIG. 6A is a diagram showing an example of the arrangement of the distance sensor 131 and the weight sensor 132 arranged in the individual area 124 in order to recognize that the user takes out the product from the individual area 124. As shown in FIG. 6A, one distance sensor 131 and weight sensor 132 are arranged in one individual area 124.

  It is desirable that the distance sensor 131 is disposed on the edge of the individual area 124 that faces the product displayed in the individual area 124 and is closer to the position where the user stands.

  It is desirable that the weight sensor 132 is disposed under the merchandise displayed in the individual area 124.

  The example of FIG. 6A is an example in which box-shaped products made of thick paper whose exterior is difficult to deform and bag-shaped products whose exterior is easily deformed are displayed in the individual area 124. A product whose exterior is likely to be deformed may be difficult to identify due to deformation of the exterior, for example, when identifying a product using image recognition based on video captured by a camera or the like. On the other hand, the goods movement detection apparatus of this embodiment can identify goods reliably by combining the distance sensor 131 and the weight sensor 132 also with respect to the thing which an exterior is easy to deform | transform.

  FIG. 6B shows an example of an operation outline sequence of the user 10, the reader (entrance check operation panel) 110-1, the reader (shelf) 130, and the server 200 when the user 10 takes out the product from the individual area 124. FIG.

  In addition, when the user 10 puts his / her portable terminal on the reader 110-1 of the entry confirmation operation panel 110 in the entry confirmation (S200), the reader 110-1 acquires (S201) the member number and the portable terminal. The server identification number is transmitted to the server 200 (S202), and the server 200 stores the terminal identification number as the individual member information among the received membership number and terminal identification number (S203).

  Before the user 10 takes out the merchandise displayed in the individual area 124, the user 10 places the portable terminal on the reader 130 in order to cause the reader 130 to obtain the terminal identification number of his / her portable terminal (S600).

  When the reader 130 reads the terminal identification number of the cheated mobile terminal (S601), the reader 130 transmits the read terminal identification number to the server 200 (S602).

  Upon receiving the terminal identification number, the server 200 compares the received terminal identification number with the terminal identification number stored as member individual information in S203, thereby identifying the user 10 who placed the portable terminal on the reader 130 in S600. (S603).

  Next, the user 10 takes out the merchandise displayed in the individual area 124 (S605).

  The distance sensor 131 and the weight sensor 132 arranged in the individual area 124 periodically sense to detect that the product has been taken out by the user (S606).

  The distance sensor 131 and the weight sensor 132 that have detected that the product has been taken out notify the server 200 that the product has been taken out together with the sensing result (S607).

  The server 200 verifies the sensing contents notified from the distance sensor 131 and the weight sensor 132, thereby identifying the product taken out by the user 10 in S605 (S608).

  The server 200 inputs the product specified in S608 to the basket of the user 10 specified in S603 from the user 10 specified in S603 and the product specified in S608 (S609).

  As described above, when the product movement detection apparatus according to the present embodiment takes out a product from the individual area 124, the product is taken out from the individual area 124 by holding the portable terminal used in the store entry confirmation to the reader 130 (S600). In order to identify a person, the terminal identification number is obtained simply by roaming the mobile terminal without the need for installation of equipment such as a camera, compared to the case where the person is identified by, for example, video such as face authentication. The person can be identified safely and reliably.

  It should be noted that since the subject of the operation of holding the mobile terminal in S600 and the subject of the removal of the product in S605 need to match, it is desirable that the operations of S600 and S605 are performed within a certain time T1. . This is because if the time from the operation of S600 to the operation of S605 is infinite, there is a high possibility that the subject of the operation of S600 and the operation of S605 will be different.

  For example, if the server 200 does not perform the process of S608 within a certain time T2 after the user 10 is specified in the process of S603, the server 200 deletes the specific result of the user 10 that is the process of S603 from the individual member information. May be. In this case, the server 200 may instruct the reader 130 to announce to the user to trick the portable terminal again.

  FIG. 6C shows another example of an operation outline sequence of the user 10, the reader (entrance check operation panel) 110-1, the reader (shelf) 130, and the server 200 when the user 10 takes out the product from the individual area 124. FIG. The sequence example of the operation outline in FIG. 6C is an example in the case where the product 10 is not taken out by the user 10 which is the operation of S605 in FIG. 6B. In this case, when the server 200 detects the expiration of the T2 timer in the process of S603, the server 200 notifies the reader 130 accordingly (S604). Upon receiving notification of expiration of the T2 timer from the server 200 (S604), the reader 130 may announce, for example, “Please touch again” using a built-in speaker. Alternatively, “Please touch again” may be displayed on the display screen provided.

  FIG. 6D shows another example of an operation outline sequence of the user 10, the reader (entrance confirmation operation panel) 110-1, the reader (shelf) 130, and the server 200 when the user 10 takes out the product from the individual area 124. FIG.

  The user 10 may pick up his / her mobile terminal in order to cause the reader 130 to acquire the terminal identification number of his / her mobile terminal after taking out the merchandise displayed in the individual area 124. FIG. 6D is an example of the case where the user of S600 puts the mobile terminal on the reader 130 after the product 10 is taken out by the user 10 of S605 of FIG. 6B.

  The user 10 takes out the merchandise displayed in the individual area 124 (S605-1).

  The distance sensor 131 and the weight sensor 132 disposed in the individual area 124 detect periodically that the product has been taken out by the user (S606-1).

  The distance sensor 131 and the weight sensor 132 that have detected the removal of the product notify the server 200 that the product has been removed together with the sensing result (S607-1).

  The server 200 verifies the sensing contents notified from the distance sensor 131 and the weight sensor 132, thereby specifying the product taken out by the user 10 in S605-1 (S608-1).

  Next, the server 200 waits for the user 10 to send his / her mobile terminal to the reader and receive the terminal identification number of the mobile terminal.

  The user 10 places the mobile terminal on the reader 130 in order to cause the reader 130 to acquire the terminal identification number of his mobile terminal (S600-1).

  When the reader 130 reads the terminal identification number of the cheated mobile terminal (S601-1), the reader 130 transmits the read terminal identification number to the server 200 (S602-1).

  The server 200 that has received the terminal identification number compares the received terminal identification number with the terminal identification number stored as individual member information in S203, thereby identifying the user 10 who placed the portable terminal on the reader 130 in S600-1. (S603-1).

  The server 200 inputs the product specified in S608-1 to the basket of the user 10 specified in S603-1 from the user 10 specified in S603-1 and the product specified in S608-1.

  It should be noted that since the subject of the product take-out operation in S605-1 needs to match the subject of the operation to deceive the mobile terminal in S600-1, the operations in S605-1 and S600-1 are performed for a certain time T3. It is desirable to be done within. This is because if the time from the operation of S605-1 to the operation of S600-1 is infinite, there is a higher possibility that the subject of the operation of S605-1 and the operation of S600-1 will be different.

  For example, if the server 200 does not perform the process of S603-1 within a certain period of time T4 after identifying the product taken out in the process of S608-1, for example, the server 200 prompts the reader 130 for the mobile terminal. Thus, the user 10 may be instructed to make an announcement.

  FIG. 6E is a diagram showing a processing flow of the distance sensor 131 and the weight sensor 132 that sense (measure) that a product has been taken out, which is the processing of S606 in FIG. 6B. The distance sensor 131 and the weight sensor 132 arranged for each individual area 124, when starting the specific process (sensor) (S610), sequentially perform sensing (S612).

  As a result of sensing (S612), when the distance sensor 131 detects a change in distance (Yes in S613), the distance sensor 131 notifies the server 200 that the distance has changed together with the distance change amount (S614). .

  Similarly, when the weight sensor 132 detects a change in weight as a result of sensing (S612) (Yes in S615), the weight sensor 132 notifies the server 200 of the change in weight together with the amount of change in weight ( S616). Each notification includes the individual area identification number of the individual area 124 where the distance sensor 131 and the weight sensor 132 are arranged.

  Detection of a change in distance in the process of S613 and detection of a change in weight in the process of S615 are determined based on whether or not a preset threshold value is exceeded. This threshold value can be freely changed for each individual area 124. Specifically, for example, the distance sensor 131 disposed in the individual area A detects a change in distance by 1 cm, the distance sensor 131 disposed in another individual area 124 detects a change in distance by 2 cm, Thus, the threshold value set in the distance sensor 131 may be changed for each individual area 124.

  Similarly, for example, the threshold value at which the weight sensor 132 arranged in the individual area B detects a change in weight is 2 g, and the threshold value at which the weight sensor 132 arranged in the other individual area 124 detects a change in weight is 10 g. As described above, the threshold value set in the weight sensor 132 may be changed for each individual area 124.

  Alternatively, the detection accuracy of the distance change in the processing of S613 and the detection of the weight change in the processing of S615 can be freely changed for each individual area 124. The detection accuracy can be freely changed in accordance with the above-described threshold value. For example, when a relatively small product is displayed in the individual area A, the distance detection accuracy of the distance sensor 131 arranged in the individual area A is higher than the detection accuracy of the distance sensor 131 arranged in the other individual area 124. You may set so that. Specifically, for example, the detection accuracy for detecting the distance by the distance sensor 131 arranged in the individual area A is 0.5 cm, and the detection accuracy for detecting the distance by the distance sensor 132 arranged in the other individual area 124 is 1 cm. The detection accuracy set in the distance sensor 131 such as a unit may be changed for each individual area 124, or distance sensors 131 having different detection accuracy may be arranged for each individual area 124.

  Similarly, for example, when a light product is displayed in the individual area B, the weight detection accuracy of the weight sensor 132 arranged in the individual area B is set to the detection accuracy of the weight sensor 132 arranged in the other individual area 124. You may set so that it may become high compared with. Specifically, the detection accuracy with which the weight sensor 132 arranged in the individual area B detects the weight is 1 g unit, and the detection accuracy with which the weight sensor 132 arranged in the other individual area 124 detects the weight is 5 g unit. As described above, the detection accuracy set in the weight sensor 132 may be changed for each individual area 124, or a weight sensor 132 having a different detection accuracy may be arranged for each individual area 124.

  When the threshold and detection accuracy can be set, the threshold and detection accuracy may be managed and controlled by the server 200, for example.

  For example, there is a method to identify the product taken out from the shelf using only the video taken with the camera, but it is difficult to change the performance of the camera according to the product characteristics such as size, shape, weight, etc. If a small product is displayed, it may be difficult to identify each product using only the captured video. In contrast, the commodity movement detection apparatus according to the present embodiment detects the movement of the commodity using the distance sensor 131 and the weight sensor 132, and the detection accuracy of the distance sensor 131 and the weight sensor 132 is a feature of each commodity. By changing it accordingly, the product can be identified reliably.

  As described above, the commodity movement detection apparatus according to the present embodiment uses the threshold value and accuracy for detecting that the commodity has been taken out according to the individual characteristics of the commodity such as the size, weight, and shape of the commodity displayed in the individual area 124. Can be freely changed, so that it is possible to reliably detect the removal of the product.

  FIG. 6F shows a processing flow of the server 200 for inputting the specified product A into the basket A of the user A specified in S603 and the user A specified in S603, which is the processing of S608 and S609 in FIG. 6B. It is a figure.

  When the server 200 starts the specific process (server) (S620), the server 200 performs a reception process every time there is a notification from the distance sensor 131 or the weight sensor 132 (S622). The server 200 analyzes the content notified from the distance sensor 131 or the weight sensor 132, and confirms whether the notification from the distance sensor 131 having the same individual area identification number and the notification from the weight sensor 132 are received. Is performed (S623). If both the notification from the distance sensor 131 having the same individual area identification number and the notification from the weight sensor 132 are received as a result of the confirmation (Yes in S623), the server 200 changes the distance included in both notifications. It is determined from the amount of change in quantity and weight whether the product has been removed from the individual area 124 (S624).

  As a result of the determination (S624), if the product has been removed (Yes in S625), the server 200 stores information on the product A determined to have been removed in S625 in the basket A of the user A identified in S603 in FIG. 6B. Input (S626).

  As a result of the determination (S625), if not removed (No in S625), the server 200 waits for the next notification without performing any processing.

  Each time the user A takes out the merchandise displayed in the individual area 124, the distance sensor 131, the weight sensor 132, and the server 200 specify the taken out merchandise shown in FIGS. 6E and F, the user identified in S603. The process of inputting information on the product identified as being taken out into the basket is repeatedly performed. As a result, all commodities taken out by the user A from the individual area 124 are registered in the basket A of the user A.

  When the server 200 inputs the information of the product determined to be removed in S625 to the basket A of the user A, the server 200 uses the specific area identification number of the individual area 124 in which the removed product is displayed. Register with the product name.

  For example, it is assumed that a certain product A is displayed in the individual area A having the individual area identification number A. When the user A takes out the product A from the individual area A, there is only information that the user takes out the product A displayed in the individual area A having the individual area identification number A in the process of S625. is doing. If the product displayed in the individual area A having the individual area identification number A is, for example, a snack A, the snack A that allows the user to know the information of the product displayed in the individual area A having the individual area identification number A It is necessary to convert the information into specific product name information.

  The server 200 has a conversion table and a conversion function for converting information on products displayed in a certain individual area 124 having a certain individual area identification number into a specific product name that can be understood by the user. With this conversion table and conversion function, the server 200 converts the product information taken out from the individual area 124 by the user A into the basket A in S627 into a specific product name that can be understood by the user. To do.

  The notification sent from the distance sensor 131 and the weight sensor 132 may include time information.

  Further, in S626, the server 200 not only inputs the information on the product A determined to be removed in S625 to the basket A of the user A but also notifies the user A that the product A is input to the basket A. You may do it.

  To notify the user A that the product A has been input to the basket A, for example, a speaker (not shown) that emits a notification sound for each individual area 124 and an LED (not shown) that lights the notification lamp are installed. The notification sound may be emitted from the speaker installed in the individual area A where the product A is displayed or the notification lamp may be lit. In addition, to notify the user that the product A has been input to the basket A, the product A is registered in the basket to the destination address of the user A registered in the pre-registration (S1) shown in FIG. It may be a notice to that effect.

  The user A can recognize that the product A has been taken out from the individual area 124 and that the taken-out product A has been input to the basket A by notification using these notification sounds, notification lamps, e-mails, or the like. As a result, the user A can immediately recognize that the product taken out by the other person from the individual area 124 is mistakenly registered in his / her basket A, and can quickly solve the problem in selecting the product. Become.

  FIG. 7 is a diagram showing a processing flow for checking out of the store in S5 of FIG.

  In order to perform the store closing process, the specific application uses information obtained by adding the member number to the information necessary for the store closing process from the information of the notification of completion of settlement received in an image arranged in a one-dimensional direction or a two-dimensional direction. You may display on the display screen of a portable terminal so that the reader 111-1 can read with the QR code which represents a numerical value and a character, for example.

  Alternatively, the specific application uses information received by adding the membership number to the information necessary for the store closing process from the information on the notification of completion of settlement, and performs near field communication such as NFC (Near Field Communication) provided in the mobile terminal. Through the reader 110-1.

  When the user A holds his / her mobile terminal over the reader 111-1 of the store exit confirmation operation panel 111 to exit the store 1, the store exit confirmation operation panel 111 starts the store exit confirmation process. (S700). The reader 111-1 of the store exit confirmation operation panel 111 acquires a settlement completion notification managed by the specific application (S701). The store exit confirmation operation panel 111 sends the settlement completion notification acquired by the reader 110-1 to the server 200 (S702).

  When the server 200 receives the payment completion notification sent from the store leaving confirmation operation panel 111, the server 200 compares the payment status of the product registered in the basket stored in the individual member information (S703).

  As a result of the comparison (S703), when the payment is correctly completed (Yes in S704), the server 200 notifies the store leaving confirmation operation panel 111 that the user A is permitted to leave the store (S705). . The store exit confirmation operation panel 111 that has received the notice that the user A is permitted to exit the store performs a process of permitting the user A to exit the store 1 (S706), and ends the store exit confirmation process (S707). ).

  The process for permitting the exit is, for example, a process of opening the door of the exit gate 101, announcing “Thank you for using” by voice, or flashing the notification lamp of the exit gate 101 in blue.

  As a result of the comparison (S703), if the payment is not completed correctly (No in S704), the server 200 notifies the store exit confirmation operation panel 111 that the user A is not permitted to leave the store (S708). . The store exit confirmation operation panel 111 that has received the message that the user A is not permitted to leave the store performs a process that does not allow the user A to leave the store 1 (S709), and ends the store exit confirmation process (S707). ).

  The processing that does not permit the closing of the store is, for example, a processing that announces that the store cannot be closed by voice while keeping the door of the closing gate 101 closed, or the notification lamp of the closing gate 101 is lit in red. In order to guide users who are not permitted to leave the store, for example, a process of announcing “please talk to an attendant by pressing the help button” may be added to the process of not permitting the store to leave.

  Further, the store exit confirmation operation panel 111 may have a function of issuing a sticker attached to the settled product to a user who has completed the settlement of the product registered in the basket.

  The sticker attached to the settled product is a settled display sticker that the user of the store 1 himself / herself attaches to the product for which payment has been completed. For example, when the sticker is peeled off, the seal is torn.

  The sticker attached to the settled product is issued from a sticker issuing machine connected to the store exit confirmation operation panel 111 as one of the processes for permitting the store exit in S706. The issued sticker may describe the product name of the product that has been settled. Further, the size of the issued sticker may be arbitrarily changed according to the size of the product that has been settled.

  The product selection process described above is a case where the user picks up the product displayed in the individual area 124 himself, but it may be difficult for some users to pick up the product himself.

  FIG. 8 is a diagram illustrating an example of another form of the shelf 120 on which products are displayed.

  For example, a monitor 135 may be arranged on the shelf 120 assuming that it is difficult for the user to take out the product himself. The monitor 135 is connected to the service corner 140 in which the store clerk of the store 1 is stationed, for example, via the network 201, and a reservation instruction for the user to interact with the store clerk and receive the product to be purchased at the service corner 140. Can be issued.

  In some cases, the user may want to return (S6) the product after taking out the product from the individual area 124. The product movement detection apparatus of the present embodiment can also return the product taken out from the individual area 124. A method for returning a product will be described with reference to FIGS. 9A, 9B, 9C, 9D, 9E, and 9F.

  In the description using FIG. 9A, FIG. 9B, FIG. 9C, FIG. 9D, FIG. 9E, and FIG. 9F, the return place of the returned product is the individual area 124 where the returned product was originally placed.

  When the user of the store 1 returns the product taken out from the individual area 124, the mobile terminal using the reader 110-1 installed in the store entry confirmation operation panel 110 to obtain the terminal identification number is used for store entry confirmation. Can be returned.

  FIG. 9A is a diagram illustrating an example of the screen transition of the user's mobile terminal when the user 10 returns the product to the individual area 124.

  FIG. 9A (A) is an example of a menu screen of a specific application installed on the user's mobile terminal. The menu screen shown in FIG. 9A is an example in which items 901 for buying a product, 902 for returning a product, 903 for viewing a basket, and 904 for viewing a history are displayed.

  A product purchase 901 is a menu used when a user purchases (settlements) a product in the product purchase (settlement) in S4 of FIG.

  A product return 902 is a menu used when the user returns the product in the product return in S6 of FIG.

  Viewing a basket 903 is a menu used when the user refers to the basket in the product selection in S3 of FIG. The reference to the basket is not limited to S3 and can be referred to any time using a specific application.

  A history 904 is a menu used when the user of the store 1 refers to the purchase history of the products purchased so far.

  When the user wants to return the extracted product after extracting the product from the individual area 124, the user displays the operation menu of the specific application shown in FIG. 9A (A) and returns the product in the operation menu 902. Select. When the user selects 902 that returns a product from the operation menu, the specific application causes the display screen of the mobile terminal to transition to FIG. 9A (B).

  FIG. 9A (B) is an example of a display screen of a mobile terminal that prompts the user who returns the product to pose his / her mobile terminal to the reader 130 in order to identify the user who returns the product.

  The specific application may display a terminal identification number on the display screen of the mobile terminal so that the reader 130 can read the information using a QR code in addition to the content that prompts the mobile terminal to be held by the reader 130. Alternatively, the specific application may be able to transmit the terminal identification number of the mobile terminal to the reader 130 via short-range wireless communication such as NFC (Near Field Communication) provided in the mobile terminal.

  When the user who returns the product puts the mobile terminal on the reader 130 in accordance with the instruction on the screen of FIG. 9A (B), the specific application changes the display screen of the mobile terminal to FIG. 9A (C).

  The reader 130 transmits to the server 200 the terminal identification number acquired by the user deceiving the mobile terminal.

  FIG. 9A (C) is an example of a display screen for the user to select a product to be returned.

  The contents displayed on the display screen are a product name, a price, the total number of products, a total amount, etc. inputted to the user's basket. Reference numerals 801-1 and 801-2 indicate the product names of the products input to the basket. 802-1 and 802-2 have shown the price of each goods. Reference numeral 801-3 represents the number of products input to the basket. Reference numeral 802-3 denotes the total amount of products input to the basket. Deletes 803-1 and 803-2 on the right side of the product name are delete buttons for selecting a product to be returned. The user selects a product to be returned by tapping the delete button of the product to be returned. When the user taps the delete button of the product to be returned and selects it, and then taps the confirm button 804-2 for confirming the selection, the specific application notifies the server 200 via the network 201 and the mobile phone. The display screen of the terminal is changed to FIG. 9A (D).

  The user can also return a plurality of types of products by selecting a plurality of delete buttons for selecting the products to be returned.

  FIG. 9A (D) is an example of a display screen that prompts the user who returns the product to place the returned product in the individual area 124.

  The user who returns the product returns the product to be returned to the individual area 124 in accordance with the instruction on the screen of FIG. 9A (D). The product returned to the individual area 124 is sensed by the distance sensor 131 and the weight sensor 132. The sensed result is transmitted to the server 200.

  Based on the sensed result, the server 200 determines whether the product returned to the individual area 124 is the product selected by the user tapping the delete button on the display screen of FIG. 9A (C). I do.

  As a result of the determination, when the product returned to the individual area 124 is the product selected by the user in FIG. 9A (C), the server 200 deletes the corresponding product from the user's basket and A notification indicating that the product returned to the mobile terminal has been confirmed is transmitted.

  The specific application of the mobile terminal that has received the notification that the returned product has been confirmed changes the display screen of the mobile terminal to FIG. 9A (E) -1.

  FIG. 9A (E) -1 is an example of a display screen indicating that the server 200 has confirmed the product returned by the user. On the display screen indicating that the server has confirmed the product returned by the user, the returned product name and a button for browsing the basket are also displayed. The user who has returned the product can view the current state of the basket by pressing a button for viewing the basket.

  As a result of the determination, if the product returned to the individual area 124 is not the product selected by the user in FIG. 9A (C), the server 200 notifies that the product returned to the user's mobile terminal cannot be confirmed. Send.

  The specific application of the mobile terminal that has received the notification that the returned product cannot be confirmed transitions the display screen of the mobile terminal to FIG. 9A (E) -2.

  FIG. 9A (E) -2 is an example of a display screen indicating that the server 200 cannot confirm the product returned by the user. The user may simply place the correct product in the individual area 124 according to the displayed content.

  When the user selects a plurality of types of products to be returned on the display screen of FIG. 9A (C), the corresponding products may be sequentially returned to the individual areas 124 where the respective products are placed.

  9B and 9C show the user 10 when the user 10 returns the product to the individual area 124 in accordance with the screen transition shown in FIG. 9A, the reader (entry confirmation operation panel) 110-1, and the reader (shelf). FIG. 130 is a diagram illustrating an example of an operation outline sequence of the server 200.

  In steps S200 to S203, the reader 10-1 obtains the user 10 by holding his / her mobile terminal over the reader 110-1 of the store entry operation panel 110 in the store entry confirmation shown in FIG. 6B (S200). (S201) The member number and the terminal identification number of the mobile terminal are transmitted to the server 200 (S202), and the server 200 stores the terminal identification number as the individual member information among the received member number and terminal identification number (S203). It is the same as the processing.

  When returning the product taken out from the individual area 124 to the individual area where the product is placed, the user 10 displays the menu screen shown in FIG. 9A (A) on the display screen of his mobile terminal (S900). .

  Next, the user 10 displays the screen shown in FIG. 9A (B) by selecting 902 for returning the product from the displayed menu (S901).

  The user 10 confirming the display content of the screen shown in FIG. 9A (B) places the mobile terminal on the reader 130 in order to cause the reader 130 to acquire the terminal identification number of his mobile terminal (S902).

  When the reader 130 reads the terminal identification number of the cheated mobile terminal (S903), the reader 130 transmits the read terminal identification number to the server 200 (S904).

  The server 200 that has received the terminal identification number compares the received terminal identification number with the terminal identification number stored as the individual member information in S203, thereby identifying the user 10 who placed the portable terminal on the reader 130 in S902. (S905).

  Next, the user 10 operates his / her portable terminal to display the screen shown in FIG. 9A (C) (S906).

  In accordance with the screen shown in FIG. 9A (C), the user 10 taps a delete button (803-1, 803-2) for selecting a product to be returned, and then taps a confirm button 804-2 for confirming the selection. (S907), the specific application notifies the server 200 of information about the product to be returned via the network 201 (S908), and changes the display screen of the portable terminal to FIG. 9A (D) (S910).

  The server 200 that has received the information about the product to be returned stores the received information in the individual member information of the user as planned return product information (S909).

  When the user 10 returns the returned product to the individual area 124 according to the screen shown in FIG. 9A (D) (S911), the distance sensor 131 and the weight sensor 132 arranged in the individual area 124 return the returned product. The return identification process (sensor) for detecting the message is started (S912). The processing content of the return specific process (sensor) is the same as the specific process (sensor) shown in FIG. 6E. The distance sensor 131 and the weight sensor 132 transmit the sensing result to the server 200 (S913).

  When the server 200 receives the sensing result of the return specifying process (sensor), the server 200 starts the return specifying process (server) for specifying the returned product (S914). The processing flow of the return specifying process (server) is shown in FIG. 9D.

  When the product returned by the return specifying process (server) is specified (S914), the server 200 compares the specified return product with the return scheduled product information stored in the member individual information in S906. Then, it is determined whether the specified product to be returned is included in the return scheduled product information (S915).

  If the result of the determination is included (Yes in S916), the server 200 notifies the user's portable terminal 10 to that effect (S917-1). When receiving the notification from the server 200, the specific application of the user's mobile terminal 10 changes the display screen of the mobile terminal to the screen shown in FIG. 9A (E) -1 (S918-1).

  When the determination result is not correctly returned (No in S916), the server 200 notifies the user's portable terminal 10 to that effect (S917-2). When receiving the notification from the server 200, the specific application of the user's mobile terminal 10 changes the display screen of the mobile terminal to the screen shown in FIG. 9A (E) -2 (S918-2). In this case, the user 10 only has to put a correct product in the specific area 124.

  FIG. 9D is a diagram illustrating a processing flow of a return specifying process (server) for specifying the returned product in S914.

  When the server 200 starts the return identification process (server) (S920), the server 200 performs a reception process every time there is a notification from the distance sensor 131 or the weight sensor 132 (S922). The server 200 analyzes the content notified from the distance sensor 131 or the weight sensor 132, and confirms whether the notification from the distance sensor 131 having the same individual area identification number and the notification from the weight sensor 132 are received. Is performed (S923). If both the notification from the distance sensor 131 having the same individual area identification number and the notification from the weight sensor 132 are received as a result of the confirmation (Yes in S923), the server 200 changes the distance included in both notifications. It is determined from the amount and the amount of change in weight whether the product has been correctly returned to the individual area 124 (S924).

  If the product is returned as a result of the determination (S924) (Yes in S925), the server 200 identifies the product determined in S924 as the return product (S926).

  Since the product is returned to the individual area 124 where the corresponding product was originally placed, it is only necessary to determine whether the product has been correctly returned based on the information on the weight and size of the product to be returned.

  The method in which the user 10 returns the product to the individual area 124 is not limited to the screen transition shown in FIG. 9A. For example, the operation for the user to select the product to be returned shown in FIG. 9A (C) may be omitted.

  FIG. 9E shows the user's portable terminal when returning the product to the individual area 124 and using only the results of sensing by the distance sensor 131 and the weight sensor 132 in the individual area 124 for specifying the product to be returned. It is an example of screen transition.

  The screen transition example shown in FIG. 9E is different from the screen transition example shown in FIG. 9A in that the display screen for the user to select the product to be returned in FIG. 9A (C) is omitted. .

  In this way, it is possible to specify a product to be returned using only the sensing results of the distance sensor 131 and the weight sensor 132. As a result, the user can save the trouble of selecting the product to be returned from the display screen of the portable terminal, and can reduce the operation when returning the product, thereby improving the user's usability.

  In the case of the screen transition example shown in FIG. 9E, when returning a plurality of types of products, the user turns the portable terminal over the reader 130 according to the display screen shown in FIG. 9E (B), and then returns to FIG. 9E (D). It is desirable that the product is returned to the individual area 124 according to the display screen shown within a certain time T5. This is because the main body that holds the portable terminal to the reader 130 according to the display screen shown in FIG. 9E (B) and the main body that returns the product to the individual area 124 according to the display screen shown in FIG. 9E (D) need to match. It is.

  Alternatively, in the case of the screen transition example shown in FIG. 9E, the return of the product is performed by returning one type of product at a time, and when returning a plurality of types of products, FIG. 9E (A) to FIG. You may make it repeat the screen transition of (E) -1.

  The above example is a case where the return place of the returned product is the individual area 124 where the corresponding product was originally placed. However, a special return place may be prepared as a return place for the returned product and returned to the return place.

  The special return place may be equipped with a distance sensor 131 and a weight sensor 132. When the distance sensor 131 and the weight sensor 132 are provided at the return place, the user 10 can return the product according to the screen transition of the portable terminal shown in FIGS. 9A and 9E.

  There may be a case where the distance sensor 131 and the weight sensor 132 are not provided at the return place. The goods movement detection apparatus of this embodiment can return goods even when the distance sensor 131 and the weight sensor 132 are not provided at the return place.

  FIG. 9F is an example of the screen transition of the mobile terminal of the user 10 when the distance sensor 131 and the weight sensor 132 are not used when returning the product to the individual area 124.

  The screen transition example shown in FIG. 9F omits the display screen that prompts the user to place the returned product in FIG. 9A (D) in the individual area 124, as compared to the screen transition example shown in FIG. 9A. The point is the difference.

  In the case of the return method that does not use the sensing of the distance sensor 131 and the weight sensor 132, the product selected by the user is determined as the product to be returned on the display screen where the user selects the product to be returned in FIG. 9F (C). The The server 200 may be deleted from the user's basket based on the product information selected on the display screen of FIG. 9F (C).

  Thus, the merchandise movement detection apparatus of one embodiment has a plurality of methods for returning merchandise, and can be selected according to the operation mode of the store 1 including the merchandise movement detection apparatus of the present embodiment, the store scale, and the like. is there.

  Furthermore, the commodity movement detection apparatus according to the present embodiment includes a detection process of the extracted commodity performed by the distance sensor 131 and the weight sensor 132 when the portable terminal having a predetermined specific terminal identification number is held over the reader 130, a server The mode can be switched to a mode (which may be referred to as a product replenishment mode) in which the specified processing of the taken-out product and the returned product performed by 200 is not performed.

  For example, when an employee of the store 1 replenishes or moves a product to the individual area 124, and when a user of the store 1 takes out or returns the product (which may be called a normal mode), the distance sensor 131 and The detection processing of the taken out product or the returned product performed by the weight sensor 132 and the specified processing of the taken out product or the returned product performed by the server 200 are unnecessary. In such a case, the employee of the store 1 puts a portable terminal having a predetermined specific terminal identification number on the reader 130, thereby detecting the extracted product performed by the distance sensor 131 and the weight sensor 132, It is possible to eliminate the processing for specifying the extracted product performed by the server 200.

  Thus, the goods movement detection apparatus of this embodiment can switch an operation mode according to the terminal identification number of the portable terminal to acquire, and is optimal for each user of the store 1 and each employee of the store 1 Operation is possible.

  If the portable terminal can communicate with the reader 110-1, the reader 111-1, and the reader 130 via near field communication such as NFC (Near Field Communication), it is not always necessary to have a display screen. The mobile terminal not having the display screen may be a terminal used exclusively for the product replenishment mode, for example, as a mobile terminal having a specific terminal identification number dedicated to the store 1. Or you may own as a terminal which the user of the store 1 uses together with his portable terminal also in normal mode.

  The mobile terminal may have a function as an RFID (Radio Frequency identifier) tag, for example. A portable terminal having an RFID tag function includes a reader (reader (entrance confirmation operation panel)) 110-1, a reader (reader (exit confirmation operation panel)) 111-1, and a reader (reader (shelf)) 130. Communication may be possible via short-range wireless communication of FRID.

  Although several embodiments of the present invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof. Furthermore, in each constituent element of the claims, even when the constituent element is expressed in a divided manner, when a plurality of constituent elements are expressed together, or when they are expressed in combination, they are within the scope of the present invention. Further, a plurality of embodiments may be combined, and an example constituted by this combination is also within the scope of the invention.

  In addition, in the present specification and each drawing, components that perform the same or similar functions as those described above with reference to the previous drawings are denoted by the same reference numerals, and repeated detailed description may be omitted as appropriate. . In addition, when the claims are expressed as control logic, when expressed as a program including instructions for causing a computer to execute, and when expressed as a computer-readable recording medium describing the instructions, the apparatus of the present invention is applied. is there. Further, the names and terms used are not limited, and other expressions are included in the present invention as long as they have substantially the same contents and the same concept.

DESCRIPTION OF SYMBOLS 100 ... Store entrance gate, 101 ... Store exit gate, 110 ... Store entry confirmation operation panel, 111 ... Store exit confirmation operation panel, 120 ... Shelf, 121 ... Display area, 122 ... Partition plate, 123 ... Rail, 124 ... Individual area, 130 ... Reader, 131 ... Distance sensor, 132 ... Weight sensor

Claims (9)

A display area for displaying products, consisting of one or more individual areas separated by rails;
A first sensing unit disposed in the individual area;
A second sensing unit disposed in the individual area;
A third sensing unit disposed in the display area;
A server that collects and controls the sensing result of the first sensing unit, the sensing result of the second sensing unit, and the sensing result of the third sensing unit;
Have
The first sensing unit notifies the server of a result of detecting that the product displayed in the individual area has been moved by a user as a first notification,
The second sensing unit notifies the server of a result of detecting that the product displayed in the individual area has been moved by the user as a second notification,
The third sensing unit notifies the server that the user has moved the product as a third notification,
The server determines that the user based on the third notification has removed the product based on the first notification and the second notification from the individual area;
Product movement detection device. The first sensing unit measures the weight of the product displayed in the individual area,
The second sensing unit is displayed in the individual area and measures a distance from the product arranged at an opposing position,
The commodity movement detection device according to claim 1, wherein the third sensing unit is arranged in the display area and acquires a terminal identification number of a portable terminal carried by the user.   2. The display area according to claim 1, wherein the display area is partitioned by left and right partition plates, and includes one or a plurality of stacked configurations between the left and right partition plates, and the spacing between the partition plates is within 1 meter. Product movement detection device. The individual area has an individual area identification number for specifying a location,
The first notification includes the individual area identification number of the individual area where the first sensing unit is arranged,
The second notification includes the individual area identification number of the individual area where the second sensing unit is arranged,
The said server specifies the said user who moved the said goods using the said 1st notification containing the said separate area identification number of the same value, the said 2nd notification, and the said 3rd notification. Product movement detection device.   The product movement detection device according to claim 1, wherein the server notifies the user that the user has moved the product when the user who has moved the product is specified.   When the interval between the first notification, the second notification, and the third notification is within a predetermined time, the server determines that the user based on the third notification The product movement detection device according to claim 1, wherein it is determined that the product has been removed from the individual area based on a notification.   The commodity movement detection device according to claim 2, wherein the operation mode is switched according to the terminal identification number of the portable terminal acquired by the third sensing unit. In the display area for displaying products, consisting of one or more individual areas separated by rails,
Detecting that the user has moved the product from the individual area using two types of sensing, the first sensing and the second sensing,
The third sensing detects that the user has moved the product,
The user based on the third notification that is the detection result of the third sensing is the product based on the first notification that is the detection result of the first sensing and the second notification that is the detection result of the second sensing. A product movement detection method for determining that a product has been removed from an individual area. A display area for displaying products, consisting of one or more individual areas separated by rails;
A first sensing unit disposed in the individual area;
A second sensing unit disposed in the individual area;
A third sensing unit disposed in the display area;
A server that collects and controls the sensing result of the first sensing unit, the sensing result of the second sensing unit, and the sensing result of the third sensing unit;
Have
The first sensing unit notifies the server of a result of detecting that the product displayed in the individual area has been moved by a user as a first notification,
The second sensing unit notifies the server of a result of detecting that the product displayed in the individual area has been moved by the user as a second notification,
The third sensing unit notifies the server that the user has moved the product as a third notification,
The server determines that the user based on the third notification has returned the product based on the first notification and the second notification to the individual area.
Product movement detection device.

Images