JP7248444B2 - Information processing device and store system - Google Patents

Description

The present invention relates to an information processing apparatus and a store system in a store such as a retail store.

Due to the serious labor shortage in retail companies, it is becoming difficult to secure store staff. Therefore, in order to reduce the number of personnel involved in operating POS (Point Of Sales) terminals and serving customers, the form of POS systems used in stores is also changing. Conventionally, many POS systems have been used in which a store clerk performs operations from product scanning (product registration) for registering information on products to be sold to money transfer. In recent years, there has been an increase in the number of self-service POS systems in which customers themselves perform everything from product scanning to payment processing.

However, in the self-service POS system, it is necessary to assign a clerk called an attendant in order to assist customers who need complicated operations and to check whether the customers are performing the correct operations in order to purchase products. there were. Therefore, even if the self-service POS system was introduced, it was not possible to reliably reduce the number of clerks.

JP 2015-109061 A

The embodiment of the present invention has been made in consideration of the above-mentioned circumstances, and its object is to easily confirm whether the customer's operation is correctly executed without complicating the customer's operation for purchasing a product. It is an object of the present invention to provide an information processing device and a store system capable of

In order to solve the above problems, the information processing apparatus in this embodiment has video receiving means, receiving means, counting means, matching means, and storage means. The video receiving means receives video captured by the camera. The receiving means receives identification data unique to the customer from the electronic device . The counting means identifies the customer corresponding to the identification data in the video, counts the number of times the customer performs a predetermined action for purchasing the product , and stores the number of times and the identification data in association with each other. be. The collation means collates the number of products whose product information is registered as the target of purchase by the customer with the number of purchases. The storage means stores collation information indicating the result of collation in association with the identification data .

1 is an overall configuration diagram of a store system according to the present embodiment; FIG. The block diagram which shows the principal part circuit structure of a store server. FIG. 2 is a block diagram showing the main circuit configuration of the accounting machine; FIG. 2 is a block diagram showing the essential circuit configuration of the check-in terminal; FIG. 2 is a block diagram showing the main configuration of an electronic device; Schematic diagram showing the main data structure of a member data record registered in the member database of the store server. Schematic diagram showing the data structure of transaction details data. The figure which shows the data structure in video analysis data. FIG. 2 is a diagram showing the data structure of video data; The figure which shows the data structure of result data. 4 is a flowchart for explaining the operation of the store server according to the embodiment; 4 is a flowchart showing the operation of the electronic device according to the embodiment; 4 is a flowchart showing first check-in processing in the embodiment; 4 is a flowchart showing second check-in processing in the embodiment; The figure which shows an example of the goods list screen in this embodiment. The figure which shows an example of the product code reading screen in this embodiment. 4 is a flowchart for explaining the operation of the store server according to the embodiment; 4 is a flowchart showing the operation of the check-in terminal according to the embodiment; 4 is a flow chart showing the operation of the accounting machine according to the present embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is an overall configuration diagram of a store system 1 according to this embodiment. The store system 1 is a self-service system that allows the customer to operate the store from product scanning for registering information on products to be sold to payment processing. In product scanning, the product code attached to the product is read.

The store system 1 in this embodiment includes a store server 10, a plurality of checkout machines 20 (20-1, . , 60-M). A plurality of checkout machines 20 (for example, K machines) are installed in one store, for example. At least one checkout machine 20 should be installed. Although only one check-in terminal 30 and one access point 50 are shown in FIG. 1, there may be two or more depending on the scale of the store. The camera 60 is installed at a position capable of photographing customers moving in the store.

At least one camera 60 is installed. Basically, the cameras 60 are arranged so as to cover the interior of the store where customers can move. The camera 60 can shoot an image of the customer when the customer moves within the shooting range of the store. In addition, the camera 60 is arranged at a position where it is possible to capture an image that can confirm that the customer has performed a predetermined action for purchasing the product. Therefore, it is desirable that the camera 60 can photograph, for example, the customer and the products displayed on the product shelf at the same time. Furthermore, each camera 60 may be installed so that one customer can be photographed by a plurality of cameras 60 at the same time. That is, by photographing the customer from different directions with a plurality of cameras 60, it is possible to reduce blind spots where it is difficult to check the customer's movements.

The store server 10, checkout machine 20, check-in terminal 30, and access point 50 are connected to a network 70 such as a LAN (Local Area Network).

The store system 1 can incorporate customer-owned electronic devices 40 (40-1, . . . , 40-N) into the system. The electronic device 40 is, for example, a smart phone, a mobile phone, a personal computer, a tablet terminal, a portable game terminal, or the like. The electronic device 40 performs wireless communication with the access point 50 when incorporated in the store system 1 . Further, the electronic device 40 may be a dedicated terminal used for registering product information provided in the store. For example, the electronic device 40 is attached to a cart used in the store and is a terminal dedicated to the store.

In the store system 1 according to the present embodiment, registration of product information may be performed using the electronic device 40 or may be performed at the checkout machine 20 . In the store system 1 , payment processing for registered product information may be executed by an external payment system using the electronic device 40 or may be executed by the checkout machine 20 .

The check-in terminal 30 is installed at the entrance of the store or the like. The check-in terminal 30 has a check-in function of authenticating a customer visiting the store and notifying the store server 10 of the authentication. Customer authentication by the check-in terminal 30 can be carried out by any one of a plurality of methods, or by combining a plurality of methods. For example, as a first authentication method, there is a method in which a store-specific code (for example, a two-dimensional code) is displayed on the display device (touch panel) of the check-in terminal 30 and read by the electronic device 40 . As a second authentication method, there is a method in which a terminal code unique to the terminal (including, for example, a member ID, which is identification data unique to the customer) is displayed on the electronic device 40 and read by the check-in terminal 30. . Furthermore, a third authentication method includes a method of inputting the customer's biometric information without using the electronic device 40 and comparing it with the biometric authentication data recorded in advance at the time of member registration for authentication. As the biometric information for authenticating the customer (member), for example, data indicating features such as face image, fingerprint, voice, iris, and vein pattern can be used.

The electronic device 40 is equipped with a function that allows the customer to perform operations such as inputting information on the product to be purchased by the customer. Unique identification information (terminal ID) is set for each of the plurality of electronic devices 40 and managed by the store server 10 .

The store server 10 controls the entire store system 1 . The store server 10 in this embodiment has a function of a POS system for product sales management and a function of a video analysis system for analyzing video received from the camera 60 . The store server 10 collates data generated by the POS system and the video analysis system to check whether the customer's operation is correctly executed without complicating the customer's purchase operation. make it easy to check. For example, the store server 10 in the present embodiment collates the number of product information items (the number of products) registered by the customer as purchase targets with the number of times the customer has performed a predetermined action for purchasing the product. The POS system manages the number of items of product information registered by customers as purchase targets. Also, the number of times a customer performs a predetermined action for purchasing a product is detected by analyzing images captured during one transaction of the customer's product purchase behavior by a video analysis system. The store server 10 can store the result of collation (result data (collation information)) when it is determined that the customer may not be performing a correct operation by collation (collation processing). The conditions under which it is determined that the customer may not be performing the correct operation include, for example, the number of times the customer performs a predetermined action to purchase a product is greater than the number of products actually registered for purchase. There is

The store server 10 (POS system) prepares transaction statement data including product information of products purchased by the customer from the product code entered in the electronic device 40 or the accounting machine 20 . The product transaction statement data includes data on the number of registered products (the number of product code inputs). The store server 10 specifies the customer who makes the payment when the payment is made at the payment machine 20, and transmits the transaction detail data of the product purchased by the customer to the payment machine 20 used by the customer for payment. The transaction statement data may be generated by the electronic device 40 or accounting machine 20 that inputs the product code. In this case, the store server 10 receives and stores transaction statement data from the electronic device 40 or the accounting machine 20 .

Also, the store server 10 (image analysis system) receives the image captured by the camera 60 and performs various analysis processes based on the image. The analysis processing includes, for example, customer identification, tracking of customers as they move through the store, detection of customer actions, and identification of products that customers intend to purchase.

In customer identification, for example, feature data is detected from a photographed face image of the customer, and the customer is identified by matching it with face authentication data (biometric information) indicating the features of the face image registered in advance by the customer. In customer tracking, a customer in a video is identified based on, for example, the customer's facial image and the color and shape of the customer's belongings such as clothes and bags. The store server 10 performs analysis for identifying the customer for each of the multiple images received from the multiple cameras 60 . The store server 10 associates and manages one customer detected from each image. In the detection of the customer's actions, for example, picking up a product displayed on a product shelf, returning a product taken from the product shelf to the product shelf, placing a product in a shopping basket, etc., and using the electronic device 40 to obtain product information. Detects various actions such as performing an action for registering In product identification, analysis processing such as reading the product code attached to the product from the video and specifying the product based on the design and shape of the product package is executed.

For example, the video analysis system counts the number of times a customer performs a predetermined action to purchase a product while one customer moves through the store for shopping for one transaction.

In this embodiment, the video analysis system is implemented in the store server 10, but the video analysis system can be implemented by a device (video analysis device) separate from the store server 10. FIG. The video analysis device is realized by a computer connected to the network 70, for example. The video analysis device receives video data from the camera 60 and executes various analysis processes as described above. The video analysis device transmits data indicating the analysis result to the store server 10 .

FIG. 2 is a block diagram showing the main circuit configuration of the shop server 10. As shown in FIG. The store server 10 includes a processor 11 , main memory 12 , auxiliary storage device 13 , communication unit 14 and system transmission line 15 . The system transmission line 15 includes an address bus, a data bus, control signal lines and the like. In store server 10 , processor 11 , main memory 12 , auxiliary storage device 13 and communication unit 14 are connected to system transmission line 15 . In the store server 10, a computer is configured by a processor 11, a main memory 12, an auxiliary storage device 13, and a system transmission line 15 connecting them.

The processor 11 corresponds to the central portion of the computer. The processor 11 controls each part to realize various functions as the store server 10 according to an operating system or application program. Processor 11 is, for example, a CPU.

The main memory 12 corresponds to the main memory portion of the computer. Main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or application programs in a non-volatile memory area. The main memory 12 may store data necessary for the processor 11 to execute processing for controlling each part in a non-volatile or volatile memory area. The main memory 12 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 11 . The non-volatile memory area is, for example, ROM. A volatile memory area is, for example, a RAM.

The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. For example, an HDD, SSD, or the like can be the auxiliary storage device 13 . The auxiliary storage device 13 stores data used by the processor 11 in performing various types of processing, data created by processing in the processor 11, and the like. The auxiliary storage device 13 may store the above application programs.

The auxiliary storage device 13 stores, for example, a product database 61 and a member database 62 . The auxiliary storage device 13 also has an area for storing transaction statement data 63 corresponding to a plurality of transactions, an area for storing video analysis data 64 generated by video analysis, and an image received from the camera 60. An area is provided for storing data 65, result data 66 indicating the result of matching data generated by the POS system and the video analysis system, and the like.

In the product database 61, product data records created for each product sold at the store are described. The product data record includes items such as product ID, product name, and price. The product ID is a unique code set for each product to individually identify each product. The product name and price are the name of the product identified by the product ID and the selling price per item.

The communication unit 14 controls data communication according to a communication protocol with the checkout machine 20, check-in terminal 30, camera 60, or electronic device 40 connected via the network 70. FIG.

FIG. 3 is a block diagram showing the essential circuitry of the accounting machine 20. As shown in FIG. The accounting machine 20 includes a processor 21, a main memory 22, an auxiliary storage device 23, a communication unit 24, a touch panel 25, a printer 26, a reader/writer 27, a human sensor 29, a change machine 210, a camera 211, and a system transmission line 212. . The system transmission line 212 includes an address bus, a data bus, control signal lines, and the like. In accounting machine 20 , processor 21 , main memory 22 , auxiliary storage device 23 , communication unit 24 , touch panel 25 , printer 26 , reader/writer 27 , human sensor 29 , and camera 211 are connected to system transmission line 212 . In the accounting machine 20, a computer is composed of a processor 21, a main memory 22, an auxiliary storage device 23, and a system transmission line 212 connecting them.

The processor 21 corresponds to the central portion of the computer. The processor 21 controls each part to realize various functions of the accounting machine 20 according to an operating system or application program. The processor 21 is, for example, a CPU.

The main memory 22 corresponds to the main memory portion of the computer. Main memory 22 includes a non-volatile memory area and a volatile memory area. The main memory 22 stores an operating system or application programs in a non-volatile memory area. The main memory 22 may store data necessary for the processor 21 to execute processing for controlling each part in a non-volatile or volatile memory area. The main memory 22 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 21 . The non-volatile memory area is, for example, ROM. A volatile memory area is, for example, a RAM.

The auxiliary storage device 23 corresponds to the auxiliary storage portion of the computer. For example, an HDD, SSD, or the like can be the auxiliary storage device 23 . The auxiliary storage device 23 stores data used when the processor 21 performs various types of processing, data created by processing in the processor 21, and the like. The auxiliary storage device 23 may store the above application programs.

The communication unit 24 controls data communication according to a communication protocol with the store server 10 connected via the network 70 .

The touch panel 25 is a device that serves both as an input device and a display device for the checkout machine 20 . The touch panel 25 detects a touch position on the displayed image and outputs the touch position information to the processor 21 .

The printer 26 issues a receipt by printing various character strings or images on receipt paper. As this type of printer 26, for example, a thermal printer, a dot impact printer, or the like can be used.

The reader/writer 27 has a function of reading data recorded on a recording medium and a function of writing data to the recording medium. The reader/writer 27 may be a contact reader/writer or a non-contact reader/writer. The recording medium is a payment card such as a credit card, debit card, electronic money card, prepaid card, or the like. A wireless communication device such as a smart phone having functions equivalent to those of a payment card may be used as the recording medium.

The human sensor 29 detects the location of a person standing in front of the accounting machine 20 using, for example, infrared rays, ultrasonic waves, or the like. When the presence of a person is detected, the human sensor 29 is turned on.

The change dispenser 210 receives inserted coins and bills. The change machine 210 also discharges coins and bills as change.

The camera 211 captures, for example, a video (image) for identifying a customer and identifying a product that the customer intends to purchase. In customer identification, for example, feature data is detected from a photographed face image of the customer, and the customer is identified by matching it with face authentication data (biometric information) indicating the features of the face image registered in advance by the customer. In product identification, analysis processing such as reading the product code attached to the product from the image and specifying the product based on the design and shape of the product package is executed.

Each accounting machine 20 is set with a unique accounting machine ID for individual identification. The accounting machine ID is stored in the auxiliary storage device 23, for example.

FIG. 4 is a block diagram showing the essential circuit configuration of the check-in terminal 30. As shown in FIG. The check-in terminal 30 includes a processor 31 , a main memory 32 , an auxiliary storage device 33 , a communication unit 34 , a touch panel 35 , a camera 36 , a speaker 37 and a system transmission line 39 . The system transmission line 39 includes an address bus, a data bus, control signal lines and the like. In the check-in terminal 30 , a processor 31 , a main memory 32 , an auxiliary storage device 33 , a communication unit 34 , a touch panel 35 , a camera 36 and a speaker 37 are connected to a system transmission line 39 . In the check-in terminal 30, a computer is composed of a processor 31, a main memory 32, an auxiliary storage device 33, and a system transmission line 39 connecting them.

The processor 31 corresponds to the central portion of the computer. The processor 31 controls each part to realize various functions of the check-in terminal 30 according to an operating system or application program. The processor 31 is, for example, a CPU (Central Processing Unit).

The main memory 32 corresponds to the main memory portion of the computer. Main memory 32 includes a non-volatile memory area and a volatile memory area. The main memory 32 stores an operating system or application programs in a non-volatile memory area. The main memory 32 may store data necessary for the processor 31 to execute processing for controlling each part in a non-volatile or volatile memory area. The main memory 32 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 31 . The non-volatile memory area is, for example, ROM (Read Only Memory). A volatile memory area is, for example, a RAM (Random Access Memory).

Auxiliary storage device 33 corresponds to the auxiliary storage portion of the computer. For example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like can be the auxiliary storage device 33 . The auxiliary storage device 33 stores data used when the processor 31 performs various types of processing, data created by processing in the processor 31, and the like. The auxiliary storage device 33 may store the above application programs.

The communication unit 34 controls data communication according to a communication protocol with the store server 10 connected via the network 70 . Note that the check-in terminal 30 may be configured to have a wireless communication unit and perform wireless communication with the access point 50 according to a wireless communication protocol.

The touch panel 35 is a device that serves both as an input device and a display device for the check-in terminal 30 . The touch panel 35 detects a touch position on the displayed image and outputs the touch position information to the processor 31 .

A camera 36 takes a video (image) to authenticate a customer who has come to the store. The camera 36 captures an image of a terminal-specific terminal code (for example, a two-dimensional code including member ID data) displayed on the electronic device 40 possessed by a customer who visits the store (second authentication method). Moreover, the camera 36 photographs a customer's facial image when authenticating the customer based on the feature of the facial image as the customer's biometric information (third authentication method).

A speaker 37 outputs a message voice or the like to customers who come to the store.

FIG. 5 is a block diagram showing the main configuration of the electronic device 40. As shown in FIG. The electronic device 40 includes a processor 41, a main memory 42, an auxiliary storage device 43, a touch panel 44, a camera unit 45, a wireless unit 46, and the like. The processor 41, main memory 42, auxiliary storage device 43, touch panel 44, camera unit 45 and wireless unit 46 are connected by a system transmission line 47 including an address bus, a data bus, control signal lines and the like.

The electronic equipment 40 constitutes a computer with a processor 41, a main memory 42, an auxiliary storage device 43, and a system transmission line 47 connecting them.

The processor 41 corresponds to the central portion of the computer. The processor 41 controls each part to realize various functions of the electronic device 40 according to an operating system and application programs.

The main memory 42 corresponds to the main memory portion of the computer. Main memory 42 includes a non-volatile memory area and a volatile memory area. The main memory 42 stores an operating system and application programs in a non-volatile memory area. The main memory 42 may also store data necessary for the processor 41 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 42 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 41 .

Auxiliary storage device 43 corresponds to the auxiliary storage portion of the computer. The auxiliary storage device 43 may be an HDD, SSD, or the like, for example. Auxiliary storage device 43 stores data used by processor 41 in various processes and data generated by processes in processor 41 . The auxiliary storage device 43 may also store application programs.

The touch panel 44 functions as an input device and display device of the electronic device 40 . The touch panel 44 displays icons for activating application programs.

The camera unit 45 has a resolution capable of photographing a bar code indicating product information attached to the product. The wireless unit 46 transmits and receives data to and from the access point 60 using wireless communication. The electronic device 40 can be used in the store system 1 when it incorporates a camera unit 45 and a wireless unit 46 among portable information processing devices such as smart phones, mobile phones, and tablet terminals.

The electronic device 40 installs the product registration program P1, and operates as an information terminal corresponding to the store system 1 by the functions realized by the product registration program P1.

The product registration program P1 controls the processor 41 so as to become a terminal for registering product information by customer's operation. The product registration program P1 is stored in the auxiliary storage device 43 . In addition to the product registration program P1, an area for storing product information and the like is provided in the auxiliary storage device 43 . Also, the product registration program P1 receives from the store server 10 and manages (stores) a member ID unique to the customer issued by member registration (registration of member information) in the store server 10 .

Next, data stored in the auxiliary storage device 13 of the store system 1 will be described.

FIG. 6 is a schematic diagram showing the main data structure of the member data record 62R registered in the member database 62 of the shop server 10. As shown in FIG. FIG. 6 shows data corresponding to one member. As shown in FIG. 6, in the member data record 62R, member information provided by a member is registered in association with a unique member ID of a customer who has registered as a member. Member information includes biometric information and personal information as information for identifying or authenticating a member (customer). Biometric information can be data indicating features such as facial images, fingerprints, voice, iris, and vein patterns. Personal information includes data indicating, for example, name, address, telephone number, settlement method (eg, cash, electronic money, credit), and the like.

FIG. 7 is a diagram showing the data structure of the transaction statement data 63 of the store server 10. As shown in FIG. The transaction details data 63 is product information registered by product scanning (input of product code) by the customer. The transaction details data 63 includes member ID 63A, transaction ID 63B, number of points purchased 63C, and product information 63D purchased. The member ID 63A is set with the member ID of the customer authenticated at the time of coming to the store. Transaction ID 63B is generated to identify one transaction by an authenticated customer, and is set in association with member ID 63A. Purchased product information 63D is information on products purchased by a customer identified by a member ID. The product ID, product name, price, etc. corresponding to the detected product code are read from the product database 61 and registered as the purchased product information 63D. The number of purchased items 63C is information indicating the number of products for which the purchased product information 63D is registered. The transaction statement data is received from the electronic device 40 when product information is registered in the electronic device 40 and is received from the accounting machine 20 when product information is registered in the accounting machine 20 .

FIG. 8 is a diagram showing the data structure of the video analysis data 64 of the store server 10. As shown in FIG. The video analysis data 64 is data indicating analysis results of the video received from the camera 60 . The video analysis data 64 includes member ID 64A, check-in date/time 64B, number of operations 64C, check-out date/time 64D, and the like. The check-in date and time 64B indicates the date and time (year, month, day and time) when the customer checked in (visited the store). The number of actions 64C indicates the number of times the customer has performed a predetermined action to purchase a product while the authenticated customer is being tracked (during product purchase behavior for one transaction). The checkout date and time 64D indicates the date and time (year, month, day and time) when the customer checked out (end of settlement processing).

Furthermore, although not shown, the image analysis data 64 may store data identifying the camera 60 that captured the image in which the customer's predetermined action for purchasing the product was detected. For example, the camera 60 is installed in association with a sales floor of a specific product. As a result, when a predetermined action by a customer is detected by analyzing the video, the camera 60 that captured the video to be analyzed can be identified, and the sales floor where the camera 60 is installed can be specified. can. Therefore, it is possible to determine which merchandise the customer has performed the predetermined action at. Furthermore, by discriminating whether or not the merchandise information of the merchandise sold at the sales floor where the customer performs the predetermined action is registered, the correspondence between the registration of the merchandise information and the sales floor where the customer performs the predetermined action is collated. can be done. By this collation, for example, the product information of the product sold at the sales floor where the predetermined action is performed is not registered, or the number of operations at the sales floor where the predetermined action is performed and the number of registered products sold at the corresponding sales floor is inconsistent.

FIG. 9 is a diagram showing the data structure of the video data 65 of the store server 10. As shown in FIG. The video data 65 includes tracking video data 65B used for tracking one customer moving in the store. The tracking video data 65B is stored in association with the transaction ID 65A, and includes video data in which one customer's product purchase behavior for one transaction is captured. Usually, the tracking video data 65B includes video data captured by a plurality of cameras 60. FIG.

FIG. 10 is a diagram showing the data structure of the result data 66 of the shop server 10. As shown in FIG. The result data 66 indicates the result (matching information) of matching data generated by the POS system and the video analysis system. In the result data 66, matching result data 66C indicating that the number of times a predetermined operation is performed is greater than the number of products is stored as a result of matching (matching information) in association with a member ID 66A and a transaction ID 66B. . The collation result data 66C not only indicates that the number of times the predetermined action was performed is greater than the number of products, but also includes data indicating that the number of products is greater than the number of times the action was performed. Also good. In addition, the matching result data 66C may include data indicating the difference (the number of mismatches) between the number of actions and the number of registered products. Further, in the collation result data 66C, it is determined that the installation location of the camera 60 that captured the image in which the predetermined action was detected (for example, corresponding to the sales floor of a specific product) does not match the registered product information. It may also contain data indicating that the

Next, the operation of the store system 1 according to this embodiment will be described. First, the operation when product information of a product to be purchased is registered by the customer's own operation using the electronic device 40 will be described.

FIG. 11 is a flow chart for explaining the operation of the store server 10 (processor 11) in this embodiment. FIG. 12 is a flow chart showing the operation of the electronic device 40 (processor 41) in this embodiment. The operations shown in FIGS. 11 and 12 are examples, and the processing procedure and processing contents are not particularly limited as long as similar results can be obtained.

First, when a customer comes to the store, the customer operates the electronic device 40 to start the product registration program P1 and start the product registration process. When the product registration process is started, the processor 41 executes the check-in process based on the product registration program P1 (Fig. 12, Act21).

FIG. 13 is a flow chart showing the first check-in process executed by the electronic device 40 in this embodiment, and FIG. 14 is a flow chart showing the second check-in process. The first check-in process uses the electronic device 40 to identify the customer, and the second check-in process uses the customer's biometric information to identify the customer.

In the store system 1, it is assumed that which of the first check-in process and the second check-in process is used is determined in advance. Also, the first check-in process and the second check-in process may be used together.

First, the first check-in process will be described with reference to the flowchart shown in FIG. When an in-store purchase is instructed by the customer's operation on the touch panel 44 (YES in Act 41 in FIG. 13), the processor 41 activates the camera unit 45 and shifts to a store code reading state.

The check-in terminal 30 causes the touch panel 35 to display a store code unique to the store, such as a two-dimensional code pattern. The customer operates the electronic device 40 so that the camera unit 45 of the electronic device 40 reads the store code displayed on the check-in terminal 30 .

When the processor 41 reads the shop code (Act 42), the processor 41 transmits a check-in request to the shop server 10 together with the member ID stored in advance in the electronic device 40 and the date and time (year, month, day and time) when the shop code was read. (Act 43).

The store server 10 receives the check-in request from the electronic device 40 through the access point 50 . When the processor 11 of the store server 10 receives the member ID together with the check-in request (YES in Act 1), it writes the member ID in the work area of the main memory 12. FIG. Then, the processor 11 searches the member database 62 using the member ID as a search key, and determines whether or not there is a member data record 62R describing the member ID (Act 2).

When the processor 11 confirms that there is no corresponding member data record 62R (NO in Act 3), the processor 11 transmits a notice of check-in disapproval to the electronic device 40 (Fig. 11, Act 4). When the processor 41 of the electronic device 40 receives the check-in disapproval notification from the shop server 10 ( FIG. 13 , Act 44 NO), the processor 41 sends the check-in disapproval notification. Output (Act 45). For example, the processor 41 causes the touch panel 44 to display a message indicating disapproval. In this case, the electronic device 40 ends the first check-in process and the product registration process.

On the other hand, when the processor 11 confirms that there is a corresponding member data record 62R, whether data (verification information) indicating the verification result preset in association with the corresponding member ID is set in the result data 66? to confirm. That is, it is determined whether it is possible that the customer corresponding to the member ID did not perform the correct operation in collation (collation processing) described later when the customer corresponding to the member ID visited the store the previous time and made a purchase. For example, when it is determined that the number of times the predetermined action for purchasing a product was performed during the previous shopping is greater than the number of products actually registered as purchase targets, the predetermined action was performed more than the number of products. Matching result data 66C indicating that the number of times is greater is stored.

Here, if the verification result data 66C is stored, the processor 11 transmits a check-in disapproval notification to the electronic device 40 according to the verification result indicated by the verification result data 66C (Fig. 11, Act 4). ). For example, the processor 11 transmits a check-in disapproval notification indicating that the store is not available, member registration is suspended, confirmation by a store clerk is required, etc., according to the matching result indicated by the matching result data 66C. When the processor 41 of the electronic device 40 receives the check-in disapproval notification from the shop server 10 ( FIG. 13 , Act 44 NO), the processor 41 sends the check-in disapproval notification. After outputting, the first check-in process ends and the product registration process ends (Act 45).

Note that when the collation result data 66C is stored, check-in permission/non-permission may be determined according to the content of the collation result data 66C instead of always disallowing check-in. good. For example, if the collation result data 66C includes data indicating the difference (number of mismatches) between the number of times a predetermined action for purchasing a product is performed and the number of registered products, the number of mismatches is set in advance. Check-in may be disallowed if the number is greater than or equal to (for example, 3 or more). Also, if the same member ID is registered in the result data 66 more than a preset number (for example, 2), check-in can be disallowed. Other check-in permission conditions can be set in advance.

If the member ID is registered in the result data 66, the corresponding member information may be notified to the store server 10 or the information processing device used by the store clerk. Also, when the member information is notified, the check-in may be permitted so that the store clerk can deal with the customers who come to the store. In this case, it is necessary for the staff to respond to the customer, but since there is no need to always have a staff member called an attendant available, this does not pose an obstacle to the reduction of staff.

If the processor 11 confirms that the member ID received by the check-in request is in the member data record 62R and that the corresponding member ID is not registered in the result data 66 (YES in Act 3), the electronic device 40 (Act 5). The processor 11 generates the member ID of the customer permitted to check-in and the transaction ID for identifying one transaction by this customer, and stores them in the auxiliary storage device 13 (Act 6).

When the processor 41 of the electronic device 40 receives the check-in permission notification from the shop server 10 (FIG. 13, YES in Act 44), it becomes ready for product information registration by the customer's operation. Registration of product information will be described later.

Next, the second check-in process will be described with reference to the flowchart shown in FIG. A second check-in process uses the customer's biometric information to identify the customer. Here, for example, a case of using feature data of a customer's face image as biometric information will be described.

The customer causes the camera 36 of the check-in terminal 30 to take a face image and requests authentication processing. The processor 31 of the check-in terminal 30 detects feature data from the face image captured by the camera 36, and matches it with the biometric information (feature data of the face image) of each member registered in the member database 62 of the store server 10. do.

When the member is authenticated by collating the biometric information, the processor 31 inquires of the store server 10 whether the member ID of the corresponding member is registered in the result data 66 in the same manner as the first check-in processing. Here, if the verification result data 66C is stored, the processor 31 transmits a notice of check-in disapproval to the electronic device 40 in the same manner as in the first check-in process. As a method of notifying the authentication result, for example, an authentication code (for example, a two-dimensional code pattern) indicating the authentication result is displayed on the touch panel 35 . In this case, the customer operates the electronic device 40 to have the camera unit 45 of the electronic device 40 read the authentication code in the same manner as in the first check-in process.

The processor 41 of the electronic device 40 receives the authentication result from the check-in terminal 30 (Fig. 14, Act 51). If the notification is that check-in is not permitted (NO in Act 52 in FIG. 14), processor 41 outputs a notification that check-in is not permitted in the same manner as described above. The check-in process of 2 is ended, and the product registration process is ended (Act 55).

If the check-in terminal 30 determines that the check-in is not permitted, the touch panel 35 of the check-in terminal 30 simply displays a notification that the check-in is not permitted (and outputs a message from the speaker 37). can be

On the other hand, if the member can be authenticated by collating the biometric information, and the member ID of the corresponding member is not registered in the result data 66, the processor 31 notifies the authentication result indicating check-in permission in the same manner as described above. .

When the processor 41 of the electronic device 40 receives the notice of check-in permission (YES in Act 52), the date and time (year, month, day and time) when the member ID and the authentication code pre-stored in the electronic device 40 are read, A check-in request is transmitted to the server 10 (Act 53).

When an in-store purchase is instructed by the customer's operation on the touch panel 44 (YES in Act 54), the processor 41 enters a state in which product information can be registered by the customer's operation. That is, the processor 41 activates the camera unit 45 and shifts to the product code reading state.

A case where the check-in by the customer is completed will be described below.

The processor 11 of the store server 10 identifies the customer who has checked in from the video captured by the camera 60. - 特許庁As features for identifying the customer from the video, for example, the customer's facial image, the color and shape of the customer's belongings such as clothes and bags can be used. Note that the identification of the customer may be performed using an image captured by the camera 36 provided in the check-in terminal 30. FIG.

After that, the processor 11 analyzes whether the customer is captured based on the features of the customer from the images captured by the cameras 60 placed in various places, and tracks the customer moving in the store (Act 7). ). The processor 11 stores the image data in which the customer to be tracked is identified as the image data 65 in association with the transaction authentication 65A, as shown in FIG.

On the other hand, when the processor 41 of the electronic device 40 receives the check-in permission notification, it displays the product list screen on the touch panel 44 and waits for an input operation by the customer (Act 22). In addition, the processor 41 causes the touch panel 35 to display a message for notifying that the operating state has shifted to a state in which product registration is possible. For example, the processor 41 causes the touch panel 35 to display a message such as "Check-in succeeded. Please start shopping." Note that the electronic device 40 may output the message by voice.

The processor 41 of the electronic device 40 causes the touch panel 44 to display a product list screen SC1 shown in FIG. 15, for example. Note that the product list screen SC1 shown in FIG. 15 shows an example of a state in which some products have already been registered, and no product information is displayed in the initial state.

The product list screen SC1 shown in FIG. 15 includes a registered product list area 70, a registration target product area 71, a total display area 72, an accounting button 73, a product registration button 74, and the like. The registered product list area 70 is an area for displaying a list of product names, quantities, unit prices, and prices of registered products. The registration target product area 71 is an area for displaying the product name, quantity, and total price of the last registered product. The total display area 72 is an area for displaying the number of registered products and the total price.

The checkout button 73 is a button for notifying the shop server 10 that the product registration is finished and the checkout process is started. The product registration button 74 is a button for instructing transition to the product registration mode.

The product list screen SC1 represents only a basic form for displaying various information about registered products, and can display various information related to product registration other than those shown in FIG. be.

When the touch panel 44 detects that the product registration button 74 has been operated (YES in Act 23), the processor 41 activates the camera unit 45 and replaces the product list screen SC1 with the product code reading screen for reading product information. is displayed on the touch panel 44 (Act 24).

FIG. 16 is a diagram showing an example of the product code reading screen SC2. An image display area 81 and a product list button 83 are provided on the product code reading screen SC2. The image display area 81 is an area for displaying an image captured by the camera unit 45, and a line 82 indicating the reading position of the barcode is displayed. The product list button 83 is a button for stopping reading of product information and instructing display of the product list screen SC1. On the commodity code reading screen SC2, for example, a message "Please match the bar code to the line" is displayed. This allows the customer to easily understand the product information registration operation using the product code reading screen SC2.

When a customer finds a product to be purchased at the sales floor, the customer takes an image of a product code symbol such as a bar code attached to the product with the camera unit 45 of the electronic device 40.例文帳に追加An image captured by the camera unit 45 is displayed in the image display area 81 . The customer adjusts the display range so that the product code symbol (barcode) is displayed at the line 82 position.

The processor 41 of the electronic device 40 extracts the code symbol from the image captured by the camera unit 45 and reads, for example, a product ID (product code) unique to the product indicated by the code symbol. When the product ID is read from the image captured by the camera unit 45 (YES in Act 25), the processor 41 transmits product registration data including the product ID and the member ID used in the check-in request to the store server 10 ( Act 27).

If the code symbol cannot be extracted from the image for a certain period of time (Act26, YES), the processor 41 changes the display from the product code reading screen SC2 to the product list screen SC1 (Act22).

When the processor 11 of the store server 10 receives the product registration data from the electronic device 40, it searches the product database 61 using the product ID as a search key. The processor 11 acquires the product data record corresponding to the product ID from the product database 61 . The product data record includes product ID, product name, price, and the like. Processor 11 transmits the product data record to electronic device 40 .

When the processor 41 of the electronic device 40 receives the product data record from the store server 10 (Act 28 ), it generates transaction statement data and stores it in the auxiliary storage device 43 . Further, the processor 41 switches the display of the touch panel 44 from the product code reading screen SC2 to the product list screen SC1, and reads the registered product list area 70 based on the product name, price, etc. included in the purchased product information of the transaction details data. , the display of the registration target product area 71 and the total display area 72 is updated.

After confirming that the product name, price, etc. of the product whose product information (product ID) has been read are displayed on the touch panel 44, the customer continues shopping. Then, when finding the product to be purchased, the product ID of the product is input to the electronic device 40.例文帳に追加When the processor 41 of the electronic device 40 detects that the product ID has been input, it transmits the product registration data including the product ID to the store server 10 in the same manner as described above. The processor 41 updates the transaction details data based on the product data record received from the shop server 10, and changes the display of the product list screen SC1. Transaction statement data includes data indicating the number of items registered for purchase.

The customer repeats the work of finding the product to be purchased while moving in the store, taking it out from the product shelf, and inputting the product ID of the product into the electronic device 40 . After inputting the product ID from the electronic device 40, the customer places the product on the cart or puts it in the bag. In addition, the customer may take out the product from the product shelf, confirm it, stop purchasing, and return the product to the product shelf. Furthermore, there is a possibility that the customer will put the product in the bag without inputting the product ID from the electronic device 40 as an illegal action by the customer.

The processor 11 of the store server 10 analyzes whether the customer has made a predetermined action to purchase the product based on the video captured by the camera 60 while tracking the customer moving through the store (Fig. 11, Act 8). For example, when the processor 11 determines that the customer has taken out the product from the product shelf by analyzing the video (YES in Act 9), the processor 11 counts up the number of times the customer has performed a predetermined action for purchasing the product ( +1) (Act 10). Further, by analyzing the image, the processor 11 determines, for example, that the customer has taken out the product from the product shelf and returned it to the product shelf (YES in Act 11), the customer has performed a predetermined action for purchasing the product. The number of times is counted down (-1) (Act 12). That is, the processor 11 of the store server 10 analyzes the behavior of the customer to be tracked, and counts the number of times the customer has performed a predetermined behavior for purchasing the product before checking out (Acts 7-13).

After finishing shopping at the sales floor, the customer touches the checkout button 73 displayed on the touch panel 44 to declare the execution of checkout. When the processor 41 of the electronic device 40 detects that the checkout button 73 has been touched (YES in Act 29), it accepts the specification of the checkout method. Here, if cashless accounting is designated (YES in Act 30), the processor 11 allows the customer to designate a payment method (Act 31). Here, for example, a credit company that can be used by the customer is specified.

The processor 11 executes settlement for the product registered in the transaction details data by the settlement method specified by the customer (for example, the settlement system of the credit company) (Act 32).

On the other hand, if cashless accounting is not designated (NO in Act 30), the processor 11 generates a transaction bar code including transaction details data and displays it on the touch panel 44 (Act 33). The customer moves to the installation place of the accounting machine 20 for accounting while carrying the electronic device 40.例文帳に追加The checkout machine 20 turns on the human sensor 29 when a customer approaches. When the human sensor 29 is turned on, the processor 21 of the accounting machine 20 causes the touch panel 25 to display a message requesting entry of the transaction bar code. The customer causes the camera 211 of the checkout machine 20 to read the transaction barcode displayed on the touch panel 44 .

The processor 21 of the accounting machine 20 causes the touch panel 25 to display the transaction contents (product name, price, total, number of products, etc.) indicated by the transaction bar code. The processor 21 also causes the touch panel 25 to display a screen for inputting the designation of the settlement method, and allows the customer to designate the settlement method. Here, for example, either cash or electronic money is specified. When a payment method is designated by operating the touch panel 25, the processor 21 executes settlement processing according to the designated payment method.

For example, in the case of payment by cash, the amount equivalent to the total amount is paid via the change dispenser 210 . Also, in the case of payment by electronic money, the price is paid from the electronic money card read by the reader/writer 27 . When the payment processing is completed, the processor 21 notifies the electronic device 40 of the payment completion.

When the processor 41 of the electronic device 40 receives the payment completion notification (FIG. 12, YES in Act 34), it transmits the transaction detail data of one transaction for which the payment processing is completed to the store server 10 (Act 35). Store server 10 stores transaction statement data 63 received from electronic device 40 in auxiliary storage device 13 . The processor 41 also transmits to the store server 10 a checkout request including each data of the member ID, the date and time when the settlement process is completed, and the transaction ID (Act 36).

When the processor 11 of the store server 10 receives the checkout request from the electronic device 40 (FIG. 11, YES in Act 13), it ends the tracking of the customer corresponding to the member ID included in the checkout request (Act 14). The processor 11 also causes the auxiliary storage device 13 to store the video analysis data 64 for one transaction for which payment has been completed. As shown in FIG. 8, the video analysis data 64 includes member ID 64A, check-in date/time 64B, number of operations 64C, check-out date/time 64D, and the like.

The processor 11 identifies the purchase points 63C of the transaction detail data 63 and the number of operations 64C registered in the video analysis data 64, using the transaction ID of the transaction for which payment processing has been completed as a key. The processor 11 compares the number of purchase points 63C and the number of operations 64C, and executes matching processing to determine whether there is a mismatch between the numbers (Act 16). That is, the processor 11 counts the number of product information (the number of products) registered by the customer as purchase targets and the number of times the customer has performed a predetermined action (such as taking out the product from the product shelf) to purchase the product. compare.

As a result of matching processing, for example, when it is determined that the number of times a predetermined action for purchasing a product is performed is greater than the number of products actually registered as purchase targets, the processor 11 registers the member ID 66A and the transaction ID 66B. and stored in the auxiliary storage device 13 (result data 66). In this case, the collation result data 66C indicates that the number of times the predetermined action was performed is greater than the number of products.

By storing the result data 66 in this manner, the store server 10 calls the corresponding tracking image data 65B corresponding to the transaction ID 66B from the image data 65 based on the transaction ID 66B associated with the collation result data 66C. be able to. That is, the image captured while the customer is being tracked is displayed on the display device (not shown) provided in the store server 10, the touch panel 25 of the checkout machine 20, or another information processing device (not shown) connected to the network 70. It can be displayed on a display device such as a personal computer). As a result, it is possible to confirm the product purchase behavior of the customer with the image. By this confirmation, the contents of the data stored in the result data 66 can be changed by the operation of the manager of the store server 10, for example. For example, when it is confirmed that the customer is performing the correct operation, the verification result data 66C is deleted (or the content is changed) so that the check-in will not be disallowed in the check-in process the next time the visitor comes to the store. can.

In this manner, the store system 1 of the present embodiment checks the actions of the customer for purchasing the product, and determines the number of times the customer performed the predetermined action for purchasing the product and the products actually registered as purchase targets. By collating the number of , it is possible to easily confirm whether the operation by the customer is correctly executed. Since the customer only needs to perform the normal operation for purchasing the product using the electronic device 40, the customer's operation for purchasing the product is not complicated.

Next, the operation of registering the product information of the product to be purchased by the customer using the checkout machine 20 will be described. For example, in the checkout machine 20, product information for a plurality of products can be collectively registered.

FIG. 17 is a flow chart for explaining the operation of the store server 10 (processor 11) in this embodiment. FIG. 18 is a flow chart showing the operation of the check-in terminal 30 (processor 31) in this embodiment. FIG. 19 is a flow chart showing the operation of the accounting machine 20 (processor 21) in this embodiment. Note that the operations shown in FIGS. 17 to 19 are examples, and the processing procedure and processing contents are not particularly limited as long as similar results can be obtained.

The check-in terminal 30 uses the customer's biometric information to manage the customer's check-in. Here, for example, a case of using feature data of a customer's face image as biometric information will be described.

The customer causes the camera 36 of the check-in terminal 30 to take a face image and requests authentication processing. The processor 31 of the check-in terminal 30 detects feature data from the face image captured by the camera 36, and matches it with the biometric information (feature data of the face image) of each member registered in the member database 62 of the store server 10. (Fig. 18, Act81).

If the member cannot be authenticated by collating the biometric information (NO in Act 82), the processor 31 causes the touch panel 35 of the check-in terminal 30 to display a notice of check-in disapproval (and outputs a message from the speaker 37). (Act 85).

Further, when the member is authenticated by collation of biometric information, the processor 31 inquires of the store server 10 whether the member ID of the corresponding member is registered in the result data 66 in the same manner as in the first check-in processing. . Here, if the verification result data 66C is stored, the processor 31 causes the touch panel 35 of the check-in terminal 30 to display a check-in disapproval notification (Act 85).

On the other hand, if the member can be authenticated by collating the biometric information and the member ID of the corresponding member is not registered in the result data 66, the processor 31 causes the touch panel 35 of the check-in terminal 30 to display a notice of check-in permission. (Furthermore, a message may be output from the speaker 37) (Act 83). The processor 31 generates a member ID of the customer who is permitted to check-in and a transaction ID for identifying one transaction by this customer. Processor 31 transmits a check-in notification including the member ID and transaction ID to store server 10 (Act 84).

When the processor 11 of the shop server 10 receives the check-in request from the check-in terminal 30 (FIG. 17, YES in Act 61), the member ID and the transaction ID included in the check-in notification are stored in the auxiliary storage device 13 (Act 62). .

After that, when the check-in by the customer is completed, the store server 10 starts tracking the customer who has checked in (Act 63). It should be noted that the processing of Acts 63 to 68 shown in FIG. 17 is executed in the same manner as the processing of Acts 7 to 10 shown in FIG. 11, and description thereof will be omitted.

While moving around the store, the customer picks up a product to be purchased from the product shelf and places it on, for example, a cart. The customer moves to the place where the checkout machine 20 is installed after completing the selection of the product to be purchased. The checkout machine 20 turns on the human sensor 29 when a customer approaches. When the human sensor 29 is turned on, the processor 21 of the checkout machine 20 shifts to the operating state of merchandise registration (Fig. 19, Act 91). The processor 21 activates the camera 211 to capture an image of the product placed in the cart or the product placed on a reading stand or the like. Here, for example, all products are collectively photographed.

The processor 21 reads the product code attached to the product from the image captured by the camera 211, or executes analysis processing such as specifying the product based on the design and shape of the package of the product, and purchases the product. Identify the products you are targeting.

The processor 21 transmits product registration data indicating the specified product to the store server 10, and receives the product data record stored in the product database 61 of the corresponding product. The processor 21 generates transaction statement data based on the product data record received from the store server 10 . Also, the processor 21 causes the touch panel 25 to display, for example, a product list screen shown in FIG. 15 according to the content of the transaction details data.

When the processor 21 detects that the checkout button on the product list screen has been touched (YES in Act 92), the processor 21 accepts designation of the payment method. The processor 21 determines the payment method according to the customer's operation of designating the payment method (Act 93).

Here, the processor 21 executes authentication processing for the customer (Act 94). For example, the processor 21 performs authentication using the customer's biometric information (for example, face image) in the same manner as the check-in terminal 30 described above.

If the member cannot be authenticated by collating the biometric information (NO in Act 95), the processor 21 causes the touch panel 25 of the accounting machine 20 to display a notification of disapproval (Act 97). On the other hand, if the member can be authenticated by collating the biometric information (YES in Act 95), the processor 21 causes the touch panel 25 of the accounting machine 20 to display a notification of permission (Act 96). The processor 21 executes payment processing using the specified payment method (Act 98).

When the payment processing is completed, the processor 21 transmits to the store server 10 a checkout notification including transaction detail data of one transaction for which the payment processing is completed, member ID, date and time when the payment processing is completed, and transaction ID. (Act 99). As shown in FIG. 7, the transaction detail data includes data on the number of products (number of purchases) whose product information is registered as an object to be purchased.

When the processor 11 of the store server 10 receives the checkout notification (FIG. 17, YES in Act 69), the transaction statement data (including the number of points purchased) received from the accounting machine 20 is stored in the auxiliary storage device 13. The processor 11 also finishes tracking the customer corresponding to the member ID received from the checkout machine 20 (Act 70). The shop server 10 executes the processing of Act71-73 shown in FIG. 17 in the same manner as the processing of Act15-17 shown in FIG. In Act 72 , matching processing is executed using the number of purchases (the number of products) indicated by the transaction details data received from the accounting machine 20 . Descriptions of Acts 71 to 73 shown in FIG. 17 are omitted below.

In this manner, in the store system 1 of the present embodiment, even when product information is registered by the checkout machine 20 without using the electronic device 40, the number of times the predetermined operation for purchasing the product is performed, By matching the number of products actually registered as purchase targets, it is possible to easily confirm whether the operation by the customer is correctly executed.

In the store system 1 of the present embodiment, there is no need to allocate a dedicated store clerk for registering product information (product scanning) and checkout, and the staff can be reduced. In addition, it is possible to check the behavior of the customer without imposing any burden on the customer, thereby suppressing fraudulent behavior by the customer. Further, in the store system 1 according to the present embodiment, the analysis of the customer's movement and the registration of the product are performed using the image captured by the camera. In other words, the movement of the customer can be easily analyzed without the need for many sensors. For this reason, it is possible to suppress the introduction cost of the system.

Note that the store server 10 is generally transferred with the program stored in a recording medium such as a ROM or HDD. However, the transfer is not limited to this, and the program may be transferred without being stored in the recording medium. In this case, a program transferred separately from the store server 10 is written in a writable storage device included in the store server 10 according to the user's operation. The program can be transferred by recording it on a removable recording medium or by communication via a network. The recording medium may be of any form, such as CD-ROM, memory card, etc., as long as it can store the program and can be read by the device.

Also, while several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and equivalents thereof.
The invention described in the original claims of the present application is appended below.
[1] Image receiving means for receiving an image taken by a camera, receiving means for receiving identification data unique to a customer, and the customer purchasing a product based on the image taken by the customer. counting means for counting the number of times a predetermined action is performed for the purchase; collation means for collating the number of products whose product information is registered as a target for purchase by the customer with the number of times; and collation information indicating the result of the collation. An information processing apparatus having a storage means for storing.
[2] The information processing apparatus according to appendix [1], wherein the storage means stores the collation information in association with the identification data.
[3] further comprising output means for outputting a notification corresponding to the verification result when the verification information indicating the verification result set in advance is stored in association with the identification data when the identification data is received; The information processing apparatus according to appendix [1].
[4] The information processing apparatus according to any one of appendices [1] to [3], further comprising image storage means for storing the image of the customer photographed in association with the identification data.
[5] A camera for photographing customers, an electronic device for registering product information of products to be purchased,
counting means for counting the number of times that the customer performs a predetermined action for purchasing the product based on the image captured by the customer; the number of products for which the product information is registered by the electronic device; and a storage means for storing collation information indicating the result of the collation.

Reference Signs List 1 store system 10 store server 11, 21, 31, 41 processor 12, 22, 32, 42 main memory 13, 23, 33, 43 auxiliary storage device 14, 24, 46 communication Unit 20 (20-1, ..., 20-K) ... accounting machine, 25, 35 ... touch panel, 26 ... printer, 27 ... reader/writer, 30 (30-1, ..., 30-M) ... information terminal, 34 Wireless unit 36 Camera 37 Speaker 40 (40-1, ..., 40-N) Electronic device 50 Access point 60 Network.

Claims (4)

an image receiving means for receiving an image captured by a camera;
receiving means for receiving customer-specific identification data from the electronic device ;
counting means for identifying a customer corresponding to the identification data in the video, counting the number of times the customer performs a predetermined action for purchasing a product, and storing the number of times and the identification data in association with each other ;
a collation means for collating the number of products whose product information is registered as a target for purchase by the customer with the number of times;
and storage means for storing collation information indicating the collation result in association with the identification data . When the identification data is stored in association with the identification data, the identification data indicates a comparison result indicating that the number of products whose product information is registered does not match the number of times when the identification data is received. 2. The information processing apparatus according to claim 1, further comprising output means for outputting a notification that authentication of a corresponding customer is not permitted . video storage means for storing the video of the customer in association with the identification data;
3. The information processing apparatus according to claim 1, further comprising changing means for changing said verification information corresponding to said identification data of said video after said video is displayed. a camera that captures the customer,
an electronic device for registering product information of products to be purchased;
receiving means for receiving customer-specific identification data from the electronic device;
Identify the customer corresponding to the identification data in the image captured by the camera , count the number of times the customer performs a predetermined action for purchasing the product , and store the number of times and the identification data in association with each other. a counting means that causes
collation means for collating the number of products for which the product information is registered by the electronic device with the number of times;
and storage means for storing collation information indicating the collation result in association with the identification data .

Images