JP2020129335A - Information processor and store system - Google Patents

Abstract

To easily check whether a customer's operation is correctly performed without complicating the customer's operation for purchasing a commodity.SOLUTION: An information processor according to the present embodiment has video receiving means, receiving means, counting means, matching means, and storage means. The video receiving means receives a video captured by a camera. The receiving means receives identification data unique to a customer. The counting means counts the number of times the customer has performed a predetermined operation for purchasing a commodity based on the video capturing the customer. The matching means matches the number of commodities whose commodity information is registered as a purchase target by the customer with the number of times. The storage means stores matching information indicating the result of the matching.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing device and a store system in a store such as a retail store.

It is becoming difficult for retailers to secure store personnel due to the serious labor shortage. Therefore, the form of the POS system used in the store has been changed in order to reduce the number of personnel involved in operating a POS (Point Of Sales) terminal and serving customers. Conventionally, a POS system of a type in which a salesclerk performs a process from product scanning (product registration) for registering information on a product to be sold to money transfer is often used. In recent years, the number of self-POS systems in which the customer himself/herself performs everything from product scanning to payment processing is increasing.

However, in the self-POS system, it is necessary to arrange a clerk called an attendant in order to assist a customer who needs a complicated operation and to confirm whether the customer is performing a correct operation to purchase a product. there were. Therefore, even if the self-POS system was introduced, it was not possible to reliably reduce the number of store staff.

JP, 2005-109061, A

The embodiment of the present invention is made in consideration of the above-mentioned circumstances, and the purpose thereof is to easily confirm whether the operation by the customer is correctly executed without complicating the operation for the customer to purchase the product. It is to provide an information processing device and a store system capable of performing the same.

In order to solve the above problems, the information processing apparatus according to the present embodiment has a video receiving unit, a receiving unit, a counting unit, a collating unit, and a storage unit. The image receiving means receives the image captured by the camera. The receiving means receives the identification data unique to the customer. The counting means counts the number of times the customer has performed a predetermined operation for purchasing a product, based on the image taken by the customer. The matching means matches the number of products whose product information is registered as a purchase target by the customer with the number of times. The storage means stores matching information indicating the result of the matching.

The whole block diagram of the store system concerning this embodiment. The block diagram which shows the principal part circuit structure of a store server. The block diagram which shows the principal part circuit structure of an accounting machine. The block diagram which shows the principal part circuit structure of a check-in terminal. The block diagram which shows the principal part structure of an electronic device. The schematic diagram which shows the main data structures of the member data record registered into the member database of a store server. The schematic diagram which shows the data structure in transaction detail data. The figure which shows the data structure in image analysis data. The figure which shows the data structure of video data. The figure which shows the data structure of result data. The flowchart for demonstrating operation|movement of the shop server in this embodiment. 6 is a flowchart showing the operation of the electronic device according to the present embodiment. The flowchart which shows the 1st check-in process in this embodiment. The flowchart which shows the 2nd check-in process in this embodiment. The figure which shows an example of the goods list screen in this embodiment. The figure which shows an example of the product code reading screen in this embodiment. The flowchart for demonstrating operation|movement of the shop server in this embodiment. The flowchart which shows operation|movement of the check-in terminal in this embodiment. The flowchart which shows operation|movement of the accounting machine in this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is an overall configuration diagram of a store system 1 according to this embodiment. The store system 1 is a self-system system capable of executing, from a product operation for registering information on a product to be sold, to a payment process, by a customer operation. In product scanning, the product code attached to the product is read.

The store system 1 in the present embodiment includes a store server 10, a plurality of accounting machines 20 (20-1,..., 20-K), a check-in terminal 30, an access point (AP) 50, a camera 60 (60-1,... ). , 60-M). A plurality of accounting machines 20 (for example, K machines) are installed in one store, for example. It should be noted that at least one accounting machine 20 may be installed. Although only one check-in terminal 30 and one access point 50 are shown in FIG. 1, there may be two or more check-in terminals 30 and access points 50 depending on the scale of the store. The camera 60 is installed at a position where it is possible to photograph a customer moving in the store.

At least one camera 60 is installed. Basically, the camera 60 is arranged so as to cover the inside of the store where the customer can move. The camera 60 can capture an image of a customer when the customer moving within the store moves within the shooting range. In addition, the camera 60 is arranged at a position where a video image that allows the customer to confirm that he or she has performed a predetermined operation for purchasing a product can be taken. Therefore, it is desirable that the camera 60 be capable of simultaneously photographing, for example, the customer and the product displayed on the product shelf. Further, each camera 60 may be installed so that a single customer can simultaneously take images with a plurality of cameras 60. In other words, by photographing the customer with a plurality of cameras 60 from different directions, it is possible to reduce the blind spot where it becomes difficult to confirm the movement of the customer.

The store server 10, the accounting machine 20, the check-in terminal 30, and the access point 50 are connected to a network 70 such as a LAN (Local Area Network).

The store system 1 can incorporate the electronic device 40 (40-1,..., 40-N) owned by the customer into the system. The electronic device 40 is, for example, a smartphone, a mobile phone, a personal computer, a tablet terminal, a portable game terminal, or the like. The electronic device 40, when incorporated in the store system 1, performs wireless communication with the access point 50. Further, the electronic device 40 may be a dedicated terminal used for registering product information provided in the store. For example, the electronic device 40 is a terminal dedicated to the store attached to a cart used in the store.

In the store system 1 according to the present embodiment, the product information may be registered using the electronic device 40 or the accounting machine 20. Further, in the store system 1, the payment process for the registered product information may be executed by the electronic device 40 by an external payment system or by the accounting machine 20.

The check-in terminal 30 is installed at the entrance of the store or the like. The check-in terminal 30 has a check-in function of authenticating a customer who has visited the store and notifying the store server 10. The customer authentication by the check-in terminal 30 can be performed by any one of a plurality of methods or a combination of a plurality of methods. For example, as the first authentication method, there is a method of displaying a code unique to the store (for example, a two-dimensional code) on the display device (touch panel) of the check-in terminal 30 and causing the electronic device 40 to read the code. Further, as a second authentication method, there is a method of displaying a terminal code unique to the terminal (for example, including a member ID which is identification data unique to a customer) on the electronic device 40 and reading it by the check-in terminal 30. .. Further, as a third authentication method, there is a method of inputting biometric information of a customer without using the electronic device 40 and performing verification by collating with biometric authentication data recorded at the time of member registration in advance. As the biometric information for authenticating a customer (member), data showing characteristics such as a facial image, fingerprint, voice, iris, vein pattern, etc. can be used.

The electronic device 40 is equipped with a function of allowing the customer to perform operations such as inputting information on products purchased by the customer. Unique identification information (terminal ID) is set for each of the plurality of electronic devices 40, and is managed by the store server 10.

The store server 10 controls the entire store system 1. The store server 10 according to the present embodiment has a function of a POS system for sales management of products and a function of a video analysis system that analyzes a video received from the camera 60. The store server 10 collates (matches) the data generated by the POS system and the video analysis system, and thereby the operation by the customer is correctly executed without complicating the operation for the customer to purchase the product. Make it easy to check. For example, the store server 10 in the present embodiment compares the number of product information items (the number of products) registered by the customer as a purchase target with the number of times the customer has performed a predetermined operation to purchase the product. The number of product information items registered as purchase targets by customers is managed by the POS system. In addition, the number of times the customer has performed a predetermined operation for purchasing a product is detected by analyzing a video captured during a product purchase action for one transaction by the video analysis system. The store server 10 can store the result of collation (result data (collation information)) when it is determined by collation (matching process) that the customer may not be performing the correct operation. The condition that is judged that the customer may not be performing the correct operation is, for example, when the number of times the predetermined operation for purchasing the product is performed is larger than the number of products actually registered for purchase. There is.

The store server 10 (POS system) creates transaction detail data including the product information of the product purchased by the customer from the product code input in the electronic device 40 or the accounting machine 20. The transaction detail data of the product includes data on the number of registered products (the number of product code inputs). When the accounting is performed by the accounting machine 20, the store server 10 identifies the customer to be accounted for, and transmits transaction detail data of the product purchased by the customer to the accounting machine 20 used by the customer for accounting. The transaction statement data may be generated in the electronic device 40 or the accounting machine 20 that inputs the product code. In this case, the store server 10 receives and stores the transaction detail data from the electronic device 40 or the accounting machine 20.

Further, the store server 10 (video analysis system) receives the video captured by the camera 60 and executes various analysis processes based on the video. The analysis processing includes, for example, identification of customers, tracking of customers moving in a store (tracking), detection of movement of customers, and identification of products that the customer intends to purchase.

In the customer identification, for example, the characteristic data is detected from the face image obtained by photographing the customer, and the customer is specified by collating it with the face authentication data (biological information) indicating the characteristics of the face image registered by the customer in advance. In the tracking of customers, for example, the customer in the image is identified based on the face image of the customer and the color and shape of personal belongings such as clothes and bags worn by the customer. The store server 10 executes an analysis for identifying a customer for each of the plurality of videos received from the plurality of cameras 60. The store server 10 associates and manages one customer detected from each video. In detecting the movement of the customer, for example, the product displayed on the product shelf or the like is picked up, the product taken out of the product shelf is returned to the product shelf, the product is put in a shopping cart, or the like, and the electronic device 40 is used to acquire the product information. Detects various actions such as performing actions to register the. To identify a product, an analysis process such as reading the product code attached to the product from the video and identifying the product based on the design or shape of the package of the product is executed.

In the video analysis system, for example, the number of times a customer has performed a predetermined operation for purchasing a product while one customer moves through a store for shopping for one transaction is counted.

In this embodiment, the store server 10 implements the video analysis system, but it is also possible to implement the video analysis system by a device (video analysis device) different from the store server 10. The video analysis device is realized by, for example, a computer connected to the network 70. The video analysis device receives the video data from the camera 60 and executes various analysis processes as described above. The video analysis device transmits data indicating the analysis result to the store server 10.

FIG. 2 is a block diagram showing a circuit configuration of a main part of the store server 10. The store server 10 includes a processor 11, a main memory 12, an auxiliary storage device 13, a communication unit 14, and a system transmission line 15. The system transmission line 15 includes an address bus, a data bus, a control signal line, and the like. In the store server 10, the processor 11, the main memory 12, the auxiliary storage device 13, and the communication unit 14 are connected to the system transmission line 15. In the store server 10, a computer is configured by the processor 11, the main memory 12, the auxiliary storage device 13, and the system transmission line 15 connecting these.

The processor 11 corresponds to the central part of the computer. The processor 11 controls each unit to realize various functions as the store server 10 according to an operating system or an application program. The processor 11 is, for example, a CPU.

The main memory 12 corresponds to the main storage portion of the computer. The main memory 12 includes a non-volatile memory area and a volatile memory area. The main memory 12 stores an operating system or application program in a non-volatile memory area. The main memory 12 may store data necessary for the processor 11 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 12 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 11. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

The auxiliary storage device 13 corresponds to the auxiliary storage portion of the computer. For example, an HDD, SSD, or the like can be the auxiliary storage device 13. The auxiliary storage device 13 stores data used by the processor 11 for performing various kinds of processing, data created by the processing in the processor 11, and the like. The auxiliary storage device 13 may store the above application program.

The auxiliary storage device 13 stores, for example, a product database 61 and a member database 62. Further, the auxiliary storage device 13 has an area for storing transaction detail data 63 corresponding to a plurality of transactions, an area for storing video analysis data 64 generated by video analysis, and an image received from the camera 60. An area is provided for storing the data 65, the result data 66 showing the result of collating the data generated by the POS system and the video analysis system, and the like.

In the product database 61, product data records created for each product sold in the store are described. The product data record includes items such as product ID, product name, and price. The product ID is a unique code set for each product in order to identify each product individually. The product name and price are the name of the product identified by the product ID and the selling price per point.

The communication unit 14 controls data communication with the checkout machine 20, the check-in terminal 30, the camera 60, or the electronic device 40 connected via the network 70 according to a communication protocol.

FIG. 3 is a block diagram showing a circuit configuration of a main part of the accounting machine 20. The accounting machine 20 includes a processor 21, a main memory 22, an auxiliary storage device 23, a communication unit 24, a touch panel 25, a printer 26, a reader/writer 27, a human sensor 29, a change machine 210, a camera 211, and a system transmission line 212. .. The system transmission line 212 includes an address bus, a data bus, a control signal line, and the like. In the accounting machine 20, the processor 21, the main memory 22, the auxiliary storage device 23, the communication unit 24, the touch panel 25, the printer 26, the reader/writer 27, the human sensor 29, and the camera 211 are connected to the system transmission path 212. In the accounting machine 20, a computer is configured by the processor 21, the main memory 22, the auxiliary storage device 23, and the system transmission line 212 connecting these.

The processor 21 corresponds to the central part of the computer. The processor 21 controls each unit so as to realize various functions as the accounting machine 20 according to an operating system or an application program. The processor 21 is, for example, a CPU.

The main memory 22 corresponds to the main storage part of the computer. The main memory 22 includes a non-volatile memory area and a volatile memory area. The main memory 22 stores an operating system or application program in a non-volatile memory area. The main memory 22 may store data necessary for the processor 21 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 22 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 21. The non-volatile memory area is, for example, a ROM. The volatile memory area is, for example, a RAM.

The auxiliary storage device 23 corresponds to the auxiliary storage portion of the computer. For example, an HDD or SSD can be the auxiliary storage device 23. The auxiliary storage device 23 stores data used by the processor 21 in performing various kinds of processing, data created by the processing in the processor 21, and the like. The auxiliary storage device 23 may store the above application program.

The communication unit 24 controls data communication with the store server 10 connected via the network 70 according to a communication protocol.

The touch panel 25 is a device that has both an input device and a display device of the accounting machine 20. The touch panel 25 detects a touch position on the displayed image and outputs the touch position information to the processor 21.

The printer 26 issues a receipt by printing various character strings or images on the receipt paper. As this type of printer 26, for example, a thermal printer or a dot impact printer can be used.

The reader/writer 27 has a function of reading data recorded on a recording medium and a function of writing data on the recording medium. The reader/writer 27 may be a contact type reader/writer or a non-contact type reader/writer. The recording medium is a payment card such as a credit card, a debit card, an electronic money card, or a prepaid card. A wireless communication device such as a smartphone having the same function as the payment card may be used as the recording medium.

The human sensor 29 detects the location of a person standing in front of the accounting machine 20 by using, for example, infrared rays or ultrasonic waves. When the presence of a person is detected, the motion sensor 29 turns on.

The change machine 210 receives coins and banknotes to be inserted. The change machine 210 also discharges coins and bills as change.

The camera 211 captures, for example, a video (image) for identifying a customer and identifying a product that the customer intends to purchase. In the customer identification, for example, the characteristic data is detected from the face image obtained by photographing the customer, and the customer is specified by collating it with the face authentication data (biological information) indicating the characteristics of the face image registered by the customer in advance. In product identification, analysis processing such as reading the product code attached to the product from the image and identifying the product based on the design and shape of the product package is executed.

A unique accounting machine ID for identifying each is set in the accounting machine 20. The accounting machine ID is stored in, for example, the auxiliary storage device 23.

FIG. 4 is a block diagram showing a circuit configuration of essential parts of the check-in terminal 30. The check-in terminal 30 includes a processor 31, a main memory 32, an auxiliary storage device 33, a communication unit 34, a touch panel 35, a camera 36, a speaker 37, and a system transmission line 39. The system transmission line 39 includes an address bus, a data bus, a control signal line, and the like. In the check-in terminal 30, the processor 31, the main memory 32, the auxiliary storage device 33, the communication unit 34, the touch panel 35, the camera 36, and the speaker 37 are connected to the system transmission path 39. In the check-in terminal 30, a computer is configured by the processor 31, the main memory 32, the auxiliary storage device 33, and the system transmission path 39 connecting these.

The processor 31 corresponds to the central part of the computer. The processor 31 controls each unit to realize various functions as the check-in terminal 30 according to the operating system or the application program. The processor 31 is, for example, a CPU (Central Processing Unit).

The main memory 32 corresponds to the main storage part of the computer. The main memory 32 includes a non-volatile memory area and a volatile memory area. The main memory 32 stores an operating system or application program in a non-volatile memory area. The main memory 32 may store data necessary for the processor 31 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 32 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 31. The non-volatile memory area is, for example, a ROM (Read Only Memory). The volatile memory area is, for example, a RAM (Random Access Memory).

The auxiliary storage device 33 corresponds to the auxiliary storage portion of the computer. For example, an HDD (Hard Disc Drive), an SSD (Solid State Drive), or the like can be the auxiliary storage device 33. The auxiliary storage device 33 stores data used by the processor 31 for performing various kinds of processing, data created by the processing by the processor 31, and the like. The auxiliary storage device 33 may store the above application program.

The communication unit 34 controls data communication with the store server 10 connected via the network 70 according to a communication protocol. The check-in terminal 30 may be provided with a wireless communication unit and configured to perform wireless communication with the access point 50 according to a wireless communication protocol.

The touch panel 35 is a device that has both an input device and a display device of the check-in terminal 30. The touch panel 35 detects a touch position on the displayed image and outputs the touch position information to the processor 31.

The camera 36 shoots a video (image) in order to authenticate a customer who has come to the store. The camera 36 captures an image of a terminal code (for example, a two-dimensional code including member ID data) unique to the terminal displayed on the electronic device 40 carried by the customer who has come to the store (second authentication method). Further, when authenticating the customer based on the characteristics of the facial image as the biometric information of the customer, the camera 36 captures the facial image of the customer (third authentication method).

The speaker 37 outputs a message voice or the like for the customer who has visited the store.

FIG. 5 is a block diagram showing a main configuration of the electronic device 40. The electronic device 40 includes a processor 41, a main memory 42, an auxiliary storage device 43, a touch panel 44, a camera unit 45, a wireless unit 46, and the like. The processor 41, the main memory 42, the auxiliary storage device 43, the touch panel 44, the camera unit 45, and the wireless unit 46 are connected by a system transmission line 47 including an address bus, a data bus, a control signal line, and the like.

The electronic device 40 configures a computer by the processor 41, the main memory 42, the auxiliary storage device 43, and the system transmission path 47 that connects them.

The processor 41 corresponds to the central part of the computer. The processor 41 controls each unit to realize various functions as the electronic device 40 according to the operating system and the application program.

The main memory 42 corresponds to the main storage portion of the computer. The main memory 42 includes a non-volatile memory area and a volatile memory area. The main memory 42 stores an operating system and application programs in a non-volatile memory area. The main memory 42 may also store data necessary for the processor 41 to execute processing for controlling each unit in a non-volatile or volatile memory area. The main memory 42 uses a volatile memory area as a work area in which data is appropriately rewritten by the processor 41.

The auxiliary storage device 43 corresponds to the auxiliary storage portion of the computer. As the auxiliary storage device 43, for example, an HDD or SSD may be used as the auxiliary storage device 43. The auxiliary storage device 43 stores data used by the processor 41 in various processes and data generated by the process of the processor 41. The auxiliary storage device 43 may store an application program.

The touch panel 44 functions as an input device and a display device of the electronic device 40. On the touch panel 44, an icon for starting the application program is displayed.

The camera unit 45 has a resolution capable of capturing a bar code indicating the product information attached to the product. The wireless unit 46 transmits/receives data to/from the access point 60 using wireless communication. It is assumed that the electronic device 40 can be used in the store system 1 when the electronic device 40 includes a camera unit 45 and a wireless unit 46 among portable information processing devices such as smartphones, mobile phones, and tablet terminals.

The electronic device 40 installs the product registration program P1 and operates as an information terminal corresponding to the store system 1 by the function realized by the product registration program P1.

The product registration program P1 controls the processor 41 so that the product registration program P1 becomes a terminal for registering product information by a customer operation. The product registration program P1 is stored in the auxiliary storage device 43. In addition to the product registration program P1, an area for storing product information and the like is provided in the auxiliary storage device 43. Further, the product registration program P1 receives from the store server 10 a member ID unique to the customer issued by performing member registration (registration of member information) in the store server 10, and manages (stores) the member ID.

Next, the data stored in the auxiliary storage device 13 of the store system 1 will be described.

FIG. 6 is a schematic diagram showing the main data structure of the member data record 62R registered in the member database 62 of the store server 10. FIG. 6 shows data corresponding to one member. As shown in FIG. 6, in the member data record 62R, the member information provided by the member is registered in association with the member ID unique to the registered customer. The member information includes biometric information and personal information as information for identifying or authenticating the member (customer). As the biometric information, for example, data showing characteristics such as a facial image, fingerprint, voice, iris, vein pattern can be used. The personal information includes, for example, data indicating a name, an address, a telephone number, a payment method (for example, cash, electronic money, credit).

FIG. 7 is a diagram showing a data structure in the transaction statement data 63 of the store server 10. The transaction statement data 63 is product information registered by product scanning (input of product code) by the customer. The transaction detail data 63 includes a member ID 63A, a transaction ID 63B, a purchase score 63C, and purchase product information 63D. The member ID 63A is set to the member ID of the customer who is authenticated when visiting the store. The transaction ID 63B is generated to identify one transaction by the authenticated customer, and is set in association with the member ID 63A. The purchase merchandise information 63D is information on the merchandise purchased by the customer identified by the member ID. In the purchased product information 63D, the product ID, product name, price, etc. corresponding to the detected product code are read from the product database 61 and registered. The purchase score 63C is information indicating the number of products for which the purchase product information 63D is registered. The transaction statement data is received from the electronic device 40 when the product information is registered in the electronic device 40, and is received from the accounting device 20 when the product information is registered in the accounting machine 20.

FIG. 8 is a diagram showing a data structure in the video analysis data 64 of the store server 10. The video analysis data 64 is data indicating the analysis result of the video received from the camera 60. The video analysis data 64 includes data such as a member ID 64A, check-in date and time 64B, number of operations 64C, and check-out date and time 64D. The check-in date and time 64B indicates the date and time (indicates the date and time) when the customer checked in (visits). The number of operations 64C indicates the number of times the customer has performed a predetermined operation for purchasing a product while the authenticated customer is being tracked (during a product purchase action for one transaction). The check-out date/time 64D indicates the date/time (indicates the year-month-day time) when the customer checked out (ends the settlement process).

Further, although not shown, the image analysis data 64 may store data for identifying the camera 60 that has captured the image in which the predetermined motion for the customer to purchase the product is detected. For example, the camera 60 is installed in association with the sales floor of a specific product. Accordingly, when a predetermined motion by the customer is detected by analyzing the image, the camera 60 in which the image to be analyzed is captured can be identified, and the sales floor of the product in which the camera 60 is installed can be specified. it can. Therefore, it is possible to discriminate which product sales floor the customer has performed the predetermined action. Further, by determining whether or not the product information of the product sold at the sales floor where the customer has performed the predetermined operation is registered, the correspondence between the registration of the product information and the sales floor at which the customer has performed the predetermined operation is collated. You can By this comparison, for example, the product information of the product sold at the sales floor that has performed the predetermined operation is not registered, or the number of operations at the sales floor that has performed the predetermined operation and the number of registrations of the products sold at the corresponding sales floor. Can be discriminated from each other.

FIG. 9 is a diagram showing a data structure of the video data 65 of the store server 10. The video data 65 includes tracking video data 65B used for tracking one customer moving in the store. The tracking video data 65B is stored in association with the transaction ID 65A, and includes video data in which one customer's product purchase behavior for one transaction is photographed. Usually, the tracking video data 65B includes video data captured by a plurality of cameras 60.

FIG. 10 is a diagram showing a data structure of the result data 66 of the store server 10. The result data 66 shows the result (matching information) of matching the data generated by the POS system and the video analysis system. In the result data 66, matching result data 66C indicating that the number of times of performing a predetermined operation is larger than the number of products is stored as the matching result (matching information) in association with the member ID 66A and the transaction ID 66B. .. The matching result data 66C includes not only data indicating that the number of times the predetermined operation has been performed is greater than the number of products, but also data indicating that the number of products is greater than the number of times the operation has been performed. Is also good. Further, the matching result data 66C may include data indicating the difference (the number of mismatches) between the number of times the operation is performed and the number of registered products. Further, in the verification result data 66C, it is determined that the installation location of the camera 60 (for example, corresponding to the sales floor of a specific product) at which the image in which the predetermined motion is detected is captured does not match the registered product information. It may include data indicating the fact.

Next, the operation of the store system 1 according to this embodiment will be described. First, the operation when the product information of the product to be purchased is registered by the customer's own operation using the electronic device 40 will be described.

FIG. 11 is a flowchart for explaining the operation of the store server 10 (processor 11) in this embodiment. FIG. 12 is a flowchart showing the operation of the electronic device 40 (processor 41) in this embodiment. Note that the operations shown in FIGS. 11 to 12 are examples, and the processing procedure and processing contents are not particularly limited as long as the same result can be obtained.

First, when the customer comes to the store, he operates the electronic device 40 to activate the product registration program P1 to start the product registration process. When the product registration process is started, the processor 41 executes the check-in process based on the product registration program P1 (FIG. 12, Act21).

FIG. 13 is a flowchart showing a first check-in process executed by the electronic device 40 in the present embodiment, and FIG. 14 is a flowchart showing a second check-in process. In the first check-in process, the customer is specified using the electronic device 40, and in the second check-in process, the customer is specified using the biometric information of the customer.

In the store system 1, which of the first check-in process and the second check-in process is to be used is predetermined. Further, the first check-in process and the second check-in process may be used together.

First, the first check-in process will be described with reference to the flowchart shown in FIG. When the in-store purchase is instructed by the customer's operation on the touch panel 44 (FIG. 13, YES in Act 41), the processor 41 activates the camera unit 45 and shifts to the store code reading state.

In the check-in terminal 30, a store code unique to the store, for example, a two-dimensional code pattern is displayed on the touch panel 35. The customer operates the electronic device 40 by the camera unit 45 of the electronic device 40 so as to read the store code displayed on the check-in terminal 30.

When the processor 41 reads the store code (Act 42), the processor 41 sends a check-in request to the store server 10 together with the member ID stored in advance in the electronic device 40 and the date and time (year, month, day, and time) when the store code was read. (Act 43).

The store server 10 receives the check-in request from the electronic device 40 via the access point 50. When the processor 11 of the store server 10 receives the member ID together with the check-in request (YES in Act 1), the member ID is written in the work area of the main memory 12. Then, the processor 11 searches the member database 62 using the member ID as a search key, and determines whether or not there is the member data record 62R in which the member ID is described (Act2).

When the processor 11 confirms that there is no corresponding member data record 62R (NO in Act3), the processor 11 transmits a check-in disapproval notice to the electronic device 40 (FIG. 11, Act4). When the check-in disapproval notice is received from the store server 10 (No in Act 44 in FIG. 13), the processor 41 of the electronic device 40 sends a disapproval notice for notifying that the check-in is not permitted. Output (Act45). For example, the processor 41 causes the touch panel 44 to display a message indicating that the permission has been denied. In this case, the electronic device 40 ends the first check-in process and ends the product registration process.

On the other hand, when the processor 11 confirms that the corresponding member data record 62R is present, whether the data (matching information) indicating the matching result preset in association with the corresponding member ID in the result data 66 is set. To confirm. That is, when the customer corresponding to the member ID visits the shop before the last time and performs shopping, it is determined whether or not it is determined that correct operation may not be performed in the collation (matching process) described later. For example, when it is determined that the number of times of performing a predetermined operation for purchasing a product at the time of previous shopping is larger than the number of products actually registered as purchase targets, the predetermined operation is performed based on the number of products. Matching result data 66C indicating that the number of times is greater is stored.

Here, when the collation result data 66C is stored, the processor 11 transmits a check-in disapproval notice to the electronic device 40 according to the collation result indicated by the collation result data 66C (FIG. 11, Act4). ). For example, the processor 11 transmits a check-in disapproval notification indicating that the store cannot be used, member registration is stopped, or a clerk needs to confirm, according to the collation result indicated by the collation result data 66C. When the check-in disapproval notice is received from the store server 10 (No in Act 44 in FIG. 13), the processor 41 of the electronic device 40 sends a disapproval notice for notifying that the check-in is not permitted. After outputting, the first check-in process is completed and the product registration process is completed (Act 45).

It should be noted that when the verification result data 66C is stored, the check-in is not always prohibited, but whether the check-in is allowed or not is determined according to the content of the verification result data 66C. good. For example, when the matching result data 66C includes data indicating the difference (number of mismatches) between the number of times a predetermined operation for purchasing a product is performed and the number of registered products, the number of mismatches is set in advance. If the number is equal to or more than three (for example, three or more), the check-in is not permitted. Further, when the same member ID is registered in the result data 66 more than a preset number (for example, 2), the check-in cannot be permitted. Other check-in permission conditions can be set in advance.

When the member ID is registered in the result data 66, the information of the corresponding member may be notified to the store server 10 or the information processing device used by the store clerk. Further, when the member information is notified, the check-in may be permitted so that the clerk can deal with the customers who visit the store. In this case, although it is necessary for the store clerk to deal with the customer, it is not necessary to always have a store clerk called an attendant, which is not an obstacle to reducing the store clerk.

When it is confirmed that the member ID received by the check-in request is in the member data record 62R and the corresponding member ID is not registered in the result data 66 (YES in Act3), the processor 11 determines that the electronic device 40 A check-in permission notification is transmitted to (Act 5). The processor 11 generates a member ID of a customer who is permitted to check-in and a transaction ID for identifying one transaction by this customer, and stores the transaction ID in the auxiliary storage device 13 (Act6).

When the processor 41 of the electronic device 40 receives the check-in permission notification from the store server 10 (YES in Act 44 in FIG. 13), the product information can be registered by the customer's operation. Registration of product information will be described later.

Next, the second check-in process will be described with reference to the flowchart shown in FIG. In the second check-in process, the customer is identified using the biometric information of the customer. Here, a case where the feature data of the customer's face image is used as the biometric information will be described.

The customer causes the camera 36 of the check-in terminal 30 to capture a face image and requests authentication processing. The processor 31 of the check-in terminal 30 detects the feature data from the face image captured by the camera 36, and compares it with the biometric information (feature data of the face image) of each member registered in the member database 62 of the store server 10. To do.

When the member can be authenticated by collating the biometric information, the processor 31 inquires of the store server 10 whether the member ID of the member is registered in the result data 66, as in the first check-in process. Here, when the collation result data 66C is stored, the processor 31 transmits a check-in disapproval notice to the electronic device 40, similarly to the first check-in processing. As a method of notifying the authentication result, for example, an authentication code (for example, a two-dimensional code pattern) indicating the authentication result is displayed on the touch panel 35. In this case, the customer operates the electronic device 40 and causes the camera unit 45 of the electronic device 40 to read the authentication code in the same manner as in the first check-in process.

The processor 41 of the electronic device 40 receives the authentication result from the check-in terminal 30 (FIG. 14, Act 51). If the check-in is not permitted (NO in Act 52 in FIG. 14), the processor 41 outputs a disapproval notice for notifying that check-in is not permitted in the same manner as described above. The check-in process of No. 2 is finished, and the product registration process is finished (Act 55).

When the check-in terminal 30 determines that the check-in is not permitted, the check-in prohibition notification is simply displayed on the touch panel 35 of the check-in terminal 30 (and a message is output from the speaker 37). May be.

On the other hand, the processor 31 can authenticate the member by collating the biometric information, and when the member ID of the corresponding member is not registered in the result data 66, the processor 31 notifies the authentication result indicating the check-in permission in the same manner as described above. ..

When the processor 41 of the electronic device 40 receives the check-in permission notification (YES in Act 52 ), the processor 41 of the electronic device 40 reads the member ID and the authentication code stored in advance in the electronic device 40 together with the date and time (year/month/day/time). A check-in request is transmitted to the server 10 (Act 53).

When in-store purchase is instructed by the customer's operation on the touch panel 44 (YES in ACT 54 ), the processor 41 enters a state in which product information can be registered by the customer's operation. That is, the processor 41 activates the camera unit 45 and shifts to the reading state of the product code.

The case where the check-in by the customer is completed will be described below.

The processor 11 of the store server 10 identifies the customer who checked in from the video imaged by the camera 60. As a feature for identifying the customer in the video, for example, the face image of the customer, the color or shape of personal belongings such as clothes or bags worn by the customer, can be used. Note that the customer may be identified using a video image captured by the camera 36 provided in the check-in terminal 30.

Hereinafter, the processor 11 analyzes whether or not the customer is captured based on the characteristics of the customer from the images captured by the plurality of cameras 60 arranged in various places, and tracks the customer moving in the store (Act7). ). As shown in FIG. 9, the processor 11 stores the video data in which the customer to be tracked is identified as video data 65 in association with the transaction authentication 65A.

On the other hand, when the check-in permission notification is received, the processor 41 of the electronic device 40 displays the product list screen on the touch panel 44 and enters a standby state for an input operation by the customer (Act 22). Further, the processor 41 causes the touch panel 35 to display a message for notifying that the operating state in which the product can be registered has been entered. For example, the processor 41 causes the touch panel 35 to display a message such as “check-in succeeded. Please start shopping”. The electronic device 40 may output the message by voice.

The processor 41 of the electronic device 40 displays the product list screen SC1 shown in FIG. 15 on the touch panel 44, for example. The product list screen SC1 shown in FIG. 15 shows an example of a state in which some products have already been registered, and product information is not displayed in the initial state.

The product list screen SC1 shown in FIG. 15 is provided with a registered product list area 70, a registration target product area 71, a total display area 72, a checkout button 73, a product registration button 74, and the like. The registered product list area 70 is an area for displaying a list of registered product names, product numbers, unit prices, and prices. The registration target product area 71 is an area for displaying the product name, the number of products, and the total price of the products registered last. The total display area 72 is an area for displaying the number of registered commodities and the total price.

The accounting button 73 is a button for notifying the store server 10 that the merchandise registration is completed and the accounting process is started. The product registration button 74 is a button for instructing a transition to the product registration mode.

The product list screen SC1 shows only a basic form for displaying various kinds of information about registered products, and it is possible to display various kinds of information related to product registration other than that shown in FIG. is there.

When the operation on the product registration button 74 is detected on the touch panel 44 (YES in Act 23), the processor 41 activates the camera unit 45 and replaces the product code reading screen for reading product information with the product list screen SC1. Then, it is displayed on the touch panel 44 (Act 24).

FIG. 16 is a diagram showing an example of the product code reading screen SC2. An image display area 81 and a product list button 83 are provided on the product code reading screen SC2. The image display area 81 is an area for displaying an image captured by the camera unit 45, and a line 82 indicating a barcode reading position is displayed. The product list button 83 is a button for stopping the reading of the product information and instructing the display of the product list screen SC1. On the product code reading screen SC2, for example, a message "Please align the bar code with the line" is displayed. Thereby, the customer can easily understand the registration operation of the product information using the product code reading screen SC2.

When the customer finds a product to purchase at the sales floor, the customer captures a product code symbol such as a barcode attached to the product by the camera unit 45 of the electronic device 40. The image captured by the camera unit 45 is displayed in the image display area 81. The customer adjusts the display range so that the product code symbol (bar code) is displayed at the position of the line 82.

The processor 41 of the electronic device 40 extracts a code symbol from the image captured by the camera unit 45 and reads, for example, a product ID (product code) unique to the product indicated by the code symbol. When the product ID is read from the image taken by the camera unit 45 (YES in Act 25), the processor 41 transmits product registration data including the product ID and the member ID used in the check-in request to the store server 10 ( Act 27).

If the code symbol cannot be extracted from the image for a certain period of time (Act 26, YES), the processor 41 changes the display from the product code reading screen SC2 to the product list screen SC1 (Act 22).

Upon receiving the product registration data from the electronic device 40, the processor 11 of the store server 10 searches the product database 61 using the product ID as a search key. The processor 11 acquires the product data record corresponding to the product ID from the product database 61. The product data record includes a product ID, a product name, a price, and the like. The processor 11 transmits the product data record to the electronic device 40.

Upon receiving the product data record from the store server 10 (Act 28), the processor 41 of the electronic device 40 generates transaction detail data and stores it in the auxiliary storage device 43. Further, the processor 41 switches the display of the touch panel 44 from the product code reading screen SC2 to the product list screen SC1, and based on the product name, price, etc. included in the purchased product information of the transaction detail data, the registered product list area 70. The display of the registration target product area 71 and the total display area 72 is updated.

The customer who confirms that the product name, price, etc. of the product whose product information (product ID) is read is displayed on the touch panel 44, continues shopping. When the product to be purchased is found, the product ID of the product is input to the electronic device 40. When detecting that the product ID has been input, the processor 41 of the electronic device 40 transmits the product registration data including the product ID to the store server 10 in the same manner as described above. The processor 41 updates the transaction detail data based on the product data record received from the store server 10 and changes the display of the product list screen SC1. The transaction statement data includes data indicating the number of products registered as purchase targets.

The customer repeats the operation of finding the product to purchase while moving in the store, taking out the product from the product shelf, and inputting the product ID of the product into the electronic device 40. After inputting the product ID from the electronic device 40, the customer places the product in a cart or puts it in a bag. Further, the customer may take out the product from the product shelf, check it, stop purchasing, and return the product to the product shelf. Further, as an illegal operation by the customer, there is a possibility that an operation such as putting the product in a bag without inputting the product ID from the electronic device 40.

The processor 11 of the store server 10 analyzes whether or not the customer has performed a predetermined operation for purchasing a product based on the image captured by the camera 60 while tracking the customer moving in the store (FIG. 11, Act 8). For example, when the processor 11 determines that the customer has taken out the product from the product shelf by analyzing the image (YES in Act 9), the processor 11 counts up the number of times the customer has performed a predetermined motion to purchase the product ( +1) (Act10). Further, when the processor 11 determines from the analysis of the image that the product taken out from the product shelf is returned to the product shelf (YES in Act 11), the customer 11 performs a predetermined operation for purchasing the product. The number of times is counted down (-1) (Act 12). That is, the processor 11 of the store server 10 analyzes the movement of the customer who is the target of tracking, and counts the number of times the customer has performed a predetermined movement to purchase a product before checking out (Acts 7 to 13).

The customer who has finished shopping at the sales floor touches the checkout button 73 displayed on the touch panel 44 to declare execution of checkout. When the processor 41 of the electronic device 40 detects that the accounting button 73 is touched (YES in Act 29), the processor 41 accepts the designation of the accounting method. Here, when cashless accounting is designated (YES in Act 30), the processor 11 causes the customer to designate the settlement method (Act 31). Here, for example, a credit company that can be used by customers is designated.

The processor 11 executes the payment for the product registered in the transaction statement data by the payment method specified by the customer (for example, the payment system by the credit company) (Act 32).

On the other hand, when the cashless accounting is not designated (NO in Act 30), the processor 11 generates a transaction barcode including the content of transaction detail data and displays it on the touch panel 44 (Act 33). The customer moves to the installation place of the accounting machine 20 that carries out the accounting process while carrying the electronic device 40. The accounting machine 20 turns on the motion sensor 29 when the customer approaches. When the human sensor 29 is turned on, the processor 21 of the accounting machine 20 causes the touch panel 25 to display a message for requesting the input of the transaction barcode. The customer causes the camera 211 of the accounting machine 20 to read the transaction barcode displayed on the touch panel 44.

The processor 21 of the accounting machine 20 causes the touch panel 25 to display the accounting content (product name, price, total, number of products, etc.) indicated by the transaction barcode. Further, the processor 21 causes the touch panel 25 to display a screen for inputting the payment method specification, and allows the customer to specify the payment method. Here, for example, either cash or electronic money is designated. When the payment method is specified by the operation on the touch panel 25, the processor 21 executes the payment process by the specified payment method.

For example, in the case of cash payment, the total amount of money is paid via the change dispenser 210. Further, in the case of payment by electronic money, the price is paid from the electronic money card read by the reader/writer 27. When the payment process is completed, the processor 21 notifies the electronic device 40 of the completion of payment.

When the payment completion notification is received (YES in Act 34 in FIG. 12), the processor 41 of the electronic device 40 transmits transaction detail data of one transaction for which payment processing is completed to the store server 10 (Act 35). The store server 10 stores the transaction statement data 63 received from the electronic device 40 in the auxiliary storage device 13. Further, the processor 41 sends a checkout request including the member ID, the date and time when the settlement processing is completed, and the transaction ID data to the store server 10 to the store server 10 (Act 36).

When the processor 11 of the store server 10 receives the checkout request from the electronic device 40 (YES in Act 13 of FIG. 11), the tracking of the customer corresponding to the member ID included in the checkout request ends (Act 14). In addition, the processor 11 stores the video analysis data 64 for one transaction for which payment is completed in the auxiliary storage device 13. As shown in FIG. 8, the video analysis data 64 includes data such as a member ID 64A, a check-in date/time 64B, an operation count 64C, and a check-out date/time 64D.

The processor 11 identifies the purchase score 63C of the transaction detail data 63 and the number of operations 64C registered in the video analysis data 64, using the transaction ID of the transaction for which the settlement processing has been completed as a key. The processor 11 collates the purchase score 63C with the operation count 64C, and executes a match process for determining whether the numbers do not match (Act 16). That is, the processor 11 determines the number of product information items registered as purchase targets by the customer (the number of products) and the number of times the customer has performed a predetermined operation (such as taking out the product from the product shelf) to purchase the product. Compare.

As a result of the matching process, for example, the processor 11 determines that the number of times of performing a predetermined operation for purchasing a product is larger than the number of products actually registered for purchase, the member ID 66A and the transaction ID 66B. The matching result data 66C is stored in the auxiliary storage device 13 (result data 66) in association with. In this case, the matching result data 66C indicates that the number of times the predetermined operation is performed is larger than the number of products.

By storing the result data 66 in this way, the store server 10 calls the corresponding tracking video data 65B corresponding to the transaction ID 66B from the video data 65 based on the transaction ID 66B associated with the matching result data 66C. be able to. That is, a video image taken while the customer is being tracked (not shown) provided in the store server 10, the touch panel 25 of the checkout machine 20, or another information processing device connected to the network 70 ( It can be displayed on a display device such as a personal computer. As a result, the customer's product purchase behavior can be confirmed by the video. By this confirmation, the content of the data stored in the result data 66 can be changed by the operation of the administrator of the store server 10, for example. For example, if it is confirmed that the customer is performing the correct operation, the verification result data 66C is deleted (or the content is changed) so that the check-in processing will not be prohibited at the next visit. it can.

In this way, in the store system 1 according to the present embodiment, the operation of the customer for purchasing the product is checked, the number of times the predetermined operation for purchasing the product is performed, and the product actually registered as the purchase target. It is possible to easily confirm whether the operation by the customer is correctly executed by performing the matching process for the number of. Since the customer only needs to perform an operation for purchasing a normal product using the electronic device 40, the operation for the customer to purchase the product is not complicated.

Next, the operation when the product information of the product to be purchased is registered by the customer's own operation using the accounting machine 20 will be described. For example, in the accounting machine 20, the product information of a plurality of products can be collectively registered.

FIG. 17 is a flowchart for explaining the operation of the store server 10 (processor 11) in this embodiment. FIG. 18 is a flowchart showing the operation of the check-in terminal 30 (processor 31) in this embodiment. FIG. 19 is a flowchart showing the operation of the accounting machine 20 (processor 21) in this embodiment. Note that the operations shown in FIGS. 17 to 19 are examples, and the processing procedure and processing contents thereof are not particularly limited as long as similar results can be obtained.

The check-in terminal 30 manages the check-in of the customer by using the biometric information of the customer. Here, a case where the feature data of the customer's face image is used as the biometric information will be described.

The customer causes the camera 36 of the check-in terminal 30 to capture a face image and requests authentication processing. The processor 31 of the check-in terminal 30 detects the feature data from the face image captured by the camera 36, and compares it with the biometric information (feature data of the face image) of each member registered in the member database 62 of the store server 10. (FIG. 18, Act 81).

When the member cannot be authenticated by collating the biometric information (NO in Act 82), the processor 31 displays a check-in disapproval notice on the touch panel 35 of the check-in terminal 30 (further outputs a message from the speaker 37). It may be (Act85).

If the member can be authenticated by collating the biometric information, the processor 31 inquires of the store server 10 whether the member ID of the member is registered in the result data 66 as in the first check-in process. .. Here, when the verification result data 66C is stored, the processor 31 causes the touch panel 35 of the check-in terminal 30 to display a check-in disapproval notice (Act 85).

On the other hand, the processor 31 can authenticate the member by collating the biometric information, and when the member ID of the corresponding member is not registered in the result data 66, displays a check-in permission notification on the touch panel 35 of the check-in terminal 30. (Furthermore, a message may be output from the speaker 37) (Act 83). The processor 31 generates a member ID of a customer who is permitted to check in and a transaction ID for identifying one transaction by this customer. The processor 31 transmits a check-in notification including the member ID and the transaction ID to the store server 10 (Act84).

When receiving the check-in request from the check-in terminal 30 (YES in Act 61 in FIG. 17), the processor 11 of the store server 10 stores the member ID and the transaction ID included in the check-in notification in the auxiliary storage device 13 (Act 62). ..

After that, when the check-in by the customer is completed, the shop server 10 starts the tracking for the customer who checked in (Act 63). The processes of Acts 63 to 68 shown in FIG. 17 are the same as the processes of Acts 7 to 10 shown in FIG.

While moving inside the store, the customer takes out the product to be purchased from the product shelf and places it on a cart or the like. When the customer finishes selecting the product to be purchased, the customer moves to the installation place of the accounting machine 20. The accounting machine 20 turns on the motion sensor 29 when the customer approaches. When the human sensor 29 is turned on, the processor 21 of the accounting machine 20 shifts to a product registration operation state (FIG. 19, Act 91). The processor 21 activates the camera 211 to take an image of the product placed in the cart or the product placed on the reading stand or the like. Here, for example, it is assumed that all the products are photographed together.

The processor 21 reads the product code attached to the product from the image captured by the camera 211, or executes an analysis process such as specifying the product based on the design or shape of the package of the product to purchase the product. Identify the target product.

The processor 21 transmits the product registration data indicating the specified product to the store server 10, and receives the product data record stored in the product database 61 of the corresponding product. The processor 21 generates transaction statement data based on the product data record received from the store server 10. Further, the processor 21 displays the product list screen shown in FIG. 15, for example, on the touch panel 25 according to the content of the transaction detail data.

When the processor 21 detects that the checkout button on the product list screen is touched (YES in Act 92), the processor 21 accepts the designation of the payment method. The processor 21 determines the payment method according to the operation of the customer specifying the payment method (Act 93).

Here, the processor 21 executes an authentication process for the customer (Act94). For example, it is assumed that the processor 21 executes authentication using the biometric information (for example, face image) of the customer similarly to the check-in terminal 30 described above.

When the member cannot be authenticated by collating the biometric information (NO in Act95), the processor 21 displays a disapproval notice on the touch panel 25 of the accounting machine 20 (Act97). On the other hand, if the member can be authenticated by collating the biometric information (YES in Act 95), the processor 21 displays a notification of permission on the touch panel 25 of the accounting machine 20 (Act 96). The processor 21 executes the settlement process by the designated settlement method (Act98).

When the settlement process is completed, the processor 21 sends a checkout notification including transaction detail data of one transaction for which the settlement process is completed, member ID, date and time when the settlement process is completed, and transaction ID data to the store server 10. (Act99). As shown in FIG. 7, the transaction statement data includes data on the number of products (purchase points) for which product information is registered as a purchase target.

Upon receiving the check-out notification (YES in Act 69 in FIG. 17), the processor 11 of the store server 10 stores the transaction statement data (including the purchase point data) received from the accounting machine 20 in the auxiliary storage device 13. Further, the processor 11 finishes tracking the customer corresponding to the member ID received from the accounting machine 20 (Act 70). The store server 10 executes the processing of Act 71 to 73 shown in FIG. 17 in the same manner as the processing of Act 15 to 17 shown in FIG. In Act 72, the matching process is executed using the purchase points (the number of products) indicated by the transaction statement data received from the accounting machine 20. Hereinafter, description of Acts 71 to 73 shown in FIG. 17 will be omitted.

In this way, in the store system 1 according to the present embodiment, even when the transaction information is registered by the accounting machine 20 without using the electronic device 40, the number of times the predetermined operation for purchasing the product is performed, and By performing the matching process on the number of products actually registered as purchase targets, it is possible to easily confirm whether the operation by the customer is correctly executed.

In the store system 1 according to the present embodiment, it is not necessary to arrange a dedicated store clerk for product information registration (product scanning) and accounting check, and it is possible to reduce the number of staff. In addition, it is possible to check the customer's operation without imposing any burden on the customer, and suppress the customer's illegal behavior. Further, in the store system 1 according to the present embodiment, analysis of customer movements and registration of products are performed using images taken by a camera. That is, the movement of the customer can be easily analyzed without requiring many sensors. Therefore, it is possible to suppress the introduction cost of the system.

The store server 10 is generally transferred while the program is stored in a recording medium such as a ROM or a HDD. However, the present invention is not limited to this, and the program may be transferred without being stored in the recording medium. In this case, the program transferred separately from the store server 10 is written in the writable storage device of the store server 10 according to the operation of the user or the like. The program can be transferred by recording it on a removable recording medium or by communication via a network. The recording medium may have any form as long as it can store the program and can be read by the device, such as a CD-ROM or a memory card.

Further, although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and modifications thereof are included in the scope and the gist of the invention, and are also included in the invention described in the claims and the scope equivalent thereto.

1... Store system, 10... Store server, 11, 21, 31, 41... Processor, 12, 22, 32, 42... Main memory, 13, 23, 33, 43... Auxiliary storage device, 14, 24, 46... Communication Unit, 20 (20-1,..., 20-K)... Accounting machine, 25, 35... Touch panel, 26... Printer, 27... Reader/writer, 30 (30-1,..., 30-M)... Information terminal, 34 ... wireless unit, 36 ... camera, 37 ... speaker, 40 (40-1, ..., 40-N) ... electronic device, 50 ... access point, 60 ... network.

Claims (5)

Video receiving means for receiving the video captured by the camera,
Receiving means for receiving identification data unique to the customer,
Counting means for counting the number of times the customer has performed a predetermined operation for purchasing a product, based on the image taken by the customer;
Collating means for collating the number of products whose product information is registered as a purchase target by the customer with the number of times,
An information processing apparatus, comprising: a storage unit that stores verification information indicating a result of the verification. The information processing apparatus according to claim 1, wherein the storage unit stores the collation information in association with the identification data. When the identification data is received, when the collation information indicating a preset collation result is stored in association with the identification data, the output unit further includes an output unit that outputs a notification according to the collation result. 1. The information processing device according to 1. The information processing apparatus according to claim 1, further comprising: a video storage unit that stores the video imaged by the customer in association with the identification data. A camera that captures customers
An electronic device for registering product information of a product to be purchased,
Counting means for counting the number of times the customer has performed a predetermined operation for purchasing a product, based on the image taken by the customer;
Collating means for collating the number of products and the number of products in which the product information is registered by the electronic device;
A storage system having a storage unit that stores verification information indicating a result of the verification.