JP6696554B2 - Payment system and payment method - Google Patents

Description

  The present invention relates to a payment system, a product registration device, a payment device, a program, and a payment method.

  At cashier terminals in stores such as supermarkets, (1) processing for registering the product to be paid for (such as reading a barcode) and (2) processing for payment for the registered product (such as receipt of payment and return of changes) Two processes are performed.

  Then, there is an operation method in which the function of such a cashier terminal is separated into two devices, and the process (1) and the process (2) are performed by different devices. For example, Patent Document 1 discloses a self-POS system in which a registration device used for the process (1) and an accounting device used for the process (2) are separately provided. The clerk uses the registration device to register the product. The registration device captures an image of the customer with the image capturing unit. A clerk operating the registration device selects a customer image to be associated with the accounting data (data related to registered merchandise) from the customer images captured by the image capturing unit. As a result, the registration device associates the customer image with the accounting data. After that, the customer uses the accounting device to perform accounting. The accounting apparatus captures an image of the customer and acquires accounting data associated with the image of the customer having a high match with the generated image of the customer. Then, the customer performs accounting based on this accounting data.

JP, 2012-248162, A

  A customer who uses the registration device may be different from a customer who uses the payment device to settle a product registered by the registration device. For example, when a couple is shopping, a husband may use the registration device and a wife may use the accounting device. Therefore, it is difficult for a store clerk to determine a customer who uses the accounting apparatus, or for the apparatus to automatically determine the customer.

  In the invention of Patent Document 1, the clerk determines the image of the customer to be associated with the accounting information. Therefore, customers other than the customer who used the registration device cannot use the accounting device.

  The present invention has been made in view of the above problems. An object of the present invention is to provide a technique that enables a customer to flexibly make a payment.

The settlement system of the present invention includes a product registration device, a settlement device, and a warning device. In the settlement system, the product registration device and the settlement device are installed separately. The merchandise registration device is configured to generate a reconciliation information generating unit that generates reconciliation information regarding a reimbursement process of the merchandise based on registration of the merchandise, and a control unit that associates the reconciliation information with a customer image of a customer who is in the vicinity of the merchandise registration device. And have. The settlement device has a settlement means for performing settlement processing based on the settlement information. The merchandise registration device includes a display unit that displays the customer image, and an input reception unit that receives an input for selecting the customer who performs the settlement processing in the settlement unit from the customer image. The warning device has a warning unit that performs a warning process when the payment process of the payment information associated with the customer image corresponding to the customer near the exit is not completed.
The input receiving unit receives selection of the plurality of customer images. The control means associates the selected plurality of customer images with the settlement information. In the case where the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed, the warning unit is configured to display a plurality of customer images associated with the settlement information. When all correspond to a customer in the vicinity of the exit or a customer in the vicinity of the exit, the warning process is performed, and one of the plurality of customer images associated with the settlement information is in the vicinity of the exit. If the customer or the customer in the vicinity of the exit is not dealt with, the warning process is not performed.

The settlement method of the present invention is executed by a settlement system in which the product registration device and the settlement device are separately installed. The settlement system includes the product registration device, the settlement device, and a warning device. In the payment method, the payment information generation unit of the product registration device generates a payment information regarding payment processing of the product based on registration of the product, and a control unit of the product registration device includes the payment information generation step. A control step of associating the customer image obtained by imaging a customer in the vicinity with the settlement information, a settlement means of the settlement device , a settlement step of performing settlement processing based on the settlement information, and a display means of the commodity registration device, A display step of displaying the customer image; an input receiving step of the commodity registration apparatus; an input receiving step of receiving an input for selecting a customer who performs settlement processing in the settlement means from the customer image; and a warning means of the warning device. A warning step of performing a warning process when the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed.
The input receiving unit receives selection of the plurality of customer images in the input receiving step. In the control step, the control unit associates the selected plurality of customer images with the settlement information. The warning means, in the warning step, when the settlement processing of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed, a plurality of associations associated with the settlement information are provided. If all of the customer image of, corresponding to a customer in the vicinity of the exit or a customer in the vicinity of the exit, perform the warning process, any of the plurality of customer images associated with the settlement information, If the customer near the exit or the customer near the exit does not correspond, the warning process is not performed.

  According to the present invention, there is provided a technique that enables a customer to make a flexible payment.

It is a figure which illustrates arrangement | positioning of the goods registration apparatus and the settlement apparatus which a settlement system has. FIG. 2 is a block diagram illustrating the information processing system according to the first embodiment. 6 is a flowchart illustrating a process executed by the product registration device according to the first embodiment. 6 is a flowchart illustrating a flow of processing executed by the settlement device of the first embodiment. FIG. 3 is a diagram illustrating a hardware configuration of a computer that realizes the product registration device of the first embodiment. FIG. 3 is a diagram illustrating a hardware configuration of a computer that realizes the settlement device of the first embodiment. It is a figure which illustrates the settlement information in a table format. It is a figure which illustrates the display in a display apparatus. It is a figure which illustrates the structure of association information in a table format. It is a block diagram which illustrates the information processing system of Embodiment 1 which has a 2nd display control part and a 2nd input reception part. It is a block diagram which illustrates the settlement device which has a judgment part. It is a block diagram which illustrates the settlement system of Embodiment 2. FIG. 9 is a diagram illustrating an example of association information according to the second embodiment. 9 is a flowchart illustrating the flow of processing executed by the warning device of the second embodiment. It is a figure which illustrates the operating environment of the settlement system of Embodiment 2. 11 is a flowchart illustrating the flow of processing executed by the warning device of the third embodiment.

  Embodiments of the present invention will be described below with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description thereof will be omitted as appropriate.

[Embodiment 1]
FIG. 1 is a diagram exemplifying an arrangement of a product registration device 3000 and a settlement device 4000 included in the settlement system 2000. The payment system 2000 includes a product registration device 3000 and a payment device 4000. As shown in FIG. 1, the product registration device 3000 and the settlement device 4000 are provided as independent devices. In a store that uses the payment system 2000, the product is registered using the product registration device 3000 and the payment device 4000. Here, the number of installed merchandise registration devices 3000 and settlement devices 4000 is 1 or more, respectively.

  The product registration device 3000 is used for the process of registering a product as a settlement object. A customer who wants to purchase a product goes to the product registration device 3000 with the product. The clerk operating the product registration device 3000 receives the product from the customer and registers the product as a settlement object. Specifically, the store clerk causes the reader included in the product registration device 3000 to read the barcode attached to each product. With the registration of the product, the product registration device 3000 generates settlement information. The settlement information is information relating to settlement processing of a product registered as a settlement target.

  The settlement device 4000 is used for settlement (receipt of payment, etc.) of a product registered as a settlement target. After the registration of the product is completed, the customer moves to any settlement device 4000. The settlement device 4000 acquires the settlement information regarding the product purchased by the customer, and performs the settlement process based on the settlement information. Specifically, the settlement apparatus 4000 presents the price to the customer, counts the price input by the customer, refunds the change to the customer, issues a receipt, and the like.

<Structures of the product registration device 3000 and the settlement device 4000>
FIG. 2 is a block diagram illustrating the settlement system 2000 according to the first embodiment. In FIG. 2, each block does not represent a hardware-based configuration but a functional-based configuration.

  The product registration device 3000 has a first imaging unit 3020, a first display control unit 3040, a first input reception unit 3060, and a generation unit 3080. The first imaging unit 3020 generates an image including the customer. Hereinafter, this image is referred to as a first customer image. The first display control unit 3040 displays the first customer image on the display device 10 that can be viewed by the customer. The first input receiving unit 3060 receives an input for selecting the first customer image of the customer who performs the settlement process. The generation unit 3080 generates related information that associates the selected first customer image with the payment information.

  The settlement device 4000 includes a second imaging unit 4020 and an acquisition unit 4080. The 2nd imaging part 4020 produces | generates the image containing a customer. Hereinafter, this image is referred to as a second customer image. The acquisition unit 4080 uses the related information to acquire the settlement information associated with the first customer image corresponding to the second customer image. The “first customer image corresponding to the second customer image” is a first customer image in which it is considered that the same customer as the customer shown in the second customer image appears. Further detailed description of the “first customer image corresponding to the second customer image” will be described later.

<Action / effect>
In general, since there are a plurality of customers in a store, a plurality of customers may be included in the image captured by the first image capturing unit 3020. Therefore, it may be difficult to determine which first customer image is the first customer image (the first customer image showing the customer) to be associated with the settlement information about the product purchased by a certain customer.

  Further, the customer who uses the settlement device 4000 and the customer who uses the product registration device 3000 are not always the same. For example, when a couple is shopping, the husband may use the product registration device 3000 and the wife may use the settlement device 4000. Therefore, it is difficult for a store clerk to determine the customer who uses the settlement apparatus 4000 or to automatically determine the customer.

  The product registration device 3000 of the present embodiment causes the customer to select the first customer image to be associated with the settlement information when associating the settlement information with the first customer image showing the customer. Therefore, the customer using the product registration device 3000 not only sees the first customer image showing himself but also the first customer image showing a customer other than himself (for example, a family standing next to him). You can also choose. Therefore, according to the settlement system 2000 of the present embodiment, the customer can flexibly perform the settlement.

  Hereinafter, this embodiment will be described in more detail.

<Process flow>
FIG. 3 is a flowchart illustrating a process executed by the product registration device 3000 according to the first embodiment. The first imaging unit 3020 generates a first customer image (S102). The first display control unit 3040 displays the first customer image on the display device 10 (S104). The first input receiving unit 3060 receives the selection of the first customer image (S106). The generation unit 3080 generates related information by associating the selected first customer image with the payment information (S108).

  FIG. 4 is a flowchart illustrating the flow of processing executed by the settlement device 4000 according to the first embodiment. The 2nd imaging part 4020 produces | generates a 2nd customer image (S202). The acquisition unit 4080 acquires the settlement information associated with the first customer image corresponding to the second customer image (S204).

<Example of hardware configuration of product registration device 3000>
Each functional component of the product registration device 3000 may be implemented by hardware that implements each functional component (eg, a hard-wired electronic circuit, etc.), or a combination of hardware and software (eg: Combination of an electronic circuit and a program for controlling the electronic circuit).

  FIG. 5: is a figure which illustrates the hardware constitutions of the computer 1000 which implement | achieves the goods registration apparatus 3000 of Embodiment 1. As shown in FIG. The computer 1000 may be implemented by using a dedicated device such as a cashier terminal or a general-purpose device such as a PC (Personal Computer) or a mobile terminal.

  The computer 1000 has a bus 1020, a processor 1040, a memory 1060, a storage 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage 1080, the input / output interface 1100, and the network interface 1120 to mutually transmit and receive data. However, the method of connecting the processors 1040 and the like to each other is not limited to bus connection. The processor 1040 is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 1060 is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The storage 1080 is a storage device such as a hard disk, an SSD (Solid State Drive), or a memory card. Further, the storage 1080 may be a memory such as a RAM or a ROM.

  The input / output interface 1100 is an interface for connecting the computer 1000 and an input / output device. The input / output device is, for example, a keyboard or a mouse.

  The network interface 1120 is an interface for communicatively connecting the computer 1000 to an external device. The network interface 1120 may be a network interface for connecting with a wired line or a network interface for connecting with a wireless line. For example, the computer 1000 configuring the merchandise registration device 3000 is connected to the computer 6000 configuring the settlement device 4000 via a network.

  The storage 1080 stores program modules that respectively realize the first imaging unit 3020, the first display control unit 3040, the first input reception unit 3060, and the generation unit 3080. The processor 1040 implements the function of each corresponding functional configuration unit by executing each of these program modules. Here, when executing the above-mentioned modules, the processor 1040 may execute these modules after reading them on the memory 1060, or may execute them without reading them on the memory 1060.

  The hardware configuration of the computer 1000 is not limited to the configuration shown in FIG. For example, each program module may be stored in memory 1060. In this case, the computer 1000 does not have to include the storage 1080.

  The input / output device connected to the input / output interface 1100 includes a reader 40 that reads the product information symbol. The specific mounting method of the reader 40 depends on the product information symbol attached to the product. The product information symbol is a symbol attached to the product, and is a symbol that represents information that identifies the product (such as the product information ID (Identifier)). The symbol is a barcode, a two-dimensional code (such as QR code (registered trademark)), or a character string symbol. The character string referred to here also includes a numerical value string. The product information symbol is, for example, a bar code in which information specifying product information is encoded, or a character string symbol representing information specifying product information.

  For example, when the product information symbol is a bar code, the reader 40 is a bar code reader. Further, for example, when the product information symbol is a two-dimensional code, the reader 40 is a two-dimensional code reader. In addition, for example, when the product information symbol is a character string symbol, the reader 40 has an image sensor for imaging the character string, and a processing unit that analyzes the imaged character string symbol to determine the product ID and the like. Note that various known techniques related to character string analysis can be used for analyzing character string symbols. A description of these known techniques will be omitted.

  When a plurality of types of symbols are used as the product information symbols, a plurality of types of readers are connected to the input / output interface 1100. For example, when a bar code and a two-dimensional code are used as the product information symbol, a bar code reader and a two-dimensional code reader are connected to the input / output interface 1100.

  The input / output device connected to the input / output interface 1100 includes the display device 10. The display device 10 is a display device controlled by the first display control unit 3040. The display device 10 has a touch panel 12, for example. The display device 10 is installed so that the customer who uses the product registration device 3000 can view it.

<< Hardware Configuration of First Imaging Unit 3020 >>
The first imaging unit 3020 has an imaging element that records the result of imaging. For example, the first imaging unit 3020 is configured using a camera having this imaging device. The first image capturing unit 3020 may capture a still image or a moving image. In the latter case, the first customer image is each frame forming a moving image.

  The first imaging unit 3020 is installed at a position where an image of a customer who uses the product registration device 3000 can be captured. The first imaging unit 3020 may be provided integrally with the product registration device 3000 or may be provided separately. In the latter case, for example, the camera 30 that realizes the first imaging unit 3020 is connected to the input / output interface 1100.

<Example of hardware configuration of settlement device 4000>
Each functional component of the settlement device 4000 may be implemented by hardware (eg, a hard-wired electronic circuit) that implements each functional component, or a combination of hardware and software (eg, electronic components). Combination of a circuit and a program for controlling the circuit).

  FIG. 6 is a diagram illustrating a hardware configuration of a computer 6000 that realizes the settlement device 4000 of the first embodiment. The computer 6000 may be implemented by using a dedicated device such as a cashier terminal or a general-purpose device such as a PC (Personal Computer) or a mobile terminal. The configuration of the computer 6000 is similar to that of the computer 1000.

  The storage 6080 stores program modules for realizing the functions of the second imaging unit 4020 and the acquisition unit 4080. The processor 6040 implements the function of each corresponding functional configuration unit by executing each of these program modules. Here, when the processor 6040 executes each of the above modules, these modules may be read into the memory 6060 and then executed, or may be executed without being read into the memory 6060.

  The hardware configuration of the computer 6000 is not limited to the configuration shown in FIG. For example, each program module may be stored in the memory 6060. In this case, the computer 6000 does not have to include the storage 6080.

  The input / output device connected to the input / output interface 6100 includes the display device 20 controlled by the second display control unit 4040. The display device 20 has a touch panel 22, for example. The display device 20 is installed toward the customer so that the customer who uses the settlement apparatus 4000 can browse. This display device may be provided integrally with the settlement device 4000 or may be provided separately.

  In addition, the input / output devices connected to the input / output interface 6100 include a device for the customer to pay the price, a device for refunding the change, and a device for issuing the receipt (not shown). ).

<< Hardware Configuration of Second Imaging Unit 4020 >>
The second image capturing unit 4020 is realized by, for example, the same hardware configuration as the first image capturing unit 3020. The camera 35 is a camera that realizes the second imaging unit 4020. The camera 35 or the like that realizes the second imaging unit 4020 is installed at a position where an image of a customer who uses the settlement device 4000 can be captured.

<Product registration processing by the product registration device 3000>
As described above, the product registration device 3000 generates the payment information regarding the product registered as the payment target. The product registration device 3000 stores the generated settlement information in a storage unit inside or outside the product registration device 3000.

  A plurality of products may be included in the settlement target in one settlement process. For example, the merchandise registration device 3000 receives one or a plurality of merchandise items that have been registered until the operation for instructing the start of the payment target registration process is received and the operation for instructing the end of the payment target registration process is accepted. It is registered as a settlement object in one settlement process. The settlement information regarding a certain settlement process indicates the ID of each product registered as the target of the settlement process. In addition, the settlement information may further indicate a transaction number, the price of each product, the total price, and the like.

  FIG. 7 is a diagram exemplifying the settlement information in a table format. The settlement information shown in FIG. 7 is referred to as settlement information 200. The checkout information 200 has two columns, a checkout information ID 202 and a product list 204. The product list 204 is a list of product IDs registered as settlement objects. The product ID 206 is an ID of a product registered as a settlement object.

  Note that various known techniques can be used for a specific method of generating the settlement information using the ID of the product read by a reader or the like, and thus the description of this method will be omitted.

<Details of Processing Performed by First Imaging Unit 3020>
The first imaging unit 3020 generates a first customer image (FIG. 3: S102). There are various timings at which the first image capturing unit 3020 captures an image. For example, the first imaging unit 3020 always repeatedly captures images while the product registration device 3000 is operating. The frequency at which the first image capturing unit 3020 repeatedly captures images is 1/30 second, which is the same as the frame rate of a general moving image, for example.

  Further, for example, the first imaging unit 3020 may detect that the customer is near the product registration device 3000, and may perform imaging according to the detection. For example, an infrared sensor or the like for detecting a person is provided near the first imaging unit 3020. The first imaging unit 3020 can recognize that there is a customer near the first imaging unit 3020 by receiving the notification from the infrared sensor. Therefore, for example, the first imaging unit 3020 captures an image of the customer when the infrared sensor detects that the customer is near the first imaging unit 3020, and generates a first customer image.

  The first image capturing unit 3020 may repeatedly capture an image of the customer for a predetermined period from the time when the detection is performed. For example, the first image capturing unit 3020 repeatedly captures an image of the customer for a predetermined time after the detection is performed. In addition, for example, the first imaging unit 3020 may repeatedly image the customer from the time when the detection is performed until the registration of the product purchased by the customer is completed (until the payment information is generated). ..

  The above “predetermined time” may be set in the first imaging unit 3020 in advance, or may be stored in a storage unit provided inside or outside the product registration device 3000. In the latter case, the first imaging unit 3020 acquires and uses the above-described predetermined time from this storage unit. Unless otherwise specified, various predetermined values (predetermined time, predetermined value, etc.) used by each functional configuration section described below are similarly set in the functional configuration section or acquired from the storage section. Used.

  The first image capturing unit 3020 may be operated by a store clerk who operates the product registration device 3000. For example, the store clerk guides the customer so that the face of the customer is included in the imaging range of the first imaging unit 3020 by calling the customer. Then, the clerk confirms that the customer's face is included in the image capturing range of the first image capturing unit 3020, and causes the first image capturing unit 3020 to capture the customer image.

  In addition, the guidance may be performed by the first imaging unit 3020. For example, the first imaging unit 3020 guides the customer by displaying guidance in text on the display device 10 or performing voice guidance by sound, so that the customer's face is imaged by the first imaging unit 3020. To do.

  As described above, the image captured by the first image capturing unit 3020 may include multiple customers. Therefore, the first image pickup unit 3020 extracts each customer shown in the image recorded in the image pickup device of the first image pickup unit 3020, and generates the first customer image for each customer. Here, a known object recognition process of extracting a person shown in the image can be used for the process of extracting each customer shown in the image. Therefore, details of this process are omitted.

  When the first image capturing unit 3020 captures an image of a customer multiple times, multiple original images of the same customer are generated. Therefore, the first image capturing unit 3020 generates the first customer image using any one of the plurality of original images. There are various methods for determining which original image is used to generate the first customer image. For example, the first imaging unit 3020 sets the image in which the customer is well captured as the first customer image. The “image showing a good image of the customer” is an image showing a large image of the customer or an image with a small blur. Here, a method of calculating the size of the object (customer) shown in the image or the size of the blur is a known technique. Therefore, description of these methods is omitted.

<Details of Processing Performed by First Display Control Unit 3040>
The first display control unit 3040 displays the first customer image generated by the first imaging unit 3020 on the display device 10 (FIG. 3: S104). FIG. 8 is a diagram illustrating a display on the display device 10. In FIG. 8A, the first display control unit 3040 is displaying one first customer image 50 on the touch panel 12 of the display device 10. On the other hand, in FIG. 8B, the first display control unit 3040 is displaying three first customer images on the touch panel 12 of the display device 10. When there are many customers who have been imaged by the first imaging unit 3020, the first display control unit 3040 displays the button 70 on the touch panel of the display device 10. When the customer presses the button 70, the first display control unit 3040 displays the first customer image 50 that is not currently displayed on the touch panel 12.

<Details of Processing Performed by First Input Receiving Section 3060>
The first input receiving unit 3060 receives the selection of the first customer image displayed on the display device 10 (FIG. 3: S106). As a method for accepting the selection of the first customer image, various known techniques for accepting the selection of the image or the button displayed on the display can be used. For example, when the display device 10 has the touch panel 12 and the first input receiving unit 3060 displays the first customer image on the touch panel 12, the first input receiving unit 3060 displays the first customer image displayed on the touch panel 12. By detecting the pressing, the selection of the first customer image is accepted.

  In the case of FIG. 8A described above, the customer confirms whether or not the customer shown in the first customer image 50 displayed on the touch panel 12 is himself. When the customer shown in the first customer image 50 is himself / herself, the customer selects the first customer image 50 by pressing the first customer image 50.

  In the case of FIG. 8B described above, the customer is reflected in the first customer image 50 displayed on the touch panel 12 or the first customer image displayed on the touch panel 12 by pressing the button 70. It is confirmed whether or not there is the first customer image 50 that is present. Then, when there is the first customer image 50 in which the user is shown, the customer selects the first customer image 50 by pressing the first customer image 50.

  When the first display control unit 3040 displays a plurality of first customer images as in FIG. 8B, the first input receiving unit 3060 may receive an input for selecting a plurality of first customer images. Good. For example, when a family of three uses the product registration device 3000, the display device 10 displays the first customer images of these three, respectively. The family may select the first customer image for each of the three people. By doing so, all of these three persons can use the settlement apparatus 4000 to settle the products. For example, in FIG. 8B, the customer selects the plurality of first customer images 50 by pressing the plurality of first customer images 50.

  Here, the first input accepting unit 3060 may accept an input from the customer, which indicates that there is no first customer image showing himself. For example, in FIG. 8, the customer presses the button 60 to make an input indicating that there is no first customer image showing himself. For example, when this input is made, the first image capturing unit 3020 captures an image of the customer again to generate a first customer image. Then, the first display control unit 3040 displays the generated first customer image on the display device 10.

  The method by which first input receiving unit 3060 receives an input is not limited to the method using a touch panel. For example, the first input receiving unit 3060 may receive an input via a keyboard or the like.

<Details of Processing Performed by Generation Unit 3080>
The generation unit 3080 associates the settlement information with the first customer image (FIG. 3: S108). Information indicating this association is referred to as association information. FIG. 9 is a diagram exemplifying the configuration of the association information in a table format. The association information shown in FIG. 9 is referred to as association information 300. The association information 300 has two columns, a first customer image 302 and a settlement information ID 304. The first customer image 302 indicates an image file in which the first customer image is recorded. The settlement information ID 304 indicates the ID of the settlement information.

  The generation unit 3080 associates with the first customer image the settlement information regarding the product purchased by the customer, which is reflected in the first customer image. Specifically, the generation unit 3080 associates the settlement information generated by the registration process with the first customer image generated from the time when the product registration process is started to the time when the registration process is completed. .. In addition, when an input for selecting a plurality of first customer images is made to the first input receiving unit 3060, the generating unit 3080 displays the related information in which the plurality of first customer images are associated with the settlement information. To generate.

  The generation unit 3080 stores the association information in a storage unit that can be accessed by each settlement device 4000. This storage unit may be internal or external to the product registration device 3000. For example, the storage unit outside the product registration device 3000 is a database server or the like accessible from the product registration device 3000 and the settlement device 4000.

<About the settlement process by the settlement device 4000>
The settlement device 4000 acquires the settlement information and performs the settlement process based on the settlement information. A known method can be used as a method for performing the settlement process based on the information (settlement information) used by the settlement device 4000 for the settlement process of a product. Details of this known method are omitted.

<Details of Processing Performed by Second Imaging Unit 4020>
The 2nd imaging part 4020 produces | generates a 2nd customer image (FIG. 4: S202). The process of the second imaging unit 4020 generating the second customer image is the same as the process of the first imaging unit 3020 generating the first customer image.

<Details of processing performed by acquisition unit 4080>
The acquisition unit 4080 uses the related information to acquire the settlement information associated with the first customer image corresponding to the second customer image (FIG. 4: S204). Specifically, the acquisition unit 4080 accesses the storage unit in which the generation unit 3080 stores the related information, and acquires the settlement information indicated by the related information indicating the first customer image corresponding to the second customer image. ..

  The “first customer image corresponding to the second customer image” is a first customer image in which it is considered that the same customer as the customer shown in the second customer image appears. For example, the “first customer image corresponding to the second customer image” is the first customer image in which the customer having the highest degree of similarity to the customer in the second customer image is shown. In this case, the acquisition unit 4080 calculates the degree of similarity between the customer shown in the second customer image and the customer shown in each first customer image.

  Here, there are various methods for the acquisition unit 4080 to calculate the similarity. For example, the acquisition unit 4080 calculates the feature amount of the imaged customer for each of the first customer image and the second customer image. Then, the acquisition unit 4080 calculates the degree of similarity between the feature amounts of these customers. Here, various known methods used for object matching can be used for the method of extracting the feature amount of the object from the image and the method of calculating the similarity between the feature amounts. The method of calculating the degree of similarity between the first customer image and the second customer image is not limited to the method of using the feature amount. For the calculation of the first similarity, various known methods for calculating the similarity of the objects shown in the image can be used.

  In addition, for example, the settlement device 4000 displays a candidate for the first customer image (hereinafter, a candidate image) in which the same customer as the customer in the second customer image is displayed on a display device that can be viewed by the customer, and the candidate by the customer is displayed. The selection of the image may be accepted. In this case, the settlement device 4000 further includes a second display control unit 4040 and a second input reception unit 4060 (FIG. 10). The second display control unit 4040 displays the candidate image on the display device 20 that can be viewed by the customer. The second input receiving unit 4060 receives an input for selecting the candidate image displayed on the display screen. Then, the second input receiving unit 4060 acquires the settlement information associated with the selected candidate image.

<Details of Processing Performed by Second Display Control Unit 4040>
The second display control unit 4040 sets the first customer image in which the customer having a high similarity to the customer in the second customer image is shown as the candidate image. For example, the second display control unit 4040 sets the first customer image whose similarity to the customer shown in the second customer image is a predetermined value or more as the candidate image. Further, for example, the second display control unit 4040 sets the first customer image having a predetermined rank or higher when arranged in the ascending order of the above-mentioned degrees of similarity as a candidate image. The method by which the second display control unit 4040 calculates the degree of similarity is the same as the method by which the acquisition unit 4080 calculates the degree of similarity.

<Details of Processing Performed by Second Input Receiving Section 4060>
Second input receiving unit 4060 receives selection of candidate images. The method by which the second input receiving unit 4060 receives the selection of the candidate image is the same as the method by which the first input receiving unit 3060 receives the selection of the first customer image.

<Other functions>
The settlement device 4000 may further include a determination unit 4100. FIG. 11 is a block diagram illustrating a settlement device 4000 having a determination unit 4100. In a predetermined case, the determination unit 4100 determines that "there is no first customer image showing the same customer as the customer shown in the second customer image". In this predetermined case, for example, 1) an input indicating that there is no candidate image showing the customer who uses the settlement device 4000 is input to the second input reception unit 4060 (operation such as pressing the button 60 in FIG. 8). When it is performed, 2) when the second input receiving unit 4060 does not receive the operation of selecting the candidate image (when the customer does not select the candidate image), or 3) is displayed by the second display control unit 4040. This is the case when there is no candidate image to be used.

  When the determination unit 4100 determines that “there is no first customer image showing the same customer as the customer shown in the second customer image”, the settlement device 4000 performs various exceptional processes. For example, the second display control unit 4040 displays a message on the display device 20 to the effect that there is no settlement information regarding the product purchased by the customer. Further, for example, the settlement device 4000 may execute the series of processes shown in FIG. 4 again. Thereby, the degree of similarity and the like are calculated using the second customer image newly generated by imaging the customer. By doing this, the customer will be able to make payments more reliably.

[Embodiment 2]
FIG. 12 is a block diagram illustrating a settlement system 2000 according to the second embodiment. In FIG. 12, each block represents a functional unit, not a hardware unit.

  The settlement system 2000 according to the second embodiment has a function of performing a warning process when a customer who is leaving the area where the settlement device 4000 is installed has not finished the settlement process. Therefore, the settlement system 2000 of Embodiment 2 is configured as follows.

  The related information generated by the generation unit 3080 according to the second embodiment further indicates the completion flag. The completion flag indicates whether or not the settlement using the settlement information indicated by the related information has been completed. That is, the generation unit 3080 of the second embodiment generates the related information in which the first customer image, the settlement information, and the completion flag are associated with each other. Hereinafter, it is assumed that the value of the completion flag indicating that the settlement has been completed is “settlement completed” and the value of the completion flag indicating that the settlement has not been completed is “settlement incomplete”. FIG. 13 is a diagram exemplifying the association information 300 according to the second embodiment. The association information 300 further includes a completion flag 306 in addition to the first customer image 302 and the settlement information ID 304.

  The settlement system 2000 according to the second embodiment further includes a warning device 5000. The warning device 5000 has a third imaging unit 5020 and a warning unit 5040. The third image capturing unit 5020 captures an image and generates an image including a customer at an exit (hereinafter, also simply referred to as an “exit”) of an area where the settlement device 4000 is installed. Hereinafter, the image generated by the third imaging unit 5020 will be referred to as a third customer image.

  The warning unit 5040 performs a warning process when the first warning condition is satisfied. The first warning condition is that "the completion flag associated with the first customer image in which the same customer as the customer in the third customer image is shown indicates that the settlement is not completed".

<Process flow>
FIG. 14 is a flowchart illustrating the flow of processing executed by the warning device 5000 according to the second embodiment. The third imaging unit 5020 images the customer at the exit and generates a third customer image (S302). The warning unit 5040 determines whether or not the first warning condition is satisfied (S304). When the first warning condition is satisfied (S304: YES), the warning unit 5040 performs warning processing (S306). If the first warning condition is not satisfied (S304: NO), the process of FIG. 14 ends.

<Example of hardware configuration>
For example, the warning device 5000 is realized by a computer having the same hardware configuration as the computer that realizes the product registration device 3000 and the settlement device 4000. To the input / output interface of this computer, the hardware (for example, a camera) that constitutes the third imaging unit 5020 is connected. The third imaging unit 5020 is provided near the exit. For example, the third imaging unit 5020 is provided on the ceiling near this exit. In addition, for example, if the exit has a gate through which the customer passes, the third imaging unit 5020 may be provided at this gate. However, the third imaging unit 5020 only needs to be able to image the customer at the exit, and the installation location is not limited to the above example. In other respects, the third image pickup unit 5020 is mounted similarly to the first image pickup unit 3020 and the second image pickup unit 4020.

  The storage of the computer that realizes the warning device 5000 has a program module that realizes the warning unit 5040. The processor of the computer that realizes the warning device 5000 realizes the function of the warning unit 5040 by executing this program module.

<Details of Processing Performed by Third Imaging Unit 5020>
The process performed by the third imaging unit 5020 (FIG. 14: S302) is the same as the process performed by the first imaging unit 3020 and the second imaging unit 4020.

<Details of processing performed by warning unit 5040>
The warning unit 5040 determines whether or not the first warning condition is satisfied (FIG. 14: S304), and performs the warning process when the first customer image is satisfied (FIG. 14: S306). There are various warning processes performed by the warning unit 5040. For example, the warning unit 5040 outputs an alarm sound at a place where the customer imaged by the first imaging unit 3020, a store clerk, a security guard, or the like can be heard. For example, this place is near the exit, near the merchandise registration device 3000, or a security room. In this case, a speaker or the like for outputting the alarm sound is installed at a place for outputting the alarm sound.

  Further, for example, the warning unit 5040 displays a warning message at a place where the customer imaged by the third imaging unit 5020, a store clerk, a security guard, or the like can be seen. For example, a display device that can be viewed by the customer is provided near the exit. Then, the warning unit 5040 displays a warning message to the effect that the settlement has not been completed on this display device. Further, for example, the warning unit 5040 displays a warning message on the display device 10 of each product registration device 3000, the display device in the guard room, or the like.

  Further, when a gate is installed at the exit, the warning unit 5040 may perform a process of closing the gate when the first warning condition is satisfied. By doing so, the customer cannot get out of the exit, and it is possible to prevent the customer who has not made the payment from returning by mistake.

  In addition, when the member system is introduced in the store that operates the settlement system 2000, the warning unit 5040 may issue a warning using the member information. Specifically, it is assumed that the image of the member (such as a face photo) and the contact information of the member (such as an email address) are registered in advance as member information. When the first warning condition is satisfied, the warning unit 5040 accesses a database or the like in which member information is stored and searches for an image of a member who has the same customer as the customer shown in the third customer image. To do. Then, when there is such an image, the warning unit 5040 sends a warning message to the contact information of the customer indicated by the member information in which the image is shown. For example, the warning unit 5040 sends a mail including a warning message to the customer's mail address. By using the member information, it is possible to directly give a warning message to the customer. Therefore, even if the customer mistakenly forgets to pay the bill and exits the exit, it is possible to warn the customer so that another person does not know the fact. Therefore, the privacy of the customer can be protected.

<Specific example>
The operation of the settlement system 2000 of the second embodiment will be specifically illustrated. FIG. 15 is a diagram illustrating an operating environment of the settlement system 2000 according to the second embodiment. In FIG. 15, the settlement device 4000 is installed in the area 80. The exit 90 is an exit of the area 80. Gate 100 is the gate through which the customer passes when exiting exit 90. In FIG. 15, the third imaging unit 5020 is provided in this gate 100.

  Usually, the customer uses the product registration device 3000 and then uses the payment device 4000 to make a payment. When the settlement of the customer is completed, the settlement apparatus 4000 changes the value of the completion flag associated with the first customer image selected by the customer using the second input reception unit 4060 to “settlement completed”.

  When the customer passes through the gate 100, the third imaging unit 5020 images the customer and generates a third customer image. Then, the warning unit 5040 determines whether or not the completion flag associated with the first customer image in which the same customer as the customer in the third customer image is shown as “payment incomplete”. As described above, if the customer has completed the settlement, the completion flag indicates “settlement completed”. Therefore, the warning unit 5040 does not perform the warning process.

  On the other hand, if the customer has not performed the settlement, the completion flag associated with the first customer image in which the same customer as the customer in the third customer image is shown as “payment incomplete”. In this case, the warning unit 5040 performs warning processing. For example, the warning unit 5040 closes the gate 100 and displays a warning message on the display device provided in the gate 100.

<Action / effect>
The settlement system 2000 of this embodiment performs a warning process when the first warning condition is satisfied. Here, the satisfaction of the first warning condition means that the customer has tried to exit (or has exited) before paying for the purchased product. Therefore, according to the settlement system 2000 of the present embodiment, it is possible to prevent the customer from forgetting the settlement and returning, so that it is possible to prevent a trouble from occurring between the customer and the store. ..

[Third Embodiment]
The settlement system 2000 of the third embodiment is represented in FIG. 13 similarly to the settlement system 2000 of the second embodiment. Except for the points described below, the settlement system 2000 of the third embodiment is the same as the settlement system 2000 of the second embodiment.

  In the settlement system 2000 of the third embodiment, when there are a plurality of customer candidates who perform settlement based on the settlement information, when all the customers of the candidates try to exit before the settlement based on the settlement information is performed, Perform warning processing. Therefore, the settlement system 2000 of Embodiment 3 is configured as follows.

  The first input receiving unit 3060 of the third embodiment receives selection of a plurality of first customer images. The specific method by which the first input receiving unit 3060 receives the selection of the plurality of first customer images is as described in the first embodiment.

  The generation unit 3080 of the third embodiment generates the related information by associating the selected plurality of first customer images with the settlement information. As a result, the customer who performs the settlement based on the settlement information becomes the customer shown in any of the plurality of associated first customer images. In other words, it means that there are multiple candidates for customers who perform settlement based on the settlement information. The specific method of generating the related information by associating the plurality of first customer images with the adjustment information is also as described in the first embodiment.

  The warning unit 5040 according to the third embodiment performs a warning process when the second warning condition is satisfied in addition to the first warning condition. On the other hand, the warning unit 5040 does not perform the warning process when the second warning condition is not satisfied.

  The second warning condition is “for all the first customer images associated with the settlement information together with the first customer image showing the same customer as the third customer image, the third customer image showing the same customer is It has been generated ”. Here, the fact that the third customer image showing the same customer as the first customer image is generated means that the customer shown in the first customer image exits the area where the settlement device 4000 is installed. It means that it came out. Therefore, the second warning condition is that the customer currently exiting the exit among the candidates (each customer associated with the payment information) of the customers who will be paying for the product purchased by the customer currently exiting the exit. This means that all customers except for have already exited. Therefore, if the customer who is currently exiting the exit exits the exit, all the customers who are candidates for the payment exit the exit without performing the payment based on the payment information. Therefore, the warning unit 5040 of the third embodiment performs a warning process in such a case.

  On the other hand, when the second warning condition is not satisfied, it means that at least one of the candidates of customers who pays for the product purchased by the customer who is currently exiting has not exited the exit yet. .. In this case, if there is no problem if the customer who has not left the exit makes the settlement, the warning unit 5040 does not perform the warning process.

<Process flow>
FIG. 16 is a flowchart illustrating the flow of processing executed by the warning device 5000 according to the third embodiment. The flowchart of FIG. 16 is the same as the flowchart of FIG. 14 except that the branch of S402 is included.

  When the first warning condition is satisfied (S304: YES), the warning unit 5040 determines whether the second warning condition is satisfied (S402). When the second warning condition is satisfied (S402: YES), the warning unit 5040 performs warning processing (S306). If the second warning condition is not satisfied (S402: NO), the process of FIG. 16 ends.

<Example of hardware configuration>
The hardware configuration of the settlement system 2000 of the third embodiment is the same as the hardware configuration of the settlement system 2000 of the second embodiment. However, in the storage 1080 of the computer 1000 used to implement the warning device 5000, a program module for realizing the function of the warning unit 5040 of the third embodiment is stored.

<Details of Processing Performed by Third Imaging Unit 5020>
The third imaging unit 5020 of the third embodiment stores the generated third customer image in the storage unit inside or outside the warning device 5000. That is, in the warning device 5000 of the third embodiment, the history of the third customer image is stored.

<Details of processing performed by warning unit 5040>
The warning unit 5040 determines whether or not the second warning condition is satisfied (FIG. 16: S402). Specifically, the warning unit 5040 performs processing as follows.

  The warning unit 5040 acquires each first customer image other than the first customer image from the related information indicating the first customer image in which the same customer as the customer in the third customer image is shown. Then, for each acquired first customer image, the warning unit 5040 determines whether or not there is a third customer image in which the same customer as the customer in the first customer image is shown.

  The warning unit 5040 uses the third customer image stored in the storage unit by the third imaging unit 5020. Specifically, the warning unit 5040 compares the customer imaged in the acquired first customer image with the customer imaged in each of the third customer images stored in the storage unit to obtain the first customer image. A third customer image in which the same customer as the customer in one customer image is shown is searched.

  For example, the warning unit 5040 calculates the degree of similarity between the customer shown in the first customer image and the customer shown in the third customer image by the same process as the process performed by the second display control unit 4040. Then, when there is a third customer image whose similarity is equal to or higher than a predetermined threshold value, the warning unit 5040 determines that there is a third customer image in which the same customer as the customer in the first customer image is present. On the other hand, when there is no third customer image whose similarity is equal to or higher than the predetermined threshold value, the warning unit 5040 determines that there is no third customer image in which the same customer as the customer in the first customer image appears.

  The second warning condition is satisfied when, for all the acquired first customer images, there is a third customer image in which the same customer as the customer in the first customer image appears. In this case, the warning unit 5040 performs warning processing. On the other hand, if there is no third customer image showing the same customer as the customer shown in the first customer image in any one or more of the acquired first customer images, the second warning condition is not satisfied. In this case, the warning unit 5040 does not perform the warning process.

  The warning process performed by the warning unit 5040 according to the third embodiment is similar to the warning process performed by the warning unit 5040 according to the second embodiment.

<Action / effect>
The warning unit 5040 of the present embodiment, regarding the settlement information associated with the customer at the exit of the area where the settlement device 4000 is installed, determines whether each of the other customers associated with the settlement information has left the exit. It is determined (whether it is reflected in any of the third customer images generated by the third imaging unit 5020). Then, the warning unit 5040 performs a warning process when each of these customers is exiting. By doing so, when there are a plurality of candidate customers who perform settlement based on certain settlement information, a warning is issued only when all of the candidate customers exit the exit. On the other hand, if there is a customer who is still in the area among the candidates for the settlement processing based on the settlement information, no warning is given. Therefore, according to the settlement system 2000 of the present embodiment, it is possible to prevent the customer from forgetting the settlement and returning home, and to allow the customer to flexibly perform the settlement.

  Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than the above may be adopted.

Hereinafter, an example of the reference mode will be additionally described.
1. A payment system having a product registration device and a payment device,
The product registration device,
First imaging means for generating a first customer image including a customer;
First display control means for displaying the first customer image on a display device that can be viewed by the customer;
First input receiving means for receiving an input for selecting the first customer image of the customer who performs the settlement process;
And a generation unit that generates related information in which the selected first customer image and the payment information used for payment of the product are associated with each other,
The settlement device is
A second imaging means for generating a second customer image including the customer;
A settlement system comprising: a first customer image corresponding to the second customer image; and an acquisition unit that acquires the settlement information associated in the related information.
2. Second display control means for displaying a candidate image, which is a candidate for the first customer image showing the same customer as the customer shown in the second customer image, on a display device which can be viewed by the customer.
Second input receiving means for receiving an input for selecting a candidate image displayed on the display device,
The acquisition means acquires the settlement information associated with the selected candidate image in the related information. The payment system described in.
3. The first input receiving means receives selection of a plurality of first customer images,
The related information is generated by associating the selected plurality of first customer images with the settlement information to generate the related information. Or 2. The payment system described in.
4. The related information further associates with the settlement information a completion flag indicating whether or not the settlement using the settlement information is completed,
The settlement system is
Third imaging means for generating a third customer image including the customer at the exit of the area where the settlement device is installed;
When the completion flag associated with the first customer image in which the same customer as the customer in the third customer image is shown indicates that the settlement using the settlement information is not completed, 1. A warning device having warning means for performing warning processing; Through 3. The settlement system described in any one.
5. The first input receiving means receives selection of a plurality of first customer images,
The related information generates the related information by associating the selected plurality of first customer images with the settlement information.
The warning unit confirms that the completion flag associated with the first customer image showing the same customer as the customer shown in the third customer image has not been settled using the settlement information. In the case shown,
For all of the plurality of first customer images associated with the settlement information, if there is a third customer image showing the same customer as the customer shown in the first customer image, perform the warning process,
If, for any of the plurality of first customer images associated with the settlement information, there is no third customer image showing the same customer as the customer shown in the first customer image, the warning process is performed. Not 4. The payment system described in.
6. 1. Through 5. The product registration device described in any one of the items.
7. 1. Through 5. The settlement device described in any one of the above.
8. Connect the computer to 6. A program that operates as any one of the product registration devices.
9. Connect the computer to 7. A program that operates as any one of the settlement devices.
10. A payment method executed by a payment system having a product registration device and a payment device,
A first imaging step in which the product registration device generates a first customer image including a customer;
A first display control step in which the product registration device displays the first customer image on a display device that can be viewed by a customer;
A first input receiving step in which the product registration device receives an input for selecting a first customer image of a customer who performs settlement processing;
A generation step in which the product registration device generates related information in which the selected first customer image and the payment information used for payment of the product are associated with each other;
A second imaging step in which the settlement device generates a second customer image including a customer;
The settlement method, wherein the settlement device obtains the settlement information associated with the first customer image corresponding to the second customer image in the related information.
11. A second display control step in which the settlement device displays a candidate image, which is a candidate for the first customer image showing the same customer as the customer shown in the second customer image, on a display device that can be viewed by the customer; ,
A second input step in which the settlement device receives an input for selecting a candidate image displayed on the display device;
10. The acquisition step acquires the settlement information associated with the selected candidate image in the related information. The payment method described in.
12. The first input receiving step receives selection of a plurality of first customer images,
10. In the generating step, the related information is generated by associating the selected plurality of first customer images with the settlement information. Or 11. The payment system described in.
13. The related information further associates with the settlement information a completion flag indicating whether or not the settlement using the settlement information is completed,
The settlement system further includes a warning device,
A third imaging step in which the warning device generates a third customer image including a customer at an exit of the area where the settlement device is installed;
In the warning device, the completion flag associated with the first customer image showing the same customer as the customer shown in the third customer image indicates that the settlement using the settlement information is not completed. If so, the warning step of performing warning processing is included. Through 12. The settlement system described in any one.
14. The first input receiving step receives selection of a plurality of first customer images,
The related information generates the related information by associating the selected plurality of first customer images with the settlement information.
In the warning step, the completion flag associated with the first customer image in which the same customer as the customer in the third customer image is reflected indicates that the adjustment using the adjustment information is not completed. In the case shown,
For all of the plurality of first customer images associated with the settlement information, if there is a third customer image showing the same customer as the customer shown in the first customer image, perform the warning process,
If, for any of the plurality of first customer images associated with the settlement information, there is no third customer image showing the same customer as the customer shown in the first customer image, the warning process is performed. No, 13. The payment system described in.

10, 20 Display device 12, 22 Touch panel 30, 35 Camera 40 Reader 50 First customer image 60, 70 Button 80 Area 90 Exit 100 Gate 200 Settlement information 202 Settlement information ID
204 Product list 206 Product ID
300 association information 302 first customer image 304 settlement information ID
306 Completion flag 1000, 6000 Computer 1020, 6020 Bus 1040, 6040 Processor 1060, 6060 Memory 1080, 6080 Storage 1100, 6100 I / O interface 1120, 6120 Network interface 2000 Settlement system 3000 Product registration device 3020 First imaging unit 3040 First display Control unit 3060 First input reception unit 3080 Generation unit 4000 Settlement device 4020 Second imaging unit 4040 Second display control unit 4060 Second input reception unit 4080 Acquisition unit 4100 Determination unit 5000 Warning device 5020 Third imaging unit 5040 Warning unit 6000 Computer

Claims (4)

A payment system in which a product registration device and a payment device are installed separately,
Having the product registration device, the settlement device, and a warning device,
The product registration device,
A settlement information generating unit that generates settlement information regarding settlement processing of the product based on registration of the product;
Control means for associating the customer image obtained by imaging the customer in the vicinity of the commodity registration device with the settlement information,
The settlement device has a settlement means for performing a settlement process based on the settlement information,
The product registration device,
Display means for displaying the customer image,
An input receiving unit that receives an input for selecting a customer who performs a settlement process from the customer image in the settlement unit;
The warning device, if the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed, has a warning means for performing a warning process,
The input reception means receives selection of a plurality of the customer images,
The control means associates the selected plurality of customer images with the settlement information,
In the case where the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed,
If all of the plurality of customer images associated with the settlement information correspond to a customer in the vicinity of the exit or a customer in the vicinity of the exit, perform the warning process,
A settlement system that does not perform the warning process if any of the plurality of customer images associated with the settlement information does not correspond to a customer near the exit or a customer near the exit.   The settlement system according to claim 1, wherein the settlement means performs a settlement process based on settlement information associated with a customer image corresponding to a second customer image obtained by capturing an image of a customer in the vicinity of the settlement device. The outlet and the vicinity is a vicinity of the outlet area of the settlement apparatus is installed, settlement system according to claim 1 or 2. A payment method executed by a payment system in which a product registration device and a payment device are installed separately,
The settlement system includes the product registration device, the settlement device, and a warning device,
A settlement information generation step of the settlement information generation means of the commodity registration device , which generates settlement information regarding settlement processing of the commodity based on registration of the commodity;
A control step in which the control means of the product registration device associates the customer image obtained by imaging the customer in the vicinity of the product registration device with the settlement information;
A settlement step in which the settlement means of the settlement device performs a settlement process based on the settlement information;
A display step of the display means of the product registration device for displaying the customer image;
An input receiving step of the input registration means of the product registration device, which receives an input for selecting a customer who performs a settlement process in the settlement means from the customer image;
The warning means of the warning device , if the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed, a warning step of performing a warning process, and
The input receiving means receives a selection of the plurality of customer images in the input receiving step,
In the control step, the control means associates the selected plurality of customer images with the settlement information,
In the case where, in the warning step, the settlement process of the settlement information associated with the customer image corresponding to the customer in the vicinity of the exit is not completed in the warning step,
If all of the plurality of customer images associated with the settlement information correspond to a customer in the vicinity of the exit or a customer in the vicinity of the exit, perform the warning process,
A settlement method, wherein if any one of the plurality of customer images associated with the settlement information does not correspond to a customer near the exit or a customer near the exit, the warning process is not performed.

Images