JP2018160107A - Settlement processor, method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a settlement processor, a method and a program capable of preventing an accidental settlement of a commodity which is acquired by an unregistered customer by a registered customer in a shop where is mixed with registered customers and unregistered customers.SOLUTION: Disclosed settlement processor 100 in an embodiment includes: a determination part 150 configured to determine whether a customer who has acquired a commodity in a shop is a registered customer or an unregistered customer, and a notification part 190 configured so as, when a customer who has acquired the commodity is an unregistered customer and when the commodity is put in a bag owned by the registered customer by the registered customer, to make a notification to a portable terminal owned by the registered customer owing the bag.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an apparatus, a method, and a program for performing settlement of a product acquired by a customer.

  Conventionally, a customer takes a commodity to be purchased from a shelf and then moves to a POS (Point Of Sales) terminal (also referred to as a register), and a store clerk reads the commodity into the POS terminal and performs settlement. In addition, there is a case where a customer wants a POS terminal to read a product that the customer wants to purchase. In any case, it is common that the step of acquiring the product from the shelf and the step of causing the POS terminal to read the product are independent.

  When a customer purchases a plurality of products, it takes a long time for the clerk to read all the products into the POS terminal. For this reason, payment at a POS terminal often becomes a bottleneck at a store. Having a sufficient number of shop assistants and POS terminals to reduce customer waiting time requires a lot of space to place shop assistants and POS terminals, and also to hire shop assistants and introduce POS terminals. Big cost.

  As a technique for improving the settlement of merchandise, Patent Document 1 specifies a customer by a registration card that transmits an individual frequency, and when the customer pulls out the merchandise from the shelf, sales data of the merchandise is stored in the registration card. The technology to be registered in is described. By having the customer's registration card read into the POS terminal, the store clerk can settle all the products acquired by the customer without having to read each product into the POS terminal.

JP-A-8-190672

  However, in the technique described in Patent Document 1, since it is assumed that the customer identified by the registration card (that is, the registered customer) takes the product from the shelf, the handling of the unregistered customer is not considered. . Therefore, when a registered customer and an unregistered customer coexist, when an unregistered customer takes a product from the shelf, the registered customer near the product makes an unintended settlement. there is a possibility.

  The present invention has been made in view of the above-described problem, and in a store where a registered customer and an unregistered customer are mixed, a registered customer is a product acquired by an unregistered customer. A payment processing apparatus, method, and program capable of suppressing unintentional payments are provided.

  A first aspect of the present invention is a payment processing apparatus, wherein a determination unit that determines whether a customer who has acquired a product at a store is a registered customer or an unregistered customer, and the product is acquired. The registered customer who owns the bag has when the customer is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A notification unit that notifies the mobile terminal.

  A second aspect of the present invention is a payment processing apparatus, wherein a determination unit for determining whether a customer who has acquired a product at a store is a registered customer or an unregistered customer, and the product is acquired. When the customer is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer, to the registered customer who owns the bag And a settlement unit that settles the product.

  A third aspect of the present invention is a payment processing method, the step of determining whether a customer who has acquired a product at a store is a registered customer or an unregistered customer, and the customer who has acquired the product The registered customer who owns the bag when the product is put into a bag owned by the registered customer by the unregistered customer And notifying the terminal.

  According to a fourth aspect of the present invention, there is provided a payment processing program for determining whether a customer who has acquired a product at a store is a registered customer or an unregistered customer in a computer; The registered customer who owns the bag when the acquired customer is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer And a step of notifying the portable terminal of the device.

  ADVANTAGE OF THE INVENTION According to this invention, it can suppress that the registered customer unintentionally settles the goods acquired by the customer who is not registered.

It is a mimetic diagram of a settlement processing system concerning a 1st embodiment. It is a block diagram of the settlement processing device concerning a 1st embodiment. It is a schematic diagram of the settlement processing method according to the first embodiment. It is a schematic diagram of the settlement processing method according to the first embodiment. It is a schematic diagram of the settlement processing method according to the first embodiment. It is a schematic diagram of the settlement processing method according to the first embodiment. It is a schematic diagram of the notification screen displayed on the portable terminal which concerns on 1st Embodiment. It is a schematic block diagram which shows the example apparatus structure of the payment processing apparatus which concerns on 1st Embodiment. It is a figure which shows the flowchart of the payment processing method which concerns on 1st Embodiment. It is a figure which shows the flowchart of the payment processing method which concerns on 1st Embodiment. It is a block diagram of the payment processing apparatus which concerns on 2nd Embodiment. It is a schematic diagram of the payment processing method (especially customer registration process) which concerns on 2nd Embodiment. It is a schematic block diagram of the payment processing apparatus which concerns on each embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the embodiments. In the drawings described below, components having the same function are denoted by the same reference numerals, and repeated description thereof may be omitted.

(First embodiment)
FIG. 1 is a schematic diagram of a payment processing system 1 according to the present embodiment. The payment processing system 1 is possessed by a payment processing apparatus 100 that performs payment processing, a camera 10 that acquires images of at least one of customers and products, a reader 20 that reads customer identification information, and at least one of customers and salespeople. Mobile terminal 30. The payment processing apparatus 100, the camera 10, the reader 20, and the portable terminal 30 are connected by at least one of a wired connection and a wireless connection via an arbitrary network 40 such as a local area network or the Internet. The payment processing system 1 may include a conventional POS terminal that reads a product and performs payment, or may include other devices such as a server and a terminal.

  The camera 10 is an imaging device that is provided at a plurality of locations in a store and images at least one of a customer and a product. The camera 10 includes an image sensor such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The camera 10 transmits the captured content to the settlement processing apparatus 100 as image data. The camera 10 may be directly connected to the payment processing apparatus 100 or may be connected via the network 40.

  The reader 20 is a reading device that is provided at a gate installed at an entrance of a store and reads identification information that identifies a customer from a card or the like that the customer has. The reader 20 may include, for example, an image sensor such as a CCD sensor or a CMOS sensor that reads identification information represented by a code such as a one-dimensional code or a two-dimensional code written on a card held by the customer. A magnetic sensor that reads identification information indicated by the included magnetism may be included, or a short-range wireless communication device that reads identification information by near-field wireless communication such as NFC (Near Field Communication) from an antenna included in a card held by a customer May be included. Further, the reader 20 may read the identification information by reading a code displayed on the mobile terminal 30 held by the customer instead of the card, or by receiving short-range wireless communication from the mobile terminal 30. The reader 20 transmits the read identification information to the payment processing apparatus 100 as data. The reader 20 may be directly connected to the payment processing apparatus 100 or may be connected via the network 40.

  The portable terminal 30 is a portable terminal that displays information received from the payment processing apparatus 100 and transmits information input by a customer or a store clerk to the payment processing apparatus 100. The portable terminal 30 includes a display device that displays information to a customer or a store clerk, and an input device that receives an input from the customer or the store clerk. For example, a liquid crystal display or an organic EL (Electroluminescence, OLED) display configured as a touch panel in the mobile terminal 30 functions as both a display device and an input device. The portable terminal 30 is configured to be able to communicate with the payment processing apparatus 100 via the network 40 by wired communication or wireless communication.

  The settlement processing apparatus 100 identifies the customer and the product included in the image acquired by the camera 10, detects that the customer has taken the product he / she wants to purchase from the shelf, and settles the product for the customer. Moreover, the payment processing apparatus 100 sends a predetermined notification to the customer or the store clerk by transmitting information to the mobile terminal 30. The payment processing apparatus 100 is connected to the network 40 by wired communication or wireless communication, and is configured by a single computer or a cloud that is a collection of computer resources.

  The payment processing system 1 according to the present embodiment can be applied to a store in which a customer for which payment information is registered and a customer who is not registered are mixed. In such a store, for a product acquired by a registered customer, the registered customer can be settled without going through the POS terminal. On the other hand, with respect to products acquired by unregistered customers, products are transferred from unregistered customers to other registered customers (family, friends, etc.), and a POS terminal is connected to the other registered customers. Settlement without intervention. In this case, a registered customer may unintentionally settle a product acquired by a non-registered customer. The settlement processing apparatus 100 according to the present embodiment solves such a problem and enables settlement without using a POS terminal.

  FIG. 2 is a block diagram of the payment processing apparatus 100 according to the present embodiment. In FIG. 2, arrows indicate main data flows, and there may be data flows other than those shown in FIG. In FIG. 2, each block represents a functional unit configuration, not a hardware (device) unit configuration. Therefore, the blocks shown in FIG. 2 may be implemented in a single device, or may be separately implemented in a plurality of devices. Data exchange between the blocks may be performed via any means such as a data bus, a network, a portable storage medium, or the like.

  The settlement processing apparatus 100 includes an identification information reading unit 110, a registrant determination unit 120, and a companion association unit 130 for customer registration processing. In addition, the payment processing apparatus 100 performs a payment process for the product acquisition detection unit 140, the product acquirer determination unit 150, the person payment unit 160, the product tracking unit 170, the payment person determination unit 180, the notification unit 190, and other party payments. Part 200 is provided. Moreover, the payment processing apparatus 100 includes a registrant storage unit 210 and a companion storage unit 220 as storage units. Below, the detailed function of each part is demonstrated in order using FIGS.

  FIG. 3 is a schematic diagram of a settlement processing method (particularly customer registration processing) according to the present embodiment. Functions of the identification information reading unit 110, the registrant determination unit 120, and the companion association unit 130 will be described with reference to FIG. A gate 21 is installed at the entrance of the store, and a reader 20 is provided on the gate 21. In addition, the camera 10 is provided in the vicinity of the gate 21 at a position where the region including the customer's face passing through the gate 21 can be imaged. When the customer who is the registrant A enters the store through the gate 21, the customer 20 provides the reader 20 with the card 22 (or the portable terminal 30) and reads it to provide his / her identification information. The customer who is accompanying person B who accompanies registrant A passes through gate 21 following registrant A.

  In the registrant storage unit 210, customer information including customer payment information (credit card number, bank account number, etc.) and mobile terminal 30 information (phone number, email address, etc.) is associated with customer identification information. Registered in advance. The identification information is, for example, a unique customer ID for identifying the customer. Here, a customer already registered in the registrant storage unit 210 is referred to as a registrant A. Registration of customer information in the registrant storage unit 210 is performed by an arbitrary method. Registration of customer information in the registrant storage unit 210 may be performed by the customer himself / herself or may be performed by a store clerk according to a registration form or the like written by the customer.

  The identification information reading unit 110 receives the customer identification information read from the customer card 22 or the portable terminal 30 by the reader 20 at the gate 21 and inputs it to the settlement processing apparatus 100.

  The registrant determination unit 120 determines whether or not the customer who provided the identification information is registered in the registrant storage unit 210. Specifically, the registrant determination unit 120 determines whether customer information associated with the identification information (for example, customer ID) input by the identification information reading unit 110 is registered in the registrant storage unit 210. .

  Next, when the customer is registered in the registrant storage unit 210, the registrant determination unit 120 determines that the customer is the registrant A, and associates the customer with the identification information of the customer from the registrant storage unit 210. Get customer information. In the payment processing described later, when the registrant A acquires a product that the registrant A wants to purchase from the shelf, the payment processing apparatus 100 uses the customer information (payment information) of the registrant A to pay the product. As a result, the payment processing apparatus 100 can make a payment for the product that the registrant A wants to purchase without going through the conventional POS terminal.

  Also, the registrant determination unit 120 acquires registrant A's image data from the camera 10, acquires registrant A's feature information A 1 from the image data, and records it in the registrant storage unit 210. At this time, the registrant determination unit 120 associates the registrant A's feature information A1 with the customer information of the registrant A in the registrant storage unit 210. As the registrant A's feature information A1, any feature information A1 capable of recognizing the registrant A can be used in the payment processing described later. For example, the registrant A's feature information A1 may be image data of an area including the registrant A's face itself, or may be a feature amount calculated from image data of an area including the registrant's face. In FIG. 3, the registrant A's feature information A1 is schematically shown as a dashed frame. When the feature information A1 of the registrant A is already recorded in the registrant storage unit 210, the feature information A1 recorded in the registrant storage unit 210 is used as it is without newly acquiring the feature information A1. Also good. In other words, the feature information A1 acquired in the past may be used as the feature information A1 of the registrant A, or the feature information A1 acquired when entering the store may be used. Since the feature information A1 acquired when entering the store represents the latest hairstyle and clothes of the registrant A, the registrant A can be determined with high accuracy based on the image data in the store. preferable.

  In addition, the registrant determination unit 120 outputs a message prompting registration from a display or a speaker (not shown) when the customer who provided the identification information is not registered in the registrant storage unit 210. The subsequent processing is based on the premise that the customer who provided the identification information is the registrant A.

  In this embodiment, the registrant determination unit 120 determines the registrant A based on the identification information read by the reader 20. However, the registrant determination unit 120 uses the image data of the customer passing through the gate 21 from the camera 10 without using the reader 20. The registrant A may be determined based on this. Specifically, the registrant determination unit 120 acquires feature information of the customer who passes through the gate 21 from the image data, and compares the acquired feature information with the feature information A1 recorded in the registrant storage unit 210. , It is determined which registrant A is the customer who passes through the gate 21. In this case, the registrant A's feature information A1 needs to be recorded in the registrant storage unit 210 in advance.

  When a customer (for example, a family member, friend, etc.) who is not registered in the registrant storage unit 210 enters the store together with the registrant A, the companion association unit 130 associates the customer with the registrant A. The person B is recorded in the accompanying person storage unit 220. Specifically, the accompanying person associating unit 130 determines that the customer who does not provide the identification information passing through the registrant A through the gate 21 is the accompanying person B accompanying the registrant A. Then, the companion association unit 130 acquires the image data of the companion B from the camera 10, acquires the characteristic information B 1 of the companion B from the image data, and records it in the companion storage unit 220. At this time, the companion association unit 130 associates the feature information B1 of the companion B accompanying the registrant A with the customer information of the registrant A in the registrant storage unit 210. The definition of the feature information B1 of the companion B is the same as the feature information A1 of the registrant A. In FIG. 3, the characteristic information B1 of the accompanying person B is schematically shown as a broken-line frame.

  In the payment process described later, when the companion person B obtains a product he wants to purchase from the shelf, the payment processing apparatus 100 uses the customer information (payment information) of the registrant A associated with the companion person B to Settlement. As a result, in the payment processing apparatus 100, the registrant A can make payment for the product that the accompanying person B wants to purchase instead.

  A customer who does not correspond to either registrant A or companion B in the store is referred to as non-registrant C. For products that the non-registrant C wants to purchase, settlement is performed using a conventional POS terminal provided in the store.

  FIG. 4 is a schematic diagram of a settlement processing method (particularly principal settlement processing) according to the present embodiment. The functions of the product acquisition detection unit 140, the product acquirer determination unit 150, and the principal settlement unit 160 will be described with reference to FIG. FIG. 4 shows a state where the non-registrant C has acquired the product E. The same applies when the registrant A or companion B acquires the product E.

  A shelf D is installed in the store, and one or more products E are arranged on the shelf D. In addition, in the vicinity of the shelf D, the camera 10 is provided at a position where an area including the face of the customer (registrant A, companion B, or non-registrant C) and the product E can be imaged. In the store, an arrangement and the number of cameras 10 capable of capturing images of customers and products E existing in any place are provided.

  First, the product acquisition detection unit 140 acquires image data of an area including the product E from the camera 10 and acquires feature information E1 of the product E from the image data. Then, the product acquisition detection unit 140 detects that the product E is extracted from the shelf D using the feature information E1 of the product E. The detection that the product E is taken out from the shelf D is detected from, for example, a position where the feature information E1 of the product E is out of the region corresponding to the shelf D (or from a position in contact) between a plurality of continuous image data in time series. This is done by detecting the movement). The area corresponding to the shelf D in the image data may be recorded in advance as coordinates in the image data, or may be determined by recognizing the shelf D from the image data.

  Next, the product acquisition detection unit 140 acquires image data of an area including the face of the customer (that is, the product acquirer) who has extracted the product E from the camera 10. The customer who has taken out the product E is, for example, the customer closest to the taken out product E. The product acquisition detection unit 140 may acquire image data of an area including the customer's hand from the camera 10 and specify the customer who has taken out the product E based on the position and movement of the hand. The product acquisition detection unit 140 acquires customer feature information from the image data. The product acquisition detection unit 140 associates the feature information of the product acquirer with the extracted feature information E1 of the product E. In FIG. 4, the feature information C1 of the non-registrant C and the feature information E1 of the product E are schematically shown as a dashed frame.

  The product acquirer determining unit 150 compares the feature information of the product acquirer with the feature information A1 recorded in the registrant storage unit 210 and the feature information B1 recorded in the companion storage unit 220, thereby obtaining the product acquirer. It is determined which registrant A and companion B are, and a product acquirer who does not correspond to any registrant A or companion B is determined to be a non-registrant C. In order to determine a customer based on the feature information A1 and B1 of the registrant A and the accompanying person B, a known image recognition technique can be used. When it is determined that the product acquirer is the registrant A, the product acquirer determination unit 150 acquires the customer information (settlement information) of the registrant A from the registrant storage unit 210. When it is determined that the product acquirer is a companion B or a non-registered person C, other person settlement processing described later with reference to FIGS.

  When the product acquirer determination unit 150 determines that the product acquirer is the registrant A, the principal settlement unit 160 extracts the payment information from the customer information of the registrant A acquired by the product acquirer determination unit 150. Then, the product E is settled according to the settlement information (for example, charging to a registered credit card or bank account). At the time of payment, the principal settlement unit 160 acquires product information including the price, product name, etc. of the product E based on the feature information E1 of the product E from the payment processing apparatus 100 or an external server. In order to acquire the product information from the feature information E1 of the product E, a known image recognition technique can be used.

  The settlement may be performed every time one commodity E is acquired. In this case, when the product E is returned to the shelf D after a certain product E is settled, the principal settlement unit 160 cancels the settlement. Alternatively, the settlement may be performed collectively for one or more products E at a predetermined timing (for example, when the registrant A leaves the store). In this case, the principal settlement unit 160 temporarily records the product E acquired by the customer as a virtual purchase list in the settlement processing apparatus 100, and the product E is stored in the shelf D before the product E is settled. When it is returned to, the product E is removed from the purchase list. Then, the principal settlement unit 160 performs settlement of the product E included in the purchase list at a predetermined timing.

  5 to 6 are schematic diagrams of the settlement processing method (particularly, other party settlement processing) according to the present embodiment. Functions of the product tracking unit 170, the settlement unit determination unit 180, the notification unit 190, and the other party settlement unit 200 will be described with reference to FIGS. The product tracking process is performed when the product acquirer determination unit 150 determines that the product acquirer is the accompanying person B or the non-registered person C. FIG. 5 shows a state where the non-registrant C is moving in the store. FIG. 6 shows a state where the non-registrant C is about to put the product E in the bag F of the registrant A who is another customer. The customer's bag F may be a bag brought by the customer himself or a bag (shopping basket) prepared in advance in the store.

  In particular, as shown in FIG. 5, the product tracking unit 170 uses the image data in the store acquired from the camera 10 (broken line in FIG. 5) to store the product E held by the companion B or the non-registrant C. Chase. The tracking of the product E includes, for example, the feature information B1 or C1 of the companion B or the non-registered person C and the feature information E1 of the product E from the image data acquired in time series from the plurality of cameras 10 arranged in the store. This is performed by specifying the positions of the companion B, the non-registrant C, and the product E in time series based on the position of the camera 10 that has acquired and captured the image data including the feature information B1, C1, and E1.

  The merchandise tracking unit 170 tracks the merchandise E by (a) placing the merchandise E in one of the customer's bags F, (b) delivering the merchandise E to another customer, and (c) placing the merchandise E on the shelf. The process ends when either of the following conditions is satisfied: (d) the product E is settled at the conventional POS terminal. When the product E cannot be tracked due to other events, the product tracking unit 170 may make a notification including a predetermined message to the mobile terminal 30 of the store clerk.

  When the product E is returned to the shelf (c) or when the product E is settled at the conventional POS terminal (d), the product tracking unit 170 ends the tracking of the product E. The detection that the product E is returned to the shelf is detected, for example, from a position where the feature information E1 of the product E is from outside the region corresponding to the shelf D (or not in contact) between a plurality of continuous image data in time series. This is done by detecting the movement). The detection of the settlement of the product E at the conventional POS terminal is performed by detecting, for example, that the feature information E1 of the product E passes through an area corresponding to the POS terminal between a plurality of image data continuous in time series. Is done by.

  When the product E is delivered to another customer (b), the product tracking unit 170 ends the tracking of the product E, and the product acquisition detection unit 140, the product acquirer determination unit 150, and the principal settlement unit 160 It is assumed that the customer has acquired the product, and the product acquisition detection process shown in FIG. 4 is executed again. The detection that the product E is delivered to another customer is, for example, when the feature information E1 of the product E is near the companion B or the non-registrant C among a plurality of continuous image data in time series. This is done by detecting moving near.

  When the product E is put in any customer's bag F (a), the product tracking unit 170 ends the tracking of the product E. In particular, as shown in FIG. 6, the detection that the product E is put in the customer's bag F is, for example, an area in which the feature information E1 of the product E corresponds to the bag F between a plurality of image data continuous in time series. This is done by detecting movement from outside to inside (or from a non-contact position to a contact position).

  Next, the settlement person determination unit 180 determines the registrant A (settlement person) who makes a settlement from the bag F in which the product E is put. In the present embodiment, the settlement operator determination unit 180 regards the customer closest to the bag F containing the product E as the customer who is the owner of the bag F. The settlement person determination unit 180 acquires image data of an area including the face of the customer who is the owner of the bag F from the camera 10 and acquires customer characteristic information from the image data. The settler determination unit 180 compares the feature information of the bag owner with the feature information A1 recorded in the registrant storage unit 210 and the feature information B1 recorded in the companion storage unit 220, so that the bag owner can It is determined which registrant A and accompanying person B, and the bag owner who does not correspond to any registrant A and accompanying person B is determined to be non-registered person C. After the payment owner determination unit 180 determines the bag owner, the notification unit 190 performs a predetermined notification to the registrant A or the mobile terminal 30 of the store clerk. The notification is displayed on the mobile terminal 30 using, for example, an email or an application executed by the mobile terminal 30.

  7A and 7B are schematic diagrams of notification screens displayed on the mobile terminal 30 according to the present embodiment. When the product acquirer is a non-registrant C, or when the product acquirer is a companion B and the owner of the bag F is not the registrant A associated with the companion B, the notification unit 190 Information on the mobile terminal 30 of the clerk recorded in advance in the payment processing apparatus 100 is acquired, and the notification shown in FIG. The notification screen of FIG. 7A is an image including a message 31 indicating that payment for the product E acquired by the companion B or the non-registrant C is not correctly performed, and the face of the companion B or the non-registrant C. 32 and the image 33 of the product E are included. Thereby, the store clerk can know that the settlement of the product E acquired by the companion B or the non-registrant C is not correctly performed, for example, the companion B or the so that the settlement of the product E is performed at the POS terminal. Unregistered person C can be guided.

  When the merchandise acquirer is the companion B and the owner of the bag F is the registrant A associated with the companion B, the settler determination unit 180 determines the customer information (payment information) of the registrant A. And information on the portable terminal 30) from the registrant storage unit 210. Thereafter, the notification unit 190 extracts the information of the mobile terminal 30 from the customer information of the registrant A acquired by the settlement person determination unit 180, and makes a notification shown in FIG. 7B to the mobile terminal 30 of the registrant A. . The notification screen of FIG. 7B shows a message 34 asking whether to permit settlement of the product E acquired by the companion B, an image 35 including the face of the companion B, an image 36 of the product E, and a button permitting settlement. 37 and a button 38 for rejecting the settlement. As a result, the registrant A can select whether or not to pay for the product E acquired by the companion B.

  The other person settlement unit 200 receives from the registrant A the selection of permission or denial of settlement on the notification screen of FIG. In the notification screen of FIG. 7B, when the registrant A selects the permission of settlement, that is, when the registrant A approves the settlement, the other party settlement unit 200 is acquired by the settlement unit determination unit 180. The settlement information is extracted from the customer information of the registrant A, and the product E is settled according to the settlement information (for example, charging to a registered credit card or bank account). At the time of settlement, the third party settlement unit 200 acquires product information including the price, product name, etc. of the product E based on the feature information E1 of the product E from the settlement processing device 100 or an external server. In order to acquire the product information from the feature information E1 of the product E, a known image recognition technique can be used.

  The settlement may be performed every time one commodity E is acquired. In this case, when the product E is returned to the shelf D after a certain product E is settled, the other party settlement unit 200 cancels the settlement. Alternatively, the settlement may be performed collectively for one or more products E at a predetermined timing (for example, when the registrant A leaves the store). In this case, the third party settlement unit 200 temporarily records the product E approved by the registrant as a virtual purchase list in the settlement processing apparatus 100, and before the product E is settled, the product E Is returned to the shelf D, the product E is removed from the purchase list. Then, the other person settlement unit 200 performs settlement of the product E included in the purchase list at a predetermined timing.

  When refusal of settlement is selected by the registrant A on the notification screen, the other party settlement unit 200 does not perform settlement. At this time, the notification unit 190 makes the notification shown in FIG. 7A to the clerk's mobile terminal 30 and the clerk cannot correctly settle the product E acquired by the companion B or the non-registrant C. You may let me know.

  In this embodiment, when the non-registrant C puts the product E in the bag F of the registrant A, the notification unit 190 performs the notification shown in FIG. The notification shown in FIG. 7B may be made to the mobile terminal 30 of A. In this case, the other person settlement unit 200 displays the image including the face of the non-registrant C as in the case where the companion B puts the product E into the bag F of the registrant A (b) in FIG. In this notification screen, accepting or not accepting settlement is selected from the registrant A, and settlement is performed according to the selection.

  In this embodiment, the registrant A approves the settlement of the product E acquired by the companion B or the non-registrant C, but the notification unit 190 sends the notification shown in FIG. And the store clerk may approve the settlement. In this case, the third party settlement unit 200 accepts the selection of permission or denial of settlement from the store clerk on the notification screen of FIG. 7B, and performs settlement according to the selection.

  FIG. 8 is a schematic configuration diagram illustrating an exemplary device configuration of the payment processing apparatus 100 according to the present embodiment. The payment processing apparatus 100 includes a CPU (Central Processing Unit) 101, a memory 102, a storage device 103, and an interface 104. The payment processing apparatus 100 may be an independent apparatus or may be configured integrally with another apparatus.

  The interface 104 is a communication unit that transmits and receives data, and is configured to be able to execute at least one communication method of wired communication and wireless communication. The interface 104 includes a processor, an electric circuit, an antenna, a connection terminal, and the like necessary for the communication method. The interface 104 performs communication using the communication method in accordance with a signal from the CPU 101. The interface 104 communicates with, for example, the camera 10, the reader 20, and the portable terminal 30.

  The storage device 103 stores a program executed by the payment processing apparatus 100, data of a processing result by the program, and the like. The storage device 103 includes a read-only ROM (Read Only Memory), a readable / writable hard disk drive, a flash memory, or the like. The storage device 103 may include a computer-readable portable storage medium such as a CD-ROM.

  The memory 102 includes a RAM (Random Access Memory) that temporarily stores data being processed by the CPU 101, a program read from the storage device 103, and data.

  The CPU 101 temporarily records temporary data used for processing in the memory 102, reads a program recorded in the storage device 103, and performs various calculations, control, discrimination, etc. on the temporary data according to the program It is a processor which performs the processing operation of. Further, the CPU 101 records the processing result data in the storage device 103 and transmits the processing result data to the outside via the interface 104.

  In the present embodiment, the CPU 101 executes the program recorded in the storage device 103 to thereby execute the identification information reading unit 110, the registrant determination unit 120, the companion association unit 130, the product acquisition detection unit 140, the product acquisition in FIG. Functions as a person determination unit 150, a principal settlement unit 160, a product tracking unit 170, a settlement person determination unit 180, a notification unit 190, and a third party settlement unit 200. The memory 102 or the storage device 103 functions as the registrant storage unit 210 and the accompanying person storage unit 220 in FIG.

  The payment processing apparatus 100 is not limited to the specific configuration shown in FIG. The payment processing apparatus 100 is not limited to one apparatus, and may be configured by connecting two or more physically separated apparatuses by wire or wireless. Each unit included in the payment processing apparatus 100 may be realized by an electric circuit configuration. Here, the electric circuit configuration is a term that conceptually includes a single device, a plurality of devices, a chipset, or a cloud.

  In addition, at least a part of the payment processing apparatus 100 may be provided in SaaS (Software as a Service) format. That is, at least a part of the functions for realizing the payment processing apparatus 100 may be executed by software executed via a network.

  9 and 10 are flowcharts of the settlement processing method according to the present embodiment. The flowchart of FIG. 9 shows customer registration processing in the payment processing method according to the present embodiment. The flowchart in FIG. 9 is started, for example, when the customer holds the card 22 (or the portable terminal 30) indicating the identification information over the reader 20.

  First, the identification information reading unit 110 receives customer identification information read from the customer card 22 or the portable terminal 30 by the reader 20 at the gate 21 and inputs the customer identification information to the payment processing apparatus 100 (step S101).

  The registrant determination unit 120 determines which registrant A recorded in the registrant storage unit 210 is the customer who provided the identification information input in step S101 (step S102). Also, the registrant determination unit 120 acquires the image data of the registrant A who provided the identification information in step S101 from the camera 10, acquires the feature information A1 of the registrant A from the image data, and stores the registrant storage unit. 210 is recorded (step S103). At this time, the registrant determination unit 120 associates the registrant A's feature information A1 with the customer information of the registrant A in the registrant storage unit 210. When the feature information A1 of the registrant A is already recorded in the registrant storage unit 210, step S103 may be omitted.

  When another customer who does not provide the identification information passes through the gate 21 following the registrant A who provided the identification information in step S101 (YES in step S104), the companion association unit 130 identifies the customer as the registrant A. It is determined that the accompanying person B. The accompanying person associating unit 130 acquires the image data of the accompanying person B from the camera 10, acquires the characteristic information B1 of the accompanying person B from the image data, and records it in the accompanying person storage unit 220 (step S105). At this time, the companion association unit 130 associates the feature information B1 of the companion B accompanying the registrant A with the customer information of the registrant A in the registrant storage unit 210. When there is no accompanying person B following the registrant A (NO in step S104), the characteristic information B1 of the accompanying person B is not recorded.

  The flowchart of FIG. 10 shows a payment process in the payment processing method according to the present embodiment. The flowchart of FIG. 10 is started when the customer takes out the product E from the shelf D, for example.

  First, the product acquisition detection unit 140 acquires image data of an area including the extracted product E from the camera 10, and acquires feature information E1 of the product E extracted using the image data (step S201). . Next, the product acquisition detection unit 140 acquires image data of an area including the face of the customer (product acquirer) who has extracted the product E from the camera 10, and acquires the feature information of the product acquirer using the image data. (Step S202). At this time, the product acquisition detection unit 140 associates the feature information of the product acquirer with the extracted feature information E1 of the product E.

  Next, the product acquirer determination unit 150 uses the feature information of the product acquirer acquired in step S202 as the feature information A1 recorded in the registrant storage unit 210 and the feature information B1 recorded in the companion storage unit 220. By comparing, it is determined which registrant A and companion B the merchandise acquirer is, and the merchandise acquirer who does not correspond to any registrant A and companion B is determined as non-registrant C (Step S203).

  When it is determined that the product acquirer is the registrant A (YES in step S203), the product acquirer determination unit 150 acquires customer information (settlement information) of the registrant A from the registrant storage unit 210. The principal settlement unit 160 performs settlement of the product extracted in step S201 according to the settlement information (for example, charging to a registered credit card or bank account) (step S204).

  When it is determined that the product acquirer is the companion B or the non-registered person C (NO in step S203), the product tracking unit 170 uses the in-store image data acquired from the camera 10 to perform the companion. The product E held by B or the non-registrant C is tracked (step S205).

  The merchandise tracking unit 170 detects whether or not the merchandise E is put in any of the customer's bags F (step S206). The detection that the product E is put in the customer's bag F is performed, for example, between the plurality of pieces of image data continuous in time series and the feature information E1 of the product E from the outside corresponding to the bag F to the inside (or contact). This is done by detecting movement (from a position not touching to a position touching).

  When the product E is not put in the bag F and satisfies the predetermined termination condition (NO in step S206), the settlement processing method is terminated. The predetermined termination condition is, for example, that the product E is delivered to another customer, the product E is returned to the shelf D, or the product E is settled at the POS terminal. When any of these end conditions is satisfied, a predetermined process corresponding to the end condition may be performed (not shown in FIG. 10).

  When the product E is put in one of the customer's bags F (YES in step S206), the settler determination unit 180 displays an area including the face of the customer who is the owner of the bag F containing the product E. Image data is acquired from the camera 10 and characteristic information of the bag owner is acquired from the image data. The settler determination unit 180 compares the feature information of the bag owner with the feature information A1 recorded in the registrant storage unit 210 and the feature information B1 recorded in the companion storage unit 220, so that the bag owner can It is determined which registrant A and companion B, and the bag owner who does not correspond to any registrant A and companion B is determined to be a non-registrant C (step S207).

  When the merchandise acquirer is the companion B and the bag owner is the registrant A associated with the companion B (YES in step S208, YES in step S209), the approver determination unit 180 owns the bag. The customer information of the registrant A who is the registrant (payment information and information on the portable terminal 30) is acquired from the registrant storage unit 210. Thereafter, the notification unit 190 extracts the information of the mobile terminal 30 from the customer information of the registrant A who is the bag owner, and sends a predetermined notification as shown in FIG. 7B to the mobile terminal 30 of the registrant A. This is performed (step S210).

  The other party payment unit 200 receives an input from the registrant A in the notification in step S210. If the input indicates permission of payment, the other party payment unit 200 uses the payment information included in the customer information of the registrant A to Settlement is performed, and if the input indicates settlement denial, settlement of the product E is not performed (step S211). When payment is not performed, a predetermined notification may be given to the clerk's portable terminal 30 as in step S212.

  If the product acquirer is a non-registrant C (NO in step S208), or if the product acquirer is a companion B and the bag owner is not a registrant A associated with the companion B (in step S208) (Yes, NO in step S209), the notification unit 190 acquires information on the mobile terminal 30 of the clerk recorded in advance in the payment processing apparatus 100, and the information is shown in FIG. Such a predetermined notification is performed (step S212).

  The CPU 101 of the payment processing apparatus 100 becomes the main body of each step (process) included in the payment processing method shown in FIGS. That is, the CPU 101 reads out the payment processing program for executing the payment processing method shown in FIGS. 9 and 10 from the memory 102 or the storage device 103, executes the program, and controls each part of the payment processing device 100. 9 and 10 are executed.

  The payment processing apparatus 100 according to the present invention identifies and tracks customers and products based on image information acquired by the camera 10, but uses other well-known techniques for identifying and tracking customers and products. Can do. For example, the customer and the product may be identified and tracked by information or a combination of information acquired from at least one of a camera, an infrared sensor, a pressure sensor, a weight sensor, and a sound sensor provided in a store. Further, the customer may be identified and tracked using a wireless communication signal or a GPS (Global Positioning System) signal emitted from the mobile terminal 30 owned by the customer.

  The settlement processing apparatus 100 according to the present invention includes a registered customer and an unregistered customer in a store in which a registered customer (registrant) and an unregistered customer (accompanied person or non-registered person) coexist. Determine. Then, the payment processing apparatus 100 notifies the store clerk or the mobile terminal 30 of the registered customer when the unregistered customer acquires the product and the acquired product is put in the registered customer's bag. I do. Thereby, it can suppress that the registered customer unintentionally settles the product acquired by the customer who is not registered. Further, since the payment processing apparatus 100 accepts a selection as to whether or not to perform payment for a product acquired by an unregistered customer on the notification screen, the registered customer pays for the product instead of the unregistered customer. It can be performed.

(Second Embodiment)
In the first embodiment, since the customer holding the bag is regarded as the owner of the bag, the original owner of the bag cannot be specified when the bag is delivered between customers. In contrast, in the present embodiment, the bag owner and the characteristic information of the bag are recorded in association with each other, so that the bag owner can be specified even when the bag is delivered between customers. it can. Other configurations in the present embodiment are the same as those in the first embodiment.

  FIG. 11 is a block diagram of the payment processing apparatus 100 according to the present embodiment. The payment processing apparatus 100 according to the present embodiment further includes a bag association unit 230 and a bag storage unit 240 in addition to the configuration of FIG. Below, the detailed function of the bag correlation part 230 and the bag memory | storage part 240 is demonstrated using FIG.

  FIG. 12 is a schematic diagram of a settlement processing method (particularly customer registration processing) according to the present embodiment. In the present embodiment, in the vicinity of the gate 21, the camera 10 is provided at a position where the region including the bag F of the customer can be imaged in addition to the region including the customer's face passing through the gate 21.

  In the present embodiment, after the registrant determination unit 120 determines the registrant A and records the characteristic information, the bag association unit 230 acquires the image data of the bag F held by the registrant A from the camera 10, The characteristic information F1 of the bag F is acquired and recorded in the bag storage unit 240. At this time, the bag association unit 230 associates the feature information F1 of the bag F held by the registrant A with the customer information of the registrant A in the registrant storage unit 210. That is, the registrant A is recorded as the owner of the bag F when entering the store, and the registrant A remains the owner of the bag F even if the bag F is handed over from the registrant A to another customer after entering the store. It is.

  After that, as in the first embodiment, after the product acquisition detection unit 140 and the product acquirer determination unit 150 detect the acquisition of the product E by the companion B or the non-registrant C, the product tracking unit 170 detects the companion B. Alternatively, the product E acquired by the non-registered person C is tracked, and when the product E is put in one of the customers' bags F, the tracking is ended. Next, the settlement person determination unit 180 determines the registrant A who makes a settlement from the bag F in which the product E is put. Unlike the first embodiment, the settlement operator determination unit 180 according to the present embodiment is based on the feature information F1 of the bag F in which the product E is put and the feature information F1 of the bag F recorded in the bag storage unit 240. Thus, the registrant A who is the owner of the bag F is determined. Specifically, the settlement operator determination unit 180 acquires image data of an area including the bag F in which the product E is put from the camera 10, and acquires characteristic information F1 of the bag F from the image data. The settlement operator determination unit 180 compares the acquired feature information F1 of the bag F with the feature information F1 of the bag F recorded in the bag storage unit 240, thereby registering the owner of the bag F at the time of entering the store. Person A is determined.

  When the product acquirer is a non-registrant C, or when the product acquirer is a companion B and the owner of the bag F containing the product E is not the registrant A (that is, the owner of the bag F stores the bag In the case where the information is not recorded in the unit 240), the notification unit 190 acquires information on the mobile terminal 30 of the clerk recorded in advance in the payment processing apparatus 100, and FIG. The notification shown in is performed.

  When the merchandise acquirer is the companion B and the owner of the bag F in which the merchandise E is put is the registrant A, the settler determination unit 180 sets the customer information of the registrant A (payment information and mobile phone). Information on the terminal 30) is acquired from the registrant storage unit 210. Thereafter, the notification unit 190 extracts the information of the mobile terminal 30 from the customer information of the registrant A acquired by the settlement person determination unit 180, and makes a notification shown in FIG. 7B to the mobile terminal 30 of the registrant A. . The subsequent processing is the same as in the first embodiment.

  When the bags F of a plurality of customers in the same store are the same product, for example, the feature information F1 of each bag F is made different by attaching seals having different colors, patterns, or shapes to the same bag, Each bag F can be made distinguishable.

  When using a shopping cart prepared in the store as a customer's bag, change the color, pattern or shape of each shopping cart, or add a unique character string or code to each shopping cart. It is desirable to be able to distinguish from the appearance. With such a configuration, it is possible to easily determine the shopping cart from the image data of the camera 10 and specify the registrant A who is the owner of the shopping cart. When the same shopping basket is used, the owner of the shopping basket can be determined by providing a tag such as RFID (Radio Frequency Identifier) on the shopping basket and providing a reader for the tag in the store.

  The payment processing apparatus 100 according to the present embodiment has the same effect as that of the first embodiment. In addition, even when a bag is handed over between customers in the store, the settlement processing device 100 records when entering the store. It is possible to determine a registered customer (registrant) who is the owner of the registered bag and make a settlement for the registered customer.

(Other embodiments)
FIG. 13 is a schematic configuration diagram of the payment processing apparatus 100 according to each of the above-described embodiments. FIG. 13 shows a configuration example for the payment processing apparatus 100 to function as an apparatus that can suppress unintended payments in a store where registered customers and non-registered customers coexist. The settlement processing apparatus 100 includes a product acquirer determination unit 150 (determination unit) that determines whether a customer who acquired a product at a store is a registered customer or a non-registered customer, and the customer who acquired the product A mobile terminal of the registered customer who owns the bag when the product is put into a bag owned by the registered customer by the unregistered customer who is the unregistered customer A notification unit 190 that notifies the

  The present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the spirit of the present invention.

  A program for operating the configuration of the embodiment to realize the functions of the above-described embodiment (more specifically, a payment processing program for causing a computer to execute the processes illustrated in FIGS. 9 and 10) is recorded on a recording medium, A processing method of reading a program recorded on the recording medium as a code and executing it on a computer is also included in the category of each embodiment. That is, a computer-readable recording medium is also included in the scope of each embodiment. In addition to the recording medium on which the above program is recorded, the program itself is included in each embodiment.

  As the recording medium, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, and a ROM can be used. Further, the embodiment is not limited to the processing executed by a single program recorded in the recording medium, and the embodiments that execute processing by operating on the OS in cooperation with other software and the function of the expansion board are also described in each embodiment. Included in the category.

  A part or all of the above-described embodiment can be described as in the following supplementary notes, but is not limited thereto.

(Appendix 1)
A determination unit that determines whether the customer who acquired the product at the store is a registered customer or a non-registered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A notification unit for notifying a mobile terminal of a registered customer;
A payment processing apparatus.

(Appendix 2)
The settlement processing apparatus according to claim 1, further comprising a settlement unit that performs settlement of the product to the registered customer according to a selection input by the registered customer in the notification.

(Appendix 3)
The supplementary note 2, wherein the settlement unit performs the settlement for the registered customer who has acquired the product when the customer who has acquired the product is the registered customer. Payment processing device.

(Appendix 4)
An association unit for associating the registered customer with characteristic information of the bag possessed when the registered customer enters the store;
The settlement processing apparatus according to appendix 2 or 3, wherein the settlement unit performs the settlement with respect to the registered customer who owns the bag based on the feature information of the bag.

(Appendix 5)
5. The tracking device according to any one of appendices 1 to 4, further comprising a tracking unit that tracks the unregistered customer and the product in the store and identifies the bag in which the product is placed. Payment processing device.

(Appendix 6)
The payment processing device according to any one of appendices 1 to 5, wherein the notification unit performs the notification to a mobile terminal owned by a store clerk of the store.

(Appendix 7)
The registered customer is a customer in which payment information for making the payment is registered,
The settlement processing apparatus according to any one of appendices 2 to 4, wherein the settlement unit performs the settlement according to the settlement information.

(Appendix 8)
A determination unit that determines whether the customer who acquired the product at the store is a registered customer or a non-registered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A settlement unit that settles the product for the customer
A payment processing apparatus.

(Appendix 9)
Determining whether the customer who acquired the product at the store is a registered customer or an unregistered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A step of notifying a mobile terminal of a registered customer;
Payment processing method.

(Appendix 10)
On the computer,
Determining whether the customer who acquired the product at the store is a registered customer or an unregistered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A step of notifying a mobile terminal of a registered customer;
Settlement processing program that executes.

(Appendix 11)
The settlement processing apparatus according to appendix 4, wherein the feature information is at least one of image data of an area including the bag and a feature amount calculated from the image data.

(Appendix 12)
The payment processing apparatus according to any one of appendices 1 to 7, wherein the bag is either the bag brought by the registered customer or the bag prepared in advance in the store. .

DESCRIPTION OF SYMBOLS 100 Payment processing apparatus 150 Merchandise acquirer determination part 160 Personal settlement part 170 Merchandise tracking part 190 Notification part 200 Other person settlement part 230 Bag association part 30 Portable terminal

Claims (10)

A determination unit that determines whether the customer who acquired the product at the store is a registered customer or a non-registered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A notification unit for notifying a mobile terminal of a registered customer;
A payment processing apparatus.   The settlement processing apparatus according to claim 1, further comprising a settlement unit that performs settlement of the product to the registered customer according to a selection input by the registered customer in the notification.   3. The payment unit according to claim 2, wherein when the customer who acquired the product is the registered customer, the payment unit performs the payment for the registered customer who acquired the product. The settlement processing apparatus described. An association unit for associating the registered customer with characteristic information of the bag possessed when the registered customer enters the store;
The payment processing apparatus according to claim 2, wherein the payment unit performs the payment with respect to the registered customer who owns the bag based on the characteristic information of the bag.   5. The apparatus according to claim 1, further comprising a tracking unit that tracks the unregistered customer and the product in the store and identifies the bag in which the product is placed. The settlement processing apparatus described.   The payment processing apparatus according to claim 1, wherein the notification unit performs the notification to a mobile terminal owned by a store clerk of the store. The registered customer is a customer in which payment information for making the payment is registered,
The payment processing apparatus according to claim 2, wherein the payment unit performs the payment according to the payment information. A determination unit that determines whether the customer who acquired the product at the store is a registered customer or a non-registered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A settlement unit that settles the product for the customer
A payment processing apparatus. Determining whether the customer who acquired the product at the store is a registered customer or an unregistered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A step of notifying a mobile terminal of a registered customer;
Payment processing method. On the computer,
Determining whether the customer who acquired the product at the store is a registered customer or an unregistered customer;
The registration that owns the bag when the customer who acquired the product is the unregistered customer and the product is put into a bag owned by the registered customer by the unregistered customer A step of notifying a mobile terminal of a registered customer;
Settlement processing program that executes.

Images