JP7163604B2 - Settlement system, settlement method and program - Google Patents

Description

The present invention relates to a settlement system, a settlement method, and a program.

In Patent Document 1, when a product whose purchase is age-restricted (age-restricted product) is registered as an accounting target, an image of the customer is analyzed to determine whether or not the age condition is satisfied. Disclosed is a device (register) that outputs a warning prompting age verification when it is determined that there is no such age.

JP 2016-181013 A

The device described in Patent Document 1 is configured assuming that it is mainly operated by a store clerk, and it is described that it may be applied to a device (self-register) operated by the customer himself/herself. No specific mechanism has been disclosed.

An object of the present invention is to sell age-restricted products even at a device (self-register) operated by the customer himself/herself.

According to the invention,
imaging means for generating a customer's face image;
estimating means for estimating the age of the customer based on the face image;
product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
a settlement means for settlement of the goods;
determining means for determining whether an age condition is satisfied based on the age of the customer estimated by the estimating means when the product registration means detects registration of the age-restricted product;
response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
A checkout system is provided comprising:

Moreover, according to the present invention,
the computer
an imaging step of generating a face image of the customer;
an estimation step of estimating the age of the customer based on the face image;
a product registration step of accepting product registration by the customer and detecting registration of an age-restricted product;
a checkout step of checking out the merchandise;
a determination step of determining whether an age condition is met based on the age of the customer estimated in the estimation step when registration of the age-restricted product is detected in the product registration step;
a response step of transmitting the registration information of the product registered in the product registration step or the customer information for judging the age of the customer to another device when it is determined that the age condition is not satisfied;
A checkout method is provided for performing

Moreover, according to the present invention,
the computer,
imaging means for generating a customer's face image;
estimation means for estimating the age of the customer based on the face image;
Product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
settlement means for settlement of the goods;
Determination means for determining whether an age condition is met based on the age of the customer estimated by the estimation means when the registration of the age-restricted product is detected by the product registration means;
Response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
A program is provided to act as a

According to the present invention, it is possible to sell age-restricted products even at a device (self-register) operated by the customer himself/herself.

It is a figure for demonstrating the outline|summary of the process of the settlement system of this embodiment. It is a figure which shows an example of the functional block diagram of the settlement system of this embodiment. It is a figure which shows an example of the hardware constitutions of the apparatus of this embodiment. It is a figure which shows typically an example of the information which the settlement system of this embodiment processes. It is a flow chart which shows an example of the flow of processing of the settlement system of this embodiment. It is a figure for demonstrating the outline|summary of the process of the settlement system of this embodiment. It is a flow chart which shows an example of the flow of processing of the settlement system of this embodiment. It is a flow chart which shows an example of the flow of processing of the settlement system of this embodiment. It is a flow chart which shows an example of the flow of processing of the settlement system of this embodiment.

<First embodiment>
First, the outline of the settlement system of the present embodiment will be described. The settlement system of this embodiment is a system (self-register) operated by the customer himself/herself. That is, the customer operates the settlement system by himself/herself, registers products to be accounted for, and performs settlement processing (payment).

Then, the settlement system of the present embodiment estimates the customer's age based on the customer's facial image when a product whose purchase is age-restricted (age-restricted product) is registered as an accounting object, and the estimated result is Take appropriate action. This reduces the inconvenience of selling age-restricted products to customers who do not meet age restrictions.

However, the accuracy rate of age estimation based on image analysis is not 100%. In order to compensate for this point, the settlement system of the present embodiment performs characteristic processing when the customer's age estimated by image analysis does not satisfy the age condition (○ years old or older). An outline of the characteristic processing will be described with reference to FIG.

The settlement system 10 is a system operated by the customer himself/herself to register products to be accounted for and perform settlement processing (payment). The external device 20 is a device operated by a person (clerk, employee, etc.) on the store side. It may be a computer installed in a place other than the sales floor), a computer installed in an office away from the store, or the like. The settlement system 10 and the external device 20 are configured to communicate with each other.

The settlement system 10 has means for photographing the face of the customer operating the system and estimating the customer's age based on the customer's facial image.

Then, if the estimated age of the customer who has registered the age-restricted product satisfies the age condition (○ years old or older), the settlement system 10 does not perform any special processing, and keeps the age-restricted product registered as an accounting object. continue the registration process and settlement process.

On the other hand, if the estimated age of the customer who registered the age-restricted product does not satisfy the age condition (○ years old or older), as shown in the figure, the settlement system 10 collects customer information (eg, the The customer's face image, ID card, passport, or other age-determinable information) is transmitted to the external device 20 . The external device 20 displays the received information on the display, and accepts input from the user (a person at the store) as to whether or not the product can be sold. Then, the external device 20 notifies the settlement system 10 of the input content (“sale possible” or “sale not possible”).

If the response received from the external device 20 is "sellable", the settlement system 10 continues the product registration processing and settlement processing while keeping the age-restricted product registered as the accounting object.

On the other hand, if the answer received from the external device 20 is "not for sale", the settlement system 10 restricts the sale of the age-restricted product to the customer.

According to such a settlement system 10, it is possible to reduce the inconvenience of selling age-restricted products to customers who do not meet the age limit. In addition, it is possible to reduce the inconvenience of erroneously restricting sales of age-restricted products to customers who meet the age limit.

Next, the configuration of the settlement system 10 will be described in detail. FIG. 2 shows an example of a functional block diagram of the settlement system 10. As shown in FIG. As illustrated, the settlement system 10 includes an imaging unit 11 , an estimation unit 12 , a product registration unit 13 , a determination unit 14 , a correspondence unit 15 and a settlement unit 16 .

Note that the settlement system 10 may be implemented by a plurality of physically and/or logically separated devices, or may be physically and/or logically implemented by one device. When implemented by multiple physically and/or logically separate devices, the multiple devices are configured to communicate with each other in a wired and/or wireless manner. For example, the imaging unit 11, product registration unit 13, correspondence unit 15, and checkout unit 16 are realized by a first device (terminal operated by a customer), and the estimation unit 12 and determination unit 14 are realized by a second device (store server). may be implemented with

These functional units provided in the settlement system 10 include a CPU (Central Processing Unit) of any computer, a memory, a program loaded into the memory, a storage unit such as a hard disk that stores the program (stored in advance from the stage of shipping the device). Programs downloaded from storage media such as CDs (Compact Discs) and servers on the Internet can also be stored), and can be realized by any combination of hardware and software centered on the interface for network connection. be done. It should be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.

FIG. 3 is a block diagram illustrating the hardware configuration of the settlement system 10. As shown in FIG. As shown in FIG. 3, the settlement system 10 has a processor 1A, a memory 2A, an input/output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. It may not have the peripheral circuit 4A. In addition, when the settlement system 10 is realized by a plurality of physically and/or logically separated devices, each device can have the hardware configuration.

The bus 5A is a data transmission path for mutually transmitting and receiving data between the processor 1A, memory 2A, peripheral circuit 4A and input/output interface 3A. The processor 1A is, for example, an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 2A is, for example, a RAM (Random Access Memory) or a ROM (Read Only Memory). The input/output interface 3A is an interface for acquiring information from input devices (eg, keyboard, mouse, microphone, etc.), external devices, external servers, external sensors, etc., and output devices (eg, displays, speakers, printers, mailers, etc.). etc.), an interface for outputting information to an external device, an external server, and the like. The processor 1A can issue commands to each module and perform calculations based on the calculation results thereof.

Returning to FIG. 2, the functional configuration of each functional unit will be described.

The product registration unit 13 receives product registration by customers and detects registration of age-restricted products.

First, the product registration unit 13 receives input of information identifying products to be accounted for. For example, the product registration unit 13 may receive input of information for identifying products for accounting via a reader that reads codes such as barcodes. When the barcode (indicating product identification information) attached to the product to be accounted is held over the reader, the reader analyzes the barcode (converts the pattern into information) and reads the product identification information indicated by the barcode. recognize.

In addition, the product registration unit 13 may receive input of information identifying products to be accounted for through an input device such as a touch panel display or physical buttons. A virtual button displayed on the touch panel display and a physical button provided in the checkout system 10 are associated with a predetermined product. By operating (tapping, pressing, etc.) on the button, information identifying the product corresponding to the button is input.

In addition, it is also possible to input information for identifying the product to be accounted for by taking an image of the product to be accounted for by the camera of the settlement system 10 . In this case, the features of the appearance of each of a plurality of commodities are registered in advance, and the commodities included in the image are recognized by image analysis (pattern matching, etc.) using the information.

When the product registration unit 13 receives an input of information identifying a product to be accounted for, it acquires product information (price, product name, etc.) of the product from the product master and registers it as an accounting target.

Further, the product registration unit 13 determines whether or not the registered product is an age-restricted product based on the list showing age-restricted products as shown in FIG. In the list of FIG. 4, product classifications of age-restricted products are registered, but identification information of each product may be registered.

The imaging unit 11 generates a face image of the customer. The imaging unit 11 includes a camera. The camera is attached to or near the checkout system 10 in a manner (position, orientation, etc.) capable of photographing the facial image of the customer who operates the checkout system 10 .

The imaging unit 11 may generate a moving image or may generate a still image. The imaging unit 11 may photograph the customer and generate one or more still images when the product registration unit 13 determines that the first age-restricted product has been registered. In addition, the imaging unit 11 may generate a moving image for a predetermined time in response to the product registration unit 13 determining that the first age-restricted product has been registered. In addition, the imaging unit 11 may generate face images of all customers at any timing regardless of registration of age-restricted products.

The estimation unit 12 estimates the customer's age based on the face image generated by the imaging unit 11 . Details of means for estimating a person's age by image analysis are not particularly limited, but an example will be described below.

For example, arbitrary machine learning based on teacher data that associates facial features of multiple people (e.g., positional relationship of facial parts such as eyes, nose, mouth, contours, wrinkles, etc.) with age, An estimation model for estimating age from facial features may be generated. Then, the estimated age of the person included in the image may be obtained by inputting the facial feature amount extracted from the face image generated by the imaging unit 11 into the estimation model.

When the product registration unit 13 detects registration of an age-restricted product, the determination unit 14 determines whether the age condition is satisfied based on the age of the customer estimated by the estimation unit 12 . The age condition is "M years old or older".

The content of the age condition (the value of M) can be determined based on the content of the age limit stipulated by rules (laws, etc.) that regulate the purchase of age-restricted products. For example, if the content of the age restriction is a rule that "20 years old or older can purchase", the age condition may be "20 years old or older". That is, the content of the age restriction and the content of the age condition may match. It should be noted that the content of the age restriction and the content of the age condition do not have to match. For example, if the content of the age restriction is a rule that "20 years old or older can purchase", the age condition may be "25 years old or older", "30 years old or older", etc. with a little leeway. This is because the accuracy rate of age estimation based on image analysis is not 100%. By making the content of the age condition stricter than the content of the age limit, it is possible to avoid the inconvenience of mistakenly selling age-restricted products to customers under the age limit.

If the content of the age condition is stricter than the content of the age limit, it is likely that a customer who satisfies the age limit will be judged as not meeting the age condition. However, in the case of this embodiment, as explained in the above outline, sales are not restricted based only on the results of image analysis, and if it is determined that the image analysis does not satisfy the age condition, the store side After receiving the judgment result of human beings, if it is judged that "sale is not possible" there, sales will be regulated. Therefore, even if the content of the age condition is stricter than the content of the age limit, it is possible to reduce the inconvenience of losing a sales opportunity by imposing sales restrictions on customers who satisfy the age limit.

The content of the age condition (value of M) can be determined for each product or each product category. This is in consideration of the fact that the content of age restrictions stipulated by predetermined rules (laws, etc.) may differ for each product or product category (Product A can be purchased by those aged 20 or older, while Product B can be purchased by those aged 15 or older. or more can be purchased, etc.). In this case, when the registration of an age-restricted product is detected by the product registration unit 13, the determination unit 14 refers to the pre-generated "registration information indicating the age condition of each age-restricted product" to register the age-restricted product. An age condition is specified, and it is determined whether the specified age condition is satisfied based on the customer's age estimated by the estimation unit 12 .

If the determining unit 14 determines that the age condition is not satisfied, the corresponding unit 15 transmits customer information for determining the customer's age to another device (external device 20). For example, the correspondence unit 15 transmits the customer's face image (customer information) generated by the imaging unit 11 to another device (external device 20). In addition, when the determination unit 14 determines that the age condition is not satisfied, the response unit 15 displays information that prompts the customer to take an image (read) of information that can determine the age, such as an ID card or a passport. can be output via Then, the corresponding unit 15 may transmit information (eg, image) imaged (read) according to the information to another device (external device 20). In addition, when the determining unit 14 determines that the age condition is not satisfied, the corresponding unit 15 stores the customer's face image generated by the imaging unit 11 and the information captured (read) in response to the above instruction. device (external device 20). After transmitting the information (face image, etc.) to the external device 20, the corresponding unit 15 receives a response from the external device 20 as to whether or not the product can be sold to the customer. When age-determinable information such as an ID card or passport is sent to the external device 20, the store clerk or the like can accurately determine whether age-restricted products can be sold to the customer.

If the response received from the external device 20 is "not for sale", the correspondence unit 15 may delete the age-restricted product from the list of products for accounting registered by the product registration unit 13.

Also, the response unit 15 may notify the customer operating the settlement system 10 of the error. For example, information such as "Product A is an age-restricted product. Therefore, product A cannot be sold."

In addition, the settlement system 10 may transmit information such as "A customer who does not meet the age limit is going to purchase an age-restricted product at the cash register XX" to the terminal operated by the store clerk. The store clerk who received the notification can go to the cash register and perform a predetermined process (collection of age-restricted products, customer service such as explanation). In this case, the store clerk may perform age confirmation processing (input as to whether or not the product can be sold, etc.) on the settlement system 10 . In addition, when the other device (external device 20) is a mobile terminal possessed by a store clerk, the store clerk may perform age verification processing on the mobile terminal.

The checkout unit 16 performs checkout for commodities. The settlement system 10 calculates the total payment amount based on the information registered by the product registration unit 13 and displays it on a display or the like. The settlement unit 16 accepts payment for the total payment amount. For example, the settlement unit 16 may accept cash input through an insertion slot provided in the settlement system 10 . Then, the settlement unit 16 may output change, issue a receipt, and the like. Alternatively, the settlement unit 16 may accept insertion of a credit card. Then, the settlement unit 16 may communicate with the system of the credit card company and perform settlement processing based on the information acquired from the credit card.

Next, an example of the processing flow of the settlement system 10 of this embodiment will be described using the flowchart of FIG.

In S10, the product registration unit 13 accepts product registration. The customer can, for example, operate a code reader of the settlement system 10 to read the code, operate a button of the settlement system 10, or photograph the product to be accounted with the camera of the settlement system 10. to the settlement system 10. After identifying the product based on the input information, the product registration unit 13 acquires the product information (price, product name, etc.) of the product from the product master and registers it as an accounting object.

In S11, the product registration unit 13 determines whether the registered product is an age-restricted product based on a list such as that shown in FIG. If the product registered in S10 is not an age-restricted product ("No" in S11), the process proceeds to S17. On the other hand, if the product registered in S10 is an age-restricted product ("Yes" in S11), the determination unit 14 determines whether the age of the customer estimated by the estimation unit 12 satisfies the age condition (S12).

In addition, in response to the detection that the age-restricted product has been registered in S11, the imaging unit 11 generates a customer's face image, the estimation unit 12 estimates the customer's age based on the face image, and the determination unit 14 The determination may be made based on the result of estimation by the estimation unit 12 .

In addition, the imaging unit 11 may generate a customer's face image at an arbitrary timing different from the above, the estimation unit 12 may estimate the customer's age based on the face image, and store the result. Then, the determination unit 14 may read the stored information and perform the above determination.

If it is determined in S12 that the age condition is satisfied ("Yes" in S12), the process proceeds to S17. On the other hand, if it is determined in S12 that the age condition is not satisfied ("No" in S12), the corresponding unit 15 transmits the customer's facial image to the external device 20 (S13). Then, the correspondence unit 15 receives a reply as to whether or not the product can be sold to the customer from the external device 20 (S14).

During the period from the face image transmission (S13) to the response reception (S14), the settlement system 10 may be in a waiting state in which other inputs (such as new product registration and settlement start instruction input) are not accepted. In addition, the settlement system 10 may be in a partially stopped state in which it accepts new product registration and does not accept the input of an instruction to start settlement from the transmission of the face image (S13) to the reception of the reply (S14). If an instruction input to start payment is received in the partial stop state, the payment system 10 may display a message such as "We are currently confirming whether age-restricted products can be sold. Please wait for a while." .

If the answer received in S14 is "sale possible" ("sale possible" in S15), the process proceeds to S17. On the other hand, if the answer received in S14 is "not for sale" ("not for sale" in S15), the response unit 15 performs error processing (S16). For example, the correspondence unit 15 may delete the age-restricted product from the list of accounting target products registered by the product registration unit 13 . Also, the response unit 15 may notify the customer operating the settlement system 10 of the error. For example, information such as "Product A is an age-restricted product. Therefore, product A cannot be sold." In addition, the settlement system 10 may transmit information such as "A customer who does not meet the age limit is going to purchase an age-restricted product at the cash register No. XX" to the terminal operated by the store clerk.

After the error processing of S16, the process proceeds to S17. If there is no instruction input to start the settlement process ("No" in S17), the same process is repeated. On the other hand, if there is an instruction input to start the settlement process ("Yes" in S17), the settlement unit 16 performs the settlement process (S18). For example, the settlement unit 16 may accept the insertion of cash as payment for the total amount of payment calculated based on the products registered so far, and may output change or a receipt as necessary. Also, the settlement unit 16 may accept the insertion of a credit card, communicate with the system of the credit company, and perform settlement processing.

Here, a modified example of the flow of the processing will be described. In S11, "whether or not the product is an age-restricted product" is determined, but "whether or not it is the first age-restricted product" may be determined. "First age-restricted product" means the first age-restricted product registered by the customer. This does not apply to the second and subsequent age-restricted products registered by the customer. Then, when the second and subsequent age-restricted products are registered as accounting objects, processing corresponding to the processing for the first age-restricted product may be performed.

For example, if the first age-restricted product results in "Yes" in S12 or "Sellable" in S15, and the error processing in S16 is not executed, the second and subsequent age-restricted products will also receive an error in S16. Continue the processing (product registration processing, settlement processing, etc.) while registering the age-restricted product as an accounting object without executing the processing. On the other hand, if the first age-restricted product results in "No" in S12 and "cannot be sold" in S15, and the error processing in S16 is not executed, the second and subsequent age-restricted products will also cause an error in S16. Execute the process. In the case of this modified example, when the second and subsequent age-restricted products are registered, the processing of judging whether the age condition is satisfied, sending a face image, receiving an answer, etc., can be omitted. As a result, the processing load on the computer is reduced.

Here, another modified example of the flow of the processing will be described. This is based on the premise that the content of the age condition (the value of M) is determined for each product or each product category. In S11, "whether or not the product is age-restricted" was determined, but "whether or not the product is age-restricted and whether the age condition is stricter than the previously registered age-restricted product (whether M is small or not" is determined). )” may be judged. "If the product is not an age-restricted product" and "If the product is an age-restricted product but the age conditions are looser or the same as those of the previously registered age-restricted product (M is greater or equal)" is No. On the other hand, if "the product is an age-restricted product and the age conditions are stricter than those of the previously registered age-restricted product (M is small)," If there is no product”, the answer is Yes. In the case of the modification, too, it is possible to avoid the inconvenience of unnecessary processes such as determining whether the age condition is satisfied, transmitting a face image, and receiving an answer. As a result, the processing load on the computer is reduced.

As another modification, when "Yes" is obtained in S12 (when the determination unit 14 determines that the age condition is satisfied), and when "Sales are possible" in S15 (when the store clerk determines that sales are possible) In this case, the settlement system 10 may notify the customer operating the settlement system 10 to that effect.

For example, the response unit 15 may display a message such as "Product A is an age-restricted product, but we have determined that the customer is XX years old or older." Also, a message such as "Is the judgment result correct?" may be displayed, and an input of "yes" or "no" may be further accepted. In this way, when the determination unit 14 determines that the age condition is satisfied, or when the store clerk determines that the sales are permitted, the response unit 15 notifies the customer to that effect, and if the determination is incorrect, notifies the customer to that effect. The customer may be notified of a message prompting for input.

In addition, if the age-restricted product is registered ("Yes" in S11), regardless of the determination result in S12 (both "Yes" and "No" in S12) ), a message such as "Product A is an age-restricted product, but are you over the age of XX?"

As another modification, in S13, instead of the customer's face image, information (eg, image) that enables age determination, such as an identification card or passport, may be sent to the external device 20 . Alternatively, in S<b>13 , the customer's facial image and information (eg, image) such as an identification card or passport that can determine the age of the customer may be transmitted to the external device 20 . For example, after it is determined in S12 that the age condition is not satisfied, the response unit 15 sends information via a display or the like to prompt the customer to take an image (read) of information that can determine the age, such as an ID card or passport. can be output. Then, the corresponding unit 15 can transmit information (eg, image) imaged (read) according to the information to another device (external device 20) in S13.

Here, another example of the processing flow of the settlement system 10 of the present embodiment will be described using the flowchart of FIG. 9 .

In S40, the product registration unit 13 accepts product registration. The customer can, for example, operate a code reader of the settlement system 10 to read the code, operate a button of the settlement system 10, or photograph the product to be accounted with the camera of the settlement system 10. to the settlement system 10. After identifying the product based on the input information, the product registration unit 13 acquires the product information (price, product name, etc.) of the product from the product master and registers it as an accounting object. While there is no instruction input to start the settlement process ("No" in S41), product registration is repeated.

When an instruction to start the settlement process is input ("Yes" in S41), the product registration unit 13 determines whether age-restricted products are included in the registered products based on a list such as that shown in FIG. (S42).

If age-restricted products are not included ("No" in S42), the checkout unit 16 performs checkout processing (S48). For example, the settlement unit 16 may accept the insertion of cash as payment for the total amount of payment calculated based on the products registered so far, and may output change or a receipt as necessary. Also, the settlement unit 16 may accept the insertion of a credit card, communicate with the system of the credit company, and perform settlement processing.

On the other hand, if age-restricted products are included ("Yes" in S42), the determination unit 14 determines whether the age of the customer estimated by the estimation unit 12 satisfies the age condition (S43).

In addition, in response to the determination in S42 that age-restricted products are included, the imaging unit 11 generates a face image of the customer, the estimation unit 12 estimates the age of the customer based on the face image, and the determination unit 14 The determination may be made based on the result of estimation by the estimation unit 12 .

In addition, the imaging unit 11 may generate a customer's face image at an arbitrary timing different from the above, the estimation unit 12 may estimate the customer's age based on the face image, and store the result. Then, the determination unit 14 may read the stored information and perform the above determination.

When it is determined in S43 that the age condition is satisfied ("Yes" in S43), the settlement unit 16 performs settlement processing (S48).

On the other hand, when it is determined in S43 that the age condition is not satisfied ("No" in S43), the corresponding unit 15 transmits the customer's facial image to the external device 20 (S44). Then, the correspondence unit 15 receives a reply as to whether or not the product can be sold to the customer from the external device 20 (S45).

If the answer received in S45 is "sales possible" ("sales possible" in S46), the settlement unit 16 performs settlement processing (S48). On the other hand, if the answer received in S45 is "not for sale" ("not for sale" at S46), the response unit 15 performs error processing (S47). For example, the response unit 15 may notify the customer operating the settlement system 10 of the error. For example, information such as "Product A is an age-restricted product. Therefore, product A cannot be sold." Further, the correspondence unit 15 may delete the age-restricted product from the product list for accounting registered by the product registration unit 13 . In addition, the settlement system 10 may transmit information such as "A customer who does not meet the age limit is going to purchase an age-restricted product at the cash register No. XX" to the terminal operated by the store clerk. After the above error processing in S47, the settlement unit 16 performs settlement processing (S48).

Here, a modified example of the flow of the processing will be described. When "Yes" is determined in S43 (when the determining unit 14 determines that the age condition is satisfied), and when "Sales are permitted" in S46 (when the store clerk determines that sales are permitted), the settlement system 10 , to that effect may be notified to the customer who operates the settlement system 10 .

For example, the response unit 15 may display a message such as "Product A is an age-restricted product, but we have determined that the customer is XX years old or older." Also, a message such as "Is the judgment result correct?" may be displayed, and an input of "yes" or "no" may be further accepted. In this way, when the determination unit 14 determines that the age condition is satisfied, or when the store clerk determines that the sales are permitted, the response unit 15 notifies the customer to that effect, and if the determination is incorrect, notifies the customer to that effect. The customer may be notified of a message prompting for input.

Note that if age-restricted products are included in the accounting target ("Yes" in S42), regardless of the determination result in S43 (if "Yes" or "No" in S43), the settlement system 10 ), a message such as "Product A is an age-restricted product, but are you XX years old or older?"

As another modified example, in S44, instead of the customer's face image, information (eg, image) that can determine the age of the customer, such as an identification card or passport, may be sent to the external device 20 . Alternatively, in S<b>44 , the customer's facial image and information (eg, image) such as an identification card or passport that can determine the age of the customer may be transmitted to the external device 20 . For example, after it is determined in S43 that the age condition is not satisfied, the response unit 15 displays, via a display or the like, information urging the customer to take an image (read) of information such as an ID card or passport that can determine the age. can be output. Then, the corresponding unit 15 can transmit information (eg, image) imaged (read) according to the information to another device (external device 20) in S44.

According to the settlement system 10 of the present embodiment described above, the customer's age is estimated by image analysis, and based on the estimation result, it is determined whether or not the age-restricted product can be sold to the customer who is about to purchase it. can be done. Then, sales to customers can be regulated based on the judgment result. This suppresses the inconvenience of selling age-restricted products to customers who do not meet age restrictions.

In addition, we do not restrict sales based only on the result of image analysis (sale is not possible), and if it is determined that the image analysis does not meet the age requirement, we will receive the judgment result of the person on the store side. If the product is judged to be “not for sale”, the sales will be regulated. Therefore, it is possible to reduce the inconvenience of losing a sales opportunity due to the uncertainty of image analysis. Furthermore, since this process is included, the criteria for age conditions determined by image analysis can be stricter than the criteria for actual age restrictions. As a result, the inconvenience of selling age-restricted products to customers who do not meet the age limit can be sufficiently reduced.

In addition, according to the settlement system 10 of the present embodiment, the store does not need to judge whether or not the age-restricted product can be sold to all customers who are going to purchase it. It is only necessary to make judgments for customers judged not to satisfy the age condition in (1). As a result, the burden on the store side can be reduced.

<Second embodiment>
The settlement system 10 of the present embodiment differs from that of the first embodiment in the details of processing performed when an age-restricted product is registered as an accounting object and it is determined by image analysis that the age condition is not satisfied. Other configurations are the same as those of the first embodiment. Processing contents of the settlement system 10 of the present embodiment will be described with reference to FIG. 6 .

The settlement system 10 is a system operated by the customer himself/herself to register products to be accounted for and perform settlement processing (payment). The store clerk's settlement device 30 is a device operated by a store clerk to perform settlement processing (payment). The store clerk's checkout device 30 may be able to register products for accounting. The settlement system 10 and the store clerk's settlement device 30 are configured to be able to communicate with each other.

When the image analysis determines that the age condition is not satisfied, the settlement system 10 transmits the registration information indicating the commodities registered as accounting objects to the settlement device 30 for salesclerks without executing settlement processing. That is, the settlement system 10 does not accept settlement processing when it is determined by image analysis that the age condition is not satisfied.

In this case, the customer moves to the store clerk's checkout device 30 and performs the checkout process there. The clerk who operates the clerk's checkout device 30, for example, judges whether the customer satisfies the age limit based on the appearance of the customer, and requests the presentation of an identification card or the like for age confirmation as necessary. After confirming that the age limit is satisfied, the store clerk can perform the checkout process while including the age-restricted product in the product list to be accounted for. On the other hand, when it is confirmed that the age limit is not met, the store clerk can delete the age-restricted product from the product list to be accounted for and perform the settlement process for the remaining products.

According to such a settlement system 10, it is possible to reduce the inconvenience of selling age-restricted products to customers who do not meet the age limit. In addition, it is possible to reduce the inconvenience of erroneously restricting sales of age-restricted products to customers who meet the age limit.

The configuration of the settlement system 10 will be described in detail below. An example of the hardware configuration of the settlement system 10 is shown in FIG. 3 as in the first embodiment.

An example of a functional block diagram of the settlement system 10 is shown in FIG. 2, as in the first embodiment. As illustrated, the settlement system 10 includes an imaging unit 11 , an estimation unit 12 , a product registration unit 13 , a determination unit 14 , a correspondence unit 15 and a settlement unit 16 . The configurations of the imaging unit 11, the estimating unit 12, the product registration unit 13, the determining unit 14, and the checkout unit 16 are the same as in the first embodiment. Therefore, description here is omitted.

When the determination unit 14 determines that the age condition is not satisfied, the correspondence unit 15 transmits the product registration information registered by the product registration unit 13 to another device (clerk's checkout device 30). The registration information includes information for identifying the registered product (product code, product name, etc.), sales quantity, sales price, and the like.

Note that the response unit 15 may display on the display information indicating that the registration information has been transmitted to the clerk's checkout device 30 and that the clerk's checkout device 30 has accepted the checkout process (notification to the customer). . In addition, when there are a plurality of cashier's checkout devices 30, the correspondence unit 15 may display information identifying the cashier's checkout device 30 that has transmitted the registration information on the display (notify the customer).

Further, the settlement device for salesclerk 30 to which the registration information is transmitted may issue a serial number for the received registration information and transmit it to the settlement system 10 . Then, the correspondence unit 15 may display the serial number on the display (notify the customer).

For example, the correspondence unit 15 may display information such as "Please go to the XX cash register and pay the bill. Please say XX (serial number)."

The customer who has received the notification moves to a predetermined salesclerk's settlement device 30 and notifies the salesclerk of the serial number. The clerk's settlement device 30 associates and stores the registration information received from the settlement system 10 and the serial number. When the clerk inputs the serial number to the clerk's settlement device 30, the clerk's settlement device 30 reads the registered information corresponding to the inputted serial number, and becomes ready for settlement processing.

The clerk who operates the clerk's checkout device 30, for example, judges whether the customer satisfies the age limit based on the appearance of the customer, and requests the presentation of an identification card or the like for age confirmation as necessary. After confirming that the age limit is satisfied, the store clerk can perform the checkout process while including the age-restricted product in the product list to be accounted for. On the other hand, when it is confirmed that the age limit is not met, the store clerk can delete the age-restricted product from the product list to be accounted for and perform the settlement process for the remaining products.

Next, an example of the processing flow of the settlement system 10 of the present embodiment will be described using the flowchart of FIG. 7 .

In S20, the product registration unit 13 accepts product registration. The customer can, for example, operate a code reader of the settlement system 10 to read the code, operate a button of the settlement system 10, or photograph the product to be accounted with the camera of the settlement system 10. to the settlement system 10. After identifying the product based on the input information, the product registration unit 13 acquires the product information (price, product name, etc.) of the product from the product master and registers it as an accounting object. While there is no instruction input to start the settlement process ("No" in S21), product registration is repeated.

When an instruction to start the settlement process is input ("Yes" in S21), the product registration unit 13 determines whether age-restricted products are included in the registered products based on the list shown in FIG. 4, for example. (S22).

If age-restricted products are not included ("No" in S22), the checkout unit 16 performs checkout processing (S25). For example, the settlement unit 16 may accept the insertion of cash as payment for the total amount of payment calculated based on the products registered so far, and may output change or a receipt as necessary. Also, the settlement unit 16 may accept the insertion of a credit card, communicate with the system of the credit company, and perform settlement processing.

On the other hand, if age-restricted products are included ("Yes" in S22), the determination unit 14 determines whether the age of the customer estimated by the estimation unit 12 satisfies the age condition (S23).

In addition, in response to the determination in S22 that age-restricted products are included, the imaging unit 11 generates a face image of the customer, the estimation unit 12 estimates the age of the customer based on the face image, and the determination unit 14 The determination may be made based on the result of estimation by the estimation unit 12 .

In addition, the imaging unit 11 may generate a customer's face image at an arbitrary timing different from the above, the estimation unit 12 may estimate the customer's age based on the face image, and store the result. Then, the determination unit 14 may read the stored information and perform the above determination.

If it is determined in S23 that the age condition is satisfied ("Yes" in S23), the settlement unit 16 performs settlement processing (S25).

On the other hand, if it is determined in S23 that the age condition is not satisfied ("No" in S23), the response unit 15 transmits the registration information to the clerk's checkout device 30 and notifies the customer to that effect (S24).

The customer who has received the notification moves to a predetermined checkout device for store clerk 30 and performs checkout processing there. The clerk who operates the clerk's checkout device 30, for example, judges whether the customer satisfies the age limit based on the appearance of the customer, and requests the presentation of an identification card or the like for age confirmation as necessary. After confirming that the age limit is satisfied, the store clerk can perform the checkout process while including the age-restricted product in the product list to be accounted for. On the other hand, when it is confirmed that the age limit is not met, the store clerk can delete the age-restricted product from the product list to be accounted for and perform the settlement process for the remaining products.

Here, a modified example of the flow of the processing will be described. If the result of S23 is "Yes" (if the determination unit 14 determines that the age condition is satisfied), the settlement system 10 may notify the customer who operates the settlement system 10 to that effect. For example, the response unit 15 may display a message such as "Product A is an age-restricted product, but we have determined that the customer is XX years old or older." Also, a message such as "Is the judgment result correct?" may be displayed, and an input of "yes" or "no" may be further accepted. In this way, when the determination unit 14 determines that the age condition is met, the response unit 15 notifies the customer that the age condition has been determined, and if the customer is incorrect, a message prompting the customer to enter that effect. may be notified to the customer.

Another modified example of the flow of the processing will be described. This is based on the premise that the content of the age condition (the value of M) is determined for each product or each product category. If a plurality of age-restricted products are included as a result of the determination in S22, in S23, the determination unit 14 can specify age conditions for each of the plurality of products, and determine whether each satisfies them. In this case, if it is determined that the age conditions for all age-restricted products are met, it can proceed to Yes, and if it is determined that at least one age-restricted product does not meet the age conditions, it can proceed to No.

Next, an example of the processing flow of the settlement system 10 of the present embodiment will be described using the flowchart of FIG. 8 .

In S30, the product registration unit 13 accepts product registration. The customer can, for example, operate a code reader of the settlement system 10 to read the code, operate a button of the settlement system 10, or photograph the product to be accounted with the camera of the settlement system 10. to the settlement system 10. After identifying the product based on the input information, the product registration unit 13 acquires the product information (price, product name, etc.) of the product from the product master and registers it as an accounting object.

In S31, the product registration unit 13 determines whether or not the registered product is the first age-restricted product based on the list shown in FIG. 4, for example. "First age-restricted product" means the first age-restricted product registered by the customer. This does not apply to the second and subsequent age-restricted products registered by the customer.

If the product registered in S30 is not the first age-restricted product ("No" in S31), the process proceeds to S34. On the other hand, if the product registered in S30 is the first age-restricted product ("Yes" in S31), the determination unit 14 determines whether the age of the customer estimated by the estimation unit 12 satisfies the age condition ( S32).

In addition, in response to the detection that the first age-restricted product has been registered in S31, the imaging unit 11 generates a customer's facial image, the estimating unit 12 estimates the customer's age based on the facial image, The determination unit 14 may make the above determination based on the estimation result of the estimation unit 12 .

In addition, the imaging unit 11 may generate a customer's face image at an arbitrary timing different from the above, the estimation unit 12 may estimate the customer's age based on the face image, and store the result. Then, the determination unit 14 may read the stored information and perform the above determination.

If it is determined in S32 that the age condition is satisfied ("Yes" in S32), the process proceeds to S34. On the other hand, if it is determined in S32 that the age condition is not satisfied ("No" in S32), the corresponding unit 15 raises a flag indicating that settlement is not possible (S33). After that, the process proceeds to S34.

If there is no instruction input to start the settlement process ("No" in S34), the same process is repeated. On the other hand, if there is an instruction input to start the settlement process ("Yes" in S34), the state of the settlement impossible flag is checked (S35).

If the settlement impossible flag is not set ("No" in S35), the settlement unit 16 performs settlement processing (S37). For example, the settlement unit 16 may accept the insertion of cash as payment for the total amount of payment calculated based on the products registered so far, and may output change or a receipt as necessary. Also, the settlement unit 16 may accept the insertion of a credit card, communicate with the system of the credit company, and perform settlement processing.

On the other hand, if the settlement is not possible flag is set ("Yes" in S35), the response unit 15 transmits the registration information to the store clerk's settlement device 30 and notifies the customer to that effect (S36).

The customer who has received the notification moves to a predetermined checkout device for store clerk 30 and performs checkout processing there. The clerk who operates the clerk's checkout device 30, for example, judges whether the customer satisfies the age limit based on the appearance of the customer, and requests the presentation of an identification card or the like for age confirmation as necessary. After confirming that the age limit is satisfied, the store clerk can perform the checkout process while including the age-restricted product in the product list to be accounted for. On the other hand, when it is confirmed that the age limit is not met, the store clerk can delete the age-restricted product from the product list to be accounted for and perform the settlement process for the remaining products.

Here, a modified example of the flow of the processing will be described. In S31, "whether or not the product is the first age-restricted product" is determined. That is, the processing of S32 and S33 may be performed each time an age-restricted product is registered. It should be noted that the processing load on the computer can be reduced if the processing is performed only when the first age-restricted product is registered.

Here, another modified example of the flow of the processing will be described. This is based on the premise that the content of the age condition (the value of M) is determined for each product or each product category. In S31, "whether or not it is the first age-restricted product" is determined. small or not)" may be determined. "If the product is not an age-restricted product" and "If the product is an age-restricted product but the age conditions are looser or the same as those of the previously registered age-restricted product (M is greater or equal)" is No. On the other hand, if "the product is an age-restricted product and the age conditions are stricter than those of the previously registered age-restricted product (M is small)," If there is no product”, the answer is Yes. In the case of the modification, too, it is possible to avoid the inconvenience of unnecessary processes such as determining whether the age condition is satisfied, transmitting a face image, and receiving an answer. As a result, the processing load on the computer is reduced.

As another modified example, when the result of S32 is "Yes" (when the determination unit 14 determines that the age condition is satisfied), the fact may be notified to the customer who operates the settlement system 10 . For example, the response unit 15 may display a message such as "Product A is an age-restricted product, but we have determined that the customer is XX years old or older." Also, a message such as "Is the judgment result correct?" may be displayed, and an input of "yes" or "no" may be further accepted. In this way, when the determination unit 14 determines that the age condition is met, the response unit 15 notifies the customer that the age condition has been determined, and if the customer is incorrect, a message prompting the customer to enter that effect. may be notified to the customer.

According to the settlement system 10 of the present embodiment described above, a method different from that of the settlement system 10 of the first embodiment can achieve the same effects as those of the settlement system 10 of the first embodiment. As a result, the width of the design spreads.

Here, a modified example in which the processing of the first embodiment and the processing of the second embodiment are combined will be described.
First, the settlement system 10 receives an "input as to whether or not to permit photographing of a face image" from a customer. For example, when an age-restricted product is registered as an accounting object, the settlement system 10 may output information prompting the input and accept the input. Note that the settlement system 10 may receive the above input at other timings.

When an age-restricted product is registered as an accounting object and an input permitting photographing of a face image is received, the estimation unit 12 estimates the customer's age based on the customer's face image generated by the imaging unit 11. do. Next, the determination unit 14 determines whether the customer's age estimated by the estimation unit 12 satisfies the age condition.

If the determination unit 14 determines that the age condition is not satisfied, the response unit 15 asks the customer, "Do you permit transmission of customer information (e.g., face image, ID image, etc.) for determining the customer's age? input of whether or not” is accepted. Upon receiving an input permitting transmission, the response unit 15 transmits the customer information to another device (external device 20). The process of transmitting customer information to another device (external device 20) is as described in the first embodiment. On the other hand, when receiving an input not to permit transmission, the response unit 15 transmits the product registration information to the cashier's checkout device 30 . The process of transmitting the product registration information to the store clerk's checkout device 30 is as described in the second embodiment.

Also, when an age-restricted product is registered as an object of accounting and an input not to permit photographing of a face image is received, the corresponding unit 15 transmits product registration information to the salesclerk's checkout device 30 . The process of transmitting the product registration information to the store clerk's checkout device 30 is as described in the second embodiment.

The decision as to whether or not to photograph a face image and whether or not to transmit information for judging age may be made at any timing before the start of product registration, when registering age-confirmed products, or after registering all products and before settlement.

Also in this modified example, the same effects as those of the first and second embodiments can be achieved. In addition, it is possible to perform processing that meets the customer's request.

Examples of reference forms are added below.
1. imaging means for generating a customer's face image;
estimating means for estimating the age of the customer based on the face image;
product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
a settlement means for settlement of the goods;
determining means for determining whether an age condition is satisfied based on the age of the customer estimated by the estimating means when the product registration means detects registration of the age-restricted product;
response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
payment system.
2. In the settlement system described in 1,
The corresponding means is a checkout system that transmits the registration information to a checkout device operated by a store clerk.
3. 2. In the payment system described in 2,
The settlement system in which the response means notifies the customer of information specifying the settlement device that transmitted the registration information.
4. In the settlement system described in 1,
The settlement system, wherein the response means receives a response from the other device as to whether or not the customer can be sold to the customer after transmitting the customer information to the other device.
5. In the settlement system according to any one of 1 to 4,
The corresponding means, when the determining means determines that the age condition is satisfied, is a settlement system for notifying the customer to that effect.
6. In the settlement system according to any one of 1 to 5,
When the determination means determines that the age condition is satisfied, the response means notifies the customer that the age condition is determined to be satisfied, and if the customer is incorrect, displays a message prompting an input to that effect. A checkout system that notifies the customer.
7. the computer
an imaging step of generating a face image of the customer;
an estimation step of estimating the age of the customer based on the face image;
a product registration step of accepting product registration by the customer and detecting registration of an age-restricted product;
a checkout step of checking out the merchandise;
a determination step of determining whether an age condition is met based on the age of the customer estimated in the estimation step when registration of the age-restricted product is detected in the product registration step;
a response step of transmitting the registration information of the product registered in the product registration step or the customer information for judging the age of the customer to another device when it is determined that the age condition is not satisfied;
Checkout method to perform.
8. the computer,
imaging means for generating a customer's face image;
estimation means for estimating the age of the customer based on the face image;
Product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
settlement means for settlement of the goods;
Determination means for determining whether an age condition is met based on the age of the customer estimated by the estimation means when the registration of the age-restricted product is detected by the product registration means;
Response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
A program that acts as a

1A processor 2A memory 3A input/output I/F
4A Peripheral circuit 5A Bus 10 Settlement system 11 Imaging unit 12 Estimation unit 13 Merchandise registration unit 14 Judgment unit 15 Corresponding unit 16 Settlement unit 20 External device 30 Settlement device for store clerk

Claims (11)

imaging means for generating a customer's face image;
estimating means for estimating the age of the customer based on the face image;
product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
a settlement means for settlement of the goods;
determining means for determining whether an age condition is satisfied based on the age of the customer estimated by the estimating means when the product registration means detects registration of the age-restricted product;
response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
A settlement system that allows customers to process settlement by themselves . 2. The settlement system according to claim 1, wherein said customer information includes a facial image of said customer. In the settlement system according to claim 1 or 2,
The settlement system, wherein the response means receives a response from the other device as to whether or not the customer can be sold to the customer after transmitting the customer information to the other device. In the settlement system according to any one of claims 1 to 3,
The other device is a mobile terminal operated by a store clerk,
The settlement system, wherein the corresponding means transmits the customer information to the portable terminal when it is determined that the age condition is not satisfied. In the settlement system according to claim 4,
The mobile terminal is a settlement system including either a smart phone or a tablet. In the settlement system according to claim 1 ,
The corresponding means is a checkout system that transmits the registration information to a checkout device operated by a store clerk. In the settlement system according to claim 6 ,
The settlement system in which the response means notifies the customer of information specifying the settlement device that transmitted the registration information. In the settlement system according to any one of claims 1 to 7 ,
The corresponding means, when the determining means determines that the age condition is satisfied, is a settlement system for notifying the customer to that effect. In the settlement system according to any one of claims 1 to 8 ,
When the determination means determines that the age condition is satisfied, the response means notifies the customer that the age condition is determined to be satisfied, and if the customer is incorrect, displays a message prompting an input to that effect. A checkout system that notifies the customer. the computer
an imaging step of generating a face image of the customer;
an estimation step of estimating the age of the customer based on the face image;
a product registration step of accepting product registration by the customer and detecting registration of an age-restricted product;
a checkout step of checking out the merchandise;
a determination step of determining whether an age condition is met based on the age of the customer estimated in the estimation step when registration of the age-restricted product is detected in the product registration step;
a response step of transmitting the registration information of the product registered in the product registration step or the customer information for judging the age of the customer to another device when it is determined that the age condition is not satisfied;
A checkout method that allows customers to self- checkout. A program for realizing the settlement system according to claim 1,
the computer,
imaging means for generating a customer's face image;
estimation means for estimating the age of the customer based on the face image;
Product registration means for accepting product registration by the customer and detecting registration of age-restricted products;
settlement means for settlement of the goods;
Determination means for determining whether an age condition is met based on the age of the customer estimated by the estimation means when the registration of the age-restricted product is detected by the product registration means;
Response means for transmitting to another device the product registration information registered by the product registration means or customer information for judging the age of the customer when it is determined that the age condition is not satisfied;
A program that acts as a

Images