JP2022012399A - Information processing device, method for controlling information processing device, and program - Google Patents

Abstract

To solve the problem that, in the case that a user performs a settlement of a commodity with the electronic money having an upper limit when leaving a shop in which commodities are sold in an unmanned manner, the user has to return a commodity to an original place in the shop where the commodity was placed because settlement cannot be performed dues to balance shortage of electronic money.SOLUTION: Balance information showing the balance of electronic money is acquired from a storage device held by a user, and a total amount of commodities obtained by the user is specified by using an image picked up by imaging means for imaging the inside of a shop. If the specified total amount exceeds the balance, information for making the user recognize that the total amount exceeds the balance is outputted to the user.SELECTED DRAWING: Figure 7

Description

The present invention relates to an information processing apparatus, a control method of the information processing apparatus, and a program.

In the past, in stores such as supermarkets and mass merchandisers, it was common for customers to select the displayed products and have the clerk perform the settlement process at the cash register corner, but the number of cash registers to reduce labor costs and equipment costs. There was a problem that the area around the cash register was crowded without increasing the number of items. In Patent Document 1, a plurality of cameras installed in a store are used to photograph a customer to identify the customer, and the behavior of the customer is photographed to recognize which customer possesses which product. When leaving the store, payment is automatically made by the payment method registered in advance by the customer. As a result, since cash is not delivered, the customer side can shorten the time required for shopping.

JP-A-2019-14504

However, in Patent Document 1, when payment is made using electronic money with an upper limit, when the customer tries to make a payment, the electronic money cannot be settled due to insufficient balance, and the customer has the product in the store. It can be a hassle to go back to the place.

An object of the present invention is to provide a technique capable of preventing a shortage of the balance of electronic money when performing a payment process using electronic money having an upper limit.

In order to solve the above-mentioned problems, the present invention uses an acquisition means for acquiring balance information indicating the balance of electronic money from a storage device possessed by the user and an image captured by an image pickup means for imaging the inside of the store. When the specific means for specifying the total amount of goods picked up by the user and the total amount specified by the specific means exceed the balance indicated by the balance information acquired by the acquisition means, the user is notified. It is characterized by including an output means for outputting information for recognizing that fact.

According to the present invention, it is possible to prevent the balance of electronic money from becoming insufficient when performing payment processing using electronic money having an upper limit.

It is a schematic diagram which shows an example of the store which concerns on 1st Embodiment. It is a block diagram which shows an example of the function and composition of the image processing apparatus which concerns on 1st Embodiment and the member connected | movement | movement | apparatus, and the member connected to it. It is a figure which shows an example of the hardware composition of the image processing apparatus which concerns on 1st Embodiment. It is an example of a data structure showing the relationship between a person managed by the image processing apparatus according to the first embodiment and monetary information. It is an example of a data structure showing the relationship between a person and a product managed by the image processing apparatus according to the first embodiment. It is an example of the data structure of the information about the product in the store managed by the image processing apparatus which concerns on 1st Embodiment. This is an example of notifying that the balance is insufficient in the display function of the terminal device by the notification instruction from the image processing device according to the first embodiment. It is a flowchart which shows an example of the process which the image processing apparatus which concerns on 1st Embodiment executes from the time when a customer comes to a store to the time when a customer leaves a store. This is an example of notifying that there is no product that can be purchased with the balance in the store by the display function of the terminal device by the notification instruction from the image processing device according to the second embodiment. It is a flowchart which shows an example of the process which the image processing apparatus which concerns on 2nd Embodiment executes from the time when a customer comes to a store to the time when a customer leaves a store. This is an example of notifying that the balance is insufficient in the display function of the terminal device by the notification instruction from the image processing device according to the third embodiment. It is a flowchart which shows an example of the process which the image processing apparatus which concerns on 3rd Embodiment executes from the time when a customer comes to a store to the time when a customer leaves a store. This is an example of notifying that the balance is insufficient in the display function of the terminal device by the notification instruction from the image processing device according to the fourth embodiment. It is a flowchart which shows an example of the process which the image processing apparatus which concerns on 4th Embodiment executes from the time when a customer comes to a store to the time when a customer leaves a store.

Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. The following embodiments are merely examples, and are not intended to limit the scope of the present invention. In the drawings, the same or similar configurations are given the same reference numbers, and duplicate explanations are omitted.

<First Embodiment>
FIG. 1 is a schematic diagram showing an example of a store 100 according to the first embodiment. The store 100 is provided with a store entrance 101, a store exit 105, a store camera 108, a voice notification device 109, and a product shelf 110, and the store 100 has a customer 111.

The customer 111 carries a terminal device (storage device) 112 such as a smartphone that has a display function and can be connected to a network. The terminal device 112 may be an IC card. In that case,
The store entrance 101 is provided with a money information reading device 102, an entrance camera 103, and an entrance gate 104. Further, the store exit 105 is provided with an exit camera 106 and an exit gate 107. A plurality of store entrances 101 and a plurality of store exits 105 may be installed.

At the store entrance 101, as a process of entering the store of the customer (user) 111, money information (the upper limit amount of electronic money that the customer 111 can use at the time of entering the store) and money information (the upper limit amount of electronic money that the customer 111 can use at the time of entering the store) and the money information from the terminal device 112 of the customer 111 by the currency information reading device 102. Read the terminal information of the terminal device 112. Then, the entrance camera 103 takes a picture of the customer 111 who has read the money information by the money information reading device 102, and the entrance gate 104 is opened.

In the store 100, the video data of the store camera 108 is analyzed to recognize the product possessed by the customer 111.

At the store exit 105, when the customer 111 is detected by analyzing the video data of the exit camera 106, the store exit process is performed based on the monetary information of the customer 111 and the product possessed by the customer 111, and the exit is processed. Open the gate 107.

FIG. 2 is a block diagram showing an example of the functions and configurations of the image processing device (information processing device) 200 according to the first embodiment and the members connected to the image processing device (information processing device) 200. Each block shown here can be realized by an element such as a computer CPU or a mechanical device in terms of hardware, and by a computer program or the like in terms of software, but here, it is realized by their cooperation. The functional blocks are described. Therefore, it is understood by those skilled in the art who have touched this specification that these functional blocks can be realized in various forms by combining hardware and software.

The image processing device 200 is connected to the image pickup device 201 (corresponding to various cameras in FIG. 1), the money information reading device 102, the voice notification device 109, the terminal device 112, and the Internet via a network (not shown in FIG. 1). To. Further, it has an operation unit 202 that performs various operations, a setting unit 212 that sets various operations of the operation unit 202, and a storage unit 213 that stores data. Further, the operation unit 202 includes an image acquisition unit 203, a detection unit 204, a money information association unit 207, a product association unit 208, a settlement determination unit 209, a notification instruction unit 210, and a settlement unit 211.

The image acquisition unit 203 acquires an image from the image pickup device 201 and stores it in the storage unit 213.

The detection unit 204 includes a person detection unit 205 and a product detection unit 206. The person detection unit 205 detects a person included in the image. The product detection unit 206 detects a product picked up by a person included in the image. Further, the product detection unit 206 tracks the detected product with a plurality of consecutive images in chronological order, so that the customer 111 picks up the product from the product shelf 110 or returns the product to the product shelf 110. Identify the product.

The money information association unit 207 acquires money information from the money information reading device 102, associates it with the information of the person who owns the money information detected by the person detection unit 205, and stores it in the storage unit 213. The management of data representing the relationship between this person and monetary information will be described later with reference to FIG.

The product association unit 208 associates the information of the product detected by the product detection unit 206 with the information of the person who picks up the product and stores it in the storage unit 213. The management of data representing the relationship between the person and the product will be described later with reference to FIG.

When the information of the product associated with the person by the product association unit 208 is changed, the settlement determination unit 209 of the product is based on the monetary information associated with the person by the money information association unit 207. Determine if the total amount is settleable.

The notification instruction unit (output unit) 210 instructs the voice notification device 109 and the terminal device 112 closest to the customer 111 to give a predetermined notification when the payment determination unit 209 determines that the amount cannot be settled. .. At this time, the voice notification device 109 is instructed to be notified by voice, and the terminal device 112 is instructed to be notified by the display function of the terminal device 112. As another embodiment, a notification instruction may be given to either the voice notification device 109 or the terminal device 112. However, when the terminal device 112 is an IC card, the notification instruction unit 210 instructs the voice notification device 109 to notify by voice.

The settlement unit 211 makes a settlement request to an external electronic money settlement server (not shown) based on the total amount of money information and goods associated with the person by the currency information association unit 207.

FIG. 3 is a diagram showing an example of the hardware configuration of the image processing apparatus 200 according to the first embodiment. The image processing device 200 includes a CPU 301, a ROM 302, a RAM 303, a hard disk drive (HDD) 304, an input device 305, a display device 306, a disk drive 307, and a network interface 308. The network interface 308 is connected to the network 309.

The CPU 301 is a control device that controls the image processing device 200 in an integrated manner.

The ROM 302 stores a program for the CPU 301 to control the image processing device 200. A secondary storage device may be provided instead of the ROM 302.

The RAM 303 is a memory for expanding a program read from the ROM 302 by the CPU 301 and executing processing. The RAM 303 is also used as a temporary storage memory as a storage area for temporarily storing data to be processed in various ways.

The HDD 304 stores image data and data to be processed. The CPU 301 reads out image data and data to be processed from the HDD 304.

The input device 305 includes a keyboard for inputting data such as numerical values, a pointing device for instructing a display position of a display area of the display device 306, a mouse, a touch panel, and the like.

The display device 306 is a device such as a display that displays an image or an area frame.

The disc drive 307 reads the image data in the CD, DVD, Blu-ray disc, or flexible disc, and the CPU 301 acquires the image data via the disc drive 307. When the CPU 301 inputs image data from the HDD 304 or the network interface 308, the disk drive 307 may not be necessary.

The network interface 308 is a circuit that communicates via the network 309. The CPU 301 acquires image data from an external device (for example, the image pickup device 201) via the network 309. The CPU 301 transmits an instruction to the external voice notification device 109 and the terminal device 112 via the network 309.

As described above, the hardware configuration of the image processing apparatus 200 has the same hardware components as those mounted on a general PC (personal computer). Therefore, it is possible to implement various functions realized by the image processing apparatus 200 as software that operates on a PC. The image processing device 200 can realize various functions of the image processing device by executing a program by the CPU 301.

FIG. 4 is an example of a data structure showing a relationship between a person managed by the image processing apparatus 200 according to the first embodiment and monetary information.

The person identifier 401 is an identifier for identifying the customer 111. The person identifier 401 is issued when the person detection unit 205 detects the customer 111 from the image data taken by the entrance camera 103 of the store entrance 101.

The monetary information 402 is an upper limit amount (balance information) of electronic money that can be used by the customer 111 indicated by the person identifier 401. The money information 402 is read from the terminal device 112 of the customer 111 by the money information reading device 102 of the store entrance 101, and is acquired by the money information associating unit 207.

The terminal information 403 is an identifier for identifying a terminal possessed by the customer 111 indicated by the person identifier 401. The terminal information 403 is read from the terminal device 112 of the customer 111 by the money information reading device 102 of the store entrance 101, and is acquired by the money information associating unit 207. Further, although not shown in FIG. 4, information for notifying the terminal device 112 when the balance of electronic money is insufficient is also managed by the image processing device 200. The information for notifying the terminal device 112 is, for example, an e-mail address of an e-mail that can be viewed on the terminal device 112. Further, when a store-dedicated application is installed in the terminal device 112, it is information necessary for notifying the application.

FIG. 5 is an example of a data structure showing the relationship between a person and a product managed by the image processing apparatus 200 according to the first embodiment.

The person identifier 501 is an identifier for identifying the customer 111, and is the same as the person identifier 401.

The product 502 is a product picked up by the customer 111. The product 502 is detected by the product detection unit 206.

The price 503 is the price of the product 502. The management of information on the products in the store, including the price 503, will be described later with reference to FIG.

The number 504 is the number of products picked up by the customer 111. The number 504 is detected by the product detection unit 206.

The total amount of money 505 is the total amount of goods picked up by the customer 111.

FIG. 6 is an example of a data structure of information about a product in a store 100 managed by the image processing device 200 according to the first embodiment.

The product type 601 is a product type. The product 602 is an identifier for identifying each product in the same product type 601 and is the same as the product 502. The price 603 is the price of the product 602, which is the same as the price 503.

FIG. 7 is an example of notifying that the balance is insufficient by the display function of the terminal device 112 by the notification instruction from the image processing device 200 according to the first embodiment.

Reference numeral 701 is a display unit of the terminal device 112. Reference numeral 702 is a message notifying the customer 111 displayed on the display unit 701 that the balance is insufficient. When the image processing device 200 gives a notification instruction to the terminal device 112 by e-mail, the message is displayed by the customer opening the e-mail. Further, when the image processing device 200 gives a notification instruction to the terminal device 112 using the dedicated application, the notification is displayed by the push notification by the dedicated application.

As another embodiment, when the image processing device 200 gives a notification instruction to the terminal device 112 using the dedicated application, the notification is given by operating the vibration function of the terminal device 112 via the dedicated application. Is also good.

FIG. 8 is a flowchart showing an example of processing executed by the image processing apparatus 200 according to the first embodiment from the time when the customer 111 comes to the store to the time when the customer 111 leaves the store. Each process shown in FIG. 8 is executed by each functional unit included in the image processing device 200.

In step S801, the image processing device 200 acquires the money information 402 and the terminal information 403 of the customer 111 from the money information reading device 102.

In step S802, the image processing device 200 acquires image data taken by the customer 111 who acquired the monetary information 402 in step S801 from the entrance camera 103.

In step S803, the image processing device 200 analyzes the image data acquired in step S802 to detect the customer 111. Then, the person identifier 401 for identifying the customer 111 is issued.

In step S804, the image processing apparatus 200 stores the person identifier 401 issued in step S803, the monetary information 402 acquired in step S802, and the terminal information 403 in association with each other.

In step S805, the image processing device 200 acquires image data taken in the store 100 from the store camera 108 in order to perform analysis in step S806. In addition, image data taken around the store exit 105 is acquired from the exit camera 106.

In step S806, the image processing apparatus 200 analyzes the image data acquired in step S805.

In step S807, the image processing apparatus 200 proceeds to step S808 when the product 502 picked up by the customer 111 is detected as a result of the analysis in step S806, or when the customer 111 is detected at the store exit 105. On the other hand, if neither is detected by the image processing apparatus 200, the process returns to step S805.

In step S808, when the image processing apparatus 200 detects the product 502 picked up by the customer 111 as a result of the analysis in step S806, the image processing apparatus 200 performs an operation of picking up the product 502 from the product shelf 110 or returning the product 502. Therefore, the process proceeds to step S809. On the other hand, when the image processing apparatus 200 detects the customer 111 at the store exit 105 in step S806, it determines that the payment has been made and proceeds to step S812.

In step S809, the image processing device 200 stores the information of the person identifier 401 issued in step S803 and the information of the product 502 detected in step S806 in association with each other. As a result of the analysis in step S806, when the customer 111 is operating to return the product 502 to the product shelf 110, in step S809, the image processing device 200 associates the returned product 502 with the customer 111. To release.

In step S810, the image processing device 200 determines whether or not the total amount of goods 505 is a receivable amount based on the monetary information 402 of the customer 111. If the total amount of goods 505 is a receivable amount, the process returns to step S805, and if not, the process proceeds to step S811.

In step S811, the image processing device 200 transmits an instruction to notify the customer 111 that the balance is insufficient to the voice notification device 109 and the terminal device 112 closest to the customer 111. At this time, the voice notification device 109 is instructed to be notified by voice, and the terminal device 112 is instructed to be notified by the display function of the terminal device 112. After transmitting the instruction, the process returns to step S805.

In step S812, the image processing device 200 transmits a payment request to an external electronic money payment server (not shown) based on the monetary information 402 of the customer 111 and the total amount of the product 505, and ends the processing. ..

As described above, according to the first embodiment, it is possible to notify that the balance of the electronic money is insufficient before the payment processing by the electronic money is performed, so that the customer can charge the electronic money or return the product. It is possible to take measures such as taking measures such as. That is, it is possible to prevent the balance of electronic money from becoming insufficient when performing payment processing using electronic money.

<Second embodiment>
In the second embodiment, in addition to the processing of the first embodiment described above, when there is no product that can be purchased with the balance of electronic money in the store 100, the method of notifying the customer 111 to that effect. explain. In the following, the same contents as those of the first embodiment will be omitted, and the contents peculiar to the second embodiment will be described.

FIG. 9 is an example of notifying that there is no product that can be purchased with the balance of electronic money in the store 100 by the display function of the terminal device 112 by the notification instruction from the image processing device 200 according to the second embodiment.

902 is a message notifying the customer 111 that there is no product that can be purchased with the balance in the store 100. When the image processing device 200 gives a notification instruction to the terminal device 112 by e-mail, the message is displayed by the customer opening the e-mail. Further, when the image processing device 200 gives a notification instruction to the terminal device 112 using the dedicated application, the notification is displayed by the push notification by the dedicated application.

FIG. 10 is a flowchart showing an example of processing executed by the image processing apparatus 200 according to the second embodiment from the time when the customer 111 comes to the store to the time when the customer 111 leaves the store. In FIG. 10, the processes of steps S1013 and S1014 are added to the processes of FIG.

In step S1013, the image processing device 200 determines whether or not there is a product that can be purchased with the balance of electronic money in the store 100 based on the monetary information 402 of the customer 111 and the total amount of the product 505. In order to make this determination, the image processing device 200 holds data on the price of the cheapest product in the store 100 in advance. If there is a product that can be purchased with the balance in the store 100, the process returns to step S805, and if not, the process proceeds to step S1014.

In step S1014, the image processing device 200 transmits an instruction to the voice notification device 109 and the terminal device 112 closest to the customer 111 to notify the customer 111 that there is no product that can be purchased with a balance in the store 100. do. At this time, the voice notification device 109 is instructed to be notified by voice, and the terminal device 112 is instructed to be notified by the display function of the terminal device 112. After transmitting the instruction, the process returns to step S805.

As described above, according to the second embodiment, the customer knows that there is no more product that can be purchased with the current balance of electronic money after picking up the product and before picking up the next product. It becomes possible.

<Third embodiment>
In the first embodiment described above, when the total amount of goods 505 is not the amount that can be settled, the customer 111 is only notified that the balance is insufficient. In the third embodiment, in addition to the insufficient balance, a method of notifying the combination of products that maximizes the total price of the products in the balance will be described. In the following, the same contents as those of the first embodiment will be omitted, and the contents peculiar to the third embodiment will be described.

FIG. 11 is an example of notifying that the balance is insufficient by the display function of the terminal device 112 by the notification instruction from the image processing device 200 according to the third embodiment.

Reference numeral 1102 is a message notifying the customer 111 that the balance is insufficient and the combination of products that maximizes the total price of the products within the balance (less than or equal to the balance). When the image processing device 200 gives a notification instruction to the terminal device 112 by e-mail, the message is displayed by the customer opening the e-mail. Further, when the image processing device 200 gives a notification instruction to the terminal device 112 using the dedicated application, the notification is displayed by the push notification by the dedicated application.

FIG. 12 is a flowchart showing an example of processing executed by the image processing apparatus 200 according to the third embodiment from the time when the customer 111 comes to the store to the time when the customer 111 leaves the store. In FIG. 12, the process of step S1213 is added to the process of FIG.

In step S1213, the image processing device 200 obtains a combination of products having the maximum total price of the products in the balance based on the monetary information 402 of the customer 111 and the price 503 of the products. Then, the obtained combination of products is used for the notification instruction in step S811.

As described above, according to the third embodiment, the customer can know the combination of products that can be purchased by making the maximum use of the current balance of electronic money.

<Fourth Embodiment>
In the first embodiment described above, when the total amount of goods 505 is not the amount that can be settled, the customer 111 is only notified that the balance is insufficient. In the fourth embodiment, in addition to the insufficient balance, when there is an alternative product lower than the price in the store 100, a method of notifying the combination of the products including the alternative product will be described. In the following, the same contents as those of the first embodiment will be omitted, and the contents peculiar to the fourth embodiment will be described.

FIG. 13 is an example of notifying that the balance is insufficient by the display function of the terminal device 112 by the notification instruction from the image processing device 200 according to the fourth embodiment.

Reference numeral 1302 is a message notifying the customer 111 that the balance is insufficient and that the combination of products including the substitute product is notified when the substitute product (similar product) having a price lower than the price exists in the store 100. When the image processing device 200 gives a notification instruction to the terminal device 112 by e-mail, the message is displayed by the customer opening the e-mail. Further, when the image processing device 200 gives a notification instruction to the terminal device 112 using the dedicated application, the notification is displayed by the push notification by the dedicated application.

FIG. 14 is a flowchart showing an example of processing executed by the image processing apparatus 200 according to the fourth embodiment from the time when the customer 111 comes to the store to the time when the customer 111 leaves the store. In FIG. 14, the process of step S1413 is added to the process of FIG.

In step S1413, the image processing device 200 has the same product type and price in the store 100 based on the monetary information 402 and the product 502 of the customer 111 and the information about the product in the store described above in FIG. Identify if there is a cheaper alternative. Then, if there is an alternative product, a combination of products including the alternative product is obtained. Then, it is used for the notification instruction in step S811.

As described above, according to the fourth embodiment, when the balance is insufficient, the customer can shop without reducing the number of products to be purchased.

<Fifth Embodiment>
In each of the above-described embodiments, after the product 502 picked up by the customer 111 is detected, it is determined whether the total price of the products 505 is a settleable amount. In the fifth embodiment, before the customer 111 picks up the product 502, it is determined whether the total price of the product 505 is the amount that can be settled if it is assumed that the customer 111 picks up the product 502.

Specifically, the image processing device 200 detects the moving direction of the customer 111's hand, and when the distance between the customer 111's hand and the product 502 to which the customer 111's hand has moved reaches a predetermined distance, It is regarded as the product 502 picked up by the customer 111. Then, the image processing apparatus 200 executes the processing after step S808 in FIG.

As described above, according to the fifth embodiment, when the balance of electronic money is insufficient, the customer can know the balance shortage before picking up the product, so that it takes time and effort to return the product to the product shelf. It can be omitted.

Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various embodiments within the range not deviating from the gist of the present invention are also included in the present invention. included. In addition, some of the above-described embodiments may be combined as appropriate.

Then, when a software program that realizes the functions of the above-described embodiment is supplied to a system or device having a computer capable of executing the program directly from a recording medium or by using wired / wireless communication, the program is executed. Is also included in the present invention. Therefore, in order to realize the functional processing of the present invention on a computer, the program code itself supplied and installed on the computer also realizes the present invention. That is, the computer program itself for realizing the functional processing of the present invention is also included in the present invention. In that case, as long as it has the function of the program, the form of the program such as the object code, the program executed by the interpreter, the script data supplied to the OS, etc. does not matter.

The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / optical magnetic storage medium, or a non-volatile semiconductor memory. Further, as a method of supplying the program, a method is conceivable in which the computer program forming the present invention is stored in a server on the computer network, and the connected client computer downloads and programs the computer program.

200 Image processing device 202 Operation unit 203 Image acquisition unit 204 Detection unit 205 Human body detection unit 206 Product detection unit 207 Money information association unit 208 Product association unit 209 Payment judgment unit 210 Notification instruction unit 211 Payment unit 212 Setting unit 213 Storage unit

Claims (9)

An acquisition means for acquiring balance information indicating the balance of electronic money from a storage device owned by the user, and
A specific means for specifying the total amount of goods picked up by the user using an image captured by an image pickup means for imaging the inside of the store, and a specific means for specifying the total price of the product picked up by the user.
When the total amount of money specified by the specific means exceeds the balance indicated by the balance information acquired by the acquisition means, it is provided with an output means for outputting information for making the user recognize that fact. An information processing device that features it. Further equipped with a management means for managing the amount of each product in the store,
The output means further outputs information for making the user recognize that there is no product that can be purchased when the balance is less than the amount of any product managed by the management means. The information processing apparatus according to claim 1. 1. 2. The information processing apparatus according to 2. The output means is a combination of products whose total amount is equal to or less than the balance among the products picked up by the user when the total amount exceeds the balance, and the total amount of the products within the balance is the maximum. The information processing apparatus according to claim 3, further comprising outputting information on a combination of products. The output means further provides information on a product similar to the product picked up by the user when the total amount exceeds the balance, and the price is cheaper than the product picked up by the user. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing apparatus is to be output. The information processing device according to any one of claims 1 to 5, wherein the output means is a voice notification means that gives a voice notification, or outputs to the storage device. The information processing device according to claim 6, wherein when the storage device is an IC card having a function of performing wireless communication, the output means outputs via the voice notification means. The acquisition process of acquiring balance information indicating the balance of electronic money from the storage device owned by the user, and
A specific process for specifying the total amount of products picked up by the user using an image captured by an imaging means that images the inside of the store, and a specific process.
When the total amount of money specified in the specific step exceeds the balance indicated by the balance information acquired in the acquisition step, it has an output step of outputting information for making the user recognize that fact. A characteristic control method for information processing equipment. A program for making a computer function as each means of the information processing apparatus according to any one of claims 1 to 7.

Images