JP6884719B2 - Information processing device, control method of information processing device, and control program of information processing device - Google Patents

Description

The present invention relates to an information processing device capable of executing processing related to handling of an article in an article providing system for providing an article, a control method of information processing, and a control program of the information processing device.

In recent years, in a place where goods are handled, such as a store or a warehouse, such as an unmanned store where goods are sold unmanned, it is necessary for a person to actually work at the stock place to track the goods removed from the stock place. There are systems that do not. For example, Patent Document 1 describes a computing system in which a processor is used to track the removal or placement of goods at a stock location having a material handling facility.

Special Table 2016-523932

In the system described in Patent Document 1, an imaging device (for example, a camera) is used to track an article removed from a stock location by a user, and a series of the hands before and after the user's hand enters the stock location. Image is taken. Then, based on the comparison of these images, it is determined whether the user has moved the article, that is, whether the article has been excluded from the inventory location or placed in the inventory location. However, if the users are close to each other, there is a problem that an erroneous determination may occur when determining the user who has moved the article.

Therefore, in view of the above-mentioned problems, the present invention can prevent erroneous determination of a user who excludes an article from an inventory location or places an article in the inventory location, and can further improve the determination accuracy of the user in providing the article. An object of the present invention is to provide an apparatus, a control method of an information processing apparatus, a control program of the information processing apparatus, and an article providing system.

The information processing apparatus according to the embodiment of the present invention includes an acquisition unit that acquires identification information associated with a plurality of users who have entered a predetermined space, and a detection unit that detects at least a walking locus of the user in a predetermined space. , An article determination unit that determines whether or not a predetermined change has occurred in a display location where articles in a predetermined space are displayed, a display location that is determined by the article determination unit that a predetermined change has occurred, and walking. Based on the locus, the user determination unit that determines the identification information associated with the settlement information related to the settlement of the goods displayed at the display location where the predetermined change is determined, and the identification information determined by the user determination unit A payment storage unit that stores at least one payment information associated with the identification information and a payment unit that executes payment based on the payment information stored in the payment storage unit are provided, and the user determination unit makes a payment. The identification information associated with the information is determined based on the payment history of the user.

Further, in the information processing device according to the embodiment of the present invention, the user determination unit may determine the identification information associated with the payment information based on the attribute information of the user.

Further, in the information processing device according to the embodiment of the present invention, the user determination unit is provided in the payment space in a predetermined space, and based on the information transmitted from a plurality of types of sensors for detecting an article, the user determination unit is used for payment information. The identification information to be associated may be determined.

Further, the information processing device according to the embodiment of the present invention determines a payment error based on the payment history storage unit that stores the payment history by the payment unit for each user and the payment history, and the payment error occurs. Based on the past determination history in the predetermined space at that time, a payment correction unit that associates the user's identification information related to the payment error with the payment information for resolving the payment error may be further provided.

Further, the information processing apparatus according to the embodiment of the present invention learns information about the state of a predetermined space when a settlement error occurs, and the judgment by the article judgment unit, the judgment by the user judgment unit, and the detection by the detection unit. A learning unit that changes the accuracy of at least one of the above according to the state of a predetermined space may be further provided.

Further, in the information processing device according to the embodiment of the present invention, the payment correction unit receives a return request after the payment is executed by the payment unit, and a plurality of types of articles for which the return request is provided are provided in the payment space. When detected by the sensor, the identification information of the user who received the return request may be associated with the refund process of the item requested to be returned.

Further, in the information processing apparatus according to the embodiment of the present invention, the article determination unit determines that the removal of the product has occurred among the predetermined changes at the display place where the articles are displayed, and the weight after the change is determined. When it becomes larger than before the change, the arrangement of the products may occur within the predetermined change.

Further, in the information processing apparatus according to the embodiment of the present invention, in the article determination unit, the shape of the displayed article group after the change is smaller than that before the change at the display place where the articles are displayed. In this case, if it is determined that the removal of the product has occurred among the predetermined changes and the shape after the change is larger than that before the change, the arrangement of the products may occur among the predetermined changes. ..

Further, in the information processing device according to the embodiment of the present invention, the user determination unit determines the position of the walking locus when a predetermined change occurs from the display location where the predetermined change is determined to have occurred. The identification information associated with the user within the range may be determined as the identification information associated with the payment information relating to the settlement of the goods displayed at the display location where it is determined that the predetermined change has occurred.

Further, the information processing device according to the embodiment of the present invention further includes a limiting unit that controls a limiting means for restricting entry / exit into a predetermined space, and the limiting function is identification information in which payment is executed by the payment unit. The restriction on the user's exit from the predetermined space may be lifted.

Further, the information processing apparatus according to the embodiment of the present invention further includes a user storage unit that stores identification information associated with the user in association with specific information that identifies the user, and the acquisition unit is a predetermined space. The identification information associated with the specific information transmitted from the terminal device of the user who entered the user may be acquired from the identification information stored in the user storage unit.

Further, the information processing device according to the embodiment of the present invention displays the payment information associated with the identification information on the display unit of the terminal device corresponding to the identification information associated with the payment information. It may be further provided with a display output unit for outputting.

The control method of the information processing device according to the embodiment of the present invention includes an acquisition step of acquiring identification information associated with a plurality of users who have entered a predetermined space in the information processing device, and a user's control method in the predetermined space. A predetermined change occurs in at least a detection step of detecting a walking locus, an article determination step of determining whether or not a predetermined change has occurred in a display place where articles in a predetermined space are displayed, and an article determination step. Based on the display location determined to have been processed and the walking locus, a user determination step for determining identification information associated with payment information relating to settlement of goods displayed at the display location determined to have caused a predetermined change, and a user determination step. For each identification information determined by the user determination step, a payment storage step that stores at least one payment information associated with the identification information and a payment that executes payment based on the payment information stored in the payment storage step. The user determination step determines the identification information associated with the payment information based on the payment history of the user.

The control program of the information processing device according to the embodiment of the present invention has an acquisition function of acquiring identification information associated with a plurality of users who have entered a predetermined space in the information processing device, and a user's control program in the predetermined space. A predetermined change is generated by at least a detection function for detecting a walking locus, an article determination function for determining whether or not a predetermined change has occurred at a display place where articles in a predetermined space are displayed, and an article determination function. Based on the display location determined to be, and the walking locus, a user determination function that determines identification information associated with payment information related to payment of goods displayed at the display location determined to have caused a predetermined change, and a user A payment storage function that stores at least one payment information associated with the identification information for each identification information determined by the judgment function, and a payment function that executes payment based on the payment information stored in the payment storage function. The user determination function determines the identification information associated with the payment information based on the user's payment history.

According to the present invention, an information processing device and a control method of an information processing device that can prevent erroneous determination of a user who excludes an article from an inventory location or places an article in the inventory location and further improve the determination accuracy of the user in providing the article. And a control program for an information processing device can be provided.

It is the schematic of the article provision system configuration by one Embodiment of this invention. This is an example of a block diagram of a server (information processing device) according to an embodiment of the present invention. This is an example of a block diagram of a terminal device according to an embodiment of the present invention. It is the schematic explaining the structural example in the store by one Embodiment of this invention. It is the schematic explaining the determination of the user who acquired the product from the display place by one Embodiment of this invention. Both (a) and (b) are schematic views explaining the determination of the user who acquired the product from the display place according to the embodiment of the present invention. When a user enters a store, (a) is an explanatory diagram, (b) is an example of a screen of the user's terminal device, and (c) is an example of identification information stored in a storage unit. When the user executes payment, (a) is an explanatory diagram, (b) is an example of a screen of the user's terminal device, and (c) is an example of payment information stored in a storage unit. (A) is an example of the purchase history stored in the storage unit 130, and (b) is an example of the attribute information. When the user executes payment, (a) is an explanatory diagram of the payment location, and (b) is an example of payment information that is updated and stored in the storage unit. (A) is an example of user attribute information, and (b) is an example of user purchase history. It is an example of the flowchart of the control method of an information processing apparatus according to one Embodiment of this invention. It is an example of the flowchart of the control method of an information processing apparatus according to one Embodiment of this invention. Both (a) and (b) are screen examples of the user's terminal device. It is an example of the flowchart of the control method of an information processing apparatus according to one Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram of an article providing system configuration according to an embodiment of the present invention. The article providing system 500 is a service system that allows the user 400 to acquire and purchase the article even if the manager who provides the article does not exist on the spot. Hereinafter, as an example, a mode in which the provision of goods is an unmanned store in which there is no salesperson or clerk who sells the goods will be described as shown in FIG. As shown in FIG. 1, the article providing system 500 includes at least a server (information processing device) 100, a store 200, a terminal device 300, and a network NET. The server 100 is connected to the store 200 and the terminal device 300 via the network NET. Although two servers 100 are shown in FIG. 1, they may be realized as a larger number of a plurality of server groups, or may be realized independently. In the store 200, a plurality of products (articles) are displayed on product shelves (display locations). Although the details will be described later, the payment of the product purchased by the user 400 at the store 200 is performed by the server 100 or a predetermined payment service via the network NET.

The terminal device 300 is associated with the user 400, and although a smartphone is shown in FIG. 1, any terminal device such as a tablet or a wearable terminal (glasses type, wristwatch type, headset type, etc.) that can be connected to a network can be used. Anything can be used. Further, in FIG. 1, only one terminal device 300 is shown for the sake of simplicity, but it goes without saying that there may be more than one terminal device 300. That is, there may be a plurality of users who enter the store 200. After that, when there are a plurality of users and it is necessary to distinguish them, the users are referred to as users 400A and 400B, and the terminal devices associated with each user are referred to as 300A, 300B and the like. It is preferable that the terminal device 300 is provided by the service side and the application software (hereinafter, also referred to as “application”) for using the store 200 is downloaded. Further, between the terminal device 300 and a predetermined communication device provided in the store 200, a beacon signal using Bluetooth (Bluetooth) (registered trademark), BLE (Bluetooth Low Energy), and an RFID (Radio Frequency IDentifier) standard are used. Short-range wireless communication such as Bluetooth, ultrasonic communication, and infrared communication may be performed.

FIG. 2 is a block diagram of a server (information processing device) 100 according to an embodiment of the present invention. As shown in FIG. 2, the server 100 includes a control unit 110, a communication unit 120, and a storage unit 130. Details will be described later, but the functions of each of these parts will be briefly described.

The control unit 110 is a processor having a function of controlling each unit of the server 100. The control unit 110 includes an acquisition unit 111, a detection unit 112, an article determination unit 113, a user determination unit 114, a settlement unit 115, a restriction unit 116, a settlement correction unit 117, a display output unit 118, and a learning unit 119. The acquisition unit 111 acquires the identification information associated with the user who has entered the predetermined space. The acquisition unit 111 may acquire the identification information associated with the user who has entered the predetermined space from the identification information stored in the storage unit 130. Alternatively, a setting unit (not shown) may set temporary identification information for a user who enters a predetermined space, and the acquisition unit 111 may acquire the temporary identification information. Here, the identification information is information for uniquely identifying each user in the article providing system, and is, for example, an ID (Identifier) including a two-dimensional code such as a combination of alphanumeric characters / symbols and a QR code. It may be a user name or the like.

The detection unit 112 detects at least the walking locus of the user who has entered the predetermined space in the predetermined space. The article determination unit 113 determines whether or not a predetermined change has occurred at the display place where the products in the predetermined space are displayed. In addition, the article determination unit 113 determines that the removal of the product has occurred among the predetermined changes when the weight after the change is smaller than that before the change at the display place where the product is displayed. When the weight after the change becomes larger than that before the change, it is determined that the arrangement of the products has occurred within the predetermined change. Alternatively, when the shape of the displayed product group after the change becomes smaller than that before the change at the display place where the product is displayed, the article determination unit 113 removes the product among the predetermined changes. It is determined that the product has occurred, and when the shape after the change is larger than that before the change, it is determined that the arrangement of the products has occurred among the predetermined changes. The user determination unit 114 determines that the product displayed at the display location where the predetermined change has occurred based on the display location determined by the article determination unit 113 and the walking locus. Determine the identification information associated with the payment information related to the payment. The user determination unit 114 provides identification information associated with a user whose position in the walking locus when a predetermined change occurs is within a predetermined range from the display location where the predetermined change is determined to have occurred. It is determined as identification information associated with the settlement information related to the settlement of the product displayed at the display location where the predetermined change is determined to have occurred. In addition, when the product is removed from the predetermined change, the user determination unit 114 associates the information regarding the purchase of the product (that is, the withdrawal of the charge) with the identification information as the payment information. Further, when the arrangement of the product occurs among the predetermined changes, the user determination unit 114 associates the information regarding the return of the product (that is, the refund of the fee) with the identification information as the payment information. The settlement unit 115 executes settlement based on the settlement information associated with the identification information. In addition, the settlement unit 115 executes a refund process when the settlement information relates to the return of the product.

The restriction unit 116 controls a restriction means for restricting entry / exit to a predetermined space. The limiting means may be, for example, a door key. In addition, the restriction unit 116 controls the restriction means so as to release the restriction on the exit of the user associated with the identification information for which the settlement is executed by the settlement unit 115 from the predetermined space. For example, the restriction unit 116 can release the restriction on the exit of the user associated with the identification information in which the product purchase process or the product return process is executed from the predetermined space. The settlement correction unit 117 determines a settlement error based on the settlement history, and based on the past determination history in a predetermined space when the settlement error occurs, setstles the user's identification information related to the settlement error. Correspond to the payment information that eliminates the error of. Here, the settlement error is a state in which the number of products and the sales amount do not match, for example, the purchase of the product is processed twice or the sales amount is insufficient for the number of pieces. Point to. The display output unit 118 outputs display information for displaying the payment information associated with the identification information on the display unit of the terminal device corresponding to the identification information associated with the payment information. The learning unit 119 learns information about the state of a predetermined space when a settlement error occurs, and has an accuracy of at least one of determination by the article determination unit, determination by the user determination unit, and detection by the detection unit. Is changed according to the state of a predetermined space. The state of the predetermined space refers to the position of the user existing in the predetermined space and the state of the product possessed (corresponding to the identification information). The learning unit 119 learns information about the state of a predetermined space when a settlement error occurs. Then, the learning unit 119 changes the accuracy of at least one of the determination by the article determination unit, the determination by the user determination unit, and the detection by the detection unit according to the state of the predetermined space. For example, when a situation similar to the situation in which the erroneous determination occurred in the past occurs in the store 200, the learning unit 119 causes the learning unit 119 to acquire the detection data of various sensors so as to prevent the erroneous determination in the past. For example, the interval for receiving the detection data from the floor sensor 60 is shortened.

The communication unit 120 includes a reception unit 121 and a transmission unit 122, and has a function of executing communication (transmission / reception of various data) with the store 200 or the terminal device 300 via the network NET according to an instruction from the control unit 110. .. For example, the receiving unit 121 receives the identification information of the user who has entered the predetermined space in response to the instruction of the acquiring unit 111. In addition, the receiving unit 121 receives the data related to the walking locus transmitted from the detecting means installed in the store 200 in response to the instruction of the detecting unit 112. In addition, the receiving unit 121 and the transmitting unit 122 exchange payment information with a server on a predetermined payment service side that executes payment in response to an instruction from the payment unit 115. The transmission unit 122 transmits the display information output by the display output unit 118 for displaying the payment information associated with the identification information on the display unit of the terminal device corresponding to the identification information to the terminal device 300. To do. These communications may be executed by wire or wirelessly, and any communication protocol may be used as long as they can communicate with each other.

The storage unit 130 is typically realized by various recording media such as an HDD (Hard Disc Drive), an SSD (Solid State Drive), and a flash memory, and stores various programs and data required for the server 100 to operate. It has a function to memorize. The storage unit 130 stores (stores) at least one payment information associated with the identification information for each identification information determined by the user determination unit 114. Further, the storage unit 130 may store the identification information associated with the user in advance, or may store each identification information in association with information indicating a payment method or a payment service used for payment. Further, the storage unit 130 stores the payment history (purchase history, return history) of each user. The storage unit 130 also stores information indicating which product is displayed at which position on the product shelf.

Next, the terminal device 300 will be described. As shown in FIG. 3, the terminal device 300 includes a control unit 310, a communication unit 320, a storage unit 330, an input reception unit 340, a display unit 350, a voice interface (I / F) 360, and a speaker 370.

The communication unit 320 includes a reception unit 321 and a transmission unit 322, and has a function of executing communication with the server 100 or with a communication means installed in the store 200 via the network NET. The communication may be executed by wire or wirelessly, and any communication protocol may be used as long as mutual communication can be executed. Further, the communication unit 320 may be used for exchanging data with the authentication device 95 (see FIG. 7) installed in the store 200.

The storage unit 330 has a function of storing various programs and various data required for the terminal device 300 to operate. For example, the storage unit 330 includes information such as an application program necessary for enjoying the service according to the present embodiment. The storage unit 330 is typically realized by various recording media such as an HDD, an SSD, and a flash memory.

The input receiving unit 340 receives the input from the user 400 and transmits the information related to the input to the control unit 310. In the terminal device 300, the input receiving unit 340 is realized by a touch panel or the like, detects contact by a user's finger or an indicator such as a stylus and the contact position, and transmits the coordinates of the contact position to the information processing unit 311. In the present embodiment, the input reception unit 340 receives a user's selection of purchased products, a payment request, and a return request.

The control unit 310 is a processor having a function of controlling each unit of the terminal device 300. The control unit 310 includes an information processing unit 311, a display processing unit 312, and a determination unit 313. The information processing unit 311 has a function of controlling the communication unit 320 to transmit the information to the server 100 according to the information input from the input reception unit 340. The information processing unit 311 also has a function of transmitting the information received from the server 100 by the communication unit 320 to the display processing unit 312. The display processing unit 312 has a function of converting display data transmitted from the information processing unit 311 into pixel information and writing it to the frame buffer of the display unit 350.

The display unit 350 is a monitor having a function of displaying an image according to the display data written in the frame buffer by the display processing unit 312, and is typically realized by a liquid crystal display. The display unit 350 displays various notifications received from the server 100 via the network NET, for example, payment information and warnings. The voice I / F 360 is an interface for a speaker 370 and an earphone (not shown). The payment information may be output by voice or a predetermined warning sound may be output via the voice I / F 360. Further, the payment request from the user may be instructed (input) by voice.

Next, the store 200 will be described with reference to FIGS. 4 and 5. FIG. 4 is a schematic view illustrating a configuration example in the store 200 according to the embodiment of the present invention. After that, when it is not necessary to distinguish between them, the alphabets A and B of the symbols indicating that there are a plurality of symbols in the figure may be omitted. As shown in FIG. 4, a product shelf 80 is installed in the store 200 as a display place for the product 50. A floor sensor capable of detecting the walking locus of the user 400 is provided on the floor of the store 200. The floor sensor 60 may be realized by, for example, a capacitive sheet-shaped sensor, or may be realized by a plurality of sensor modules embedded under the floor or on the floor. Here, the floor sensor 60 functions as an input means for inputting data regarding the walking locus of the user 400 who has entered the store 200. The data regarding the walking locus input to the floor sensor 60 is transmitted from the communication means 220 provided in the store 200 to the server 100 via the network NET. The detection unit 112 of the server 100 can analyze the data obtained from the floor sensor 60 to detect the walking locus of the user 400.

Further, each stage of the product shelf 80 is provided with a shelf pressure sensor 10 that functions as a weight sensor for detecting a change in weight, and a change in the weight of the product displayed on the product shelf 80 is detected. Like the floor sensor 60, the shelf pressure sensor 10 may have a sheet shape or may be realized by a plurality of sensor modules. The shelf pressure sensor 10 sequentially measures the weight of the product loaded on the shelf pressure sensor 10 itself, and the measured data is transmitted to the server 100 via the network NET. The article determination unit 113 of the server 100 compares the received data (that is, the weight applied to the shelf pressure sensor 10) in chronological order, and determines whether or not there is a change in the continuous data. Then, when the weight after the change becomes smaller than that before the change, it is determined that a predetermined change has occurred. The predetermined change here means that the product loaded on the shelf pressure sensor 10 has been removed. In addition, the article determination unit 113 can also determine that the product is loaded on the shelf pressure sensor 10 (that is, the product is returned or placed on the product shelf 80). For example, when the article determination unit 113 determines that the weight after the change is larger than that before the change in response to the change in the data received from the shelf pressure sensor 10, the product is returned to the product shelf 80. It means that. The time interval for comparing the data received by the article determination unit 113 and the detection unit 112 in chronological order may be a predetermined interval, for example, every 1 minute or every 30 seconds. It is not limited. Moreover, the time interval may be changed according to the state of a predetermined space. For example, the time interval may be shortened when the number of users existing in the predetermined space (in the store) is large or when the walking speed of the users is faster than the predetermined speed. Further, the time interval may be changed according to the learning result by the learning unit 119 described later.

Further, the product shelf 80 may be provided with a plurality of TOF (Time of Flight) sensors 20 to measure the distance in the depth direction of the product shelf 80. With this TOF sensor 20, changes in the shape of the product group can be detected. That is, the TOF sensor 20 measures a group of products arranged in the depth direction of the product shelf 80, and the distance-measured data is transmitted to the article determination unit 113. The article determination unit 113 compares the distance measurement data obtained by the TOF sensor 20 in chronological order, and determines whether or not there is a change in the continuous distance measurement data (that is, the shape of the product group). Then, when the shape of the product group before the change becomes smaller than the shape of the product group after the change, it is determined that a predetermined change has occurred. The predetermined change here means that the products displayed on the product shelf 80 have been removed. Further, as a predetermined change, it can be determined that the product has been returned to the product shelf 80 as described above. The time interval in the time series order of the distance measurement data by the TOF sensor 20 can also be changed in the same manner as described above.

According to one embodiment of the present invention, each of these sensors is used in combination to determine which product the user who has entered the store 200 has acquired from the product shelf 80. This determination will be described with reference to FIG. FIG. 5 is a schematic plan view of the inside of the store 200 as viewed from above. The detection unit 112 detects the walking locus R1 in the store 200 of the user 400 by using the data acquired by the floor sensor 60. Further, the article determination unit 113 determines the point C1 at which a predetermined change has occurred in the product shelf 80A by using the data acquired by the shelf pressure sensor 10 or the TOF sensor 20. From the data acquired by the shelf pressure sensor 10, as a predetermined change, it is detected that the weight after the change is smaller than that before the change at the display place where the products are displayed. Further, based on the data acquired by the TOF sensor 20, as a predetermined change, it is detected that the shape of the displayed product group after the change becomes smaller than that before the change at the display place where the products are displayed. Will be done. That is, it is detected that the shape of the product group at the display location has become smaller in response to the increase in the distance detected by the TOF sensor 20. When a predetermined change occurs at the point C1, the user determination unit 114 determines that the product displayed at the point C1 has been acquired by the user whose walking position P1 is within the predetermined range from the point C1. The predetermined range may be stored in the storage unit 130 as a fixed value (for example, a radius of 30 cm or less centered on the point C1), or as a value corresponding to the walking locus R1 and stored in the storage unit 130 as a table. It may have been done. Here, the table refers to the distance required to acquire the product according to the gender and age group of the user estimated based on the stride length of the walking locus R1, the size of the foot, and the magnitude (weight) of the pressure. It is something to remember.

In addition, in order to improve the accuracy of the determination by the user determination unit 114, the line-of-sight sensor 30 and the motion sensor 40 may be provided on the product shelf 80. The line-of-sight sensor 30 acquires data on the line-of-sight of the user 400 located in front of the product shelf 80. Further, a shelf floor sensor 70 is provided between the product shelf 80 and the floor of the store 200 to acquire data on changes in the weight of the entire product shelf 80. The data acquired by each of these sensors may also be transmitted to the detection unit 112 of the server 100 via the network NET and used as an auxiliary for the above determination. For example, when a product is removed from the product shelf 80 based on the user's line-of-sight data obtained from the line-of-sight sensor 30, the user who was paying attention to the product may be extracted and determined together with the walking locus. .. Further, the data obtained from the motion sensor 40 may be used to determine whether or not the user has entered the inside of the product shelf 80. Further, as shown in FIGS. 6A and 6B, the TOF sensor 20 that measures the product shelf 80 from above determines the position (x, y, z) of the shelf on which the user extends his / her hand 400H. However, it may be determined which goods have been removed or which goods have been returned to the shelves.

Next, the purchase process of the product in the store 200 will be described with reference to FIGS. 7 to 12. Here, it is assumed that the user 400 has registered the use of the service and the application for using the store 200 is installed in the terminal device 300. In this case, the identification information of the user who has registered the use of the service in the storage unit 130 of the server 100 or an external memory provided separately from the server 100 is, for example, the user information table 133 shown in FIG. 7 (c). Is stored in advance as. In the user information table 133, a name, a payment method, and the like are associated and stored for each identification information (customer ID). Here, the payment method is a method used for payment specified in advance by the user, and is, for example, electronic money, credit card, online banking, mobile carrier payment, virtual currency, and the like.

As shown in FIG. 7A, an authentication device 95 is provided at the entrance ENT of the store 200, and in the present embodiment, only a user who has succeeded in user authentication can enter the store 200. First, the user 400 launches an application on the terminal device 300 in order to perform admission processing to the store 200. FIG. 7B is an example of the terminal device 300 in which the key (QR code in the example of the figure) DIS1 which is the specific information to be read by the authentication device 95 is displayed. When the user 400 causes the authentication device 95 to read the key DIS1, information about the key DIS1 is transmitted to the server 100 by the communication means 220 provided in the store 200. The control unit 110 of the server 100 determines whether or not the identification information corresponding to the key DIS1 is stored in the user information table 133. Here, the key DIS1 may be the user's identification information (customer ID) itself, or may be another information associated with the identification information. In the latter case, text data, image, voice, fingerprint information, retinal information and the like are used as specific information, and may be read by the authentication device 95.

When the identification information is stored in the user information table 133, the restriction unit 116 releases the entrance restriction by the restriction means (for example, a door key, an alarm device, etc.) provided in the store 200. That is, the restriction unit 116 transmits an instruction to release the admission restriction provided in the store 200 to the store 200. The means for restricting the entrance is not limited to the one that physically restricts the admission, and may be a means that allows admission to the store 200 but prohibits the use of the application.

Hereinafter, a mode in which a plurality of users (user A400A, user B400B) exist in the store 200 will be described. As shown in FIG. 8A, when the users 400A and 400B enter the store 200, as described with reference to FIG. 5, the floor sensor 60 provides information on the walking loci of the users 400A and 400B to the store. It is transmitted from the communication means 220 of 200 to the detection unit 112. A floor sensor is provided near the entrance ENT or near the authentication device 95, and the identification information of each user and the user's footprint are associated with each other in advance in the storage unit 130 when entering the store 200. Be remembered. Further, as described above, the article determination unit 113 uses the data acquired from the shelf pressure sensor 10, the TOF sensor 20, the line-of-sight sensor 30, and the motion sensor 40 provided on the product shelf 80 from the product shelf 80. Determine if the item has been removed. Further, the article determination unit 113 identifies the removed product based on the information stored in the storage unit 130 regarding the correspondence between the product shelf and the product. Based on the data acquired from each sensor, the user determination unit 114 determines a user (a user who has the removed product) associated with the payment information regarding the settlement of the removed product. Then, as shown in FIG. 8C, the payment information table 131T in which the acquired product, the amount of the acquired product, and the total amount of money are associated with each identification information (customer ID) as payment information is stored in the payment memory. It is stored in the unit 131. Further, as shown in FIG. 8B, the payment information of the product acquired and possessed by the user is displayed on the display units 350A and 350B of the terminal devices 300A and 300B. In the example of FIG. 8, user A (customer ID: 12345) is associated with "chocolate" and "water", and user B (customer ID: 67899) is associated with "notebook" and "notebook". "Flour" is associated.

The determination by the article determination unit 113 or the user determination unit 114 may be performed each time the user removes or returns the product from the product shelf, and the output data from each sensor is stored in association with the time. In addition, each past data may be performed in accordance with the time. However, the former is desirable for the convenience of the user because the payment information is reflected and displayed on the terminal device 300 each time as shown in FIG. 8B.

Further, it is considered that the accuracy of the association between the user's identification information and the user's footprint is low when the footprints are similar between the users. In this case, a camera may be provided in the store 200, and the identification information and the user's face image may be stored in association with each other in advance at the entrance ENT. Then, the camera may take an image of the vicinity of the product shelf where a predetermined change has occurred, analyze the obtained image, and determine the user who has acquired the product.

When a product is removed from the product shelf, if there are a plurality of users in the vicinity of the product shelf, the user who has removed the product can be determined with a certainty of accuracy or higher depending on the information from various sensors. May not be available. According to one embodiment of the present invention, in such a case, the accuracy of determination can be improved by using the purchase history and attribute information of the user. This will be described below.

In the example of FIG. 8, a "notebook" is associated with the user B, but when the user B acquires the "notebook" from the product shelf, the user A and the user B are present at the place where the notebook is arranged. It is assumed that it is not possible to determine which user the "notebook" should be associated with only by the determination by the sensor. Here, "determination impossible" means that the hand of the user who holds the notebook cannot be extracted by a predetermined ratio or more even by analyzing the image at the location where the notebook is placed, or the sensor information cannot be acquired due to some problem. Etc. are included. If the determination is not possible, the user determination unit 114 refers to the purchase history 136 of each user stored in the storage unit 130 shown in FIG. 9A, and refers to the user who is likely to purchase the notebook. Is determined as the user to be associated with. In the example of FIG. 9A, it can be seen that the user B with the customer ID: 67899 purchases the notebook at predetermined intervals. When the determination date has passed a predetermined interval from the previous note purchase date, the user determination unit 114 associates the note with the identification information of the user B, assuming that the user B is likely to purchase the note.

Further, the user determination unit 114 may determine the user to which the product is associated based on the attribute information of the user. For example, as shown in FIG. 9B, the storage unit 130 stores the service usage start date (the application registration date or the date when the product is first purchased at the store) as the user attribute information. ), Gender, age, place of residence, occupation, etc. are memorized. In the example of FIG. 9, the user determination unit 114 can associate the note with the identification information of the user B who is a "student" who is likely to purchase the "note" based on the attribute information of the user. Further, when the installation location of the store 200 when the notebook is purchased is in "Tokyo", the notebook may be associated with the identification information of the user B. The attribute information may be prioritized for each product, and the determination may be made based on the priority. For example, when the product is "alcoholic beverages", "age" may be positioned at the highest priority as attribute information.

Next, the payment process of the product will be described. As shown in FIG. 8A, when the user 400A enters the payment area (payment space) 90 of the store 200, as shown in FIG. 10A, the screen DIS3 for selecting the execution of the payment of the product is displayed. It is displayed on the display unit of the terminal device 300. This is realized, for example, by outputting the display information for displaying the payment information on the terminal device 300 by the display output unit 118 based on the payment information stored in the payment storage unit 131. After that, when the button (purchase button) DIS4 for executing the settlement is selected by the user 400, the settlement unit 115 controls to execute the settlement. For example, when the payment method is a credit card, the payment unit 115 controls the transmission unit 122 to transmit a payment request to a server of a credit company (not shown). When the payment is completed (when the payment completion response is received), the restriction unit 116 sends an instruction to release the restriction of the restriction means (for example, the door key) for restricting the exit of the store 200, and the exit OUT of the store 200. Is unlocked. In addition, the storage unit 130 stores a payment history table 134 that stores the user's payment history.

The settlement process may be performed in another mode. Hereinafter, payment processing according to another aspect will be described with reference to FIG. As shown in FIG. 11A, the payment area 90 according to one embodiment of the present invention is provided with a plurality of types of sensors for detecting an article. In FIG. 11A, the placing place 92 is a place where the basket BSK containing the product is placed. The mounting location 92 is composed of at least one of a capacitance sheet, a pressure sheet, a temperature sensor, a resistivity sensor, a conductivity sensor, etc. that function as a weight sensor, and is an article placed on the loading location 92. Detects attribute information (weight, temperature, conductivity, etc.). Further, the TOF sensor 20 and the camera described above are installed around the mounting place 92 to measure the distance change in the shape and take an image. In addition, the article may be directly placed in the place 92 without using the basket BSK. When the car BSK is used, the attribute information of the article is required in consideration of the weight, conductivity and the like of the car BSK. In the case of FIG. 11, the basket BSK of the user A is placed, and in the basket BSK, "flour" is contained in addition to the "water" and "chocolate" associated with the user A in advance as payment information. Is detected. In this case, the user determination unit 114 updates the payment information so that the "flour" is associated with the identification information of the user A.

The user determination unit 114 extracts a user to whom "flour" is erroneously associated from the situation in the store 200 near the time when "flour" is associated with user A. For example, when "flour" is associated with user A at "10:00", the situation in the store 200 in a predetermined time width "9:50 to 10:00" including 10:00 can be seen. , Obtained from the storage unit 130. The situation in the store 200 is a detection history of various sensors installed in the store 200, and includes, for example, a walking locus detected by the floor sensor 60, a change in weight detected by the shelf pressure sensor 10, and the like. .. In addition, the situation in the store 200 includes a history of determination by the user determination unit 114. The user determination unit 114 can extract the user B who is likely to be erroneously associated with "flour" around 10:00. Then, the user determination unit 114 updates so as to delete the "flour" from the payment information of the user B to which the "flour" is associated.

It should be noted that the settlement process according to the other aspects described above is not essential, and may be performed when the determination by the user determination unit 114 is uncertain or in response to the user's request. In the former case, it is preferable that a notification requesting that the product be placed in the placement location 92 be sent to the user's terminal, and payment by placing the product in the placement location 92 is mandatory for purchasing the product. It may be a condition.

As described above, according to one embodiment of the present invention, the user who has acquired the product is determined based on the walking locus of the user who entered the store 200 and a predetermined change in the display place of the product. Since this predetermined change is detected by the sensor, it is possible to provide the store 200 in which the cost increases and the processing load on the server is reduced as compared with the case where a plurality of cameras are provided.

Further, it is determined that the product has been acquired by the user whose walking locus when a predetermined change occurs at the display location is within a predetermined range from the display location where the predetermined change is determined to have occurred. Therefore, it is possible to improve the determination accuracy of the user who has acquired the product.

Further, according to one embodiment of the present invention, the determination of the user who associates the product is supplementarily performed based on the purchase history and attribute information of the user. Therefore, it is possible to improve the determination accuracy of the association between the user and the product when a predetermined accuracy cannot be obtained by the determination by various sensors or images.

Further, a placement place for analyzing the purchased product with various sensors and images is provided, and payment is made at the placement place. Therefore, it is possible to further improve the accuracy of associating products and prevent erroneous settlement.

Further, according to one embodiment of the present invention, only the registered user for the service, that is, the user whose identification information is stored in advance, can enter the store 200, and only the user who has completed the payment. It is possible to leave the store 200. Since the user's information is registered on the service side, the user registered to use the service can enhance the security of the store 200, which is an unmanned store, in terms of crime prevention.

In addition, when using the store 200, it is not necessary that the usage registration for the service is performed (the application may not be installed). In this case, for example, when the user 400 enters the store 200, a setting unit (not shown) sets temporary identification information. For example, a camera is installed at the entrance ENT of the store, and a temporary identification number (one-time customer ID) is assigned to the image of the face of the user 400 who has entered the store 200 (by performing face recognition). It is stored in a predetermined storage unit. A floor sensor may be provided at the entrance ENT, and a temporary identification number may be associated with the footprint in place of the face image or together with the face image. After that, the acquisition of the product at the store 200 by the user is the same as the above-described embodiment, and thus the description thereof will be omitted. That is, the storage unit of the server 100 stores the payment information of the product in association with the temporary identification number. The payment is made, for example, via a payment device installed in the payment area 90 of the store 200. The payment device includes, for example, at least a display and a camera, and the display displays a list of products acquired by the user who makes the payment. This can be realized, for example, by outputting display information based on the payment information of the product associated with the user from the display output unit 118 to the payment device according to the determination by the user determination unit 114 of the server 100. Then, a request for the user to execute the payment via the payment device is output to the server of the credit card company, or the total amount is withdrawn from the electronic money. Upon completion of the payment, the exit OUT of the store 200 is unlocked, and the user can leave the store 200.

As described above, according to another embodiment of the present invention, even a user who has not registered to use the service can use the store 200, which is highly convenient. However, the use by an unspecified number of users leaves anxiety about crime prevention for unmanned stores. For this reason, a store such as a user who has an unpaid product or a user who repeatedly changes the display location of the product by storing the usage history of the past store 200 in association with the face image obtained by the face recognition. It is also possible to prevent the restriction unit 116 from releasing the restriction means for restricting the entrance to the store 200 for the user who is found to have an unfavorable act to use the 200. Further, the user information associated with the temporary identification information is not limited to the face image, but may be a part of the user's clothes, personal belongings, or the like. However, as described above, from the viewpoint of crime prevention in the store, it is preferable to use a face image.

Next, the control method according to the embodiment of the present invention described above will be described with reference to the drawings. FIG. 12 is a flowchart of the above-mentioned control. First, the acquisition unit 111 acquires the identification information associated with the user who has entered the predetermined space (step S11). The identification information may be stored in the storage unit 130 or the external memory when the service usage registration is performed in advance. Then, based on the data obtained from the floor sensor 60, the detection unit 112 detects the walking locus in a predetermined space (step S12). The article determination unit 113 determines whether or not a predetermined change has occurred at the display place where the products in the predetermined space are displayed (step S13). If a predetermined change does not occur, the process returns to step S12 and the detection of the walking locus is continued. When it is determined in step S13 that a predetermined change has occurred, the user determination unit 114 determines that the predetermined change has occurred, and the payment information regarding the settlement of the product is based on the display location and the walking locus. The identification information associated with is determined (step S14). The user determination unit 114 determines whether or not the association between the identification information and the product has determination accuracy equal to or higher than a predetermined value (step S15). If it is determined in step S15 that the determination accuracy is not equal to or higher than a predetermined value, the process proceeds to step S16 and the erroneous determination process proceeds.

Here, the erroneous determination process in step S16 will be described with reference to the flowchart of FIG. The user determination unit 114 determines whether or not the identification information associated with the payment information can be determined based on at least one of the user's payment history and the user's attribute information (step S161). That is, the user determination unit 114 determines whether or not the product can be associated with the user based on the user's payment history (purchase history). Alternatively, the user determination unit 114 determines whether or not the product can be associated with the user based on the attribute information of the user. The condition of whether or not they can be associated may be stored in advance in the storage unit 130. The condition is a condition in which a predetermined relationship can be defined between the product and the user, such as "purchasing the same product at a predetermined interval" and "purchasing a product of the same manufacturer". In addition, regarding attribute information, conditions such as "does not violate age restrictions" and "products preferred by women" may be sufficient. If the association is possible in step S161, the process proceeds to step S162, and the association between the user and the product is updated or newly created. If the association is not possible in step S161, the user is stored in the storage unit 130 as a user who needs to be reconfirmed (step S163). Here, as the payment information, although it is uncertain, it is stored in association with the user, and information indicating that the user needs to be reconfirmed is added and stored.

The explanation will be continued by returning to the flowchart of FIG. When it is determined in step S15 that the determination accuracy is equal to or higher than a predetermined value, or when the erroneous determination process in step S16 is completed, at least one associated with the identification information is associated with each identification information in the storage unit 130. Payment information is stored (step S17). Then, when a predetermined payment request is received from the user's terminal device 300, or when the user 400 enters the payment area 90, the user determination unit 114 is a user who needs to be reconfirmed by the user 400. Whether or not it is determined (step S18). The user who needs to be reconfirmed is the user set in the erroneous determination process in step S16. If the user needs to be reconfirmed, a confirmation notification is transmitted from the server 100 to the user's terminal device 300 (step S19). Here, the confirmation notification requests the user 400 to place the product on the mounting location 92, for example, "Please place the product at the loading location" on the display screen of the terminal device 300. It may be a pop-up notification such as, a voice output, or a voice guidance in the store 200. After that, the user 400 places the product in the placement place 92, the product to be purchased is identified by a sensor or an image, and it is determined whether or not the association of the purchased product with the user 400 is completed (step). S20). If the association is not completed, the user 400 may be notified again. If it is determined in step S20 that the association has been completed, or if the user does not need to be reconfirmed in step S18, the process proceeds to step S21, and the settlement unit 115 performs the settlement process.

There is a request to return the purchased product. The return processing will be described below. After executing the payment by the payment unit 115, the user 400 registers the return request on the application in advance. The return request can be registered, for example, on the display screen of the terminal 300 shown in FIG. 14A. The return request is stored in the storage unit 130 in association with the identification information of the user 400. Then, when the user 400 who has made the return request enters the store 200, a notification such as "Please return to the return location" is displayed on the display screen of the terminal 300 as shown in FIG. 14 (b). This can be realized, for example, by determining the user 400 who has entered the server 100, and when the user has already sent the return request, the display information for displaying the notification is transmitted to the terminal 300. The return location may be the above-mentioned storage location 92. When the item requested to be returned by the user 400 is detected at the storage location 92, the payment correction unit 117 associates the identification information of the user 400 who received the return request with the refund processing of the item requested to be returned. .. That is, refund processing is performed. The user may return the returned product to the product shelf 80. In this case, various sensors provided on the product shelf 80 detect that the product has been returned, and the settlement correction unit 117 performs the refund process. Further, for example, in the payment area 90, a box for putting the returned goods is installed, and the user may put the returned goods in the box. It is preferable that this box has a structure in which it is not purchased by another user until the return processing is completed on the store side.

The return processing according to the embodiment of the present invention described above will be described with reference to the flowchart of FIG. First, the receiving unit 121 receives the return request from the terminal 300 (step T11). Then, the settlement correction unit 117 determines whether or not the product can be returned (step T12). Here, whether or not the product can be returned is determined based on the purchase history whether or not the deadline from the purchase by the user to the return request is within a predetermined period. The predetermined period may be set according to the type of product. Further, it is determined whether or not the product placed in the placement place 92 has changed from the time of sale of the product, such as damage to the product or opening of the product. These can be determined by, for example, changes in weight, changes in conductivity, and the like by various sensors at the placement location 92. If the return is possible, the payment correction unit 117 performs a refund process and updates the purchase history of the user 400 (step T13). If the product cannot be returned (for example, the product is damaged or the return deadline is longer than a predetermined period), the user is notified that the product cannot be returned (step T14). The notification to the user may be made, for example, by displaying a pop-up notification such as "This product cannot be returned" on the terminal 300 or by outputting by voice. After that, the limiting unit 116 unlocks the outlet (step T15).

Although the present invention has been described with reference to the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and modifications based on the present disclosure. Therefore, it should be noted that these modifications and modifications are included in the scope of the present invention. For example, the functions included in each means, each step, etc. can be rearranged so as not to be logically inconsistent, and a plurality of means, steps, etc. can be combined or divided into one. .. In addition, the configurations shown in the above embodiments may be combined as appropriate. For example, the process described as the function of the server 100 may be performed by the server provided in the store 200. Further, each component described as being included in the server 100 may be distributed and realized by a plurality of servers.

Specifically, the processing that is supposed to be performed by the control unit 110 may be performed by the server provided in the store 200, and for example, the functions of the article determination unit 113, the restriction unit 116, and the like are provided in the store 200. It may be provided on the server.

Although one embodiment of the invention according to the present invention has been described, it goes without saying that the present invention is not limited to this. For example, in the above description, the mode in which payment information, user information, and the like are stored in the storage unit 130 of the server 100 has been described, but the various information may be stored as a database in a memory different from the server 100.

Further, in the above description, an example of a store has been described as a predetermined space. However, the predetermined space can also be applied to rental services such as warehouses for storing goods, libraries and rental video stores. Further, the predetermined space is not a closed space as shown in FIG. 1, but an open space may be used as long as it is a space provided with a floor sheet. For example, an unmanned sales space may be provided in an empty space of a building or condominium, or in a corner of an office.

Instead of the walking locus using the floor sensor, a change in the user's position information may be used. This can be achieved, for example, by installing a beacon transmitter in a predetermined space and using information on the position of the own terminal estimated by the terminal device side using short-range wireless communication.

Further, regarding the return processing, a user different from the user who purchased the product may visit the store 200 and return the product. This can be realized, for example, by transmitting to the server 100 that the user A requests the return to the user B and registering the return in the storage unit 130 when the user A makes a return request in advance.

Each functional unit of the server 100 may be realized by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like, or may be realized by a CPU (Central). It may be realized by software using a Processing Unit). Further, each functional unit may be realized by one or a plurality of integrated circuits, and the functions of the plurality of functional units may be realized by one integrated circuit.

When each functional part of the server 100 is realized by software, the server 100 or the terminal device 300 is a CPU that executes a command of a program that is software that realizes each function, and the computer (or CPU) reads the program and various data. It is equipped with a ROM (Read Only Memory) or a storage device (these are referred to as "recording media") that can be recorded, a RAM (Random Access Memory) for expanding the above program, and the like. Then, the object of the present invention is achieved by the computer (or CPU) reading the program from the recording medium and executing the program. That is, the information processing device 100 according to the present invention limits the acquisition unit 111, the detection unit 112, the article determination unit 113, the user determination unit 114, the settlement unit 115, by executing the program loaded on the RAM by the CPU. It functions as a unit 116, a setting unit 117, and a display output unit 118. As the recording medium, a "non-temporary tangible medium", for example, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The above program is, for example, a script language such as ActionScript, JavaScript (registered trademark), Python, Ruby, C language, C ++, C #, Objective-C, Swift, Java (registered trademark), or other object-oriented programming language. It can be implemented using a markup language such as HTML5.

500 Goods provision system 400 Users 100 Servers (information processing equipment)
200 Store 220 Communication means 300 Terminal device 110 Control unit 111 Acquisition unit 112 Detection unit 113 Goods judgment unit 114 User judgment unit 115 Settlement unit 116 Restriction unit 117 Setting unit 118 Display output unit 120 Communication unit 121 Reception unit 122 Transmission unit 130 Storage unit 310 Control unit 311 Information processing unit 312 Display processing unit 313 Judgment unit 320 Communication unit 330 Storage unit 340 Input reception unit 350 Display unit 370 Speaker 321 Reception unit 322 Transmission unit 95 Authentication device 50 Product 80 Product shelf 60 Floor sensor 10 Shelf pressure sensor 20 TOF sensor R1 walking locus 80A product shelf C1 point P1 walking position 30 line-of-sight sensor 40 human sensor 70 shelf floor sensor 400H hand 133 user information table 131T payment information table 131 payment storage 90 payment area 134 payment history table 132E table 131E payment Information table

Claims (14)

An acquisition unit for acquiring identification information of a plurality of users who have entered the predetermined space,
A detection unit that detects at least a walking locus in the predetermined space of the user,
An article determination unit that determines whether or not a predetermined change has occurred at a display location where articles in the predetermined space are displayed.
Settlement information regarding the settlement of goods displayed at the display location determined by the article determination unit and the display location determined by the walking locus based on the display location determined by the article determination unit. A user judgment unit that determines the user's identification information associated with
For each identification information determined by the user determination unit, a payment storage unit that stores at least one payment information associated with the identification information, and a payment storage unit.
A payment unit that executes payment based on payment information stored in the payment storage unit,
A payment history storage unit that stores the payment history by the payment unit for each user,
When a payment error of one user occurs, another related to the payment error is based on the past judgment history and the payment history of each user in the predetermined space when the payment error occurs. A payment correction unit that updates the payment information associated with the user's identification information so as to eliminate the payment error of the other user caused by the payment error of the one user.
Ru with an information processing apparatus. The user determination unit determines the identification information associated with the payment information based on the payment history of the user.
The information processing apparatus according to claim 1. The user determination unit determines the identification information associated with the payment information based on the attribute information of the user.
The information processing apparatus according to claim 1 or 2. The user determination unit determines identification information associated with the payment information based on information transmitted from a plurality of types of sensors that detect articles and is provided in the payment space in the predetermined space.
The information processing apparatus according to any one of claims 1 to 3. The payment correction unit receives a return request after the payment is executed by the payment unit, and when the article requested to be returned is detected by the plurality of types of sensors provided in the payment space, the return is returned. The information processing device according to claim 4 , wherein the identification information of the user who has received the request is associated with the refund processing of the article requested to be returned. The information regarding the state of the predetermined space when the settlement error occurs is learned, and the accuracy of at least one of the determination by the article determination unit, the determination by the user determination unit, and the detection by the detection unit is determined. Further equipped with a learning unit that changes according to the state of a predetermined space,
The information processing apparatus according to any one of claims 1 to 5 , wherein the information processing device is characterized by the above. The article determination unit determines that the removal of the product has occurred among the predetermined changes when the weight after the change at the display place where the product is displayed becomes smaller than that before the change, and after the change. When the weight of the product is heavier than that before the change, it is determined that the product placement has occurred within the predetermined change.
The information processing apparatus according to any one of claims 1 to 6, wherein the information processing device is characterized by the above. When the shape of the displayed product group after the change becomes smaller than that before the change at the display place where the product is displayed, the article determination unit removes the product among the predetermined changes. When the shape after the change is larger than that before the change, it is judged that the arrangement of the products has occurred among the predetermined changes.
The information processing apparatus according to any one of claims 1 to 7. The user determination unit identifies that the position of the walking locus when the predetermined change occurs is associated with a user who is within a predetermined range from the display location where the predetermined change is determined to have occurred. The information is determined as identification information corresponding to the settlement information relating to the settlement of the goods displayed at the display location where the predetermined change is determined to have occurred.
The information processing apparatus according to any one of claims 1 to 8. Further provided with a limiting unit that controls a limiting means for limiting the user's exit to the predetermined space.
The restriction unit releases the restriction on the exit of the user associated with the identification information for which payment has been executed by the payment unit from the predetermined space.
The information processing apparatus according to any one of claims 1 to 9. A user storage unit that stores the identification information associated with the user in association with the specific information that identifies the user is further provided.
The acquisition unit acquires the identification information associated with the specific information transmitted from the terminal device of the user who has entered the predetermined space from the identification information stored in the user storage unit.
The information processing apparatus according to any one of claims 1 to 10. A display output unit for outputting display information for displaying the payment information associated with the identification information on the display unit of the terminal device corresponding to the identification information associated with the payment information is further provided.
The information processing apparatus according to any one of claims 1 to 11. For information processing equipment
An acquisition step of acquiring identification information of a plurality of users who have entered the predetermined space,
A detection step for detecting at least a walking locus of the user in the predetermined space,
A product determination step for determining whether or not a predetermined change has occurred at a display location where products in the predetermined space are displayed, and a product determination step.
Settlement related to the settlement of products displayed at the display location determined to have undergone the predetermined change based on the display location determined to have caused the predetermined change in the product determination step and the walking locus. A user determination step that determines the user's identification information associated with the information, and
A payment storage step for storing at least one payment information associated with the identification information for each identification information determined by the user determination step, and a payment storage step.
A payment step for executing payment based on the payment information stored in the payment storage step, and
A step of storing the payment history in the payment step for each user, and
When a payment error of one user occurs, another related to the payment error is based on the past judgment history and the payment history of each user in the predetermined space when the payment error occurs. A step of updating the payment information associated with the user's identification information so as to eliminate the payment error of the other user caused by the payment error of the one user, and
A method of controlling an information processing device to execute. For information processing equipment
An acquisition function that acquires the identification information of multiple users who have entered a predetermined space,
A detection function that detects at least a walking locus of the user in the predetermined space, and
A product determination function for determining whether or not a predetermined change has occurred at a display location where products in the predetermined space are displayed, and
Settlement information related to the settlement of products displayed at the display location determined to have undergone the predetermined change based on the display location determined by the product determination function to have caused a predetermined change and the walking locus. A user judgment function that determines the user's identification information associated with
A payment storage function that stores at least one payment information associated with the identification information for each identification information determined by the user determination function, and a payment storage function.
A payment function that executes payment based on payment information stored in the payment storage function, and
A payment history storage function that stores the payment history by the payment function for each user,
When a payment error of one user occurs, another related to the payment error is based on the past judgment history and the payment history of each user in the predetermined space when the payment error occurs. An information processing device that realizes a payment correction function that updates the payment information associated with the user's identification information so as to eliminate the payment error of the other user caused by the payment error of the one user. Control program.

Images