JP2019145054A - Information processing device, control method for information processing device, and control program for information processing device - Google Patents

Abstract

To provide an information processing device and the like that can prevent an erroneous determination of a user having excluded or arranged an article from or in a stock place, and can further improve the user's determination accuracy in providing the article.SOLUTION: The information processing device includes: an acquisition unit that acquires identification information associated with a plurality of entered users; a detection unit that detects a walking track of a user; an article determination unit that determines whether or not a change has occurred at a display place; a user determination unit that, on the basis of the display place determined by the article determination unit that a change has occurred and the walking track, determines identification information to be associated with settlement information concerning settlement of an article displayed at the display place determined that a change has occurred; a settlement storage unit that, for each piece of identification information determined by the user determination unit, stores settlement information associated with the identification information; and a settlement unit that executes settlement based on the settlement information stored in the settlement storage unit. The user determination unit determines the identification information to be associated with settlement information on the basis of a settlement history of the user.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus capable of executing processing relating to handling of an article in an article providing system for providing an article, and a control program for an information processing control method information processing apparatus.

  In recent years, for example, in an unmanned store where merchandise is sold unattended, tracking the items removed from the inventory location requires the actual operation of the person at the inventory location in a store or warehouse. Not appearing system. For example, Patent Literature 1 describes a computing system in which removal or placement tracking of articles in an inventory location having a material handling facility is performed by a processor.

JP-T-2006-532932 Publication

  In the system described in Patent Literature 1, an image capturing device (for example, a camera) is used to track an article removed from a stock location by the user, and a series of the hand before and after the user's hand enters the stock location. Images will be taken. Then, based on the comparison of the images, it is determined whether the user has moved the article, that is, whether the article has been removed from the stock location or placed in the stock location. However, when the users are close to each other, there is a problem that an erroneous determination may occur when determining the user who moved the article.

  Therefore, in view of the above-described problems, the present invention prevents an erroneous determination of a user who excludes an article from an inventory location or arranges an article at an inventory location, and can further improve the determination accuracy of the user in providing the article. It is an object to provide an apparatus, a control method for an information processing apparatus, a control program for the information processing apparatus, and an article providing system.

  An information processing apparatus according to an embodiment of the present invention includes an acquisition unit that acquires identification information associated with a plurality of users who have entered a predetermined space, and a detection unit that detects at least a walking trajectory of the user in the predetermined space. An article determination unit that determines whether or not a predetermined change has occurred at a display place where an article in a predetermined space is displayed; a display place that is determined to have generated a predetermined change by the article determination unit; and walking Based on the trajectory, a user determination unit that determines identification information associated with settlement information related to the settlement of an article displayed at a display location where it is determined that a predetermined change has occurred, and each identification information determined by the user determination unit A payment storage unit that stores at least one payment information associated with the identification information, and a payment unit that executes payment based on the payment information stored in the payment storage unit, Provided, the user determination section, the identification information associating the payment information, determines on the basis of the payment history of the user.

  Furthermore, in the information processing apparatus according to an embodiment of the present invention, the user determination unit may determine identification information associated with the payment information based on the attribute information of the user.

  Furthermore, in the information processing apparatus according to an embodiment of the present invention, the user determination unit is provided in a payment space in a predetermined space, and sets the payment information based on information transmitted from a plurality of types of sensors that detect articles. The identification information to be associated may be determined.

  Furthermore, an information processing apparatus according to an embodiment of the present invention includes a payment history storage unit that stores a payment history by a payment unit for each user, and determines an error in payment based on the payment history, and the payment error occurs. And a payment correction unit that associates the identification information of the user related to the payment error with the payment information for eliminating the payment error, based on the past determination history in the predetermined space at the time.

  Furthermore, an information processing apparatus according to an embodiment of the present invention learns information about a predetermined space state when a payment error occurs, makes a determination by an article determination unit, a determination by a user determination unit, and a detection by a detection unit You may further provide the learning part which changes at least any one precision of these according to the state of predetermined | prescribed space.

  Further, in the information processing apparatus according to an embodiment of the present invention, the payment correction unit receives a return request after executing the payment by the payment unit, and a plurality of types of articles in which the goods requested for return are provided in the payment space. When detected by the sensor, the refund processing of the article requested for return may be associated with the identification information of the user who has received the return request.

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the article determination unit determines that the removal of the product has occurred among the predetermined changes at the display place where the articles are displayed, and the weight after the change is In the case where it becomes larger than before the change, the arrangement of the products may occur among the predetermined changes.

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the article determination unit has a smaller shape after the change of the displayed article group at the display place where the article is displayed than before the change. If it is determined that the removal of the product has occurred among the predetermined changes, and the shape after the change is larger than before the change, the arrangement of the products may occur among the predetermined changes. .

  Furthermore, in the information processing apparatus according to the embodiment of the present invention, the user determination unit determines whether the position when the predetermined change occurs in the walking trajectory from the display place where it is determined that the predetermined change has occurred. The identification information associated with the users within the range may be determined as identification information associated with the settlement information related to the settlement of the article displayed at the display location where it is determined that a predetermined change has occurred.

  Furthermore, the information processing apparatus according to an embodiment of the present invention further includes a restriction unit that controls a restriction unit that restricts entry into and exit from the predetermined space, and the restriction function includes identification information for which payment has been executed by the payment unit. The restriction on the exit of the user associated with the user from the predetermined space may be released.

  Furthermore, the information processing apparatus according to an embodiment of the present invention further includes a user storage unit that stores identification information associated with the user in association with specific information that identifies the user, and the acquisition unit includes a predetermined space. You may acquire the identification information linked | related with the specific information transmitted from the user's terminal device which entered in the identification information memorize | stored in the user memory | storage part.

  Furthermore, the information processing apparatus according to the embodiment of the present invention displays display information for causing the payment information associated with the identification information to be displayed on the display unit of the terminal device corresponding to the identification information associated with the payment information. May be further provided.

  An information processing apparatus control method according to an embodiment of the present invention includes: an acquisition step of acquiring identification information associated with a plurality of users who entered a predetermined space in the information processing apparatus; At least a detection step for detecting a walking locus, an article determination step for determining whether or not a predetermined change has occurred at a display place where an article in a predetermined space is displayed, and a predetermined change occurs in the article determination step A user determination step of determining identification information associated with settlement information related to settlement of an article displayed at a display location determined to have a predetermined change based on the display location determined to have been performed and a walking trajectory; A settlement storage step for storing at least one settlement information associated with the identification information for each identification information determined by the user determination step , To execute and settlement step of executing a settlement based on the settlement information stored in the settlement storing step, the user determination step, the identification information to be associated with payment information, determines on the basis of the payment history of the user.

  An information processing apparatus control program according to an embodiment of the present invention includes: an acquisition function for acquiring identification information associated with a plurality of users who have entered a predetermined space; At least a detection function that detects a walking trajectory, an article determination function that determines whether or not a predetermined change has occurred at a display place where an article in a predetermined space is displayed, and a predetermined change has occurred due to the article determination function A user determination function for determining identification information associated with settlement information related to settlement of articles displayed at a display location determined to have undergone a predetermined change based on the display location determined as a For each piece of identification information determined by the determination function, a payment storage function for storing at least one payment information associated with the identification information, and a payment storage function To realize the payment function to execute a settlement based on 憶 been settlement information, user determining function, the identification information to be associated with payment information, determines on the basis of the payment history of the user.

  According to the present invention, an information processing apparatus capable of preventing an erroneous determination of a user who excludes an article from an inventory location or places an article in an inventory location and further improves the determination accuracy of the user in providing the article, and a control method for the information processing apparatus In addition, a control program for the information processing apparatus can be provided.

It is the schematic of the article | item provision system structure by one Embodiment of this invention. It is an example of the block diagram of the server (information processing apparatus) by one Embodiment of this invention. It is an example of the block diagram of the terminal device by one Embodiment of this invention. It is the schematic explaining the structural example in the shop by one Embodiment of this invention. It is the schematic explaining the determination of the user who acquired goods from the display place by one Embodiment of this invention. (A), (b) is the schematic explaining the determination of the user who acquired goods from the display place by one Embodiment of this invention. (A) is explanatory drawing, (b) is a screen example of a user's terminal device, (c) is an example of the identification information memorize | stored in a memory | storage part when a user enters a store. (A) is explanatory drawing, (b) is a screen example of a user's terminal device, (c) is an example of the payment information memorize | stored in a memory | storage part when a user performs payment. (A) is an example of a purchase history stored in the storage unit 130, and (b) is an example of attribute information. (A) is explanatory drawing of a payment place when a user performs payment, (b) is an example of the payment information updated and memorize | stored in a memory | storage part. (A) is an example of user attribute information, and (b) is an example of a user purchase history. It is an example of the flowchart of the control method of information processing apparatus by one Embodiment of this invention. It is an example of the flowchart of the control method of information processing apparatus by one Embodiment of this invention. (A), (b) is a screen example of a user's terminal device. It is an example of the flowchart of the control method of information processing apparatus by one Embodiment of this invention.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 is a schematic diagram of an article providing system configuration according to an embodiment of the present invention. The article providing system 500 is a service system that allows the user 400 to acquire and purchase an article even when there is no manager who provides the article. Hereinafter, as an example, a mode in which provision of an article is an unmanned store where a salesperson and a salesclerk who sell a product do not exist as illustrated in FIG. 1 will be described. As shown in FIG. 1, the article providing system 500 includes at least a server (information processing apparatus) 100, a store 200, a terminal device 300, and a network NET. The server 100 is connected to the store 200 and the terminal device 300 via the network NET. Although two servers 100 are shown in FIG. 1, they may be realized as a plurality of more server groups, or may be realized independently. In the store 200, a plurality of products (articles) are displayed on a product shelf (display place). Although details will be described later, settlement of a product purchased by the user 400 at the store 200 is performed by the server 100 or a predetermined settlement service via the network NET.

  The terminal device 300 is associated with the user 400. Although the smartphone is shown in FIG. 1, the terminal device 300 may be a terminal device that can be connected to a network, such as a tablet or a wearable terminal (glasses type, wristwatch type, headset type, etc.). Anything is acceptable. Further, in FIG. 1, only one terminal device 300 is shown for ease of explanation, but it goes without saying that there may be more terminals. That is, there may be a plurality of users who enter the store 200. Thereafter, when there are a plurality of users and it is necessary to distinguish between them, the users 400A and 400B are referred to, and the terminal devices associated with each user are denoted as 300A and 300B. It is preferable that application software (hereinafter also referred to as “application”) provided by the service side and used for the store 200 is downloaded to the terminal device 300. In addition, between the terminal device 300 and a predetermined communication device provided in the store 200, a beacon signal using Bluetooth (registered trademark) and BLE (Bluetooth Low Energy), RFID (Radio Frequency IDentifier) standard Near field communication such as ultrasonic wave, infrared communication, or the like may be performed.

  FIG. 2 is a block diagram of a server (information processing apparatus) 100 according to an embodiment of the present invention. As illustrated in FIG. 2, the server 100 includes a control unit 110, a communication unit 120, and a storage unit 130. Although the details will be described later, the functions of these units will be briefly described.

  The control unit 110 is a processor having a function of controlling each unit of the server 100. The control unit 110 includes an acquisition unit 111, a detection unit 112, an article determination unit 113, a user determination unit 114, a settlement unit 115, a restriction unit 116, a settlement correction unit 117, a display output unit 118, and a learning unit 119. The acquisition unit 111 acquires identification information associated with a user who has entered a predetermined space. The acquisition unit 111 may acquire identification information associated with a user who has entered a predetermined space from the identification information stored in the storage unit 130. Alternatively, temporary identification information may be set for a user who enters a predetermined space by a setting unit (not shown), and the acquisition unit 111 may acquire the temporary identification information. Here, the identification information is information for uniquely identifying each user in the article providing system. For example, an ID (Identifier) including a two-dimensional code such as a combination of alphanumeric characters and symbols, a QR code, It may be a user name or the like.

  The detection unit 112 detects at least a walking locus of the user who entered the predetermined space in the predetermined space. The article determination unit 113 determines whether or not a predetermined change has occurred at the display place where the products in the predetermined space are displayed. The article determination unit 113 determines that the removal of the product has occurred among the predetermined changes when the weight after the change is smaller than that before the change at the display place where the product is displayed. When the weight after the change becomes larger than that before the change, it is determined that the arrangement of the product has occurred among the predetermined changes. Alternatively, the article determination unit 113 may remove the merchandise out of a predetermined change when the changed shape of the displayed merchandise group becomes smaller than that before the change at the display place where the merchandise is displayed. When it determines with having occurred and the shape after a change becomes large compared with before a change, it determines with arrangement | positioning of goods having generate | occur | produced among predetermined changes. The user determination unit 114 is configured to display the product displayed at the display place where the predetermined change is determined based on the display place where the predetermined change is determined by the article determination unit 113 and the walking trajectory. The identification information associated with the payment information related to payment is determined. The user determination unit 114 includes identification information associated with a user whose position when a predetermined change occurs in the walking trajectory is within a predetermined range from the display location where the predetermined change is determined to occur. It is determined as identification information associated with the settlement information related to the settlement of the product displayed at the display location where it is determined that the predetermined change has occurred. Note that the user determination unit 114 associates information regarding purchase of a product (that is, charge deduction) with identification information as settlement information when removal of the product occurs in a predetermined change. In addition, when the placement of the product occurs among the predetermined changes, the user determination unit 114 associates information regarding the return of the product (that is, refund of the fee) with the identification information as the payment information. The settlement unit 115 executes settlement based on the settlement information associated with the identification information. Further, the settlement unit 115 executes a refund process when the settlement information relates to the return of the product.

  The restriction unit 116 controls restriction means for restricting entry / exit into a predetermined space. The limiting means may be a door key, for example. In addition, the restriction unit 116 controls the restriction unit so as to release the restriction on the exit of the user associated with the identification information for which payment has been performed by the payment unit 115 from the predetermined space. For example, the restricting unit 116 can release the restriction on the exit from a predetermined space of the user associated with the identification information on which the product purchase process or the product return process is executed. The payment correction unit 117 determines a payment error based on the payment history, and based on the past determination history in a predetermined space when the payment error occurs, the payment correction unit 117 uses the identification information of the user related to the payment error as the payment information. Corresponding payment information to eliminate the error. Here, the payment error is a state in which the number of products and the sales amount do not match, for example, the purchase of the product is processed twice, or the sales proceeds are insufficient with respect to the number Point to. The display output unit 118 outputs display information for causing the payment information associated with the identification information to be displayed on the display unit of the terminal device corresponding to the identification information associated with the payment information. The learning unit 119 learns information related to a state of a predetermined space when a payment error occurs, and at least one accuracy of determination by the article determination unit, determination by the user determination unit, and detection by the detection unit Is changed according to the state of a predetermined space. The state of the predetermined space refers to the position of the user existing in the predetermined space and the state of the product possessed (associated with the identification information). The learning unit 119 learns information regarding the state of a predetermined space when a payment error occurs. The learning unit 119 changes the accuracy of at least one of the determination by the article determination unit, the determination by the user determination unit, and the detection by the detection unit according to the state of the predetermined space. For example, when a situation similar to the situation in which an erroneous determination has occurred in the past has occurred in the store 200, the learning unit 119 causes the detection data of various sensors to be acquired so as to prevent the past erroneous determination. For example, the interval at which the detection data from the floor sensor 60 is received is shortened.

  The communication unit 120 includes a reception unit 121 and a transmission unit 122, and has a function of performing communication (transmission and reception of various data) with the store 200 or the terminal device 300 via the network NET in accordance with an instruction from the control unit 110. . For example, the receiving unit 121 receives identification information of a user who has entered a predetermined space in response to an instruction from the acquiring unit 111. In addition, the receiving unit 121 receives data related to the walking trajectory transmitted from the detection unit installed in the store 200 in accordance with an instruction from the detecting unit 112. In addition, the receiving unit 121 and the transmitting unit 122 exchange settlement information with a server on a predetermined settlement service side that performs settlement in accordance with an instruction from the settlement unit 115. The transmission unit 122 transmits, to the terminal device 300, display information for displaying the settlement information output by the display output unit 118 and associated with the identification information on the display unit of the terminal device corresponding to the identification information. To do. These communications may be executed either by wire or wireless, and any communication protocol may be used as long as mutual communication can be executed.

  The storage unit 130 is typically realized by various recording media such as an HDD (Hard Disc Drive), an SSD (Solid State Drive), and a flash memory, and stores various programs and data necessary for the server 100 to operate. It has a function to memorize. For each piece of identification information determined by the user determination unit 114, the storage unit 130 stores (stores) at least one settlement information associated with the identification information. In addition, the storage unit 130 may store in advance identification information associated with the user, or may store information indicating a payment method or a payment service used for payment for each piece of identification information. In addition, the storage unit 130 stores settlement history (purchase history, return history) of each user. The storage unit 130 also stores information indicating which products are displayed at which positions on the product shelves.

  Next, the terminal device 300 will be described. As illustrated in FIG. 3, the terminal device 300 includes a control unit 310, a communication unit 320, a storage unit 330, an input reception unit 340, a display unit 350, a voice interface (I / F) 360, and a speaker 370.

  The communication unit 320 includes a reception unit 321 and a transmission unit 322, and has a function of executing communication with the server 100 or communication means installed in the store 200 via the network NET. The communication may be executed either by wire or wireless, and any communication protocol may be used as long as mutual communication can be executed. Further, the communication unit 320 may be used for exchanging data with the authentication device 95 (see FIG. 7) installed in the store 200.

  The storage unit 330 has a function of storing various programs and various data necessary for the operation of the terminal device 300. For example, the storage unit 330 includes information such as an application program necessary for enjoying the service according to the present embodiment. The storage unit 330 is typically realized by various recording media such as an HDD, an SSD, and a flash memory.

  The input receiving unit 340 receives an input from the user 400 and transmits information related to the input to the control unit 310. In the terminal device 300, the input reception unit 340 is realized by a touch panel or the like, detects a contact by an indication tool such as a user's finger or stylus and the contact position, and transmits the coordinates of the contact position to the information processing unit 311. In the present embodiment, the input reception unit 340 receives selection of purchased products by the user, a settlement request, and a return request.

  The control unit 310 is a processor having a function of controlling each unit of the terminal device 300. The control unit 310 includes an information processing unit 311, a display processing unit 312, and a determination unit 313. The information processing unit 311 has a function of performing control so that information is transmitted from the communication unit 320 to the server 100 in accordance with the information input from the input receiving unit 340. The information processing unit 311 also has a function of transmitting information received from the server 100 by the communication unit 320 to the display processing unit 312. The display processing unit 312 has a function of converting display data transmitted from the information processing unit 311 into pixel information and writing it into a frame buffer of the display unit 350.

  The display unit 350 is a monitor having a function of displaying an image in accordance with display data written in the frame buffer by the display processing unit 312 and is typically realized by a liquid crystal display. The display unit 350 is various notifications received from the server 100 via the network NET, and displays, for example, settlement information and warnings. The audio I / F 360 is an interface of a speaker 370 or an earphone (not shown). Note that the settlement information may be output by voice via the voice I / F 360, or a predetermined warning sound may be output. In addition, a payment request from the user may be instructed (input) by voice.

  Next, the store 200 will be described with reference to FIGS. 4 and 5. FIG. 4 is a schematic diagram illustrating a configuration example in the store 200 according to an embodiment of the present invention. In the following, when there is no need to distinguish between them, the alphabets A, B, etc., indicating that there are a plurality of them in the figure may be omitted. As shown in FIG. 4, a merchandise shelf 80 as a display place for the merchandise 50 is installed in the store 200. A floor sensor capable of detecting the walking trajectory of the user 400 is provided on the floor of the store 200. The floor sensor 60 may be realized by, for example, a capacitive sheet-like sensor, or may be realized by a plurality of sensor modules that are used under the floor or on the floor. Here, the floor sensor 60 functions as an input means for inputting data related to the walking trajectory of the user 400 who entered the store 200. Data relating to the walking trajectory input to the floor sensor 60 is transmitted from the communication means 220 provided in the store 200 to the server 100 via the network NET. The detection unit 112 of the server 100 can detect the walking locus of the user 400 by analyzing the data obtained from the floor sensor 60.

  Each stage of the product shelf 80 is provided with a shelf pressure sensor 10 that functions as a weight sensor for detecting a change in weight, and detects a change in the weight of the product displayed on the product shelf 80. Similarly to the floor sensor 60, the shelf pressure sensor 10 may be in the form of a sheet or may be realized by a plurality of sensor modules. The shelf pressure sensor 10 sequentially measures the weight of the product loaded on the shelf pressure sensor 10 itself, and the measured data is transmitted to the server 100 via the network NET. The article determination unit 113 of the server 100 compares the received data (that is, the weight applied to the shelf pressure sensor 10) in chronological order, and determines whether there is a change in the continued data. Then, when the weight after the change becomes smaller than that before the change, it is determined that a predetermined change has occurred. The predetermined change here means that the commodity loaded on the shelf pressure sensor 10 has been removed. The article determination unit 113 can also determine that a product is loaded on the shelf pressure sensor 10 (that is, a product is returned or placed on the product shelf 80). For example, if the article determination unit 113 determines that the weight after the change is greater than that before the change according to the change in the data received from the shelf pressure sensor 10, the article is returned to the merchandise shelf 80. Means that. Note that the time interval for comparing the data received by the article determination unit 113 and the detection unit 112 in chronological order may be a predetermined interval, for example, every minute or every 30 seconds. It is not limited. Further, the time interval may be changed according to the state of the predetermined space. For example, the time interval may be shortened when the number of users existing in a predetermined space (in the store) is large or when the walking speed of the users is faster than a predetermined speed. Furthermore, the time interval may be changed according to a learning result by the learning unit 119 described later.

  The product shelf 80 may be provided with a plurality of TOF (Time of Flight) sensors 20 to measure the depth direction of the product shelf 80. The TOF sensor 20 can detect a change in the shape of the product group. That is, the TOF sensor 20 measures the product group arranged in the depth direction of the product shelf 80, and the measured data is transmitted to the article determination unit 113. The article determination unit 113 compares the distance measurement data obtained by the TOF sensor 20 in time series order, and determines whether or not there is a change in the continuous distance measurement data (that is, the shape of the product group). Then, when the shape of the product group before the change is smaller than the shape of the product group after the change, it is determined that a predetermined change has occurred. Here, the predetermined change means that the product displayed on the product shelf 80 has been removed. Furthermore, as a predetermined change, it can also be determined that the product has been returned to the product shelf 80 as described above. The time interval in the time series order of the distance measurement data by the TOF sensor 20 can also be changed as described above.

  According to one embodiment of the present invention, it is determined by using these sensors in combination which products the user who entered the store 200 has acquired from the product shelf 80 and has. This determination will be described with reference to FIG. FIG. 5 is a schematic plan view of the inside of the store 200 as viewed from above. The detection unit 112 detects the walking trajectory R <b> 1 in the store 200 of the user 400 using the data acquired by the floor sensor 60. Further, the article determination unit 113 determines the point C1 where the predetermined change has occurred in the commodity shelf 80A using the data acquired by the shelf pressure sensor 10 or the TOF sensor 20. Based on the data acquired by the shelf pressure sensor 10, a case where the weight after the change is smaller than that before the change is detected as a predetermined change at the display place where the commodity is displayed. In addition, the data acquired by the TOF sensor 20 is detected as a predetermined change when the shape of the displayed product group after the change is smaller than that before the change at the display place where the product is displayed. Is done. That is, in response to the increase in the distance detected by the TOF sensor 20, it is detected that the shape of the merchandise group at the display place has decreased. When a predetermined change occurs at the point C1, the user determination unit 114 determines that a product displayed at the point C1 has been acquired by a user who has the walking position P1 within a predetermined range from the point C1. The predetermined range may be stored in the storage unit 130 as a fixed value (for example, a radius of 30 cm or less with the point C1 as the center), or stored as a table in the storage unit 130 as a value corresponding to the walking locus R1. May be. Here, the table is a distance required to acquire a product according to the gender of the user estimated based on the stride of the walking locus R1, the size of the foot, the size of the pressure (weight), and the age group. It is something to remember.

  In addition, in order to improve the accuracy of determination by the user determination unit 114, the line of sight sensor 30 and the human sensor 40 may be provided in the product shelf 80. The line-of-sight sensor 30 acquires data relating to the line of sight of the user 400 positioned in front of the product shelf 80. Further, a shelf floor sensor 70 is provided between the product shelf 80 and the floor of the store 200 to acquire data relating to a change in the weight of the entire product shelf 80. Data acquired by each of these sensors may also be transmitted to the detection unit 112 of the server 100 via the network NET and used supplementarily for the above determination. For example, based on the user's line-of-sight data obtained from the line-of-sight sensor 30, when a product is removed from the product shelf 80, the user who has focused on the product may be extracted and determined together with the walking trajectory. . Further, using data obtained from the human sensor 40, it may be determined whether or not a user's hand has entered the product shelf 80. Further, as shown in FIGS. 6A and 6B, the position (x, y, z) of the shelf where the user extends the hand 400H is determined by the TOF sensor 20 that measures the distance of the product shelf 80 from above. Then, it may be determined which product has been removed or the product has been returned to the shelf.

  Next, merchandise purchase processing in the store 200 will be described with reference to FIGS. Here, it is assumed that an application for using the store 200 is installed in the terminal device 300 by the user 400 performing service use registration. In this case, the identification information of the user who registered the use of the service in the storage unit 130 of the server 100 or an external memory provided separately from the server 100 is, for example, the user information table 133 shown in FIG. Are stored in advance. In the user information table 133, for each identification information (customer ID), a name, a settlement method, and the like are associated and stored. Here, the payment method is a method used for payment specified in advance by the user, and is, for example, electronic money, credit card, net banking, mobile carrier payment, virtual currency, or the like.

  As shown in FIG. 7A, an authentication device 95 is provided at the entrance ENT of the store 200. In this embodiment, only a user who has succeeded in user authentication can enter the store 200. First, the user 400 starts up an application in the terminal device 300 in order to perform an entrance process to the store 200. FIG. 7B is an example of a terminal device 300 on which a key (QR code in the illustrated example) DIS1 that is specific information for causing the authentication device 95 to read is displayed. When the user 400 causes the authentication device 95 to read the key DIS 1, information related to the key DIS 1 is transmitted to the server 100 by the communication unit 220 provided in the store 200. The control unit 110 of the server 100 determines whether or not the identification information corresponding to the key DIS1 is stored in the user information table 133. Here, the key DIS1 may be the user identification information (customer ID) itself, or may be other information associated with the identification information. In the latter case, text data, an image, sound, fingerprint information, retina information, or the like may be used as the specific information and may be read by the authentication device 95.

  When the identification information is stored in the user information table 133, the restriction unit 116 cancels the entrance restriction by the restriction means (for example, a door key, an alarm device, etc.) provided in the store 200. That is, the restricting unit 116 transmits an instruction to cancel the entrance restriction provided in the store 200 to the store 200. The restricting means is not limited to the one that physically restricts entry, but may be one that allows entry into the store 200 but prohibits use of the application.

  Hereinafter, a mode in which a plurality of users (user A400A and user B400B) exist in the store 200 will be described. As shown in FIG. 8 (a), when the users 400A and 400B enter the store 200, as described with reference to FIG. The data is transmitted from the 200 communication means 220 to the detection unit 112. In addition, a floor sensor is provided in the vicinity of the entrance ENT or the authentication device 95, and the identification information of each user and the user's footprint are associated with each other in advance in the storage unit 130 when entering the store 200. Remembered. In addition, as described above, the article determination unit 113 uses the data acquired from the shelf pressure sensor 10, the TOF sensor 20, the line-of-sight sensor 30, and the human sensor 40 provided in the product shelf 80, It is determined whether the product has been removed. Furthermore, the article determination unit 113 identifies the removed product based on the information related to the correspondence between the product shelf and the product stored in the storage unit 130. Based on the data acquired from each sensor, the user determination unit 114 determines a user (a user who has the removed product) associated with the settlement information related to the settlement of the removed product. Then, as shown in FIG. 8 (c), a payment information table 131T in which each piece of identification information (customer ID) is associated with the acquired product, its amount, and the total amount as the payment information is stored in the payment memory. Stored in the unit 131. Further, as shown in FIG. 8 (b), payment information of the products acquired and possessed by the user is displayed on the display units 350A and 350B of the terminal devices 300A and 300B. In the example of FIG. 8, “chocolate” and “water” are associated with the user A (customer ID: 12345) and the user B (customer ID: 67899) is associated with “notes” and “ “Flour” is associated.

  Note that the determination by the article determination unit 113 or the user determination unit 114 may be performed every time the user removes or returns the product from the product shelf, or stores the output data from each sensor in association with the time. The past data may be performed based on the time. However, the former is preferable for the convenience of the user because the payment information is reflected and displayed on the terminal device 300 each time as shown in FIG. 8B.

  In addition, the association between the user identification information and the user footprint is considered to be less accurate when the footprints are similar among users. In this case, a camera may be provided in the store 200, and the identification information and the user's face image may be stored in association with each other at the entrance ENT. Then, the camera may image the vicinity of the product shelf where a predetermined change has occurred, analyze the obtained image, and determine the user who acquired the product.

  When a product is removed from the product shelf and there are multiple users in the vicinity of the product shelf, depending on information from various sensors, the user who has removed the product can be determined with a certain degree of certainty or greater. There may not be. According to the embodiment of the present invention, in such a case, the accuracy of determination can be improved using the purchase history and attribute information of the user. This will be described below.

  In the example of FIG. 8, “notebook” is associated with user B. However, when user B obtains “notebook” from the product shelf, user A and user B exist at the notebook placement location. It is assumed that it is impossible to determine to which user the “notebook” should be associated only by the determination by the sensor. Here, “determination is impossible” means that the user's hand holding the note cannot be extracted more than a predetermined ratio or the sensor information cannot be acquired due to some problem even by analyzing the image at the note placement location. Etc. When the determination is impossible, the user determination unit 114 refers to the purchase history 136 of each user stored in the storage unit 130 illustrated in FIG. Is determined as a user to be associated. In the example of FIG. 9A, it can be seen that the user B with the customer ID: 67899 has purchased notes at a predetermined interval. When the determination date has passed a predetermined interval from the previous note purchase date, the user determination unit 114 associates the note with the identification information of the user B, assuming that the user B is highly likely to purchase the note.

  Moreover, the user determination part 114 may determine the user who matches goods based on a user's attribute information. For example, as illustrated in FIG. 9B, the storage unit 130 may store the service use start date (the registration date of the application or the date when the product is first purchased at the store) as the user attribute information. ), Sex, age, place of residence, occupation, etc. are stored. In the example of FIG. 9, the user determination unit 114 can associate a note with the identification information of the user B who is “student” who is highly likely to purchase “note” based on the attribute information of the user. Further, when the installation location of the store 200 when the notebook is purchased is within “Tokyo”, the notebook may be associated with the identification information of the user B. In addition, a priority may be given to attribute information for every goods, and determination may be performed based on the said priority. For example, when the product is “alcoholic”, “age” may be positioned as the highest priority in the attribute information.

  Next, the product settlement process will be described. As shown in FIG. 8 (a), when the user 400A enters the settlement area (settlement space) 90 of the store 200, as shown in FIG. 10 (a), a screen DIS3 for selecting execution of product settlement is displayed. It is displayed on the display unit of the terminal device 300. For example, this is realized by the display output unit 118 outputting display information for displaying the payment information on the terminal device 300 based on the payment information stored in the payment storage unit 131. Thereafter, when the user 400 selects a button (purchase button) DIS4 for executing settlement, the settlement unit 115 controls to execute settlement. For example, when the payment method is a credit card, the payment unit 115 controls the transmission unit 122 to transmit a payment request to a credit company server (not shown). When the settlement is completed (when a settlement completion response is received), the restriction unit 116 transmits an instruction to release the restriction of restriction means (for example, a door key) for restricting the exit of the store 200, and the outlet OUT of the store 200 Is unlocked. The storage unit 130 also stores a payment history table 134 that stores the user's payment history.

  Note that the payment process may be performed in another manner. Hereinafter, a settlement process according to another aspect will be described with reference to FIG. The settlement area 90 according to one embodiment of the present invention is provided with a plurality of types of sensors for detecting articles as shown in FIG. In FIG. 11A, a placement place 92 is a place where a basket BSK in which a product is placed is placed. The placement place 92 includes at least one of a capacitance sheet, a pressure sheet, a temperature sensor, a specific resistance sensor, a conductivity sensor, and the like that functions as a weight sensor, and the article placed on the placement place 92. Detect attribute information (weight, temperature, conductivity, etc.). In addition, the above-described TOF sensor 20 and camera are installed around the placement place 92 to measure the distance of the shape change and to capture an image. The article may be placed directly on the placement place 92 without using the car BSK. When the car BSK is used, the attribute information of the article is obtained in consideration of the weight, conductivity and the like of the car BSK. In the case of FIG. 11, the basket BSK of the user A is placed, and “flour” is contained in the basket BSK in addition to “water” and “chocolate” previously associated with the user A as the settlement information. Is detected. In this case, the user determination unit 114 updates the payment information so that “flour” is associated with the identification information of the user A.

  Note that the user determination unit 114 extracts a user in which “flour” is erroneously associated with the situation in the store 200 near the time when “flour” is associated with the user A. For example, when “flour” is associated with the user A at “10:00”, the situation in the store 200 in a predetermined time width “9:50 to 10:00” including 10:00 , Acquired from the storage unit 130. The situation in the store 200 is a detection history of various sensors installed in the store 200, and includes, for example, a walking locus detected by the floor sensor 60, a change in weight detected by the shelf pressure sensor 10, and the like. . In addition, the situation in the store 200 includes a determination history by the user determination unit 114. The user determination unit 114 can extract a user B who is highly likely to be associated with “flour” in the vicinity of 10:00. And the user determination part 114 is updated so that "flour" may be deleted from the payment information of the user B with which "flour" was matched.

  Note that the settlement processing according to another aspect described above is not essential, and may be performed when the determination by the user determination unit 114 is uncertain or according to the user's request. In the former case, it is preferable that a notification requesting placement of the product on the placement location 92 is transmitted to the user's terminal, and payment by placing the placement on the placement location 92 is required for purchase of the product. It is good also as conditions.

  As described above, according to an embodiment of the present invention, the user who acquired the product is determined based on the walking trajectory of the user who entered the store 200 and the predetermined change in the display location of the product. Since this predetermined change is detected by the sensor, it is possible to provide the store 200 in which the cost is increased and the processing load on the server is reduced as compared with the case where a plurality of cameras are provided.

  Furthermore, it is determined that a product has been acquired by a user whose walking locus when a predetermined change occurs in the display place is within a predetermined range from the display place where the predetermined change is determined to have occurred. Therefore, the determination accuracy of the user who has acquired the product can be improved.

  Furthermore, according to one embodiment of the present invention, the determination of the user to associate the product is supplementarily performed based on the purchase history and attribute information of the user. Therefore, when a predetermined accuracy cannot be obtained by the determination using various sensors or images, it is possible to improve the determination accuracy of the association between the user and the product.

  Further, a placement place for analyzing the purchased product with various sensors and images is provided, and settlement at the placement place is performed. For this reason, the accuracy of merchandise matching can be further improved and erroneous settlement can be prevented.

  Furthermore, according to an embodiment of the present invention, only registered users for the service, that is, only users whose identification information is stored in advance, can enter the store 200, and only users who have completed payment Exit from the store 200 is possible. Since the user registration is registered on the service side, the user registered to use the service can improve the security in crime prevention of the store 200 which is an unmanned store.

  Note that when using the store 200, the use registration for the service may not be performed (the application may not be installed). In this case, for example, when the user 400 enters the store 200, a setting unit (not shown) sets temporary identification information. For example, a camera is installed at the entrance ENT of the store, and a temporary identification number (one-time customer ID) is associated with the face image of the user 400 who entered the store 200 (face authentication is performed). It is stored in a predetermined storage unit. A floor sensor may be provided at the entrance ENT, and a temporary identification number may be associated with the footprint instead of the face image or together with the face image. After that, since the acquisition of the product in the store 200 by the user is the same as the above-described aspect, the description is omitted. That is, the storage unit of the server 100 stores product settlement information in association with the temporary identification number. The settlement is performed via a settlement device installed in the settlement area 90 of the store 200, for example. The payment device includes at least a display and a camera, for example, and a list of products acquired by a user who performs payment is displayed on the display. This can be realized, for example, by outputting display information based on the payment information of the product associated with the user according to the determination by the user determination unit 114 of the server 100 from the display output unit 118 to the payment device. Then, a request for the user to perform payment via the payment device is output to the server of the credit card company, or the total amount is drawn from the electronic money. Upon completion of the settlement, the outlet OUT of the store 200 is unlocked, and the user can leave the store 200.

  As described above, according to another embodiment of the present invention, even a user who has not registered for service use can use the store 200, which is highly convenient. However, use by an unspecified number of users remains uneasy for crime prevention for unmanned stores. For this reason, store images such as a user who has an unpaid product or a user who repeatedly changes the display location of the product store the past use history of the store 200 in association with the face image obtained by face authentication. It is possible to prevent the restricting unit 116 from releasing the restricting means for restricting entrance to the store 200 for a user who is not allowed to use 200. The user information associated with the temporary identification information is not limited to the face image, but may be a part of the user's clothes or personal belongings. However, as described above, it is preferable to use a face image from the viewpoint of crime prevention in the store.

  Next, a control method according to the embodiment of the present invention described above will be described with reference to the drawings. FIG. 12 is a flowchart of the above-described control. First, the acquisition unit 111 acquires identification information associated with a user who has entered a predetermined space (step S11). The identification information may be stored in the storage unit 130 or the external memory when the service use registration is performed in advance. Based on the data obtained from the floor sensor 60, the detection unit 112 detects a walking locus in a predetermined space (step S12). The article determination unit 113 determines whether or not a predetermined change has occurred at the display place where the products in the predetermined space are displayed (step S13). If the predetermined change does not occur, the process returns to step S12 and the detection of the walking locus is continued. If it is determined in step S13 that the predetermined change has occurred, the user determination unit 114 determines settlement information related to the settlement of the product based on the display location where the predetermined change has been determined and the walking trajectory. The identification information associated with is determined (step S14). Note that the user determination unit 114 determines whether or not the association between the identification information and the product has a determination accuracy equal to or higher than a predetermined value (step S15). If it is determined in step S15 that the determination accuracy is not equal to or greater than the predetermined value, the process proceeds to step S16 and the process proceeds to an erroneous determination process.

  Here, the erroneous determination process in step S16 will be described with reference to the flowchart of FIG. The user determination unit 114 determines whether the identification information associated with the payment information can be determined based on at least one of the user payment history and the user attribute information (step S161). That is, the user determination unit 114 determines whether or not the product can be associated with the user based on the user's payment history (purchase history). Or the user determination part 114 determines whether goods can be matched with a user based on a user's attribute information. Note that the condition as to whether or not the association is possible may be stored in the storage unit 130 in advance. The condition is a condition that can define a predetermined relationship between the product and the user, such as “Purchase the same product at a predetermined interval” and “Purchase a product of the same manufacturer”. Further, regarding the attribute information, conditions such as “does not violate age restrictions” and “products preferred by women” may be used. When the association is possible in step S161, the process proceeds to step S162, and the association between the user and the product is updated or newly created. If the association is not possible in step S161, it is stored in the storage unit 130 as a user that needs reconfirmation (step S163). Here, the settlement information is stored in association with the user although it is uncertain, and information indicating that the user needs reconfirmation is added and stored.

  Returning to the flowchart of FIG. In step S15, when it is determined that the determination accuracy is equal to or higher than the predetermined value, or when the erroneous determination process in step S16 is completed, at least one identification information associated with the identification information is stored in the storage unit 130. Is stored (step S17). When a predetermined settlement request is received from the user terminal device 300 or when the user 400 enters the settlement area 90, the user determination unit 114 is a user that the user 400 needs to reconfirm. Is determined (step S18). The user who needs reconfirmation is a user set in the erroneous determination process in step S16. If the user needs reconfirmation, a confirmation notification is transmitted from the server 100 to the user terminal device 300 (step S19). Here, the confirmation notification is a request to the user 400 to place a product on the placement location 92. For example, “please place the product on the placement location” on the display screen of the terminal device 300. Such a pop-up notification, voice output, or voice guidance in the store 200 may be used. After that, the user 400 places the product on the placement location 92, the product to be purchased is identified by a sensor or image, and it is determined whether or not the association of the purchased product with the user 400 is completed (step). S20). When the association is not completed, the user 400 may be notified again. If it is determined in step S20 that the association has been completed, or if it is not a user that requires reconfirmation in step S18, the process proceeds to step S21, and a settlement process by the settlement unit 115 is performed.

  There is a desire to return purchased products. Below, returned goods processing is explained. After the settlement by the settlement unit 115, the user 400 registers a return request in advance on the application. The return request can be registered, for example, on the display screen of the terminal 300 shown in FIG. The return request is stored in the storage unit 130 in association with the identification information of the user 400. Then, when the user 400 who has made a return request enters the store 200, as shown in FIG. 14B, a notification “Please return to the return place” is displayed on the display screen of the terminal 300. This can be realized, for example, by determining the user 400 to which the server 100 has entered and transmitting display information for displaying the notification to the terminal 300 when the user 100 has transmitted a return request. The return place may be the mounting place 92 described above. When the article requested to be returned by the user 400 is detected at the placement location 92, the payment correction unit 117 associates the refund process for the article requested to be returned with the identification information of the user 400 that has received the return request. . That is, refund processing is performed. Note that the user may return the product to be returned to the product shelf 80. In this case, it is detected by the various sensors provided in the merchandise shelf 80 that the merchandise has been returned, and the payment correction unit 117 performs the refund process. Further, for example, a box for putting returned merchandise may be installed in the settlement area 90, and the user may put merchandise to be returned into the box. Note that this box preferably has a structure that is not purchased by another user until the return processing is completed at the store side.

  The return processing according to the embodiment of the present invention described above will be described with reference to the flowchart of FIG. First, the receiving unit 121 receives a return request from the terminal 300 (step T11). Then, the payment correction unit 117 determines whether or not it can be returned (step T12). Here, whether or not the product can be returned is determined based on the purchase history whether the time limit from the purchase by the user to the return request is within a predetermined period. The predetermined period may be set according to the type of product. Further, it is determined whether or not the product placed at the placement location 92 has changed from the point of sale of the product, such as product damage or opening. These can be determined from, for example, a change in weight, a change in conductivity, and the like by various sensors at the placement location 92. If the return can be made, the payment correction unit 117 performs a refund process and updates the purchase history of the user 400 (step T13). If the return is not possible (for example, if the product is damaged or the return deadline is longer than a predetermined period), the user is notified that the return is not possible (step T14). The notification to the user may be made, for example, by causing the terminal 300 to display a pop-up notification such as “This product cannot be returned” or by outputting by voice. Thereafter, the restricting unit 116 unlocks the exit (step T15).

  Although the present invention has been described based on the drawings and examples, it should be noted that those skilled in the art can easily make various modifications and corrections based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present invention. For example, the functions included in each means, each step, etc. can be rearranged so that there is no logical contradiction, and a plurality of means, steps, etc. can be combined or divided into one. . The structures described in the above embodiments may be combined as appropriate. For example, the processing described as the function of the server 100 may be performed by a server provided in the store 200. In addition, each component described as being included in the server 100 may be realized by being distributed by a plurality of servers.

  Specifically, the processing performed by the control unit 110 may be performed by a server provided in the store 200. For example, functions such as the article determination unit 113 and the restriction unit 116 are provided in the store 200. A server may be provided.

  Although one embodiment of the present invention has been described, it goes without saying that the present invention is not limited to this. For example, in the above description, payment information, user information, and the like have been described as being stored in the storage unit 130 of the server 100. However, the various types of information may be stored as a database in a memory different from the server 100.

  In the above description, an example of a store has been described as the predetermined space. However, the predetermined space can also be applied to rental-type services such as warehouses for storing articles, libraries and rental video stores. In addition, the predetermined space may be an open space as long as it is a space provided with a floor sheet, instead of the closed space as shown in FIG. For example, an unmanned sales space may be provided in an empty space of a building or a condominium or a corner of an office.

  Note that a change in the position information of the user may be used instead of the walking locus using the floor sensor. This can be realized, for example, by installing a beacon transmitter in a predetermined space and using information on the position of the terminal estimated on the terminal device side using short-range wireless communication.

  In addition, regarding the return processing, another user different from the user who purchased the product may come to the store 200 and return the product. For example, when user A makes a return request in advance, this can be realized by sending a request for return to user B to server 100 and registering it in storage unit 130.

  Each functional unit of the server 100 may be realized by a logic circuit (hardware) or a dedicated circuit formed in an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)) or the like, or a CPU (Central It may be realized by software using a Processing Unit. Each functional unit may be realized by one or a plurality of integrated circuits, and the functions of the plurality of functional units may be realized by a single integrated circuit.

  When each function unit of the server 100 is realized by software, the server 100 or the terminal device 300 reads a CPU that executes instructions of a program, which is software that realizes each function, and reads the program and various data by a computer (or CPU). A ROM (Read Only Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) in which the program is expanded, and the like are provided. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. That is, in the information processing apparatus 100 according to the present invention, when the CPU executes a program loaded on the RAM, the acquisition unit 111, the detection unit 112, the article determination unit 113, the user determination unit 114, the settlement unit 115, the restriction Functions as a unit 116, a setting unit 117, and a display output unit 118. As the recording medium, a “non-temporary tangible medium” such as a semiconductor memory or a programmable logic circuit can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

  Note that the above programs include script languages such as ActionScript, JavaScript (registered trademark), Python, and Ruby, object-oriented programming languages such as C language, C ++, C #, Objective-C, Swift, and Java (registered trademark), It can be implemented using a markup language such as HTML5.

500 article providing system 400 user 100 server (information processing apparatus)
DESCRIPTION OF SYMBOLS 200 Store 220 Communication means 300 Terminal apparatus 110 Control part 111 Acquisition part 112 Detection part 113 Article determination part 114 User determination part 115 Settlement part 116 Restriction part 117 Setting part 118 Display output part 120 Communication part 121 Reception part 122 Transmission part 130 Storage part 310 control unit 311 information processing unit 312 display processing unit 313 determination unit 320 communication unit 330 storage unit 340 input reception unit 350 display unit 370 speaker 321 reception unit 322 transmission unit 95 authentication device 50 product 80 product shelf 60 floor sensor 10 shelf pressure sensor 20 TOF sensor R1 walking locus 80A commodity shelf C1 point P1 walking position 30 gaze sensor 40 human sensor 70 shelf floor sensor 400H hand 133 user information table 131T settlement information table 131 settlement storage unit 90 settlement area 1 4 settlement history table 132E table 131E settlement information table

Claims (14)

An acquisition unit for acquiring identification information associated with a plurality of users who have entered the predetermined space;
A detection unit for detecting at least a walking locus of the user in the predetermined space;
An article determination unit that determines whether or not a predetermined change has occurred in the display place where the article in the predetermined space is displayed;
Settlement information related to the settlement of the product displayed at the display place where the predetermined change is determined based on the display place where the predetermined change is determined by the article determination unit and the walking trajectory A user determination unit that determines identification information associated with
A payment storage unit that stores at least one payment information associated with the identification information for each identification information determined by the user determination unit;
A settlement unit that executes settlement based on the settlement information stored in the settlement storage unit;
With
The information processing apparatus that determines identification information associated with the payment information based on a payment history of the user. The user determination unit determines identification information associated with the payment information based on the attribute information of the user;
The information processing apparatus according to claim 1. The user determination unit is provided in a payment space within the predetermined space, and determines identification information associated with the payment information based on information transmitted from a plurality of types of sensors that detect articles.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. A payment history storage unit for storing a payment history by the payment unit for each user;
The payment error is determined based on the payment history, and based on the past determination history in the predetermined space when the payment error occurs, the identification information of the user related to the payment error is included in the identification information of the payment. A payment correction unit for associating payment information to eliminate errors,
Further comprising
The information processing apparatus according to any one of claims 1 to 3. Learning information regarding the state of the predetermined space when the payment error occurs, and at least one accuracy of determination by the article determination unit, determination by the user determination unit, and detection by the detection unit, A learning unit that changes according to the state of the predetermined space;
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus.   The settlement correction unit receives a return request after executing settlement by the settlement unit, and when the article requested for return is detected by the plurality of types of sensors provided in the settlement space, the return 6. The information processing apparatus according to claim 4, wherein a refund process of an article requested to be returned is associated with identification information of a user who has received the request. The article determination unit determines that the removal of the product has occurred among the predetermined changes when the weight after the change at the display place where the product is displayed is smaller than that before the change. When the weight of the product becomes larger than before the change, it is determined that the arrangement of the product has occurred among the predetermined changes.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. The article determination unit may remove a product out of a predetermined change when the changed shape of the displayed product group is smaller than that before the change at the display place where the product is displayed. When the shape after the change is larger than before the change, it is determined that the arrangement of the product has occurred among the predetermined changes.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. The user determination unit is an identification associated with a user whose position when the predetermined change occurs in the walking locus is within a predetermined range from a display place where the predetermined change is determined to occur. The information is determined as identification information associated with the settlement information related to the settlement of the product displayed at the display location where it is determined that the predetermined change has occurred.
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. A restriction unit for controlling restriction means for restricting the user from leaving the predetermined space;
The restriction unit releases the restriction on exit from the predetermined space of the user associated with the identification information for which payment has been executed by the payment unit,
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. A user storage unit for storing identification information associated with the user in association with specific information for specifying the user;
The acquisition unit acquires identification information associated with the specific information transmitted from a terminal device of a user who has entered the predetermined space, from the identification information stored in the user storage unit,
The information processing apparatus according to any one of claims 1 to 10. A display output unit for outputting display information for displaying the payment information associated with the identification information on the display unit of the terminal device corresponding to the identification information associated with the payment information;
The information processing apparatus according to claim 1, wherein the information processing apparatus is an information processing apparatus. In the information processing device,
An acquisition step of acquiring identification information associated with a plurality of users who have entered the predetermined space;
A detection step of detecting at least a walking trajectory of the user in the predetermined space;
A product determination step of determining whether or not a predetermined change has occurred at a display place where the product of the predetermined space is displayed;
Settlement relating to the settlement of the product displayed at the display location where the predetermined change is determined based on the display location where the predetermined change is determined in the product determination step and the walking trajectory A user determination step of determining identification information associated with the information;
A settlement storage step for storing at least one settlement information associated with the identification information for each identification information determined by the user determination step;
A settlement step for executing settlement based on the settlement information stored in the settlement storage step;
And execute
The method for controlling an information processing apparatus, wherein the user determination step determines identification information associated with the payment information based on a payment history of the user. In the information processing device,
An acquisition function for acquiring identification information associated with a plurality of users who have entered a predetermined space;
A detection function for detecting at least a walking locus of the user in the predetermined space;
A product determination function for determining whether or not a predetermined change has occurred in a display place where the product in the predetermined space is displayed;
Settlement information related to the settlement of the product displayed at the display location where the predetermined change has been determined based on the display location where the predetermined change has been determined by the product determination function and the walking trajectory A user determination function for determining identification information associated with
A payment storage function for storing at least one payment information associated with the identification information for each identification information determined by the user determination function;
A payment function for executing payment based on the payment information stored in the payment storage function;
Realized,
The control program for an information processing apparatus, wherein the user determination function determines identification information associated with the payment information based on the payment history of the user.

Images