KR20210141234A - Un-manned sell system - Google Patents

Abstract

The present invention relates to an unmanned sales system, including: a kiosk including an input/output unit for allowing a purchaser to input a purchase product payment signal and outputting payment information of a purchase product; a product storage unit to which a locking state is settable, and provided with a camera unit for photographing a storage space in which one or more storage products are accommodated and a weight calculation unit for calculating an average weight variation value of the storage product that is stored; and a management server that determines the purchase product taken out to an outside from the product storage unit, and approves the payment signal to transmit the payment information to the kiosk, wherein the product storage unit transmits a plurality of photographed images, which are obtained by photographing the storage space by the camera unit from an opening time point to a closing time point of the storage space, to the management server, transmits the average weight variation value calculated by the weight calculation unit to the kiosk, and combines an image comparison result obtained by comparing the photographed images of the management server and a weight comparison result obtained by comparing the average weight variation value of the kiosk with a purchase product weight value so as to determine the purchase product.

Description

Unmanned Selling System {UN-MANNED SELL SYSTEM}

The present invention relates to an unmanned sales system that can sell products unattended based on a product image and product weight without a separate seller.

In general, in order to purchase a product at a store, the buyer selects the product they want to purchase, takes the product to a checkout place, such as a checkout counter, for payment of the selected product, and pays the seller to purchase it. are being adopted

For example, when purchasing coffee at a convenience store, the buyer obtains the coffee he wants to purchase at the convenience store from the product storage department, such as a refrigerator, takes it to the checkout counter, hands it to the seller, and the seller provides price information for the product After determining using barcodes, etc., the purchase stage of the product is completed by paying the amount for the determined price and passing it to the buyer.

However, in the case of the product purchase method as described above, there is a problem in that the seller cannot purchase the product when the seller is absent due to circumstances because the seller must wait at the stand.

In addition, when a large number of buyers flock in a short time or there is only one stand for checkout, there is a problem in that the buyer has to wait for a long time to purchase the product.

Recently, in order to overcome this problem, various unmanned vending devices such as kiosks are installed in product vendors, and the situation in which buyers can directly purchase products using the unmanned vending device without directly bringing the product to the seller is increasing.

The prior art literature on the conventional unmanned vending device is as follows.

Patent Registration No. 10-1949258 (Title of Invention: Kiosk-based payment system) However, the conventional unmanned sales system has the following problems. However, there is a problem in that generations who cannot operate electronic devices well, for example, the elderly, cannot pay for products through unmanned sales products. That is, not only the procedure for purchasing a product as an unattended product is difficult, but also when the purchaser cannot properly perform an operation such as recognizing a barcode on the product, it is rather difficult to purchase the product. In addition, there is a problem that cannot be prevented when theft or theft occurs such as when a buyer acquires a product and takes it without paying for it, such as a shelf in which the product is stored. In order to overcome this problem, the seller must be resident in CCTV or at the checkout counter, which increases the maintenance cost such as labor cost and equipment cost, which eventually becomes a burden to the operator. In addition, when the seller incorrectly recognizes barcode information on the buyer's product or the buyer erroneously operates the unmanned selling device, there is a problem in that accurate price payment for the product to be purchased is not made.

In order to solve the above problems, an object of the present invention is to provide an unmanned sales system that directly recognizes price information for the selected product and pays for the product when a buyer directly selects a product to purchase.

In particular, for this purpose, the present applicant has developed a technology for determining the purchase product of the purchaser according to the stored product by comparing the photographed images taken at the opening and closing of the product storage device by arranging a photographing device in the conventional product storage device. .

However, when determining a purchase product by comparing only the photographed images, the following problem occurs and is intended to be solved.

First, if the product is stacked on the shelf as the photographing device shoots the upper part of the shelf, even if the purchaser takes the product out, the image of the product is preserved as it is, so there is a problem in that the purchase product is not confirmed properly.

In addition, when the user consumes only the internal contents without purchasing the product on the shelf, for example, when there is a user's cheating such as drinking a drink and placing only an empty bottle on the shelf, there is a problem in that it is difficult to determine it only with the photographed image.

In addition, when the photographed image is taken unclearly or the display state of the product is not properly displayed, there is a problem in that information on the payment product or the amount of payment cannot be accurately grasped even if the photographed image is compared.

The present invention aims to solve the above problems, but is not limited to the technical problems as described above, and another technical problem may be derived from the following description.

An unmanned sales system according to an embodiment of the present invention includes: a kiosk provided with an input/output unit through which a purchaser inputs a purchase product payment signal and outputs payment information of the purchased product; a product storage unit in which a camera unit for photographing a storage space in which one or more stored products are accommodated and a weight calculation unit for calculating an average weight change value of the stored products are disposed, and a locking state can be set; and a management server that determines the purchased product exported from the product storage unit to the outside, approves the payment signal, and transmits the payment information to the kiosk, wherein the product storage unit includes: an opening time of the storage space The camera unit transmits a plurality of photographed images obtained by photographing the storage space to the management server, and transmits the average weight change value calculated by the weight calculation unit to the kiosk, and the management server The purchase product is determined by combining the image comparison result of comparing the plurality of photographed images and the weight comparison result of comparing the average weight change value of the kiosk and the purchased product weight value.

In addition, the camera unit, the first photographed image of the storage space at the opening time of the storage space and the second photographed image of the storage space at the closing time of the storage space, the management server is the first photographed image and comparing the second photographed image to first determine the purchased product taken out from the storage space.

In addition, the weight calculation unit, a plurality of weight sensors arranged on the shelf on which the stored products are loaded to sense the weight; and a weight integration unit for calculating an average weight change value of the weight by integrating the weight measurement values of the weight sensor, wherein the kiosk has a first storage unit for storing purchased product weight values for each purchased product, and the average weight change value is compared with the weight value of the purchased product to secondarily determine the purchased product.

In addition, when a plurality of shelves are disposed, the weight calculation unit further includes an integrated calculation unit that separates and manages the average weight change value for each shelf based on the average weight change value calculated from the weight integration unit. characterized in that

In addition, when the average weight change value is less than the purchased product weight value, the management server is characterized in that it transmits a call message to the manager terminal.

In addition, when the average weight change value exceeds the purchased product weight value, the kiosk measures an error value between the average weight change value and the purchased product weight value, and the purchased product weight stored in the first storage unit It is characterized in that the value is corrected.

In addition, when the average weight change value is the same as the purchased product weight value, the kiosk finally determines the purchased product and outputs the determined purchased product information to the outside.

According to the unmanned sales system and the unmanned sales method using the same according to an embodiment of the present invention having the above configuration, the following effects are obtained.

First, the buyer simply recognizes the payment method in the kiosk, then goes to the product storage department and brings the desired product. , through this, users who have difficulty using the kiosk such as the elderly can easily purchase the product.

From the perspective of the business operator, there is no need to hire a separate manpower or directly sell the product in the store, so labor costs and maintenance costs are reduced. Safety and security status are also excellent effects.

In particular, it is possible to prevent image fluctuation errors by first determining the payment product by comparing the photographed images, and secondarily checking the payment product through the weight difference value calculated through the weight calculation unit and finally confirming it. can have an effect.

In addition, if the product cannot be confirmed by image alone, for example, if purchased products are stacked on a shelf in a vertical direction, it is not possible to check whether the product is sold only by image comparison, whereas by adding weight information, the quantity and information of the payment product can be checked. It has the effect of being able to decide clearly.

In addition, if there is a change in weight even though there is no change in the photographed image as the weight information is used, a notification is sent to the manager terminal to check and manage the misconduct of the product storage device user in real time. there is

1 is a block diagram of an unmanned sales system according to an embodiment of the present invention.
2 is a configuration diagram of a product storage unit and a weight calculation unit of the unmanned sales system according to an embodiment of the present invention.
3 is a schematic diagram of the configuration of an unmanned sales system according to an embodiment of the present invention.
4 is a step-by-step flowchart of an unattended selling method according to an embodiment of the present invention.
5 is a flowchart of unmanned sales step-by-step for each component of the unmanned sales system according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings, embodiments of the present invention will be described in detail so that those of ordinary skill in the art to which the present invention pertains can easily implement them. The present invention may be embodied in many different forms and is not limited to the structure or method described herein.

An embodiment of the present invention relates to an unmanned sales system and a product unattended sales method using the same. Hereinafter, such a sales system will be briefly referred to as an “unmanned sales system” and a sales method will be referred to as an “unmanned product sales method”. .

1 is a configuration diagram of an unattended vending system 100 according to an embodiment of the present invention, and FIG. 2 is a schematic diagram of the configuration of an unmanned vending system 100 according to an embodiment of the present invention.

1 and 2 , the unmanned selling system 100 according to an embodiment of the present invention is a system in which a buyer can purchase a product by using the buyer's payment method in a state where a separate seller does not exist. A kiosk 110 including an input/output unit 111 for inputting a purchase product payment signal or outputting payment information of a purchased product, a storage space for storing one or more products for sale is formed therein, and photographing the storage space The camera unit 123 and the product storage unit 120 in which the weight calculation unit 124 for measuring the weight of the stored product is disposed and the product storage unit 120 determine the purchased product taken out to the outside, and the kiosk 110 ) may include a management server 130 that approves the commercial payment signal and transmits payment information to the kiosk 110 .

That is, the purchaser recognizes the payment method through the kiosk 110 and, based on the recognized payment method information, can take out the purchased product that he/she wants to purchase among the stored products stored in the product storage unit 120 to the outside. The information on the purchased product is output to the kiosk 110 through the management server 130 , so that the purchaser can check the information of the purchased product through the kiosk 110 and proceed with payment. A detailed operation for this will be described below.

The kiosk 110 is a means by which a user can select a purchased product to purchase a product or perform payment for the selected purchased product. In detail, the kiosk 110 allows the buyer to input a payment signal for the purchased product, and the input/output unit 111 for outputting detailed product-related information such as price information and payment information of the purchased product to the outside, to recognize the purchaser's payment method The payment method recognition unit 112 for the purchase, the payment unit 113 for generating a payment signal for the purchased product selected by the buyer, and an additional purchase setting unit 114 for additional purchase of the product before payment after the buyer selects the purchased product ), the product storage selection unit 115 that can select the product storage unit 120 in which the purchase product desired by the purchaser is accommodated, and the average weight change value of the weight detected from the weight calculation unit 124 to be described later is the weight of the purchased product. It may include a weight comparison unit 116 that determines the weight comparison result by comparing it with the purchased product weight value, a first storage unit 117 in which various information is stored, and a first communication unit 118 that transmits various information signals to the outside. have. Hereinafter, each configuration will be described in detail.

The input/output unit 111 receives a signal from the purchaser or provides various information to the outside. In the present invention, the input/output unit 111 is described as one configuration, but is not limited thereto. Note that it can be configured.

In detail, when the kiosk 110 is not used, an image or an image stored in the first storage unit 117 such as a promotional image may be output to the outside through the input/output unit 111 . The image or image stored in the first storage unit 117 may be set and stored by an administrator, and may include, for example, a promotional image for a product, the current date and time, weather information, and the like. In addition, the input/output unit 111 may display a screen through which the purchaser can search for a product stored in the product storage unit 120 and check information on the stored product.

When the buyer intends to pay for the purchased product through the kiosk 110 , the image and price information of the purchased product are transmitted from the management server 130 to the first communication unit 118 and through the input/output unit 111 . It can be output to the outside, and through this, the buyer can check the purchase amount of the purchased product.

In addition, the purchaser can determine whether to pay for the purchased product through the input/output unit 111 , and according to the determination, the payment unit 113 generates a payment signal for the purchased product and transmits it to the management server 130 , and then the management server When the 130 generates a payment approval signal that approves the payment signal, the purchased product may be settled. A detailed description thereof will be provided later.

The payment method recognition unit 112 is a means for recognizing the information of the purchaser's payment method. In detail, the payment method recognition unit 112 may recognize a payment method, for example, a purchaser's credit card or check card, and determine whether the recognized payment method is a normal payment method. Here, the normal payment method means that payment can be normally made through the payment method. For example, when the payment method is reported as lost or the transaction is suspended, the payment method may be recognized as abnormal.

The payment method recognition unit 112 may generate a first determination result when the payment method is recognized as normal, and on the contrary, when the payment method is recognized as abnormal, it may generate a second determination result, and the generated first determination result Alternatively, the result signal of the second determination result may be transmitted to the management server 130 . Thereafter, the management server 130 may set the lock state of the product storage unit 120 according to whether the transmitted result signal is the first determination result or the second determination result. A detailed description thereof will be provided later.

The payment unit 113 is a means by which the purchaser can proceed with payment for the purchased product taken out from the product storage unit 120 . In detail, when the buyer selects a purchased product, the kiosk 110 receives information about the purchased product from the management server 130 and outputs it through the input/output unit 111 to the outside, and the buyer checks the purchased product information and then pays A payment signal may be generated through the payment unit 113 by using the payment method recognized by the means recognition unit 112 . The payment unit 113 may transmit the generated payment signal to the management server 130 .

The additional purchase setting unit 114 adds a product if the purchaser is in the product to be additionally purchased among the stored products stored in the product storage unit 120 before proceeding with payment for the purchased product through the payment unit 113 . It is a means to purchase. In detail, when the purchaser inputs an additional purchase signal, the additional purchase setting unit 114 may select the product storage unit 120 in which the desired product is stored among the stored products through the product storage selection unit 115 again. .

The product storage selection unit 115 selects the product storage unit 120 from the purchaser when the payment method recognized through the payment method recognition unit 112 is recognized as normal and the first determination result is transmitted to the management server 130 . It is a means of receiving a signal. In detail, when there is one product storage unit 120, the configuration of the product storage selection unit 115 may be omitted, but when there are a plurality of product storage units 120, the purchaser selects the product storage selection unit 115. Through this, the product storage unit 120 for releasing the lock state may be selected, and the selected selection signal may be transmitted to the management server 130 . When the purchaser selects the product storage unit 120 in which the desired product is stored through the product storage selection unit 115 , the management server 130 may unlock the selected product storage unit 120 . A detailed description thereof will be provided later.

For example, the purchaser utilizes a recognition code such as a QR code of the product storage unit 120 through the input/output unit 111 to select the product storage unit 120 as the product storage selection unit 115, or the product storage unit ( A desired product storage unit 120 may be touched and selected through the arrangement map of 120 .

The weight comparison unit 116 compares the average weight change value of the weight detected from the weight calculation unit 124 with the product weight value, which is the weight of the purchased product stored in the first storage unit 117, to determine the product whose weight has changed. is a means That is, the weight comparison unit 116 may calculate a weight comparison result by comparing the average weight change value with the purchased product weight value, and through the weight comparison result, which purchased product was sold or if the weight is different from the purchased product weight, the contents It is a means to determine whether or not the missing state.

If the purchased product weight value exceeds the average weight change value, there is a possibility that some of the contents of the stored product have been taken out in an illegal way, or an operation error of the weight calculation unit 124 or the weight comparison unit 116 is detected. A notification about the matter can be sent to the manager's terminal of the manager deemed to have been completed.

Conversely, when the purchased product weight value is less than the average weight change value, since there is an error in the actual purchased product weight information, an error in the purchased product weight information stored in the first storage unit 117 may be adjusted.

Even if the error is finally adjusted or otherwise, the purchased product may be finally confirmed if the purchased product weight value and the average weight change value are the same.

The detailed operation of the weight comparison unit 116 will be described later in detail in the step of explaining the linked operation of the kiosk 110 , the management server 130 , and the product storage unit 120 .

The first storage unit 117 is a means for storing information to be input and output through the kiosk 110 . In detail, the first storage unit 117 may store an image or an image to be output to the outside through the input/output unit 111 , and in addition, guide information for a user to purchase a purchased product using the kiosk 110 . Information such as image or image information including the product storage unit 120 for selecting the product storage unit 120, identification code, and the like may be stored.

In addition, the first storage unit 117 may store a product weight value for each product of the stored products seated on the shelf 121a. As an example, each product weight value of the stored product such as 221 g per bottle for juice A and 500 g per pack for lunch box B may be stored, and the weight comparison unit weight comparison unit based on the product weight value stored in the storage unit 117 . results can be produced.

In addition, the first communication unit 118 is a means for transmitting and receiving various types of information through the product storage unit 120 and the management server 130 . In detail, a result signal for determining whether the payment method recognized by the payment method recognition unit 112 through the first communication unit 118 is normal, a payment signal generated through the payment unit 113, and an additional purchase setting unit 114 Alternatively, the information signal of the product storage unit 120 selected through the product storage selection unit 115 may be transmitted to the management server 130 , and payment approval information, purchase product detailed information, etc. may be transmitted from the management server 130 . have.

In addition, the first communication unit 118 may receive the average weight change value information calculated by the weight calculation unit 124 to calculate the weight comparison result from the weight comparison unit.

The product storage unit 120 is a means capable of accommodating one or more products for purchase by a buyer therein. In detail, the product storage unit 120 includes a storage space portion 121 having a space for accommodating one or more stored products therein, a door portion 122 capable of selectively opening or closing the storage space portion 121 and setting a locking state. ), the camera unit 123 disposed in the storage space unit 121 to photograph the space in which one or more stored products are stored, and the average weight of the changed weight by detecting the weight information of the storage products stored in the storage space unit 121 A weight calculation unit 124 for measuring the change value, a second storage unit 125 for storing various information for management, and a second communication unit 126 for transmitting and receiving various signals with the management server 130 and the kiosk 110 . ) may be included.

The storage space unit 121 is a means for forming a space in which storage products for purchase by the purchaser are accommodated therein. The storage space unit 121 may include a shelf generally used in a store or a convenience store, which has a general configuration, and a redundant description thereof will be omitted.

In addition, one or more shelves 121a may be disposed in the storage space unit 121 . In detail, a plurality of stored products may be stacked and stored in one or more shelves 121a in a vertical or horizontal direction, and a user can take out a purchased product he wants to purchase from among the plurality of stored products from the shelf 121a. can In addition, some components of the weight calculation unit may be disposed on the shelf 121a. This will be described later.

The door unit 122 is a means for selectively opening or closing the storage space unit 121 , and may be a slide (sliding door) or a rotary door. In addition, the door unit 122 is formed with a locking unit capable of setting a locking state, and upon receiving a lock setting signal from the management server 130, the storage space unit 121 can be set to a locked state in a closed state, Conversely, upon receiving a lock release signal from the management server 130 , the storage space unit 121 may be set to an unlocked state so that it can be opened. When the door unit 122 receives the lock setting signal and is maintained in the locked state, even if the purchaser pushes or rotates the door unit 122 , the storage space unit 121 is not opened. In this case, the lock unit is an electronic lock control device. may include.

The camera unit 123 is disposed inside the storage space 121 and is a means for photographing a space in which one or more storage products are disposed in the storage space. In detail, the camera unit 123 has a sensor disposed therein, and when the sensor recognizes the time when the door unit 122 opens the storage space unit 121 , it can start photographing the storage space unit 121 , and When the sensor recognizes the time when the unit 122 closes the storage space 121 , the photographing of the storage space 121 may be stopped. In this case, the camera unit 123 generates a plurality of photographed images by photographing the storage space unit 121 at a set time interval, or generates each photographed image at the opening and closing time points of the storage space unit 121 . can do.

The weight calculation unit 124 is disposed in the product storage unit 120 and is a means capable of calculating a change in weight of the product accommodated in the storage space. In detail, the weight calculating unit 124 includes a plurality of weight sensors 124a, which are arranged on each of the one or more shelves 121a, and can sense the weight of the stored products arranged on the shelves 121a in real time, at least one A weight integration unit 124b and a weight integration unit arranged on each shelf 121a and calculating an average weight change value by integrating the weight change values detected by a plurality of weight sensors 124a disposed on the corresponding shelves 121a It may include an integrated calculation unit 124c that calculates and manages the average weight change values calculated in each of the shelves 124b by integrating them for each shelf 121a.

The plurality of weight sensors 124a are respectively disposed below the shelf 121a to separately detect a change in weight of the stored products stored in the shelf 121a. For example, when the shelf 121a has a rectangular shape, four weight sensors 124a may be disposed at the lower edge end of the shelf 121a. In this case, each weight sensor 124a may detect primary weight information, which is the weight of the stored product excluding the weight of the shelf 121a itself, when the door part of the product storage unit 120 opens the storage space, and the number of products. When the door unit of the payment 120 closes the storage space, secondary weight information that is the weight of the stored product excluding the weight of the shelf 121a itself can be detected.

The weight integration unit 124b is disposed one by one on one shelf 121a and calculates the difference between the secondary weight information and the primary weight information detected by a plurality of weight sensors 124a disposed on the shelf 121a. A weight change value for each weight sensor 124a may be determined, and an average weight change value may be calculated from the weight change value calculated for each sensor 124a. This is to minimize a weight measurement error for each weight sensor 124a and to minimize a weight measurement error value due to an error of the weight sensor 124a when a single weight sensor 124a is used.

The integrated calculation unit 124c is a means for calculating and managing the weight change value for each shelf 121a by integrating and calculating the average weight change value calculated by the weight integration unit 124b for each shelf 121a. That is, when there are a plurality of shelves 121a, the integrated calculation unit 124c determines and classifies the average weight change value for each shelf 121a, so that the weight comparison unit later determines the weight information of the stored products stored for each shelf 121a. The average weight change value for each shelf 121a determined by the integrated calculation unit 124c may be substituted for comparison.

The second storage unit 125 may store a plurality of pieces of information generated through the product storage unit 120 . In detail, a plurality of photographed images captured by the camera unit 123 may be stored in the second storage unit 125 . Also, the average weight change value for each shelf 121a calculated through the weight calculation unit may be stored. The plurality of photographed images stored in the second storage unit 125 and the average weight change value information for each shelf 121a may be transmitted to the management server 130 and the kiosk 110 through the second communication unit 126 , respectively. .

The second communication unit 126 is a means for transmitting and receiving various types of information through the kiosk and the management server 130 .

In detail, the second communication unit 126 may transmit a plurality of photographed images photographed through the camera unit 123 to the management server 130 , and also the locked state of the door unit 122 from the management server 130 . may receive a lock setting signal or a lock release signal for setting the .

Also, the second communication unit 126 may transmit information on the average weight change value for each shelf 121a calculated through the weight calculation unit to the kiosk.

The management server 130 is connected to the kiosk 110 and the product storage unit 120 to control and manage the operations of the kiosk 110 and the product storage unit 120 . The management server 130 may determine the purchased product exported from the product storage unit 120 to the outside, approve the payment signal of the kiosk 110, and transmit payment information to the kiosk 110, and the product storage unit ( 120) can be set. The management server 130 may include, for example, a cloud server. That is, since the management server 130 can integrate and manage a plurality of kiosks 110 and the product storage unit 120 at the central end, there is an effect of high management efficiency.

In detail, the management server 130 compares the image comparison unit 131 capable of comparing a plurality of photographed images photographed from the camera unit 123, and comparison data of a plurality of photographed images compared through the image comparison unit 131. A purchase product determination unit 132 that determines the purchase product of the buyer based on The lock state setting unit 134 for setting the lock state of the accommodating unit 120, image information and detailed information (eg, price information, etc.) of the stored product stored in the product accommodating unit 120, payment information, etc. A third storage unit 135 to store and communicate with the kiosk 110 and the product storage unit 120 may include a third communication unit 136 for transmitting and receiving various types of information.

The image comparison unit 131 is a means for comparing a plurality of photographed images photographed from the camera unit 123, preferably, the photographed image at the open time point and the photographed image at the closed time point. In detail, the photographed image at the time of opening of the product storage unit 120 may be the first photographed image in a state in which the stored products inside are not taken out, and the photographed image at the time of closing is the purchase that the purchaser wants to purchase among the stored products. It may be a second photographed image of a state in which the product is taken out. The image comparison unit 131 may compare the first photographed image and the second photographed image to generate image difference information generated by the difference between the photographed images.

The purchase product determination unit 132 is a means for preliminarily determining a purchased product based on the image difference information obtained by comparing the photographed images through the image comparison unit 131 . In detail, the purchase product determination unit 132 may compare the image difference information with the purchased product image information stored in the third storage unit 135 to preliminarily determine the type and quantity of the purchased product purchased by the purchaser.

In addition, the purchase product determination unit may receive the comparison result of the weight comparison unit and determine the pre-determined purchase product as the final purchase product, and may calculate purchase price information of the determined final purchase product. The calculated purchase price information may be transmitted to the kiosk 110 through the third communication unit 136 .

When the purchaser generates a payment signal for purchase price information through the payment unit 113 of the kiosk 110 , the payment approval unit 133 is a means for receiving the payment signal and proceeding with approval of the payment signal. The payment approval unit 133 may generate a payment approval signal for approving the payment signal, and may transmit the generated payment information to the kiosk 110 . The operation of the payment approval unit 133 is a known technology generally used in the process of payment through a payment method, and a detailed description thereof will be omitted.

The lock state setting unit 134 may release the lock of the product storage unit 120 when receiving a signal as a result of the first determination that the payment method is normal from the kiosk 110, and when payment for the purchased product is completed, the product storage unit It is a means to set the lock of 120. In detail, the lock state setting unit 134 may control the lock setting or unlocking of the product storage unit 120 by transmitting a signal for controlling the lock unit disposed on the door unit 122 of the product storage unit 120 . .

In addition, the lock state setting unit 134 may have a different operation method when there is one product storage unit 120 and when there are a plurality of product storage units 120 .

First, a case in which there is one product storage unit 120 will be described. When the payment method recognition unit 112 determines that the payment method is normal and transmits the first determination result to the management server 130 , the lock state setting unit 134 may release the lock state of the product storage unit 120 . . In this case, since there is only one product storage unit 120, the purchaser does not need to separately select the product storage unit 120. Upon receiving the first determination result, the locking state of the product storage unit 120 is released immediately. This is so that buyers can take out the products they want right away.

Otherwise, when a plurality of product storage units 120 are disposed, the purchaser selects the product storage selection unit 115 after the first determination result generated by the payment method recognition unit 112 is transmitted to the management server 130 . Through this, one or more product storage units 120 in which desired purchased products are stored may be selected, and the lock state setting unit 134 may unlock the selected one or more selected product storage units. That is, in this case, since the purchaser can select the desired product storage unit to be unlocked through the product storage selection unit 115 , the lock state setting unit 134 may release only the locked state of the selected product storage unit 120 . can

Conversely, the lock state setting unit 134 may maintain the locked state of the product storage unit 120 when receiving the second determination result signal that the payment method is abnormal from the kiosk 110 . That is, in this case, it is determined that the stored product cannot be sold because the payment method is abnormal, and the product storage unit 120 is maintained in a locked state to maintain product safety.

In addition, the lock state setting unit 134 transmits a payment approval signal to the kiosk ( 110), the product storage unit 120 may be set to a locked state. In detail, when the payment approval signal is transmitted to the kiosk 110 and payment is completed, there is no reason to maintain the unlocking of the product storage unit 120 anymore. Payment 120 may be kept in a locked state.

The third storage unit 135 may store detailed information on the stored product stored in the product storage unit 120 , for example, product description information and unit price information on the stored product, and image information of the stored product. The stored product detailed information in the third storage unit 135 may be transmitted to the kiosk 110 and output to the outside, and the image information of the stored product is compared with the image difference information in the purchase product determination unit 132 to purchase price information. can be used to determine

The third communication unit 136 is a means for transmitting and receiving various signals by being connected to the first communication unit 118 of the kiosk 110 and the second communication unit 126 of the product storage unit 120. In detail, the third communication unit ( 136) may transmit detailed information of the received product and purchase price information to the kiosk 110 through the first communication unit 118, and receive a result signal for determining whether the payment method is normal, and a payment signal and a weight comparison result of the weight comparison unit. In addition, the third communication unit 136 may transmit a lock setting signal or a lock release signal for setting the lock state of the product storage unit 120 to the product storage unit 120 through the second communication unit 126 . and a photographed image of the camera unit 123 may be transmitted.

Hereinafter, an unattended product selling method in which the unmanned selling system 100 according to an embodiment of the present invention operates to sell a product will be described in detail step by step with reference to the drawings. 4 is a step-by-step flowchart of an unmanned sales method according to an embodiment of the present invention, and FIG. 5 is a step-by-step flowchart of unmanned sales for each component of the unmanned sales system 100 according to an embodiment of the present invention.

4 and 5 , in the unmanned product sales method, a product inquiry step for inquiring a product stored in the product storage unit 120, a payment method recognition step for recognizing a payment method (S110), a payment method When it is recognized as normal, the product storage unit selection step (S120) of selecting the product storage unit 120, the unlocking step (S130) of releasing the lock state of the selected product storage unit, and the purchaser after unlocking the selected product storage unit The storage space unit 121, an image photographing step of photographing a product image of the storage space from the opening time to the closing time (S140), an image comparison step of pre-determining a purchased product by comparing the photographed images transmitted from the management server 130 ( S150), a weight information detection step (S160) of detecting the weight information of the stored product seated on the shelf 121a of the product storage unit 120 from the opening time to the closing time of the storage space unit 121 (S160), a weight calculation unit ( 124) compares the weight information and calculates the average weight change in the weight difference calculation step (S170), the average weight change value calculated by the weight comparison unit and the image comparison step Purchase product determination step (S180) to finally determine a pre-confirmed purchase product by comparing the amount of change, purchase product addition step (S191) to add purchased products among stored products, It may include a payment step (S192) of performing a payment according to the purchase price information and a lock setting step (S193) of setting the selected product storage unit to a locked state when the payment is approved.

First, in the kiosk 110 before the product inquiry step, the image or image stored in the first storage unit 117 may be maintained in a state in which it is output to the outside through the input/output unit 111 .

In the product inquiry step, the purchaser may inquire product information on the product stored in the product storage unit 120 through the input/output unit 111 . In detail, when the purchaser inputs a product information inquiry signal through the input/output unit 111 , detailed information about the stored product stored in the product storage unit 120 from the management server 130 , for example, product name, product unit price, product An image may be output through the input/output unit 111 , and the purchaser may check whether a desired purchased product exists.

When the purchaser confirms that there is a product desired to be purchased through the product inquiry step, the payment method recognition step (S100) in which the purchaser recognizes the payment method to the payment method recognition unit 112 of the kiosk 110 may proceed. In detail, the purchaser can recognize the payment means such as the purchaser's credit card to the payment method recognition unit 112, and the payment method recognition unit 112 determines whether the recognized payment method is a normal payment method, and if normal, the first If the determination result is abnormal, the second determination result signal may be transmitted to the management server 130 . Also, in this process, a process of recognizing a payment method through the input/output unit 111 may be guided.

When the payment method recognition unit 112 transmits the first determination result to the management server 130 , the product storage unit selection step (S120) in which the purchaser can select the product storage unit 120 may proceed. In the product storage unit selection step (S120), the product storage unit 120 is selected by recognizing the QR code of the desired product storage unit 120 through the input/output unit 111 of the kiosk 110 or selecting it through a touch input. can The product storage unit selection step ( S120 ) may be omitted when only one product storage unit 120 is disposed.

Conversely, when the payment method recognition unit 112 transmits the second determination result to the management server 130 , the kiosk 110 may return to the image or image output state before the product inquiry step.

When the purchaser selects the product storage unit 120 through the product storage unit selection step (S120) of the kiosk 110, the management server 130 unlocks the selected product storage unit lock state (S130) can be performed. In detail, when the purchaser selects the product storage unit 120 through the input/output unit 111 , the information of the selected product storage unit 120 is transmitted to the first communication unit 118 of the kiosk 110 and the third communication unit of the management server 130 . It can be transmitted to the management server 130 by communication of 136. The lock state setting unit 134 of the management server 130 generates a lock release signal for releasing the lock state of the selected product storage unit selected product. may be transmitted to the receiving unit, and the locking unit disposed on the door unit 122 of the selected product receiving unit may operate to release the locked state of the selected product receiving unit.

When the door unit 122 is opened to take out the purchased product desired by the buyer from the storage space in a state in which the lock state of the optional product storage unit is released, that is, from the time the storage space unit 121 is opened, the door unit An image taking step (S140) of photographing the storage space 121 by operating the camera unit 123 until the 122 is closed and the storage space 121 is closed may be performed. In this case, the camera unit 123 may photograph the storage space unit 121 from the opening time to the closing time of the storage space unit 121 over a plurality of times, and thus a plurality of photographed images may be generated.

When the storage space unit 121 is closed, a plurality of photographed images taken from the camera unit 123 may be transmitted to the management server 130 by communication between the second communication unit 126 and the third communication unit 136 . . In addition, the image comparison unit 131 of the management server 130 compares a plurality of transmitted images to extract image difference information before and after the purchaser takes out the product of the storage space unit 121 to the outside. An image comparison step (S150) may be performed. The image difference information extracted in the image comparison step (S150) may be compared with the image information of the stored product stored in the third storage unit 135, and accordingly, the purchased product is preliminarily determined by the purchase product determination unit 132. can be confirmed

In addition, at the same time the image taking step (S140) is performed, that is, from the time the storage space unit 121 is opened to the time when the door unit 122 is closed and the storage space unit 121 is closed, the weight calculation unit operates to operate the storage space. A weight information detection step (S160) of detecting weight information for each shelf 121a of the may be performed.

In detail, in the weight information detection step (S160), a plurality of weight sensors 124a arranged for each shelf 121a among the configuration of the weight calculation unit may detect weight information, and the weight information detected by the weight integration unit 124b can be integrated to calculate the weight information value.

In addition, in the weight information sensing step (S160), the weight of the stored product stored in the shelf 121a may be primarily detected at the time the storage space is opened to determine the primary weight information value, and the storage space may be closed. At a point in time, the weight of the stored product stored in the shelf 121a may be detected secondarily to determine the secondary weight information value.

After the weight information detection step (S160), a weight difference calculation step (S170) capable of calculating an average weight change value from the determined weight information value may be performed. In detail, the weight integration unit 124b of the weight calculation unit 124 may determine an average value of the secondary weight information value and the primary weight information value detected by the weight sensor 124a for each shelf 121a, and the integrated calculation unit Reference numeral 124c calculates a difference value between the secondary weight information value and the primary weight information value based on the determined average value to calculate an average weight change value for each shelf 121a. That is, the calculated average weight change value may be changed in proportion to the change in the stored products for each shelf 121a. In addition, the average weight change value may be transmitted to the kiosk 110 through the second communication unit of the product storage unit.

The purchase product determination step (S180) compares the average weight change value calculated by the weight comparison unit 116 of the kiosk 110 with the purchase product weight value of the purchased product pre-determined through the image comparison step to obtain a pre-confirmed purchase product. This may be the final decision step. In detail, in the purchase product determination step, it may be determined whether the purchased product weight value is equal to or less than the average weight change value.

As a result of judgment, if the purchased product weight value exceeds the average weight change value (when the purchased product weight value exceeds the average weight change value by less than the first set value), only a part of the purchased product is lost As a result, it is possible to transmit the comparison result to the management server, and the management server 130 receives it and sends an error to the manager terminal because it may be considered that a part of the stored product is lost or an error has occurred in the operation state of the weight calculation unit or the weight comparison unit. You can send messages for invoking a state, etc.

Conversely, when the purchased product weight value is equal to or less than the average weight change value as a result of the determination, it may be secondarily determined whether the purchased product weight value and the average weight change value are the same. As a result of the determination, when the purchased product weight value is less than the average weight change value (when the purchased product weight value is less than the difference between the average weight change value and the first set value), the weight value information of the purchased product stored in the first storage unit is Because it is wrong or because the purchased product information is incorrect, the kiosk 110 corrects the purchased product weight value information stored in the first storage unit 130 based on the error value between the average weight change value and the purchased product weight value, or Purchase information can be adjusted.

Further, as a result of the secondary determination, when the purchased product weight value is the same as the average weight change value, the purchase product determination unit 132 may determine the purchase product by finally confirming the purchase of the pre-determined purchase product. In detail, the fact that the purchased product weight value and the average weight change value are the same means that the purchased product pre-confirmed through image comparison is the actual purchased product. and, based on this, purchase price information of the purchased product may be calculated, and may be transmitted to the kiosk 110 and output to the outside through the input/output unit 111 .

That is, in the product purchase decision step ( S180 ), a product to be purchased may be finally determined through comparison of photographed images and weight comparison.

The purchase product addition step S191 is a step for the user to additionally purchase a purchased product from among the stored products when the purchase product is determined and the purchase qualification information is output through the input/output unit 111 to the outside. When the purchaser inputs a purchase product addition signal through the additional purchase setting unit 114 , the steps from the product storage unit selection step S120 to the purchase product determination step S180 may be repeated. However, the purchase product addition step ( S191 ) is performed only when the purchaser inputs a purchase product addition signal through the additional purchase setting unit 114 , otherwise it is a step that can be omitted.

In the payment step (S192), when the buyer checks the purchase price information output to the outside and inputs a payment signal through the payment unit 113, the payment signal is transmitted to the management server 130 and the management server 130 approves the payment The unit 133 may determine whether to approve the payment of the payment signal, and transmit payment information to the kiosk 110 . When payment information is transmitted to the kiosk 110 according to the payment approval signal, the payment is completed and the purchaser can acquire the purchased product.

After that, in the lock setting step (S193), the payment approval signal is generated from the management server 130 and at the same time the lock state setting unit 134 transmits the lock setting signal to the selection product storage unit to the door unit ( 122) may control the locking unit to maintain the locked state. The optional product storage unit, which has been unlocked through the process, is kept in a locked state to prevent non-purchasers from taking the stored products out.

According to the unmanned sales system 100 according to the embodiment of the present invention having the above configuration, the following effects are obtained.

From the buyer's point of view, there is no need to wait in front of the checkout counter to calculate the purchased product or directly input the product's payment information into the kiosk 110 device. Since the information is calculated, there is an effect that a purchase product can be easily purchased.

From the perspective of the business operator, since there is no need to hire a separate manpower or directly sell the product at the store, labor and maintenance costs are reduced, and the locking state of the product storage unit 120 is set according to the situation even though it is unmanned. Therefore, the safety and security of the store is also highly effective.

In particular, it is possible to prevent image fluctuation errors by first determining the payment product by comparing the photographed images, and secondarily checking the payment product through the weight difference value calculated through the weight calculation unit and finally confirming it. can have an effect.

In addition, when the product cannot be confirmed only by the image, for example, when the purchased products are stacked in a vertical direction on the shelf 121a, it is not possible to check whether the product is sold only by comparing the images, whereas by adding weight information, the quantity of the payment product is and information can be clearly determined.

In addition, if there is a change in weight even though there is no change in the photographed image as the weight information is used, a notification is sent to the manager terminal to check and manage the misconduct of the product storage device user in real time. there is

So far, preferred embodiments of the present invention have been mainly looked at. Those of ordinary skill in the art to which the present invention pertains will understand that the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments are to be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

100: unmanned sales system 110: kiosk
111: input/output unit 112: payment method recognition unit
113: payment unit 114: additional purchase setting unit
115: product storage unit selection unit 116: weight comparison unit
117: first storage unit 118: first communication unit
120: product storage 121: storage space
121a: shelf 122: door unit
123: camera unit 124: weight calculation unit
124a: weight sensor 124b: weight integrated part
124c: integrated calculation unit 125: second storage unit
126: second communication unit 130: management server
131: image comparison unit 132: purchase product decision unit
133: payment approval unit 134: lock state setting unit
135: third storage unit 136: third communication unit

Claims (7)

a kiosk provided with an input/output unit through which a purchaser inputs a purchase product payment signal and outputs payment information of the purchased product;
a product storage unit in which a camera unit for photographing a storage space in which one or more stored products are accommodated and a weight calculation unit for calculating an average weight change value of the stored products are disposed, and a locking state can be set; and
a management server that determines the purchased product exported from the product storage unit to the outside, approves the payment signal, and transmits the payment information to the kiosk; and
The product storage unit,
From the opening time of the storage space to the closing time, the camera unit transmits a plurality of photographed images of the storage space to the management server, and transmits the average weight change value calculated by the weight calculation unit to the kiosk and
Unmanned, characterized in that the purchase product is determined by combining the image comparison result of comparing the plurality of photographed images of the management server and the weight comparison result of comparing the average weight change value of the kiosk and the purchased product weight value sales system. The method of claim 1,
The camera unit,
Taking a first photographed image of the storage space at an opening time of the storage space and a second photographing image of the storage space at a closing time of the storage space,
and the management server compares the first photographed image and the second photographed image to primarily determine the purchased product taken out from the storage space. 3. The method of claim 2,
The weight calculation unit,
a plurality of weight sensors arranged on a shelf on which stored products are loaded to sense the weight; and
A weight integration unit for calculating an average weight change value of the weight by integrating the weight measurement values of the weight sensor;
The kiosk has a first storage unit for storing the purchased product weight value for each purchased product, and comparing the average weight change value with the purchased product weight value to secondarily determine the purchased product. 4. The method of claim 3,
When a plurality of shelves are arranged,
The weight calculation unit,
and an integrated calculation unit that separates and manages the average weight change value for each shelf based on the average weight change value calculated from the weight integration unit. 4. The method of claim 3,
When the average weight change value is less than the purchased product weight value,
and the management server transmits a call message to the manager terminal. 4. The method of claim 3,
When the average weight change value exceeds the purchased product weight value,
and the kiosk measures an error value between the average weight change value and the purchased product weight value, and corrects the purchased product weight value stored in the first storage unit. 7. The method of claim 6,
When the average weight change value is the same as the purchased product weight value,
The kiosk finally confirms the purchased product and outputs the confirmed purchased product information to the outside.

Images