WO2018161363A1

WO2018161363A1 - Self-service vending method and system

Info

Publication number: WO2018161363A1
Application number: PCT/CN2017/076786
Authority: WO
Inventors: 文彬
Original assignee: 深圳市楼通宝实业有限公司
Priority date: 2017-03-07
Filing date: 2017-03-15
Publication date: 2018-09-13
Also published as: CN106971457A

Abstract

Disclosed are a self-service vending method and system. The method comprises: a vending device opens a vending window after a user is successfully authenticated, obtains, from a camera, captured images of goods after the vending window is closed when the vending device detects that the vending window is closed, and determines goods bought by the user this time by comparing the captured images of goods after the vending window is closed with captured images of goods before the vending window is opened; the vending device requests, from a cloud service platform, an electronic shopping list of the goods purchased this time and prompts the user to complete payment according to the electronic shopping list. In this way, a vending device can recognize goods purchased by a user by means of only a camera and a built-in processor, the recognition speed is fast without the need of an additional recognition device, and the user can complete payment after selecting goods, thereby increasing shopping convenience and improving shopping experience.

Description

Self-service selling method and system

Technical field

The invention belongs to the field of electronic information technology, and in particular relates to a self-service selling method and system.

Background technique

Vending machines are developed in Japan and Europe and the United States in the 1970s. They are also known as 24-hour micro-supermarkets. Due to the convenience of vending machines, they are widely used in crowded public places such as subway stations, railway stations and pedestrian streets. .

In the prior art, the purchase process of the vending machine is to select the goods first, then pay the goods, and finally the goods are shipped. The purchase process is still complicated. When the goods are selected, the purchaser can only see the goods through the transparent glass. The partial packaging, the user selects the item to be purchased through the physical button or virtual button on the vending machine, and then the vending machine prompts the user to pay the money to complete the payment. When the payment is successful, the merchandise slides from the vending machine's cargo lane into the shipping port. The existing vending machine only discriminates the merchandise through the packaging of the merchandise through the glass, and the vending machine provides less information on the merchandise, which is likely to cause a wrong selection of the merchandise. In addition, since the user pays the merchandise first, if the purchase is made, Errors will not be returned, reducing the convenience of shopping.

technical problem

The invention provides a self-service selling method and system, which aims to solve the problem that the existing vending machine purchase process is complicated, the product information provided is small, the product selection error is easy to occur, and the product is received first, and then Purchase errors will not be returned, reducing the convenience of shopping.

Technical solution

The invention provides a self-service selling method, comprising:

When the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated;

After the user authentication is successful, the selling device opens the selling window, and when the selling device detects that the selling window is closed, the captured image of the goods after the selling window is closed is obtained from the camera, and the sales are sold through the Comparing the captured image of the product after the window is closed with the captured image of the product before the opening of the sales window, and determining the goods purchased by the user this time;

The selling device requests an electronic shopping list of the purchased product from the cloud service platform, and prompts the user to complete the payment according to the electronic shopping list.

The invention provides a self-service selling system, the system comprising: a cloud service platform and a selling device;

The cloud service platform is configured to authenticate the user when receiving a purchase instruction sent by the user through the client of the mobile terminal;

The selling device is configured to open a sales window after the user is successfully authenticated, and, when detecting that the selling window is closed, acquire a captured image of the product after the selling window is closed from the camera, and pass the Comparing the captured image of the goods after the sale window is closed with the captured image of the goods before the opening of the sales window, and determining the goods purchased by the user this time;

The selling device is further configured to request an electronic shopping list of the purchased item from the cloud service platform, and prompt the user to complete the payment according to the electronic shopping list.

Beneficial effect

The self-sale method and system provided by the present invention, when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated, and when the user authenticates successfully, the selling device opens the sales window, and When the selling device detects that the selling window is closed, the captured image of the product after the closing of the selling window is obtained from the camera, and the captured image of the product closed by the selling window and the captured image of the product before the opening of the selling window are obtained. Comparing, determining the goods purchased by the user this time, the selling device requests an electronic shopping list of the purchased goods from the cloud service platform, and prompts the user to complete the payment according to the electronic shopping list, so that the selling device only It is necessary to identify the goods purchased by the user through the camera and the built-in processor. The identification speed is fast without the need for additional identification devices, and when the sales window is opened, the user can pick up the goods, so that the package can be clearly and completely printed. Product information, the user can select the desired goods based on the goods information And then complete the payment after the completion of the selection of the user, enhancing the convenience of shopping, while improving the shopping experience.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is some embodiments of the invention.

1 is a schematic flow chart showing an implementation of an automatic vending method according to a first embodiment of the present invention;

2 is a schematic flowchart showing an implementation of an automatic vending method according to a second embodiment of the present invention;

3 is a schematic structural diagram of an automatic vending system according to a third embodiment of the present invention;

4 is a schematic structural diagram of an automatic vending system according to a fourth embodiment of the present invention.

Embodiments of the invention

The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. The embodiments are merely a part of the embodiments of the invention, and not all of the embodiments. All other embodiments obtained by a person skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Please refer to FIG. 1. FIG. 1 is a schematic diagram of an implementation process of a self-service selling method according to a first embodiment of the present invention. The self-sale method shown in FIG. 1 mainly includes the following steps:

S101. When the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated.

The client is built in the mobile terminal, and the client includes an APP or a browser. When the client is an APP, the APP can be connected to the cloud service platform, and the user forwards the operation instruction to the cloud service platform by operating a function virtual key on the APP to implement control of the selling device. When the client is a browser, the user controls the selling device by opening a website associated with the cloud service platform on the browser. The vending device may include a display screen and display a QR code for logging in/downloading the app and/or logging into the website on the display screen to facilitate the user to log in to the app or website.

The cloud service platform is a server that controls the selling device and stores basic information and user information of the selling device, for example, basic information such as a physical address, a number, a location area of the selling device, and a user's identification code. And the user's name, age, gender, etc. The cloud server authenticates the user. If the authentication is successful, step S102 is performed. If the authentication fails, the user ends the purchase, and the user cannot purchase the product. If the type of the authentication is the manner of obtaining the information to be authenticated from the user in advance, the cloud server controls the selling device to enable the authentication mode to obtain the information to be authenticated of the user, and the information to be authenticated is related to the type of the authentication, for example, the authentication type is For face authentication, the information to be authenticated is a face image.

S102. After the user is successfully authenticated, the selling device opens the selling window, and when the selling device detects that the selling window is closed, the captured image of the product after the selling window is closed is obtained from the camera, and is closed by the selling window. The comparison between the captured image of the goods and the captured image of the goods before the opening of the sales window determines the goods purchased by the user this time.

The merchandise is placed inside the vending device for sale. When the sales window is opened, the user can pick up the goods placed in the selling device, so that the user can see the goods information printed on the goods package in detail and complete, such as production date, nutritional formula, heat, manufacturer, production address. When the goods information is selected, the user can select the goods according to the information on the package of the goods, thereby improving the shopping experience.

The camera can be one or more 360-degree panoramic cameras, or multiple common cameras. The camera does not limit the type and number of cameras under the condition that all the items in the selling device can be photographed, and the camera can be mounted at each position of the selling device.

The selling device can capture images in the area where the goods are placed through the camera. The selling device compares the captured image of the item before and after the opening of the window to determine whether the user has taken the item and the type of item the user took.

S103. The selling device requests an electronic shopping list of the purchased product from the cloud service platform, and prompts the user to complete the payment according to the electronic shopping list.

The request includes: the type and quantity of the goods. In an actual application, the cloud service platform acquires the type and quantity of the goods in the request for the settlement, and settles according to the price of the individual goods.

The electronic shopping list includes: shopping information such as the name of the goods, the quantity, the unit price of the goods, and the total amount. The mobile terminal displays the shopping information on the electronic shopping list through the display screen.

It should be noted that, in the embodiment of the present invention, the classification of the goods is to treat the identical goods as the same type of goods.

In the embodiment of the present invention, when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated, and when the user authentication succeeds, the selling device opens the sales window, and when the selling device When detecting that the sales window is closed, the captured image of the product after the sales window is closed is obtained from the camera, and the comparison between the captured image of the product closed by the sales window and the captured image of the product before the opening of the sales window is determined. The user purchases the goods, the selling device requests the cloud service platform for the electronic shopping list of the purchased product, and prompts the user to complete the payment according to the electronic shopping list, so that the selling device only needs to pass the camera and the built-in processor. The product can be identified by the user, the identification speed is fast, no additional identification device is needed, and when the sales window is opened, the user can pick up the goods, so that the goods information printed on the package can be clearly and completely seen, and the user can The item information selects the desired item, and the user selects the completed item. And then complete the payment, enhancing the convenience of shopping, while improving the shopping experience.

Referring to FIG. 2, FIG. 2 is a schematic flowchart of a self-sale method according to a second embodiment of the present invention, which can be applied to a self-service selling device. The self-sale method shown in FIG. 2 mainly includes the following steps:

S201. The mobile terminal sends a membership authentication request for the user to the cloud service platform according to the member authentication command sent by the user through the client, so that the cloud service platform performs member authentication on the user.

The client is built in the mobile terminal, and the client includes an APP or a browser. When the client is an APP, the APP can be connected to the cloud service platform, and the user forwards the operation instruction to the cloud service platform by operating a function virtual key on the APP to implement control of the selling device. When the client is a browser, the user controls the selling device by opening a website associated with the cloud service platform on the browser. If the user does not register a member, the user registers with the member through the APP and the website.

The method of membership authentication is not limited. The member authentication method may be a member name and password authentication method, a short message verification code authentication method, or a two-dimensional code authentication method. In the member authentication process, the member authentication request includes the member's member authentication information, such as the member name and password, the short message verification code, and the two-dimensional code information, and the cloud service platform compares the pre-stored standard information with the standby member. The authentication information determines whether the user is a member. The standard information may be that when the user registers the member, the mobile terminal uploads the user's face photo, fingerprint information and the like to the cloud service platform, and the cloud service platform uses the uploaded information as standard information.

S202. When the mobile terminal receives the member authentication success message of the user by the cloud service platform, displaying a purchase authentication interface, and prompting the user to select a purchase authentication mode in the purchase authentication interface.

The purchase authentication method is different from the member authentication method, and the purchase authentication method is used to trigger the sale window to be opened. The purchase authentication method is a face authentication method, a fingerprint authentication method, a two-dimensional code authentication method, a password authentication method, and a short-range wireless communication technology (NFC, Near). Field Communication) One or more combinations of authentication methods. The purchase authentication interface is an interface for the user to select an authentication method. The name of the above-mentioned authentication methods is displayed on the purchase authentication interface, and the user is prompted to select a purchase authentication mode in the purchase authentication interface by means of voice, text or prompt tone.

It should be noted that the two-dimensional code authentication mode in the embodiment of the present invention may be that the mobile terminal scans the two-dimensional code displayed on the selling device, or the selling device scans the two-dimensional code displayed on the mobile terminal.

S203. The mobile terminal receives the determining instruction of the user, determines the purchase authentication mode selected by the user, and requests the cloud service platform to authenticate the user according to the selected purchase authentication mode.

The request may include basic information of the vending device, such as basic information such as the physical address, number, location area of the vending device, and the purchase authentication method selected by the user. If the request is successful, step S204 is performed.

S204. When the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated.

The purchase instruction is used to trigger the authentication process of the cloud service platform for the user. If the authentication is successful, step S205 is performed; if the authentication fails, the purchase is ended, and the user cannot purchase the goods.

Further, if the request is successful and the selected purchase authentication method includes the face authentication mode, the fingerprint authentication mode, the two-dimensional code authentication mode, or the password authentication mode, when the cloud service platform receives the user by moving When the terminal sends a purchase instruction to the client, the user is authenticated including:

The cloud service platform controls the selling device to open the authentication mode according to the selected purchase authentication mode, and obtains the user's information to be authenticated from the selling device, and the cloud service platform passes the comparison between the information to be authenticated and the pre-stored standard. Information to determine the authentication result of the user.

Wherein, if the selected purchase authentication method is the face authentication mode, the selling device acquires the face image of the user and transmits the image to the cloud service platform; if the selected purchase authentication mode is the fingerprint authentication mode, the selling device obtains The fingerprint feature of the user is transmitted to the cloud service platform; if the selected purchase authentication method is the password authentication mode, the selling device receives the password entered by the user and transmits the password to the cloud service platform, or pre-sells the sales An electronic password lock is installed on the device, and the selling device obtains the password input by the user in the electronic password lock and sends the password to the cloud service platform.

Further, if the selected purchase authentication method includes the NFC authentication mode, when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated before:

After the selling device successfully completes the NFC connection with the mobile terminal, the selling device acquires the NFC payment information from the mobile terminal and forwards the information to the cloud service platform through the built-in NFC module, wherein the NFC payment information includes: an NFC payment type and The user's payment account;

Then, when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated by:

Receiving, by the cloud service platform, the NFC payment information sent by the selling device and forwarding the information to the payment platform, to request the payment platform to query whether the user is a licensed payment user;

If yes, the cloud service platform determines that the user authentication is successful;

If not, the cloud service platform searches for the balance in the member account corresponding to the user, and determines that the user authentication is successful when the balance is greater than or equal to the preset reference value.

The cloud service platform forwards the NFC payment information to the payment platform according to the NFC payment type in the NFC payment information, where the NFC payment type corresponds to the payment platform, for example, the NFC payment type is a payment type differentiated by a mobile phone brand. If the NFC payment type used by the user is the NFC payment of the brand A, the cloud service platform forwards the NFC payment information to the payment platform corresponding to the brand A.

Further, when the balance is less than the preset reference value, the cloud service platform sends the insufficient information to the selling device; the selling device receives the insufficient balance information and prompts the user to recharge.

Optionally, when the balance is less than the preset reference value, the cloud service platform sends the insufficient balance information to the mobile terminal; the mobile terminal receives the insufficient balance information, and prompts the user to recharge through the client.

The method of prompting the user to recharge is not limited, and the amount of the user's recharge may be voiced, and the amount of the user's required recharge may also be displayed.

Compared with the selling device prompting the user to recharge, the user is prompted to recharge the user to ensure the security of the user.

S205. After the user is successfully authenticated, the selling device opens a sales window, and when the selling device detects that the selling window is closed, the captured image of the product after the selling window is closed is obtained from the camera, and is closed by the selling window. The comparison between the captured image of the subsequent product and the captured image of the product before the opening of the sales window determines the purchase of the product by the user.

When the sales window is opened, the user can pick up the goods in the selling device, so that the user can see the detailed information of the goods printed on the package, such as production date, nutritional formula, heat, manufacturer, production address, etc. Product information, users can select goods based on the information on the package, improving the shopping experience.

Further, after the user is successfully authenticated, the selling device opens a sales window, and when the selling device detects that the selling window is closed, the captured image of the product after the selling window is closed is obtained from the camera, and passes through the selling window. The comparison between the captured image of the closed product and the captured image of the product before the opening of the sales window determines that the user purchased the goods this time includes:

After the sales window is closed, the selling device captures a captured image of the goods in each product area through the camera, and acquires a captured image of the goods before the opening of the sales window in each product area;

The selling device compares the captured image with the captured image to determine a product area for reducing the goods;

The selling device determines the goods purchased by the user this time based on the goods placement area corresponding to the goods area of the reduced goods and the goods area of the reduced goods.

Optionally, after the selling device determines to reduce the goods area of the goods, determine a same location area as the goods area of the reduced goods in the acquired captured image, and identify the location area in the acquired captured image. The packaging of the goods to determine the goods purchased by the user this time. Since the outer packaging of different goods is different, the type and quantity of the goods can be determined by identifying the keywords on the packaging of the goods.

The item placement rules are used to define the placement of the same item in the merchandiser. For example, in a vending device, the same items can be placed in the same row or in the same column. In this way, the type and quantity of the reduced goods can be determined more quickly by the camera and the placement rules. It should be noted that, in the embodiment of the present invention, the classification of the goods is to treat the identical goods as the same type of goods.

The camera can be shot in a bird's-eye view, that is, you can take a bird's-eye view of the product, or you can take a complete image of each item. The number of images to be captured may depend on the type of camera. For example, if the camera is a 360-degree panoramic camera, only one camera can be taken; if the camera is a normal camera, only multiple cameras can be taken. The selling device can perform the sharpness processing on the captured image to more accurately identify the goods purchased by the user this time.

Further, after the sales window is opened, the selling device prompts the user to return the position of the goods in the same position as the front goods. In this way, the user is prevented from returning the goods according to the position before the opening of the sales window after viewing the goods, resulting in different goods in the divided areas, and the settlement is inaccurate.

Further, after the selling window is opened, the selling device prompts the user to pick up the product and view the product information by displaying a text prompt or playing a voice.

Further, after the selling window is opened, the selling device prompts the user to take the goods and close the selling window by displaying a text prompt or playing a voice.

The selling device can display the prompted text to the user through the display screen, or play the prompt voice to the user through the voice playing device.

S206. The selling device requests an electronic shopping list of the purchased product from the cloud service platform, and prompts the user to complete the payment according to the electronic shopping list.

Optionally, after the user completes the payment, the mobile terminal sends a message of completing the payment to the cloud service platform, where the cloud service platform saves the electronic shopping list of the goods purchased by the user.

Further, the selling device records the purchase process of the user through the camera, and uploads a video file containing the user purchase process to the cloud service platform to store the video file on the cloud service platform.

Wherein, after the user's purchase process is photographed, the selling device can determine the type and quantity of the goods taken by the user by identifying the package of the goods taken by the user in the video file and the packaging of the goods placed on the shelf. The type and quantity of goods on the shelf.

The time to open the record user purchase process is not limited. You can start the camera when the sales window is open. You can also start the camera record before the sales window is opened. Similarly, the time to stop recording the user purchase process is not limited. You can sell it. When the window is closed, the camera is turned off, and the camera can be turned off after the user completes the payment; of course, the camera can be always turned on without being turned off to improve the security of the selling device. In this way, the user's purchase process can be recorded through the camera to effectively prevent malicious personnel from maliciously destroying the sale device and improper purchase behavior, and also facilitate the operation personnel to handle disputes.

In the embodiment of the present invention, the mobile terminal sends a membership authentication request to the cloud service platform according to the member authentication command sent by the user through the client, so that the cloud service platform performs member authentication on the user. When receiving the member authentication success message of the user by the cloud service platform, the mobile terminal displays a purchase authentication interface, and prompts the user to select a purchase authentication mode in the purchase authentication interface, and the mobile terminal receives the determination instruction of the user, and determines the The user selects the purchase authentication method, and requests the cloud service platform to authenticate the user according to the selected purchase authentication mode. When the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, The user performs authentication, and when the user is authenticated successfully, the selling device opens a sales window, and when the selling device detects that the selling window is closed, the camera obtains a captured image of the product after the selling window is closed, and passes the sales. The image of the goods after the window is closed and the goods before the opening of the sales window Aligning the captured images to determine the goods purchased by the user this time, the selling device requests the cloud service platform for the electronic shopping list of the purchased goods, and prompts the user to complete the payment according to the electronic shopping list, so that the selling device The user can purchase the goods purchased by the camera and the built-in processor. The recognition speed is fast without the need for additional identification devices, and when the sales window is opened, the user can pick up the goods, so that the package can be clearly and completely printed. Some goods information, the user can select the desired goods according to the goods information, and then the user completes the payment after completing the selection, thereby enhancing the convenience of shopping and improving the shopping experience.

Please refer to FIG. 3. FIG. 3 is a schematic structural diagram of a self-service selling system according to a third embodiment of the present invention. For convenience of description, only parts related to the embodiment of the present invention are shown. The self-sales system illustrated in FIG. 3 mainly includes: a selling device 301 and a cloud service platform 302. The above devices are described in detail as follows:

The cloud service platform 302 is configured to authenticate the user when receiving a purchase instruction sent by the user through the client of the mobile terminal;

The selling device 301 is configured to: when the user is successfully authenticated, open a sales window, and when detecting that the selling window is closed, obtain a captured image of the product after the selling window is closed from the camera, and close the window after the selling window is closed. Comparing the captured image of the goods with the captured image of the goods before the opening of the sales window to determine the goods purchased by the user this time;

The vending device 301 is further configured to request an electronic shopping list of the purchased product from the cloud service platform 302, and prompt the user to complete the payment according to the electronic shopping list.

The client is built in the mobile terminal, and the client includes an APP or a browser. When the client is an APP, the APP can be connected to the cloud service platform 302. The user forwards the operation instruction to the cloud service platform 302 by operating a function virtual key on the APP to control the selling device 301. When the client is a browser, the user controls the vending device 301 by opening a website associated with the cloud service platform 302 on the browser. The vending device 301 can include a display screen and display a two-dimensional code for logging in/downloading the APP and/or logging into the website on the display screen, thereby facilitating the user to log in to the APP or website.

The vending device 301 is internally placed for sale of goods for sale. When the sales window is opened, the user can pick up the goods placed in the selling device 301, so that the user can see the goods information printed on the goods package in detail and complete, such as production date, nutritional formula, heat, manufacturer, production. With the information such as the address, the user can select the goods according to the information on the package of the goods, which improves the shopping experience.

For details of the embodiment, please refer to the description of the embodiment shown in FIG. 1 , and details are not described herein again.

In the embodiment of the present invention, the cloud service platform 302 authenticates the user when receiving the purchase instruction sent by the user through the client of the mobile terminal, and the selling device 301 opens the sales window after the user is successfully authenticated, and When it is detected that the sales window is closed, the captured image of the product after the sales window is closed is obtained from the camera, and the captured image of the product closed by the sales window is compared with the captured image of the product before the opening of the sales window. Determining the goods purchased by the user this time; the selling device 301 requests the cloud service platform 302 for the electronic shopping list of the purchased goods, and prompts the user to complete the payment according to the electronic shopping list, so that the selling device only needs to pass the camera and The built-in processor can complete the identification of the goods purchased by the user, the recognition speed is fast without the need for additional identification devices, and when the sales window is opened, the user can pick up the goods, so that the goods information printed on the package can be clearly and completely seen. The user can select the desired item based on the item information, and then the user selects the completed product. After the completion of payments, and enhance the convenience of shopping, while improving the shopping experience.

Referring to FIG. 4, FIG. 4 is a schematic structural diagram of an automatic vending system according to a fourth embodiment of the present invention. For convenience of description, only parts related to the embodiment of the present invention are shown. The vending system illustrated in FIG. 4 mainly includes: a selling device 401, a mobile terminal 402, and a cloud service platform 403. The above devices are described in detail as follows:

The mobile terminal 402 is configured to send a membership authentication request for the user to the cloud service platform 403 according to the member authentication command sent by the user through the client, so that the cloud service platform 403 performs member authentication on the user.

The client is built into the mobile terminal 402, and the client includes an APP or a browser. When the client is an APP, the APP can be connected to the cloud service platform 403. The user forwards the operation instruction to the cloud service platform 403 by operating a function virtual key on the APP to control the selling device 401. When the client is a browser, the user controls the vending device 401 by opening a website associated with the cloud service platform 403 on the browser. If the user does not register a member, the user registers with the member through the APP and the website.

The method of membership authentication is not limited. The member authentication method may be a member name and password authentication method, a short message verification code authentication method, or a two-dimensional code authentication method. In the member authentication process, the member authentication request includes the member's membership authentication information, such as the member name and password, the short message verification code, and the two-dimensional code information, and the cloud service platform 403 compares the pre-stored standard information with the Member authentication information to determine whether the user is a member. The standard information may be that when the user registers the member, the mobile terminal 402 uploads the user's face photo, fingerprint information and the like to the cloud service platform 403, and the cloud service platform 403 uses the uploaded information as standard information.

The mobile terminal 402 is further configured to: when receiving the member authentication success message of the user by the cloud service platform 403, display a purchase authentication interface, and prompt the user to select a purchase authentication mode in the purchase authentication interface.

The purchase authentication method is different from the member authentication method, and the purchase authentication method is used to trigger the sale window to be opened. The purchase authentication method is one or a combination of a face authentication method, a fingerprint authentication method, a two-dimensional code authentication method, a password authentication method, and an NFC authentication method. The purchase authentication interface is an interface for the user to select an authentication method. The name of the above-mentioned authentication methods is displayed on the purchase authentication interface, and the user is prompted to select a purchase authentication mode in the purchase authentication interface by means of voice, text or prompt tone.

It should be noted that the two-dimensional code authentication method in the embodiment of the present invention may be that the mobile terminal 402 scans the two-dimensional code displayed on the selling device 401, or the selling device 401 scans the two-dimensional code displayed on the mobile terminal 402.

The mobile terminal 402 is further configured to receive the determining instruction of the user, determine the purchase authentication mode selected by the user, and request the cloud service platform 403 to authenticate the user according to the selected purchase authentication mode.

The request may include basic information of the vending device 401, for example, basic information such as a physical address, a number, a location area of the vending device 401, and the purchase authentication method selected by the user.

The cloud service platform 403 is configured to authenticate the user when receiving a purchase instruction sent by the user through the client of the mobile terminal 402.

The purchase instruction is used to trigger the cloud service platform 403 to authenticate the user. If the authentication is successful, the sales device 401 is notified that the authentication is successful; if the authentication fails, the purchase is ended and the user cannot purchase the product.

Further, the cloud service platform 403 is further configured to control the selling device 401 to open the authentication mode according to the selected purchase authentication mode, and obtain the information to be authenticated of the user from the selling device 401, and The authentication information and the pre-stored standard information determine the authentication result of the user.

If the selected purchase authentication method is the face authentication mode, the selling device 401 acquires the face image of the user and transmits the image to the cloud service platform 403; if the selected purchase authentication method is the fingerprint authentication method, the sale is performed. The device 401 obtains the fingerprint feature of the user and transmits the fingerprint feature to the cloud service platform 403. If the selected purchase authentication mode is the password authentication mode, the selling device 401 receives the password entered by the user and transmits the password to the cloud service platform 403. Alternatively, an electronic code lock is installed on the vending device 401 in advance, and the vending device 401 acquires the password input by the user in the electronic code lock and sends the password to the cloud service platform 403.

Further, if the selected purchase authentication method includes the NFC authentication mode, the selling device 401 is further configured to: after the NFC connection is successfully completed with the mobile terminal 402, from the mobile terminal 401 by using a built-in NFC module. The NFC payment information is obtained and forwarded to the cloud service platform 403, where the NFC payment information includes: an NFC payment type and a payment account of the user.

Further, the cloud service platform 403 is further configured to perform the following steps:

Receiving the NFC payment information sent by the selling device and forwarding to the payment platform to request the payment platform to query whether the user is a licensed payment user;

If yes, it is determined that the user authentication is successful;

If not, the balance in the member account corresponding to the user is searched, and when the balance is greater than or equal to the preset reference value, the user authentication is determined to be successful.

The cloud service platform 403 forwards the NFC payment information to the payment platform according to the NFC payment type in the NFC payment information, where the NFC payment type corresponds to the payment platform, for example, the NFC payment type is a payment type differentiated by the mobile phone brand. If the NFC payment type used by the user is the NFC payment of the brand A, the cloud service platform 403 forwards the NFC payment information to the payment platform corresponding to the brand A.

Further, when the balance is less than the preset reference value, the cloud service platform 403 sends the insufficient information to the vending device 401; the vending device 401 receives the insufficient balance information and prompts the user to recharge.

Optionally, when the balance is less than the preset reference value, the cloud service platform 403 sends the insufficient balance information to the mobile terminal 402; the mobile terminal 402 receives the insufficient balance information, and prompts the user through the client. Top up.

The selling device 401 is configured to open a sales window after the user is successfully authenticated, and when the selling device 401 detects that the selling window is closed, obtain a captured image of the product after the selling window is closed from the camera, and pass the The comparison between the captured image of the goods after the sale window is closed and the captured image of the goods before the opening of the sales window determines the goods purchased by the user this time.

When the sales window is opened, the user can pick up the goods in the selling device 401, so that the user can see the goods information printed on the goods package in detail and complete, such as production date, nutritional formula, heat, manufacturer, production address. When the goods information is selected, the user can select the goods according to the information on the package, thereby improving the shopping experience.

The camera can be one or more 360-degree panoramic cameras, or multiple common cameras. The camera does not limit the type and number of cameras in the case where all the items in the vending device 401 can be photographed, and the camera can be mounted at each position of the vending device 401.

The selling device 401 can capture an image in the area where the goods are placed by the camera. The selling device 401 compares the captured images of the goods before and after the opening of the sales window to determine whether the user has taken the goods and the type of goods taken by the user.

Further, the selling device 401 is further configured to perform the following steps:

After the sales window is closed, the camera captures a captured image of the product in each product area, and acquires a captured image of the product before the opening of the sales window in each product area;

Comparing the captured image with the captured image to determine the product area for reducing the goods;

The goods purchased by the user this time are determined according to the goods placement area corresponding to the goods area of the reduced goods and the goods area of the reduced goods.

The item placement rule is used to record the placement of the same item in the vending device 401. For example, in the vending device 401, the same items may be placed in the same row or in the same column. In this way, the type and quantity of the reduced goods can be determined more quickly by the camera and the placement rules. It should be noted that the classification of goods is to treat identical goods as the same type of goods.

The camera can be shot in a bird's-eye view, that is, you can take a bird's-eye view of the product, or you can take a complete image of each item. The number of images to be captured may depend on the type of camera. For example, if the camera is a 360-degree panoramic camera, only one camera can be taken; if the camera is a normal camera, only multiple cameras can be taken. The selling device 401 can perform the sharpness processing on the captured image to more accurately identify the goods purchased by the user this time.

Further, the selling device 401 is further configured to prompt the user to pick up the goods and view the goods information by displaying a text prompt or playing a voice after the selling window is opened.

Further, the selling device 401 is further configured to prompt the user to take the goods and close the sales window by displaying a text prompt or playing a voice after the selling window is opened.

The selling device 401 can display the prompted text to the user through the display screen, or play the prompted voice to the user through the voice playing device.

The selling device 401 is further configured to request an electronic shopping list of the purchased product from the cloud service platform, and prompt the user to complete the payment according to the electronic shopping list.

The request includes: the type and quantity of the goods. In an actual application, the cloud service platform acquires the type and quantity of the goods in the request for the settlement, and settles according to the price of the individual goods. The electronic shopping list includes: shopping information such as the name of the goods, the quantity, the unit price of the goods, and the total amount. The mobile terminal displays the shopping information on the electronic shopping list through the display screen.

Optionally, after the user completes the payment, the mobile terminal 402 sends a message to the cloud service platform 403 to complete the payment, and the cloud service platform 403 saves the electronic shopping list of the goods purchased by the user.

Further, the selling device 401 is further configured to record the purchase process of the user by using the camera, and upload a video file including the user purchase process to the cloud service platform 403 to store the video file on the cloud service platform. 403. The time to open the record user purchase process is not limited. You can start the camera when the sales window is open. You can also start the camera record before the sales window is opened. Similarly, the time to stop recording the user purchase process is not limited. You can sell it. When the window is closed, the camera is turned off, and the camera can be turned off after the user completes the payment; of course, the camera can be always turned on without being turned off to improve the security of the selling device. In this way, the user's purchase process can be recorded through the camera to effectively prevent malicious personnel from maliciously destroying the sale device and improper purchase behavior, and also facilitate the operation personnel to handle disputes.

For details of the embodiment, please refer to the description of the embodiment shown in FIG. 1 and FIG. 2, and details are not described herein again.

In the embodiment of the present invention, the mobile terminal 402 sends a membership authentication request to the cloud service platform 403 according to the member authentication command sent by the user through the client, so that the cloud service platform 403 performs membership for the user. Authentication, when the mobile terminal 402 receives the member authentication success message of the user by the cloud service platform 403, displays a purchase authentication interface, and prompts the user to select a purchase authentication mode in the purchase authentication interface, and the mobile terminal 402 receives the user. Determining an instruction, determining the purchase authentication mode selected by the user, and requesting the cloud service platform 403 to authenticate the user according to the selected purchase authentication mode, when the cloud service platform 403 receives the user of the user through the mobile terminal 402 When the purchase instruction is sent, the user is authenticated. When the user is authenticated successfully, the selling device 401 opens the sales window, and when the selling device 401 detects that the sales window is closed, the sales window is closed from the camera. The image of the finished product, and the image of the goods after the closing of the sales window Comparing the captured images of the goods before the opening of the sales window, determining the goods purchased by the user this time, the selling device 401 requests the cloud service platform 403 for the electronic shopping list of the goods purchased this time, and prompts the user to follow the The electronic shopping order completes the payment, so that the selling device can complete the identification of the goods purchased by the user through the camera and the built-in processor, the identification speed is fast without the need for additional identification devices, and when the sales window is opened, the user can pick up the goods, thereby The product information printed on the package can be clearly and completely seen, and the user can select the desired product according to the product information, and then the user completes the payment after completing the selection, thereby enhancing the convenience of shopping and improving the shopping experience.

In the various embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be another division manner, for example, multiple modules or components may be combined or Can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication link shown or discussed may be an indirect coupling or communication link through some interface, device or module, and may be electrical, mechanical or otherwise.

The modules described as separate components may or may not be physically separated. The components displayed as modules may or may not be physical modules, that is, may be located in one place, or may be distributed to multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

The integrated modules, if implemented in the form of software functional modules and sold or used as separate products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, or all or part of the technical solution, may be embodied in the form of a software product stored in a storage medium. A number of instructions are included to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing storage medium includes: a U disk, a mobile hard disk, a read only memory (ROM, Read-Only) Memory, random access memory (RAM), disk or optical disk, and other media that can store program code.

It should be noted that, for the foregoing method embodiments, for the sake of brevity, they are all described as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In the following, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

In the above embodiments, the descriptions of the various embodiments are all focused, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

The above is a description of the self-sale method and system provided by the present invention. For those skilled in the art, according to the idea of the embodiment of the present invention, there are changes in the specific implementation manner and the application range. In summary, the present specification The content should not be construed as limiting the invention.

Claims

A self-service selling method, comprising:

When the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user is authenticated;

After the user authentication is successful, the selling device opens the selling window, and when the selling device detects that the selling window is closed, the captured image of the goods after the selling window is closed is obtained from the camera, and the sales are sold through the Comparing the captured image of the product after the window is closed with the captured image of the product before the opening of the sales window, and determining the goods purchased by the user this time;

The selling device requests an electronic shopping list of the purchased product from the cloud service platform, and prompts the user to complete the payment according to the electronic shopping list.
The method according to claim 1, wherein when the selling device detects that the sales window is closed, the captured image of the product after the sales window is closed is acquired from the camera, and passes through the sales window. Comparing the captured image of the closed product with the captured image of the product before the opening of the sales window, determining that the user purchased the goods this time includes:

After the selling window is closed, the selling device captures a captured image of the goods in each product area through the camera, and acquires a captured image of the goods before the opening of the selling window in each of the goods areas;

Comparing the captured image with the captured image to determine the product area for reducing the goods;

Determining the goods purchased by the user this time according to the goods placement area corresponding to the goods area of the reduced goods and the goods area of the reduced goods.
The method according to claim 1, wherein when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the user before authenticating the user includes:

The mobile terminal sends a membership authentication request to the cloud service platform to the cloud service platform according to the member authentication command sent by the user through the client, so that the cloud service platform performs member authentication on the user;

When the mobile terminal receives the member authentication success message of the user by the cloud service platform, displaying a purchase authentication interface, and prompting the user to select a purchase authentication mode in the purchase authentication interface, where the purchase authentication The method is one or more combinations of face authentication mode, fingerprint authentication mode, two-dimensional code authentication mode, password authentication mode, and NFC authentication mode of short-range wireless communication technology.
The method according to claim 3, wherein when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the method further includes:

The mobile terminal receives the determination instruction of the user, determines the purchase authentication mode selected by the user, and requests the cloud service platform to perform authentication on the user according to the selected purchase authentication mode.
The method according to claim 4, wherein if the selected purchase authentication method includes the NFC authentication mode, the cloud service platform receives a purchase instruction sent by a user through a client of the mobile terminal. Before authenticating the user, include:

After the selling device successfully completes the NFC connection with the mobile terminal, the selling device acquires NFC payment information from the mobile terminal and forwards the information to the cloud service platform by using a built-in NFC module, wherein the NFC payment information is forwarded to the cloud service platform. The method includes: an NFC payment type and a payment account of the user;

Then, when the cloud service platform receives the purchase instruction sent by the user through the client of the mobile terminal, the authentication of the user includes:

Receiving, by the cloud service platform, the NFC payment information sent by the selling device, and forwarding the information to the payment platform, to request the payment platform to query whether the user is a licensed payment user;

If yes, the cloud service platform determines that the user authentication is successful;

If not, the cloud service platform searches for a balance in the member account corresponding to the user, and determines that the user authentication is successful when the balance is greater than or equal to a preset reference value.
The method according to any one of claims 1 to 5, further comprising:

The selling device records the purchase process of the user through the camera, and uploads a video file including the user purchase process to the cloud service platform, so as to store the video file in the cloud service platform.
A self-service selling system, characterized in that the system comprises: a cloud service platform and a selling device;

The cloud service platform is configured to authenticate the user when receiving a purchase instruction sent by the user through the client of the mobile terminal;

The selling device is configured to open a sales window after the user is successfully authenticated, and, when detecting that the selling window is closed, acquire a captured image of the product after the selling window is closed from the camera, and pass the Comparing the captured image of the goods after the sale window is closed with the captured image of the goods before the opening of the sales window, and determining the goods purchased by the user this time;

The selling device is further configured to request an electronic shopping list of the purchased item from the cloud service platform, and prompt the user to complete the payment according to the electronic shopping list.
The system of claim 7 wherein:

The selling device is further configured to: after the selling window is closed, photograph the captured image of the goods in each goods area through the camera, and acquire the goods before the opening of the sales window in each goods area. Shooting an image;

The selling device is further configured to compare the captured image and the captured image to determine a product area for reducing the goods;

The selling device is further configured to determine the goods purchased by the user according to the goods placement area corresponding to the goods area of the reduced goods and the goods area of the reduced goods.
The system of claim 7 wherein said system further comprises: a mobile terminal;

The mobile terminal is configured to send a membership authentication request to the cloud service platform to the cloud service platform according to the member authentication command sent by the user through the client, so that the cloud service platform performs the user on the user Member certification;

The mobile terminal is further configured to: when receiving the member authentication success message of the user by the cloud service platform, display a purchase authentication interface, and prompt the user to select a purchase authentication mode in the purchase authentication interface, where The purchase authentication method is one or a combination of a face authentication mode, a fingerprint authentication mode, a two-dimensional code authentication mode, a password authentication mode, and a short-range wireless communication technology NFC authentication mode.
The system of claim 9 wherein:

The mobile terminal is further configured to receive the determining instruction of the user, determine the purchase authentication mode selected by the user, and request the cloud service platform to perform the purchase authentication mode on the user according to the selected Certification.
The system according to claim 10, wherein, if the selected purchase authentication method includes the NFC authentication mode, the selling device is further configured to: after successfully completing the NFC connection with the mobile terminal Obtaining, by the built-in NFC module, the NFC payment information from the mobile terminal, and forwarding the information to the cloud service platform, where the NFC payment information includes: an NFC payment type and a payment account of the user;

The cloud service platform is further configured to receive the NFC payment information sent by the selling device and forward the information to the payment platform, to request the payment platform to query whether the user is a licensed payment user;

The cloud service platform is further configured to: if yes, determine that the user authentication is successful;

The cloud service platform is further configured to: if not, search for a balance in the member account corresponding to the user, and determine that the user authentication is successful when the balance is greater than or equal to a preset reference value.
A system according to any one of claims 7-11, wherein

The selling device is further configured to record a purchase process of the user by using the camera, and upload a video file including the user purchase process to the cloud service platform, to store the video file in the Cloud service platform.