CN109243112A - A kind of open environment shopping control method and device - Google Patents
A kind of open environment shopping control method and device Download PDFInfo
- Publication number
- CN109243112A CN109243112A CN201810964706.8A CN201810964706A CN109243112A CN 109243112 A CN109243112 A CN 109243112A CN 201810964706 A CN201810964706 A CN 201810964706A CN 109243112 A CN109243112 A CN 109243112A
- Authority
- CN
- China
- Prior art keywords
- shopping
- user
- commodity
- product display
- display zone
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/0036—Checkout procedures
- G07G1/0045—Checkout procedures with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0633—Lists, e.g. purchase orders, compilation or processing
- G06Q30/0635—Processing of requisition or of purchase orders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
- G06V20/36—Indoor scenes
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07G—REGISTERING THE RECEIPT OF CASH, VALUABLES, OR TOKENS
- G07G1/00—Cash registers
- G07G1/12—Cash registers electronically operated
Abstract
The present invention provides a kind of open environment shopping control method and devices, the method comprise the steps that receiving the commodity selection information that terminal APP is sent；According to the merchandise news for the end article that the corresponding user of commodity selection validation of information commodity selection information needs to take；According to the merchandise news, the product display zone in the corresponding automatic vending machine of range of goods in merchandise news is confirmed；LED light bright light corresponding with product display zone is controlled, to prompt user to take the end article in product display zone.Realize the commodity selection information submitted in advance according to user, determine the kind of commodity, and then the product display zone where determining, and then it is prompted by corresponding LED light, the commodity needed are searched for user to provide convenience, shopping efficiency is substantially increased, the shopping-time that user carries out screening in numerous commodity is shortened, improves user experience.
Description
Technical field
The present invention relates to image identification technical fields, more specifically to a kind of open environment shopping control method
And device.
Background technique
Substance circulating is the most basic element of human society.Retail trade is directly facing the open of consumer's sale
The important means that relevant industries (hereinafter referred to as retail trade or retailer) circulate as material present needs to employ a large amount of
Cashier realize the dealing work of commodity, cashier counts consumer's purchase piece by piece, statistics is completed
Afterwards, it completes to pay jointly with consumer.
And automatic selling counter, then it solves the artificial defect for counting and manually settling accounts of retail trade, is a kind of towards disappearing
The self-service of expense person, Automatic-settlement sell mode.The product of the selected commodity of user can be counted by the selection of user
Kind and total value complete payment process so that user settles accounts.But current automatic selling counter can only be carried out according to user's
Selection, automatic shipment Automatic-settlement, can not be realized in open retail shopping environments the shopping of behavior to(for) user with
Acquired progress accurately identifies, to realize clearing.
It, can only be by the commodity manually bought for consumer in short, at present in existing open shopping environment
It carries out inspection piece by piece, statistics and total price to calculate, expends a large amount of human costs, the long low efficiency of settlement time, poor accuracy, and
Poor user experience.
Summary of the invention
In view of this, the present invention provides a kind of open environment shopping control method and device to solve the prior art not
Foot.
To solve the above problems, the present invention provides a kind of open environment shopping control method, comprising:
Receive the commodity selection information that terminal APP is sent；
The end article for needing to take according to the corresponding user of commodity selection information described in the commodity selection validation of information
Merchandise news；The merchandise news includes range of goods；
According to the merchandise news, confirm in the corresponding automatic vending machine of the range of goods in the merchandise news
Product display zone；
LED light bright light corresponding with the product display zone is controlled, to prompt the user to the commodity display
End article in area is taken.
Preferably, described " the control LED light bright light corresponding with the product display zone, to prompt the user couple
End article in the product display zone is taken " after, further includes:
The current shopping items taken to the user identify, generate recognition result；
Judge whether the current shopping items are the end article according to the recognition result；
If the current shopping items are the end article, control and close the quotient corresponding with the end article
The LED light of product display area.
Preferably, described " the current shopping items taken to the user identify, generate recognition result " includes:
The user is received to be taken the current shopping items triggering and the product display zone by the product display zone
Corresponding gravity sensor and the weight change signal generated；
According to the weight change signal, acquires the user and take the continuous shooting shopping images of the current shopping items；
The current shopping items taken to user described in continuous shooting shopping image identify, generate identification
As a result, in order to judge whether the current shopping items are the end article according to the recognition result.
Preferably, before described " the current shopping items taken to the user identify, generate recognition result ",
Further include:
The image for acquiring the commodity display of each product display zone in automatic vending machine compares image as display；
" the current shopping items taken to the user identify, generate recognition result " includes:
The user is received to be taken the current shopping items triggering and the product display zone by the product display zone
Corresponding gravity sensor and the weight change signal generated；
According to the weight change signal, the image of the corresponding product display zone of the weight change signal is acquired, as
Shopping movement images；
The shopping movement images are compared identification with display control image, generate recognition result, in order to
Judge whether the current shopping items are the end article according to the recognition result.
Preferably, described " according to the merchandise news, to confirm that the range of goods in the merchandise news is corresponding certainly
After product display zone in dynamic vending machine ", further includes:
According to the first infrared sensor, the anchor point of user position is obtained；
According to the anchor point, the user is prompted to be moved in the range of the shopping area by voice module；
It receives user and enters the shopping area entry instruction that the generation of the second infrared sensor is triggered in shopping area；
According to the shopping area entry instruction, the cabinet door of automatic vending machine is opened, in order to which the user is described automatic
It does shopping in the shopping area of vending machine.
Preferably, described " the control LED light bright light corresponding with the product display zone, to prompt the user couple
End article in the product display zone is taken " after, further includes:
The shopping END instruction for closing the cabinet door triggering is received, the shopping generated after the commodity of taking of the user is obtained
Inventory；
The payment information based on the shopping list is generated according to the shopping list, in order to which the user is according to described
Payment information carries out payment and settlement.
In addition, to solve the above problems, the present invention also provides a kind of open environment shopping control devices, comprising: receive
Module, confirmation module and cue module；
The receiving module, for receiving the commodity selection information of terminal APP transmission；
The confirmation module is used for the corresponding user's need of the commodity selection information according to the commodity selection validation of information
The merchandise news of the end article to be taken；The merchandise news includes range of goods；
The confirmation module is also used to confirm the range of goods in the merchandise news according to the merchandise news
Product display zone in corresponding automatic vending machine；
The cue module, for controlling LED light bright light corresponding with the product display zone, to prompt the use
It takes to the end article in the product display zone at family.
In addition, to solve the above problems, the present invention also provides a kind of user terminal, including memory and processor, institute
Memory is stated for storing open formula environment shopping control program, the processor runs the open environment shopping control journey
Sequence is so that the user terminal executes open environment shopping control method as described above.
In addition, to solve the above problems, the present invention also provides a kind of computer readable storage medium, it is described computer-readable
Open environment shopping control program is stored on storage medium, the open environment shopping control program is executed by processor
Shi Shixian open environment shopping control method as described above.
A kind of open environment shopping control method provided by the invention and device.Wherein, method provided by the present invention
The commodity selection information sent by receiving user by terminal APP, and then the commodity that user needs to take are determined according to the information,
And confirm the place product display zone of the commodity, corresponding LED light is lighted in control, is prompted user, with convenient
The commodity are directly found in user.Provided open environment shopping control method through the invention, realizes open
Shopping environment in, according to the demand locating goods of client, i.e., the commodity selection information submitted in advance according to user determines commodity
Kind, and then the product display zone where determining and then is prompted, searching for user need to by corresponding LED light
The commodity wanted provide convenience, and substantially increase shopping efficiency, when shortening user and carrying out the shopping of screening in numerous commodity
Between, improve user experience.
Detailed description of the invention
Fig. 1 is that the structure for the hardware running environment that open environment of the present invention shopping control method example scheme is related to is shown
It is intended to；
Fig. 2 is the flow diagram of open environment of the present invention shopping control method first embodiment；
Fig. 3 is the flow diagram of open environment of the present invention shopping control method second embodiment；
Fig. 4 is the flow diagram of open environment of the present invention shopping control method 3rd embodiment；
Fig. 5 is the flow diagram of open environment of the present invention shopping control method fourth embodiment；
Fig. 6 is the flow diagram of open environment of the present invention shopping the 5th embodiment of control method；
Fig. 7 is the flow diagram of open environment of the present invention shopping control method sixth embodiment；
Fig. 8 is the functional block diagram of open environment of the present invention shopping control device.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Specific embodiment
The embodiment of the present invention is described below in detail, in which the same or similar labels are throughly indicated same or like
Element or element with the same or similar functions.
In addition, term " first ", " second " are used for descriptive purposes only and cannot be understood as indicating or suggesting relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include one or more of the features.In the description of the present invention, the meaning of " plurality " is two or more,
Unless otherwise specifically defined.
In the present invention unless specifically defined or limited otherwise, term " installation ", " connected ", " connection ", " fixation " etc.
Term shall be understood in a broad sense, for example, it may be being fixedly connected, may be a detachable connection, or integral；It can be mechanical connect
It connects, is also possible to be electrically connected；It can be directly connected, can also can be in two elements indirectly connected through an intermediary
The interaction relationship of the connection in portion or two elements.It for the ordinary skill in the art, can be according to specific feelings
Condition understands the concrete meaning of above-mentioned term in the present invention.
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
As shown in Figure 1, Fig. 1 is the structural schematic diagram of the hardware running environment for the terminal that the embodiment of the present invention is related to.
The PC being set in automatic counter machine that the terminal of that embodiment of the invention can be is also possible to smart phone, plate electricity
The packaged types terminal devices such as brain, E-book reader, MP3 player, MP4 player, portable computer.In addition it is also possible to
The computer hardware device being had by automatic counter machine itself.
As shown in Figure 1, the terminal may include: processor 1001, such as CPU, network interface 1004, user interface
1003, memory 1005, communication bus 1002.Wherein, communication bus 1002 is for realizing the connection communication between these components.
User interface 1003 may include display screen, input unit such as keyboard, remote controler, and optional user interface 1003 can also include
Standard wireline interface and wireless interface.Network interface 1004 optionally may include standard wireline interface and wireless interface (such as
WI-FI interface).Memory 1005 can be high speed RAM memory, be also possible to stable memory, such as magnetic disk storage.
Memory 1005 optionally can also be the storage device independently of aforementioned processor 1001.In addition, terminal further includes that image is adopted
Collect equipment 1006, is specifically as follows camera, camera etc..Described image acquire equipment 1006 by communication bus 1002 with it is described
Processor 1001 connects.In addition, terminal further includes gravity sensor 1007.The gravity sensor by communication bus 1002 with
The processor 1001 connects.Optionally, terminal can also include RF (Radio Frequency, radio frequency) circuit, audio-frequency electric
Road, WiFi module etc..In addition, mobile terminal can also configure gyroscope, barometer, hygrometer, thermometer, infrared sensor
Etc. other sensors, details are not described herein.
It will be understood by those skilled in the art that the restriction of the not structure paired terminal of terminal shown in Fig. 1, may include ratio
More or fewer components are illustrated, certain components or different component layouts are perhaps combined.
As shown in Figure 1, as may include operating system, number in a kind of memory 1005 of computer readable storage medium
It does shopping according to interface control program, network attachment procedure and open environment and controls program.
A kind of open environment shopping control method provided by the invention and device.Wherein, the method, which realizes, is opening
It puts in the shopping environment of formula, according to the demand locating goods of client, i.e., the commodity selection information submitted in advance according to user determines
The kind of commodity, and then determine the product display zone at place, and then prompted by corresponding LED light, it is looked into for user
It looks for the commodity of needs to provide convenience, substantially increases shopping efficiency, shorten the purchase that user carries out screening in numerous commodity
The object time, improve user experience.
Embodiment 1:
Referring to Fig. 2, first embodiment of the invention provides a kind of open environment shopping control method, comprising:
Step S10 receives the commodity selection information that terminal APP is sent；
It is above-mentioned, method provided by the present embodiment be applied to automatic vending machine, or with open shopping environment from
In dynamic scene of selling goods, for example, after opening cabinet door, user, which can enter, wherein carries out free quotient in open automatic vending machine
Product are settled accounts after closing cabinet door.
It is above-mentioned, terminal APP be user operated by terminal installation APP, wherein terminal can for intelligent movable equipment,
Tablet computer, portable PC, the MP4 that can be networked with intelligent operating system or other smart machines etc..
Above-mentioned, commodity selection information browses the commodity in the automatic vending machine of target by terminal APP for user
Afterwards, select and generate corresponding inventory, and the commodity selection information generated according to the inventory.
Step S20 needs to take according to the corresponding user of commodity selection information described in the commodity selection validation of information
The merchandise news of end article；The merchandise news includes range of goods；
Step S30 confirms the corresponding automatic selling of the range of goods in the merchandise news according to the merchandise news
Product display zone in cargo aircraft；
It is above-mentioned, it can be the article No. or code of included commodity in commodity selection information, by being converted to needed for user
The merchandise news of the end article to be taken includes the quantity of kind and commodity in merchandise news.And then believed according to the commodity
Breath, confirms the position for the product display zone that the range of goods is placed.
Above-mentioned, each commodity has the product display zone of fixed difference according to the difference of classification, in order to distinguish commodity
And user is convenient to choose different classes of commodity, different commodity be set to different product display zones it
In.For example, being sales counter in automatic vending machine, multiple cells separated by partition, each cell are equipped in sales counter
For a product display zone.
Step S40 controls LED light bright light corresponding with the product display zone, to prompt the user to described
End article in product display zone is taken.
Above-mentioned, each product display zone is corresponding to be provided with a LED light, and LED light is used for the quotient to place
The position of product display area is prompted, and the range prompted can include but is not limited to: product display zone whether goods out of stock few,
Whether product display zone is taken cargo, position indicating, prompt out of stock etc..It, can also be according to mentioning in addition, the indicator light of LED
Show the difference of information, carries out flashing or the transformation of color, user is prompted in order to more eye-catching.
The commodity selection information that method provided by the present invention is sent by receiving user by terminal APP, and then according to this
Information determines the commodity that user needs to take, and confirms the place product display zone of the commodity, and control is lighted corresponding LED and referred to
Show lamp, user is prompted, directly finds the commodity to be convenient to user.Provided open environment purchase through the invention
Object control method realizes in open shopping environment, according to the demand locating goods of client, i.e., is mentioned in advance according to user
The commodity selection information of friendship determines the kind of commodity, and then determines the product display zone at place, and then refer to by corresponding LED
Show that lamp is prompted, searches the commodity needed for user and provide convenience, substantially increase shopping efficiency, shorten user in crowd
The shopping-time that screening is carried out in more commodity, improves user experience.
Embodiment 2:
Referring to Fig. 3, second embodiment of the invention provides a kind of open environment shopping control method, is based on above-mentioned Fig. 2 institute
The first embodiment shown, step S40 " the control LED light bright light corresponding with the product display zone, described in prompt
User takes to the end article in the product display zone " after, further includes:
Step S50, the current shopping items taken to the user identify, generate recognition result；
Above-mentioned, user is in shopping process, and can take some commodity, as current shopping items, the current shopping quotient
Product are unknown commodity, need to identify the current shopping items by identification methods, to determine the kind of the commodity
And quantity.
Above-mentioned, recognition methods can carry out for the weight reduction of image-recognizing method or weight change to current shopping items
Identification, to determine commodity, i.e. recognition result.
Step S60 judges whether the current shopping items are the end article according to the recognition result；
It is above-mentioned, according to recognition result, judge whether the current shopping items are that user passes through target transmitted by terminal APP
Commodity.
It is corresponding with the end article to control closing if the current shopping items are the end article by step S70
The product display zone LED light.
If it is determined that the current shopping items that user takes are the end articles that user is chosen by terminal APP, then may be used
Close the corresponding LED light in product display zone of the commodity.
In addition, can determine that the kind of commodity and the corresponding quantity of range of goods, user pass through terminal by recognition result
Commodity selection information transmitted by APP may include end article kind and end article quantity corresponding with end article kind.
If end article quantity is greater than the commodity amount in recognition result, the end article that user takes can determine that
Quantity does not reach the quantity of the corresponding goods in the commodity selection information sent in advance, i.e. user is enough without that, then can lead to
Voice prompting, the quantity that user also needs to take are crossed, and flash for prompting can be carried out by LED light, in order to prompt to use
Continue to take the commodity until enough in family.
It whether is that end article identifies and judges by the commodity taken for user, such as in the present embodiment
What fruit user took is end article, then stops being prompted using the LED light of end article position, it is unnecessary to reduce
Indicator light flashing or other modes prompt, reduce the interference that user is normally done shopping, retain other and correctly mention
Show information, so that user be made more accurately to do shopping under clear environment, improves the shopping efficiency of user indirectly, be user
It provides convenience.
Embodiment 3:
Referring to Fig. 4, third embodiment of the invention provides a kind of open environment shopping control method, is based on above-mentioned Fig. 3 institute
The second embodiment shown, " the current shopping items taken to the user identify the step S50, generate identification knot
Fruit " includes:
Step S51 receives the user and is taken the current shopping items triggering and the quotient by the product display zone
The corresponding gravity sensor in product display area and the weight change signal generated；
Step S52 acquires the user and takes the continuous shooting purchases of the current shopping items according to the weight change signal
Object image；
Step S53 identifies the current shopping items taken of user described in continuous shooting shopping image,
Recognition result is generated, in order to judge whether the current shopping items are the end article according to the recognition result.
Above-mentioned, each product display zone is equipped with a corresponding gravity sensor, obtains the quotient in real time by gravity sensor
The weight value of the commodity of product display area, can real-time perception commodity take, put during weight change, i.e. weight change signal.
After shopping items are taken out by product display zone, gross mass changes, and corresponding gravity sensor is triggered, according to institute
The weight of the shopping items of reduction generates a weight change signal.
It is above-mentioned, it receives the product display zone and takes the weight change signal of gravity sensor that commodity are triggered, i.e., ought use
Family take certain product display zone commodity when, the weight in the region changes, then triggers gravity sensor, generates a weight and becomes
Change signal, and then the acquisition of the image of the commodity of taking for user can be carried out according to the weight change signal, is become according to weight
Change the acquisition for triggering taken for user commodity, improves and the timeliness of Image Acquisition is carried out for user's commodity of taking,
It wants weight to change, can be compared for a preset change threshold, if variation reaches the standard of change threshold,
It can determine that commodity are taken, and then can carry out carrying out Image Acquisition to the commodity, with kind and the quantity etc. for determining the commodity.
It is above-mentioned, after generating weight change signal, image is carried out to the current shopping items that user takes according to the signal
Acquisition obtains continuous shooting shopping image.It wherein, may include the shopping gesture of user in continuous shooting shopping image, and shopping gesture institute
The current shopping items of crawl.Continuous shooting does shopping image as continuous shooting shopping accessed within a preset time interval in preset time
Image acquires 10 continuous shootings and does shopping for example, the shopping gesture in user's shopping is taken in lasting 5 seconds of commodity process clock
Image.
Continuous shooting shopping image can be optimized, for example, intercepting the current purchase of the key frame in each continuous shooting shopping image
The screenshot of object commodity removes the region for influencing identification, obtains the corresponding minimum screenshot of the key frame of each continuous shooting shopping image,
And further the minimum screenshot is identified, recognition efficiency can be improved, reduce operand.
It is above-mentioned, by being identified for continuous shooting shopping image, so that it is determined that range of goods and quantity that user is taken,
And then a shopping list is generated according to the kind and quantity of the commodity.In the present embodiment, by gravity sensor in real time for
The take movement of commodity of user perceives, and the commodity if user takes generate a weight change signal, are become according to the weight
Change signal and utilize pattern recognition technique, Image Acquisition is carried out to the shopping movement of user, to confirm the taken commodity product of user
Kind and quantity, i.e. generation recognition result, to substantially increase the accuracy of the judgement of condition of merchandise taken to user.
Embodiment 4:
Referring to Fig. 5, fourth embodiment of the invention provides a kind of open environment shopping control method, is based on above-mentioned Fig. 2 institute
The first embodiment shown, the step S30 " according to the merchandise news, confirm the range of goods in the merchandise news
After product display zone in corresponding automatic vending machine ", further includes:
Step S80 obtains the anchor point of user position according to the first infrared sensor；
It is above-mentioned, in the present embodiment, it is respectively arranged with by the first infrared sensor and the second infrared sensor different
Sensing region, wherein the sensing region of the first infrared sensor is biggish range, and the model that the second infrared sensor is perceived
Enclosing for the lesser range compared to the first infrared sensor is default shopping area.First infrared sensor, is used for
Range near automatic vending machine is perceived, also, the first infrared sensor can be red equipped with one or more
Outer sensor, when user enters the range of the first infrared sensor, triggering generates letter corresponding with the first infrared sensor
Number, for determining that user will do shopping, but it is not introduced into shopping area.
It is above-mentioned, the signal of generation is triggered by user by the first infrared sensor, obtains opposite position at user
It sets, i.e. anchor point, which is the band of position for being different from shopping area.
Step S90 prompts the user to be moved to the model of the shopping area according to the anchor point by voice module
In enclosing；
Above-mentioned, shopping area is the smaller range close to automatic vending machine, for example, facing the position of automatic vending machine.
By voice module, user is prompted to be moved in the range of shopping area by anchor point.The voice module can be loudspeaker.
Step S100 receives user and enters the shopping area entry instruction that the generation of the second infrared sensor is triggered in shopping area；
It is above-mentioned, when user enters in the shopping area, the second infrared sensor is triggered, a shopping area is generated and enters finger
It enables, determines that user enters the region, can do shopping.
Step S110 opens the cabinet door of automatic vending machine according to the shopping area entry instruction, in order to which the user exists
It does shopping in the shopping area of the automatic vending machine.
It is above-mentioned, according to shopping area entry instruction, open the cabinet door of automatic vending machine.In the present embodiment, automatic vending machine
For open shopping environment, need to open cabinet door and carry out commodity and take operation, the unlatching of cabinet door for based on shopping area entry instruction,
Determine that user enters shopping area, preparation starts to do shopping, open cabinet door, thus for user shopping provide it is more intelligent
Cabinet door opening ways, provided convenience for the shopping of user.
Embodiment 5:
Referring to Fig. 6, fifth embodiment of the invention provides a kind of open environment shopping control method, is based on above-mentioned Fig. 2 institute
The first embodiment shown, step S40 " the control LED light bright light corresponding with the product display zone, described in prompt
User takes to the end article in the product display zone " after, further includes:
Step S120 is received and is closed the shopping END instruction that the cabinet door triggers, after the commodity of taking for obtaining the user
The shopping list of generation；
Step S130 generates the payment information based on the shopping list according to the shopping list, in order to the use
Family carries out payment and settlement according to the payment information.
Above-mentioned, after the cabinet door of automatic vending machine is closed the door, triggering generates shopping END instruction, determines that user terminates to do shopping,
Carry out clearing step.
In addition it is also possible to be user by operation control, into shopping settlement process, the user of cabinet door perception at this time terminates to purchase
The signal of object, and the cabinet door is automatically closed.For example, one specific shopping area of setting is moved to specific purchase when user terminates to do shopping
Outside object area, then user is perceived by infrared sensor and left, generated a shopping END instruction, cabinet door is controlled according to the instruction and is closed
It closes.
It is above-mentioned, after receiving shopping END instruction, it is generated to obtain user's commodity of taking every time in shopping process
Shopping list.For example, after commodity of taking, according to the identification for the commodity taken for user, it is clear to generate shopping by user
Single, user takes other commodity again, and then is updated after taking every time to the shopping list, when user terminates to do shopping, then should
Shopping list is final shopping list, and then generates payment information corresponding with the shopping list, in order to which user is according to this
Payment information is settled accounts, by being perceived automatically, to carry out the generation of payment information, being after user closes cabinet door
The shopping process of user provides convenience, and substantially increases payment efficiency.
Embodiment 6:
Referring to Fig. 7, sixth embodiment of the invention provides a kind of open environment shopping control method, is based on above-mentioned Fig. 3 institute
The second embodiment shown, " the current shopping items taken to the user identify the step S50, generate identification knot
Before fruit ", further includes:
Step S140 acquires the image of the commodity display of each product display zone in automatic vending machine, compares as display
Image；
Above-mentioned, each product display zone is corresponding to be equipped with one or more image capture devices, is specifically as follows high definition and takes the photograph
As head, for carrying out Image Acquisition to the product display zone.
It is above-mentioned, display control image, for the commodity in each product display zone collected before user takes commodity
It displays image and the kind and the corresponding quantity in stock of kind in current commodity display area would know that by the image.
The step S50 " the current shopping items taken to the user identify, generate recognition result " includes:
Step S54 receives the user and is taken the current shopping items triggering and the quotient by the product display zone
The corresponding gravity sensor in product display area and the weight change signal generated；
Step S55 acquires the figure of the corresponding product display zone of the weight change signal according to the weight change signal
Picture, as shopping movement images；
The shopping movement images are compared identification with display control image, generate identification knot by step S56
Fruit, in order to judge whether the current shopping items are the end article according to the recognition result.
Above-mentioned, each product display zone is equipped with a corresponding gravity sensor, obtains the quotient in real time by gravity sensor
The weight value of the commodity of product display area, can real-time perception commodity take, put during weight change, i.e. weight change signal.
After shopping items are taken out by product display zone, gross mass changes, and corresponding gravity sensor is triggered, according to institute
The weight of the shopping items of reduction generates a weight change signal.
It is above-mentioned, it receives the product display zone and takes the weight change signal of gravity sensor that commodity are triggered, i.e., ought use
Family take certain product display zone commodity when, the weight in the region changes, then triggers gravity sensor, generates a weight and becomes
Change signal, and then the acquisition of the image of the commodity of taking for user can be carried out according to the weight change signal, is become according to weight
Change the acquisition for triggering taken for user commodity, improves and the timeliness of Image Acquisition is carried out for user's commodity of taking,
It wants weight to change, can be compared for a preset change threshold, if variation reaches the standard of change threshold,
It can determine that commodity are taken, and then can carry out carrying out Image Acquisition to the commodity, with kind and the quantity etc. for determining the commodity.
It is above-mentioned, the image of the corresponding product display zone of the weight change signal is acquired, as shopping movement images；
Above-mentioned, movement images of doing shopping include useful in image to receive weight change signal when institute acquired image
Kind and with kind corresponding quantity of the family after the commodity for needs of having taken, in each product display zone.
Display control image is compared with the shopping movement images, the shopping is verified according to comparison result
Inventory generates the payment information based on the shopping list if the shopping list is consistent with the comparison result；
Through display control image compared with movement images of doing shopping, the quotient that user is taken away in product display zone can be confirmed
The information or data is compared the kind and particular number of product with shopping list of the user in shopping process, if two
Person's result always, then determines the shopping list to record correct shopping list, to the taken commodity in user's shopping process
Identification it is accurate, do not occur identification mistake, then payment information corresponding with shopping list, the knot for user can be generated
It calculates.
In the present embodiment, shopping list to generate in user's shopping process, and is tested after user terminates shopping
Card, to improve the safety of user's payment, is prevented due to identifying or counting commodity and number by verifying the accuracy of the inventory
There is mistake in amount, caused by calculate mistake, situations such as calculating or calculating less more, for user, that is, automatic vending machine, manager is provided more
Accurate statistical.
In addition, after the step s 40, can also include the following steps:
Based on Kinect bone tracer technique, the dynamic upper limb shopping image of the user is acquired, and is positioned described dynamic
The arm bone artis of the user in state upper limb shopping image；
It should be noted that bone tracer technique is the core technology of Kinect, it can be with 20 of accurate calibration human body
Key point, and real-time tracing can be carried out to the position of this 20 points.Using this technology, can develop various based on body-sensing people
The interesting application of machine interaction.Currently, the bone API in Kinect for Windows SDK can be provided in front of Kinect
The location information of at most two people, the three-dimensional coordinate information including detailed posture and skeleton point.In addition, Kinect for
Windows SDK can at most support 20 skeleton points.Data object type is provided in the form of skeletal frame, and each frame at most can be with
Save 20 points.
If application program only needs to capture the gesture actions of the upper part of the body, so that it may use Kinect for Windows
The half body mode (Seated Mode) that SDK is provided.Under half body mode, system only captures 10 skeleton points of upper half of human body
Information, and ignore the location information of other 10 skeleton points of the lower part of the body, can not be by when being sitting on chair this addresses the problem user
The problem of Kinect is identified, even if the data of lower part of the body skeleton point it is unstable or there is no will not bone number to the upper part of the body
According to impacting.And when user distance Kinect device only has 0.4 meter, application program remains to normally to carry out bone to chase after
Track, the performance of bone tracking just greatly improved in this.
In the present embodiment, using is half body mode, wherein arm bone artis, after being positioned for user,
Building artis corresponding with user images, for example, left and right ancon, left and right wrist, left and right hand, right and left shoulders, waist,
Neck, head etc. artis.It is above-mentioned, dynamic upper limb shopping image, for the dynamic within the scope of the upper limb of the user acquired in real time
Image, as video data.Positioning for the middle Bones and joints point of dynamic upper limb shopping image, can extract wherein key frame, right
Key frame carries out the identification using artificial neural network, so that it is determined that Bones and joints therein point, and do shopping in the dynamic upper limb
Real-time display tracking is carried out in image.
It obtains the dynamic vector of the corresponding arm bone artis of user's shopping gesture motion and generates shopping and move
Dynamic rail mark；
According to shopping motion track, the close end article display area of the shopping gesture motion of the user is determined；
It is above-mentioned, each arm bone artis is tracked, so that the corresponding vector of each arm bone artis is obtained,
And shopping motion track is obtained according to vector.Application program obtains the mode of each frame skeleton data with acquisition color image and depth
The mode for spending image data is the same, is all to be realized by calling call back function and transmitting a caching, obtains skeleton data tune
It is OpenSkeletonFrame () function.
It is above-mentioned, according to shopping motion track, confirm the close end article display area of the shopping gesture of user, specifically,
The corresponding coordinate range in settable each product display zone one, to whether judge the shopping gesture according to shopping motion track
Into in the coordinate range.
The corresponding target LED illumination lamp bright light in the end article display area is controlled, in order to which the user is in the mesh
It marks and does shopping under the illumination of LED illumination lamp in the end article display area.
It is above-mentioned, when the shopping gesture for judging user is close to end article display area, then light end article display
The corresponding target LED illumination lamp in area.During user does shopping, when user's shopping gesture goes to buy goods, due to
The light at night influences, it is understood that there may be the light of a part of shopping area receives blocking, can not see end article display area clearly
Situation, in the present embodiment, by tracking the limb action of user using Kinect bone tracer technique, to judge user's
The close end article display area of gesture of doing shopping, and then light the corresponding target LED illumination lamp in the display area, realize to
The close region in family carries out real-time perception and is illuminated accordingly, can not see clearly so as to avoid night shopping partial region
The case where, the position of the movement of Intellisense user and gesture of doing shopping is realized, and illuminated according to position, improves client
Experience provides convenience for user's shopping.
In addition, the present invention also provides a kind of open environment shopping control devices with reference to Fig. 8, comprising: receiving module 10,
Confirmation module 20 and cue module 30；
The receiving module 10, for receiving the commodity selection information of terminal APP transmission；
The confirmation module 20 is used for the corresponding user of commodity selection information according to the commodity selection validation of information
The merchandise news for the end article for needing to take；The merchandise news includes range of goods；
The confirmation module 20 is also used to confirm the commodity product in the merchandise news according to the merchandise news
Product display zone in the corresponding automatic vending machine of kind；
The cue module 30, for controlling LED light bright light corresponding with the product display zone, described in prompt
User takes to the end article in the product display zone.
In addition, the present invention also provides a kind of user terminal, including memory and processor, the memory is for storing
Open environment shopping control program, the processor run the open environment shopping control program so that the user is whole
End executes open environment shopping control method as described above.
In addition, being stored on the computer readable storage medium the present invention also provides a kind of computer readable storage medium
There is open environment shopping control program, the open environment shopping control program is realized when being executed by processor such as above-mentioned institute
State open environment shopping control method.
The serial number of the above embodiments of the invention is only for description, does not represent the advantages or disadvantages of the embodiments.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can be realized by means of software and necessary general hardware platform, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on this understanding, technical solution of the present invention substantially in other words does the prior art
The part contributed out can be embodied in the form of software products, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disk, CD), including some instructions are used so that terminal device (it can be mobile phone,
Computer, server or network equipment etc.) execute method described in each embodiment of the present invention.
The above is only a preferred embodiment of the present invention, is not intended to limit the scope of the invention, all to utilize this hair
Equivalent structure or equivalent flow shift made by bright specification and accompanying drawing content is applied directly or indirectly in other relevant skills
Art field, is included within the scope of the present invention.
Claims (9)
- The control method 1. a kind of open environment is done shopping characterized by comprisingReceive the commodity selection information that terminal APP is sent；According to the quotient for the end article that the corresponding user of commodity selection information described in the commodity selection validation of information needs to take Product information；The merchandise news includes range of goods；According to the merchandise news, the commodity in the corresponding automatic vending machine of the range of goods in the merchandise news are confirmed Display area；LED light bright light corresponding with the product display zone is controlled, to prompt the user in the product display zone End article take.
- The control method 2. open environment as described in claim 1 is done shopping, which is characterized in that described " control is old with the commodity The corresponding LED light bright light in area is arranged, to prompt the user to take the end article in the product display zone " it Afterwards, further includes:The current shopping items taken to the user identify, generate recognition result；Judge whether the current shopping items are the end article according to the recognition result；If the current shopping items are the end article, it is old to control the closing commodity corresponding with the end article Arrange the LED light in area.
- The control method 3. open environment as claimed in claim 2 is done shopping, which is characterized in that described " to be taken to the user Current shopping items identified, generate recognition result " include:It is corresponding with the product display zone by the product display zone current shopping items triggering of taking to receive the user Gravity sensor and the weight change signal that generates；According to the weight change signal, acquires the user and take the continuous shooting shopping images of the current shopping items；The current shopping items taken to user described in continuous shooting shopping image identify, generate identification knot Fruit, in order to judge whether the current shopping items are the end article according to the recognition result.
- The control method 4. open environment as claimed in claim 2 is done shopping, which is characterized in thatBefore " the current shopping items taken to the user identify, generate recognition result ", further includes:The image for acquiring the commodity display of each product display zone in automatic vending machine compares image as display；" the current shopping items taken to the user identify, generate recognition result " includes:It is corresponding with the product display zone by the product display zone current shopping items triggering of taking to receive the user Gravity sensor and the weight change signal that generates；According to the weight change signal, the image of the corresponding product display zone of the weight change signal is acquired, as shopping Movement images；The shopping movement images are compared identification with display control image, recognition result are generated, in order to basis The recognition result judges whether the current shopping items are the end article.
- The control method 5. open environment as described in claim 1 is done shopping, which is characterized in that described " according to the merchandise news, Confirm the product display zone in the corresponding automatic vending machine of the range of goods in the merchandise news " after, further includes:According to the first infrared sensor, the anchor point of user position is obtained；According to the anchor point, the user is prompted to be moved in the range of the shopping area by voice module；It receives user and enters the shopping area entry instruction that the generation of the second infrared sensor is triggered in shopping area；According to the shopping area entry instruction, the cabinet door of automatic vending machine is opened, in order to which the user is in the automatic vending It does shopping in the shopping area of machine.
- The control method 6. open environment as described in claim 1 is done shopping, which is characterized in that described " control is old with the commodity The corresponding LED light bright light in area is arranged, to prompt the user to take the end article in the product display zone " it Afterwards, further includes:The shopping END instruction for closing the cabinet door triggering is received, it is clear to obtain the shopping generated after the commodity of taking of the user It is single；The payment information based on the shopping list is generated according to the shopping list, in order to which the user is according to the payment Information carries out payment and settlement.
- The control device 7. a kind of open environment is done shopping characterized by comprising receiving module, confirmation module and cue module；The receiving module, for receiving the commodity selection information of terminal APP transmission；The confirmation module needs to take for the corresponding user of the commodity selection information according to the commodity selection validation of information The merchandise news of the end article taken；The merchandise news includes range of goods；The confirmation module is also used to confirm according to the merchandise news that the range of goods in the merchandise news is corresponding Automatic vending machine in product display zone；The cue module, for controlling LED light bright light corresponding with the product display zone, to prompt the user couple End article in the product display zone is taken.
- 8. a kind of user terminal, which is characterized in that including memory and processor, the memory is used for storing open formula ring Border shopping control program, the processor run the open environment shopping control program so that the user terminal executes such as The shopping control method of open environment described in any one of claim 1-6.
- 9. a kind of computer readable storage medium, which is characterized in that be stored on the computer readable storage medium open Environment shopping control program, the open environment shopping control program are realized when being executed by processor as in claim 1-6 Any one open environment shopping control method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810964706.8A CN109243112A (en) | 2018-08-23 | 2018-08-23 | A kind of open environment shopping control method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810964706.8A CN109243112A (en) | 2018-08-23 | 2018-08-23 | A kind of open environment shopping control method and device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109243112A true CN109243112A (en) | 2019-01-18 |
Family
ID=65069348
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810964706.8A Pending CN109243112A (en) | 2018-08-23 | 2018-08-23 | A kind of open environment shopping control method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109243112A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110059778A (en) * | 2019-03-05 | 2019-07-26 | 上海拉扎斯信息科技有限公司 | Indicating means, shelf and the system of product locations, device, equipment and medium |
| CN110211285A (en) * | 2019-06-04 | 2019-09-06 | 李志高 | Commodity recognition method and device |
| CN110335066A (en) * | 2019-06-14 | 2019-10-15 | 重庆新仙农业科技有限公司 | A kind of unmanned supermarket guidance system based on intelligent lighting technology |
| CN111310610A (en) * | 2020-01-22 | 2020-06-19 | 上海追月科技有限公司 | Goods identification method, goods identification system and electronic equipment |
| CN112185022A (en) * | 2020-08-31 | 2021-01-05 | 北京三快在线科技有限公司 | Intelligent cabinet control system, method and device, electronic equipment and computer medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708489A (en) * | 2012-04-12 | 2012-10-03 | 长春大学 | Intelligent supermarket shopping system based on radio frequency identification device (RFID) and 3rd generation telecommunication (3G) fused technique |
| CN106920152A (en) * | 2017-03-07 | 2017-07-04 | 深圳市楼通宝实业有限公司 | Self-service vending method and system |
| CN106952399A (en) * | 2017-02-24 | 2017-07-14 | 上海理工大学 | The automatic vending machine sold goods based on internet credit |
| CN107833366A (en) * | 2017-12-12 | 2018-03-23 | 成都缤柜科技有限公司 | A kind of self-selecting type automatic vending machine based on inductive switch |
| CN108171172A (en) * | 2017-12-27 | 2018-06-15 | 惠州Tcl家电集团有限公司 | Self-help shopping method, self-service sale device and computer readable storage medium |
| CN108198052A (en) * | 2018-03-02 | 2018-06-22 | 北京京东尚科信息技术有限公司 | User's free choice of goods recognition methods, device and intelligent commodity shelf system |
| US10528929B2 (en) * | 2016-11-30 | 2020-01-07 | Bank Of America Corporation | Computer terminal having a detachable item transfer mechanism for dispensing and collecting items |
-
2018
- 2018-08-23 CN CN201810964706.8A patent/CN109243112A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102708489A (en) * | 2012-04-12 | 2012-10-03 | 长春大学 | Intelligent supermarket shopping system based on radio frequency identification device (RFID) and 3rd generation telecommunication (3G) fused technique |
| US10528929B2 (en) * | 2016-11-30 | 2020-01-07 | Bank Of America Corporation | Computer terminal having a detachable item transfer mechanism for dispensing and collecting items |
| CN106952399A (en) * | 2017-02-24 | 2017-07-14 | 上海理工大学 | The automatic vending machine sold goods based on internet credit |
| CN106920152A (en) * | 2017-03-07 | 2017-07-04 | 深圳市楼通宝实业有限公司 | Self-service vending method and system |
| CN107833366A (en) * | 2017-12-12 | 2018-03-23 | 成都缤柜科技有限公司 | A kind of self-selecting type automatic vending machine based on inductive switch |
| CN108171172A (en) * | 2017-12-27 | 2018-06-15 | 惠州Tcl家电集团有限公司 | Self-help shopping method, self-service sale device and computer readable storage medium |
| CN108198052A (en) * | 2018-03-02 | 2018-06-22 | 北京京东尚科信息技术有限公司 | User's free choice of goods recognition methods, device and intelligent commodity shelf system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110059778A (en) * | 2019-03-05 | 2019-07-26 | 上海拉扎斯信息科技有限公司 | Indicating means, shelf and the system of product locations, device, equipment and medium |
| CN110059778B (en) * | 2019-03-05 | 2022-08-02 | 上海拉扎斯信息科技有限公司 | Commodity position indicating method, commodity shelf system, commodity position indicating device, commodity position indicating equipment and commodity position indicating medium |
| CN110211285A (en) * | 2019-06-04 | 2019-09-06 | 李志高 | Commodity recognition method and device |
| CN110335066A (en) * | 2019-06-14 | 2019-10-15 | 重庆新仙农业科技有限公司 | A kind of unmanned supermarket guidance system based on intelligent lighting technology |
| CN111310610A (en) * | 2020-01-22 | 2020-06-19 | 上海追月科技有限公司 | Goods identification method, goods identification system and electronic equipment |
| WO2021147950A1 (en) * | 2020-01-22 | 2021-07-29 | 上海追月科技有限公司 | Goods identification method, goods identification system, and electronic device |
| CN112185022A (en) * | 2020-08-31 | 2021-01-05 | 北京三快在线科技有限公司 | Intelligent cabinet control system, method and device, electronic equipment and computer medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109243112A (en) | A kind of open environment shopping control method and device | |
| CN109035629A (en) | A kind of shopping settlement method and device based on open automatic vending machine | |
| CN108694779B (en) | Goods returning method and device for open type vending machine | |
| CN109166007A (en) | A kind of Method of Commodity Recommendation and its device based on automatic vending machine | |
| CN104885111B (en) | Control method for displaying sales information on information terminal | |
| CN108985861A (en) | A kind of shopping clearing control method and device based on open shopping environment | |
| RU2739542C1 (en) | Automatic registration system for a sales outlet | |
| US11023908B2 (en) | Information processing apparatus for performing customer gaze analysis | |
| US20140279613A1 (en) | Detecting counterfeit items | |
| US20160005052A1 (en) | Information processing system and information processing method | |
| AU2020201578B2 (en) | Presentation apparatus (ICS Connection) | |
| CN109271847A (en) | Method for detecting abnormality, device and equipment in unmanned clearing scene | |
| CN112585667A (en) | Intelligent platform counter display system and method | |
| US20170149933A1 (en) | Wear system and method for providing service | |
| CN109285019A (en) | Image processing apparatus, information processing unit, system and control method | |
| US20120130920A1 (en) | Commodity processing supporting system and commodity processing supporting method | |
| CN109241883A (en) | A kind of return of goods control method and its device based on automatic vending machine | |
| CN108960132A (en) | The purchasing method and its device of commodity in a kind of open automatic vending machine | |
| CN109886092A (en) | Object identifying method and its device | |
| CN109191196A (en) | A kind of Method of Commodity Recommendation based on user characteristics, device and user terminal | |
| CN109166000A (en) | A kind of Intelligent cargo cabinet and the method for creating order | |
| CN109002782A (en) | A kind of commodity purchasing method, apparatus and user terminal based on automatic vending machine | |
| KR20200079721A (en) | Smart clothes management system and method thereof | |
| CN109556695A (en) | Weighing method, weighing device, self-service cabinet and self-service method | |
| US20180012267A1 (en) | Electronic device, apparatus and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |