CN110850967A

CN110850967A - Intelligent supermarket shopping method and system based on virtual reality and cloud computing

Info

Publication number: CN110850967A
Application number: CN201911007492.6A
Authority: CN
Inventors: 沈佳佳
Original assignee: Suzhou Sun Xuan Digital Technology Co Ltd
Current assignee: Suzhou Sun Xuan Digital Technology Co Ltd
Priority date: 2019-10-22
Filing date: 2019-10-22
Publication date: 2020-02-28

Abstract

An intelligent supermarket shopping method and system based on virtual reality and cloud computing comprise the following steps: the start information fed back by the virtual reality equipment is received, the information including the information of putting into the supermarket is extracted, the intelligent shopping cart is controlled to start, the intelligent shopping cart and the virtual reality equipment are bound with each other, the first monitoring camera is controlled to be started and to acquire user virtual movement information fed back by the virtual reality equipment in real time, the intelligent shopping cart is controlled to keep moving synchronously with the user and whether a virtual object is taken by the user is analyzed, if yes, the object information is extracted, the goods taking mechanism is controlled to push the matched object into the intelligent shopping cart, whether the user arrives at a cash position is analyzed, if yes, the object pushing mechanism is controlled to push the object into the cash position and acquire the object information calculated by the cash register equipment in real time, a cash collecting two-dimensional code matched with the amount is generated, the projection equipment is controlled to be started to project the cash collecting two-dimensional code to the ground, and the virtual reality equipment is controlled to remind the user to remove the wearing and pay.

Description

Intelligent supermarket shopping method and system based on virtual reality and cloud computing

Technical Field

The invention relates to the field of supermarket shopping, in particular to an intelligent method and system based on virtual reality and cloud computing.

Background

The virtual reality is, as the name implies, a combination of virtual and real. Theoretically, virtual reality technology (VR) is a computer simulation system that can create and experience a virtual world, which uses a computer to create a simulated environment into which a user is immersed. The virtual reality technology is to combine electronic signals generated by computer technology with data in real life to convert the electronic signals into phenomena which can be felt by people, wherein the phenomena can be true and true objects in reality or substances which can not be seen by the naked eyes, and the phenomena are expressed by a three-dimensional model. These phenomena are called virtual reality because they are not directly visible but a real world simulated by computer technology.

The virtual reality technology is accepted by more and more people, a user can experience the truest feeling in the virtual reality world, the reality of the simulation environment is hard to distinguish from the real world, and people can feel personally on the scene; meanwhile, the virtual reality has all human perception functions, such as auditory perception systems, visual perception systems, tactile perception systems, gustatory perception systems, olfactory perception systems and the like; finally, the system has a super-strong simulation system, thereby really realizing human-computer interaction, enabling people to operate at will and obtaining the most real feedback of the environment in the operation process. It is the presence, multi-awareness, interactivity, etc. features of virtual reality technology that make it popular with many people.

However, how to combine virtual reality, supermarket shopping and intellectualization, so that after the virtual shopping demand of the user is obtained, the intelligent shopping cart corresponding to the supermarket is synchronously controlled to move according to the virtual reality information of the user, and the articles virtually taken by the user are synchronously placed in the intelligent shopping cart, so that the problem that the shopping experience similar to the shopping experience when the entity enters the supermarket is met under the condition that the user is out of the home is urgently needed to be solved at present.

Disclosure of Invention

The purpose of the invention is as follows: in order to overcome the defects in the background art, the embodiment of the invention provides an intelligent method and system based on virtual reality and cloud computing, which can effectively solve the problems related to the background art.

The technical scheme is as follows:

an intelligent supermarket shopping method based on virtual reality and cloud computing comprises the following steps:

s1, after starting information fed back by the virtual reality equipment keeping the connection relation is received, supermarket information contained in the starting information is extracted, an intelligent shopping cart which is matched with the supermarket information and is in an idle state is controlled to be started, and the intelligent shopping cart and the virtual reality equipment are bound with each other;

s2, controlling a first monitoring camera arranged outside the intelligent shopping cart to start to capture a first monitoring image in real time and obtain user virtual movement information fed back by the virtual reality equipment in real time;

s3, controlling the intelligent shopping cart to keep moving synchronously with the user according to the first monitoring image and the user virtual movement information, and analyzing whether the user has an article at the position of a supermarket shelf which is taken virtually according to the real-time user virtual movement information;

s4, if yes, extracting information of the articles virtually taken by the user, and controlling a goods taking mechanism arranged at the shelf position of the supermarket to push the articles consistent with the article information to fall into the intelligent shopping cart according to the article information;

s5, analyzing whether the user goes to a cash register area and arrives at a cash register position of a cashier or not according to the first monitoring image and the user virtual movement information;

s6, if yes, controlling an article pushing mechanism arranged at the position of the storage cavity of the intelligent shopping cart to push articles in the intelligent shopping cart to be placed at the cash register position and acquiring the price information of the articles calculated by the cash register device at the cash register position in real time;

s7, after the cashier finishes scanning all the articles, generating a two-dimensional collection code with matched amount according to the price information of the articles calculated by the collection equipment, controlling the projection equipment arranged at the external position of the virtual reality equipment to start to project the two-dimensional collection code to the ground position of the area where the user is located, and controlling the virtual reality equipment to remind the user to remove the wearing and pay.

As a preferred mode of the present invention, after S6, the method further includes the steps of:

s60, after the cashier finishes scanning all the articles and packaging, controlling a weighing sensor arranged above the article transportation platform at the cash position to start to acquire weight information above the article transportation platform in real time and analyzing whether articles are placed above the article transportation platform according to the weight information;

s61, if so, controlling the article transportation platform to completely descend at the position of the transportation channel and controlling an article transportation mechanism arranged at the bottom end position of the transportation channel to push the articles above the article transportation platform which is completely descended to the position of a crawler mechanism at the side;

and S62, controlling the crawler mechanism to start to transport the article into a transport box at the tail end position of the crawler mechanism and binding the article with the virtual reality device.

As a preferred mode of the present invention, after S62, the method further includes the steps of:

s63, acquiring address information matched with the virtual reality equipment and planning a flight route of the transport unmanned aerial vehicle according to the address information and the supermarket address information;

s64, controlling a transport unmanned aerial vehicle arranged at the top of the tail end of the crawler mechanism to start and controlling the transport unmanned aerial vehicle to descend to a transport box position, and connecting the transport unmanned aerial vehicle with the top of the transport box through a connecting mechanism below the transport unmanned aerial vehicle;

and S65, transmitting the flight route to the transport unmanned aerial vehicle, and controlling the transport unmanned aerial vehicle to suspend the transport box by using a connecting mechanism to go to the destination position of the flight route.

As a preferred mode of the present invention, after S1, the method further includes the steps of:

s10, controlling a second monitoring camera arranged at the top end position inside the supermarket to start to capture a second monitoring image in real time, and acquiring real-time human body images and human body space coordinate data inside the supermarket according to the real-time second monitoring image;

and S11, generating a corresponding human body virtual reality image according to the acquired real-time human body image and the human body space coordinate data, and transmitting the human body virtual reality image to the virtual reality equipment in real time.

As a preferred mode of the present invention, after S3, the method further includes the steps of:

s30, if the situation that the user takes the goods at the virtual supermarket shelf position is analyzed, obtaining the goods information which is contained in the supermarket database and matched with the goods, and virtually displaying the goods information at the position around the goods at the virtual supermarket shelf position taken by the user;

s31, analyzing whether the user puts the virtually taken articles in the intelligent shopping cart or not according to the real-time user virtual movement information;

and S32, if yes, transmitting the item information to a goods lifting mechanism matched with the item information in the supermarket, calculating the price of the item according to all the item information in the intelligent shopping cart, and virtually displaying the calculated price of the item on the armrest position of the shopping cart virtually pushed by the user.

An intelligent supermarket shopping system based on virtual reality and cloud computing uses an intelligent supermarket shopping method based on virtual reality and cloud computing, and comprises an intelligent shopping cart, virtual reality equipment, a monitoring device, a conveying device, a supermarket database and a server, wherein the intelligent shopping cart comprises a shopping cart body, a storage cavity and an article pushing mechanism, and the shopping cart body is placed in a supermarket; the storage cavity is arranged at the position of the shopping cart body and used for storing objects; the article pushing mechanism is arranged in the storage cavity and used for pushing the articles in the storage cavity to the cash collecting position after being lifted;

the virtual reality equipment comprises an equipment body and projection equipment, wherein the projection equipment is arranged at the outer position of the equipment body and is used for projecting two-dimensional code information;

the monitoring device comprises a first monitoring camera and a second monitoring camera, wherein the first monitoring camera is arranged at the outer position of the shopping cart body and is used for shooting an environmental image around the shopping cart body; the second monitoring camera is arranged at the top end position in the supermarket and used for shooting an environment image in the supermarket;

the conveying device comprises a goods lifting mechanism, a conveying channel, a goods conveying platform, a weighing sensor, a goods conveying mechanism, a crawler mechanism, a conveying unmanned aerial vehicle, a connecting mechanism and a conveying box, wherein the goods lifting mechanism is arranged at a shelf position of a supermarket and used for pushing goods at the shelf position of the supermarket to fall into a storage cavity of the shopping cart body; the transport channel is arranged at a cash register position of a supermarket and used for lifting the article transport platform; the article transportation platform is positioned at the position of the transportation channel and is used for transporting articles; the weighing sensor is arranged above the article transportation platform and used for acquiring weight information above the article transportation platform; the article transportation mechanism is arranged at the side position of the bottom of the transportation channel and used for pushing articles above the article transportation platform to the upper part of the crawler mechanism; the upper part of the crawler mechanism is arranged at the side position of the bottom of the conveying channel and is used for conveying the articles pushed by the article conveying mechanism; the transportation unmanned aerial vehicle is arranged at the top of the tail end of the crawler mechanism and used for transporting articles to an appointed position; the connecting mechanism is arranged below the transport unmanned aerial vehicle and is used for being connected with the transport box; the transportation box is positioned at the tail end of the crawler mechanism and used for placing articles transported by the crawler mechanism;

the supermarket database is arranged at a position of a placement database planned by a supermarket management department and used for storing article information contained in a supermarket;

the server is arranged at the position where the server is placed planned by the master control center; the server includes:

the wireless module is used for being wirelessly connected with a shopping cart body, an article pushing mechanism, a first monitoring camera, a second monitoring camera, a goods lifting mechanism, an article transportation platform, a weighing sensor, an article transportation mechanism, a crawler mechanism, a transportation unmanned aerial vehicle, a connection mechanism, a supermarket database, a supermarket management center, user registered virtual reality equipment, a master control center and a network respectively;

the information receiving module is used for receiving information and/or instructions and/or requests;

the information extraction module is used for extracting information and/or instructions and/or requests contained in the specified information;

the shopping control module is used for controlling the intelligent shopping cart to execute set operation according to set steps;

the information binding module is used for binding the specified object with another specified object;

the first shooting module is used for controlling the first monitoring camera to be started or closed;

the virtual acquisition module is used for acquiring user virtual operation information fed back by the virtual reality equipment in real time;

the information analysis module is used for processing and analyzing the information according to the specified information;

the virtual extraction module is used for extracting the information of the articles virtually taken by the user through the virtual reality equipment;

the goods picking control module is used for controlling the goods picking mechanism to execute set operation according to set steps;

the article pushing module is used for controlling the article pushing mechanism to execute set operation according to set steps;

the cash register acquisition module is used for acquiring the information of the articles calculated by the cash register equipment in real time;

the two-dimensional code generating module is used for generating a collection two-dimensional code of the matched amount according to the appointed article information;

the projection control module is used for controlling the projection equipment to project the collection two-dimensional code to a designated area;

and the reminding module is used for controlling the virtual reality equipment to prompt the designated information.

As a preferred aspect of the present invention, the server further includes:

the weighing control module is used for controlling the weighing sensor to be started or closed;

the article transportation module is used for controlling the article transportation platform to lift;

the article conveying module is used for controlling the article conveying mechanism to execute set operation according to set steps;

and the crawler conveying module is used for controlling the crawler mechanism to start or close.

As a preferred aspect of the present invention, the server further includes:

the address acquisition module is used for acquiring address information matched with the virtual reality equipment;

the unmanned aerial vehicle control module is used for controlling the transport unmanned aerial vehicle to execute set operation according to set steps;

the route planning module is used for planning a flight route according to the address information of the virtual reality equipment and the address information of the supermarket;

and the connection control module is used for controlling the connection mechanism to execute the set operation according to the set steps.

As a preferred aspect of the present invention, the server further includes:

the second shooting module is used for controlling the second monitoring camera to be started or closed;

the coordinate acquisition module is used for acquiring real-time human body images and human body space coordinate data in the supermarket according to the images shot by the second monitoring camera;

and the virtual reality module is used for generating a corresponding human body virtual reality image according to the real-time human body image and the human body space coordinate data and transmitting the human body virtual reality image to the virtual reality equipment in real time.

As a preferred aspect of the present invention, the server further includes:

the information acquisition module is used for acquiring the article information contained in the supermarket database;

the information display module is used for virtually displaying the article information at the position around the article at the position where the user virtually takes the supermarket shelf;

the information transmission module is used for transmitting the specified information to the specified object;

and the price calculating module is used for calculating the price of the articles according to the information of all the articles in the intelligent shopping cart and virtually displaying the calculated price of the articles in the position of the armrest of the intelligent shopping cart virtually pushed by the user.

The invention realizes the following beneficial effects:

1. the intelligent supermarket shopping system acquires supermarket information selected by a user through virtual reality equipment after the virtual reality equipment of the user is started, then simulates a virtual supermarket scene matched with the supermarket information for the user through the virtual reality equipment, allocates an intelligent shopping cart which corresponds to the supermarket and is idle inside the supermarket for the user, then keeps the intelligent shopping cart and the user moving synchronously in the virtual supermarket scene and acquires that the user operates in the virtual supermarket scene, if the user takes an article in the virtual supermarket scene, the corresponding article is pushed into the intelligent shopping cart in the real supermarket, after the user goes to the supermarket checkout counter position, the intelligent shopping cart is controlled to push the article to be placed at the checkout counter position for a cashier to sweep out a code for settlement, then a corresponding two-dimensional code is generated according to the settlement amount of the article and the virtual reality equipment is controlled to project the payment two-dimensional code, for payment by the user; therefore, the user can experience shopping experience similar to the shopping experience of the entity entering the supermarket under the condition that the user can not go out of the house.

2. After the user finishes payment and the cashiers finish packing the articles, controlling the article placing platform to descend the articles to the bottom end of the transportation channel, then enabling the article transportation mechanism to push the articles placed on the article placing platform to the position of the crawler mechanism, transporting the articles into the transportation box by the crawler mechanism, and then controlling the transportation unmanned aerial vehicle to be connected with the transportation box by the connecting mechanism and deliver the transportation box to the corresponding user address position; thereby enabling the user to obtain the required articles.

3. When a user is positioned in a virtual supermarket to take an article, displaying the information of the article at the position around the article taken by the user for prompting; when a user is located in the virtual supermarket and articles are placed in the hand-push shopping cart in the virtual supermarket scene, the information of the articles is displayed at the position of the armrest of the hand-push shopping cart in the virtual supermarket scene so that the user can check the information.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1 is a flow chart of an intelligent supermarket shopping method according to an exemplary embodiment of the present invention;

FIG. 2 is a flow chart of a method of transporting items according to one example of the present invention;

FIG. 3 is a flow chart of a method of dispensing items according to one example of the present invention;

FIG. 4 is a flow chart of a real-time virtual reality simulation method provided by one example of the present invention;

FIG. 5 is a flow chart of a method for virtually displaying item information according to one embodiment of the present invention;

FIG. 6 is a diagram of a connection of an intelligent supermarket shopping system according to an exemplary embodiment of the present invention;

FIG. 7 is a partial schematic view of the area of the storage compartment of the shopping cart body according to one embodiment of the present invention;

FIG. 8 is a schematic view, partially in section, of an area of a shopping cart body in which a storage compartment is located, according to one embodiment of the present invention;

FIG. 9 is a partial schematic view of an article receiving area in which a pick-up mechanism is located according to one example of the invention;

FIG. 10 is a schematic view, partially in section, of the area of a transport corridor provided by one example of the present invention;

FIG. 11 is a schematic illustration in partial cross-section of an area where a track mechanism is located and is provided in accordance with an example of the present invention;

fig. 12 is a schematic diagram of a transport drone and transport box connection provided by one example of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.

Example one

Referring to fig. 1, 4, and 6-10.

Specifically, the embodiment provides an intelligent supermarket shopping method based on virtual reality and cloud computing, which is characterized by comprising the following steps:

s1, after receiving starting information fed back by the virtual reality device 2 keeping the connection relation, extracting supermarket information contained in the starting information, controlling the intelligent shopping cart 1 in an idle state matched with the supermarket information to start, and binding the intelligent shopping cart 1 and the virtual reality device 2 with each other.

In S1, specifically, after the information receiving module 51 included in the server 5 receives the start information fed back by the virtual reality device 2 registered in the server 5 and maintaining the connection relationship, after the virtual reality device 2 is registered in the server 5, the start information is fed back to the server 5 maintaining the connection relationship after each start, where the start information includes the number information of the virtual reality device 2, and the server 5 can obtain the registration information corresponding to the virtual reality device 2 through the number information, where the registration information includes the address information, the number information, the user information, and the like registered by the virtual reality device 2; then, the information receiving module 51 feeds back the received starting information to the information extracting module 52, after the information extracting module 52 included in the server 5 receives the starting information, the supermarket information included in the starting information is extracted and the extracted supermarket information is sent to the shopping control module 53, the shopping control module 53 included in the server 5 controls the intelligent shopping cart 1 in an idle state matched with the supermarket information to be started, for example, if a user needs to go to supermarket a to perform virtual shopping through the virtual reality device 2, the intelligent shopping cart 1 which is idle in supermarket a is controlled to be started; after the intelligent shopping cart 1 is started, the information binding module 54 included in the server 5 binds the intelligent shopping cart 1 and the virtual reality device 2 to each other.

And S2, controlling the first monitoring camera 30 arranged outside the intelligent shopping cart 1 to start to capture a first monitoring image in real time and acquire the user virtual movement information fed back by the virtual reality device 2 in real time.

In S2, specifically, after the intelligent shopping cart 1 and the virtual reality device 2 are bound to each other, the first capturing module 55 included in the server 5 controls the first monitoring camera 30 disposed outside the intelligent shopping cart 1 to start to capture a first monitoring image in real time, where the first monitoring image is an environment image outside the intelligent shopping cart 1 captured by the first monitoring camera 30; after the first monitoring camera 30 is started, the virtual obtaining module 56 included in the server 5 obtains the user virtual movement information fed back by the virtual reality device 2 in real time, that is, obtains coordinate data of the user moving in the virtual supermarket scene through the virtual reality device 2, the data of the taken article, and the like.

S3, controlling the intelligent shopping cart 1 to keep moving synchronously with the user according to the first monitoring image and the user virtual movement information, and analyzing whether the user has an article at the position of a supermarket shelf which is taken virtually according to the real-time user virtual movement information.

In S3, specifically, after the virtual obtaining module 56 obtains the user virtual movement information fed back by the virtual reality in real time, the user virtual movement information is transmitted to the shopping control module 53 and the information analysis module 57 in real time, and after the shopping control module 53 receives the user virtual movement information, the intelligent shopping cart 1 is controlled to keep moving synchronously with the user according to the first monitoring image and the user virtual movement information, for example: the user moves to b goods shelves position then through the virtual hand push shopping cart of virtual reality equipment 2 in the A supermarket, the shopping control module 53 controls the removal universal wheel that the removal motor drive of the intelligent shopping cart 1 in the reality is connected to move to b goods shelves position in the A supermarket according to the route of the virtual hand push shopping cart of user to reach the route that lets the virtual hand push shopping cart of user move unanimously with intelligent shopping cart 1 line of movement, the human body that the reality of A supermarket exists 1 in user virtual reality equipment 2: 1, but the virtual hand of the user in the virtual reality device 2 cannot leave the virtual shopping cart, and the virtual reality scene in the virtual reality device 2 has no physical collision between people, but has physical collision between the shopping cart and people and between the shopping cart and objects; after receiving the user virtual movement information, the information analysis module 57 included in the server 5 analyzes whether the user has an article at a virtual supermarket shelf position according to the real-time user virtual movement information.

And S4, if yes, extracting the information of the articles virtually taken by the user, and controlling the goods taking mechanism 40 arranged at the shelf position of the supermarket to push the articles consistent with the article information to fall into the intelligent shopping cart 1 according to the article information.

In S4, specifically, after the information analysis module 57 analyzes that the user has an item at a shelf location taken in a virtual supermarket scene, the virtual extraction module 58 included in the server 5 extracts information of the item virtually taken by the user through the virtual reality device 2, where the information of the item includes the shelf location of the supermarket where the item is located, the type of the item, the name of the item, the number of the item, and the like; the virtual extraction module 58 then transmits the extracted item information to the pick-up control module 59, after receiving the information, the goods-taking control module 59 included in the server 5 controls the second and third telescopic motors of the goods placing area to be started at the position consistent with the supermarket shelf position, the goods type and the goods name included in the goods information, then controlling the first expansion plate in the driving connection with the second expansion motor in the article placing area to completely contract, after the first telescopic plate is contracted, controlling a second telescopic rod connected with the third telescopic motor to drive a second pushing plate to extend out to push the articles in the article placing area and the articles with the same quantity as the articles contained in the article information out of the article placing area, so that the articles are pushed to fall into the storage cavity 11 of the intelligent shopping cart 1 at the edge of the supermarket shelf, and then controlling the first expansion plate in the article placing area to be in driving connection with the second expansion motor to completely extend.

And S5, analyzing whether the user goes to the cash register area and arrives at the cash register position of the cashier according to the first monitoring image and the virtual movement information of the user.

In S5, the information analysis module 57 specifically analyzes whether the user goes to the cash register area in real time according to the first monitoring image and the virtual movement information of the user, and whether the user goes to the cash register position of the cashier after reaching the cash register area.

And S6, if yes, controlling the article pushing mechanism 12 arranged at the position of the storage cavity 11 of the intelligent shopping cart 1 to push the articles in the intelligent shopping cart 1 to be placed at the cash register position and acquiring the price information of the articles calculated by the cash register device at the cash register position in real time.

In S6, specifically after the information analysis module 57 analyzes that the user goes to a cash register area and arrives at a cash register position where a cashier is located, the article push module 60 included in the server 5 controls a first lifting roller which is arranged in the lifting platform position in the storage cavity 11 of the intelligent shopping cart 1 and is in drive connection with a first driving motor to completely lift the lifting platform, and after the lifting platform is completely lifted, the lifting platform and the upper surface of a cash register desk are located at the same horizontal plane, and then the article push module 60 controls a first push plate which is arranged above the lifting platform and is in drive connection with a first telescopic link which is in drive connection with a first telescopic motor, to push articles above the lifting platform to the cash register desk position so that the cash register staff at the cash register desk can take the articles to scan the articles; meanwhile, the cashier acquiring module 61 included in the server 5 acquires the item price information calculated in real time by the cashier device at the cashier position in real time and sends the item price information calculated in real time to the two-dimensional code generating module 62.

S7, after the cashier finishes scanning all the articles, generating a payment two-dimensional code with matched amount according to the price information of the articles calculated by the cash register device, controlling the projection device 21 arranged at the external position of the virtual reality device 2 to start to project the payment two-dimensional code to the ground position of the area where the user is located, and controlling the virtual reality device 2 to remind the user to remove the wearing and pay.

In S7, specifically, after the information analysis module 57 analyzes that the cashier scans all the articles according to the first monitoring image, the two-dimensional code generation module 62 included in the server 5 generates a two-dimensional code for payment with a matching amount according to the received price information of the articles calculated by the cash register device and sends the generated two-dimensional code for payment to the projection control module 63, the projection control module 63 included in the server 5 controls the projection device 21 disposed at the external position of the virtual reality device 2 to start projecting the two-dimensional code for payment to the ground position of the area where the user is located, the reminding module 64 included in the server 5 controls the virtual reality device 2 to remind the user to remove the wearing for payment, and after the user removes the wearing of the virtual reality device 2, the user takes out the two-dimensional code for payment projected by the mobile phone or the tablet scanning virtual reality device 2 to pay the corresponding amount, after the payment is completed, the server 5 feeds back payment completion information to the cash register device, so that the cash register personnel can view and pack the goods on the surface of the goods transportation platform 42 at the position.

and S10, controlling the second monitoring camera 31 arranged at the top end position inside the supermarket to start to shoot a second monitoring image in real time, and acquiring real-time human body images and human body space coordinate data inside the supermarket according to the real-time second monitoring image.

Specifically, the intelligent shopping cart 1 and the virtual reality device 2 are bound to each other, the second camera module 73 included in the server 5 controls the second monitoring camera 31 arranged at the top position inside the supermarket to start to capture a second monitoring image in real time and transmit the real-time second monitoring image to the coordinate acquisition module 74, the second monitoring image is an environment image inside the supermarket captured by the second camera, and after the coordinate acquisition module 74 included in the server 5 receives the second monitoring image, the coordinate acquisition module 74 acquires the real-time human body image and the real-time human body space coordinate data inside the supermarket in real time according to the real-time second monitoring image.

And S11, generating a corresponding human body virtual reality image according to the acquired real-time human body image and the human body space coordinate data, and transmitting the human body virtual reality image to the virtual reality device 2 in real time.

Specifically, after the coordinate obtaining module 74 obtains the real-time human body image inside the supermarket and the human body space coordinate data corresponding to the human body image, the human body image and the human body space coordinate data are transmitted to the virtual reality module 75 in real time, and the virtual reality module 75 included in the server 5 generates a corresponding human body virtual reality image according to the received real-time human body image and the human body space coordinate data and transmits the human body virtual reality image to the virtual reality device 2 in real time, so as to perform real-time supermarket virtual scene simulation.

Example two

Referring to fig. 2-3, fig. 6-12.

Specifically, this embodiment is substantially the same as the first embodiment, except that in this embodiment, after S6, the method further includes the following steps:

s60, after the cashier finishes scanning all the articles and packaging, controlling the weighing sensor 43 arranged above the article transportation platform 42 at the cash register position to start to acquire the weight information above the article transportation platform 42 in real time and analyzing whether the articles are placed above the article transportation platform 42 according to the weight information.

Specifically, after the information analysis module 57 analyzes that the cashier scans all the articles according to the first monitoring image, the code scanning and packaging are completed, the weighing control module 65 contained in the server 5 controls the weighing sensor 43 arranged above the article transportation platform 42 in the cash position to start to acquire the weight information above the article transportation platform 42 in real time and transmit the acquired weight information to the information analysis module 57, the information analysis module 57 analyzes whether the articles are placed above the article transportation platform 42 according to the received weight information in real time, that is, whether the weight of the articles above the article transportation platform 42 exceeds 10g and exceeds 1 minute is analyzed, and the information analysis module 57 analyzes that the articles above the article transportation platform 42 are not human according to the second monitoring image.

And S61, if so, controlling the article transportation platform 42 to completely descend at the position of the transportation channel 41 and controlling the article transportation mechanism 44 arranged at the bottom end position of the transportation channel 41 to push the article above the article transportation platform 42 which is completely descended to the position of the crawler 45 at the side.

Specifically, after the information analysis module 57 analyzes that there is an article placed above the article transportation platform 42, the article transportation module 66 included in the server 5 controls the second lifting roller driven by the second driving motor inside the article transportation platform 42 to completely lower the article transportation platform 42 at the track position of the transportation channel 41, and after the article transportation platform 42 is completely lowered, the upper surface of the article transportation platform 42 and the upper surface of the transportation crawler are located on the same horizontal plane; then article transport module 67 control that server 5 contained set up in the article transport platform 42 top article propelling movement to the transportation track surface position of transportation passageway 41 side is stretched out to the third propelling movement board that the hydraulic stem drive that the hydraulic pump drive of the inside position of transportation passageway 41 side is connected, and after the article propelling movement of article transport platform 42 position was accomplished to the transportation track surface position, article transport module 67 control the hydraulic stem that the hydraulic pump drive is connected will the third propelling movement board contracts completely, then article transport module 66 control the second lift roller that the drive of second driving motor is connected rises article transport platform 42 at the track position of transportation passageway 41 completely.

And S62, controlling the crawler 45 to start to transport the item to the transport box 48 at the tail end position of the crawler 45 and binding the item with the virtual reality device 2.

Specifically, after the article pushing at the article transportation platform 42 is completed to the surface position of the transportation crawler, the crawler conveying module 68 of the server 5 controls the transportation crawler connected to the third driving motor inside the transportation layer at the side of the transportation channel 41 to drive the article to be transported to the article placement cavity of the transportation box 48 at the tail end position of the transportation crawler, and meanwhile, the information binding module 54 binds the article with the virtual reality device 2.

and S63, acquiring address information matched with the virtual reality device 2 and planning the flight route of the transportation unmanned aerial vehicle 46 according to the address information and the supermarket address information.

Specifically, after the transportation crawler transports the article to the article placement cavity of the transportation box 48, the address obtaining module 69 included in the server 5 obtains address information recorded when the virtual reality device 2 is registered, and transmits the address information to the route planning module 71, and the route planning module 71 included in the server 5 plans the flight route of the transportation unmanned aerial vehicle 46 according to the address information and the address information of the supermarket selected by the user; the supermarkets selectable by the user are all supermarkets recorded in the server 5, and the intelligent shopping carts 1 are arranged in the supermarkets.

S64, controlling the transportation unmanned aerial vehicle 46 arranged at the top position of the tail end of the crawler 45 to start and controlling the transportation unmanned aerial vehicle 46 to descend to the position of the transportation box 48 and be connected with the top of the transportation box 48 through the connecting mechanism 47 below.

Concretely, after route planning module 71 finishes the flight route planning of transporting unmanned aerial vehicle 46, unmanned aerial vehicle control module 70 control that server 5 contained sets up in the transportation unmanned aerial vehicle 46 of transportation track tail end top position and starts, and transportation unmanned aerial vehicle 46 starts the back, and the unmanned aerial vehicle camera starts the environment image around shooting unmanned aerial vehicle in real time, starts the back at transportation unmanned aerial vehicle 46, unmanned aerial vehicle control module 70 is according to the image control that the unmanned aerial vehicle camera shot transport unmanned aerial vehicle 46 descends to transport box 48 position and will connect the base and contradict with transport box 48's top, then unmanned aerial vehicle control module 70 control the electro-magnet of connecting the base below start with transport box 48's connection iron plate carries out the electromagnetic absorption.

S65, transmitting the flight path to the transport drone 46, controlling the transport drone 46 to suspend the transport box 48 with the connection mechanism 47 to the destination location of the flight path.

Specifically, after the transportation unmanned aerial vehicle 46 is electromagnetically attached to the transportation box 48 through the connection mechanism 47, the route planning module 71 transmits the planned flight route to the transportation unmanned aerial vehicle 46, then the unmanned aerial vehicle control module 70 controls the transportation unmanned aerial vehicle 46 to suspend the transportation box 48 by using the connection mechanism 47 to the destination position of the flight route according to the image captured by the unmanned aerial vehicle camera and the flight route, after the transportation unmanned aerial vehicle 46 reaches the destination position, the information analysis module 57 analyzes whether a user consistent with the user information recorded during registration of the virtual reality device 2 arrives according to the environmental image captured by the unmanned aerial vehicle camera in real time, if so, the unmanned aerial vehicle control module 70 controls the electromagnet to demagnetize and analyzes whether the user has an object inside the transportation box 48 according to the environmental image captured by the unmanned aerial vehicle camera, and put transport box 48 of vacant back and connect base below position, if then unmanned aerial vehicle control module 70 control the electro-magnet starts to get into the electromagnetic adsorption state, at the electro-magnet with transport box 48's the connection iron plate electromagnetic adsorption accomplishes the back, unmanned aerial vehicle control module 70 is according to environment image and flight route control that the unmanned aerial vehicle camera shot transport unmanned aerial vehicle 46 utilizes coupling mechanism 47 to suspend in midair transport box 48 returns transport track tail end position and place transport box 48 in transport track tail end, then transport unmanned aerial vehicle 46 returns to transport track tail end top and stops.

EXAMPLE III

As shown with reference to fig. 5-6.

Specifically, this embodiment is substantially the same as the first embodiment, except that in this embodiment, after S3, the method further includes the following steps:

s30, if the situation that the user takes the goods at the virtual supermarket shelf position is analyzed, the information of the goods which are contained in the supermarket database and matched with the goods is obtained, and the information of the goods is virtually displayed at the position around the goods at the virtual supermarket shelf position taken by the user.

Specifically, after the information analysis module 57 analyzes that the user has an article at the virtual supermarket shelf location taken by the user according to the real-time user virtual movement information, the information acquisition module 76 included in the server 5 acquires article information, which is included in a supermarket database connected to the server 5 and is matched with the article virtually taken by the user, and transmits the article information to the information display module 77, the information display module 77 included in the server 5 virtually displays the article information at a position around the article at the virtual supermarket shelf location taken by the user, and the surrounding position is a position convenient for the user to view.

And S31, analyzing whether the user puts the virtually taken articles into the intelligent shopping cart 1 according to the real-time user virtual movement information.

Specifically, while the information display module 77 displays the information of the articles, the information analysis module 57 analyzes whether the user has to place the articles virtually taken into the storage cavity 11 of the intelligent shopping cart 1 according to the real-time virtual movement information of the user.

And S32, if yes, transmitting the item information to a goods picking mechanism 40 which is arranged inside the supermarket and matched with the item information, calculating the price of the item according to all the item information in the intelligent shopping cart 1, and virtually displaying the calculated price of the item at the position of a shopping cart handrail of the virtual hand push of the user.

Specifically, after the information analysis module 57 analyzes that the user has placed the item to be virtually taken in the storage cavity 11 of the intelligent shopping cart 1, the information transmission module 78 included in the server 5 transmits the item information acquired by the information acquisition module 76 to the goods taking mechanism 40 in the supermarket, which is matched with the item information, and transmits the item information to the price calculation module 79, the price calculation module 79 included in the server 5 receives the item information, calculates the price of the item according to all the received item information, and after the calculation is completed, virtually displays the calculated item price at the armrest position of the shopping cart virtually pushed by the user in the supermarket virtual scene, so that the user can view the purchased item and the price corresponding to the item in real time.

Example four

As shown with reference to fig. 6-12.

Specifically, the embodiment provides an intelligent supermarket shopping system based on virtual reality and cloud computing, and the intelligent supermarket shopping method based on virtual reality and cloud computing is used, and comprises an intelligent shopping cart 1, virtual reality equipment 2, a monitoring device 3, a conveying device 4, a supermarket database and a server 5, wherein the intelligent shopping cart 1 comprises a shopping cart body 10, a storage cavity 11 and an article pushing mechanism 12, and the shopping cart body 10 is placed in a supermarket; the storage cavity 11 is arranged at the position of the shopping cart body 10 and used for storing objects; the article pushing mechanism 12 is arranged in the storage cavity 11 and used for pushing the articles in the storage cavity 11 to the cash collecting position after being lifted;

the virtual reality device 2 comprises a device body 20 and a projection device 21, wherein the projection device 21 is arranged at an external position of the device body 20 and is used for projecting two-dimensional code information;

the monitoring device 3 comprises a first monitoring camera 30 and a second monitoring camera 31, wherein the first monitoring camera 30 is arranged at the outer position of the shopping cart body 10 and is used for shooting the environmental image around the shopping cart body 10; the second monitoring camera 31 is arranged at the top end position inside the supermarket and is used for shooting an environment image inside the supermarket;

the conveying device 4 comprises a goods lifting mechanism 40, a conveying channel 41, an article conveying platform 42, a weighing sensor 43, an article conveying mechanism 44, a crawler mechanism 45, a conveying unmanned aerial vehicle 46, a connecting mechanism 47 and a conveying box 48, wherein the goods lifting mechanism 40 is arranged at a shelf position of a supermarket and used for pushing and dropping articles at the shelf position of the supermarket into the storage cavity 11 of the shopping cart body 10; the transportation channel 41 is arranged at a cash register position of a supermarket and used for lifting the article transportation platform 42; the article transport platform 42 is located at the position of the transport passage 41 for transporting the article; the weighing sensor 43 is arranged above the article transportation platform 42 and used for acquiring weight information above the article transportation platform 42; the article transportation mechanism 44 is arranged at the side position of the bottom of the transportation channel 41 and used for pushing the articles above the article transportation platform 42 to the upper part of the crawler belt mechanism 45; the upper part of the crawler 45 is arranged at the side position of the bottom of the transportation channel 41 and is used for transporting the articles pushed by the article transportation mechanism 44; the transportation unmanned aerial vehicle 46 is arranged at the top of the tail end of the crawler 45 and used for transporting articles to a specified position; the connecting mechanism 47 is arranged below the transportation unmanned aerial vehicle 46 and is used for being connected with the transportation box 48; the transport box 48 is positioned at the tail end of the crawler 45 and is used for placing the articles transported by the crawler 45;

the server 5 is arranged at the position where the server 5 is placed and planned by the master control center; the server 5 includes:

the wireless module 50 is used for being respectively in wireless connection with the shopping cart body 10, the article pushing mechanism 12, the first monitoring camera 30, the second monitoring camera 31, the goods lifting mechanism 40, the article transportation platform 42, the weighing sensor 43, the article transportation mechanism 44, the crawler mechanism 45, the transportation unmanned aerial vehicle 46, the connecting mechanism 47, the supermarket database, the supermarket management center, the virtual reality device 2 registered by the user, the master control center and the network;

an information receiving module 51, configured to receive information and/or instructions and/or requests;

an information extraction module 52, configured to extract information and/or instructions and/or requests included in the specific information;

a shopping control module 53 for controlling the intelligent shopping cart 1 to execute the set operation according to the set steps;

an information binding module 54 for binding a specified object with another specified object;

a first shooting module 55, configured to control the first monitoring camera 30 to start or close;

the virtual obtaining module 56 is configured to obtain, in real time, user virtual operation information fed back by the virtual reality device 2;

an information analysis module 57, configured to perform information processing and analysis according to the specified information;

a virtual extraction module 58, configured to extract information of an item virtually taken by a user through the virtual reality device 2;

a pickup control module 59 for controlling the pickup mechanism 40 to perform a set operation according to the set steps;

an article pushing module 60, configured to control the article pushing mechanism 12 to perform a set operation according to a set step;

the cash register acquisition module 61 is used for acquiring the information of the articles calculated by the cash register device in real time;

the two-dimensional code generating module 62 is used for generating a collection two-dimensional code of the matched amount according to the specified article information;

the projection control module 63 is used for controlling the projection device 21 to project the two-dimensional payment code to a specified area;

and the reminding module 64 is used for controlling the virtual reality device 2 to prompt the designated information.

As a preferred embodiment of the present invention, the server 5 further includes:

a weighing control module 65 for controlling the weighing sensor 43 to be turned on or off;

an article transport module 66 for controlling the article transport platform 42 to ascend and descend;

an article transport module 67 for controlling the article transport mechanism 44 to perform the set operation according to the set steps;

and a track conveying module 68 for controlling the track mechanism 45 to be started or closed.

an address obtaining module 69, configured to obtain address information matched with the virtual reality device 2;

the unmanned aerial vehicle control module 70 is used for controlling the transportation unmanned aerial vehicle 46 to execute the set operation according to the set steps;

the route planning module 71 is configured to plan a flight route according to the address information of the virtual reality device 2 and the address information of the supermarket;

and a connection control module 72 for controlling the connection mechanism 47 to perform the set operation according to the set steps.

a second capturing module 73, configured to control the second monitoring camera 31 to start or close;

the coordinate acquisition module 74 is configured to acquire real-time human body images and human body space coordinate data in the supermarket according to the images captured by the second monitoring camera 31;

and the virtual reality module 75 is configured to generate a corresponding human body virtual reality image according to the real-time human body image and the human body space coordinate data, and transmit the human body virtual reality image to the virtual reality device 2 in real time.

an information acquisition module 76, configured to acquire item information included in a supermarket database;

the information display module 77 is used for virtually displaying the article information at the position around the article at the position where the user virtually takes the supermarket shelf;

an information transmission module 78 for transmitting the designation information to the designation object;

and the price calculating module 79 is used for calculating the price of the articles according to the information of all the articles in the intelligent shopping cart 1 and virtually displaying the calculated price of the articles at the position of the armrest of the intelligent shopping cart 1 pushed by the user in a virtual mode.

The shopping cart comprises a shopping cart body 10, a movable motor and a movable universal wheel, wherein the movable motor is arranged at the inner position below the shopping cart body 10, is connected with the movable universal wheel and is used for driving the connected movable universal wheel to run; the movable universal wheel is arranged below the shopping cart body 10 and connected with a movable motor for driving the shopping cart body 10 to move.

The article pushing mechanism 12 comprises a lifting rail, a lifting platform, a first driving motor, a first lifting roller, a first telescopic motor, a first telescopic rod and a first pushing plate, wherein the lifting rail is arranged on the inner wall of the storage cavity 11 and used for providing movement for the first lifting roller; the lifting platform is positioned in the storage cavity 11 and used for lifting in the storage cavity 11; the first driving motor is arranged at the inner position of the lifting platform, is connected with the first lifting roller and is used for driving the connected first lifting roller to run; the first lifting roller is arranged at the side position of the lifting platform and used for moving at the position of the lifting track; the first telescopic motor is arranged at the side position of the lifting platform, is connected with the first telescopic rod and is used for driving the connected first telescopic rod to stretch; the first telescopic rod is respectively connected with the first pushing plate and the first telescopic motor and is used for driving the connected first pushing plate to stretch; the top of the shopping cart body 10 and the surface of the cashier desk are positioned on the same horizontal plane.

The goods lifting mechanism 40 comprises a second telescopic motor, a first telescopic plate, a third telescopic motor, a second telescopic rod and a second pushing plate, wherein the second telescopic motor is arranged at the front end of an article placing area of a supermarket shelf, is connected with the first telescopic plate and is used for driving the connected first telescopic plate to stretch; the first expansion plate is arranged at the front end of the article placing area and used for separating articles placed in the article placing area after extending out; the third telescopic motor is arranged at the tail end of the article placing area, is connected with the second telescopic rod and is used for driving the connected second telescopic rod to stretch; the second telescopic rods are respectively connected with the second pushing plates and are used for driving the connected second pushing plates to stretch; the second pushing plate is arranged at the tail end position of the article placing area and used for pushing the articles placed in the article placing area forwards.

Wherein, a track for providing the movement of the second lifting roller is arranged in the transportation channel 41; the article transportation platform 42 is provided with a second driving motor and a second lifting roller, and the second driving motor is arranged at the inner position of the side of the article transportation platform 42, connected with the second lifting roller and used for driving the connected second lifting roller to run; the second lifting roller is disposed at a side position of the article transportation platform 42, and is used for driving the article transportation platform 42 to move at a track position of the transportation channel 41.

The article transportation mechanism 44 comprises a hydraulic pump, a hydraulic rod and a third pushing plate, wherein the hydraulic pump is arranged at the inner position of the side of the bottom of the transportation channel 41, is connected with the hydraulic rod and is used for driving the connected hydraulic rod to stretch; the hydraulic rod is respectively connected with the hydraulic pump and the third pushing plate and is used for driving the connected third pushing plate to stretch; the third pushing plate is arranged at the front end of the hydraulic rod and used for pushing the object placed above the object transportation platform 42 after the object is descended to the surface of the transportation crawler on the other side of the transportation channel 41.

The crawler belt mechanism 45 comprises a transportation layer, a third driving motor and a transportation crawler belt, wherein the transportation layer is arranged at the ground position on the other side of the transportation barrel; the third driving motor is arranged at the inner position of the transportation layer, is connected with the transportation crawler and is used for driving the connected transportation crawler to run; the transportation crawler is arranged above the transportation layer and used for transporting the articles pushed by the third pushing plate into the transportation box 48 at the tail end.

The connecting mechanism 47 comprises a connecting base and an electromagnet, wherein the connecting base is arranged below the transport unmanned aerial vehicle 46, is connected with the electromagnet and is used for abutting against the upper part of the transport box 48; the electromagnet is arranged below the connecting base and is used for abutting against and electromagnetically adsorbing a connecting iron block of the transport box 48; an unmanned aerial vehicle camera is arranged outside the transportation unmanned aerial vehicle 46 and captures an environmental image around the transportation unmanned aerial vehicle 46 in real time; the inside positioning module that is provided with of transportation unmanned aerial vehicle 46, positioning module is used for acquireing transportation unmanned aerial vehicle 46's positional data in real time.

Wherein, shopping cart body 10 and transportation unmanned aerial vehicle 46 are inside all to be provided with the battery of supply electric power.

A connecting iron block is arranged above the transport box 48 and is used for being connected with an electromagnet; the transport box 48 is also provided with an article placing cavity, and the article placing cavity is arranged above the transport box 48 and used for storing the packaged articles transported by the transport crawler.

It should be understood that, in the fourth embodiment, the specific implementation process of each module described above may correspond to the description of the above method embodiments (the first to the third embodiments), and is not described in detail here.

The system provided in the fourth embodiment is only illustrated by dividing the functional modules, and in practical applications, the above-mentioned functions may be distributed by different functional modules according to needs, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above.

The above embodiments are merely illustrative of the technical ideas and features of the present invention, and are intended to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.

Claims

1. An intelligent supermarket shopping method based on virtual reality and cloud computing is characterized by comprising the following steps:

2. The intelligent supermarket shopping method based on virtual reality and cloud computing of claim 1, wherein after S6, the method further comprises the following steps:

3. The intelligent supermarket shopping method based on virtual reality and cloud computing of claim 2, wherein after S62, the method further comprises the following steps:

4. The intelligent supermarket shopping method based on virtual reality and cloud computing of claim 1, wherein after S1, the method further comprises the following steps:

5. The intelligent supermarket shopping method based on virtual reality and cloud computing of claim 1, wherein after S3, the method further comprises the following steps:

6. An intelligent supermarket shopping system based on virtual reality and cloud computing, wherein the intelligent supermarket shopping method based on virtual reality and cloud computing as claimed in any one of claims 1 to 5 comprises an intelligent shopping cart, virtual reality equipment, a monitoring device, a conveying device, a supermarket database and a server, and is characterized in that the intelligent shopping cart comprises a shopping cart body, a storage cavity and an article pushing mechanism, and the shopping cart body is placed in a supermarket; the storage cavity is arranged at the position of the shopping cart body and used for storing objects; the article pushing mechanism is arranged in the storage cavity and used for pushing the articles in the storage cavity to the cash collecting position after being lifted;

7. The intelligent supermarket shopping system based on virtual reality and cloud computing of claim 6, wherein the server further comprises:

8. The intelligent supermarket shopping system based on virtual reality and cloud computing of claim 6, wherein the server further comprises:

9. The intelligent supermarket shopping system based on virtual reality and cloud computing of claim 6, wherein the server further comprises:

10. The intelligent supermarket shopping system based on virtual reality and cloud computing of claim 6, wherein the server further comprises: