Online mall system based on augmented virtual reality and working method thereof
Technical Field
The invention relates to the field of online shopping malls, in particular to an online shopping mall system based on augmented virtual reality and a working method thereof.
Background
Due to the continuous upgrading of the consumption level of people, the scale of the shopping mall is large, hundreds of shops are resident in the large shopping mall, users cannot clearly determine the positions of the needed commodities, a large amount of time is wasted due to the fact that the users need to pocket and turn in the shopping mall even if the users know the positions, and the users with poor direction feel are prone to getting lost in the shopping mall.
In addition, a typical mall includes hot stores, and when the hot stores are crowded with people, the users who come later cannot enjoy the service in time and may be required to wait for a long time.
Disclosure of Invention
The purpose of the invention is as follows: in order to overcome the defects in the background art, the embodiment of the invention provides an online mall system based on augmented virtual reality and a working method thereof, which can effectively solve the problems related to the background art.
The technical scheme is as follows:
an online shopping mall system based on augmented virtual reality comprises a walking mechanism, a display mechanism, a delivery mechanism and a control mechanism, wherein the control mechanism comprises a processing module, a driving module and a storage module, the processing module is respectively connected with the driving module and the storage module, commodity information sold in a shopping mall and a virtual structure inside the shopping mall are stored in the storage module, the commodity information comprises commodity price and inventory quantity, and the virtual structure comprises the positions of all commodities;
the online shopping mall comprises an entity warehouse built under the line and shopping single rooms communicated with the warehouse, the walking mechanism is arranged in each independent single room and comprises a walking belt, a sound receiving module and a speed detection module, the walking belt is connected with the driving module and used for simulating the walking of a user in the mall, the sound receiving module and the speed detection module are connected with the processing module, the sound receiving module is used for receiving a sound instruction of the user and sending the sound instruction to the processing module, and the speed detection module is used for detecting the movement speed of the user and sending the movement speed to the processing module;
the display mechanism is arranged on the left wall and the right wall of the single room, is connected with the processing module and is used for simulating a virtual structure inside the mall and the virtual form of the commodity;
the goods delivery mechanism intercommunication the warehouse with the area of walking, and include first goods delivery area, letter sorting module and lead to the second goods delivery area between each list, first goods delivery area, letter sorting module and second goods delivery area respectively with drive module connects, first goods delivery area transports commodity from the warehouse extremely the letter sorting module, letter sorting module will again on the commodity letter sorting is delivered to the second that corresponds takes, the second goods delivery area transports commodity again to rather than the area of walking that communicates with on.
As a preferable mode of the present invention, the delivery mechanism further includes a packing module, and the packing module is connected to the driving module and is configured to pack the commodities on the sorting module.
As a preferable mode of the present invention, the display mechanism includes an eye tracker module, and the eye tracker module is connected to the processing module and configured to detect an eye movement trajectory of the user and send the eye movement trajectory to the processing module.
As a preferable mode of the present invention, the delivery mechanism further includes a storage chamber, the storage chamber is configured to recycle goods returned by a user, and the goods information of the returned goods is separately stored in the storage module.
As a preferable mode of the present invention, the walking mechanism further includes a sound playing module, and the sound playing module is connected to the processing module and is configured to solve the problem of the user.
A working method of an online shopping mall system based on augmented virtual reality comprises the following working steps:
when a user enters a single room, the processing module outputs a virtual structure inside the mall to the user through the display mechanism;
the voice receiving module receives a voice instruction of a user and sends the voice instruction to the processing module;
the processing module judges whether the sound instruction comprises a commodity category or a commodity name;
if so, the processing module extracts the position of the commodity category or the name in the virtual structure and outputs the position to a user through the display mechanism;
the speed detection module detects the movement speed of the user relative to the walking belt and sends the movement speed to the processing module;
the processing module outputs a first walking signal to the driving module, and the driving module drives the walking belt to reversely run at the movement speed;
the processing module controls a virtual structure in the display mechanism to translate back at the motion speed;
the processing module extracts commodities selected by a user according to the sound receiving module and outputs a first goods conveying signal to the driving module, and the driving module drives the first goods conveying belt to convey the commodities to the sorting module;
the processing module extracts a second goods conveying belt corresponding to the walking belt and outputs a sorting signal to the driving module, and the driving module drives the sorting module to sort the goods onto the second goods conveying belt;
the processing module outputs a second goods conveying signal to the driving module, and the driving module drives the second goods conveying belt to convey the goods to the walking belt.
As a preferred embodiment of the present invention, the present invention further comprises:
when the commodities are transferred to the sorting module, the processing module outputs packing signals to the driving module, and the driving module drives the packing module to pack the commodities on the sorting module.
As a preferred embodiment of the present invention, the present invention further comprises:
the eye tracker module detects an eye movement track of a user and sends the eye movement track to the processing module;
the processing module extracts a virtual commodity watched by the user in the display mechanism according to the eye movement track;
the processing module calculates the time when the user gazes at the virtual commodity;
judging whether the time is greater than or equal to a preset time or not;
if yes, the processing module displays the virtual commodity in the display mechanism in an amplifying mode, extracts commodity information of the virtual commodity and outputs the commodity information to a user.
As a preferred embodiment of the present invention, the present invention further comprises:
when the goods are transported to the walking belt, the user selects all or part of the goods to pay, and the goods which are not selected by the user stay on the walking belt;
when a user walks down the walking belt, the processing module outputs a first walking signal to the driving module, and the driving module drives the walking belt to run reversely;
when the walking belt transfers the commodities on the walking belt to the sorting module, the processing module outputs a storage signal to the driving module, and the driving module drives the sorting module to sort the commodities into the storage bin;
when the next user shops, if the selected commodity exists in the storage bin, the commodity in the storage bin is preferentially conveyed to the user.
As a preferred aspect of the present invention, the receiving module receives a voice command from a user and sends the voice command to the processing module, further comprising:
the processing module judges whether the sound instruction comprises a preset sentence pattern and a commodity category or name, wherein the preset sentence pattern is a question sentence;
if yes, the processing module combines the preset sentence pattern and the commodity category or name to calculate an answer and outputs the answer to the user through a sound playing module.
The invention realizes the following beneficial effects:
1. the shopping mall is converted into the virtual structure based on the augmented virtual reality technology, when a user walks in a single room, the virtual structure is output to the user through the display mechanism, the walking belt and the user move in opposite directions and at the same speed, and the virtual structure in the display mechanism and the walking belt move in the same direction, so that the effect of shopping the mall can be simulated only by walking in situ on the walking belt.
2. When a user browses commodities in a virtual structure in the display mechanism, the user can purchase the commodities under the voice control, and the goods delivery mechanism automatically delivers the commodities to the corresponding walking belt; if the end user selects to abandon part or all of the commodities, the walking belt reversely conveys the abandoned commodities back to the sorting module, the sorting module sorts the commodities to the storage cavity, and if the commodities selected by the subsequent user are located in the storage cavity, the sorting module preferentially conveys the commodities in the storage cavity to the user.
3. The user can further know commodity information by wearing the eye tracker module, the processing module enables the eye movement track detected by the eye tracker module to correspond to the virtual commodity in the virtual structure of the display mechanism, if the eye movement track corresponds to the virtual commodity, the user is shown to watch the virtual commodity, and more detailed service can be provided for the user according to the characteristic.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
Fig. 1 is a schematic structural diagram of an online mall system based on augmented virtual reality provided by the present invention.
Fig. 2 is a schematic structural diagram of a sorting module provided by the present invention.
Fig. 3 is a schematic diagram of the connection of the processing modules provided in the present invention.
Fig. 4 is a flow chart of a working method of the online mall system based on the augmented virtual reality provided by the present invention.
Fig. 5 is a flowchart of a method for operating the eye tracker module according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.
Example one
As shown in fig. 1-3, this embodiment provides an online shopping mall system based on augmented virtual reality, including walking mechanism, display mechanism, delivery mechanism and control mechanism, control mechanism includes processing module 1, drive module 2 and storage module 3, processing module 1 respectively with drive module 2 and storage module 3 is connected, storage module 3 is stored with the commodity information and the inside virtual structure in shopping mall that are selling in the shopping mall, the commodity information includes commodity price and stock quantity, the virtual structure includes the position of each commodity.
On-line shopping mall including build in off-line entity warehouse 4 and with 5 between the shopping list of warehouse 4 intercommunication, walking mechanism sets up in 5 between each independent list, and including walking area 6, sound receiving module 7, speed detection module 8, walk area 6 with drive module 2 connects for the walking of simulation user in the shopping mall, sound receiving module 7 and speed detection module 8 with processing module 1 connects, sound receiving module 7 is used for receiving user's voice command and sends it for processing module 1, speed detection module 8 is used for detecting user's movement speed and sends it for processing module 1.
The display mechanism is arranged on the left wall and the right wall of the single room 5, is connected with the processing module 1 and is used for simulating a virtual structure inside the mall and a virtual form of a commodity.
The goods conveying mechanism communicates the warehouse 4 with the walking belt 6, and include first goods conveying belt 9, letter sorting module 10 and lead to the second goods conveying belt 11 between each list 5, first goods conveying belt 9, letter sorting module 10 and second goods conveying belt 11 respectively with drive module 2 connects, first goods conveying belt 9 transports commodity from warehouse 4 extremely letter sorting module 10, letter sorting module 10 will again on commodity letter sorting to the second that corresponds send the goods belt 11, the second send the goods belt 11 to transport commodity to rather than communicating walking belt 6 again.
The delivery mechanism further comprises a packing module 12, and the packing module 12 is connected with the driving module 2 and used for packing the commodities on the sorting module 10.
The display mechanism comprises an eye tracker module 13, and the eye tracker module 13 is connected with the processing module 1 and used for detecting the eye movement track of the user and sending the eye movement track to the processing module 1.
The goods delivering mechanism further comprises a storage cavity 14, the storage cavity 14 is used for recovering goods returned by the user, and the goods information of the returned goods is separately stored in the storage module 3.
The walking mechanism further comprises a sound playing module 15, wherein the sound playing module 15 is connected with the processing module 1 and used for solving the problem of the user.
Specifically, this embodiment provides an online shopping mall system based on augmented virtual reality includes warehouse 4, single 5, walking mechanism, display mechanism, delivery mechanism and control mechanism, control mechanism includes processing module 1, drive module 2 and storage module 3, walking mechanism is including walking area 6, sound receiving module 7, speed detection module 8 and sound play module 15, display mechanism includes eye tracker module 13, delivery mechanism includes first delivery area 9, letter sorting module 10, second delivery area 11, packing module 12 and storing chamber 14.
The warehouse 4 can be built on the ground or underground, or shared with warehouses 4 of other supermarkets or malls, the single room 5 comprises a first port and a second port, the first port is communicated with the warehouse 4, the second port is communicated with the outside, an electric door body is arranged on the second port, the electric door body is connected with the driving module 2, a first camera module is arranged outside the second port, a second camera module is arranged inside the second port, the first camera module and the second camera module are respectively connected with the processing module 1, when the first camera module detects that a user stands in front of the electric door body, the processing module 1 controls the electric door body to be opened through the driving module 2, when the user enters the single room 5, the processing module 1 controls the electric door body to be closed through the driving module 2, the second camera module may monitor the user's behavior within the booth 5.
The sound insulation material is arranged between the single compartments 5, so that sound insulation can be fully realized.
The walking belt 6 is arranged in a straight line, one end of the walking belt is communicated with the first port, the other end of the walking belt is communicated with the second port, the running direction of the walking belt 6 is opposite to the walking direction of the user, the speed is the same, and after the user confirms that shopping is finished, the walking belt 6 stops running no matter whether the user stands on the walking belt 6 or not until the user walks down the walking belt 6.
The user can freely adjust the running speed of the walking belt 6 by sending out voice commands including "acceleration" or "deceleration", and when the processing module 1 receives the voice commands, the speed of the walking belt 6 is adjusted through the driving module 2.
The speed detection module 8 is arranged on the side surface of the single room 5 or the back surface of the door body and is straight for users.
The display mechanism at least comprises displays arranged on the left wall and the right wall of the single room 5, the displays can be additionally arranged below the walking belt 6 or on the top plate of the single room 5, the display content on the display mechanism is controlled by the processing module 1, and when a user walks, the display content is correspondingly changed.
The eye tracker module 13 is divided into a head-mounted type and a fixed type, taking the head-mounted type eye tracker as an example, when a user enters the booth 5, the user can obtain one head-mounted type eye tracker at the entrance, after the user wears the head-mounted type eye tracker, the eye tracker can obtain the eye movement track of the user, and the processing module 1 can obtain the virtual commodity watched by combining the eye movement track and the virtual content on the display mechanism.
First goods area 9 and the second of sending are sent the area 11 and are all had two-way function of transporting, and a first goods area 9 and a plurality of single 5 establishments corresponding relation, a second goods area 11 of sending only with a single 5 establishments corresponding relation, letter sorting module 10 includes an operation panel, the inside of operation panel is cavity, the storage chamber is located promptly in the operation panel, the commodity that the user returned can be deposited temporarily in it, the top of operation panel sets up to packing module 12, packing module 12 embeds there is the seal bag for separate aquatic products and dry goods.
Example two
As shown in fig. 1 to 4, this embodiment provides a working method of an online mall system based on augmented virtual reality, which includes the following working steps:
s101: when the user enters the booth 5, the processing module 1 outputs the virtual structure inside the mall to the user through the display mechanism.
S102: the sound receiving module 7 receives a sound instruction of a user and sends the sound instruction to the processing module 1.
S103: the processing module 1 determines whether the sound instruction includes a commodity category or a name.
S104: if yes, the processing module 1 extracts the position of the commodity category or the name in the virtual structure and outputs the position to the user through the display mechanism.
S105: the speed detection module 8 detects the speed of movement of the user relative to the walking belt 6 and sends it to the processing module 1.
S106: the processing module 1 outputs a first walking signal to the driving module 2, and the driving module 2 drives the walking belt 6 to reversely run at the movement speed.
S107: the processing module 1 controls the virtual structure in the display mechanism to translate back at the movement speed.
S108: the processing module 1 extracts the commodities selected by the user according to the sound receiving module 7, outputs a first goods conveying signal to the driving module 2, and the driving module 2 drives the first goods conveying belt 9 to convey the commodities to the sorting module 10.
S109: the processing module 1 extracts a second goods conveying belt 11 corresponding to the walking belt 6 and outputs a sorting signal to the driving module 2, and the driving module 2 drives the sorting module 10 to sort the goods onto the second goods conveying belt 11.
S110: the processing module 1 outputs a second goods conveying signal to the driving module 2, and the driving module 2 drives the second goods conveying belt 11 to convey the goods to the walking belt 6.
When the goods are transferred to the sorting module 10, the processing module 1 outputs a packing signal to the driving module 2, and the driving module 2 drives the packing module 12 to pack the goods on the sorting module 10.
When the goods are transported onto the walking belt 6, the user selects all or a part of the goods to be paid for, and the goods not selected by the user stay on the walking belt 6.
When a user walks down the walking belt 6, the processing module 1 outputs a first walking signal to the driving module 2, and the driving module 2 drives the walking belt 6 to run reversely.
When the walking belt 6 transfers the commodities on the walking belt to the sorting module 10, the processing module 1 outputs a receiving signal to the driving module 2, and the driving module 2 drives the sorting module 10 to sort the commodities into the storage bin.
When the next user shops, if the selected commodity exists in the storage bin, the commodity in the storage bin is preferentially conveyed to the user.
The voice receiving module 7 receives a voice command of a user and sends the voice command to the processing module 1, and further includes:
the processing module 1 judges whether the sound instruction includes a preset sentence pattern and a commodity category or name, wherein the preset sentence pattern is an interrogative sentence.
If yes, the processing module 1 calculates an answer by combining the preset sentence pattern and the commodity category or name and outputs the answer to the user through the sound playing module 15.
Specifically, in S101, if there is no user in the single room 5, the display mechanism is in a standby state, and does not display any content, only when the user enters the single room 5, the processing module 1 controls the display mechanism to start, and the display mechanism defaults to display a virtual structure at an entrance of the mall, so as to simulate an environment where the user enters the mall.
In S102, the user can follow the shopping mall by ordinary shopping, or directly switch the scenes.
The user can switch the scene by voice control, for example, utter a voice command including the name of the shop, the category or the name of the goods, and the voice receiving module 7 sends the voice command to the processing module 1.
In S103, the processing module 1 automatically recognizes the voice command, and determines whether the store name, the commodity category, or the name is included in the voice command.
In S104, if yes, the processing module 1 extracts a position in the virtual structure of the mall that best meets the sound instruction from the online mall, and replaces the virtual structure at the entrance with the virtual structure at the position in the display mechanism, so that the user can directly "visit the mall" from the position.
In S105, when the user walks on the walking belt 6, the speed detection module 8 may detect the movement speed of the user and send the movement speed to the processing module 1.
In S106, the processing module 1 controls the walking belt 6 to run in the reverse direction at the movement speed through the driving module 2, that is, the walking belt 6 and the user do movements in the opposite direction and at the same speed, so as to ensure that the user always walks in place.
In S107, the processing module 1 controls the virtual structure in the display mechanism to also be translated and reversed at the movement speed, that is, the virtual structure in the display mechanism and the walking belt 6 do the same movement, when the virtual structure is translated and reversed, the structure in the display mechanism is replaced by the structure in front of the virtual structure, and the user can simulate the effect of walking in a mall while walking in place.
In S108, the user may purchase the goods under voice control, the processing module 1 automatically identifies the purchase information in the voice command, extracts the goods purchased by the user, and then after the user confirms that the goods are purchased, the processing module 1 controls the first goods conveying belt 9 through the driving module 2 to transfer the goods selected by the user from the warehouse 4 to the sorting module 10.
When a user selects commodities, detailed commodity information or other information can be inquired through voice control, and the processing module 1 can intelligently reply through the voice playing module 15 according to voice instructions of the user.
When the goods arrive at the sorting module 10, the processing module 1 controls the packing module 12 through the driving module 2 to sort and pack the goods on the sorting module 10, for example, separately pack aquatic goods and dry goods, and separately pack edible goods and industrial goods.
In S109, the processing module 1 extracts the walking belt 6 where the user who wants to purchase the product is located and the second delivery belt 11 communicated with the walking belt 6, and the processing module 1 controls the sorting module 10 to sort the product onto the second delivery belt 11 through the driving module 2.
In S110, the processing module 1 controls the second goods conveying belt 11 to convey the goods to the walking belt 6 communicated with the second goods conveying belt through the driving module 2, when the goods arrive on the walking belt 6, the processing module 1 controls the walking belt 6 to stop running through the driving module 2, the user can walk forward to obtain the goods and complete payment according to payment information on the goods, the payment information includes a two-dimensional code, and when the user leaves the booth 5, the display mechanism is closed.
In this step, when the goods arrive on the walking belt 6, the user can choose to abandon part of the goods, if the user chooses to abandon, the abandoned goods are picked out and placed on the walking belt 6, the rest of the goods can leave the booth 5 after payment is finished, when the user walks down the walking belt 6, the processing module 1 controls the walking belt 6 to run in reverse through the driving module 2, namely, the goods on the walking belt are transferred to the sorting module 10 again, and the processing module 1 controls the sorting module 10 to sort the goods into the storage chamber 14 through the driving module 2.
When the next user shops, the processing module 1 determines whether the commodity selected by the user exists in the storage cavity 14, and if so, the commodity in the storage cavity 14 is delivered to the user through the driving module 2.
A sorting robot may be provided in the warehouse 4 to transport the goods.
EXAMPLE III
As shown in fig. 1 to 5, in the present embodiment, a commodity information display method is provided, and an eye tracker module 13 detects an eye movement track of a user and sends the eye movement track to the processing module 1.
And the processing module 1 extracts the virtual commodity watched by the user in the display mechanism according to the eye movement track.
The processing module 1 calculates the time at which the user gazes at the virtual good.
The processing module 1 determines whether the time is greater than or equal to a preset time.
If yes, the processing module 1 displays the virtual commodity in the display mechanism in an amplifying mode, extracts commodity information of the virtual commodity and outputs the commodity information to a user.
Specifically, the user wears the eye tracker module 13 when shopping, and when browsing the virtual goods in the virtual structure in the display mechanism, the eye tracker module 13 is able to acquire the eye trajectory of the user and send it to the processing module 1, the processing module 1 corresponds the eye movement track to the virtual commodity in the virtual structure of the display mechanism, if the eye movement track corresponds to the virtual commodity, indicating that the user is looking at the virtual good, the processing module 1 calculates the time at which the user is looking at the virtual good, the processing module 1 is internally provided with preset time and preset multiple, if the time watched by the user is more than or equal to the preset time, the user is interested in the virtual commodity, the processing module 1 firstly enlarges the virtual commodity by a preset multiple in the display mechanism, and then extracts the commodity information of the virtual commodity from the storage module 3 and displays the commodity information below the virtual commodity.
The above embodiments are merely illustrative of the technical ideas and features of the present invention, and are intended to enable those skilled in the art to understand the contents of the present invention and implement the present invention, and not to limit the scope of the present invention. All equivalent changes or modifications made according to the spirit of the present invention should be covered within the protection scope of the present invention.