CN111325602A - Mixed reality shopping equipment, shopping visual system and using method - Google Patents
Mixed reality shopping equipment, shopping visual system and using method Download PDFInfo
- Publication number
- CN111325602A CN111325602A CN202010092067.8A CN202010092067A CN111325602A CN 111325602 A CN111325602 A CN 111325602A CN 202010092067 A CN202010092067 A CN 202010092067A CN 111325602 A CN111325602 A CN 111325602A
- Authority
- CN
- China
- Prior art keywords
- virtual
- shopping
- glasses
- supermarket
- shelf
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000000007 visual effect Effects 0.000 title claims abstract description 30
- 239000011521 glass Substances 0.000 claims abstract description 59
- 238000006073 displacement reaction Methods 0.000 claims abstract description 4
- 238000004088 simulation Methods 0.000 claims description 6
- 230000003183 myoelectrical effect Effects 0.000 claims description 3
- 210000003462 vein Anatomy 0.000 claims description 3
- 230000006399 behavior Effects 0.000 abstract description 11
- 230000009471 action Effects 0.000 description 7
- 230000008859 change Effects 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000010354 integration Effects 0.000 description 4
- 210000003141 lower extremity Anatomy 0.000 description 4
- 230000001960 triggered effect Effects 0.000 description 3
- 210000001364 upper extremity Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000003795 chemical substances by application Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000004424 eye movement Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000005096 rolling process Methods 0.000 description 2
- 235000011888 snacks Nutrition 0.000 description 2
- 208000035473 Communicable disease Diseases 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 239000004579 marble Substances 0.000 description 1
- 230000003340 mental effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000009182 swimming Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
Abstract
The mixed reality shopping equipment at least comprises VR/AR glasses and a sports body-building machine, wherein the VR/AR glasses are at least used for displaying a 3D inner scene in a supermarket space range; in the visual field of the VR/AR glasses, the front end of the exercise body-building machine is covered and displayed as a 3D virtual supermarket shopping cart, and when the exercise body-building machine senses the exercise, the 3D internal scene is correspondingly displayed in a displacement mode. When the mixed reality shopping equipment in this application uses, the shopper takes VR glasses or AR glasses, then carries out the body-building operation on the motion body-building machine, shows (virtual) scene in the supermarket in the visual field of VR glasses or AR glasses, and along with the shopper moves on the motion body-building machine, (virtual) scene also along with the prospect, when the body-building, realizes that the virtual supermarket of shopping. In addition, the application also relates to a shopping visual system and a using method, and the occurrence scene of shopping behaviors is expanded.
Description
Technical Field
The invention belongs to the field of shopping, and particularly relates to mixed reality shopping equipment, a shopping visual system and a using method.
Background
The consumption shopping behavior is widely existed in daily life and work of residents, and in addition to the tension work, people can spend time shopping malls, browse commodities and buy required commodities to meet the entrance requirement, and meanwhile, the consumption shopping is also a good way for relaxing the body and mind and relieving the pressure.
For urban white collars, shopping through shopping malls takes time, experiences, and preferably also in good weather, and these limitations make shopping through malls a less than ideal activity to be performed immediately. In addition, when some emergency situations occur, such as people cannot go out at home or during epidemic infectious diseases, people cannot go out to shopping conveniently. Generally, people walk in a supermarket while shopping by hand pushing a shopping cart.
The treadmill is a very common fitness device, and generally, the treadmill is provided with a rotating base and a handle, the base is provided with a rotatable track, the handle is used for holding and operating by a person, and an operating platform is arranged on the area of the handle. When a person walks slowly on the running machine, the person can hold the handle, the gesture is similar to the gesture of pushing shopping in a shopping vehicle-mounted supermarket by the person, in addition, other hand or foot operations corresponding to some motion equipment are similar to the gesture in the shopping process, therefore, the two scenes can be combined into one by means of scientific and technical equipment, and the application researches in the direction.
The essence of new consumption advocated by Marble is the integration of online and offline, but the integration of e-commerce and online supermarket stores is being explored.
Disclosure of Invention
Aiming at the defects in the prior art, the invention provides mixed reality shopping equipment, so that people can enter a virtual shopping mall to go shopping and do shopping while doing sports and fitness. The application also relates to a shopping visual system and a using method of the system.
In order to solve the above technical problems, the present invention is solved by the following technical solutions.
The mixed reality shopping equipment at least comprises VR/AR glasses and a sports body-building machine, wherein the VR/AR glasses are at least used for displaying a 3D (virtual) inner scene (formed by 3D modeling in advance according to the inner scene of an offline real supermarket) in a supermarket space range; in the visual field of the VR/AR glasses, the front end of the exercise body-building machine is covered and displayed as a 3D virtual supermarket shopping cart, and when the exercise body-building machine senses the exercise, the 3D (virtual) internal scene is correspondingly displayed in a displacement mode.
When the mixed reality shopping equipment in this application uses, the shopper takes VR glasses or AR glasses, then carries out the body-building operation on the motion body-building machine, shows the virtual scene in the supermarket in the visual field of VR glasses or AR glasses, and along with the shopper moves on the motion body-building machine, the virtual scene also along with the prospect, when the body-building, realizes virtually shopping the supermarket.
In a preferred embodiment, at least one 3D (virtual) shelf is provided in the 3D (virtual) interior; at least one 3D (virtual) commodity is arranged on the 3D (virtual) goods shelf, so that scenes of a (virtual) supermarket are enriched as much as possible. In a general real-world scenario, a shopper pushes a shopping cart to pass through the goods of the shopping mall in the two rows of goods shelves. Shoppers wear VR glasses or AR glasses and shuttle in two rows of 3D (virtual) merchandise shelves.
In a preferred embodiment, the VR/AR glasses are provided with an information input device, the information input device comprises one or more of a microphone, a control handle, a gesture recognizer, a motion capture device, a digital glove, a smart ring, a myoelectric sensor, a head pointer, an eye tracker, a mouse, a trackball, and a keyboard, and is used for interacting with a (virtual) scene. Taking the gesture recognizer as an example, the gesture recognizer may recognize the motion of a bare hand in the space, and correspondingly generate a virtual hand, and the specific gesture of the virtual hand may be set by a program to interact with a virtual commodity, such as pinching, movement and turning after pinching, and the like.
In a preferred embodiment, when the smart handle, the head sight or the eye tracker recognizes the 3D (virtual) shelf/3D (virtual) product in a mouse point or when the gesture recognizer recognizes the 3D (virtual) shelf/3D (virtual) product pointed by a finger, a virtual electronic tag is further displayed around the 3D (virtual) shelf/3D (virtual) product, and at least one piece of information related to the 3D (virtual) shelf/3D (virtual) product is displayed in the virtual electronic tag. Any piece of physical merchandise on the on-site physical shelf is also 3D modeled in advance, and 3D (virtual) merchandise is displayed on the 3D (virtual) shelf.
In a preferred embodiment, the information related to the 3D (virtual) shelf includes at least information on a spatial position of the shelf or information on contents of the goods stored on the shelf; the information related to the 3D (virtual) product includes at least character information or picture information printed on an outer package of the product.
In a preferred embodiment, a virtual shopper and/or virtual merchandise introducer is displayed in the field of view of the VR/AR glasses. Specifically, the virtual shopping guide is used for indicating the spatial position of a shelf where specific commodities are stored; the virtual commodity introducer is used for introducing one or more of the commodity names, efficacies, production areas, production time, shelf life, quality guarantee period, using/eating methods, suitable crowds and suitable ages of specific commodities in a video, audio, animation, characters and pictures mode. The virtual shopper and/or virtual article introducer are abbreviated as NPC (Non-player character) which is a character having its own behavior pattern and is generally controlled by artificial intelligence AI of a computer, and the NPC performs navigation communication or article consultation communication with a shopper wearing VR/AR glasses according to program settings. In a preferred embodiment, small tool software is displayed in a superposition mode in the visual field of the VR/AR glasses, and the small tool software comprises one or more of a picture/word translator, a commodity price calculator, a currency exchange table, a clock, a calendar, weather, color marks and an electronic map of the spatial range of the supermarket.
In a preferred embodiment, the gesture recognizer is configured to recognize an interaction gesture with the 3D (virtual) merchandise, and when the 3D (virtual) merchandise is placed in the 3D virtual supermarket shopping cart, the 3D (virtual) merchandise automatically generates a shopping list of types and quantities.
In a preferred embodiment, a shopping selection button is further displayed within the virtual electronic tag, the shopping selection button including at least one of abandoning, putting in a shopping cart, purchasing, asking, connecting a contact, opening video sharing.
In a preferred embodiment, the sports fitness machine comprises an upper and/or a lower limb exercise machine. Specifically, the upper limb exercise apparatus comprises an upper arm swimming imitation training machine, a wheelchair machine or a rowing machine; the lower limb exercise apparatus comprises a treadmill, an underwater treadmill, a universal treadmill, a treadmill or a bicycle machine.
The mixed reality shopping equipment can show a (virtual) scene in a supermarket during use, can walk in the (virtual) supermarket and check and shop commodities by matching with the operation of fitness movement, achieves the purpose of combining shopping and fitness, and expands the occurrence scene of shopping behaviors.
The mixed reality shopping visual system at least comprises a supermarket simulation model library, a goods shelf model library, a commodity information database, a supermarket map database, a virtual mannequin, a visual settlement subsystem or a registrant management subsystem.
In a preferred embodiment, the supermarket simulation model base and the supermarket map database are established according to a real-site supermarket environment; the commodity model base and the commodity information database are established according to supermarket inventory physical information. Therefore, the system can correspond to scenes, arrangement and commodities in the physical supermarket one by one.
In a preferred embodiment, the virtual human model is triggered according to the relative position information sensed by the sports machine or is called, and after the triggering, the virtual human model shows an avatar to perform action interaction or voice interaction, such as introducing goods, promoting goods, inquiring and the like. The virtual human model may be 2D or 3D. The virtual human model can be NPC, and can also be customized according to the user logging in the shopping system.
In a preferred embodiment, the visual settlement subsystem performs settlement of placing an order according to the number of products, the kind, the promotion preference or the membership grade of the shopping list, and performs settlement of the price of the product by generating an order to an online ordering system of a local supermarket. The visual settlement subsystem comprises a supermarket member database, a promotion preferential commodity database, a temporary user non-member database and the like.
In a preferred embodiment, the VR/AR glasses and/or the sports machine are provided with an account login device, and after user information is verified through the account login device, the user enters the login person management subsystem; the VR/AR glasses are connected with the sports machine in a wired or wireless mode; the account login device comprises at least one of a face verifier, a palm vein verifier, an iris verifier, a fingerprint verifier, a voiceprint verifier, a password verifier and a secret gesture verifier.
In a preferred embodiment, when the shelf in the real supermarket environment changes, the 3D (virtual) interior in the supermarket space range changes correspondingly; and/or, when the goods on the shelves in the on-site supermarket environment change, then the 3D (virtual) goods on the 3D (virtual) shelves change accordingly; and/or when the supermarket inventory physical object information changes, the virtual electronic tag display information of the 3D (virtual) commodity changes correspondingly.
The mixed reality shopping visual system forms the scene, the goods shelf and the commodity information in the entity supermarket into the corresponding (virtual) supermarket scene, so that customers can conveniently enter the (virtual) supermarket to shop and settle accounts after logging in the system through the VR/AR equipment, and the occurrence scene of shopping behaviors is expanded.
The application provides a use method of mixed reality shopping equipment, specifically is: logging in a mixed reality shopping visual system through VR/AR glasses; and ordering and settling according to the quantity, the type, the preference or the member level of the commodities in the shopping list.
In a preferred embodiment, the method comprises the following steps: displaying a 3D (virtual) interior scene within an supermarket space range through the visual field of the VR/AR glasses; in the field of view of the VR/AR glasses, the front end of the running exercise machine is displayed overlaid as a 3D virtual supermarket shopping cart.
In a preferred embodiment, the method comprises the following steps: when the motion machine senses motion or movement, the 3D (virtual) internal scene is correspondingly displayed in a displacement mode.
In a preferred embodiment, the method comprises the following steps: and placing the 3D (virtual) commodity into the 3D virtual supermarket shopping cart.
In a preferred embodiment, the method comprises the following steps: indicating a 3D (virtual) shelf on which the 3D (virtual) commodity is displayed; and/or displaying related information of the 3D (virtual) commodity through a virtual electronic tag.
In a preferred embodiment, within the virtual electronic tag, a shopping selection button is also displayed, the shopping selection button including at least abandoning, putting in a shopping cart, purchasing, asking, connecting a contact, or opening a video share.
In a preferred embodiment, the method comprises the following steps: and generating the shopping lists of the types and the quantities of the 3D (virtual) commodities in the 3D virtual supermarket shopping cart.
In a preferred embodiment, the method comprises the following steps: displaying a virtual shopper and/or a virtual merchandise introducer in the field of view of the VR/AR glasses.
In a preferred embodiment, the method comprises the following steps: the virtual shopper indicates the spatial location of the shelf upon which a particular item is stored; the virtual commodity introducer introduces the commodity name, efficacy, production place, production time, shelf life, using/eating method, suitability for people or applicable age of a specific commodity in a video, audio, animation, text or picture mode.
In a preferred embodiment, the method comprises the following steps: and displaying gadget software in a view field of the VR/AR glasses in an overlapping mode, wherein the gadget software comprises but is not limited to a picture word translator, a commodity price calculator, a currency exchange table, a clock, a calendar, weather, a color mark or an electronic map of the supermarket space range.
In a preferred embodiment, the method comprises the following steps: and when the 3D (virtual) supermarket shopping cart is pushed through a settlement channel, ordering and settlement are carried out according to the shopping list.
The above is the use method of the mixed reality shopping equipment in the application, the actions on the fitness sports equipment can be converted into the shopping operation in the (virtual) scene, the supermarket shopping behavior can be carried out at home, and the occurrence scene of the shopping behavior is expanded.
Compared with the prior art, the invention has the following beneficial effects: the utility model provides a mixed reality shopping equipment, visual system of shopping and the application method of this system, through the comprehensive use of VR/AR equipment and motion body-building machine and construct (virtual) supermarket, make people when the motion body-building, can convenient entering (virtual) market, go out the operation of shopping mall and shopping. The method is a brand new attempt for on-line and off-line integration of new snacks, skillfully combines traditional on-line shopping with common picture-viewing shopping in electronic commerce, is an immersive mixed-reality shopping experience, and effectively challenges a shopping agent by adding NPC (virtual shopping guide and/or virtual commodity introducer), which lead to a revolution of shopping.
Drawings
Fig. 1 is a schematic view of a supermarket where a person pushes a shopping cart.
FIG. 2 is a schematic diagram of a shopper using mixed reality shopping equipment on a treadmill in one embodiment of the present invention.
Fig. 3 is a schematic view of a virtual shopping cart in a (virtual) supermarket according to the present invention.
Fig. 4 is a schematic diagram of a shopper holding a (virtual) product in a (virtual) supermarket in accordance with the present invention.
Fig. 5 is a schematic diagram of the product of fig. 4 with a (virtual) product label identified thereon.
Fig. 6 is a schematic diagram of a virtual article introducer introducing articles in a (virtual) supermarket according to the present invention.
Fig. 7 is a schematic diagram of a virtual goods introducer in a (virtual) supermarket in accordance with the present invention communicating with a shopper wearing AR/VR glasses.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
The embodiments described below by referring to the drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout, are exemplary only for explaining the present invention, and are not construed as limiting the present invention.
Referring to fig. 1 to 7, the mixed reality shopping equipment according to the present invention at least includes a VR/AR glasses and a sports fitness machine, wherein the VR/AR glasses are at least used for displaying a 3D (virtual) interior view within a supermarket space range; in the visual field of the VR/AR glasses, the front end of the exercise machine is covered and displayed as a 3D virtual supermarket shopping cart, a motion sensing mechanism for sensing motion is arranged on the exercise machine or the VR/AR glasses, the motion sensing mechanism is a motion sensing camera or a motion sensor, and the motion sensor can sense the motion of a motion component on the exercise machine, such as: with the movement of the shopper on the exercise body-building machine or other movement operations, the movement of the shopper is shot by the motion sensing camera and converted into forward, backward, turning and other operations in the virtual scene, so that the transformation of the virtual supermarket scene is realized. Alternatively, the exercise machine may be provided with a motion sensor, which senses the motion of the motion component, such as: on the running machine/walking machine, the motion sensor can sense the rotation change of the rolling shaft or the movement of the rolling belt on the sensing equipment to obtain a motion state, and the motion state is converted into the operations of advancing, retreating, turning and the like in a virtual scene, so that the change of the virtual supermarket scene is realized. A user wears VR/AR glasses on the exercise body-building machine, logs in a mixed reality shopping system, is personally placed in a supermarket environment, shuttles to different goods shelves, and is full of scenes of a real supermarket. The person is relatively immobile and the surrounding (virtual) environment moves relatively, and the displayed (virtual) interior generally changes according to the change of the viewpoint POV (first view angle).
Specifically, a 3D (virtual) shelf and 3D (virtual) goods are displayed in a 3D (virtual) interior displayed by the VR/AR glasses, so that the (virtual) supermarket has as rich a scene as possible, and further, a virtual shopping guide and/or a virtual goods introducer are displayed. The information input device is arranged on the VR/AR glasses and comprises one or more of a microphone, a control handle, a gesture recognizer, a motion catcher, digital gloves, a smart ring, a myoelectric sensor, a head sighting device, an eye movement tracker, a mouse, a trackball and a keyboard, and is used for realizing interactive operation with a (virtual) scene. The gesture recognizer includes but is not limited to an infrared gesture recognizer, a TOF light gesture recognizer, and a binocular camera gesture recognizer.
The exercise machine in this application includes upper and/or lower limb exercise machines. Specifically, the upper limb exercise apparatus comprises a wheelchair machine or a rowing machine; the lower limb exercise apparatus comprises a running machine, an underwater running machine or a bicycle machine, and can realize the actions of legs or hands, and the actions can be mapped into the operation in a (virtual) scene after being recognized by a recognition device, so as to realize the (virtual) shopping behavior. The exercise body-building machine is mapped into the mixed reality shopping system to move forwards and backwards, and the steering of the head (the gyroscope of the VR/AR glasses can sense the steering) and the steering force of the push handle (the pressure sensor of the exercise body-building machine can sense the stress difference) jointly promote the steering of the push cart mapped into the mixed reality shopping system.
The invention also relates to a mixed reality shopping visual system which at least comprises a supermarket simulation model library, a goods shelf model library, a commodity information database, a supermarket map database, a virtual mannequin, a visual settlement subsystem or a registrant management subsystem.
Specifically, in the mixed reality shopping visual system, the supermarket simulation model library and the supermarket map database are established according to a real-site supermarket environment; the commodity model base and the commodity information database are established according to supermarket inventory physical information and can be in one-to-one correspondence with scenes, arrangement and commodities in a physical supermarket. The virtual human model in the system is triggered according to the relative position information sensed by the moving machine or called, the virtual human model shows virtual images after being triggered, and action interaction or voice interaction is carried out, such as commodity introduction, commodity promotion, inquiry and the like.
The following detailed description is given with reference to specific examples.
Example one
As shown in fig. 2, there is a running machine 2 at home, and a shopper walks or joggs on the running machine 2 with VR glasses or AR glasses 1. The shopper logs in through an account login device on VR glasses or AR glasses 1 or a treadmill 2 in a mode of one of a face verifier, a palm vein verifier, an iris verifier, a fingerprint verifier, a voiceprint verifier, a password verifier and a secret gesture verifier. After the login detail verification is passed, entering a login person management subsystem; the VR/AR glasses are connected with the sports machine in a wired or wireless mode. The handle of the treadmill 2 is provided with a pressure sensor. The game device moves on the (universal) running machine, is very similar to a VR-CS game machine, and a player wears VR glasses and a hand simulation gun to move on the (universal) running machine, so that the game scene also moves and changes along with the movement under feet.
After logging in, a certain supermarket store around the supermarket is selected, as shown in fig. 3, a scene in the real supermarket is displayed in the visual field of the VR/AR glasses, the front end of the treadmill 2 is covered and displayed as a 3D virtual supermarket shopping cart, and the scene of a shopper pushing the shopper is similar to the scene of the shopper when the shopper holds the handle of the treadmill. The shopper walks or joggs on the treadmill and the 3D virtual supermarket cart advances in the scene of the supermarket.
As shown in FIGS. 4 and 5, the information input device on the VR/AR glasses may recognize certain actions by the shopper, such as reaching, picking, setting, turning, etc. Specifically, when the smart handle, the head sight, or the eye movement tracker recognizes the 3D (virtual) shelf/3D (virtual) product in the mouse point, or when the gesture recognizer recognizes the 3D (virtual) shelf/3D (virtual) product pointed by the finger, a virtual electronic tag is further displayed around the 3D (virtual) shelf/3D (virtual) product, and at least one piece of information related to the 3D (virtual) shelf/3D (virtual) product is displayed in the virtual electronic tag. As shown in fig. 5. The information related to the 3D (virtual) shelf includes at least spatial position information of the shelf or content information of the goods stored on the shelf; the information related to the 3D (virtual) merchandise at least includes text information, audio information, or picture information printed on an outer package of the merchandise.
In the process of shopping (virtual) supermarkets, when a shelf in the real supermarket environment changes, a 3D (virtual) interior scene in the supermarket space range correspondingly changes; and/or, when the goods on the shelf in the on-site supermarket environment change, the 3D (virtual) goods on the 3D (virtual) shelf change accordingly; and/or when the supermarket inventory physical object information changes, the virtual electronic tag display information of the 3D (virtual) commodity correspondingly changes. This can be achieved by updating the data in real time by means of a camera arranged in the supermarket.
In the process of shopping (virtual) supermarkets, a shopper can put selected (virtual) commodities into a virtual shopping cart, the process is realized through a gesture recognizer and is used for recognizing interaction gestures with the 3D (virtual) commodities, and when the 3D (virtual) commodities are placed in the 3D virtual supermarket shopping cart, the 3D (virtual) commodities automatically generate shopping lists of types and quantities, or the virtual shopping cart is settled through a settlement channel. A visual settlement subsystem in the system performs ordering settlement according to the quantity, the types, the promotion preference or the member level of the commodities in the shopping list, and the formed order is sent to an on-line order system of a real supermarket to perform commodity price settlement. The shopping operation can be completed after online payment, and the goods can be distributed to the home.
Example two
As shown in fig. 2, a shopper walks or joggs on a treadmill 2 with the treadmill 2 at home and wears VR glasses or AR glasses 1, and logs in to the system through the VR glasses or AR glasses 1 to perform a (virtual) shopping behavior of shopping through a (virtual) supermarket.
As shown in fig. 4 and 5, the operations of gesture recognition, commodity selection, commodity viewing and the like during shopping (virtual) of the supermarket are the same as those of the first embodiment.
In the process of shopping (virtual) supermarkets, when a shopper needs to quickly find a specific commodity, the shopping cart can be moved to the vicinity of a virtual shopping guide in the (virtual) supermarkets, and after the shopper is told that the commodity required by the virtual shopping guide is needed, the virtual shopping guide can indicate the space position of a goods shelf where the commodity is stored through a guide mark, so that the shopping cart is convenient to go.
As shown in fig. 7, in addition, during shopping (virtual) of the supermarket, the shopper may also pass near the virtual goods introducer, at which time the virtual goods introducer may introduce one or more of the trade name, efficacy, production area, production time, shelf life, expiration date, use/eating method, suitable crowd, suitable age of the specific goods in a form of at least one of video, audio, animation, text and picture, and the shopper may stay to receive information if interested. Such a display, like a virtual advertisement, a television shopping introduction or a live merchandise purchase. When a shopper sees a commodity of the mental apparatus, the shopper can click a button in a virtual electronic tag of the commodity to share the commodity with friends; the buttons in the virtual eMark include at least abandon, put in shopping cart, buy, ask, connect contact or open video share, etc.
After selecting the desired product, the settlement process is the same as in the first embodiment.
EXAMPLE III
When a wheelchair, a rowing machine, a running machine in water, a bicycle machine and the like exist in the house, a shopper can use the machine instead of the running machine to exercise, and other operation modes are the same as those of the first embodiment and the second embodiment.
Example four
In the above embodiment, the shopper may also display widget software in an overlapping manner in the visual field of the VR/AR glasses, where the widget software includes one or more of a picture and text translator, a commodity price calculator, a currency exchange table, a clock, a calendar, weather, color marks, and an electronic map of the spatial range of the supermarket, and can be called and used at any time during (virtual) shopping.
EXAMPLE five
The mixed reality shopping equipment, the mixed reality shopping system and the using method form corresponding (virtual) supermarket scenes of scenes, goods shelves and commodity information in the entity supermarket, so that customers can conveniently enter the (virtual) supermarket to shop and settle accounts after logging in the system through the VR/AR equipment. The actions on the fitness sports equipment can be converted into shopping operations in (virtual) scenes, supermarket shopping behaviors can be carried out at home, and the occurrence scenes of the shopping behaviors are expanded.
A large number of 3D modeling scenes, shelves, commodities and human models are stored at a network equipment end; meanwhile, programs of mutual cooperation of a user login system, a commodity ERP system, different market supermarket systems, a market supermarket map system, a settlement shopping system, a distribution system and the like are stored. The system is integrated by the existing supermarket system except for 3D (virtual) scenes and 3D (virtual) human models.
Compared with the prior art, the invention has the following beneficial effects: the utility model provides a mixed reality shopping equipment, visual system of shopping and the application method of this system, through the use of VR/AR equipment and structure (virtual) supermarket, make people when the motion body-building, can convenient entering (virtual) market, go out the operation of shopping mall and shopping. The method is a brand new attempt for on-line and off-line integration of new snacks, skillfully combines traditional on-line shopping with common picture-viewing shopping in electronic commerce, is an immersive mixed-reality shopping experience, and effectively challenges a shopping agent by adding NPC (virtual shopping guide and/or virtual commodity introducer), which lead to a revolution of shopping.
The scope of the present invention includes, but is not limited to, the above embodiments, and the present invention is subject to the appended claims, and any alterations, modifications, and improvements that can be easily made by those skilled in the art are within the scope of the present invention.
Claims (10)
1. A mixed reality shopping device is characterized in that at least comprises VR/AR glasses and a sport body-building machine,
the VR/AR glasses are at least used for displaying a 3D inner scene in a supermarket space range;
in the field of view of the VR/AR glasses, the front end of the exercise fitness machine is displayed as a 3D virtual supermarket shopping cart in a covered manner,
when the exercise body-building machine senses the exercise, the 3D internal scene correspondingly carries out displacement display.
2. The mixed reality shopping arrangement of claim 1,
at least one 3D shelf is arranged on the 3D inner scene;
at least one 3D commodity is arranged on the 3D shelf.
3. The mixed reality shopping device of claim 1, wherein the VR/AR glasses are provided with information input means comprising one or more of a microphone, a joystick, a gesture recognizer, a motion capture, a digital glove, a smart ring, a myoelectric sensor, a head sight, an eye tracker, a mouse, a trackball, a keyboard.
4. The mixed reality shopping arrangement according to claim 2 or 3, wherein when said smart handle, head sight or eye tracker recognizes said 3D shelf/3D merchandise in a mouse spot or when said gesture recognizer recognizes said 3D shelf/3D merchandise pointed by a finger, a virtual electronic tag is further displayed around said 3D shelf/3D merchandise,
and at least displaying information related to the 3D shelf/3D commodity in the virtual electronic label.
5. The mixed reality shopping arrangement of claim 4, wherein the 3D shelf-related information includes at least spatial location information of the shelf or content information of items stored on the shelf;
the information related to the 3D commodity at least comprises character information or picture information printed on the outer package of the commodity.
6. The mixed reality shopping arrangement of claim 1, wherein a virtual shopper and/or a virtual merchandise introducer are displayed in the field of view of the VR/AR glasses.
7. A mixed reality shopping visual system is characterized by at least comprising a supermarket simulation model library, a shelf model library, a commodity information database, a supermarket map database, a virtual mannequin, a visual settlement subsystem or a registrant management subsystem.
8. The mixed reality shopping visual system of claim 7, wherein the VR/AR glasses and/or the sports machine are provided with an account login device, and the user information is authenticated through the account login device and then enters the registrant management subsystem; the VR/AR glasses are connected with the sports machine in a wired or wireless mode;
the account login device comprises at least one of a face verifier, a palm vein verifier, an iris verifier, a fingerprint verifier, a voiceprint verifier, a password verifier and a secret gesture verifier.
9. A use method of mixed reality shopping equipment is characterized in that a mixed reality shopping visual system is logged in through VR/AR glasses; and ordering and settling according to the quantity, the type, the preference or the member level of the commodities in the shopping list.
10. The use of claim 9, wherein a 3D context in the supermarket space is displayed through the field of view of the VR/AR glasses; in the field of view of the VR/AR glasses, the front end of the running exercise machine is displayed overlaid as a 3D virtual supermarket shopping cart.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092067.8A CN111325602A (en) | 2020-02-14 | 2020-02-14 | Mixed reality shopping equipment, shopping visual system and using method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010092067.8A CN111325602A (en) | 2020-02-14 | 2020-02-14 | Mixed reality shopping equipment, shopping visual system and using method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111325602A true CN111325602A (en) | 2020-06-23 |
Family
ID=71167103
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010092067.8A Pending CN111325602A (en) | 2020-02-14 | 2020-02-14 | Mixed reality shopping equipment, shopping visual system and using method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111325602A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112070573A (en) * | 2020-07-30 | 2020-12-11 | 象其形(浙江)智能科技有限公司 | AR technology-based shoe purchasing method and shoe purchasing system |
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| JP2023142255A (en) * | 2022-03-24 | 2023-10-05 | 株式会社ポケモン | Program, method, information processing apparatus, and system |
| TWI824859B (en) * | 2022-11-30 | 2023-12-01 | 國立勤益科技大學 | Virtual shopping gesture control system |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106327299A (en) * | 2016-08-19 | 2017-01-11 | 滨州学院 | E-commerce display system based on 3D display |
| CN107463260A (en) * | 2017-08-09 | 2017-12-12 | 康佳集团股份有限公司 | VR equipment and its sales field purchase data processing method and storage medium |
| CN108171584A (en) * | 2018-01-18 | 2018-06-15 | 吴静 | A kind of smart supermarket purchase system based on virtual reality |
| CN108510360A (en) * | 2018-03-26 | 2018-09-07 | 深圳市酷开网络科技有限公司 | A kind of virtual reality purchase method, system and computer readable storage medium |
| CN108958491A (en) * | 2018-08-01 | 2018-12-07 | 林向阳 | Long-range experiential method and its system |
| CN109489124A (en) * | 2018-12-13 | 2019-03-19 | 王冠红 | Experience air-conditioning, experiencing machine and scene motion system |
-
2020
- 2020-02-14 CN CN202010092067.8A patent/CN111325602A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106327299A (en) * | 2016-08-19 | 2017-01-11 | 滨州学院 | E-commerce display system based on 3D display |
| CN107463260A (en) * | 2017-08-09 | 2017-12-12 | 康佳集团股份有限公司 | VR equipment and its sales field purchase data processing method and storage medium |
| CN108171584A (en) * | 2018-01-18 | 2018-06-15 | 吴静 | A kind of smart supermarket purchase system based on virtual reality |
| CN108510360A (en) * | 2018-03-26 | 2018-09-07 | 深圳市酷开网络科技有限公司 | A kind of virtual reality purchase method, system and computer readable storage medium |
| CN108958491A (en) * | 2018-08-01 | 2018-12-07 | 林向阳 | Long-range experiential method and its system |
| CN109489124A (en) * | 2018-12-13 | 2019-03-19 | 王冠红 | Experience air-conditioning, experiencing machine and scene motion system |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112070573A (en) * | 2020-07-30 | 2020-12-11 | 象其形(浙江)智能科技有限公司 | AR technology-based shoe purchasing method and shoe purchasing system |
| CN113298598A (en) * | 2020-09-15 | 2021-08-24 | 阿里巴巴集团控股有限公司 | Method and device for providing shop object information and electronic equipment |
| JP2023142255A (en) * | 2022-03-24 | 2023-10-05 | 株式会社ポケモン | Program, method, information processing apparatus, and system |
| TWI824859B (en) * | 2022-11-30 | 2023-12-01 | 國立勤益科技大學 | Virtual shopping gesture control system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111325602A (en) | Mixed reality shopping equipment, shopping visual system and using method | |
| US7760182B2 (en) | Method for video enabled electronic commerce | |
| Lee et al. | Presence in virtual golf simulators: The effects of presence on perceived enjoyment, perceived value, and behavioral intention | |
| CN103049852B (en) | Virtual fitting system | |
| US20100211479A1 (en) | Virtual marketplace accessible to widgetized avatars | |
| US20120150650A1 (en) | Automatic advertisement generation based on user expressed marketing terms | |
| US20100211899A1 (en) | Virtual Marketplace Accessible To Widgetized Avatars | |
| CN106327299B (en) | A kind of e-commerce display system based on 3D display | |
| KR101966040B1 (en) | Apparatus for dance game and method for dance game using thereof | |
| CN110168618A (en) | Augmented reality control system and method | |
| US20100259610A1 (en) | Two-Dimensional Display Synced with Real World Object Movement | |
| US20120233076A1 (en) | Redeeming offers of digital content items | |
| CN102201099A (en) | Motion-based interactive shopping environment | |
| CN102656542A (en) | Camera navigation for presentations | |
| US11847754B2 (en) | Interactive virtual reality system | |
| CN102908772A (en) | Upper limb rehabilitation training system by using augmented reality technology | |
| CN102356373A (en) | Virtual object manipulation | |
| WO2007139728A3 (en) | Computer implemented shopping system | |
| JP2008165807A (en) | Terminal try-on simulation system, and operating and applying method | |
| CN104618819A (en) | Television terminal-based 3D somatosensory shopping system and method | |
| US20190318539A1 (en) | Smart tracking system | |
| Chang et al. | A dynamic fitting room based on microsoft kinect and augmented reality technologies | |
| CN211062005U (en) | Mixed reality shopping is equipped and visual system of shopping | |
| CN111694426A (en) | VR virtual picking interactive experience system, method, electronic equipment and storage medium | |
| CN111445314A (en) | Visual communication system and visual communication method for mixed reality shopping environment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200623 |