CN111694426A - VR virtual picking interactive experience system, method, electronic equipment and storage medium - Google Patents
VR virtual picking interactive experience system, method, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN111694426A CN111694426A CN202010403237.XA CN202010403237A CN111694426A CN 111694426 A CN111694426 A CN 111694426A CN 202010403237 A CN202010403237 A CN 202010403237A CN 111694426 A CN111694426 A CN 111694426A
- Authority
- CN
- China
- Prior art keywords
- picking
- user
- virtual
- real
- strawberry
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 47
- 238000000034 method Methods 0.000 title claims abstract description 33
- 235000016623 Fragaria vesca Nutrition 0.000 claims abstract description 117
- 235000011363 Fragaria x ananassa Nutrition 0.000 claims abstract description 117
- 241000220223 Fragaria Species 0.000 claims abstract description 102
- 230000033001 locomotion Effects 0.000 claims abstract description 74
- 230000009471 action Effects 0.000 claims abstract description 68
- 239000011521 glass Substances 0.000 claims abstract description 49
- 230000003993 interaction Effects 0.000 claims abstract description 26
- 230000003238 somatosensory effect Effects 0.000 claims abstract description 9
- 235000021012 strawberries Nutrition 0.000 claims description 17
- 230000000694 effects Effects 0.000 claims description 14
- 238000004590 computer program Methods 0.000 claims description 11
- 238000005286 illumination Methods 0.000 claims description 6
- 238000004422 calculation algorithm Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000036651 mood Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002035 prolonged effect Effects 0.000 description 1
- 238000005295 random walk Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Software Systems (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention provides a virtual VR picking interactive experience system and a virtual VR picking interactive experience method, wherein the system comprises the following steps: the virtual strawberry garden module is used for constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden; the VR glasses interaction module is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user; the somatosensory interaction module is used for acquiring real picking gesture actions of a user in real time and simulating the real picking gesture actions of the user by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; according to the embodiment of the invention, the three-dimensional virtual picking garden is constructed, so that the strawberry picking action is really restored, and the experience of the system is improved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a virtual picking interactive experience system and method for VR, an electronic device and a storage medium.
Background
In recent years, with the trend of people toward good life, people usually come to leisure parks to pick fresh vegetables and fruits, which is a noisy urban area to relax the mood. Simultaneously, in order to prolong visitor's dwell time, increase economic income, VR equipment has been purchased in many agricultural leisure garden and has let the visitor carry out interactive experience, for example, VR glasses, active VR egg chair, VR body feel bicycle etc.. The three-dimensional scene that presents through the VR equipment gives the stronger sense of immersing of visitor, lets the visitor experience the labour enjoyment while, enjoys the science and technology sense that the VR equipment brought. This kind of marketing mode of "leisure + science and technology" has driven the development of leisure agriculture promptly, plays certain propaganda effect to the garden, also brings economic benefits for the garden.
Current VR interactive experience system is picked to strawberry through letting visitor wear VR glasses, and handheld handle controller carries out interactive experience in the virtual strawberry big-arch shelter that founds. This kind of experience system lets the visitor can be anytime and anywhere through the real scene of restoreing the strawberry big-arch shelter carrying on the strawberry and picks, experiences the enjoyment of picking, but after wearing the helmet, people's eye can't see outside world, and the visitor carries out human-computer interaction by a bluetooth handle controller, for example: the Bluetooth handle generates a light spot or a light beam in the virtual world, and interaction experience is carried out by moving the light spot or the light beam, and the interaction experience can cause the fidelity and naturalness of picking actions to be far from the real picking.
Disclosure of Invention
Aiming at the problems in the prior art, the embodiment of the invention provides a VR virtual picking interactive experience system and a VR virtual picking interactive experience method.
Specifically, the embodiment of the invention provides the following technical scheme:
in a first aspect, an embodiment of the present invention provides a VR virtual picking interactive experience system, including: the virtual strawberry garden module is used for constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
the VR glasses interaction module is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user;
and the somatosensory interaction module is used for acquiring real picking gesture actions of the user in real time and simulating the real picking gesture actions of the user by using the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
Further, the virtual strawberry garden module is specifically configured to:
determining the area size and the architectural style of the strawberry picking garden based on the real environment of the strawberry picking garden;
according to the pictures shot in the strawberry picking garden, a 3D Max modeling tool is adopted to construct a three-dimensional virtual picking garden model by combining the area size and the architectural style of the strawberry picking garden;
and storing the three-dimensional virtual picking garden model into a Unity scene, and adding an illumination effect and a texture effect into the Unity scene.
Further, the VR glasses interaction module is specifically configured to:
establishing a corresponding relation between VR glasses and the three-dimensional virtual picking garden model through a SteamVR plug-in, enabling a user to wear the VR glasses to move autonomously, and acquiring real moving data of the user in real time through the VR glasses;
and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user wearing the VR glasses.
Further, the somatosensory interaction module is specifically used for:
acquiring real picking gesture actions of a user in real time, and if the real picking gesture actions of the user are used as the right extending hand touching the strawberry, simulating the gesture actions of the user extending the right hand touching the strawberry by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; when the virtual three-dimensional palm touches the strawberry, the edge of the strawberry is provided with an aperture, which indicates that the strawberry can be picked;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are used for picking strawberries by stretching out the right hand, simulating the gesture actions of the user for picking strawberries by stretching out the right hand by using a virtual three-dimensional palm in the three-dimensional virtual picking garden model; the virtual three-dimensional palm simulates gesture motion of a user stretching out a right hand to pick the strawberries and is used as the right hand to hold the virtual strawberries;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are stretching out the right hand for holding the strawberry, simulating the gesture actions of stretching out the right hand for holding the strawberry by the user through a virtual three-dimensional palm in the three-dimensional virtual picking garden model;
if the gesture action that the virtual three-dimensional palm simulates the right hand of a user stretching and holding the strawberry in the three-dimensional virtual picking garden model is recognized, the strawberry falls into a virtual strawberry basket, and one-time picking experience is recorded.
Further, virtual interactive experience system of picking of VR still includes:
and the discount acquisition module is used for recording task scores according to the picking experience times and acquiring corresponding consumption discounts by using a score algorithm model.
In a second aspect, an embodiment of the present invention further provides a VR virtual picking interactive experience method, including: constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
real movement data of a user are collected in real time, and the movement track of the user in the three-dimensional virtual picking garden model is determined according to the real movement data of the user;
and real picking gesture actions of the user are collected in real time, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
Further, the method for constructing the three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden specifically comprises the following steps:
determining the area size and the architectural style of the strawberry picking garden based on the real environment of the strawberry picking garden;
according to the pictures shot in the strawberry picking garden, a 3D Max modeling tool is adopted to construct a three-dimensional virtual picking garden model by combining the area size and the architectural style of the strawberry picking garden;
and storing the three-dimensional virtual picking garden model into a Unity scene, and adding an illumination effect and a texture effect into the Unity scene.
Further, the real-time collecting of the real movement data of the user, and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user specifically include:
establishing a corresponding relation between VR glasses and the three-dimensional virtual picking garden model through a SteamVR plug-in, enabling a user to wear the VR glasses to move autonomously, and acquiring real moving data of the user in real time through the VR glasses;
and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user wearing the VR glasses.
In a third aspect, an embodiment of the present invention further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the VR virtual picking interactive experience method according to the second aspect.
In a fourth aspect, embodiments of the present invention further provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the VR virtual picking interactive experience method according to the second aspect.
According to the technical scheme, the VR virtual picking interactive experience system and the VR virtual picking interactive experience method are characterized in that the system is used for constructing a three-dimensional virtual picking garden model based on a real environment of a strawberry picking garden through a virtual strawberry garden module; the VR glasses interaction module is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user; the somatosensory interaction module is used for acquiring real picking gesture actions of a user in real time and simulating the real picking gesture actions of the user by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; by constructing the three-dimensional virtual picking garden, the strawberry picking action is really restored, and the experience of the system is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a VR virtual picking interactive experience system according to an embodiment of the present invention;
fig. 2 is a flowchart of a VR virtual picking interactive experience method according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 shows a schematic structural diagram of a VR virtual picking interactive experience system provided by an embodiment of the present invention. As shown in fig. 1, a VR virtual picking interactive experience system provided in an embodiment of the present invention includes: virtual strawberry garden module 101, VR glasses interactive module 102, body sense interactive module 103, wherein:
the virtual strawberry garden module 101 is used for constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
the VR glasses interaction module 102 is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user;
and the somatosensory interaction module 103 is used for acquiring real picking gesture actions of the user in real time and simulating the real picking gesture actions of the user by using a virtual three-dimensional palm in the three-dimensional virtual picking garden model.
In the embodiment of the invention, it is noted that a virtual reality technology (VR) generates a virtual reality experience through a computer, and real-world people interact with objects in a virtual environment in a way of seeing, hearing and touching in the virtual reality environment to generate an immersive feeling. With the continuous progress of VR technology, VR glasses are gradually accepted by users, and HTC vive becomes a mainstream consumer grade VR device.
In this embodiment, the virtual strawberry garden module 101 selects a strawberry picking leisure garden as an application scene, and it should be noted that, in this embodiment, a three-dimensional virtual picking garden model is constructed based on a real environment of a strawberry picking garden, for example, a three-dimensional modeling tool 3DMax may be used to construct a virtual strawberry garden three-dimensional model. And importing the strawberry garden model into Unity3D to establish a virtual strawberry garden scene.
In this embodiment, the VR glasses interaction module 102 includes, for example: the VR glasses are HTC Vive glasses, and the HTC Vive glasses are connected with the virtual strawberry garden scene through a SteamVR plug-in. The method comprises the steps that a user wears HTC Vive glasses, the HTC Vive glasses move autonomously in the real world, movement information of the user is obtained through a high-precision sensor, real movement data of the user are collected in real time, the movement track of the user in a three-dimensional virtual picking garden model is determined according to the real movement data of the user, and accordingly, the user can be simulated to autonomously roam in a virtual strawberry garden at a first visual angle in a three-dimensional virtual picking garden scene.
In this embodiment, the motion sensing interaction module 103 needs to be illustrated as follows, for example: real picking gesture actions of a user are collected and tracked in real time through the Leap Motion high-accuracy infrared sensing equipment, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
In this embodiment, it should be noted that the Leap Motion is a high-precision gesture recognition Motion sensing device with a small size, completes capturing of gesture motions through an infrared LED and a camera, can track 10 fingers with a precision as high as 0.01mm, and tracks hand movements at 200 frames/s, so that tracking information and hand movements are performed simultaneously.
According to the technical scheme, the VR virtual picking interactive experience system provided by the embodiment of the invention is used for constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden through the virtual strawberry garden module; the VR glasses interaction module is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user; the somatosensory interaction module is used for acquiring real picking gesture actions of a user in real time and simulating the real picking gesture actions of the user by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; according to the embodiment of the invention, the three-dimensional virtual picking garden is constructed, so that the strawberry picking action is really restored, and the experience of the system is improved.
On the basis of the foregoing embodiment, in this embodiment, the virtual strawberry garden module is specifically configured to:
determining the area size and the architectural style of the strawberry picking garden based on the real environment of the strawberry picking garden;
according to the pictures shot in the strawberry picking garden, a 3D Max modeling tool is adopted to construct a three-dimensional virtual picking garden model by combining the area size and the architectural style of the strawberry picking garden;
and storing the three-dimensional virtual picking garden model into a Unity scene, and adding an illumination effect and a texture effect into the Unity scene.
In this embodiment, for example, based on the real environment of the strawberry picking garden, the area size of the strawberry picking garden is determined, the architectural style of the strawberry picking garden is determined, and the image photo of the real strawberry picking garden is shot on site. And according to the shot pictures, combining the area size and the architectural style of the strawberry picking garden, creating a three-dimensional virtual picking garden model by using a 3D Max modeling tool, saving the model, exporting the model into an FBX file, and storing the FBX file into a Unity scene. In a scene, model positions are placed, and an illumination effect, a texture effect and the like are added, so that the scene of the strawberry picking garden is truly restored.
According to the technical scheme, the VR virtual picking interactive experience system provided by the embodiment of the invention can truly restore the scene of the strawberry picking garden, provides stronger immersion and fidelity for users, brings better user experience, enables the users to really take a noisy environment and fully relaxes the mood.
On the basis of the above embodiment, in order to enhance the interaction and ensure that the movement track of the user in the three-dimensional virtual picking garden model is consistent with the real movement data, in this embodiment, the VR glasses interaction module is specifically configured to:
establishing a corresponding relation between VR glasses and the three-dimensional virtual picking garden model through a SteamVR plug-in, enabling a user to wear the VR glasses to move autonomously, and acquiring real moving data of the user in real time through the VR glasses;
and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user wearing the VR glasses.
In this embodiment, it should be noted that, for example: the VR glasses are assumed to be HTC Vive glasses, corresponding drives are downloaded according to a tutorial of an HTCVive official network, 2 laser positioning sensors are installed, the mobile data of a head-mounted display are acquired in real time through a sensor positioning technology, a corresponding relation is established for a three-dimensional virtual picking garden model through a SteamVR plug-in, a user wears the VR glasses to move autonomously, and the real mobile data of the user are acquired by the VR glasses in real time and are transmitted back to a Unity scene running in a computer. In the scene, the motion trail of the user in the virtual strawberry garden is kept consistent with the real world through the corresponding script codes (for example, the user wears HTC VIVIVIE glasses and moves forwards in the real world, and the laser sensor can acquire the movement information of the head-worn display).
According to the technical scheme, the VR virtual picking interactive experience system provided by the embodiment of the invention establishes the corresponding relation between the VR glasses and the three-dimensional virtual picking garden model, so that the moving track of a user in the three-dimensional virtual picking garden model is consistent with real moving data, the interaction is enhanced, the interaction mode is not rigid, the simulation degree of actions is high, the improvement of the interaction effect is beneficial to the user to enjoy the technological sense brought by the VR virtual picking interactive experience system, and the user experience time is prolonged.
On the basis of the above embodiment, in order to improve the experience of the system, in this embodiment, the somatosensory interaction module is specifically configured to:
acquiring real picking gesture actions of a user in real time, and if the real picking gesture actions of the user are used as the right extending hand touching the strawberry, simulating the gesture actions of the user extending the right hand touching the strawberry by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; when the virtual three-dimensional palm touches the strawberry, the edge of the strawberry is provided with an aperture, which indicates that the strawberry can be picked;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are used for picking strawberries by stretching out the right hand, simulating the gesture actions of the user for picking strawberries by stretching out the right hand by using a virtual three-dimensional palm in the three-dimensional virtual picking garden model; the virtual three-dimensional palm simulates gesture motion of a user stretching out a right hand to pick the strawberries and is used as the right hand to hold the virtual strawberries;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are stretching out the right hand for holding the strawberry, simulating the gesture actions of stretching out the right hand for holding the strawberry by the user through a virtual three-dimensional palm in the three-dimensional virtual picking garden model;
if the gesture action that the virtual three-dimensional palm simulates the right hand of a user stretching and holding the strawberry in the three-dimensional virtual picking garden model is recognized, the strawberry falls into a virtual strawberry basket, and one-time picking experience is recorded.
In this embodiment, it should be noted that a Leap Motion device is installed in front of the HTC view glasses to collect gesture information of the user. The hands of the user appear in the Leap Motion equipment identification area, the gesture information of the hands is captured by the infrared camera of the Leap Motion, and the data detected by two adjacent frames are compared to judge the gesture.
According to the technical scheme, the VR virtual picking interactive experience system provided by the embodiment of the invention collects real picking gesture actions of a user in real time, and records a picking experience from touching a strawberry to holding the strawberry to finish the picking action, and then to extending the hand holding the strawberry, wherein the strawberry falls into a virtual strawberry basket. Through a set of complete picking experience, the experience of the system is improved, so that the whole experience process is richer and more vivid, and the mode is more natural and harmonious.
On the basis of the above embodiment, in order to establish a relationship between the VR virtual picking interactive experience system and the park economic benefit, a discount acquisition module is added to the VR virtual picking interactive experience system, in this embodiment, the VR virtual picking interactive experience system further includes:
and the discount acquisition module is used for recording task scores according to the picking experience times and acquiring corresponding consumption discounts by using a score algorithm model.
In this embodiment, for example: the user can unlock the coupon mechanism after completing a certain task in the system (for example, completing the picking experience 20 times, and recording the corresponding task score of 20 points), and obtain coupons of different discounts according to the scores of the task (for example, 20 points, 40 points and 60 points) by using a score algorithm model (for example, 20 points correspond to 9-fold coupons, 40 points correspond to 8-fold coupons, and 60 points correspond to 7-fold coupons). Meanwhile, assuming that the user selects to print the coupon, the printer receives an instruction to print the paper coupon, and the user can hold the coupon by hand to consume for the second time in the park, for example, the user experiences the interest of strawberry picking again in the three-dimensional virtual picking park model scene.
According to the technical scheme, the VR virtual picking interactive experience system further comprises a discount acquisition module, the discount acquisition module is used for acquiring the discount, the increase of the benefit of a park is facilitated, and the system can be matched with a reward mechanism to further enhance interestingness.
On the basis of the above embodiments, for convenience of understanding, for example, the operation flow of the system is as follows:
(1) a user starts a VR system;
(2) and after the VR system is started, displaying the three-dimensional virtual strawberry garden scene in a computer screen. At this time, the user can walk around in real space at will by correctly wearing the HTC five device. Along with the random walk of the user, the position information of the user changes, the mobile information of the user is captured in real time by the laser locator of the HTC view, the mobile information is converted through script codes, and the user feels that the user autonomously roams in the virtual strawberry garden through VR glasses equipment.
(3) The user autonomously roams in the virtual strawberry garden, approaches the vicinity of the virtual strawberry rack, extends out of the right hand (the right hand is taken as an example) of the user, and picks up the strawberries. At the moment, the Leap Motion device in front of the VR glasses captures the information of the movement of the right hand of the real-world user, the virtual right hand simulates the real right hand action of the user in the virtual strawberry garden to pick up the strawberries (the action of the real hand is matched with the action of the virtual hand in real time, the user stretches out the right hand in the real world, the user is placed in front of the VR glasses, the Leap Motion device captures the information, and the user sees the virtual right hand in front of the eyes in the virtual scene).
(4) When the strawberry is touched by the virtual right hand, a collision response event is triggered, a highlight aperture appears at the edge of the strawberry, and the strawberry picking can be carried out on the representative. After the aperture appears, in the real world, the user grips the right hand and the action will be captured by the Leap Motion device. Accordingly, the right hand in the virtual environment is also gripped, and the virtual strawberry is held in the hand. Then, the user stretches out the right hand, and in the virtual environment, the right hand gripping the strawberry can also stretch out correspondingly, and the strawberry can drop in the virtual strawberry basket. At this point, the strawberry picking experience is completed once.
(5) The user completes a certain number of times according to the flow (4), and the system can calculate the number of picked strawberries. In a fixed time, the number of virtual strawberries picked by the user reaches a certain number, and the system prompts to obtain coupons. The discount amount of the coupon is determined by the number of strawberries picked by the user. The picking quantity is large, and the discount limit is large. The number is small, and the corresponding discount limit is low. The user can select to print the coupon, and the printer connected with the computer can print the paper coupon. The user can hold the paper coupon, and discount or purchase other commodities that strawberry was picked is carried out in the strawberry garden.
(6) The user exits the VR virtual experience system.
Fig. 2 is a flowchart of a VR virtual picking interactive experience method according to an embodiment of the present invention, and as shown in fig. 2, the VR virtual picking interactive experience method according to the embodiment of the present invention includes the following steps:
constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
real movement data of a user are collected in real time, and the movement track of the user in the three-dimensional virtual picking garden model is determined according to the real movement data of the user;
and real picking gesture actions of the user are collected in real time, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
The VR virtual picking interactive experience method provided by the embodiment of the present invention may specifically execute the VR virtual picking interactive experience system described in the above embodiment, and the technical principle and the beneficial effect thereof are similar, and reference may be specifically made to the above embodiment, which is not described herein again.
Based on the same inventive concept, an embodiment of the present invention provides an electronic device, which specifically includes the following contents, with reference to fig. 3: a processor 310, a communication interface 320, a memory 330, and a communication bus 340;
the processor 310, the communication interface 320 and the memory 330 complete communication with each other through the bus 340; the communication interface 320 is used for realizing information transmission among related devices such as modeling software, an intelligent manufacturing equipment module library and the like; the process 310 is configured to call a computer program in the memory 330, and the processor, when executing the computer program, implements the method provided by the above method embodiments, for example, constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden; real movement data of a user are collected in real time, and the movement track of the user in the three-dimensional virtual picking garden model is determined according to the real movement data of the user; and real picking gesture actions of the user are collected in real time, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
Based on the same inventive concept, another embodiment of the present invention further provides a non-transitory computer-readable storage medium, on which a computer program is stored, the computer program being implemented by a processor to perform the methods provided by the above method embodiments, for example, constructing a three-dimensional virtual picking garden model based on the real environment of a strawberry picking garden; real movement data of a user are collected in real time, and the movement track of the user in the three-dimensional virtual picking garden model is determined according to the real movement data of the user; and real picking gesture actions of the user are collected in real time, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
In addition, in the present invention, terms such as "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Moreover, in the present invention, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
Furthermore, in the description herein, reference to the description of the term "one embodiment," "some embodiments," "an example," "a specific example," or "some examples," etc., means that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above are not necessarily intended to refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples. Furthermore, various embodiments or examples and features of different embodiments or examples described in this specification can be combined and combined by one skilled in the art without contradiction.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.
Claims (10)
1. The utility model provides a virtual interactive experience system of picking of VR which characterized in that includes:
the virtual strawberry garden module is used for constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
the VR glasses interaction module is used for acquiring real movement data of a user in real time and determining a movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user;
and the somatosensory interaction module is used for acquiring real picking gesture actions of the user in real time and simulating the real picking gesture actions of the user by using the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
2. The VR virtual picking interactive experience system of claim 1, wherein the virtual strawberry garden module is specifically configured to:
determining the area size and the architectural style of the strawberry picking garden based on the real environment of the strawberry picking garden;
according to the pictures shot in the strawberry picking garden, a 3D Max modeling tool is adopted to construct a three-dimensional virtual picking garden model by combining the area size and the architectural style of the strawberry picking garden;
and storing the three-dimensional virtual picking garden model into a Unity scene, and adding an illumination effect and a texture effect into the Unity scene.
3. The VR virtual picking interactive experience system of claim 1, wherein the VR glasses interactive module is specifically configured to:
establishing a corresponding relation between VR glasses and the three-dimensional virtual picking garden model through a SteamVR plug-in, enabling a user to wear the VR glasses to move autonomously, and acquiring real moving data of the user in real time through the VR glasses;
and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user wearing the VR glasses.
4. The VR virtual picking interactive experience system of claim 1, wherein the somatosensory interaction module is specifically configured to:
acquiring real picking gesture actions of a user in real time, and if the real picking gesture actions of the user are used as the right extending hand touching the strawberry, simulating the gesture actions of the user extending the right hand touching the strawberry by a virtual three-dimensional palm in the three-dimensional virtual picking garden model; when the virtual three-dimensional palm touches the strawberry, the edge of the strawberry is provided with an aperture, which indicates that the strawberry can be picked;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are used for picking strawberries by stretching out the right hand, simulating the gesture actions of the user for picking strawberries by stretching out the right hand by using a virtual three-dimensional palm in the three-dimensional virtual picking garden model; the virtual three-dimensional palm simulates gesture motion of a user stretching out a right hand to pick the strawberries and is used as the right hand to hold the virtual strawberries;
continuously acquiring real picking gesture actions of the user in real time, and if the real picking gesture actions of the user are stretching out the right hand for holding the strawberry, simulating the gesture actions of stretching out the right hand for holding the strawberry by the user through a virtual three-dimensional palm in the three-dimensional virtual picking garden model;
if the gesture action that the virtual three-dimensional palm simulates the right hand of a user stretching and holding the strawberry in the three-dimensional virtual picking garden model is recognized, the strawberry falls into a virtual strawberry basket, and one-time picking experience is recorded.
5. The VR virtual picking interactive experience system of claim 4, the system further comprising:
and the discount acquisition module is used for recording task scores according to the picking experience times and acquiring corresponding consumption discounts by using a score algorithm model.
6. A VR virtual picking interactive experience method is characterized by comprising the following steps:
constructing a three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden;
real movement data of a user are collected in real time, and the movement track of the user in the three-dimensional virtual picking garden model is determined according to the real movement data of the user;
and real picking gesture actions of the user are collected in real time, and the real picking gesture actions of the user are simulated by the virtual three-dimensional palm in the three-dimensional virtual picking garden model.
7. The VR virtual picking interactive experience method of claim 1, wherein the building of the three-dimensional virtual picking garden model based on the real environment of the strawberry picking garden specifically comprises:
determining the area size and the architectural style of the strawberry picking garden based on the real environment of the strawberry picking garden;
according to the pictures shot in the strawberry picking garden, a 3D Max modeling tool is adopted to construct a three-dimensional virtual picking garden model by combining the area size and the architectural style of the strawberry picking garden;
and storing the three-dimensional virtual picking garden model into a Unity scene, and adding an illumination effect and a texture effect into the Unity scene.
8. The VR virtual picking interactive experience method of claim 1, wherein the real-time collecting of real movement data of a user, and determining a movement trajectory of the user in the three-dimensional virtual picking garden model according to the real movement data of the user specifically include:
establishing a corresponding relation between VR glasses and the three-dimensional virtual picking garden model through a SteamVR plug-in, enabling a user to wear the VR glasses to move autonomously, and acquiring real moving data of the user in real time through the VR glasses;
and determining the movement track of the user in the three-dimensional virtual picking garden model according to the real movement data of the user wearing the VR glasses.
9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of the VR virtual picking interactive experience method of any of claims 6 to 8.
10. A non-transitory computer readable storage medium having stored thereon a computer program, wherein the computer program when executed by a processor implements the steps of the VR virtual picking interactive experience method of any of claims 6 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010403237.XA CN111694426A (en) | 2020-05-13 | 2020-05-13 | VR virtual picking interactive experience system, method, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010403237.XA CN111694426A (en) | 2020-05-13 | 2020-05-13 | VR virtual picking interactive experience system, method, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111694426A true CN111694426A (en) | 2020-09-22 |
Family
ID=72477193
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010403237.XA Pending CN111694426A (en) | 2020-05-13 | 2020-05-13 | VR virtual picking interactive experience system, method, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111694426A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112363628A (en) * | 2020-11-27 | 2021-02-12 | 上海影创信息科技有限公司 | Virtual object interactive processing method and system and VR glasses thereof |
| CN113495628A (en) * | 2021-07-30 | 2021-10-12 | 浙江星秀农业科技有限公司 | Firefly simulation interaction method and system based on VR technology |
| CN114020978A (en) * | 2021-09-28 | 2022-02-08 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN114429741A (en) * | 2020-10-29 | 2022-05-03 | 陕西红星闪闪网络科技有限公司 | Real-time farm fruit picking experience system and method |
| CN115167586A (en) * | 2022-08-02 | 2022-10-11 | 四川轻化工大学 | Greenhouse simulation and environmental data monitoring system based on Unity3D |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110112934A1 (en) * | 2008-06-10 | 2011-05-12 | Junichi Ishihara | Sensory three-dimensional virtual real space system |
| CN104966430A (en) * | 2015-06-09 | 2015-10-07 | 北京农业智能装备技术研究中心 | Grape vine binding simulation training system and method |
| CN106066690A (en) * | 2016-05-27 | 2016-11-02 | 北京派得伟业科技发展有限公司 | Simulation rice transplanting method and apparatus based on body-sensing technology |
| CN208521255U (en) * | 2018-06-26 | 2019-02-19 | 杭州书微信息科技有限公司 | A kind of man-machine interactive system based on virtual reality |
-
2020
- 2020-05-13 CN CN202010403237.XA patent/CN111694426A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110112934A1 (en) * | 2008-06-10 | 2011-05-12 | Junichi Ishihara | Sensory three-dimensional virtual real space system |
| CN104966430A (en) * | 2015-06-09 | 2015-10-07 | 北京农业智能装备技术研究中心 | Grape vine binding simulation training system and method |
| CN106066690A (en) * | 2016-05-27 | 2016-11-02 | 北京派得伟业科技发展有限公司 | Simulation rice transplanting method and apparatus based on body-sensing technology |
| CN208521255U (en) * | 2018-06-26 | 2019-02-19 | 杭州书微信息科技有限公司 | A kind of man-machine interactive system based on virtual reality |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114429741A (en) * | 2020-10-29 | 2022-05-03 | 陕西红星闪闪网络科技有限公司 | Real-time farm fruit picking experience system and method |
| CN112363628A (en) * | 2020-11-27 | 2021-02-12 | 上海影创信息科技有限公司 | Virtual object interactive processing method and system and VR glasses thereof |
| CN113495628A (en) * | 2021-07-30 | 2021-10-12 | 浙江星秀农业科技有限公司 | Firefly simulation interaction method and system based on VR technology |
| CN114020978A (en) * | 2021-09-28 | 2022-02-08 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN114020978B (en) * | 2021-09-28 | 2024-06-11 | 北京市农林科学院信息技术研究中心 | Park digital roaming display method and system based on multi-source information fusion |
| CN115167586A (en) * | 2022-08-02 | 2022-10-11 | 四川轻化工大学 | Greenhouse simulation and environmental data monitoring system based on Unity3D |
| CN115167586B (en) * | 2022-08-02 | 2023-11-03 | 四川轻化工大学 | Greenhouse simulation and environmental data monitoring system based on Unity3D |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111694426A (en) | VR virtual picking interactive experience system, method, electronic equipment and storage medium | |
| US11532172B2 (en) | Enhanced training of machine learning systems based on automatically generated realistic gameplay information | |
| CN102656542B (en) | Camera navigation for presentations | |
| CN102470273B (en) | Visual representation expression based on player expression | |
| US9245177B2 (en) | Limiting avatar gesture display | |
| CN102473320B (en) | Bringing a visual representation to life via learned input from the user | |
| CN103207667B (en) | A kind of control method of human-computer interaction and its utilization | |
| CN105094335B (en) | Situation extracting method, object positioning method and its system | |
| CN106873778A (en) | A kind of progress control method of application, device and virtual reality device | |
| CN111771231A (en) | Matching mesh for avatars | |
| CN106462725A (en) | Systems and methods of monitoring activities at a gaming venue | |
| CN102201099A (en) | Motion-based interactive shopping environment | |
| CN106484115A (en) | For strengthening the system and method with virtual reality | |
| CN102262438A (en) | Gestures and gesture recognition for manipulating a user-interface | |
| CN102947774A (en) | Natural user input for driving interactive stories | |
| CN105279795A (en) | Augmented reality system based on 3D marker | |
| CN102622509A (en) | Three-dimensional game interaction system based on monocular video | |
| US11949934B2 (en) | Video distribution system, video distribution method, video distribution program, information processing terminal, and video viewing program | |
| CN104854623A (en) | Avatar-based virtual dressing room | |
| Kirakosian et al. | Near-contact person-to-3d character dance training: Comparing ar and vr for interactive entertainment | |
| CN111773669B (en) | Method and device for generating virtual object in virtual environment | |
| CN110308787A (en) | The AR interaction systems and method of a kind of multidimensional interactive identification in conjunction with chess/card game | |
| CN111694427A (en) | AR virtual honey shake interactive experience system, method, electronic equipment and storage medium | |
| CN111420400A (en) | Display method, device, equipment and medium for game elements in AR game | |
| Wang et al. | Construction of a somatosensory interactive system based on computer vision and augmented reality techniques using the kinect device for food and agricultural education |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200922 |