CN107688389B - VR grabbing action optimization method and device - Google Patents
VR grabbing action optimization method and device Download PDFInfo
- Publication number
- CN107688389B CN107688389B CN201710747577.2A CN201710747577A CN107688389B CN 107688389 B CN107688389 B CN 107688389B CN 201710747577 A CN201710747577 A CN 201710747577A CN 107688389 B CN107688389 B CN 107688389B
- Authority
- CN
- China
- Prior art keywords
- gesture
- grabbing
- action
- initial
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Multimedia (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a method and a device for optimizing VR grabbing actions, wherein the method comprises the following steps: creating a grabbing gesture of a hand model for executing grabbing action; carrying out parameter configuration on the grabbing gesture so as to enable the game development tool and the motion capture handle to be matched for use; the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture; and controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture so as to enable the hand model to smoothly move from the initial gesture to the target gesture. According to the VR grabbing action optimization method, the initial gesture can be smoothly moved to the target gesture through the intermediate gesture in the grabbing action process in a mode of calculating the intermediate gesture, so that the whole grabbing action is more real, the user experience is improved, and the technical problem that the existing VR grabbing action process is lack of reality is solved.
Description
Technical Field
The invention relates to the technical field of virtual reality application, in particular to a method and a device for optimizing VR grabbing actions.
Background
In existing virtual reality applications, such as the Oculus official case, the way to implement the grabbing action is generally by making a target gesture, directly switching to the target gesture when needed, or playing the target gesture in an animation manner.
In the grabbing actions of the two modes, if the experiencer plays games, such as shooting games, the attention of the experiencer is not focused on the grabbing process, but the experiencer observes whether enemies exist in the surrounding environment in a whole body and mind manner, and the influence on the experience effect of the experiencer is small. And if the experiencer experiences related projects, for example, the experiencer experiences the converter spot inspection projects, that is, the virtual reality device captures an operation tool in a virtual scene to simulate daily spot inspection work of the converter workshop device. At this time, the attention of the experiencer is focused on the gestures in the virtual scene, and the grabbing action processes in the above two ways can make the experiencer feel obtrusive.
In summary, the existing VR grabbing action process lacks authenticity, resulting in poor user experience.
Disclosure of Invention
In view of this, the present invention provides a method and an apparatus for optimizing VR grabbing actions to alleviate the technical problem of lack of reality in the existing VR grabbing action process.
In a first aspect, an embodiment of the present invention provides a method for optimizing a VR grabbing action, where the method includes:
creating a grab gesture for the hand model to perform a grab action, the grab gesture comprising: the initial gesture at the moment of starting the grabbing action and the target gesture at the moment of finishing the grabbing action;
performing parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable the game development tool and the motion capture handle to be matched for use;
based on the triggering of the motion capture handle, the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture;
and controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture so as to enable the hand model to smoothly move from the initial gesture to the target gesture.
With reference to the first aspect, an embodiment of the present invention provides a first possible implementation manner of the first aspect, where creating a grip gesture in which a hand model performs a grip action includes:
acquiring the hand model and a function library provided by virtual reality equipment, wherein the function library comprises information of communication functions of the motion capture handle and the game development tool;
and controlling the hand model to simulate the gripping action according to the information in the function library through the action capturing handle, thereby obtaining the capturing gesture of the capturing action.
With reference to the first aspect, an embodiment of the present invention provides a second possible implementation manner of the first aspect, where controlling, by the motion capture handle, the hand model to simulate a gripping motion according to information in the function library, so as to obtain a gripping gesture of the gripping motion includes:
controlling the hand model in the game development tool to execute corresponding actions based on a first action instruction sent by a developer through the action capture handle so as to determine a preset grabbing action;
and reserving the preset grabbing action to obtain the gesture of the grabbing action.
With reference to the first aspect, an embodiment of the present invention provides a third possible implementation manner of the first aspect, wherein interpolating, by an interpolation algorithm, the initial gesture and the target gesture based on the triggering of the motion capture handle includes:
receiving a second motion instruction sent by the motion capture handle;
after the second action instruction is received, calculating the position data of the initial gesture and the position data of the target gesture through the interpolation algorithm to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
With reference to the first aspect, an embodiment of the present invention provides a fourth possible implementation manner of the first aspect, where controlling, according to the position data indicated by the initial gesture, the intermediate gesture, and the target gesture, the hand model to sequentially execute the grabbing actions includes:
and controlling the hand model to sequentially reach the positions indicated by the initial gesture, the intermediate gesture and the target gesture so as to execute the grabbing action.
With reference to the first aspect, an embodiment of the present invention provides a fifth possible implementation manner of the first aspect, where the number of the intermediate gestures is multiple, and each intermediate gesture corresponds to one piece of location data.
In a second aspect, an embodiment of the present invention further provides an apparatus for optimizing a VR grabbing action, where the apparatus includes:
a creation module for creating a grab gesture for a hand model to perform a grab action, the grab gesture comprising: the initial gesture at the moment of starting the grabbing action and the target gesture at the moment of finishing the grabbing action;
the parameter configuration module is used for carrying out parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable the game development tool and the motion capture handle to be matched for use;
the difference operation module is used for carrying out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm based on the game development tool triggered by the motion capture handle to obtain an intermediate gesture between the initial gesture and the target gesture;
and the control module is used for controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture so as to enable the hand model to smoothly move from the initial gesture to the target gesture.
With reference to the second aspect, an embodiment of the present invention provides a first possible implementation manner of the second aspect, where the creating module includes:
the acquisition unit is used for acquiring the hand model and a function library provided by virtual reality equipment, wherein the function library comprises information of communication functions of the motion capture handle and the game development tool;
and the first control unit is used for controlling the hand model to simulate the grabbing action according to the information in the function library through the action capturing handle, so that the grabbing gesture of the grabbing action is obtained.
With reference to the second aspect, an embodiment of the present invention provides a second possible implementation manner of the second aspect, where the first control unit includes:
the control subunit is used for controlling the hand model in the game development tool to execute corresponding actions based on a first action instruction sent by a developer through the action capture handle so as to determine a preset capture action;
and the holding subunit is used for holding the preset grabbing action so as to obtain the gesture of the grabbing action.
With reference to the second aspect, an embodiment of the present invention provides a third possible implementation manner of the second aspect, where the difference operation module includes:
the receiving unit is used for receiving a second motion instruction sent by the motion capture handle;
and the computing unit is used for computing the position data of the initial gesture and the position data of the target gesture through the interpolation algorithm after the second action instruction is received, so as to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
The embodiment of the invention has the following beneficial effects: the embodiment of the invention provides a VR grabbing action optimization method and a VR grabbing action optimization device, wherein the method comprises the following steps: creating a grab gesture of the hand model to perform a grab action, the grab gesture comprising: an initial gesture at the moment of starting the grabbing action and a target gesture at the moment of finishing the grabbing action; carrying out parameter configuration on the grabbing gesture so as to enable the game development tool and the motion capture handle to be matched for use; based on the triggering of the motion capture handle, the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture; and controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture so as to enable the hand model to smoothly move from the initial gesture to the target gesture.
In the existing VR grabbing action process, a target gesture is generally made, the target gesture is directly switched to when needed, or the target gesture is played in an animation mode, and the grabbing actions of the two modes lack authenticity. Compared with the existing VR grabbing action process, the VR grabbing action optimization method comprises the steps of firstly creating an initial gesture and a target gesture for executing grabbing actions, then configuring parameters of the grabbing gestures to enable a game development tool and a motion capture handle to be matched for use, further, based on triggering of the motion capture handle, carrying out difference operation on the initial gesture and the target gesture by the game development tool through an interpolation algorithm to obtain an intermediate gesture, and finally controlling hand models to sequentially execute the grabbing actions according to position data indicated by the initial gesture, the intermediate gesture and the target gesture to enable the hand models to smoothly move to the target gesture from the initial gesture. According to the VR grabbing action optimization method, the initial gesture can be smoothly moved to the target gesture through the intermediate gesture in the grabbing action process in a mode of calculating the intermediate gesture, so that the whole grabbing action is more real, the user experience is improved, and the technical problem that the existing VR grabbing action process is lack of reality is solved.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
In order to make the aforementioned and other objects, features and advantages of the present invention comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a VR grabbing action optimization method according to an embodiment of the present invention;
fig. 2 is a flowchart of a grabbing gesture for simulating a grabbing motion by a motion capture handle control hand model according to information in a function library, so as to obtain a grabbing motion according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating an interpolation operation performed by the over-interpolation algorithm on the initial gesture and the target gesture according to the embodiment of the present invention;
fig. 4 is a schematic structural diagram of an apparatus for optimizing VR grabbing action according to an embodiment of the present invention.
Icon:
11-a creation module; 12-a parameter configuration module; 13-a difference operation module; 14-control module.
Detailed Description
To make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings, and it is apparent that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
To facilitate understanding of the embodiment, a detailed description is first given of an optimization method for VR capture according to the embodiment of the present invention.
The first embodiment is as follows:
a method for optimizing VR grabbing actions, referring to fig. 1, the method includes:
s101, creating a hand model to execute a grabbing gesture of a grabbing action, wherein the grabbing gesture comprises the following steps: an initial gesture at the moment of starting the grabbing action and a target gesture at the moment of finishing the grabbing action;
in the embodiment of the present invention, the creating process is performed in a game development tool, and specifically, the game development tool used in the embodiment of the present invention is a unity3d engine. The grabbing gestures are pre-made, and after the grabbing gestures are made, the grabbing gestures can be directly obtained and used as resources when used every time.
S102, carrying out parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable a game development tool and a motion capture handle to be matched for use;
after the game development tool obtains the grabbing gesture, parameter configuration needs to be performed on the grabbing gesture, and after the configuration is completed, the game development tool and the motion capture handle can be used in a matched mode, namely, the motion capture handle can control the grabbing gesture in the game development tool to execute grabbing action.
S103, based on the triggering of the motion capture handle, the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture;
after the configuration is completed and a certain action is triggered by the action capture handle, the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture.
And S104, controlling the hand model to sequentially execute grabbing actions according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture, so that the hand model smoothly moves from the initial gesture to the target gesture.
After the intermediate gesture is obtained, the game development tool can control the hand models to sequentially execute the grabbing action according to the initial gesture, the intermediate gesture and the position data indicated by the target gesture, so that the hand models smoothly move to the target gesture from the initial gesture.
It should be noted that the above processes are all completed in the game development tool.
In the existing VR grabbing action process, a target gesture is generally made, the target gesture is directly switched to when needed, or the target gesture is played in an animation mode, and the grabbing actions of the two modes lack authenticity. Compared with the existing VR grabbing action process, the VR grabbing action optimization method comprises the steps of firstly creating an initial gesture and a target gesture for executing grabbing actions, then configuring parameters of the grabbing gestures to enable a game development tool and a motion capture handle to be matched for use, further, based on triggering of the motion capture handle, carrying out difference operation on the initial gesture and the target gesture by the game development tool through an interpolation algorithm to obtain an intermediate gesture, and finally controlling hand models to sequentially execute the grabbing actions according to position data indicated by the initial gesture, the intermediate gesture and the target gesture to enable the hand models to smoothly move to the target gesture from the initial gesture. According to the VR grabbing action optimization method, the initial gesture can be smoothly moved to the target gesture through the intermediate gesture in the grabbing action process in a mode of calculating the intermediate gesture, so that the whole grabbing action is more real, the user experience is improved, and the technical problem that the existing VR grabbing action process is lack of reality is solved.
In the embodiment of the invention, the grabbing gesture for creating the hand model to execute the grabbing action is different from the creating mode in the prior art, when the grabbing gesture is created, an artist generally makes the gesture, the process is complicated, the labor is wasted, and the reality of the made grabbing gesture is poor. In an alternative embodiment, creating a grip gesture for the hand model to perform the grip action includes: the method comprises the following steps:
acquiring a hand model and a function library provided by virtual reality equipment, wherein the function library comprises information of a communication function of a motion capture handle and a game development tool;
in the embodiment of the present invention, the virtual display device is a device provided by Oculus.
And controlling the hand model to simulate the grasping action according to the information in the function library by the action capturing handle, thereby obtaining the capturing gesture of the capturing action.
Specifically, the motion capture handle is Oculus touch here. When creating the grabbing gesture, the motion capture handle controls a hand model in a virtual scene (i.e. unity3d) to simulate the grabbing motion, and then the grabbing gesture of the grabbing motion is obtained.
After obtaining the hand model and the function library provided by the virtual reality device, the motion capture handle is used to control the hand model to simulate the grasping motion according to the information in the function library, and in an alternative embodiment, referring to fig. 2, the motion capture handle is used to control the hand model to simulate the grasping motion according to the information in the function library, so that the specific process of obtaining the grasping gesture of the grasping motion is described as follows:
s201, controlling a hand model in a game development tool to execute corresponding actions based on a first action instruction sent by a developer through an action capture handle so as to determine a preset capture action;
specifically, the developer controls the motion capture handle to move, so that the hand model in the virtual scene also executes corresponding movement, when the movement obtains a required gesture, the pause button can be clicked, and the required gesture stops in the virtual scene to obtain a preset capture action.
S202, reserving the preset grabbing action to obtain the gesture of the grabbing action.
After the preset grabbing action is obtained, the unit 3d includes a preset reserving function, so that the preset grabbing action can be reserved, the gesture of the grabbing action is obtained, and the gesture is stored as a resource.
After the parameter configuration is performed on the grabbing gesture, the interpolation operation may be performed on the initial gesture and the target gesture through the interpolation algorithm based on the trigger of the motion capture handle, and in an optional embodiment, referring to fig. 3, the interpolation operation performed on the initial gesture and the target gesture through the interpolation algorithm based on the trigger of the motion capture handle includes the following steps:
s301, receiving a second motion instruction sent by a motion capture handle;
the second action instruction is an action instruction when a relevant operation is performed in the virtual scene, such as: and the grabbing operation tool carries out point inspection operation on the converter workshop equipment.
S302, after the second action instruction is received, calculating the position data of the initial gesture and the position data of the target gesture through an interpolation algorithm to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
After the second action instruction is received, the position data of the initial gesture and the position data of the target gesture can be calculated through an interpolation algorithm, and the position data of the intermediate gesture is obtained.
Optionally, controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture includes:
and controlling the hand model to sequentially reach the positions indicated by the initial gesture, the intermediate gesture and the target gesture so as to execute the grabbing action.
Specifically, the number of the intermediate gestures is multiple, and each intermediate gesture corresponds to one piece of position data.
According to the VR grabbing action optimization method, when the grabbing gesture is created, the grabbing gesture is obtained by simulating the grabbing action in a game development tool, the process is simple and rapid, the obtained grabbing gesture is more real, and the development efficiency is improved; and the position of the intermediate gesture is calculated between the initial gesture and the target gesture, so that the process of the hand model from the initial gesture to the target gesture is smoother and more real, and the user has better experience in a virtual scene.
Example two:
an apparatus for optimizing VR grabbing actions, referring to fig. 4, the apparatus comprising:
a creating module 11, configured to create a grabbing gesture of the hand model for performing a grabbing action, where the grabbing gesture includes: an initial gesture at the moment of starting the grabbing action and a target gesture at the moment of finishing the grabbing action;
the parameter configuration module 12 is used for performing parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable the game development tool and the motion capture handle to be matched for use;
the difference value operation module 13 is used for performing interpolation operation on the initial gesture and the target gesture by the game development tool through an interpolation algorithm based on the triggering of the motion capture handle to obtain an intermediate gesture between the initial gesture and the target gesture;
and the control module 14 is used for controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture so as to enable the hand model to smoothly move from the initial gesture to the target gesture.
In the embodiment of the invention, an initial gesture and a target gesture for executing a grabbing action are created, then the grabbing gesture is subjected to parameter configuration so that a game development tool and a motion capture handle can be used in a matched mode, further, based on the triggering of the motion capture handle, the game development tool carries out difference operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture, and finally, according to position data indicated by the initial gesture, the intermediate gesture and the target gesture, a hand model is controlled to execute the grabbing action in sequence so that the hand model moves to the target gesture smoothly from the initial gesture. In the embodiment of the invention, the initial gesture can be smoothly moved to the target gesture through the intermediate gesture in the process of performing the grabbing action by calculating the intermediate gesture, so that the whole grabbing action is more real, the user experience is improved, and the technical problem that the existing VR grabbing action process is lack of authenticity is solved.
Optionally, the creating module includes:
the system comprises an acquisition unit, a display unit and a control unit, wherein the acquisition unit is used for acquiring a hand model and a function library provided by virtual reality equipment, and the function library comprises information of a communication function between a motion capture handle and a game development tool;
and the first control unit is used for simulating the grabbing action by controlling the hand model through the action capturing handle according to the information in the function library, so that the grabbing gesture of the grabbing action is obtained.
Optionally, the first control unit comprises:
the control subunit is used for controlling a hand model in the game development tool to execute corresponding actions based on a first action instruction sent by a developer through the action capture handle so as to determine a preset capture action;
and the retention subunit is used for retaining the preset grabbing action so as to obtain the gesture of the grabbing action.
Optionally, the difference operation module includes:
the receiving unit is used for receiving a second motion instruction sent by the motion capture handle;
and the computing unit is used for computing the position data of the initial gesture and the position data of the target gesture through an interpolation algorithm after receiving the second action instruction to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
Optionally, the control module comprises:
and the second control unit is used for controlling the hand model to sequentially reach the positions indicated by the initial gesture, the middle gesture and the target gesture so as to execute the grabbing action.
Optionally, the number of the intermediate gestures is multiple, and each intermediate gesture corresponds to one position data.
The contents of the second embodiment can refer to the contents of the first embodiment, and are not described herein again.
The computer program product of the method and the apparatus for optimizing VR grabbing according to the embodiments of the present invention includes a computer readable storage medium storing a program code, where instructions included in the program code may be used to execute the method described in the foregoing method embodiments, and specific implementation may refer to the method embodiments, and will not be described herein again.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the system and the apparatus described above may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In addition, in the description of the embodiments of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance.
Finally, it should be noted that: the above-mentioned embodiments are only specific embodiments of the present invention, which are used for illustrating the technical solutions of the present invention and not for limiting the same, and the protection scope of the present invention is not limited thereto, although the present invention is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: any person skilled in the art can modify or easily conceive the technical solutions described in the foregoing embodiments or equivalent substitutes for some technical features within the technical scope of the present disclosure; such modifications, changes or substitutions do not depart from the spirit and scope of the embodiments of the present invention, and they should be construed as being included therein. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (9)
1. A method for optimizing VR grab actions, the method comprising:
creating a grab gesture for the hand model to perform a grab action, the grab gesture comprising: the initial gesture at the moment of starting the grabbing action and the target gesture at the moment of finishing the grabbing action;
performing parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable the game development tool and the motion capture handle to be matched for use;
based on the triggering of the motion capture handle, the game development tool carries out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm to obtain an intermediate gesture between the initial gesture and the target gesture;
and controlling the hand models to sequentially execute the grabbing actions according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture, and controlling the hand models to sequentially reach the positions indicated by the initial gesture, the intermediate gesture and the target gesture so as to execute the grabbing actions, so that the hand models smoothly move from the initial gesture to the target gesture.
2. The method of claim 1, wherein creating a grab gesture for a hand model to perform a grab action comprises:
acquiring the hand model and a function library provided by virtual reality equipment, wherein the function library comprises information of communication functions of the motion capture handle and the game development tool;
and controlling the hand model to simulate the gripping action according to the information in the function library through the action capturing handle, thereby obtaining the capturing gesture of the capturing action.
3. The method of claim 2, wherein controlling the hand model to simulate a grasping motion according to the information in the function library via the motion capture handle to obtain a grasping gesture of the grasping motion comprises:
controlling the hand model in the game development tool to execute corresponding actions based on a first action instruction sent by a developer through the action capture handle so as to determine a preset grabbing action;
and reserving the preset grabbing action to obtain the gesture of the grabbing action.
4. The method of claim 1, wherein interpolating the initial gesture and the target gesture by an interpolation algorithm based on the triggering of the motion capture handle comprises:
receiving a second motion instruction sent by the motion capture handle;
after the second action instruction is received, calculating the position data of the initial gesture and the position data of the target gesture through the interpolation algorithm to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
5. The method of claim 1, wherein the number of the intermediate gestures is plural, and each intermediate gesture corresponds to one position data.
6. An apparatus for optimizing VR grabbing actions, the apparatus comprising:
a creation module for creating a grab gesture for a hand model to perform a grab action, the grab gesture comprising: the initial gesture at the moment of starting the grabbing action and the target gesture at the moment of finishing the grabbing action;
the parameter configuration module is used for carrying out parameter configuration on the grabbing gesture based on a configuration instruction sent by a developer so as to enable the game development tool and the motion capture handle to be matched for use;
the difference operation module is used for carrying out interpolation operation on the initial gesture and the target gesture through an interpolation algorithm by the game development tool based on the triggering of the motion capture handle to obtain an intermediate gesture between the initial gesture and the target gesture;
and the control module is used for controlling the hand model to sequentially execute the grabbing action according to the position data indicated by the initial gesture, the intermediate gesture and the target gesture, and controlling the hand model to sequentially reach the positions indicated by the initial gesture, the intermediate gesture and the target gesture so as to execute the grabbing action, so that the hand model smoothly moves from the initial gesture to the target gesture.
7. The apparatus of claim 6, wherein the creation module comprises:
the acquisition unit is used for acquiring the hand model and a function library provided by virtual reality equipment, wherein the function library comprises information of communication functions of the motion capture handle and the game development tool; and the first control unit is used for controlling the hand model to simulate the grabbing action according to the information in the function library through the action capturing handle, so that the grabbing gesture of the grabbing action is obtained.
8. The apparatus of claim 7, wherein the first control unit comprises:
the control subunit is used for controlling the hand model in the game development tool to execute corresponding actions based on a first action instruction sent by a developer through the action capture handle so as to determine a preset capture action;
and the holding subunit is used for holding the preset grabbing action so as to obtain the gesture of the grabbing action.
9. The apparatus of claim 8, wherein the difference operation module comprises:
the receiving unit is used for receiving a second motion instruction sent by the motion capture handle;
and the computing unit is used for computing the position data of the initial gesture and the position data of the target gesture through the interpolation algorithm after the second action instruction is received, so as to obtain the position data of the intermediate gesture between the initial gesture and the target gesture.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710747577.2A CN107688389B (en) | 2017-08-25 | 2017-08-25 | VR grabbing action optimization method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710747577.2A CN107688389B (en) | 2017-08-25 | 2017-08-25 | VR grabbing action optimization method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107688389A CN107688389A (en) | 2018-02-13 |
| CN107688389B true CN107688389B (en) | 2021-08-13 |
Family
ID=61155472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710747577.2A Active CN107688389B (en) | 2017-08-25 | 2017-08-25 | VR grabbing action optimization method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107688389B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113450438A (en) * | 2020-03-24 | 2021-09-28 | 深圳市灼华互娱科技有限公司 | Virtual character driving method and device based on motion capture and computer equipment |
| CN112121410B (en) * | 2020-10-22 | 2024-04-12 | 深圳市瑞立视多媒体科技有限公司 | VR game-based cabinet-entering method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7843429B2 (en) * | 1997-08-22 | 2010-11-30 | Pryor Timothy R | Interactive video based games using objects sensed by TV cameras |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| CN104798104A (en) * | 2012-12-13 | 2015-07-22 | 英特尔公司 | Gesture pre-processing of video stream using a markered region |
| CN105930785A (en) * | 2016-04-15 | 2016-09-07 | 丁盛 | Intelligent concealed-type interaction system |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102039031B (en) * | 2010-12-28 | 2012-07-04 | 华中科技大学 | Multifunctional rehabilitation system for hands based on virtual reality |
| CN102254475B (en) * | 2011-07-18 | 2013-11-27 | 广州赛宝联睿信息科技有限公司 | Method for realizing endoscopic minimal invasive surgery simulated training 3D platform system |
| US20140340498A1 (en) * | 2012-12-20 | 2014-11-20 | Google Inc. | Using distance between objects in touchless gestural interfaces |
-
2017
- 2017-08-25 CN CN201710747577.2A patent/CN107688389B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7843429B2 (en) * | 1997-08-22 | 2010-11-30 | Pryor Timothy R | Interactive video based games using objects sensed by TV cameras |
| CN102024151A (en) * | 2010-12-02 | 2011-04-20 | 中国科学院计算技术研究所 | Training method of gesture motion recognition model and gesture motion recognition method |
| CN104798104A (en) * | 2012-12-13 | 2015-07-22 | 英特尔公司 | Gesture pre-processing of video stream using a markered region |
| CN105930785A (en) * | 2016-04-15 | 2016-09-07 | 丁盛 | Intelligent concealed-type interaction system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107688389A (en) | 2018-02-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108597530B (en) | Sound reproducing method and apparatus, storage medium and electronic apparatus | |
| CN107911614B (en) | A kind of image capturing method based on gesture, device and storage medium | |
| US8545325B2 (en) | Communication game system | |
| CN108273265A (en) | The display methods and device of virtual objects | |
| CN103795931B (en) | A kind of information processing method and electronic equipment | |
| Gutierrez et al. | IMA-VR: A multimodal virtual training system for skills transfer in Industrial Maintenance and Assembly tasks | |
| WO2019057150A1 (en) | Information exchange method and apparatus, storage medium and electronic apparatus | |
| EP2877255A1 (en) | User-based mini-game generation and distribution | |
| CN108525305A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN109983424B (en) | Method and device for selecting object in virtual reality scene and virtual reality equipment | |
| CN110389659A (en) | The system and method for dynamic haptic playback are provided for enhancing or reality environment | |
| CN107688389B (en) | VR grabbing action optimization method and device | |
| CN104281265A (en) | Application program control method, application program control device and electronic equipment | |
| CN108829468A (en) | A kind of three-dimensional space model jumps processing method and processing device | |
| CN109308437A (en) | Action recognition error correction method, electronic equipment, storage medium | |
| CN105975072A (en) | Method, device and system for identifying gesture movement | |
| CN111798549A (en) | Dance editing method and device and computer storage medium | |
| CN114344903A (en) | Method, terminal and storage medium for controlling virtual object to pick up virtual item | |
| CN112121406A (en) | Object control method and device, storage medium and electronic device | |
| CN106325505B (en) | Control method and device based on viewpoint tracking | |
| CN108654088B (en) | Program debugging method and device, storage medium and electronic device | |
| CN108762726B (en) | Basic framework development platform and method for designing game through platform | |
| US8827817B2 (en) | Apparatus and method for collecting game data | |
| CN108543308A (en) | The selection method and device of virtual objects in virtual scene | |
| CN109584148A (en) | A kind of method and apparatus handling two-dimentional interface in VR equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |