TW201830090A - Method and device for simulating human body in virtual reality, storage medium, and electronic device - Google Patents

Abstract

The present application discloses a method and device for simulating human body in virtual reality, a storage medium, and an electronic device. The method includes obtaining a human body model shown in virtual reality, wherein the human body model is used to simulate an objective human body in a real environment; obtaining position information of all of trackers in a tracker set of the objective human body, wherein the tracker set includes at lease one tracker disposed on a predetermined body part of the objective human body; and controlling the human body model to move in the virtual reality based on the obtained position information to simulate movement of the objective human body using the human body model. The present application solves a technical problem that reality simulation for human body movements is unable to be carried out in the virtual reality.

Description

 Human body simulation method and device, storage medium and electronic device in virtual reality  

The present application relates to the field of virtual reality, and particularly relates to a simulation method and device, a storage medium and an electronic device for a human body in a virtual reality.

With the breakthrough of virtual reality technology, civilian home devices have emerged as an important part of entertainment life, allowing people to experience an unprecedented feeling. In order to make people better interact better in the scene, it is closer to the real feeling. The real interaction between people in the virtual environment is especially important, and the first step of real interaction is to ask for image movement and humanity. Close.

In the existing virtual reality interactive games, most of them use non-real humans to represent the characters, but the simulated characters are either physically unable to move, or by playing animations, and some directly canceling the arms. And the legs, only the head, body and hands, can not realistically simulate the movement of the characters, affecting the user experience.

In response to the above problems, no effective solution has been proposed yet.

The embodiment of the present application provides a simulation method and device for a human body in a virtual reality, a storage medium, and an electronic device, so as to at least solve the technical problem that the virtual reality cannot perform real simulation on the human body motion.

According to an aspect of the embodiments of the present application, a method for simulating a human body in a virtual reality includes: acquiring a human body model displayed in a virtual reality, wherein the human body model is used to perform a target human body in a real environment. Simulating; acquiring location information of all trackers in the set of trackers of the target human body, wherein the set of trackers includes at least one tracker disposed on a predetermined body part of the target human body; and according to the acquired position The mannequin in the message control virtual reality is moved to cause the human body model to simulate the action of the target human body.

According to another aspect of the embodiments of the present application, a simulation apparatus for a human body in a virtual reality is provided, including: a first acquiring unit, configured to acquire a human body model displayed in a virtual reality, wherein the human body model is used Simulating a target human body in a real environment; a second acquiring unit, configured to acquire location information of all trackers in the tracker set of the target human body, wherein the tracker set includes at least one set in the target a tracker on the predetermined body part of the human body; and a control unit configured to control the mannequin in the virtual reality to move according to the acquired position information, so that the human body model simulates the action of the target human body.

In the embodiment of the present application, a human body model displayed in a virtual reality is acquired, wherein the human body model is used to simulate a target human body in a real environment; and all trackers in the tracker set of the target human body are acquired. Location information, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and controlling the human body model in the virtual reality to move according to the acquired position information, The human body model is simulated to simulate the movement of the target human body, and the human body model in the virtual reality is controlled to move according to the position information of the tracker on the predetermined body part of the target human body, thereby achieving control of the human body model to simulate the target human body motion. The purpose is to realize the technical effect of simulating the movement of the target human body according to the position information of the predetermined body part of the target human body, thereby solving the technical problem that the virtual reality cannot perform real simulation on the human body motion.

S202~S206‧‧‧Steps

The drawings are intended to provide a further understanding of the present application, and are intended to be a part of this application. In the drawings: FIG. 1 is a schematic diagram of a scene layout of a human body simulation method in an optional virtual reality according to an embodiment of the present application; FIG. 2 is an optional virtual reality according to an embodiment of the present application. A flowchart of a simulation method of a human body; FIG. 3 is a schematic diagram of a standard human skeleton according to an embodiment of the present application; and FIG. 4 is a schematic diagram of a process of controlling a target node to move with a parent node of a target node according to an embodiment of the present application; 5 is a schematic diagram of a partial skeleton including a head, a body and legs according to an embodiment of the present application; FIG. 6 is a schematic diagram of a partial skeleton including both hands and arms according to an embodiment of the present application; FIG. 7 is a diagram according to the present invention; FIG. 8 is a schematic diagram of a simplified simulation of a human body in a virtual reality according to an embodiment of the present application; FIG. 9 is a schematic diagram of a human body simulation apparatus according to an embodiment of the present application; Schematic diagram of the terminal.

The technical solutions in the embodiments of the present application are clearly and completely described in the following, in which the embodiments of the present application are described in detail in the embodiments of the present application. The examples are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are intended to be within the scope of the application.

It should be noted that the terms "first", "second" and the like in the specification and the claims of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or order. It is to be understood that the materials so used are interchangeable under appropriate circumstances, and that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "comprises" and "comprises" and "the" and "the" are intended to cover a non-exclusive inclusion, for example, a process, method, system, product, or device that comprises a series of steps or units is not necessarily limited to Those steps or units may include other steps or units not explicitly listed or inherent to such processes, methods, products or devices.

In accordance with an embodiment of the present application, an embodiment of a method that can be performed by an embodiment of the apparatus of the present application is provided. It is noted that the steps illustrated in the flowchart of the drawings may be in a computer system such as a set of computer executable instructions. The steps shown and described may be performed in a different order than the ones described herein, although the logical order is shown in the flowchart.

According to an embodiment of the present application, a simulation method of a human body in a virtual reality is provided.

The method can be applied to various virtual reality devices by setting a tracker on the target human body to obtain a position information of a predetermined body part of the target human body, and controlling the human body model in the virtual reality to move according to the acquired position information. In order to make the human body model simulate various actions of the target human body. 1 is a schematic diagram of a scene layout of a human body simulation method in an optional virtual reality according to an embodiment of the present application. As shown in FIG. 1 , a tracker is disposed on a predetermined body part of a target human body, wherein the target The head of the human body is wearing a visual helmet (equivalent to a head tracker), and the left and right hands of the target human body respectively hold a handle (equivalent to a hand tracker), when the target human body performs any action in a predetermined area. The virtual reality device shown in FIG. 1 acquires the position information of the visual helmet and the two handles through the position information receiving device, thereby acquiring the position information of the target human head and the hand, and controlling according to the acquired position information. The human body model in the virtual reality moves correspondingly to simulate various actions made by the target human body, thereby realizing the technique of simulating the movement of the target human body according to the position information of the predetermined body part of the target human body. The effect, in turn, solves the technical problem that the virtual reality cannot perform real simulation on human motion, so that people are in virtual reality. The interactions more realistic feeling.

It should be noted that, when the simulation method of the human body in the virtual reality provided by the embodiment of the present application is applied to various virtual reality devices, the virtual reality device should include a necessary tracker to obtain a predetermined body part of the target human body. Position information, such as: head tracker, hand tracker, foot tracker, etc., wherein the head tracker is mainly used to obtain the head position information of the target human body, and then control the human body model according to the head position information. Simulate the movement of the head, neck and torso of the target human body. The hand tracker is used to obtain the position information of the hands of the target human body, and then control the hands and arms of the human body model to the target human body according to the position information of the hands. The motion is simulated, and the foot tracker is used to obtain the position information of the target human body's feet, and then according to the position information of the feet, the human body model is controlled to simulate the motion of the target body's feet and legs. The tracker included in the virtual reality device should include at least a head tracker to control the body model to simulate the body motion of the target human body through at least the head position information of the target human body. The virtual reality device shown in FIG. 1 includes a head tracker and a hand tracker, and the virtual reality device can simulate the hands and arms of the target human body through the hand tracker, thereby making the human body The model's simulation of the target human body is closer to reality. Similarly, the virtual reality device can include both a head tracker, a hand tracker, and a foot tracker to control the body model to simulate the body movements of the target human body, both hands and arms, and both feet and legs.

FIG. 2 is a flowchart of a method for simulating a human body in an optional virtual reality according to an embodiment of the present application. The simulation method of the human body in the virtual reality provided by the embodiment of the present application is specifically described below with reference to FIG. 2 . As shown in FIG. 2, the simulation method of the human body in the virtual reality mainly includes the following steps S202 to S206:

Step S202: Acquire a human body model displayed in a virtual reality, wherein the human body model is used to simulate a target human body in a real environment.

Virtual reality technology is a computer simulation system that can create a virtual world. It uses a computer to generate a multi-source information fusion and interactive 3D dynamic vision simulation environment, through the simulation of the user's physical behavior in the environment. The household is immersed in the environment. The human body model displayed in the virtual reality is used to simulate the user's entity behavior, simulate the user model by controlling the human body model, and make the human body model simulate the action closer to the user's entity behavior, thereby making the user virtual reality. The interaction in the environment is more realistic and enhances the user experience.

Step S204: Acquire location information of all trackers in the tracker set of the target human body, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body.

In the embodiment of the present application, the tracker is disposed on a predetermined body part of the target human body, and when the predetermined body part of the target human body acts, the position of the tracker also changes accordingly, and therefore, the position information of the tracker is the target. The position information of the body's predetermined body part. As shown in Fig. 1, when the target human body turns the head, the orientation of the helmet worn by the target human body (equivalent to the head tracker) also changes, and according to the orientation of the helmet, the head orientation of the target human body can be obtained; When the target human body raises the arm, the position of the handle held by the target human body (equivalent to the hand tracker) also changes, and according to the position of the handle held by the target human body, the position of the hand and the arm of the target human body can be obtained. .

Step S206, controlling the human body model in the virtual reality according to the acquired position information to move, so that the human body model simulates the action of the target human body.

According to the principle of inverse dynamics, the position of the n-level parent bone on the bone chain in which it is located can be determined by first determining the position of the child bone, and then determining the position of the entire bone chain. In the embodiment of the present application, when the human body model is controlled to simulate the target human body, the position information of each part of the human body model is determined according to the acquired position information of the tracker, and then the position of other parts is derived according to the inverse dynamics. The message is used to determine the positional information of all parts of the entire human body model, so that the human body model can realistically simulate the movement of the target human body.

In the embodiment of the present application, the human body model displayed in the virtual reality is acquired, wherein the human body model is used to simulate the target human body in the real environment; and the position information of all the trackers in the tracker set of the target human body is acquired, The tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and the human body model in the virtual reality is controlled to be moved according to the acquired position information, so that the human body model simulates the action of the target human body, The position information of the tracker on the predetermined body part of the target human body controls the human body model in the virtual reality to move, and achieves the purpose of controlling the human body model to simulate the target human body motion, thereby realizing the position information of the predetermined body part according to the target human body. The technical effect of simulating the human body model to simulate the movement of the target human body, thereby solving the technical problem that the virtual reality cannot perform real simulation on the human body motion.

Optionally, the location information includes a location of the tracker, and controlling the human body model in the virtual reality to perform the moving according to the acquired location information includes: using the location represented by any one of the acquired location information as the target location; Determining whether a distance between a current location of the target node of the human body model and the target location is greater than a first predetermined threshold, wherein the target node is associated with a predetermined body part of the target human body corresponding to the target location; if the current location and target of the target node The distance between the positions is greater than the first preset threshold, and then all the parent nodes of the control target node and the target node are moved, wherein the target node and the parent node are used to simulate multiple bones of one bone chain in the target human body.

As an optional implementation manner of the embodiment of the present application, the position information of the tracker includes the position of the tracker, and the position of the tracker is the target position, and the corresponding part of the human body model used for simulating the target human body is used as the target node. Then, controlling the human body model to simulate the target human body requires controlling the target node to move to the target position. In the embodiment of the present application, a preset threshold is set. If the distance between the target node and the target location is greater than the preset threshold, the target node needs to be moved to the target location, and the control target node moves to the target location, and At the same time, the parent node of the target node is controlled to move with the movement of the target node, so as to achieve the purpose of real simulation of the target human body. If the distance between the target node and the target location is less than or equal to the preset threshold, then the target node is considered to be approximately at the target location, and the target node does not need to be moved. In the embodiment of the present application, the target node is a human body model node corresponding to a predetermined body part of the target human body at the target position. The parent node of the target node also corresponds to the target human body part, which is the same bone body as the predetermined body part of the target human body, and is the parent bone of the predetermined body part of the target human body.

Figure 3 is a schematic diagram of the standard human skeleton. As shown in Figure 3, each bone in Figure 3 corresponds to a node in the human body model, in which the neck bone and the spine are the parent bone of the skull, the neck bone and the spine are in the human body model. The corresponding node in the middle is the parent node of the node corresponding to the head bone. Similarly, the arm and the clavicle are the parent bone of the hand, the upper leg bone and the leg bone are the parent bone of the foot, and the corresponding node of the arm and the clavicle in the human body model is the parent node of the node corresponding to the hand, the upper leg bone and the leg bone The corresponding node in the human body model is the parent node of the node corresponding to the foot.

Optionally, controlling the movement of all the parent nodes of the target node and the target node comprises: acquiring a positional relationship between all the parent nodes of the target node and the target location; selecting a parent node adjacent to the target node as the rotation node according to the positional relationship; maintaining rotation The distance between the node and all the child nodes of the rotating node is unchanged, and all the child nodes of the rotating node are rotated to move the target node to the line connecting the rotating node and the target position; the parent node adjacent to the rotating node is reselected as the rotation Node until all parent nodes of the target node are selected.

As an optional implementation manner of the embodiment of the present application, when the distance between the target node and the target location is greater than a preset threshold, the target node and the parent node of the target node are moved to simulate the human body model to the target human body. The control movement mode is shown in Fig. 4. In Fig. 4, N1, N2, N3, and N4 are the four nodes in the human body model, and the body parts of the target human body corresponding to N1, N2, N3, and N4 are in the same bone. In the chain, and the body parts corresponding to N1, N2, and N3 are the parent bones of the body parts corresponding to N4, N1, N2, and N3 are the parent nodes of N4. When the human body model is controlled to simulate the target human body, N4 is the target node, and the tracker is disposed on the predetermined body part of the target human body corresponding to N4, and T is the position of the acquired tracker, that is, the target position. Before controlling all the parent nodes of the target node N4 and the target node N4 to move, first obtain the positional relationship between all the parent nodes N1, N2, N3 of the target node N4 and the target position T. Alternatively, the parent node N1, N2 may be obtained. N3 is connected to the target position T to determine its positional relationship. For the first move, the parent node N3 adjacent to the target node N4 is first selected as the rotation node, and the distance between the rotation node N3 and all its child nodes (node N4) is kept unchanged, that is, the length of the N3N4 is kept unchanged, and the mobile node N4 is rotated, and the N4 is rotated. Move to the line connecting node N3 and target position T. Optionally, during the rotational movement, the angle moved by the node N4 is the minimum angle that may be moved, and during the first movement, the angle of the movement of the node N4 is a1. For the second movement, the parent node (N2) adjacent to the current rotating node N3 is selected as a new rotating node, and the distance between the rotating node N2 and all its child nodes (nodes N3, N4) is kept unchanged, that is, N2N3, N2N4, and N3N4 are maintained. The length of the node N3 and the node N4 are rotated, and N4 is moved to the line connecting the node N2 and the target position T. During the second movement, the angle at which the node N3 and the node N4 move is a2. According to the above moving method, until all the parent nodes of the target node N4 are selected. In FIG. 4, the third moving process selects the parent node N1 of the target node N4 as a rotating node, and keeps the distance between the nodes N1, N2, N3, N4 unchanged, and rotates the mobile nodes N2, N3, N4, so that Node N4 moves to the line connecting node N1 to the target location. At this point, a simulation of the human body model to the target human body motion is completed. It should be noted that, if the distance between the target node N4 and the target position T is less than or equal to the preset threshold after the above movement is completed, the simulation of the target human body by the human body model is completed, if the distance between the target node N4 and the target position T is If the threshold value is greater than the preset threshold, the human body model needs to be controlled again to move according to the above moving process until the distance between the target node N4 and the target position T is less than or equal to a preset threshold.

Optionally, the location information includes the orientation of the tracker, and controlling the human body model in the virtual reality to perform the moving according to the acquired location information includes: using the orientation indicated by any one of the acquired location information as the target orientation; Determining whether the target angle between the current orientation of the target node of the human body model and the target orientation is greater than a second preset threshold; if the target angle is greater than the second preset threshold, controlling all the parent nodes of the target node and the target node according to the first pre-predetermined The angle is rotated, wherein the angle of rotation of the target node is equal to the second preset threshold, and the rotation angle of all the parent nodes of the target node is less than or equal to the rotation angle of the target node; if the target angle is less than or equal to the second preset threshold, The control target node rotates according to the target angle, and controls the parent node of the target node to rotate according to the second preset angle, wherein the second preset angle is less than or equal to the target angle.

As an optional implementation manner of the embodiment of the present application, the body part of the human body model is controlled to rotate according to the obtained angle of the tracker to simulate the target human body. Since the rotation angle of the body part of the target body is limited, when the control human body model simulates the rotation of the target human body, the second threshold is set, and the target angle required to be rotated according to the angle information of the acquired tracker is greater than the second threshold. The control target node and the target node's parent node rotate according to the first preset angle. Optionally, when the control target node and the target node's parent node rotate according to the first preset angle, the control target node follows the second threshold. Rotating, while controlling the parent node of the target node to rotate according to an angle less than or equal to the second threshold. If the target angle required to be rotated according to the acquired angle information of the tracker is less than or equal to the second threshold, the target node is controlled The parent node of the target node rotates according to the second preset angle. Specifically, the control target node rotates according to the target angle, and the parent node of the control target node rotates according to a rotation angle smaller than or equal to the target angle. Optionally, when the target node has multiple parent nodes, the angles of rotation of the multiple parent nodes of the target node are less than or equal to the rotation angle of the target node, and in all the nodes, the rotation angle of the parent node is less than or equal to the rotation of the child node. angle.

For example, if the target node is a head node and the second preset threshold is 90 degrees, when the human body model simulates the target human body, when the target angle required to be rotated according to the angle information of the tracker is greater than 90 degrees, the human body is controlled. The model rotates the head at 90 degrees. Optionally, the neck can be controlled to rotate 70 degrees in the same direction to control the spine to rotate 50 degrees in the same direction. If the target angle to be rotated is 60 degrees according to the angle information of the tracker, the human body model is controlled to rotate the head according to 60 degrees. Alternatively, the neck can be controlled to rotate 30 degrees in the same direction to control the spine to rotate in the same direction. 15 degrees.

Optionally, the tracker set includes at least a head tracker, and acquiring location information of all the trackers in the tracker set of the target human body includes: acquiring a head position information of the head tracker; and controlling the virtual reality according to the acquired position information. The movement of the human body model in the environment includes: controlling the human body model according to the head position information to perform at least one of the following actions: head rotation, body bending, and body movement.

In the embodiment of the present application, the tracker set includes at least a head tracker, and according to the position information of the head tracker, the human body model is controlled to simulate the motion of the target human body, wherein the human body model can rotate the head of the target human body. Simulation of body bending and body movement.

Optionally, before controlling the movement of the human body model in the virtual reality according to the acquired location information, the method comprises: combining the left-hand node and the right-hand node of the human body model into a hand node; and/or the left leg of the human body model The node and the right leg node are merged into a leg node, wherein the merged hand node and the leg node are the parent nodes of the human body model head node.

As an optional implementation manner of the embodiment of the present application, after acquiring the location information of the head tracker and controlling the motion of the human body model to simulate the motion of the target human body according to the location information, the node of the human body model may be simplified and The head node acts as a target node, and controls the head node and the parent node of the head node to move, so that the human body model simulates the action of the target human body. Specifically, the left-hand node and the right-hand node may be merged into a hand node, the left leg node and the right leg node are merged into a leg node, and the merged hand node and/or leg node are used as a parent node of the head node. When the head node moves, the hand node and/or the leg node are controlled to move accordingly.

Taking the tracker set including the head tracker and the hand tracker as an example, when the human body model is controlled to simulate the target human body, the head and body movements of the target human body are simulated through the head node, and the hands of the target human body are simulated through the hand node. With the arms moving, the human skeleton shown in Fig. 3 can be divided into two parts shown in Fig. 5 and Fig. 6, wherein Fig. 5 shows the skeleton part of the head, the body, and the legs, Figure 6 shows the skeleton portion of both hands and arms. As shown in Fig. 7, the skeleton portion shown in Fig. 6 can be simplified. Combine the left leg bone with the right leg bone, and use the midpoint of the left leg bone and the right leg bone as the position of the combined leg bone, and merge the left foot and the right foot to the midpoint of the left and right feet. As the position of the merged foot, the leg bones and feet are merged as the parent of the head.

Optionally, the tracker set includes at least a head tracker and a hand tracker, and acquiring location information of all trackers in the target human body tracker set includes: acquiring a head tracker head position message and a hand tracker Hand position information; controlling the human body model in the virtual reality according to the acquired position information to move: controlling the human body model according to the head position information and the hand position information to perform at least one of the following actions: head rotation, body bending, Body movement, arm movement, arm bending and arm rotation.

As an optional implementation manner of the embodiment of the present application, when the tracker set includes a head tracker and a hand tracker, the head position information of the target human body is obtained through the head tracker, and the target human body is acquired through the hand tracker. The hand position information simulates the head and body movements of the target human body according to the head position information, and simulates the hand and arm movements of the target human body according to the hand position information.

Optionally, the tracker set includes at least a head tracker, a hand tracker and a foot tracker, and acquiring location information of all trackers in the target human body tracker set includes: acquiring a head tracker head position message The hand position information of the hand tracker and the foot position information of the foot tracker; controlling the movement of the human body model in the virtual reality according to the acquired position information includes: according to the head position information, the hand position information, and The foot position message controls the mannequin to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, arm rotation, leg movement, leg bending, and leg rotation.

As an optional implementation manner of the embodiment of the present application, when the tracker set includes a head tracker, a hand tracker, and a foot tracker, the head tracker obtains the head position information of the target human body through the hand. The tracker obtains the hand position information of the target human body, obtains the foot position information of the target human body through the foot tracker, simulates the head and body movements of the target human body according to the head position information, and targets the target human body according to the hand position information. The hand and arm movements are simulated, and the target's feet and legs are simulated according to the foot position information.

Optionally, before acquiring the human body model displayed in the virtual reality, the method further includes: establishing a human body model having a preset body proportion; acquiring an actual body proportion of the target human body according to the position information of the tracker; and scaling according to the actual body proportion The human body model is such that the body proportion of the human body model is consistent with the body proportion of the target human body.

As an optional implementation manner of the embodiment of the present application, in order to improve the similarity between the human body model and the target human body, a human body model conforming to the actual body proportion of the target human body is established. Specifically, a human body model having a standard body ratio is first established, and then the actual body proportional relationship of the target human body is obtained according to the position information of the tracker configured on the target human body, for example, according to the position information of the target human body head tracker. Knowing the height of the target human body, and then knowing the arm length of the target human body based on the position information of the target human body. Finally, according to the actual body proportion relationship of the target human body, the above-mentioned human body model with a standard body proportion is scaled so that the body proportional relationship of the human body model is consistent with the actual body proportion of the target human body.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not subject to the described action sequence. Limitations, as some steps may be performed in other orders or concurrently in accordance with the present application. In the following, those skilled in the art should also be aware that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by means of a software plus a necessary general hardware platform, and of course, can also be through hardware, but many In the case of the former is a better implementation. Based on such understanding, the technical solution of the present application, which is essential or contributes to the related art, can be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, CD-ROM). The plural instructions are included to cause a terminal device (which may be a cell phone, a computer, a server, or a network device, etc.) to perform the methods described in various embodiments of the present application.

According to an embodiment of the present application, there is also provided a simulation device for a human body in a virtual reality for implementing a simulation method of a human body in the virtual reality, wherein the simulation device of the human body in the virtual reality is mainly used to execute the foregoing embodiment of the present application. The simulation method of the human body in the virtual reality provided by the content is as follows: FIG. 8 is an optional virtual reality according to an embodiment of the present application. A schematic diagram of a simulation device of a human body, as shown in FIG. 8, the simulation device of the human body in the virtual reality mainly includes: a first acquisition unit 810, configured to acquire a human body model displayed in a virtual reality, wherein the human body model Used to simulate a target human body in a real environment.

Virtual reality technology is a computer simulation system that can create a virtual world. It uses a computer to generate a multi-source information fusion and interactive 3D dynamic vision simulation environment, through the simulation of the user's physical behavior in the environment. The household is immersed in the environment. The human body model displayed in the virtual reality is used to simulate the user's entity behavior, simulate the user model by controlling the human body model, and make the human body model simulate the action closer to the user's entity behavior, thereby making the user virtual reality. The interaction in the environment is more realistic and enhances the user experience.

The second obtaining unit 820 is configured to acquire location information of all trackers in the tracker set of the target human body, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body.

In the embodiment of the present application, the tracker is disposed on a predetermined body part of the target human body, and when the predetermined body part of the target human body acts, the position of the tracker also changes accordingly, and therefore, the position information of the tracker is the target. The position information of the body's predetermined body part. As shown in Fig. 1, when the target human body turns the head, the orientation of the helmet worn by the target human body (equivalent to the head tracker) also changes, and according to the orientation of the helmet, the head orientation of the target human body can be obtained; When the target human body raises the arm, the position of the handle held by the target human body (equivalent to the hand tracker) also changes, and according to the position of the handle held by the target human body, the position of the hand and the arm of the target human body can be obtained. .

The control unit 830 is configured to control the human body model in the virtual reality to move according to the acquired position information, so that the human body model simulates the action of the target human body.

According to the principle of inverse dynamics, the position of the n-level parent bone on the bone chain in which it is located can be determined by first determining the position of the child bone, and then determining the position of the entire bone chain. In the embodiment of the present application, when the human body model is controlled to simulate the target human body, the position information of each part of the human body model is determined according to the acquired position information of the tracker, and then the position of other parts is derived according to the inverse dynamics. The message is used to determine the positional information of all parts of the entire human body model, so that the human body model can realistically simulate the movement of the target human body.

In the embodiment of the present application, the human body model displayed in the virtual reality is acquired, wherein the human body model is used to simulate the target human body in the real environment; and the position information of all the trackers in the tracker set of the target human body is acquired, The tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and the human body model in the virtual reality is controlled to be moved according to the acquired position information, so that the human body model simulates the action of the target human body, The position information of the tracker on the predetermined body part of the target human body controls the human body model in the virtual reality to move, and achieves the purpose of controlling the human body model to simulate the target human body motion, thereby realizing the position information of the predetermined body part according to the target human body. The technical effect of simulating the human body model to simulate the movement of the target human body, thereby solving the technical problem that the virtual reality cannot perform real simulation on the human body motion.

Optionally, the location information includes a location of the tracker, and the control unit includes: a location module, configured to use, as the target location, a location indicated by any one of the acquired location information; the first determining module is configured to: Determining whether a distance between a current location of the target node of the human body model and the target location is greater than a first predetermined threshold, wherein the target node is associated with a predetermined body part of the target human body corresponding to the target location; the first control module is configured to: Controlling the target node and all the parent nodes of the target node to move if the distance between the current position of the target node and the target position is greater than the first preset threshold, wherein the target node and the parent node are used to simulate a bone in the target human body Multiple bones of the chain.

As an optional implementation manner of the embodiment of the present application, the position information of the tracker includes the position of the tracker, and the position of the tracker is the target position, and the corresponding part of the human body model used for simulating the target human body is used as the target node. Then, controlling the human body model to simulate the target human body requires controlling the target node to move to the target position. In the embodiment of the present application, a preset threshold is set. If the distance between the target node and the target location is greater than the preset threshold, the target node needs to be moved to the target location, and the control target node moves to the target location, and It is necessary to control the parent node of the target node to move with the movement of the target node, so as to achieve the purpose of real simulation of the target human body. If the distance between the target node and the target location is less than or equal to the preset threshold, then the target node is considered to be approximately at the target location, and the target node need not be moved. In the embodiment of the present application, the target node is a human body model node corresponding to a predetermined body part of the target human body at the target position. The parent node of the target node also corresponds to the target human body part, which is the same bone body as the predetermined body part of the target human body, and is the parent bone of the predetermined body part of the target human body.

Figure 3 is a schematic diagram of the standard human skeleton. As shown in Figure 3, each bone in Figure 3 corresponds to a node in the human body model, in which the neck bone and the spine are the parent bone of the skull, the neck bone and the spine are in the human body model. The corresponding node in the middle is the parent node of the node corresponding to the head bone. Similarly, the arm and the clavicle are the parent bone of the hand, the upper leg bone and the leg bone are the parent bone of the foot, and the corresponding node of the arm and the clavicle in the human body model is the parent node of the node corresponding to the hand, the upper leg bone and the leg bone The corresponding node in the human body model is the parent node of the node corresponding to the foot.

Optionally, the first control module includes: an acquiring submodule, configured to acquire a positional relationship between all the parent nodes of the target node and the target location; and a rotating node submodule, configured to select the adjacent to the target node according to the positional relationship The parent node acts as a rotation node; the rotation sub-module is used to keep the distance between the rotation node and all the child nodes of the rotation node unchanged, and rotate all the child nodes of the rotation node to move the target node to the connection between the rotation node and the target position. On-line; a repeating sub-module for reselecting a parent node adjacent to a rotating node as a rotating node until all parent nodes of the target node are selected.

As an optional implementation manner of the embodiment of the present application, when the distance between the target node and the target location is greater than a preset threshold, the target node and the parent node of the target node are moved to simulate the human body model to the target human body. The control movement mode is shown in Fig. 4. In Fig. 4, N1, N2, N3, and N4 are the four nodes in the human body model, and the body parts of the target human body corresponding to N1, N2, N3, and N4 are in the same bone. In the chain, and the body parts corresponding to N1, N2, and N3 are the parent bones of the body parts corresponding to N4, N1, N2, and N3 are the parent nodes of N4. When the human body model is controlled to simulate the target human body, N4 is the target node, and the tracker is disposed on the predetermined body part of the target human body corresponding to N4, and T is the position of the acquired tracker, that is, the target position. Before controlling all the parent nodes of the target node N4 and the target node N4 to move, first obtain the positional relationship between all the parent nodes N1, N2, N3 of the target node N4 and the target position T. Alternatively, the parent node N1, N2 may be obtained. N3 is connected to the target position T to determine its positional relationship. For the first move, the parent node N3 adjacent to the target node N4 is first selected as the rotation node, and the distance between the rotation node N3 and all its child nodes (node N4) is kept unchanged, that is, the length of the N3N4 is kept unchanged, and the mobile node N4 is rotated, and the N4 is rotated. Move to the line connecting node N3 and target position T. Optionally, during the rotational movement, the angle moved by the node N4 is the minimum angle that may be moved, and during the first movement, the angle of the movement of the node N4 is a1. For the second movement, the parent node (N2) adjacent to the current rotating node N3 is selected as a new rotating node, and the distance between the rotating node N2 and all its child nodes (nodes N3, N4) is kept unchanged, that is, N2N3, N2N4, and N3N4 are maintained. The length of the node N3 and the node N4 are rotated, and N4 is moved to the line connecting the node N2 and the target position T. During the second movement, the angle at which the node N3 and the node N4 move is a2. According to the above moving method, until all the parent nodes of the target node N4 are selected. In FIG. 4, the third moving process selects the parent node N1 of the target node N4 as a rotating node, and keeps the distance between the nodes N1, N2, N3, N4 unchanged, and rotates the mobile nodes N2, N3, N4, so that Node N4 moves to the line connecting node N1 to the target location. At this point, a simulation of the human body model to the target human body motion is completed. It should be noted that, if the distance between the target node N4 and the target position T is less than or equal to the preset threshold after the above movement is completed, the simulation of the target human body by the human body model is completed, if the distance between the target node N4 and the target position T is If the threshold value is greater than the preset threshold, the human body model needs to be controlled again to move according to the above moving process until the distance between the target node N4 and the target position T is less than or equal to a preset threshold.

Optionally, the location information includes an orientation of the tracker, and the control unit includes: a direction module, configured to use a direction indicated by any one of the acquired location information as a target orientation; and a second determining module, configured to: Determining whether the target angle between the current orientation of the target node of the human body model and the target orientation is greater than a second preset threshold; and the second control module, configured to control the target node and the target node when the target angle is greater than the second preset threshold All the parent nodes rotate according to the first preset angle, wherein the angle of rotation of the target node is equal to the second preset threshold, and the rotation angle of all the parent nodes of the target node is less than or equal to the rotation angle of the target node; the third control module And, when the target angle is less than or equal to the second preset threshold, the control target node rotates according to the target angle, and controls the parent node of the target node to rotate according to the second preset angle, wherein the second preset angle is less than or Equal to the target angle.

As an optional implementation manner of the embodiment of the present application, the body part of the human body model is controlled to rotate according to the obtained angle of the tracker to simulate the target human body. Since the rotation angle of the body part of the target body is limited, when the control human body model simulates the rotation of the target human body, the second threshold is set, and the target angle required to be rotated according to the angle information of the acquired tracker is greater than the second threshold. The control target node and the target node's parent node rotate according to the first preset angle. Optionally, when the control target node and the target node's parent node rotate according to the first preset angle, the control target node follows the second threshold. Rotating, while controlling the parent node of the target node to rotate according to an angle less than or equal to the second threshold. If the target angle required to be rotated according to the acquired angle information of the tracker is less than or equal to the second threshold, the target node is controlled The parent node of the target node rotates according to the second preset angle. Specifically, the control target node rotates according to the target angle, and the parent node of the control target node rotates according to a rotation angle smaller than or equal to the target angle. Optionally, when the target node has multiple parent nodes, the angles of rotation of the multiple parent nodes of the target node are less than or equal to the rotation angle of the target node, and in all the nodes, the rotation angle of the parent node is less than or equal to the rotation of the child node. angle.

For example, if the target node is a head node and the second preset threshold is 90 degrees, when the human body model simulates the target human body, when the target angle required to be rotated according to the angle information of the tracker is greater than 90 degrees, the human body is controlled. The model rotates the head at 90 degrees. Optionally, the neck can be controlled to rotate 70 degrees in the same direction to control the spine to rotate 50 degrees in the same direction. If the target angle to be rotated is 60 degrees according to the angle information of the tracker, the human body model is controlled to rotate the head according to 60 degrees. Alternatively, the neck can be controlled to rotate 30 degrees in the same direction to control the spine to rotate in the same direction. 15 degrees.

Optionally, the tracker set includes at least a head tracker, and the second obtaining unit includes: a first acquiring module, configured to acquire a head position information of the head tracker; and the control unit includes: a fourth control module, At least one of the following actions is performed by controlling the human body model according to the head position information: head rotation, body bending, and body movement.

In the embodiment of the present application, the tracker set includes at least a head tracker, and according to the position information of the head tracker, the human body model is controlled to simulate the motion of the target human body, wherein the human body model can rotate the head of the target human body. Simulation of body bending and body movement.

Optionally, the device includes: a first merging unit, configured to merge the left-hand node and the right-hand node of the human body model into a hand node before controlling the movement of the human body model in the virtual reality according to the acquired location information; and/ Or a second merging unit, configured to merge the left leg node and the right leg node of the human body model into a leg node before controlling the movement of the human body model in the virtual reality according to the acquired position information, wherein the merged hand The node and leg nodes are the parent nodes of the human body model head node.

As an optional implementation manner of the embodiment of the present application, after acquiring the location information of the head tracker and controlling the motion of the human body model to simulate the motion of the target human body according to the location information, the node of the human body model may be simplified and The head node acts as a target node, and controls the head node and the parent node of the head node to move, so that the human body model simulates the action of the target human body. Specifically, the left-hand node and the right-hand node may be merged into a hand node, the left leg node and the right leg node are merged into a leg node, and the merged hand node and/or leg node are used as a parent node of the head node. When the head node moves, the hand node and/or the leg node are controlled to move accordingly.

Taking the tracker set including the head tracker and the hand tracker as an example, when the human body model is controlled to simulate the target human body, the head and body movements of the target human body are simulated through the head node, and the hands of the target human body are simulated through the hand node. With the arms moving, the human skeleton shown in Fig. 3 can be divided into two parts shown in Fig. 5 and Fig. 6, wherein Fig. 5 shows the skeleton part of the head, the body, and the legs, Figure 6 shows the skeleton portion of both hands and arms. As shown in Fig. 7, the skeleton portion shown in Fig. 6 can be simplified. Combine the left leg bone with the right leg bone, and combine the left leg and the right foot with the midpoint of the left leg bone and the right leg bone, and combine the left foot and the right foot as the combined midpoint of the left foot and the right foot. The feet, the resulting leg bones and feet are the parent nodes of the head.

Optionally, the tracker set includes at least a head tracker and a hand tracker, and the second acquiring unit includes: a second acquiring module, configured to acquire a head tracker head position message and a hand tracker hand Position information; the control unit includes: a fifth control module, configured to control the human body model according to the head position information and the hand position information to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending And the arm rotates.

As an optional implementation manner of the embodiment of the present application, when the tracker set includes a head tracker and a hand tracker, the head position information of the target human body is obtained through the head tracker, and the target human body is acquired through the hand tracker. The hand position information simulates the head and body movements of the target human body according to the head position information, and simulates the hand and arm movements of the target human body according to the hand position information.

Optionally, the tracker set includes at least a head tracker, a hand tracker and a foot tracker, and the second obtaining unit comprises: a third acquiring module, configured to acquire a head tracker head position message, a hand The position information of the part tracker and the foot position information of the foot tracker; the control unit comprises: a sixth control module for controlling the human body model according to the head position information, the hand position information and the foot position information At least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, arm rotation, leg movement, leg bending, and leg rotation.

As an optional implementation manner of the embodiment of the present application, when the tracker set includes a head tracker, a hand tracker, and a foot tracker, the head tracker obtains the head position information of the target human body through the hand. The tracker obtains the hand position information of the target human body, obtains the foot position information of the target human body through the foot tracker, simulates the head and body movements of the target human body according to the head position information, and targets the target human body according to the hand position information. The hand and arm movements are simulated, and the target's feet and legs are simulated according to the foot position information.

Optionally, the device further includes: an establishing unit, configured to establish a human body model having a preset body proportion before acquiring the human body model displayed in the virtual reality; and a third acquiring unit, configured to acquire the position information according to the tracker The actual body proportion of the target human body; a scaling unit for scaling the human body model according to the actual body proportion so that the body proportion of the human body model is consistent with the body proportion of the target human body.

As an optional implementation manner of the embodiment of the present application, in order to improve the similarity between the human body model and the target human body, a human body model conforming to the actual body proportion of the target human body is established. Specifically, a human body model having a standard body ratio is first established, and then the actual body proportional relationship of the target human body is obtained according to the position information of the tracker configured on the target human body, for example, according to the position information of the target human body head tracker. Knowing the height of the target human body, and then knowing the arm length of the target human body based on the position information of the target human body. Finally, according to the actual body proportion relationship of the target human body, the above-mentioned human body model with a standard body proportion is scaled so that the body proportional relationship of the human body model is consistent with the actual body proportion of the target human body.

According to an embodiment of the present application, there is also provided an electronic device comprising a storage and a processor, wherein the storage stores a computer program, and the processor is configured to execute the method by using the computer program.

According to the embodiment of the present application, a terminal for implementing the simulation method of the human body in the virtual reality is provided. The terminal can be used as the electronic device. As shown in FIG. 9, the terminal mainly includes a processor 901 and a display 902. And the network connection 埠 903, wherein: the network connection 埠 903 is mainly used for network communication with the tracker to obtain the location information of the tracker.

The display 902 is mainly used to display a human body model for simulating a target human body.

The processor 901 is mainly configured to: perform a human body model displayed in a virtual reality, wherein the human body model is used to simulate a target human body in a real environment; and the position of all trackers in the tracker set of the target human body is acquired. The message, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and controlling the human body model in the virtual reality to move according to the acquired position information, so that the human body model simulates the action of the target human body.

The processor 901 is further configured to use, as the target location, the location represented by any one of the acquired location information, and determine whether the distance between the current location and the target location of the target node of the human body model is greater than a first preset threshold. Wherein, the target node is associated with a predetermined body part of the target human body corresponding to the target position; if the distance between the current position of the target node and the target position is greater than the first preset threshold, controlling all the parent nodes of the target node and the target node Move, where the target node and the parent node are used to simulate multiple bones of a bone chain in the target human body.

The processor 901 is further configured to acquire a positional relationship between all the parent nodes of the target node and the target location; select a parent node adjacent to the target node as the rotation node according to the positional relationship; and keep the distance between the rotating node and all the child nodes of the rotating node unchanged. Rotating all the child nodes of the rotating node to move the target node to the line connecting the rotating node and the target position; reselecting the parent node adjacent to the rotating node as the rotating node until all the parent nodes of the target node are selected .

The processor 901 is further configured to use, as the target orientation, the orientation indicated by any one of the acquired location information, and determine whether the target angle between the current orientation of the target node of the human body model and the target orientation is greater than a second preset threshold. If the target angle is greater than the second preset threshold, all the parent nodes of the control target node and the target node are rotated according to the first preset angle, wherein the angle of rotation of the target node is equal to the second preset threshold, and all the parents of the target node The rotation angle of the node is less than or equal to the rotation angle of the target node; if the target angle is less than or equal to the second preset threshold, the control target node rotates according to the target angle, and controls the parent node of the target node to rotate according to the second preset angle. Wherein the second preset angle is less than or equal to the target angle.

The processor 901 is further configured to acquire a head position information of the head tracker; and control the human body model according to the head position information to perform at least one of the following actions: head rotation, body bending, and body movement.

The processor 901 is further configured to merge the left-hand node and the right-hand node of the human body model into a hand node; and/or merge the left-leg node and the right-leg node of the human body model into a leg node, wherein the merged hand node and The leg node is the parent node of the mannequin head node.

The processor 901 is further configured to acquire a head position information of the head tracker and a hand position information of the hand tracker; and control the human body model according to the head position information and the hand position information to perform at least one of the following actions: head rotation, Body bending, body movement, arm movement, arm bending and arm rotation.

The processor 901 is further configured to acquire a head position information of the head tracker, a hand position information of the hand tracker, and a foot position information of the foot tracker; according to the head position information, the hand position information, and the foot position The positional message controls the mannequin to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, arm rotation, leg movement, leg bending, and leg rotation.

The processor 901 is further configured to establish a human body model having a preset body proportion; obtain an actual body proportion of the target human body according to the position information of the tracker; and scale the human body model according to the actual body proportion, so that the body proportion of the human body model and the body of the target human body The ratio is the same.

For example, the specific examples in this embodiment may refer to the examples described in Embodiment 1 and Embodiment 2, and details are not described herein again.

Embodiments of the present application also provide a storage medium. A computer program is stored in the storage medium, wherein the computer program is configured to execute the method described above at runtime.

Optionally, in the embodiment, the storage medium may be used to store the code of the simulation method of the human body in the virtual reality of the embodiment of the present application.

Optionally, in this embodiment, the storage medium may be located in at least one network device of multiple network devices in a network of a mobile communication network, a wide area network, a metropolitan area network, or a regional network.

Optionally, in this embodiment, the storage medium is configured to store a code for performing the following steps: S1, acquiring a human body model displayed in a virtual reality, wherein the human body model is used for the target in the real environment The human body performs simulation; S2, acquiring position information of all trackers in the target human body tracker set, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body; S3, according to the acquired position information The human body model in the virtual reality is controlled to move so that the human body model simulates the action of the target human body.

Optionally, in the embodiment, the storage medium may include, but is not limited to, a flash drive, a read-only memory (ROM), a random access memory (RAM), and a portable device. A variety of media that can store code, such as hard drives, disks, or compact discs.

Optionally, in this embodiment, the processor performs, according to the stored code in the storage medium, a location represented by any one of the acquired location information as a target location; and determines a current location of the target node of the human body model. Whether the distance between the position and the target position is greater than a first preset threshold, wherein the target node is associated with a predetermined body part of the target human body corresponding to the target position; if the distance between the current position of the target node and the target position is greater than the first The preset threshold controls all the parent nodes of the target node and the target node to move, wherein the target node and the parent node are used to simulate multiple bones of one bone chain in the target human body.

Optionally, in this embodiment, the processor performs acquiring a positional relationship between all the parent nodes of the target node and the target location according to the stored code in the storage medium; and selecting a parent node adjacent to the target node as the rotation according to the positional relationship. Node; keep the distance between the rotating node and all the child nodes of the rotating node unchanged, rotate all the child nodes of the node to move the target node to the line connecting the rotating node and the target position; reselect the parent node adjacent to the rotating node As a rotating node, all the parent nodes of the target node are selected.

Optionally, in this embodiment, the processor performs, according to the stored code in the storage medium, a direction indicated by any one of the acquired location information as a target orientation; and determines a current target node of the human body model. Whether the target angle between the orientation and the target orientation is greater than a second preset threshold; if the target angle is greater than the second preset threshold, all the parent nodes of the control target node and the target node are rotated according to the first preset angle, wherein the target The angle of rotation of the node is equal to the second preset threshold, and the rotation angle of all the parent nodes of the target node is less than or equal to the rotation angle of the target node; if the target angle is less than or equal to the second preset threshold, the control target node rotates according to the target angle. And controlling the parent node of the target node to rotate according to a second preset angle, wherein the second preset angle is less than or equal to the target angle.

Optionally, in this embodiment, the processor performs acquiring the head position information of the head tracker according to the stored code in the storage medium; and controlling the human body model according to the head position information to perform at least one of the following actions: head rotation Body bending and body movement.

Optionally, in this embodiment, the processor performs combining the left-hand node and the right-hand node of the human body model into a hand node according to the stored code in the storage medium; and/or the left leg node and the right leg of the human body model The nodes are merged into leg nodes, wherein the merged hand nodes and leg nodes are the parent nodes of the human body model head node.

Optionally, in this embodiment, the processor performs the acquiring the head position information of the head tracker and the hand position information of the hand tracker according to the stored code in the storage medium; according to the head position information and the hand The positional information controls the mannequin to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, and arm rotation.

Optionally, in this embodiment, the processor executes the head position information of the head tracker, the hand position information of the hand tracker, and the foot of the foot tracker according to the stored code in the storage medium. Position message; control the mannequin according to the head position message, the hand position message and the foot position message to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, arm rotation, leg movement, The legs are bent and the legs are rotated.

Optionally, in this embodiment, the processor performs a human body model with a preset body proportion according to the stored code in the storage medium; and obtains an actual body proportion of the target human body according to the position information of the tracker; The human body model is scaled so that the body proportion of the human body model is consistent with the body proportion of the target human body.

The integrated unit in the above embodiments, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in the above computer readable storage medium. Based on such understanding, the technical solution of the present application, in essence or the part contributing to the related art, or all or part of the technical solution may be embodied in the form of a software product, which is stored in a storage medium, including The plurality of instructions are used to cause one or more computer devices (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application.

In the above-mentioned embodiments of the present application, the descriptions of the various embodiments are different, and the parts that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided by the present application, it should be understood that the disclosed client may be implemented in other manners. The device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner. For example, multiple units or components may be combined or integrated. Go to another system, or some features can be ignored, or not executed. Alternatively, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some ports, units or modules, and may be in electrical or other form.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of a hardware or a software functional unit.

The above description is only a preferred embodiment of the present application, and it should be noted that those skilled in the art can make various improvements and refinements without departing from the principles of the present application. It should be considered as the scope of protection of this application.

Claims (20)

 A simulation method for a human body in a virtual reality, comprising: acquiring a human body model displayed in a virtual reality, wherein the human body model is used for simulating a target human body in a real environment; and acquiring a tracker set of the target human body Location information of all trackers, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and controlling the human body model in the virtual reality according to the acquired position information Moving is performed to cause the human body model to simulate the motion of the target human body.    The method of claim 1, wherein the location information includes a location of the tracker, and controlling the human body model in the virtual reality to move according to the acquired location information comprises: acquiring the acquired location a location indicated by any one of the location information as a target location; determining whether a distance between the current location of the target node of the human body model and the target location is greater than a first predetermined threshold, wherein the target node and Correlating a predetermined body part of the target human body corresponding to the target position; and controlling the target node if a distance between a current position of the target node and the target position is greater than the first preset threshold Moving with all parent nodes of the target node, wherein the target node and the parent node are used to simulate multiple bones of one bone chain in the target human body.    The method of claim 2, wherein controlling the target node and all parent nodes of the target node to move comprises: acquiring a positional relationship between all parent nodes of the target node and the target location; Selecting, by the location relationship, a parent node adjacent to the target node as a rotation node; maintaining a distance between the rotation node and all child nodes of the rotation node, and rotating all child nodes of the rotation node, so that Moving the target node to a line connecting the rotating node and the target location; and reselecting a parent node adjacent to the rotating node as the rotating node until all parent nodes of the target node are selected Finished.    The method of claim 1, wherein the location information includes an orientation of the tracker, and controlling the human body model in the virtual reality to move according to the acquired location information comprises: acquiring the acquired location The orientation indicated by any one of the location information is used as the target orientation; determining whether the target angle between the current orientation of the target node of the human body model and the target orientation is greater than a second preset threshold; if the target angle is greater than The second preset threshold is used to control that all the parent nodes of the target node and the target node are rotated according to a first preset angle, wherein an angle of rotation of the target node is equal to the second preset threshold. The rotation angle of all the parent nodes of the target node is less than or equal to the rotation angle of the target node; and if the target angle is less than or equal to the second preset threshold, controlling the target node to rotate according to the target angle And controlling the parent node of the target node to rotate according to a second preset angle, wherein the second The preset angle is less than or equal to the target angle.    The method of any one of claims 1 to 4, wherein the set of trackers includes at least a head tracker, and acquiring location information of all trackers in the tracker set of the target human body comprises: acquiring The head position information of the head tracker; and controlling the movement of the human body model in the virtual reality according to the acquired position information comprises: controlling the human body model according to the head position information to perform at least one of the following actions: Head rotation, body bending and body movement.    The method of claim 5, wherein before the moving according to the acquired location information to control the human body model in the virtual reality, the method comprises: placing a left-hand node and a right-hand node of the human body model Merging into a hand node; and/or merging the left leg node and the right leg node of the mannequin into a leg node, wherein the merged hand node and the leg node are the mannequin head The parent node of the node.    The method of any one of claims 1 to 4, wherein the set of trackers includes at least a head tracker and a hand tracker to acquire locations of all trackers in the tracker set of the target human body The message includes: acquiring a head position information of the head tracker and a hand position information of the hand tracker; and controlling the movement of the human body model in the virtual reality according to the acquired position information, including: The head position information and the hand position information control the human body model to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, and arm rotation.    The method of any one of claims 1 to 4, wherein the set of trackers comprises at least a head tracker, a hand tracker and a foot tracker, and the tracker set of the target human body is acquired The location information of all the trackers includes: obtaining a head position information of the head tracker, a hand position information of the hand tracker, and a foot position information of the foot tracker; and according to the acquired The movement of the human body model in the positional control virtual reality comprises: controlling the human body model according to the head position information, the hand position information and the foot position information to perform at least one of the following actions: Rotation, body bending, body movement, arm movement, arm bending, arm rotation, leg movement, leg bending, and leg rotation.    The method of claim 1, wherein before acquiring the human body model displayed in the virtual reality, the method further comprises: establishing a human body model having a preset body proportion; and according to the position information of the tracker Obtaining an actual body proportion of the target human body; scaling the human body model according to the actual body proportion such that a body proportion of the human body model is consistent with a body proportion of the target human body.    A human body simulation device in a virtual reality, comprising: a first acquiring unit, configured to acquire a human body model displayed in a virtual reality, wherein the human body model is used for simulating a target human body in a real environment; An acquiring unit, configured to acquire location information of all trackers in the tracker set of the target human body, wherein the tracker set includes at least one tracker disposed on a predetermined body part of the target human body; and a control unit And controlling to move the human body model in the virtual reality according to the acquired location information, so that the human body model simulates an action of the target human body.    The device of claim 10, wherein the location information includes a location of the tracker, and the control unit comprises: a location module, configured to: use any one of the acquired location messages The position of the target is used as a target location; the first determining module is configured to determine whether a distance between a current location of the target node of the human body model and the target location is greater than a first preset threshold, wherein the target node is Corresponding to the predetermined body part of the target human body corresponding to the target position; and a first control module, configured to: if a distance between a current location of the target node and the target location is greater than the first pre- When the threshold is set, all the parent nodes of the target node and the target node are controlled to move, wherein the target node and the parent node are used to simulate multiple bones of one bone chain in the target human body.    The device of claim 11, wherein the first control module comprises: an acquisition submodule, configured to acquire a positional relationship between all parent nodes of the target node and the target location; a module, configured to select a parent node adjacent to the target node as a rotation node according to the positional relationship; and a rotation submodule, configured to maintain a distance between the rotation node and all child nodes of the rotation node Rotating all child nodes of the rotating node to move the target node to a line connecting the rotating node and the target position; and repeating a sub-module for reselecting adjacent to the rotating node The parent node acts as the rotating node until all parent nodes of the target node are selected.    The device of claim 10, wherein the location information includes an orientation of the tracker, and the control unit comprises: a heading module for using any one of the acquired location messages The orientation of the representation is the target orientation; the second determining module is configured to determine whether the target angle between the current orientation of the target node of the human body model and the target orientation is greater than a second preset threshold; the second control module, And controlling, when the target angle is greater than the second preset threshold, all the parent nodes of the target node and the target node to rotate according to a first preset angle, wherein an angle of rotation of the target node is equal to The second preset threshold, the rotation angle of all the parent nodes of the target node is less than or equal to the rotation angle of the target node; and the third control module is configured to use the target angle to be less than or equal to the second pre- When the threshold is set, the target node is controlled to rotate according to the target angle, and the parent node of the target node is controlled to enter the second preset angle. Rotation, wherein said second predetermined angle is less than or equal to the target angle.    The device according to any one of claims 10 to 13, wherein the tracker set includes at least a head tracker, and the second obtaining unit comprises: a first acquisition module, configured to acquire the head The head position information of the part tracker; and the control unit comprises: a fourth control module, configured to control the human body model according to the head position information to perform at least one of the following actions: head rotation, body bending, and body mobile.    The device according to claim 10, further comprising: a first merging unit, configured to: control the left hand of the mannequin before moving the mannequin in the virtual reality according to the acquired location information The node and the right-hand node are merged into a hand node; and/or a second merging unit is configured to: before the movement of the human body model in the virtual reality is controlled according to the acquired location information, the left leg node of the human body model And the right leg node is merged into a leg node, wherein the merged hand node and the leg node are parent nodes of the mannequin head node.    The device of any one of claims 10 to 13, wherein the set of trackers comprises at least a head tracker and a hand tracker, and the second obtaining unit comprises: a second acquisition module, Obtaining a head position information of the head tracker and a hand position information of the hand tracker; and the control unit includes: a fifth control module, configured to use the head position information and the The hand position message controls the mannequin to perform at least one of the following actions: head rotation, body bending, body movement, arm movement, arm bending, and arm rotation.    The device of any one of claims 10 to 13, wherein the set of trackers comprises at least a head tracker, a hand tracker and a foot tracker, the second obtaining unit comprising: a third Obtaining a module, configured to acquire a head position information of the head tracker, a hand position information of the hand tracker, and a foot position information of the foot tracker; and the control unit includes: a sixth control module, configured to control the human body model according to the head position information, the hand position information, and the foot position information to perform at least one of the following actions: head rotation, body bending, body movement, Arm movement, arm bending, arm rotation, leg movement, leg bending and leg rotation.    The device according to claim 10, further comprising: a establishing unit, configured to establish a human body model having a preset body proportion before acquiring the human body model displayed in the virtual reality; and a third acquiring unit, configured to: Acquiring an actual body proportion of the target human body according to the position information of the tracker; and a scaling unit, configured to scale the human body model according to the actual body proportion, so that a body proportion of the human body model and the target human body The body proportions are the same.    A storage medium storing a computer program, wherein the computer program is set to execute the method described in any one of claims 1 to 9 at runtime.    An electronic device comprising a memory and a processor, wherein the memory stores a computer program, the processor being arranged to execute the method described in any one of claims 1 to 9 by the computer program .