CN210605634U - Hand motion sensing device for virtual reality and glove assembly thereof - Google Patents
Hand motion sensing device for virtual reality and glove assembly thereof Download PDFInfo
- Publication number
- CN210605634U CN210605634U CN201920515709.3U CN201920515709U CN210605634U CN 210605634 U CN210605634 U CN 210605634U CN 201920515709 U CN201920515709 U CN 201920515709U CN 210605634 U CN210605634 U CN 210605634U
- Authority
- CN
- China
- Prior art keywords
- hand
- virtual reality
- finger
- user
- glove
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 230000033001 locomotion Effects 0.000 title claims abstract description 88
- 230000004044 response Effects 0.000 claims abstract description 18
- 210000001145 finger joint Anatomy 0.000 claims abstract description 6
- 210000003811 finger Anatomy 0.000 claims description 105
- 230000009471 action Effects 0.000 claims description 27
- 238000005253 cladding Methods 0.000 claims description 16
- 230000003993 interaction Effects 0.000 claims description 16
- 230000008447 perception Effects 0.000 claims description 13
- 210000003813 thumb Anatomy 0.000 claims description 13
- 230000000007 visual effect Effects 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 9
- 239000004744 fabric Substances 0.000 claims description 9
- 239000000463 material Substances 0.000 claims description 9
- 235000014676 Phragmites communis Nutrition 0.000 claims description 8
- 238000013480 data collection Methods 0.000 claims description 7
- 239000000835 fiber Substances 0.000 claims description 6
- 238000012545 processing Methods 0.000 claims description 4
- 230000008859 change Effects 0.000 claims description 3
- 210000004177 elastic tissue Anatomy 0.000 claims description 3
- 239000011347 resin Substances 0.000 claims description 3
- 229920005989 resin Polymers 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 claims description 2
- 230000000712 assembly Effects 0.000 claims 1
- 238000000429 assembly Methods 0.000 claims 1
- 230000001681 protective effect Effects 0.000 claims 1
- 230000002452 interceptive effect Effects 0.000 abstract description 11
- 230000036544 posture Effects 0.000 description 15
- 238000009434 installation Methods 0.000 description 8
- 210000000707 wrist Anatomy 0.000 description 7
- 210000004932 little finger Anatomy 0.000 description 6
- 238000013461 design Methods 0.000 description 5
- 230000001133 acceleration Effects 0.000 description 4
- 238000004088 simulation Methods 0.000 description 3
- 241000905957 Channa melasoma Species 0.000 description 2
- 241000203475 Neopanax arboreus Species 0.000 description 2
- 210000001015 abdomen Anatomy 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000003414 extremity Anatomy 0.000 description 2
- 210000005224 forefinger Anatomy 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000005094 computer simulation Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000000016 photochemical curing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000000087 stabilizing effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Abstract
A motion sensing device for virtual reality comprises a glove component and a motion response module, wherein the glove component is a detachable multilayer sleeve and comprises an anti-skidding wrapping part, a sleeving part and a protection part, and the sleeving part and the protection part comprise a hand back part and five half glove parts extending outwards from the hand back part to form a five-claw finger sleeve structure; the motion response module comprises a finger sensing unit, a control unit, a wireless transceiving unit and a power supply unit which are arranged among the multilayer kits and are used for tracking the hand motion of a user in a virtual reality environment, wherein the finger sensing unit comprises a plurality of inertial sensors which are configured according to the back of the hand, the connecting position of the back of the hand to each finger and the position of each finger joint so as to generate motion information according to the hand motion of the user. Therefore, the interactive experience of the virtual reality is improved, and the reality of the real hand fused into the space is achieved.
Description
Technical Field
The utility model relates to a virtual reality technical field indicates especially one kind and dresses in human hand and under the virtual environment system to the dynamic data trapping apparatus and the glove structure of human finger slight action of emulation simulation and perception.
Background
The virtual reality system is a high and new technology in the field of graphic images appearing in recent years, and is also called a smart technology or an artificial environment, the virtual reality is a virtual world which utilizes computer simulation to generate a three-dimensional space, and provides simulation of senses such as vision, hearing, touch and the like for a user, so that the user can observe objects in the three-dimensional space in time without limitation as if the user is in the same situation.
Most of the interaction modes for hands in the past VR experience mostly adopt the integration of a joystick type single-click trigger and a tracker to achieve real-time interaction in the VR environment, and the invention has the practical benefit; a data gloves that is used for virtual reality usually contain a plurality of sensors of installing in gloves inside, possess data acquisition, transmission and control module simultaneously in gloves, and in virtual manual catching gloves of intelligence, use through the cooperation VR eyes, realize virtual reality, can ordinary virtual manual catching gloves of intelligence need install messy parts such as "beacon", camera and fix a position the hand for gloves are heavier, and the wearing of gloves feels very uncomfortable.
Furthermore, most of the tactile feedback of the game experience to the virtual object is simulated by the motion sensing vibrator or the ultrasonic vibrator, but the vibration wave generated by the ultrasonic wave is easy to damage the human body and has weak tactile sensation, and the motion sensing vibrator can only simulate the vibration generated during the touch, but cannot simulate the forced feedback when the user holds the virtual object by hand. So that the user cannot be immersed in the virtual game completely and get more fun.
In view of the above, the present invention is conceived to overcome the above-mentioned problems through careful experiments and studies in view of the shortcomings in the prior art.
Novel content
In view of this, the utility model aims to provide a hand action perception device and gloves subassembly for virtual reality, the hand external member that more imitate and high feel just possess independent finger end sensor in respective finger portion, and data receiving module, a control mainboard for data receiving and dispatching, and very big volume that has reduced traditional data gloves, can replace the handle of VR equipment completely, be the ideal external device that realizes virtual reality simulation training such as electric power, complement the hand to interactive experience in real touch-control, sway, interactive behaviors such as real-time feedback, reach the authenticity that real hand fuses into the space.
To achieve an object of the present invention, the present invention provides a hand motion sensing device for virtual reality, which comprises a glove assembly and a motion response module, wherein the glove assembly comprises a detachable multi-layer sleeve to form a body portion and five finger-sleeve portions for a user to wear on the hand; the motion response module is embedded between the multilayer kits and comprises a finger sensing unit, a control unit, a wireless transceiving unit and a power supply unit, wherein the finger sensing unit comprises a plurality of inertial sensors which are respectively arranged on the body part and each finger sleeve part, the plurality of inertial sensors are configured according to the connection position of the back of the hand, the back of the hand to each finger and the position of each finger joint of the user, the lower end of each inertial sensor is respectively provided with a data collection chip and generates motion information according to the motion of the hand of the user; the control unit is connected with each data collection chip through a flexible connecting wire to receive the action information, and generates motion data which can be used by an external virtual reality host computer to determine the position and the position change of the glove assembly in the virtual reality environment after operation processing; the wireless receiving and transmitting unit is connected with the virtual reality host through a wireless network so as to receive the motion data and transmit the data by the virtual reality host; the power supply unit is respectively connected with the plurality of inertial sensors, the plurality of data collection chips, the control unit and the wireless transceiving unit to supply power to the inertial sensors, the plurality of data collection chips, the control unit and the wireless transceiving unit.
To achieve another objective of the present invention, the present invention provides a glove assembly of a hand motion sensing device based on virtual reality, which is a detachable multi-layer kit and includes a covering member, a placing member and a protection member, wherein the covering member includes a back portion and five half-finger sleeve portions extending outward from the back portion to form a five-claw finger-stall structure, one side of the back portion has a groove and each half-finger-stall portion has a groove communicated with the groove, the groove extends to the end of the half-finger-stall portion; the object placing piece is arranged in the groove of the back of the hand and used for placing the control unit and the wireless transceiving unit in the action response module, and the object placing piece is provided with a fixing piece which is connected and fixed with the control unit; the protection piece comprises a hand back part and five half finger sleeve parts extending outwards from the hand back part to form a five-claw finger sleeve structure, wherein the hand back part is provided with a groove at one side corresponding to the sheathing member, and each half finger sleeve part is provided with a convex block corresponding to five grooves of the sheathing member; the object placing part is placed between the groove of the sleeving part and the groove of the protection part, the finger sensing units are placed between the grooves of the sleeving part and the convex blocks of the protection part to stabilize the positions of the inertial sensors, and the protection part is coated outside the sleeving part to form a detachable multilayer sleeve part, so that the body part and five finger sleeve parts are formed to be worn on the hand of a user.
According to the utility model discloses an embodiment, wherein more contain a vibrations feedback unit for the interaction of discernment user between a virtual object in the virtual reality environment, and trigger predetermined dynamics data transmission to the control unit according to the relevant interactive type between user and the virtual object.
According to the utility model discloses an embodiment, wherein vibrations feedback unit contains a plurality of actuators, and it disposes thumb position, forefinger position and middle finger position in five dactylotheca parts of gloves subassembly respectively to make between user and the virtual object because of interactive type's triggering and send dynamics data by the virtual reality host computer, and transmit dynamics data in order to feed back to the user through the control unit.
According to the utility model discloses an embodiment, wherein still include a visual feedback unit for the interaction of discernment user between the virtual object in the virtual reality environment, and trigger predetermined luminance data transmission to the control unit according to the relevant interactive type between user and the virtual object.
According to the utility model discloses an embodiment, wherein the vision feedback unit contains a plurality of LED light-emitting component and disposes respectively in the gloves subassembly the fingertip position of five finger sleeve portions to make between user and the virtual object because of the triggering of interactive type send luminance data by the virtual reality host computer, and transmit luminance data through the control unit so that the user knows the stage nature condition that triggers under interactive state through the vision.
According to an embodiment of the present invention, the virtual reality hand motion sensing device is configured to transmit data through a Wireless Local Area Network (WLAN).
According to the present invention, the finger sensing unit further comprises a plurality of reed switches and a connection control unit, each reed switch is disposed at the finger tip of each finger sleeve, so that the user can trigger a contact signal when touching different fingers, and the control unit operates according to the contact signal to generate a preset gesture data and receive the preset gesture data by the virtual reality host.
According to the utility model discloses an embodiment, wherein more contain an antiskid cladding piece for provide the user and dress in hand and user cooperation registrate piece, put thing piece and protection piece and overlap in the hand according to the preface cover, antiskid cladding piece adopts the elastic fiber cloth material to make, and antiskid cladding piece adopts brush hair fiber cloth in the outer face that corresponds the registrate piece, so that the registrate piece, put the multilayer external member that thing piece and protection piece constitute and form the antiskid with antiskid cladding piece and user's hand and fix.
According to the utility model discloses an embodiment, wherein registrant and protection piece adopt soft rubber material to make respectively to form the protection to each subassembly in the action response module, one side that the registrant corresponds anti-skidding cladding piece is equipped with the devil's felt, so that the registrant forms the antiskid with the brush hair fibre cloth of devil's felt with anti-skidding cladding piece fixedly.
According to the utility model discloses an embodiment, wherein put the cavity casing that thing adoption photocuring resin material made, the inside of cavity casing is used for settling the control unit and fixes the control unit with the mounting, and the mounting is for offering screw thread and through screw and the control unit lock and fix on the cavity casing.
According to the utility model discloses an embodiment, wherein half finger cover portion of each of cover spare and protection piece is the part that covers each finger of user to first knuckle for the cover respectively, and each indent of half finger cover portion of each of cover spare extends to the position that the finger indicates the abdomen to be used for settling a vibrations feedback unit, each indent of half finger cover portion of each of cover spare is located the fingertip position and is used for settling a vision feedback unit, and the protection piece can be opened in the fingertip position and be equipped with the hole in order to expose the vision feedback unit.
Drawings
Fig. 1 is an external view of the hand movement sensing device of the present invention.
Fig. 2 is an exploded side view of the glove assembly of the present invention.
Fig. 3 is an exploded view of the glove assembly of the present invention on the other side.
Fig. 4 is a schematic view of the combination of the glove assembly of the present invention.
Fig. 5 is a schematic view showing the glove assembly of the present invention showing the velcro being torn away.
Description of reference numerals: 10-a glove component; 101-an anti-slip wrap; 102-a nesting component; 102 a-dorsum manus; 102 b-half of the finger sleeve portion; 1021-a groove; 1022-groove; 103-placing the object; 1031-a fixing member; 104-a guard; 104 a-dorsum manus; 104 b-half of the finger sleeve; 1041-a groove; 1042-bumps; 11-a body portion; 12-a finger cuff portion; 20-action response module; 21-a finger sensing unit; 211-inertial sensors; 212-data collection chip; 22-a control unit; 23-a wireless transceiver unit; 24-a power supply unit; 30-a vibration feedback unit; 40-a visual feedback unit; 60-soft connecting material; 70-reed switch element.
Detailed Description
The following detailed description and technical contents of the present invention are described with reference to the accompanying drawings, however, the accompanying drawings are only provided for reference and illustration, and are not intended to limit the present invention. Various embodiments of the present invention will be described in detail below with reference to the accompanying drawings, but the present invention is not limited to only these embodiments. The present invention covers any alternatives, modifications, equivalents, and alternatives falling within the spirit and scope of the invention. In the following description of the preferred embodiments of the present invention, specific details are set forth in order to provide a thorough understanding of the present invention, and it will be apparent to those skilled in the art that the present invention may be practiced without these specific details.
The following detailed description and technical contents of the present invention will be described in order to achieve the objects of the present invention with reference to the accompanying drawings and preferred embodiments of the present invention, which are not intended to limit the present invention. In the following description of the present invention, the terms "upper", "lower", "top", "bottom", "inner", "outer", and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description of the present invention, and the terms "upper", "lower", "top", "bottom", "inner", "outer", and the like, and are not intended to limit the present invention since the devices or components indicated herein must have a specific orientation, be constructed and operated in a specific orientation.
Please refer to fig. 1 and fig. 2, which respectively show an appearance schematic diagram and an operation block diagram of the hand motion sensing device for virtual reality according to the present invention. The hand motion sensing device for virtual reality of the utility model comprises a glove component 10 and a motion response module 20; the technical features of the glove assembly of the present invention will be described in advance, and then the overall configuration and actuation of the hand movement sensing device will be described in detail. The glove assembly for virtual reality of the utility model comprises a detachable multi-layer sleeve component to form a body part 11 and five finger sleeve parts 12, so as to provide a user to wear the glove; the glove assembly of the present invention can be worn as a single piece on a left-handed or right-handed glove member, or can be worn as a pair of left-handed and right-handed glove members, and the single-handed glove member will be described below.
The multi-layer kits comprise an anti-slip coating 101, a kit 102, a placement object 103 and a protection element 104; the motion response module 20 is used for tracking the hand motion of the user in a virtual reality environment, and the motion response module 20 is embedded between the multilayer kits and comprises a finger sensing unit 21, a control unit 22 and a wireless transceiving unit 23; the structure of the glove assembly will be described first.
The covering member 102 comprises a back portion 102a and five half finger sleeve portions 102b extending outwardly from the back portion to form a five-finger sleeve structure, wherein one side of the back portion 102a has a recess 1021, each half finger sleeve portion 102b has a groove 1022 communicating with the recess 1021, and the groove 1022 extends to the end of the half finger sleeve portion. The article placing component 103 is configured in the groove 1021 of the back of the hand and is used for placing the control unit 22 and the wireless transceiving unit 23 in the action response module 20, and the article placing component 103 is provided with a fixing component 1031 which is connected and fixed with the control unit 22; the guard 104 includes a back portion 104a and five half-finger sleeve portions 104b extending outwardly from the back portion 104a to form a five-finger sleeve structure; as illustrated herein, the sleeve member 102 and the five finger cuff structure of the guard 104 are substantially similar in overall structural profile, but not so limited. The back of the hand 104a of the guard 104 has a recess 1041 corresponding to one side of the sleeve member 102 and each half cuff 104b has a projection 1042 corresponding to the five recesses 1022 of the sleeve member 102. The anti-slip cover 101 is worn on the hand of a user and the user fits the sleeve member 102, the object placing member 103 and the protection member 104 to sequentially penetrate and sleeve on the hand.
According to the utility model discloses an embodiment, wherein antiskid cladding piece 101 adopts the elastic fiber cloth material to make, and antiskid cladding piece 101 adopts brush hair fiber cloth in the outer face that corresponds registrant 102 to it is fixed with antiskid cladding piece 101 and user's hand formation antiskid to make registrant 102, put the multilayer external member that thing piece 103 and protection piece 104 constitute.
According to the present invention, wherein the engaging member 102 and the protecting member 104 are made of soft rubber respectively to form a protection for each component of the motion response module 20, one side of the engaging member 102 corresponding to the anti-slip covering member 101 is provided with a velcro (not shown), so that the engaging member 102 is fixed to prevent slipping by using the velcro and the bristle fiber cloth of the anti-slip covering member 101.
According to an embodiment of the present invention, the central object 103 is a hollow shell made of light-cured resin material, the interior of the hollow shell is used for placing the control unit 22 and fixing the control unit 22 with the fixing member 1031, and the fixing member 1031 is threaded on the hollow shell and locked and fixed with the control unit through a screw.
According to an embodiment of the present invention, each of the half-finger sleeve portions of the sleeve member 102 and the protection member 104 covers the portion from the fingertip to the first knuckle of each finger of the user, so as to provide a comfortable feeling and a better control feeling when the user wears the finger.
The above disclosure discloses the overall structure design of the glove assembly of the present invention, the receiver explains the hand motion sensing device of the present invention, the motion response module 20 in the glove assembly 10 is mainly used to track the hand motion of the user in the virtual reality environment, and the finger sensing unit 21 therein comprises a plurality of inertial sensors 211 respectively disposed on the body portion 11 and each finger sleeve portion 12, the plurality of inertial sensors 211 are configured according to the connecting position of the back of the hand (such as the body portion 11) and the back of the hand to each finger (such as the finger sleeve portion 12) and each finger joint position (such as the finger sleeve portion 12), and each inertial sensor 211 lower end is respectively provided with a data collecting chip 212 and generates a motion information according to the hand motion of the user. The control unit 22 is connected to each data collecting chip 212 through a flexible connecting wire 60 (e.g., a Flexible Printed Circuit (FPC)) to receive the motion information, and after performing operation processing, generates motion data that can be used by an external virtual reality host (not shown) to determine the position and position change of the glove assembly 10 in the virtual reality environment. The wireless transceiving unit 23 is connected with the virtual reality host through a wireless network, so that the virtual reality host receives the motion data and performs data transmission.
According to an embodiment of the present invention, the middle article 103 is disposed between the recess 1021 of the engaging member 102 and the recess 1041 of the protecting member 104; the finger sensing unit 21 is disposed between the groove 1022 of the sleeve 102 and the protrusion 1042 of the protection element 104 for supporting and stabilizing the positions of the plurality of inertial sensors 211, and the protection element 104 is covered outside the sleeve 102 to form a detachable multi-layer kit, so as to form the body 11 and the five finger sleeves 12 for the user to wear on the hand.
According to an embodiment of the present invention, the system further comprises a vibration feedback unit 30 for identifying the interaction between a user and a virtual object in the virtual reality environment, and triggering the preset force data to be sent to the control unit 22 according to the type of the relevant interaction between the user and the virtual object; the vibration feedback unit 30 includes a plurality of actuators (not shown) respectively disposed at a thumb position, an index finger position and a middle finger position of the five glove parts 12 of the glove assembly 10, so that the force data is sent from the virtual reality host machine due to the triggering of the interaction type between the user and the virtual object, and is transmitted by the control unit to be fed back to the user.
According to an embodiment of the present invention, the display device further comprises a visual feedback unit 40 for identifying the interaction between a virtual object of the user in the virtual reality environment, and triggering the preset brightness data to be sent to the control unit according to the type of the relevant interaction between the user and the virtual object. Wherein the visual feedback unit 40 comprises a plurality of LED light emitting components and is respectively disposed at the finger tip positions of the five glove parts 12 of the glove component 10, such as: the groove 1022 embedded in the cover 102 is close to the fingertip, so that the user and the virtual object are triggered by the interaction type, the virtual reality host sends the brightness data, and the control unit 22 transmits the brightness data to make the user visually know the stage condition triggered in the interaction state.
According to the utility model discloses an embodiment, wherein virtual reality's hand action perception device passes through wireless local area network framework in order to form data transmission.
According to an embodiment of the present invention, the finger sensing unit 21 further comprises a plurality of reed switches 70 and a connection control unit 22, each reed switch is configured at the fingertip position of each finger sleeve, so that the user triggers a contact signal when touching different fingers, and the control unit operates according to the contact signal to generate a preset gesture data and receives the preset gesture data from the virtual reality host.
According to an embodiment of the present invention, each of the grooves 1022 of each half-finger sleeve 102b of the covering member 102 can extend to the position of the finger abdomen for placing the vibration feedback unit (e.g. actuator), each of the grooves 1022 of each half-finger sleeve 102b of the covering member 102 is located at the fingertip position for placing the visual feedback unit (e.g. LED light emitting component), and a hole (not shown) can be formed at the fingertip position of the protection member 104 to expose the visual feedback unit, so that the user can clearly observe the visual feedback unit.
According to an embodiment of the present invention, the motion response module 20 further includes a power supply unit 24, which is respectively connected to the plurality of inertial sensors 211, the plurality of data collecting chips 212, the control unit 22 and the wireless transceiver unit 23 to supply required power to the components, and the power supply unit 24 may be a battery or may be externally connected to other power sources, which is not limited herein.
Hand action perception device through dispose in inertial sensor 211 and the data acquisition chip 212 of each dactylotheca, and a plurality of inertial sensor and data acquisition chip 212 set up respectively in each knuckle position of each dactylotheca, send the motion information of self (including information such as gesture, speed, acceleration, chronogenesis) to supply the virtual reality host computer to confirm to wear the motion information of finger (thumb, forefinger, middle finger, ring finger and little finger) in the finger position. For example: the inertial sensor 101 may be disposed at the second node of the first finger sleeve 10 through the sensor base, and the inertial sensor transmits the motion information directly to the virtual reality host in a wireless manner. Furthermore, the inertial sensor 211 of the main body 11 is disposed at the back of the hand and wirelessly transmits the collected motion information to the virtual reality host. For example, the control unit 22 integrates and calculates the motion information of the thumb, the index finger, the middle finger, the ring finger, the little finger and the wrist through the motion information of the thumb, the index finger, the middle finger, the ring finger, the little finger and the wrist collected by the inertial sensor, and sends the integrated information to the virtual reality host through the wireless transceiver 24 for corresponding processing.
Further, the operation state of the hand motion sensing device of the present invention is described by taking HTC view as an example. Under the wifi wireless communication environment, the virtual reality host receives motion information collected by a plurality of inertial sensors worn on a glove assembly 10 (such as a left hand and a right hand) of a user, determines limb motion information of a thumb, an index finger, a middle finger, a ring finger, a little finger and a wrist wearing the glove assembly 10 according to the received motion information, and generates posture, position and gesture information of a virtual object according to the determined limb motion information; the head-mounted display (not shown) is used for receiving and displaying the posture, position and gesture information of the virtual object generated by the virtual reality host. In the virtual reality environment, the principle of calibrating the hand movement sensing device is to make the installation part of the movement measuring module in a known posture, and then determine the deviation of the installation direction of the movement measuring module according to the comparison between the measured posture of the movement measuring module and the known posture of the body part. For example, in the case of a calibration action of the inertial sensor at the wrist, it may be the hand facing forward with the palm facing down as a standard calibration action. For example, after the hand movement sensing device is worn in a predetermined manner, it is necessary to calibrate the mounting error of each inertial sensor.
In a specific embodiment, the calibration may be performed according to existing human body calibration actions on system software; during calibration, the measurement object needs to make a corresponding calibration action according to the posture of the software interface. Such as straightening fingers, drooping arms, or straightening fingers, lifting arms. And the receiving processor calibrates the motion information generated by calculation according to the biomechanics constraint of the human body and the external constraint. After the calibration is completed, the motion of the motion capture object (object to be measured) can be captured. For example: after the hand motion sensing device is worn according to a preset mode, corresponding software on the virtual reality host is started. The method comprises the steps of selecting a model of a motion capture object on a virtual reality host software interface according to motion capture object information and installation positions of various inertial sensors on the motion capture object, and if the software does not contain the model of the corresponding object, manually creating or inputting the model of the object, wherein the model of the object comprises the connection relation of various parts of the object, the sizes and initial positions of the various parts, and the like.
In particular embodiments, constraints and limits between various parts, such as allowable articulation angles, etc., may also be set or modified for the object model; after the object model is determined, the installation positions of the sensors are specified on a software interface of the virtual reality host according to the actual installation positions of the inertial sensors, and the specified positions need to be consistent with the actual positions. After the installation positions of the inertial sensors are determined, the installation errors of the inertial sensors need to be calibrated. The calibration can be performed according to the existing human body calibration action on software, and the calibration gesture can also be specified and designed by a user. During calibration, the measurement object needs to make a corresponding calibration action according to the posture of the software interface. The receiving processor determines the installation error of the inertial sensor according to the known attitude and the motion information measured by the inertial sensor. After the calibration of the inertial sensor is completed, the motion of the motion capture object can be captured.
When performing motion capture, assuming that the shoulder position is fixed relative to the head, the virtual reality host determines the motion information (including velocity, acceleration, timing, posture, etc.) of the wrist from the motion information transmitted from the inertial sensor 212 disposed in the body portion 1 (back of the hand position) and the relative postures between the calibrated inertial sensor and the plurality of inertial sensors disposed in the finger sleeve portion 12 (finger position), so that the virtual reality host obtains the position of the elbow relative to the head based on the preset upper arm length and shoulder position. Then, the virtual reality host determines motion information (including velocity, acceleration, timing, posture, etc.) of each finger joint according to the motion information transmitted by each inertial sensor of the five finger sleeves (finger joint positions) respectively arranged on the finger sleeve part 12 and the relative posture between the plurality of inertial sensors and each finger obtained by calibration; the virtual reality host computer obtains the relative position of each joint of each finger based on the preset palm length and the obtained wrist position.
In a specific embodiment, the virtual reality host determines motion information (including speed, acceleration, timing, posture, etc.) of the thumb according to the motion information transmitted by the inertial sensor disposed at the body portion 11 (e.g., the back of the hand) and the calibrated inertial sensor, and corresponding to the motion information transmitted by the inertial sensor disposed at the finger sleeve portion 12 (e.g., the position of the thumb) and the relative posture between the calibrated inertial sensors; and the virtual reality host machine obtains each knuckle position and posture of the thumb based on the preset knuckle length of the thumb and the obtained root position of the thumb. Similarly, the positions and postures of the knuckles of other fingers (for example, the index finger, the middle finger, the ring finger, or the little finger) are obtained based on the same arithmetic processing method.
The motion information of five fingers (motion information of thumb, index finger, middle finger, ring finger and little finger) acquired by the hand motion sensing device and the glove components thereof can be acquired in real time by the motion capture glove, so that the motion information of all fingers and wrists can be acquired in real time, and most of motions required in the virtual reality system, such as clicking operation, long-time pressing operation, grabbing operation, pinching operation and the like can be completed. Moreover, by means of the design of the magnetic reed switch, the current touch condition between the fingers is judged, the OK gesture or the gesture actions related to more detailed finger details can be effectively judged, and further the actions are reflected in the virtual reality, so that a user can see various detailed actions of the hand through the display, and the user experience is improved.
To sum up above-mentioned, a hand action perception device and gloves subassembly for virtual reality, as the use of the interactive sensing of hand for providing immersive VR interactive experience, have following advantage at least:
1. the utility model provides a user more can carry out the interactive integration with hand gesture situation and virtual reality's content in a flexible way.
2. The utility model discloses a transmission mode adopts near-end WLAN framework transmission, and main media communication mode is wiFi, can once send packet data to a plurality of virtual reality host computers, saves transmission time.
3. The utility model discloses a gloves subassembly adopts the devil's felt pattern of quick detach formula to adhere the cladding in mechanism design, provides user's convenience of considerable degree.
4. The utility model discloses a hand action perception device is in gloves front end design LED and vibrations module, provides the user and is in contact or when triggering relevant entity content/situation project in the virtual environment, can obtain real-time feedback experience.
5. The utility model discloses a hand action perception device adopts crooked module to listen in the mode is listened to each position of finger, can distinguish according to the parameter variation finger bending degree, reaches high sensitivity and the superexcellent hand form and distinguishes.
6. The utility model discloses a hand action perception device is to the hand on listening the situation, and application reed switch design judges to the present situation of touching between individual finger, can effectively differentiate relevant hand gesture actions such as OK or fist.
Although the present invention has been described with reference to the above preferred embodiments, it should be understood that various changes, substitutions and alterations can be made herein without departing from the spirit and scope of the invention as defined by the appended claims. The above-described embodiments are intended to illustrate the features and effects of the invention, but not to limit the scope of the invention, and all equivalent changes and modifications that can be made without departing from the spirit and scope of the invention should be construed in accordance with the substance of the present disclosure and the appended claims.
Claims (10)
1. A hand motion perception device for virtual reality, characterized by: the method comprises the following steps:
a glove assembly comprising a plurality of layers of detachable sleeves to form a body portion and five finger sleeve portions for a user to wear on a hand;
an action response module for tracking hand movements of the user in a virtual reality environment, the action response module being embedded between each of the plurality of layered assemblies and comprising:
a finger sensing unit, including a plurality of inertial sensors respectively disposed on each of the body portions and each of the finger sleeves, each of the plurality of inertial sensors being configured according to a back of a hand of each of the users, a connection position of the back of the hand to each of the fingers, and a position of each finger joint, and a data collecting chip being disposed at a lower end of each of the plurality of inertial sensors and generating motion information according to a hand motion of the user;
a control unit, which is connected with each data collection chip by a flexible connecting wire to receive the action information and generates motion data which can be used by an external virtual reality host to determine the position and the position change of the glove assembly in the virtual reality environment after operation processing;
the wireless transceiving unit is connected with the virtual reality host through a wireless network so as to receive the motion data and transmit data by the virtual reality host; and
and the power supply unit is respectively connected with the plurality of inertial sensors, the plurality of data collection chips, the control unit and the wireless transceiving unit so as to supply power to the wireless transceiving unit.
2. The hand motion perception device for virtual reality of claim 1, wherein: the glove assembly further comprises a vibration feedback unit for identifying interaction between a virtual object of the user in the virtual reality environment and triggering preset force data to be sent to the control unit according to the type of the relevant interaction between the user and the virtual object, wherein the vibration feedback unit comprises a plurality of actuators which are respectively arranged at a thumb part, an index finger part and a middle finger part of the five finger stall parts of the glove assembly, so that the force data are sent by the virtual reality host machine due to the triggering of the interaction type between the user and the virtual object and are sent back to the user through the control unit.
3. The hand motion perception device for virtual reality of claim 1, wherein: the visual feedback unit comprises a plurality of LED light-emitting components and is respectively configured at fingertip positions of the five finger sleeve parts of the glove component, so that the brightness data are sent by the virtual reality host machine due to the triggering of the interaction type between the user and the virtual object, and the control unit transmits the brightness data to enable the user to visually know the stage condition triggered in the interaction state.
4. The hand motion perception device for virtual reality of claim 1, wherein: the virtual reality hand motion sensing device forms data transmission through a wireless local area network architecture.
5. The hand motion perception device for virtual reality of claim 1, wherein: the finger sensing unit further comprises a plurality of reed switch elements and is connected with the control unit, each reed switch element is configured at the fingertip position of each finger sleeve part, so that the user can trigger a contact signal when different fingers are in contact, the control unit carries out operation according to the contact signal to generate preset gesture data, and the virtual reality host computer receives the preset gesture data.
6. A glove assembly for virtual reality according to any of claims 1 to 5, wherein: it is a detachable multi-layer kit and comprises:
the glove comprises a glove part and a handle part, wherein the glove part comprises a hand back part and five half glove parts extending outwards from the hand back part to form a five-claw finger glove structure, one side of the hand back part is provided with a groove, each half glove part is provided with a groove communicated with the groove, and the groove extends to the tail end of the half glove part;
the object placing piece is arranged in the groove of the back of the hand and used for placing the control unit and the wireless receiving and transmitting unit in the action response module, and the object placing piece is provided with a fixing piece which is fixedly connected with the control unit; and
the protective piece comprises a hand back part and five half finger sleeve parts extending outwards from the hand back part to form the five-claw finger sleeve structure, wherein the hand back part is provided with a groove at one side corresponding to the sheathing element, and each half finger sleeve part is provided with a convex block corresponding to the five grooves of the sheathing element;
wherein the placement element is placed between the groove of the sleeve element and the groove of the protection element, the finger sensing unit is placed between the groove of the sleeve element and the projection of the protection element to stabilize the positions of the plurality of inertial sensors, and the protection element is covered outside the sleeve element to form a detachable multi-layer sleeve element, so that the body part and five finger sleeve parts are formed to be worn on the hand of the user.
7. The glove assembly for virtual reality of claim 6, wherein: more contain an antiskid cladding piece, be used for providing the user dress in the hand just the user cooperation the registrate piece put the article and the protection piece overlaps in the hand according to the preface, antiskid cladding piece adopts the elastic fiber cloth material to make, antiskid cladding piece is in corresponding the outer face of registrate piece adopts the brush hair fiber cloth, so that the registrate piece put the article and the multilayer external member that the protection piece constitutes with antiskid cladding piece with the user hand forms the antiskid fixedly.
8. The glove assembly for virtual reality of claim 7, wherein: the registrant with the protection piece adopts soft rubber material to make respectively, in order to right each subassembly in the action response module forms the protection, the registrant corresponds one side of antiskid cladding piece is equipped with the devil's felt, so that the registrant with the devil's felt with the brush hair fiber cloth of antiskid cladding piece forms the antiskid fixedly.
9. The glove assembly for virtual reality of claim 6, wherein: the object placing piece is a hollow shell made of a light-cured resin material, the control unit is arranged in the hollow shell and fixed by the fixing piece, and the fixing piece is provided with threads on the hollow shell and is locked and fixed with the control unit through screws.
10. The glove assembly for virtual reality of claim 6, wherein: the cover member and the protection member are each a part covering the fingertip of each finger of the user to the first knuckle, the grooves of the cover member extend to the finger pulp position to place a vibration feedback unit, the grooves of the cover member are located at the fingertip position to place a visual feedback unit, and the protection member is provided with holes at the fingertip position to expose the visual feedback unit.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW108100460 | 2019-01-06 | ||
| TW108100460A TW202026049A (en) | 2019-01-06 | 2019-01-06 | A motion capture apparatus and gloves for virtual reality system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN210605634U true CN210605634U (en) | 2020-05-22 |
Family
ID=70685843
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201920515709.3U Expired - Fee Related CN210605634U (en) | 2019-01-06 | 2019-04-16 | Hand motion sensing device for virtual reality and glove assembly thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN210605634U (en) |
| TW (1) | TW202026049A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631428A (en) * | 2020-12-25 | 2021-04-09 | 睿爱智能科技(上海)有限责任公司 | Gloves of intelligence response |
| CN115547129A (en) * | 2022-10-19 | 2022-12-30 | 肇庆医学高等专科学校 | AR implementation system and method for heart three-dimensional visualization |
| WO2023080314A1 (en) * | 2021-11-08 | 2023-05-11 | 주식회사 비햅틱스 | Device for providing tactile stimulation |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114077301B (en) * | 2020-08-20 | 2023-10-10 | 鹏鼎控股(深圳)股份有限公司 | Virtual reality glove and manufacturing method thereof |
-
2019
- 2019-01-06 TW TW108100460A patent/TW202026049A/en unknown
- 2019-04-16 CN CN201920515709.3U patent/CN210605634U/en not_active Expired - Fee Related
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112631428A (en) * | 2020-12-25 | 2021-04-09 | 睿爱智能科技(上海)有限责任公司 | Gloves of intelligence response |
| WO2023080314A1 (en) * | 2021-11-08 | 2023-05-11 | 주식회사 비햅틱스 | Device for providing tactile stimulation |
| CN115547129A (en) * | 2022-10-19 | 2022-12-30 | 肇庆医学高等专科学校 | AR implementation system and method for heart three-dimensional visualization |
| CN115547129B (en) * | 2022-10-19 | 2023-10-03 | 肇庆医学高等专科学校 | AR realization system and method for three-dimensional visualization of heart |
Also Published As
| Publication number | Publication date |
|---|---|
| TW202026049A (en) | 2020-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN210605634U (en) | Hand motion sensing device for virtual reality and glove assembly thereof | |
| US10758158B2 (en) | System and method for rehabilitation exercise of the hands | |
| US20210217246A1 (en) | Wearable electronic devices and extended reality systems including neuromuscular sensors | |
| CN111638801B (en) | Controller for gesture recognition and gesture recognition method thereof | |
| JP2021073598A (en) | Wearable wireless HMI device | |
| CN108196686B (en) | Hand motion gesture capturing device, method and virtual reality interaction system | |
| US6128004A (en) | Virtual reality glove system with fabric conductors | |
| KR101548156B1 (en) | A wireless exoskeleton haptic interface device for simultaneously delivering tactile and joint resistance and the method for comprising the same | |
| US10775946B2 (en) | Universal handheld controller of a computer system | |
| CN207087856U (en) | A kind of ectoskeleton based on touch feedback | |
| US20220155866A1 (en) | Ring device having an antenna, a touch pad, and/or a charging pad to control a computing device based on user motions | |
| CN108687744A (en) | A kind of ectoskeleton based on touch feedback | |
| CN113632176A (en) | Method and apparatus for low latency body state prediction based on neuromuscular data | |
| CN114503057A (en) | Orientation determination based on both image and inertial measurement units | |
| RU2662399C1 (en) | System and method for capturing movements and positions of human body and parts of human body | |
| CN113509298A (en) | Artificial limb hand force position information feedback system and method based on vibration | |
| US10409375B1 (en) | Apparatus, system, and method for providing localized tactile feedback | |
| TWM580450U (en) | Hand action sensing device for virtual reality and glove assembly thereof | |
| CN208176095U (en) | It is a kind of that gloves are interacted based on the virtual reality of laser positioning and Bluetooth technology | |
| TWI644189B (en) | Wireless control device, position calibrator and accessory | |
| CN109801709A (en) | A kind of system of hand gestures capture and health status perception for virtual environment | |
| JP6431284B2 (en) | Apparatus and method for extending human hand function using excess artificial appendages | |
| WO2021207033A1 (en) | Input device to control a computing device with a touch pad having a curved surface configured to sense touch input | |
| CN111367416A (en) | Virtual reality gloves and virtual reality interaction system | |
| CN211827193U (en) | Virtual reality gloves and virtual reality interaction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200522 |