CN112379783B - Virtual reality system for enhancing upper limb multidirectional movement of user immersion - Google Patents
Virtual reality system for enhancing upper limb multidirectional movement of user immersion Download PDFInfo
- Publication number
- CN112379783B CN112379783B CN202011472617.5A CN202011472617A CN112379783B CN 112379783 B CN112379783 B CN 112379783B CN 202011472617 A CN202011472617 A CN 202011472617A CN 112379783 B CN112379783 B CN 112379783B
- Authority
- CN
- China
- Prior art keywords
- user
- tension
- acquisition point
- handle
- numerical control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
Abstract
A virtual reality system for enhancing multi-directional movement of an upper limb of a user's immersion, comprising: the system comprises interactive physical training equipment, a position positioning module (a handle inductor and an arm ring inductor), a data processing terminal and a head-mounted display; the data processing terminal is interconnected with the interactive physical training equipment, the position positioning module and the head-mounted display; the terminal processor calculates the spatial position of the upper limbs of a user by integrating data and utilizing position data transmitted by the handle inductor and the arm ring inductor and the position conversion module, and simultaneously shows the spatial position of the upper limbs of the user in a virtual display device in a virtual reality dynamic deductive mode according to the action mirror image model by combining stress data transmitted by the interactive physical training device. Based on the technical scheme disclosed by the invention, the method can further develop specific application projects which are widely applied to various fields such as virtual reality upper limb rehabilitation training, entertainment and leisure and the like in the future.
Description
The application is a parent Chinese invention patent application 201911119408X, application date: application for division of "virtual reality system for immersive upper limb multidirectional activity" on 11/15/2019.
Technical Field
The invention relates to the technical field of virtual reality, in particular to a virtual reality system supporting multi-directional pulling force and real-time feedback interaction reverse pulling of upper limbs.
Background
The virtual reality technology is widely applied to entertainment, movie and television, teaching, rehabilitation, training, rehearsal, engineering design, planning and designing, medicine, military and aerospace, and the multi-sense interaction technology is introduced into the virtual reality environment, so that deep interaction and immersion can be realized, and interaction experience closer to nature can be obtained. On one hand, virtual reality systems based on multi-sensory interaction have become a hot spot of current research in the field of virtual reality. However, the interaction in the current virtual reality system has the problems of being excessively dependent on high-end equipment, difficult to realize multi-sensor synchronous interaction and the like. On the other hand, in recent years, the virtual reality industry in China is rapidly developing, related key technologies are further mature, and breakthroughs are continuously made in the technical fields of picture quality, image processing, eyeball capture, 3D sound field, machine vision and the like. However, a great deal of current technical development mainly centers on visual feedback (optimized in terms of distortion or lag of visual images, stereoscopic sense, pixel resolution, visual field, speed, frame rate and the like) and auditory feedback (optimized in terms of user's own voice, voice of others, and voice of objects or environments) in the virtual reality experience, and technical breakthroughs and market applications in the virtual reality experience of the tactile environment feedback are relatively few. Virtual reality presence and immersion are not matched with comprehensive sensory feelings due to the lack of appropriate tactile feedback in the interaction process of the user, and the immersion and experience are limited.
The prior art interaction device is often insufficient in performance in the aspect of tactile feedback experience and occupies a large space. "an immersive virtual reality interactive device" (chinese patent application No. 201921771085.8) applied by the inventor of the yaochi et al in 2019.10.21 firstly provides an immersive virtual reality interactive device, which is a virtual reality interactive device capable of providing multi-directional tension real-time feedback and occupies a small space.
The invention is further developed on the basis of the set of equipment for supporting the multidirectional tensile force.
Disclosure of Invention
The invention aims to support the design concept of a multidirectional tensile instrument device based on 'an immersive virtual reality interaction device' (Chinese patent application No. 201921771085.8), and further discloses a wall-mounted virtual reality system supporting upper limb movement, which can obtain real hand feeling and enhance immersive experience.
Based on the technical scheme disclosed by the invention, the method can further develop specific application projects which are widely applied to various fields such as virtual reality upper limb rehabilitation training, entertainment and leisure and the like in the future.
The technical scheme required to be protected is characterized in that:
an upper limb activity virtual reality system comprising: interactive physical training equipment, a positioning module (a handle inductor and an arm ring inductor), a data processing terminal and a head-mounted display. The data processing terminal is interconnected with the interactive physical training equipment, the positioning module and the head-mounted display. The terminal processor calculates the spatial position of the upper limbs of a user by integrating data and utilizing position data transmitted by the handle inductor and the arm ring inductor and the position conversion module, and simultaneously shows the spatial position of the upper limbs of the user in a virtual display device in a virtual reality dynamic deductive mode according to the action mirror image model by combining stress data transmitted by the interactive physical training device.
Each part is designed as follows:
the interactive physical training device comprises a numerical control slide rail assembly, a handle assembly and a central pivot assembly. The numerical control slide rail assembly comprises a slide table base (14), a numerical control slide table (13), a transverse rail (11) and a lifting rail (12); the numerical control sliding table (13) is movably connected to the transverse track (11), the numerical control sliding table (13) comprises a sliding block and a sliding block stepping motor, the sliding block is meshed with the transverse track (11), and the rotating shaft is driven by the sliding block stepping motor to be converted into a transverse moving direction d1 and a displacement s1 of the whole numerical control sliding table (13) on the transverse track (11); the transverse rail (11) is integrally and movably connected to the lifting rail (12) after being arranged on the sliding table base (14); the sliding table base (14) comprises a base and a base stepping motor, the base is meshed with the lifting track (12), and the rotating shaft is driven by the base stepping motor to be converted into the lifting direction d2 and the displacement s2 of the whole sliding table base (14) on the lifting track (12); handle components includes elasticity stay cord (41), numerical control moves back line ware (42), steering wheel, handle (43), the elasticity stay cord twines in moving back the line ware pivot, and the one end of elasticity stay cord is connected in the slip table, and its other end is used for connecting the handle, steering wheel output shaft moves back line ware pivot, moves back line ware pivot and is used for accomodating or release elasticity stay cord, adjusts elasticity stay cord (41) length. The elastic cord (41) has elasticity and an inherent elastic coefficient f. The central pivot assembly comprises a controller (32), a tension sensor and a remote controller (34); the tension sensor is arranged on the handle assembly and used for acquiring tension state data (tension magnitude n and direction d3) of the elastic pull rope and providing the data to the controller (32); the device comprises a slide block stepping motor, a base stepping motor and a steering engine, wherein drivers of the slide block stepping motor, the base stepping motor and the steering engine are connected and controlled by a controller (32). The remote controller (34) is connected to the controller (32) and used for initially setting or resetting the position of the sliding table base (14) on the transverse rail (2) and the lifting rail (12) and the operation length of the pull rope before the movement of the upper limbs so as to meet the requirements of users. The tension sensor transmits the data of the tension of the user and the tension direction to the controller (32) in real time.
The positioning module comprises a handle inductor and arm ring inductor hardware. The handle sensor is arranged on a handle (43) held by a user, and is used for obtaining the relative spatial position of the handle (43) in a space established by a numerical control slide rail component of the interactive physical training equipment and providing the relative spatial position to a position conversion module in a terminal processor. The arm ring sensor is arranged on the elbow joint of a user, and the relative spatial position of the arm ring sensor in the set space is obtained and provided for the position conversion module. The system can obtain the motion data of the elbow by combining the position information of two points of the handle sensor and the arm ring sensor.
The terminal processor comprises a position conversion module and a tension analysis feedback module.
The position conversion module acquires the position of the upper limb of the user and performs space calculation to obtain the position corresponding to the virtual space; setting a numerical control sliding table (13) of interactive physical training equipment as a position acquisition point 0(X0, Y0 and Z0), as an origin of a space coordinate, using an arm ring sensor on an arm of a user as an acquisition point 1(X1, Y1 and Z1), using a sensor on an extension bar as an acquisition point 2(X2, Y2 and Z2), and using a sensor on a holding bar as an acquisition point 3(X3, Y3 and Z3); under the condition of not using lengthening, the acquisition point 2 and the acquisition point 3 are the same point, and the acquisition point 3 is taken as a description object; without using lengthening, decision point 4(X4, Y4, Z4) is determined to be on the extension of acquisition Point 0 from acquisition Point 3 when acquisition Point 0 is at a higher position than acquisition Point 3; without the use of lengthening, decision point 4 is determined on the gravity parabola at acquisition point 0 from acquisition point 3 when acquisition point 0 is at a position lower than acquisition point 3.
The tension analysis feedback module: according to the transverse displacement s1 vertical displacement s2 of the numerical control sliding table (13), the tension direction d3 and the size n state data of the elastic pull rope (41) and the inherent elastic coefficient f of the elastic pull rope (41), under the action form and constraint of an action mirror image model, a tension analysis feedback module analyzes and processes and feeds back, instructs a steering engine to control a numerical control wire withdrawing device to perform rope withdrawing and releasing actions, adjusts the length of the elastic pull rope (41) in real time, further changes the tension height and the tension size of a virtual object, and enables a user to feel real force opposition in the upper limb action process; the instruction numerical control sliding table (13) moves left and right on the transverse sliding rail, so that the tension direction is changed, a user obtains tension direction feedback consistent with own vision, touch sense and movement sense perception and judgment, and the virtual reality immersion experience of the user is enhanced.
The invention has the beneficial effects
1. The interaction equipment of the system has small space occupation and can be arranged in a small room.
2. The interactive equipment firstly discloses a special multidirectional pulling force interaction new mode.
3. The steering engine compliance controller in the interactive equipment can adapt to the drawing and withdrawing of the tension rope, and a special bidirectional tension interaction new mode is disclosed for the first time.
The system has small occupied area, fuses the novel multidirectional pulling force interaction mode innovation point with the virtual reality technology again, and innovates again on the pulling force analysis feedback, so that the experience of a user in the aspects of real hand feeling and immersion feeling is brought into play to the utmost extent. Has wide development prospect in the application fields of medical treatment, health care, education, entertainment and the like.
Drawings
FIG. 1 is a schematic diagram of the system of the present invention
FIG. 2 is a schematic diagram of an interactive device
FIG. 3 is a schematic diagram of the structure of the tension sensor in the present interactive device
FIG. 4 is a schematic diagram of the interactive equipment hub component
FIG. 5 is a schematic diagram of the method for computing the imaging orientation of the tension-triggered object in the virtual reality environment of the device
FIG. 6 is a schematic view of the installation of the extension bar of the device
FIG. 7 is a schematic diagram of the system in situ
Numerical labeling:
the device comprises a slide rail assembly 1, a transverse slide rail 11, a lifting rail 12, a numerical control sliding table 13, a sliding table base 14 and a cover 15;
the central pivot component 3, a power supply module 31, a power line plug 311, a singlechip 32, a Bluetooth module 33 and a lifting remote controller 34;
an elastic pull rope 41, a numerical control wire withdrawing device 42, a numerical control wire withdrawing device rotating shaft 421, a handle 43, a tension sensor 44 and an extension bar (45).
Detailed Description
The technical solutions provided in the present application will be further described with reference to the following specific embodiments and accompanying drawings. The advantages and features of the present application will become more apparent in conjunction with the following description.
It should be noted that the embodiments of the present application have a better implementation and are not intended to limit the present application in any way. The technical features or combinations of technical features described in the embodiments of the present application should not be considered as being isolated, and they may be combined with each other to achieve a better technical effect. The scope of the preferred embodiments of this application may also include additional implementations, and this should be understood by those skilled in the art to which the embodiments of this application pertain.
Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
The drawings in the present application are in simplified form and are not to scale, but rather are provided for convenience and clarity in describing the embodiments of the present application and are not intended to limit the scope of the application. Any modification of the structure, change of the ratio or adjustment of the size of the structure should fall within the scope of the technical disclosure of the present application without affecting the effect and the purpose of the present application. And the same reference numbers appearing in the various drawings of the present application designate the same features or components, which may be employed in different embodiments.
The present embodiment combines hardware and software.
As shown in fig. 7.
Site space: the space is small because the space is available indoors and outdoors.
The method comprises the following steps:
1. the wall-mounted interactive control equipment is used for supporting multidirectional activities.
2. By arranging the sensors, a position positioning system of the upper limb holding part, tension in an active applying mode and pull-back tension in a passive mode are realized.
3. Expression pattern of upper limb movement. An elastic cord.
4. Data processing and instruction feedback.
5. And (6) displaying.
As shown in fig. 1, the upper limb movement virtual reality system includes: interactive physical training equipment, a positioning module (a handle inductor and an arm ring inductor), a processing terminal and a head-mounted display.
The interactive physical training equipment comprises a numerical control slide rail assembly, a handle assembly and a central pivot assembly, and is shown in figures 2, 3 and 4.
The numerical control slide rail assembly is arranged on a wall body or a bracket and the like and comprises a sliding table base (14), a numerical control sliding table (13), a transverse rail (11) and a lifting rail (12);
the numerical control sliding table (13) is movably connected to the transverse track (11), the numerical control sliding table (13) comprises a sliding block and a sliding block stepping motor, the sliding block is meshed with the transverse track (11), and the rotating shaft is driven by the sliding block stepping motor to be converted into a transverse moving direction d1 and a displacement s1 of the whole numerical control sliding table (13) on the transverse track (11);
the transverse rail (11) is integrally and movably connected to the lifting rail (12) after being arranged on the sliding table base (14);
the sliding table base (14) comprises a base and a base stepping motor, the base is meshed with the lifting track (12), and the rotating shaft is driven by the base stepping motor to be converted into the lifting direction d2 and the displacement s2 of the whole sliding table base (14) on the lifting track (12);
handle components includes elasticity stay cord (41), numerical control moves back line ware (42), steering wheel, handle (43), the elasticity stay cord twines in moving back the line ware pivot, and the one end of elasticity stay cord is connected in the slip table, and its other end is used for connecting the handle, steering wheel output shaft moves back line ware pivot, moves back line ware pivot and is used for accomodating or release elasticity stay cord, adjusts elasticity stay cord (41) length. By way of example only, and not limitation, one end of the elastic pull rope is a fixed end and can be fixed to the sliding table together through the wire withdrawing device.
The elastic cord (41) has elasticity and an inherent elastic coefficient f.
The handle (43) can also be provided with an extension rod (45) which is additionally arranged between the free end of the elastic pull rope (41) and the handle (43) and is used for simulating individual special application items, such as simulating the movement of upper limbs of fishing rods and the like. The handle (43) serves as a gripping bar and the extension bar (45) serves as an extension bar of the gripping bar.
The central pivot assembly comprises a controller (32), a tension sensor and a remote controller (34); the tension sensor is arranged on the handle assembly and used for acquiring tension state data (tension magnitude n and direction d3) of the elastic pull rope and providing the data to the controller (32); the device comprises a slide block stepping motor, a base stepping motor and a steering engine, wherein drivers of the slide block stepping motor, the base stepping motor and the steering engine are connected and controlled by a controller (32). The remote controller (34) is connected to the controller (32) and used for initially setting or resetting the reference height position of the sliding table base (14) on the lifting track (12) and the operation length of the pull rope before the movement of the upper limbs so as to meet the requirements of users.
The controller may be implemented by, for example, a single chip microcomputer.
The hub assembly may further include a power module (31), and the system power supply technology is conventional and not necessarily limited. The power supply module (31) supplies power to the central assembly.
The communication module is used for realizing communication connection between the controller (32) and the handle, the arm ring and the remote controller (34), belongs to the conventional technology and is not necessarily limited.
Specifically, the remote controller (34) is used for controlling a power switch of the equipment, and the initial height position of the sliding table base (14) above the lifting track (12) is also controlled through up and down keys of the remote controller; the upper and lower buttons of the handle (43) are used for controlling the stretching of the pull rope. The user can adjust the initial state of the hardware equipment by himself to be suitable for the physical characteristics (such as height), interactive postures (such as standing posture and sitting posture) and the length of the pull rope (the initial height of the handle and the initial size of the counter force) which are controlled individually by the user. The remote controller (34) and the handle (43) transmit initial height data of the numerical control base (14) and initial pull force data of the pull rope set by a user to the single chip microcomputer sensor through the communication module. These are conventional techniques and are not necessarily limited.
The tension sensor transmits the data of the tension of the user and the tension direction to the controller (32) in real time.
And the positioning module comprises a handle inductor and arm ring inductor hardware.
The handle sensor is arranged on a handle (43) and an extension bar (45) which are held by a user, and is used for obtaining the relative spatial position of the handle (43) in the space established by the numerical control slide rail component of the interactive physical training equipment and providing the relative spatial position to a position conversion module in the terminal processor.
The arm ring sensor is arranged on the elbow joint of a user, and the relative spatial position of the arm ring sensor in the set space is obtained and provided for the position conversion module. The significance is as follows:
by combining the position information of two points of the handle sensor and the arm ring sensor, the system can obtain the action data of 'up, down, left, right, front, back, horizontal rotation and vertical rotation' of the elbow.
And the system can more accurately detect the spatial position and the specific action of the arm by combining the third position data of the virtual reality head-mounted display.
Each position sensor can be connected with the terminal processor through Bluetooth, and the technology is conventional.
And the terminal processor comprises a position conversion module, a tension analysis feedback module, an action mirror image model and virtual scene contents.
The position conversion module: the position of the upper limb of the user is collected and spatial calculation is carried out to obtain the position corresponding to the virtual space. The numerical control sliding table (13) of the interactive physical training equipment is set as a position acquisition point 0(X0, Y0 and Z0) and is used as an origin of a space coordinate, an arm ring sensor on the elbow of a user is used as an acquisition point 1(X1, Y1 and Z1), a sensor on an extension bar is used as an acquisition point 2(X2, Y2 and Z2), a sensor on a holding rod is used as an acquisition point 3(X3, Y3 and Z3), the acquisition point 2 and the acquisition point 3 are the same point under the condition of not using extension, and the acquisition point 3 is used as a description object. Without using lengthening, decision point 4(X4, Y4, Z4) is determined to be on the extension of acquisition Point 0 from acquisition Point 3 (user-perceived virtual object point of application or force, enhancing the immersive experience) when acquisition Point 0 is at a position higher than acquisition Point 3. As shown in fig. 5 (b): in the case of no lengthening, the pull trigger point 4(X4, Y4, Z4) of the virtual object should be on the extension line of the acquisition point 0 and the acquisition point 3 in the pull-down activity, and can be applied to the application items such as kiteflying and the like. Without using lengthening, decision point 4 is determined to be on the extension of acquisition point 0 from acquisition point 3 or on the gravity parabola (decision point virtually perceived by the user, enhancing the immersive experience) when acquisition point 0 is at a position lower than acquisition point 3. As shown in fig. 5 (a): in the case of no lengthening, the pull trigger point 4(X4, Y4, Z4) of the virtual object should be on the extension of the acquisition point 0 to the acquisition point 3 or gravity parabola in the pull-up activity. The method is applied to application items such as fishing and the like.
The tension analysis feedback module: according to the transverse displacement s1 vertical displacement s2 of the numerical control sliding table (13), the tension direction d3 and the size n state data of the elastic pull rope (41) and the inherent elastic coefficient f of the elastic pull rope (41), under the action form and constraint of an action mirror image model, a tension analysis feedback module analyzes and processes and feeds back, instructs a steering engine to control a numerical control wire withdrawing device to perform rope withdrawing and releasing actions, adjusts the length of the elastic pull rope (41) in real time, further changes the tension height and the tension size of a virtual object, and enables a user to feel real force opposition in the upper limb action process; the instruction numerical control sliding table (13) moves left and right on the transverse sliding rail, so that the tension direction between the virtual object and the user is changed, the user obtains tension direction feedback consistent with own vision, touch and movement perception and judgment, and the virtual reality immersion experience of the user is greatly enhanced.
The action mirror image model and the application scene content are specific application projects in various fields of various industries to be developed, and are not the scope and the invention task disclosed by the technical scheme of the invention. For example, tension-type upper limb activities such as a virtual fishing project, a virtual kitting project, a virtual yacht-launching project, a virtual radish pulling game project, upper limb rehabilitation training and the like are arranged, various application scene contents are arranged, and planning and creative ideas can be planned and created according to specific projects.
The terminal processor calculates the spatial position of the upper limbs of a user by integrating data and utilizing position data transmitted by the handle inductor and the arm ring inductor and the position conversion module, and simultaneously shows the spatial position of the upper limbs of the user in a virtual display device in a virtual reality dynamic deductive mode according to the action mirror image model by combining stress data transmitted by the interactive physical training device.
Four, head-mounted virtual display device
The head-mounted virtual display equipment is connected with the terminal processor through a data line or a Bluetooth module, and displays and plays virtual scenes and interactive contents rendered through the terminal processor.
When the technical scheme is specifically realized, the power module (8) of the embodiment can further comprise an adapter and a power line plug (11), the power line plug (11) is connected with external commercial power, and the external commercial power is converted into power supply voltage which accords with the actual central assembly through the adapter.
When the technical scheme is specifically realized, the communication module of the embodiment can be realized by selecting a Bluetooth module.
The system has small occupied area, fuses the novel multidirectional pulling force interaction mode innovation point with the virtual reality technology again, and innovates again on the pulling force analysis feedback, so that the experience of a user in the aspects of real hand feeling and immersion feeling is brought into play to the utmost extent. Has wide development prospect in the application fields of medical treatment, health care, education, entertainment and the like.
The above description is only illustrative of the preferred embodiments of the present application and is not intended to limit the scope of the present application in any way. Any changes or modifications made by those skilled in the art based on the above disclosure should be considered as equivalent effective embodiments, and all the changes or modifications should fall within the protection scope of the technical solution of the present application.
Claims (2)
1. A virtual reality system for enhancing multi-directional movement of an upper limb of a user's immersion, comprising: the system comprises interactive physical training equipment, a positioning module, a data processing terminal and a head-mounted display, wherein the positioning module comprises a handle inductor and an arm ring inductor; the data processing terminal is interconnected with the interactive physical training equipment, the positioning module and the head-mounted display; the terminal processor calculates the spatial position of the upper limb of a user by integrating data and utilizing position data transmitted by the handle inductor and the arm ring inductor and the position conversion module, and displays the spatial position of the upper limb of the user in a head-mounted virtual display device in a virtual reality dynamic deduction mode according to an action mirror image model by combining stress data transmitted by the interactive physical training device;
the interactive physical training device comprises a numerical control slide rail component, a handle component and a central pivot component; the numerical control slide rail assembly comprises a slide table base (14), a numerical control slide table (13), a transverse rail (11) and a lifting rail (12); the numerical control sliding table (13) is movably connected to the transverse track (11), the numerical control sliding table (13) comprises a sliding block and a sliding block stepping motor, the sliding block is meshed with the transverse track (11), and the rotating shaft is driven by the sliding block stepping motor to be converted into a transverse moving direction d1 and a displacement s1 of the whole numerical control sliding table (13) on the transverse track (11); the transverse rail (11) is integrally and movably connected to the lifting rail (12) after being arranged on the sliding table base (14); the sliding table base (14) comprises a base and a base stepping motor, the base is meshed with the lifting track (12), and the rotating shaft is driven by the base stepping motor to be converted into the lifting direction d2 and the displacement s2 of the whole sliding table base (14) on the lifting track (12); the handle assembly comprises an elastic pull rope (41), a numerical control wire withdrawing device (42), a steering engine and a handle (43), the elastic pull rope is wound on a wire withdrawing device rotating shaft, one end of the elastic pull rope is connected to the sliding table, the other end of the elastic pull rope is connected to the handle, the steering engine output shaft is connected with a wire withdrawing device rotating shaft, and the wire withdrawing device rotating shaft is used for containing or releasing the elastic pull rope and adjusting the length of the elastic pull rope (41); the elastic pull rope (41) has elasticity and an inherent elastic coefficient f; the central pivot assembly comprises a controller (32), a tension sensor and a remote controller (34); the tension sensor is arranged on the handle assembly and used for acquiring tension state data (tension magnitude n and direction d3) of the elastic pull rope and providing the data to the controller (32); the device comprises a slide block stepping motor, a base stepping motor and a steering engine, wherein drivers of the slide block stepping motor, the base stepping motor and the steering engine are connected and controlled by a controller (32); the remote controller (34) is connected with the controller (32) and is used for initially setting or resetting the reference height position of the sliding table base (14) on the lifting track (12) and the operation length of the pull rope before the upper limb moves so as to adapt to the requirements of a user; the tension sensor transmits the data of the tension of the user and the tension direction to the controller (32) in real time;
the terminal processor comprises a position conversion module and a tension analysis feedback module; the position conversion module acquires the position of the upper limb of the user and performs space calculation to obtain the position corresponding to the virtual space; setting a numerical control sliding table (13) of interactive physical training equipment as a position acquisition point 0(X0, Y0 and Z0), as an origin of a space coordinate, using an arm ring sensor on an arm of a user as an acquisition point 1(X1, Y1 and Z1), using a sensor on an extension bar as an acquisition point 2(X2, Y2 and Z2), and using a sensor on a holding bar as an acquisition point 3(X3, Y3 and Z3); under the condition of not using lengthening, the acquisition point 2 and the acquisition point 3 are the same point, and the acquisition point 3 is taken as a description object; without using lengthening, decision point 4(X4, Y4, Z4) is determined to be on the extension of acquisition Point 0 from acquisition Point 3 when acquisition Point 0 is at a higher position than acquisition Point 3; without using lengthening, decision point 4 is determined at acquisition point 0 on an extension or gravity parabola from acquisition point 3 when acquisition point 0 is at a position lower than acquisition point 3;
the tension analysis feedback module: according to the transverse displacement s1 vertical displacement s2 of the numerical control sliding table (13), the tension direction d3 and the size n state data of the elastic pull rope (41) and the inherent elastic coefficient f of the elastic pull rope (41), under the action form and constraint of an action mirror image model, a tension analysis feedback module analyzes and processes and feeds back, instructs a steering engine to control a numerical control wire withdrawing device to perform rope withdrawing and releasing actions, adjusts the length of the elastic pull rope (41) in real time, further changes the tension height and the tension size of a virtual object, and enables a user to feel real force opposition in the upper limb action process; the instruction numerical control sliding table (13) moves left and right on the transverse sliding rail, so that the tension direction is changed, a user obtains tension direction feedback consistent with own vision, touch sense and movement sense perception and judgment, and the virtual reality immersion experience of the user is enhanced.
2. The upper limb activity virtual reality system of claim 1, wherein the positioning module comprises a handle sensor, an arm ring sensor hardware; the handle sensor is arranged on a handle (43) held by a user, and is used for obtaining the spatial position of the handle (43) and providing the spatial position to a position conversion module in the terminal processor; the arm ring inductor is arranged on the elbow joint of a user, obtains the spatial position of the arm ring inductor and provides the spatial position for the position conversion module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011472617.5A CN112379783B (en) | 2019-11-15 | 2019-11-15 | Virtual reality system for enhancing upper limb multidirectional movement of user immersion |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911119408.XA CN111103974B (en) | 2019-11-15 | 2019-11-15 | Immersive virtual reality system for multi-directional movement of upper limbs |
| CN202011472617.5A CN112379783B (en) | 2019-11-15 | 2019-11-15 | Virtual reality system for enhancing upper limb multidirectional movement of user immersion |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911119408.XA Division CN111103974B (en) | 2019-11-15 | 2019-11-15 | Immersive virtual reality system for multi-directional movement of upper limbs |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112379783A CN112379783A (en) | 2021-02-19 |
| CN112379783B true CN112379783B (en) | 2021-12-07 |
Family
ID=70420687
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911119408.XA Active CN111103974B (en) | 2019-11-15 | 2019-11-15 | Immersive virtual reality system for multi-directional movement of upper limbs |
| CN202011472617.5A Active CN112379783B (en) | 2019-11-15 | 2019-11-15 | Virtual reality system for enhancing upper limb multidirectional movement of user immersion |
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911119408.XA Active CN111103974B (en) | 2019-11-15 | 2019-11-15 | Immersive virtual reality system for multi-directional movement of upper limbs |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN111103974B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113407024B (en) * | 2021-05-25 | 2022-10-11 | 四川大学 | Evidence display and switching method and device for court trial virtual reality environment |
| CN113552948B (en) * | 2021-07-23 | 2022-10-18 | 哈尔滨学院 | Man-machine interaction learning system |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106621312A (en) * | 2016-12-30 | 2017-05-10 | 深圳游视虚拟现实技术有限公司 | Simulated gunnery method and system based on virtual reality |
| CN106774926A (en) * | 2016-12-30 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | A kind of virtual reality interacts glove system and virtual reality system |
| CN109674615A (en) * | 2018-06-19 | 2019-04-26 | 杭州易脑复苏科技有限公司 | A kind of system and method for trained limb motion |
| CN109857250A (en) * | 2019-01-10 | 2019-06-07 | 安徽师范大学 | Device for force feedback under a kind of reality environment |
| CN110134230A (en) * | 2019-04-04 | 2019-08-16 | 北京理工大学 | A kind of input system based on hand finger tip force feedback in virtual reality scenario |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10299738B2 (en) * | 2013-05-16 | 2019-05-28 | New York University | Game-based sensorimotor rehabilitator |
| US10509468B2 (en) * | 2016-01-27 | 2019-12-17 | Tactai, Inc. | Providing fingertip tactile feedback from virtual objects |
| CN107261417A (en) * | 2017-07-07 | 2017-10-20 | 广州康医疗设备实业有限公司 | Man-machine interactive system for rehabilitation training of upper limbs |
| CN109907936B (en) * | 2017-12-13 | 2022-06-14 | 上海电气集团股份有限公司 | Upper limb rehabilitation training equipment based on virtual reality |
| CN108227921A (en) * | 2017-12-30 | 2018-06-29 | 北京工业大学 | A kind of digital Zeng Houyi ancient Chinese chime with 12 bells interactive system based on immersive VR equipment |
| CN108524186A (en) * | 2018-02-28 | 2018-09-14 | 裴文平 | A kind of virtual reality rehabilitation training system and method |
| EP3782013A1 (en) * | 2018-04-14 | 2021-02-24 | The California State University - San Marcos | Hands on laboratory and demonstration equipment with a hybrid virtual/augmented environment, along with their methods of use |
| CN108980589B (en) * | 2018-10-17 | 2023-10-17 | 歌尔科技有限公司 | Wear display device and mobile device support thereof |
| CN209281087U (en) * | 2019-01-09 | 2019-08-20 | 天津瀚海星云数字科技股份有限公司 | A kind of VR device of stable structure |
-
2019
- 2019-11-15 CN CN201911119408.XA patent/CN111103974B/en active Active
- 2019-11-15 CN CN202011472617.5A patent/CN112379783B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106621312A (en) * | 2016-12-30 | 2017-05-10 | 深圳游视虚拟现实技术有限公司 | Simulated gunnery method and system based on virtual reality |
| CN106774926A (en) * | 2016-12-30 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | A kind of virtual reality interacts glove system and virtual reality system |
| CN109674615A (en) * | 2018-06-19 | 2019-04-26 | 杭州易脑复苏科技有限公司 | A kind of system and method for trained limb motion |
| CN109857250A (en) * | 2019-01-10 | 2019-06-07 | 安徽师范大学 | Device for force feedback under a kind of reality environment |
| CN110134230A (en) * | 2019-04-04 | 2019-08-16 | 北京理工大学 | A kind of input system based on hand finger tip force feedback in virtual reality scenario |
Non-Patent Citations (1)
| Title |
|---|
| 可穿戴交互技术下的健康循证设计;陈筝等;《新建筑》;20180630(第3期);第20-23页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112379783A (en) | 2021-02-19 |
| CN111103974B (en) | 2020-12-08 |
| CN111103974A (en) | 2020-05-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104706499B (en) | Upper limbs cranial nerves rehabilitation training system | |
| JP5750717B2 (en) | Virtual reality environment generation device and controller device | |
| US5436638A (en) | Image display method and apparatus with means for yoking viewpoint orienting muscles of a user | |
| KR101548156B1 (en) | A wireless exoskeleton haptic interface device for simultaneously delivering tactile and joint resistance and the method for comprising the same | |
| WO2019019240A1 (en) | Device for integrating gesture recognition and ultrasonic tactile feedback and method and use thereof | |
| CN112379783B (en) | Virtual reality system for enhancing upper limb multidirectional movement of user immersion | |
| KR101855863B1 (en) | real-time simulation system for preventing motion sickness | |
| CN106354256B (en) | A kind of control method for movement of virtual reality | |
| US20200276476A1 (en) | Method and apparatus for an activity environment generator | |
| CN206140526U (en) | Portrait platform is drawn by robot | |
| CN105310853A (en) | Virtual reality somatosensory interaction massage chair | |
| CN205068298U (en) | Interaction system is wandered to three -dimensional scene | |
| CN111068257B (en) | Upper limb rehabilitation training device | |
| CN114708408A (en) | Experience system for virtual reality and meta-universe scene building in water | |
| US20170371157A1 (en) | Virtual reality control device | |
| US9000899B2 (en) | Body-worn device for dance simulation | |
| Vatavu | Sensorimotor realities: Formalizing ability-mediating design for computer-mediated reality environments | |
| CN210776583U (en) | Immersive virtual reality interaction equipment | |
| CN203102284U (en) | Tablet personal computer used for motion sensing games | |
| CN212789785U (en) | Household VR cinema system | |
| Kawahara et al. | Transformed human presence for puppetry | |
| CN113761947A (en) | Virtual simulation multi-person interactive system | |
| TWI291889B (en) | Interactive control system | |
| CN112034980A (en) | Household VR cinema system | |
| CN219658242U (en) | Prevent human error VR scene training experience integration platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |