CN110280016B - VR scene experience system - Google Patents

VR scene experience system Download PDF

Info

Publication number
CN110280016B
CN110280016B CN201910493074.6A CN201910493074A CN110280016B CN 110280016 B CN110280016 B CN 110280016B CN 201910493074 A CN201910493074 A CN 201910493074A CN 110280016 B CN110280016 B CN 110280016B
Authority
CN
China
Prior art keywords
mechanical arm
user
scene
sliding rail
control device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910493074.6A
Other languages
Chinese (zh)
Other versions
CN110280016A (en
Inventor
骆国庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201910493074.6A priority Critical patent/CN110280016B/en
Publication of CN110280016A publication Critical patent/CN110280016A/en
Application granted granted Critical
Publication of CN110280016B publication Critical patent/CN110280016B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B21/00Exercising apparatus for developing or strengthening the muscles or joints of the body by working against a counterforce, with or without measuring devices
    • A63B21/00181Exercising apparatus for developing or strengthening the muscles or joints of the body by working against a counterforce, with or without measuring devices comprising additional means assisting the user to overcome part of the resisting force, i.e. assisted-active exercising
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B26/00Exercising apparatus not covered by groups A63B1/00 - A63B25/00
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B71/00Games or sports accessories not covered in groups A63B1/00 - A63B69/00
    • A63B71/06Indicating or scoring devices for games or players, or for other sports activities
    • A63B71/0619Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
    • A63B71/0622Visual, audio or audio-visual systems for entertaining, instructing or motivating the user
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/28Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25Output arrangements for video game devices
    • A63F13/28Output arrangements for video game devices responding to control signals received from the game device for affecting ambient conditions, e.g. for vibrating players' seats, activating scent dispensers or affecting temperature or light
    • A63F13/285Generating tactile feedback signals via the game input device, e.g. force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/90Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63GMERRY-GO-ROUNDS; SWINGS; ROCKING-HORSES; CHUTES; SWITCHBACKS; SIMILAR DEVICES FOR PUBLIC AMUSEMENT
    • A63G31/00Amusement arrangements
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63GMERRY-GO-ROUNDS; SWINGS; ROCKING-HORSES; CHUTES; SWITCHBACKS; SIMILAR DEVICES FOR PUBLIC AMUSEMENT
    • A63G31/00Amusement arrangements
    • A63G31/02Amusement arrangements with moving substructures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • General Health & Medical Sciences (AREA)
  • Physical Education & Sports Medicine (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Biophysics (AREA)
  • Orthopedic Medicine & Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention provides a VR scene experience system, comprising: VR glasses for providing a virtual scene; the first mechanical arm is used for assisting the human body to move in a three-dimensional space; the second mechanical arm is used for providing a physical prop for a human body; and the control device is in communication connection with the first mechanical arm and the second mechanical arm and is used for respectively controlling the three-dimensional space movement of the first mechanical arm and the three-dimensional space movement of the second mechanical arm. The first mechanical arm and the sliding rail component widen the moving range of a user in a three-dimensional space, and the space experience of the user is enhanced.

Description

VR scene experience system
Technical Field
The invention belongs to the field of sports, games and entertainment activities, relates to an experience system, and particularly relates to a VR scene experience system.
Background
Virtual Reality (VR) technology is a computer simulation system that can create and experience Virtual worlds, which uses computers to create a simulated environment, which is a system simulation of multi-source information-fused, interactive three-dimensional dynamic views and physical behaviors to immerse users in the environment.
Generally, a complete virtual reality experience system is composed of a virtual environment, a virtual environment processor with a high-performance computer as a core, a visual system with a helmet display as a core, an auditory system with voice recognition, sound synthesis and sound positioning as cores, a body orientation and posture tracking device with an orientation tracker, data gloves and data clothes as main bodies, and functional components such as a taste, smell, touch and force feedback unit. Through the mutual cooperation between different equipment in the virtual reality experience system, the user can obtain many-sided experience such as sense of hearing, sense of touch, motion. However, the spatial movement range of the user in the existing virtual reality experience system is very limited, which results in poor spatial experience of the user during the movement.
Disclosure of Invention
In view of the above shortcomings of the prior art, the present invention is directed to provide a VR scene experience system, which is used to solve the problem in the prior art that the spatial experience of a user during a movement process is poor due to a very limited spatial movement range of the user.
To achieve the above and other related objects, the present invention provides a VR scene experience system, including: VR glasses for providing a virtual scene; the first mechanical arm is used for assisting the human body to move in a three-dimensional space; the second mechanical arm is used for providing a physical prop for a human body; and the control device is connected with the first mechanical arm and the second mechanical arm and is used for respectively controlling the three-dimensional space movement of the first mechanical arm and the three-dimensional space movement of the second mechanical arm.
In an embodiment of the invention, the VR scene experience system further includes a slide rail assembly, and the slide rail assembly is connected to the first mechanical arm and the second mechanical arm and is configured to assist the first mechanical arm and the second mechanical arm to move in a three-dimensional space.
In an embodiment of the present invention, the slide rail assembly includes: the first sliding rail is arranged at the bottom of the first mechanical arm and used for assisting the first mechanical arm to move left and right along the first sliding rail; the second sliding rail is arranged at the bottom of the second mechanical arm and used for assisting the second mechanical arm to move left and right along the second sliding rail; and the third sliding rail is arranged at the bottoms of the first sliding rail and the second sliding rail and is used for assisting the first sliding rail or/and the second sliding rail to move back and forth along the third sliding rail.
In an embodiment of the present invention, the VR scene experience system further includes a props library; the prop library is used for storing the entity props.
In an embodiment of the invention, the VR scene experience system further includes a ground feedback board; the ground feedback board is arranged under the feet of the human body, is communicated with the control device and comprises a plurality of irregular cylinders for enhancing the touch feeling of the soles.
In an embodiment of the invention, the VR scene experience system further includes a support arm; the support arm is connected with the control device and is used for assisting the human body to move and/or providing tactile sensation for the human body.
In an embodiment of the present invention, the support arms include one or more of a head support arm, a hand support arm, a foot support arm, a waist support arm, and a hip support arm.
In an embodiment of the invention, the VR glasses are communicatively connected to the control device through a wireless communication manner, and the control device controls the virtual scene provided by the VR glasses.
In an embodiment of the invention, the control device controls the first robot arm, the second robot arm and the VR glasses in an open-loop control manner or/and a closed-loop control manner.
In an embodiment of the invention, the VR scene experience system further includes: the sound effect device is connected with the control device in a communication mode and is used for providing sound corresponding to the virtual scene; the blowing device is in communication connection with the control device and is used for simulating the air flow in the virtual scene; and the moisture spraying device is in communication connection with the control device and is used for simulating the humidity change in the virtual scene.
The VR scene experience system comprises a first mechanical arm and a sliding rail assembly, so that the moving range of a user in a three-dimensional space is widened, and the spatial experience of the user is enhanced; the VR scene experience system comprises a second mechanical arm, the second mechanical arm can provide an entity prop for a user, and the VR scene experience system comprises a ground feedback plate, so that the touch sense of the user is enhanced; the VR scene experience system further includes a support arm that can assist a user in performing movements so that the user can perform a number of actions that cannot be performed in reality. Therefore, compared with the traditional VR experiencing system, the VR scene experiencing system can enable a user to obtain better experience.
Drawings
Fig. 1 is a schematic diagram illustrating an implementation structure of a VR scene experience system in an embodiment of the present invention.
Fig. 2 is a schematic connection diagram of the VR scene experience system in an embodiment of the invention.
Fig. 3 is a schematic diagram illustrating an implementation structure of the ground feedback board in the VR scene experience system according to an embodiment of the present invention.
Description of the element reference numerals
1 VR scene experience system
11. First mechanical arm
111. Base seat
112. First joint
113. Second joint
114. Third joint
12. Second mechanical arm
121. Base seat
122. First joint
123. Second joint
124. Third joint
125. Paw
13 VR glasses
14. Control device
15. Sliding rail assembly
151. First slide rail
152. Second slide rail
153. Third slide rail
16. Ground feedback board
161. Irregular cylinder
162. Supporting plate
17. Support arm
171. Head support arm
172. Hand support arm
173. Foot support arm
174. Waist support arm
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the components related to the present invention are only shown in the drawings rather than drawn according to the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated.
The virtual reality system can be divided into four types, namely an immersion type virtual reality system, an augmented reality type virtual reality system, a desktop type virtual reality system and a distributed virtual reality system according to different functions. The immersive virtual reality system provides a user with a completely immersive experience, so that the user has a feeling of being placed in a virtual world. The helmet display is obviously characterized in that the helmet display is utilized to seal the vision and the hearing of a user to generate virtual vision. Meanwhile, the hand feeling channel of the user is sealed by the data glove, and virtual touch feeling is generated. The system adopts the voice recognizer to enable a user to issue an operation command to the system host, and meanwhile, the head, the hand and the eyes are tracked by the corresponding head tracker, the hand tracker and the eye sight direction tracker, so that the system achieves the real-time performance as much as possible. A common immersive system is a system based on a head-mounted display, which uses binocular parallax between left and right eyes to form a stereoscopic impression.
For virtual reality systems, such as immersive virtual reality systems, VR display systems on the user side typically include a modeling module. The modeling module is used for establishing three-dimensional objects required in the virtual environment world, such as: text, cards, object models, three-dimensional environments, etc. A Graphical User Interface (GUI) in the modeling module displays all buttons, menus, text, cards, etc. The GUI is also responsible for providing logical modules that can be relied upon for the function and interaction of these elements. For example, the logic modules include a text parameter control module and a 3D rendering module. The text parameter control module is mainly used for controlling the size of displayed text, such as: the height, width, etc. of the text. The 3D rendering module mainly manages the entire 3D engine, and the main camera of the VR scene determines the objects to be rendered and the details of the encapsulated rendering of the 3D engine and sends them to the 3D rendering module through the rendering pipeline, and also provides access through the pixel and vertex shaders. The modeling module may also include other functional modules or elements, such as an input module, an artificial intelligence module, and so forth.
In addition to the display system, the virtual reality system also includes a sensory simulation system that is matched to the VR display system. The sensory simulation system is used to provide various senses, such as hearing, taste, smell, and touch, etc., to a user. In addition, the virtual reality system also comprises a space moving system, when a user is immersed in a scene constructed by the display system, the user can make corresponding action reactions according to different situations in the scene, such as walking, running, jumping, lying prone and the like, and at this time, if the user only makes the actions and the body does not move correspondingly, the body of the user can be inconsistent with the feeling of the user, and the user experience can be reduced. For the existing virtual reality experience system, due to the limitations of the system structure, the connection mode and the like, the spatial movement range of the user is very limited, and therefore the position movement which can be felt by the user is also very limited. In addition, the virtual reality system should adopt a synchronous and coordinated control mode to control different components. Synchronization includes synchronization of the virtual scene presented by the display system with the user's perception, synchronization of user actions with the virtual scene, and synchronization of actions between different components.
In order to widen the spatial movement range of a user, enhance the spatial experience and the tactile experience of the user and simultaneously realize the control of synchronous coordination, the invention provides a VR scene experience system, which comprises VR glasses and a virtual scene display module, wherein the VR glasses are used for providing a virtual scene; the first mechanical arm is used for assisting the human body to move in a three-dimensional space; the second mechanical arm is used for providing a physical prop for a human body; and the control device is connected with the first mechanical arm and the second mechanical arm and is used for respectively controlling the three-dimensional space movement of the first mechanical arm and the three-dimensional space movement of the second mechanical arm.
Referring to fig. 1 and fig. 2, fig. 1 is a schematic diagram illustrating an implementation structure of a VR scene experience system in an embodiment of the present invention, fig. 2 is a schematic diagram illustrating a connection relationship of the VR scene experience system in an embodiment of the present invention, and the connection relationship schematic diagram illustrated in fig. 2 only reflects a connection relationship, not a position relationship, between different components in the VR scene experience system. As can be seen from fig. 1 and fig. 2, in the present embodiment, the VR scene experience system 1 includes VR glasses 13, a first mechanical arm 11, a second mechanical arm 12, and a control device 14.
The VR glasses 13 are worn on the head of the user, and the main configuration is two lenses, which are included, and the lenses create different image depth perception in the local space based on different visual fields, so as to form a virtual reality visual field in the brain visual system of the user. The VR glasses 13 use a head-mounted display device to seal the vision and hearing of the user from the outside, and guide the user to generate a feeling of the user in the virtual environment, and the display principle is that the left and right eye screens respectively display images of the left and right eyes, and the human eyes generate a stereoscopic impression in the mind after acquiring the information with the difference. The VR glasses 13 can provide a virtual scene for the user, the virtual scene comprises one or more combinations of an entertainment scene, a sports scene, a treatment scene, a game scene, a social scene and a learning scene, and the user can select or customize the virtual scene according to the needs of the user.
The first mechanical arm 11 includes a base 111, a first joint 112, a second joint 113, and a third joint 114, and is used for assisting a user in completing movement in a three-dimensional space. The first mechanical arm 11 is at least a three-degree-of-freedom mechanical arm, that is, the first mechanical arm 11 can realize X movement, Y movement, and Z movement. Preferably, the first robot arm 11 has six degrees of freedom, that is, the first robot arm 11 can realize X movement, Y movement, Z movement, X rotation, Y rotation, and Z rotation. The first robot arm 11 utilizes a first joint 112, a second joint 113 and a third joint 114 to achieve telescopic and rotational movements, and the base 111 is used for fixing the first robot arm 11.
In a specific implementation process, the first mechanical arm 11 fixes a user at the end of the mechanical arm by using the third joint 11, and the first mechanical arm 11 drives the user to move in a three-dimensional space through stretching and rotating. By adjusting the speed and force of the first mechanical arm 11, the user can complete similar position changes in the virtual scene at similar speed, for example, the user can complete jogging, quick jumping, and the like. Furthermore, when the user performs an action, the first mechanical arm 11 assists the user to complete the action under the control of the control device 14, for example: when the user does not move in place due to insufficient strength, the first mechanical arm 11 can provide assistance for the user so that the user can smoothly complete the movement; or the first robot arm 11 can direct the user motion in the correct direction when the direction of the user motion deviates.
In an actual implementation process, on the premise of ensuring the safety of the user, the first mechanical arm 11 only contacts the user at the positions of the head, the back, the legs, the hands, and the like. Compare in traditional cladding formula VR equipment, the user is more nimble and comfortable at experience in-process.
The second arm 12 includes a base 121, a first joint 122, a second joint 123, a third joint 124, and a gripper 125. The first joint 122, the second joint 123 and the third joint 124 are used for assisting the hand claw 125 to move in a three-dimensional space, and the hand claw 125 can grab an object and send the object to a specified position under the control of the control device 14. Specifically, the gripper 125 selects a corresponding prop in the current scene to send to the hand of the user under the control of the control device 14, for example, to provide the user with an equipment prop in a game scene or provide the user with sports equipment in a sports scene. The second mechanical arm 12 is at least a three-degree-of-freedom mechanical arm, and preferably, the second mechanical arm 12 is a six-degree-of-freedom mechanical arm.
The control device 14 is connected in communication with the first mechanical arm 11 and the second mechanical arm 12, and is configured to control the first mechanical arm 11 and the second mechanical arm 12 to move in a three-dimensional space and perform corresponding actions. The motion includes an auxiliary motion of the first robot arm 11, a grasping motion of the second robot arm 12, and the like.
In an embodiment of the present invention, the VR scene experience system 1 further includes a slide rail assembly 15, where the slide rail assembly 15 is connected to the first mechanical arm 11 and the second mechanical arm 12, and is communicatively connected to the control device 14, so as to assist the three-dimensional space movement of the first mechanical arm 11 and the second mechanical arm 12.
In an embodiment of the present invention, the slide rail assembly 15 includes: the first slide rail 151 is arranged at the bottom of the first mechanical arm 11 and used for assisting the first mechanical arm 11 to move left and right along the first slide rail 151; a second slide rail 152 disposed at the bottom of the second mechanical arm 12 for assisting the second mechanical arm 12 to move left and right along the second slide rail 152; and a third slide rail 153, disposed at the bottom of the first slide rail 151 and the second slide rail 152, for assisting the first slide rail 151 or/and the second slide rail 152 to move back and forth along the third slide rail.
Specifically, the first mechanical arm 11 is connected to the first slide rail 151 and can move left and right along the first slide rail 151; the first slide rail 151 is connected to the third slide rail 153, and can move back and forth along the third slide rail 153. The first mechanical arm 11 can reach any point in the whole sliding rail range through the movement of the first mechanical arm on the first sliding rail 151 and the movement of the first sliding rail 151 on the third sliding rail 153, and the movement range in the horizontal direction is widened. By combining the extension and rotation of the first mechanical arm 11, the movement of the first mechanical arm 11 on the first slide rail 151, and the movement of the first slide rail 151 on the third slide rail 153, a user can realize three-dimensional movement within the range of the slide rail assembly 15, and when the position of the user changes in a virtual scene, the body of the user can complete similar position changes at the same speed, so that the coordination of the physical feeling and the visual feeling of the user is ensured, and the spatial experience of the user is improved.
The second mechanical arm 12 is connected to the second slide rail 152 and can move left and right along the second slide rail 152; the second slide rail 152 is connected to the third slide rail 153, and can move back and forth along the third slide rail 153. The second robot arm 12 can reach any point within the entire slide rail assembly 15 by moving itself on the second slide rail 152 and moving the second slide rail 152 on the third slide rail 153. The second robotic arm 12 can reach under or behind the user as necessary to deliver a physical prop to a designated location.
In an embodiment of the invention, the VR scene experience system further includes a ground feedback board 16; the ground feedback board 16 is disposed under the foot of the human body, and is connected to the control device 14 in a communication manner, and includes a plurality of irregular columns 161 for enhancing the tactile sensation of the sole of the foot. Please refer to fig. 3, which is a schematic structural diagram of the ground feedback plate 16 according to an embodiment of the present invention. As can be seen, the floor feedback plate 16 is comprised of a support plate 162 and a plurality of irregular cylinders 161. The ground feedback plate 16 is disposed under the feet of the user for enhancing the tactile sensation of the soles of the feet of the user. Specifically, the supporting plate 162 mainly plays a supporting role, so that the user can clearly feel that the user steps on the actual object under the foot; each of the irregular cylinders 161 is moved upward or downward under the control of the control means 14, and the tactile sensation in a local range of the sole of the foot of the user can be enhanced. For example, when a user steps on an object in a virtual scene, the irregular cylinders 161 at the corresponding positions move upwards, and the rest irregular cylinders 161 are kept still, so that the corresponding positions under the feet of the user can generate a squeezing feeling, and the simulation of stepping on the object by the soles is realized; when the user is in an uphill slope in the virtual scene, the irregular cylinders are sequentially lowered from the positions in front of feet to the positions behind the feet, so that the user feels that the body of the user leans backwards, and the uphill slope is simulated. Preferably, the irregular cylinder 161 may be implemented by using an inflatable balloon, which has a shape of a cylinder or a square column.
In an embodiment of the invention, the VR scene experience system further includes a support arm; the support arm is connected with the control device and is used for assisting the human body to move and/or providing tactile sensation for the human body. In this embodiment, the support arm contacts with a corresponding part of the body of the user, so as to assist the specific part of the user to complete a corresponding action, and protect the parts from being injured by muscle strain. Unlike the conventional wrapped VR experience device that uses an exoskeleton or the like, in this embodiment, the first mechanical arm and the support arm are matched to contact with the user only at a specific position, so that the assistance to the user is more accurate. Meanwhile, other parts of the body of the user are not bound by the exoskeleton, so that the user can act more flexibly and comfortably in the experience process, and the feeling is more real. In addition, the arm is provided with a sense simulation unit, which can provide similar stimulation for the user when the user is stimulated at a specific position in the virtual scene, such as: the user can be stimulated to generate pain when falling down, and the tactile stimulation is provided for the user when the user contacts an object.
In one embodiment of the present invention, the arms 17 include one or more of a head arm 171, a hand arm 172, a foot arm 173, a waist arm 174, and a hip arm. The head support arm 171 is in contact with the head of the user for fixing the head of the user and simulating a corresponding tactile sensation; the hand support arm 172 is in contact with the hand of the user and is used for fixing the hand of the user and simulating corresponding tactile sensation; the foot support arm 173 contacts the foot of the user for fixing the foot of the user and simulating a corresponding tactile sensation; the waist support arm 174 is in contact with the waist of the user and is used for fixing the waist of the user and simulating corresponding tactile feeling; the buttock support arm is in contact with the user's buttock for fixing the user's buttock and simulating a corresponding tactile sensation.
In an embodiment of the invention, the VR glasses are communicatively connected to the control device through a wireless communication manner. Preferably, the VR glasses and the control device communicate wirelessly, for example, through bluetooth, wiFi, 3G, 4G or Zigbee communication connection.
In an embodiment of the invention, the control device controls the first robot arm, the second robot arm and the VR glasses in an open-loop control manner or/and a closed-loop control manner.
The open-loop control mode refers to that the first mechanical arm, the second mechanical arm and the VR glasses preset actions or scenes taken at each time point, and the first mechanical arm, the second mechanical arm and the VR glasses work independently according to preset programs without interaction. After the control device completes the presetting, continuous control is not needed, for example: at a certain moment, the VR glasses present an object for a user, the first mechanical arm assists the user to complete a hand stretching action at the same moment, the second mechanical arm sends an entity prop to the hand of the user, and the three actions are preset. The open-loop control mode has the advantages of simple operation, strong controllability, no need of a complex control system and the defects of preset actions, weak participation sense of users and relatively poor experience.
When the control device adopts the closed-loop control mode, the control device continuously controls the first mechanical arm, the second mechanical arm and the VR glasses. The control device controls the VR glasses to provide a virtual scene for a user, then controls the first mechanical arm to assist the user to complete corresponding actions according to the current virtual scene and the reaction and action of the user, and controls the second mechanical arm to provide corresponding props for the user according to the actions of the user. For example: at a certain moment, the VR glasses present an object to the user, and the user can choose to reach for grasping or directly walk through: when a user selects to stretch hands to grab, the control device controls the first mechanical arm to assist the user in completing a hand stretching action, and the control device controls the second mechanical arm to send a tool to the hand of the user; when the user selects to walk directly, the control device controls the first mechanical arm to assist the user in completing walking actions and controls the VR glasses to present corresponding scenes. By adopting a closed-loop control mode, the control device can make corresponding decisions according to the actions of the user and the contents presented by the VR glasses, and send decision information to the VR glasses, the first mechanical arm, the second mechanical arm and the ground feedback plate; the VR glasses, the first mechanical arm, the second mechanical arm and the ground feedback plate make corresponding actions according to the received decision information and feed back the corresponding actions to the control device. The closed-loop control mode has the advantages that different components interact with each other to enable a scene to be closer to reality, and user experience and participation sense are stronger; the disadvantage is that the closed-loop control requires a high degree of effort on the control device.
In an embodiment of the present invention, the VR scene experience system further includes: the sound effect device is connected with the control device in a communication mode and is used for providing sound corresponding to the virtual scene; the blowing device is in communication connection with the control device and is used for simulating the air flow in the virtual scene; and the moisture spraying device is in communication connection with the control device and is used for simulating the humidity change in the virtual scene.
To sum up, the VR scene experience system comprises a first mechanical arm and a sliding rail assembly, so that the moving range of a user in a three-dimensional space is expanded, and the spatial experience of the user is enhanced; the VR scene experience system comprises a second mechanical arm, the second mechanical arm can provide an entity prop for a user, and the VR scene experience system comprises a ground feedback plate and a support arm, so that the touch sense of the user is enhanced; the VR scene experience system assists a user in moving through the first mechanical arm and the support arm, so that the user can complete a plurality of actions which cannot be completed in reality; the VR scene experience system realizes fine control of the whole system through the control device, so that all parts are coordinated with each other. Compared with the traditional VR scene experience system, the VR scene experience system only contacts with the body of the user at a specific part, and the assistance to the user is more precise, so that the action of the user is more flexible and comfortable. Therefore, the invention effectively overcomes various defects in the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.

Claims (3)

1. A VR scene experience system, the VR scene experience system comprising:
VR glasses to provide a virtual scene, the VR glasses including two lenses to provide different visual depth perception in different visual fields and local spaces;
the robot comprises a first mechanical arm and a second mechanical arm, wherein the first mechanical arm is used for assisting a human body to move in a three-dimensional space in a telescopic, rotary and moving mode, and the contact position of the first mechanical arm and the human body comprises a head part, a back part, leg parts and/or a hand part;
the second mechanical arm is used for grabbing the entity prop and sending the entity prop to a designated position, so that the entity prop is provided for a human body;
the control device is in communication connection with the first mechanical arm and the second mechanical arm and is used for respectively controlling the three-dimensional space movement of the first mechanical arm and the three-dimensional space movement of the second mechanical arm;
the VR glasses are in communication connection with the control device in a wireless communication mode; the control device controls the first mechanical arm, the second mechanical arm and the VR glasses in an open-loop control mode or/and a closed-loop control mode; the open-loop control mode refers to the action taken or the scene presented at each time point is preset by the first mechanical arm, the second mechanical arm and the VR glasses, and the first mechanical arm, the second mechanical arm and the VR glasses work independently according to a preset program; the closed-loop control mode means that the control device continuously controls the first mechanical arm, the second mechanical arm and the VR glasses;
the sliding rail assembly is connected with the first mechanical arm and the second mechanical arm so that the first mechanical arm and the second mechanical arm can reach any point within the range of the sliding rail assembly, the sliding rail assembly comprises a first sliding rail, a second sliding rail and a third sliding rail, and the first sliding rail is arranged at the bottom of the first mechanical arm and used for assisting the first mechanical arm to move left and right along the first sliding rail; the second sliding rail is arranged at the bottom of the second mechanical arm and used for assisting the second mechanical arm to move left and right along the second sliding rail; the third slide rail is arranged at the bottoms of the first slide rail and the second slide rail and is used for assisting the first slide rail or/and the second slide rail to move back and forth along the third slide rail; the second mechanical arm moves on the second sliding rail, the second sliding rail moves on the third sliding rail, and the second mechanical arm can reach any point within the range of the sliding rail assembly and send the prop to the lower part or the rear part of the human body;
the VR scene experience system further comprises a support arm; the support arm is connected with the control device and is used for assisting the human body to move and/or providing tactile sensation for the human body; the support arms comprise one or more of head support arms, hand support arms, foot support arms, waist support arms and hip support arms;
the ground feedback plate is arranged under the feet of the human body, is in communication connection with the control device, and comprises a plurality of irregular cylinders and a support plate, wherein each irregular cylinder is an inflatable air bag and is used for moving upwards or downwards under the control of the control device so as to enhance the touch feeling of the user in a local range of the feet; the ground feedback plate can be used for simulating that a human body steps on an object and/or an uphill scene in the virtual scene; when the human body steps on an object in the virtual scene, the irregular cylinders at the corresponding positions move upwards, and the rest irregular cylinders are kept static; and when the human body ascends in the virtual scene, the irregular cylinders are sequentially lowered from the front position of the foot to the rear position of the foot.
2. The VR scene experience system of claim 1, wherein: the VR scene experience system further comprises a prop library; the property library is used for storing the entity properties.
3. The VR scene experience system of claim 1, further comprising:
the sound effect device is in communication connection with the control device and is used for providing sound corresponding to the virtual scene;
the blowing device is in communication connection with the control device and is used for simulating the air flow in the virtual scene;
and the moisture spraying device is in communication connection with the control device and is used for simulating the humidity change in the virtual scene.
CN201910493074.6A 2019-06-06 2019-06-06 VR scene experience system Active CN110280016B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910493074.6A CN110280016B (en) 2019-06-06 2019-06-06 VR scene experience system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910493074.6A CN110280016B (en) 2019-06-06 2019-06-06 VR scene experience system

Publications (2)

Publication Number Publication Date
CN110280016A CN110280016A (en) 2019-09-27
CN110280016B true CN110280016B (en) 2023-03-24

Family

ID=68003570

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910493074.6A Active CN110280016B (en) 2019-06-06 2019-06-06 VR scene experience system

Country Status (1)

Country Link
CN (1) CN110280016B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017151872A1 (en) * 2016-03-02 2017-09-08 Osterhout Group, Inc. Speaker systems for head-worn computer systems
CN107221223A (en) * 2017-06-01 2017-09-29 北京航空航天大学 A kind of band is strong/the virtual reality aircraft cockpit system of touch feedback
CN107783639A (en) * 2016-08-24 2018-03-09 南京乐朋电子科技有限公司 Virtual reality leisure learning system
CN107919049A (en) * 2017-12-24 2018-04-17 佛山市龙远科技有限公司 A kind of simulation travelling experiencing system based on VR
CN107970601A (en) * 2017-12-24 2018-05-01 佛山市龙远科技有限公司 A kind of simulation space experiencing system based on VR
CN107993290A (en) * 2017-12-18 2018-05-04 快创科技(大连)有限公司 It is a kind of that demo system is assembled based on AR and the mechanical part of cloud storage technology
CN207627896U (en) * 2017-08-30 2018-07-20 广州云友网络科技有限公司 A kind of enhanced mobile virtual reality body-sensing device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017151872A1 (en) * 2016-03-02 2017-09-08 Osterhout Group, Inc. Speaker systems for head-worn computer systems
CN107783639A (en) * 2016-08-24 2018-03-09 南京乐朋电子科技有限公司 Virtual reality leisure learning system
CN107221223A (en) * 2017-06-01 2017-09-29 北京航空航天大学 A kind of band is strong/the virtual reality aircraft cockpit system of touch feedback
CN207627896U (en) * 2017-08-30 2018-07-20 广州云友网络科技有限公司 A kind of enhanced mobile virtual reality body-sensing device
CN107993290A (en) * 2017-12-18 2018-05-04 快创科技(大连)有限公司 It is a kind of that demo system is assembled based on AR and the mechanical part of cloud storage technology
CN107919049A (en) * 2017-12-24 2018-04-17 佛山市龙远科技有限公司 A kind of simulation travelling experiencing system based on VR
CN107970601A (en) * 2017-12-24 2018-05-01 佛山市龙远科技有限公司 A kind of simulation space experiencing system based on VR

Also Published As

Publication number Publication date
CN110280016A (en) 2019-09-27

Similar Documents

Publication Publication Date Title
JP6749384B2 (en) Control method of human-computer interaction and its operation
US7542040B2 (en) Simulated locomotion method and apparatus
CN114766038A (en) Individual views in a shared space
TWI648655B (en) Method of display user movement in virtual reality system and related device
US8487749B2 (en) Tactile virtual world
Hashemian et al. HeadJoystick: Improving flying in VR using a novel leaning-based interface
CN104470593A (en) System and method for social dancing
KR20130039585A (en) Cognitive ability training apparatus using robots and method thereof
Iwata Haptic interfaces
US9000899B2 (en) Body-worn device for dance simulation
Sundén et al. Hybrid Virtual Reality Touch Table: An immersive collaborative platform for public explanatory use of cultural objects and sites.
Dhanasree et al. Hospital emergency room training using virtual reality and leap motion sensor
US11989351B2 (en) Virtual, augmented and mixed reality systems with physical feedback
US9940847B1 (en) Virtual reality exercise device
CN110280016B (en) VR scene experience system
JP2000338858A (en) Virtual space bodily sensing device
JP6955726B2 (en) Animation production method
Ujitoko et al. Interpretation of tactile sensation using an anthropomorphic finger motion interface to operate a virtual avatar
Hollerbach et al. The convergence of robotics, vision, and computer graphics for user interaction
US11436806B1 (en) Dual perspective rendering in virtual reality
Vaibhav et al. Applications of haptics technology in advance robotics
CN115033105B (en) Large-space movable platform supporting bare-hand multi-touch force sense natural interaction
Hasnain Adaptive Dynamic Refocusing: Toward Solving Discomfort in Virtual Reality
Elsayed Computer-supported movement guidance: investigating visual/visuotactile guidance and informing the design of vibrotactile body-worn interfaces
WO2024035347A1 (en) Virtual reality control device and virtual reality system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant