CN111796670A - Large-space multi-person virtual reality interaction system and method - Google Patents
Large-space multi-person virtual reality interaction system and method Download PDFInfo
- Publication number
- CN111796670A CN111796670A CN202010423927.1A CN202010423927A CN111796670A CN 111796670 A CN111796670 A CN 111796670A CN 202010423927 A CN202010423927 A CN 202010423927A CN 111796670 A CN111796670 A CN 111796670A
- Authority
- CN
- China
- Prior art keywords
- data
- laser
- virtual reality
- motion capture
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 26
- 238000000034 method Methods 0.000 title claims abstract description 22
- 230000033001 locomotion Effects 0.000 claims abstract description 70
- 230000003287 optical effect Effects 0.000 claims abstract description 18
- 238000004364 calculation method Methods 0.000 claims abstract description 9
- 230000002452 interceptive effect Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 206010044565 Tremor Diseases 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
本发明适用于虚拟现实技术领域，提供了一种大空间多人虚拟现实交互系统，包括：激光动捕设备，用于通过光学摄像头采集数据，并进行定位；动捕设备，用于通过可追踪工具捕捉人体动作数据；混合动捕服务器，其通过网络设备分别连接所述激光动捕设备及动捕设备，用于接收激光数据以及动作数据，并进行计算处理；背负式电脑设备，其通过预置系统及网络与所述混合动捕服务器连接，用于从所述混合动捕服务器获取数据，并处理为3D数据信息；头戴显示设备，用于接收背负式电脑设备传送的3D数据信息并显示。本发明还相应提供一种交互方法。借此，本发明通过多方面数据采集，大大提高用户的交互体验。
The invention is applicable to the technical field of virtual reality, and provides a large-space multi-person virtual reality interaction system, including: a laser motion capture device for collecting data through an optical camera and positioning; The tool captures human motion data; the hybrid motion capture server is connected to the laser motion capture device and the motion capture device respectively through a network device to receive laser data and motion data, and perform calculation processing; The system and the network are connected to the hybrid motion capture server for acquiring data from the hybrid motion capture server and processing it into 3D data information; the head-mounted display device is used for receiving the 3D data information transmitted by the backpack computer equipment and show. The present invention also provides an interaction method correspondingly. Thereby, the present invention greatly improves the user's interactive experience by collecting data from various aspects.
Description
技术领域technical field
本发明涉及大空间多人虚拟现实交互技术领域，尤其涉及一种大空间多人虚拟现实交互系统及方法。The invention relates to the technical field of multi-person virtual reality interaction in a large space, in particular to a large-space multi-person virtual reality interaction system and method.
背景技术Background technique
虚拟现实，英文称为Virtual Reality(VR)，即利用计算机发展中的高科技手段构造出一个虚拟的境界，使参与者获得与现实一样的感觉。虚拟现实是一个在当今国际上倍受关注的课题。如果真正实现了虚拟现实，那么对整个人类的生活与发展将会发生很大的变革。虚拟现实系统的最大特点在于它与用户的直接交互性。在系统中，用户可以直接控制对象的各种参数，如：运动方向、速度等，而系统也可以向用户反馈信息，如：模拟驾驶系统中两车相撞，用户会感觉到震颤，车在抖动。经过不平路面时，汽车会颠簸。这种交互性粗看只是一个技术上的变化，但它出现以后，“以计算机为主体”的看法逐渐被人们所抛弃，大多数人开始接受“人是信息环境的主体”这一思想。Virtual reality, called Virtual Reality (VR) in English, uses the high-tech means in the development of computers to construct a virtual realm, so that participants can feel the same as reality. Virtual reality is a topic that attracts much attention in today's world. If virtual reality is truly realized, great changes will take place in the life and development of the whole human being. The biggest feature of virtual reality system is its direct interaction with users. In the system, the user can directly control various parameters of the object, such as: movement direction, speed, etc., and the system can also feedback information to the user, such as: in the simulated driving system, two cars collide, the user will feel the tremor, the car is in jitter. When driving over uneven roads, the car jolts. This kind of interaction is just a technical change, but after it appeared, the view of "computer-based" was gradually abandoned by people, and most people began to accept the idea that "human is the main body of the information environment".
发明内容SUMMARY OF THE INVENTION
针对上述的缺陷，本发明的目的在于提供一种大空间多人虚拟现实交互系统及方法，其通过多方面数据采集，大大提高用户的交互体验。In view of the above-mentioned defects, the purpose of the present invention is to provide a large-space multi-person virtual reality interactive system and method, which greatly improves the user's interactive experience by collecting data from various aspects.
为了实现上述目的，本发明提供一种大空间多人虚拟现实交互系统，所述系统包括：In order to achieve the above purpose, the present invention provides a large-space multi-person virtual reality interaction system, the system includes:
激光动捕设备，用于通过光学摄像头采集数据，并进行定位；Laser motion capture equipment, which is used to collect data through an optical camera and perform positioning;
动捕设备，用于通过可追踪工具捕捉人体动作数据；Motion capture equipment, used to capture human motion data through trackable tools;
混合动捕服务器，其通过网络设备分别连接所述激光动捕设备及动捕设备，用于接收光学数据以及动作数据，并进行计算处理；A hybrid motion capture server, which is respectively connected to the laser motion capture device and the motion capture device through a network device, for receiving optical data and motion data, and performing calculation processing;
背负式电脑设备，其通过预置系统及网络与所述混合动捕服务器连接，用于从所述混合动捕服务器获取数据，并处理为3D数据信息；A backpack computer device, which is connected to the hybrid motion capture server through a preset system and a network, and is used to obtain data from the hybrid motion capture server and process it into 3D data information;
头戴显示设备，用于接收背负式电脑设备传送的3D数据信息并显示。The head-mounted display device is used to receive and display the 3D data information transmitted by the backpack computer device.
根据本发明的大空间多人虚拟现实交互系统，所述激光动捕设备包括至少四个光学摄像头。According to the large-space multi-person virtual reality interaction system of the present invention, the laser motion capture device includes at least four optical cameras.
根据本发明的大空间多人虚拟现实交互系统，所述动捕设备包括至少四个设于人体的可追踪工具。According to the large-space multi-person virtual reality interaction system of the present invention, the motion capture device includes at least four trackable tools provided on the human body.
本发明还提供一种大空间多人虚拟现实交互方法，所述方法包括：The present invention also provides a large-space multi-person virtual reality interaction method, the method comprising:
通过光学摄像头采集数据，并进行定位；Collect data through an optical camera and perform positioning;
通过可追踪工具捕捉人体动作数据；Capture human motion data with trackable tools;
从所述激光动捕设备及动捕设备，接收激光数据以及动作数据，并进行计算处理；Receive laser data and motion data from the laser motion capture device and the motion capture device, and perform calculation processing;
从所述混合动捕服务器获取数据，并处理为3D数据信息；Obtain data from the hybrid motion capture server and process it into 3D data information;
接收背负式电脑设备传送的3D数据信息并显示。Receive and display the 3D data information transmitted by the backpack computer equipment.
根据本发明的大空间多人虚拟现实交互方法，所述激光动捕设备包括至少四个光学摄像头。According to the large-space multi-person virtual reality interaction method of the present invention, the laser motion capture device includes at least four optical cameras.
根据本发明的大空间多人虚拟现实交互方法，所述动捕设备包括至少四个设于人体的可追踪工具。According to the large-space multi-person virtual reality interaction method of the present invention, the motion capture device includes at least four trackable tools provided on the human body.
本发明适用于虚拟现实技术领域，提供了一种大空间多人虚拟现实交互系统，包括：激光动捕设备，用于通过光学摄像头采集数据，并进行定位；动捕设备，用于通过可追踪工具捕捉人体动作数据；混合动捕服务器，其通过网络设备分别连接所述激光动捕设备及动捕设备，用于接收激光数据以及动作数据，并进行计算处理；背负式电脑设备，其通过预置系统及网络与所述混合动捕服务器连接，用于从所述混合动捕服务器获取数据，并处理为3D数据信息；头戴显示设备，用于接收背负式电脑设备传送的3D数据信息并显示。本发明还相应提供一种交互方法。借此，本发明通过多方面数据采集，大大提高用户的交互体验。The invention is applicable to the technical field of virtual reality, and provides a large-space multi-person virtual reality interaction system, comprising: a laser motion capture device for collecting data through an optical camera and positioning; The tool captures human motion data; the hybrid motion capture server is connected to the laser motion capture device and the motion capture device respectively through a network device for receiving laser data and motion data, and performing calculation processing; knapsack computer equipment, which is pre- The system and the network are connected to the hybrid motion capture server for acquiring data from the hybrid motion capture server and processing it into 3D data information; the head-mounted display device is used for receiving the 3D data information transmitted by the backpack computer equipment and show. The present invention also provides an interaction method accordingly. Thereby, the present invention greatly improves the user's interactive experience by collecting data from various aspects.
附图说明Description of drawings
图1是本发明的系统结构示意图；Fig. 1 is the system structure schematic diagram of the present invention;
图2是本发明一实施例的系统结构图。FIG. 2 is a system structure diagram of an embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本发明进行进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
参见图1，本发明提供一种大空间多人虚拟现实交互系统，所述系统包括：Referring to FIG. 1, the present invention provides a large-space multi-person virtual reality interaction system, the system includes:
激光动捕设备，用于通过光学摄像头采集数据，并进行定位；Laser motion capture equipment, which is used to collect data through an optical camera and perform positioning;
动捕设备，用于通过可追踪工具捕捉人体动作数据；Motion capture equipment, used to capture human motion data through trackable tools;
混合动捕服务器，其通过网络设备分别连接所述激光动捕设备及动捕设备，用于接收激光数据以及动作数据，并进行计算处理；A hybrid motion capture server, which is respectively connected to the laser motion capture device and the motion capture device through a network device, for receiving laser data and motion data, and performing calculation processing;
背负式电脑设备，其通过预置系统及网络与所述混合动捕服务器连接，用于从所述混合动捕服务器获取数据，并处理为3D数据信息；A backpack computer device, which is connected to the hybrid motion capture server through a preset system and a network, and is used to obtain data from the hybrid motion capture server and process it into 3D data information;
头戴显示设备，用于接收背负式电脑设备传送的3D数据信息并显示。The head-mounted display device is used to receive and display the 3D data information transmitted by the backpack computer device.
本发明的大空间多人VR解决方案，是套完整的商用虚拟现实解决方案，搭配头显、激光定位系统、背负式计算机，这一套全整合的虚拟现实系统能够史无前例的为体验者带来身临其境的虚拟现实体验感。The large-space multi-person VR solution of the present invention is a complete set of commercial virtual reality solutions. With head-mounted display, laser positioning system, and backpack computer, this fully integrated virtual reality system can bring unprecedented experience to experiencers. Immersive virtual reality experience.
大空间多人VR解决方案，采用“激光+动捕”整体硬件技术解决方案，激光定位能进行精准的、绝对的定位，但容易被遮挡。动作捕捉则不怕遮挡，提供光线被遮挡后的数据。只依靠动作捕捉的话，则达不到混合形式的精准程度。因此，此套“激光+动捕”的混合算法的解决方案，具有高精度，低延迟的特性。体验者可以像在真实世界一样与空间内的物体或者人进行交互，追踪精度高。The multi-person VR solution in a large space adopts the overall hardware technology solution of "laser + motion capture". Laser positioning can perform accurate and absolute positioning, but it is easy to be blocked. Motion capture is not afraid of occlusion, and provides data after the light is occluded. Relying on motion capture alone will not achieve the level of precision of hybrid formats. Therefore, this set of "laser + motion capture" hybrid algorithm solution has the characteristics of high precision and low delay. The experiencer can interact with objects or people in the space just like in the real world, and the tracking accuracy is high.
本发明的设备由一个360°全景眼镜、一个互动仓座椅、一个内容资源库组成，有单人座、双人座以及三人座。游戏中，戴上360°全景眼镜，就好像真正置身其中，通过转动头部瞄准目标，通过控制摇杆来进行操作，玩过的人无一不被其刺激体验所震撼。The device of the present invention is composed of a 360° panoramic glasses, an interactive warehouse seat, and a content resource library, and includes a single seat, a double seat and a triple seat. In the game, wearing 360° panoramic glasses is like being really in it. By turning the head to aim at the target and controlling the joystick to operate, everyone who has played it is shocked by its stimulating experience.
结合图2，一实施例中，所述激光动捕设备包括至少四个光学摄像头，动捕设备包括至少四个设于人体的可追踪工具。Referring to FIG. 2 , in one embodiment, the laser motion capture device includes at least four optical cameras, and the motion capture device includes at least four trackable tools provided on the human body.
本发明还提供一种大空间多人虚拟现实交互方法，所述方法包括：The present invention also provides a large-space multi-person virtual reality interaction method, the method comprising:
通过光学摄像头采集数据，并进行定位；Collect data through an optical camera and perform positioning;
通过可追踪工具捕捉人体动作数据；Capture human motion data with trackable tools;
从所述激光动捕设备及动捕设备，接收光学数据以及动作数据，并进行计算处理；Receive optical data and motion data from the laser motion capture device and the motion capture device, and perform calculation processing;
从所述混合动捕服务器获取数据，并处理为3D数据信息；Obtain data from the hybrid motion capture server and process it into 3D data information;
接收背负式电脑设备传送的3D数据信息并显示。Receive and display the 3D data information transmitted by the backpack computer equipment.
根据本发明的大空间多人虚拟现实交互方法，所述激光动捕设备包括至少四个光学摄像头。According to the large-space multi-person virtual reality interaction method of the present invention, the laser motion capture device includes at least four optical cameras.
根据本发明的大空间多人虚拟现实交互方法，所述动捕设备包括至少四个设于人体的可追踪工具。According to the large-space multi-person virtual reality interaction method of the present invention, the motion capture device includes at least four trackable tools provided on the human body.
综上所述，本发明适用于虚拟现实技术领域，提供了一种大空间多人虚拟现实交互系统，包括：激光动捕设备，用于通过光学摄像头采集数据，并进行定位；动捕设备，用于通过可追踪工具捕捉人体动作数据；混合动捕服务器，其通过网络设备分别连接所述激光动捕设备及动捕设备，用于接收光学数据以及动作数据，并进行计算处理；背负式电脑设备，其通过预置系统及网络与所述混合动捕服务器连接，用于从所述混合动捕服务器获取数据，并处理为3D数据信息；头戴显示设备，用于接收背负式电脑设备传送的3D数据信息并显示。本发明还相应提供一种交互方法。借此，本发明通过多方面数据采集，大大提高用户的交互体验。To sum up, the present invention is applicable to the field of virtual reality technology, and provides a large-space multi-person virtual reality interaction system, including: a laser motion capture device for collecting data and positioning through an optical camera; a motion capture device, It is used to capture human motion data through a trackable tool; a hybrid motion capture server is connected to the laser motion capture device and the motion capture device respectively through a network device to receive optical data and motion data, and perform calculation processing; knapsack computer A device, which is connected to the hybrid motion capture server through a preset system and a network, for acquiring data from the hybrid motion capture server and processing it into 3D data information; a head-mounted display device for receiving the transmission from the backpack computer equipment 3D data information and display. The present invention also provides an interaction method accordingly. Thereby, the present invention greatly improves the user's interactive experience by collecting data from various aspects.
当然，本发明还可有其它多种实施例，在不背离本发明精神及其实质的情况下，熟悉本领域的技术人员当可根据本发明作出各种相应的改变和变形，但这些相应的改变和变形都应属于本发明所附的权利要求的保护范围。Of course, the present invention can also have other various embodiments, without departing from the spirit and essence of the present invention, those skilled in the art can make various corresponding changes and modifications according to the present invention, but these corresponding Changes and deformations should belong to the protection scope of the appended claims of the present invention.
Claims (6)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010423927.1A CN111796670A (en) | 2020-05-19 | 2020-05-19 | Large-space multi-person virtual reality interaction system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010423927.1A CN111796670A (en) | 2020-05-19 | 2020-05-19 | Large-space multi-person virtual reality interaction system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111796670A true CN111796670A (en) | 2020-10-20 |
Family
ID=72806481
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010423927.1A Pending CN111796670A (en) | 2020-05-19 | 2020-05-19 | Large-space multi-person virtual reality interaction system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111796670A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113110746A (en) * | 2021-05-08 | 2021-07-13 | 北京幻威科技有限公司 | Light field scanning type optical-inertial combined motion capture system |
| CN114844934A (en) * | 2022-04-28 | 2022-08-02 | 北京北建大科技有限公司 | Multi-person large-space VR interactive scene building method based on cloud rendering |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140011688A (en) * | 2012-07-18 | 2014-01-29 | 주식회사 도담시스템스 | Virtual reality simulation apparatus and method using motion capture technology and |
| CN106843507A (en) * | 2017-03-24 | 2017-06-13 | 苏州创捷传媒展览股份有限公司 | A kind of method and system of virtual reality multi-person interactive |
| CN107479699A (en) * | 2017-07-28 | 2017-12-15 | 深圳市瑞立视多媒体科技有限公司 | Virtual reality exchange method, apparatus and system |
| CN109313484A (en) * | 2017-08-25 | 2019-02-05 | 深圳市瑞立视多媒体科技有限公司 | Virtual reality interactive system, method and computer storage medium |
| CN110108159A (en) * | 2019-06-03 | 2019-08-09 | 武汉灏存科技有限公司 | The analogue simulation system and method for the more people's interactions of large space |
-
2020
- 2020-05-19 CN CN202010423927.1A patent/CN111796670A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140011688A (en) * | 2012-07-18 | 2014-01-29 | 주식회사 도담시스템스 | Virtual reality simulation apparatus and method using motion capture technology and |
| CN106843507A (en) * | 2017-03-24 | 2017-06-13 | 苏州创捷传媒展览股份有限公司 | A kind of method and system of virtual reality multi-person interactive |
| CN107479699A (en) * | 2017-07-28 | 2017-12-15 | 深圳市瑞立视多媒体科技有限公司 | Virtual reality exchange method, apparatus and system |
| CN109313484A (en) * | 2017-08-25 | 2019-02-05 | 深圳市瑞立视多媒体科技有限公司 | Virtual reality interactive system, method and computer storage medium |
| WO2019037074A1 (en) * | 2017-08-25 | 2019-02-28 | 深圳市瑞立视多媒体科技有限公司 | Virtual reality interaction system and method, and computer storage medium |
| CN110108159A (en) * | 2019-06-03 | 2019-08-09 | 武汉灏存科技有限公司 | The analogue simulation system and method for the more people's interactions of large space |
Non-Patent Citations (1)
| Title |
|---|
| 戚玉强等: "《传感器与检测技术》", vol. 4, 31 August 2018, 北京航空航天大学出版社, pages: 165 - 166 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113110746A (en) * | 2021-05-08 | 2021-07-13 | 北京幻威科技有限公司 | Light field scanning type optical-inertial combined motion capture system |
| CN114844934A (en) * | 2022-04-28 | 2022-08-02 | 北京北建大科技有限公司 | Multi-person large-space VR interactive scene building method based on cloud rendering |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Krueger et al. | The responsive workbench | |
| US11587298B2 (en) | Caching and updating of dense 3D reconstruction data | |
| CN105159450B (en) | One kind is portable can interactive desktop level virtual reality system | |
| Behringer et al. | Augmented Reality: Placing artificial objects in real scenes | |
| JP2015100138A (en) | Virtual interactive presence system and method | |
| EP4262193A2 (en) | Puppeteering remote avatar by facial expressions | |
| Rekimoto | A vision-based head tracker for fish tank virtual reality-VR without head gear | |
| CN102520793A (en) | Gesture identification-based conference presentation interaction method | |
| US20230147759A1 (en) | Viewpoint dependent brick selection for fast volumetric reconstruction | |
| CN111586459A (en) | Method and device for controlling video playing, electronic equipment and storage medium | |
| CN111796670A (en) | Large-space multi-person virtual reality interaction system and method | |
| CN103257707A (en) | Three-dimensional roaming method utilizing eye gaze tracking and conventional mouse control device | |
| CN114862992A (en) | Virtual digital human processing method, model training method and device thereof | |
| CN104516492A (en) | Man-machine interaction technology based on 3D (three dimensional) holographic projection | |
| CN104850700B (en) | A kind of collaborative Visual Simulation System | |
| JP2023152955A (en) | Head-tracking-based media selection for video communication in virtual environment | |
| CN204406327U (en) | Based on the limb rehabilitating analog simulation training system of said three-dimensional body sense video camera | |
| CN114463470A (en) | Virtual space browsing method and device, electronic equipment and readable storage medium | |
| WO2023240999A1 (en) | Virtual reality scene determination method and apparatus, and system | |
| US20230336689A1 (en) | Method and Device for Invoking Public or Private Interactions during a Multiuser Communication Session | |
| Akyildiz | Metaverse: Challenges for extended reality and holographic-type communication in the next decade | |
| CN114207557A (en) | Position synchronization of virtual and physical cameras | |
| CN107463261A (en) | Three-dimensional interaction system and method | |
| KR20210073428A (en) | Method and System for restoring objects and background and creating your own character for reality-based Social Network Services | |
| CN112023436A (en) | Augmented reality system applied to traditional Chinese medicine extraction and concentration process |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201020 |