KR20170143264A - Virtual reality access monitoring system and method - Google Patents
Virtual reality access monitoring system and method Download PDFInfo
- Publication number
- KR20170143264A KR20170143264A KR1020160077285A KR20160077285A KR20170143264A KR 20170143264 A KR20170143264 A KR 20170143264A KR 1020160077285 A KR1020160077285 A KR 1020160077285A KR 20160077285 A KR20160077285 A KR 20160077285A KR 20170143264 A KR20170143264 A KR 20170143264A
- Authority
- KR
- South Korea
- Prior art keywords
- virtual reality
- camera
- hmd
- central control
- control server
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000012544 monitoring process Methods 0.000 title claims abstract description 18
- 230000033001 locomotion Effects 0.000 claims abstract description 19
- 238000001514 detection method Methods 0.000 claims description 14
- 230000006870 function Effects 0.000 description 5
- 230000003190 augmentative effect Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000012549 training Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/271—Image signal generators wherein the generated image signals comprise depth maps or disparity maps
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
- H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Embodiments of the invention relate to a virtual reality multiple access monitoring system and method.
With the development of information and communication technologies and the popularization of computers and smart phones, conventional face-to-face education has been replaced by various forms of e-Learning.
In early e-learning, approaches such as simply transferring content from text-based media such as textbooks to digital content were used extensively. However, educational effects that can be achieved with simple text, video, or Flash- Lt; / RTI >
In order to overcome this, interest in technology called Augmented Reality or Mixed Reality is increasing recently.
The augmented reality means a technique that provides additional information or meaning about an object or place actually observed by a content user. When applied to learning contents, the augmented reality enhances context-awareness of a learning scene, It is expected that the learning effect will be improved by promoting the learners' real feeling and immersion feeling.
The user of such augmented reality contents interacts with the digital contents through manipulation of a realistic interface, that is, an object in the real world, rather than manipulating the content with a universal input device such as a mouse or a keyboard as in conventional learning contents.
When applied to the learning contents, the manipulation activity through the realistic interface can enhance the learning experience of the learner. In actual education, since the learning is performed through various senses, it is possible to perform such learning or learning in the e-learning It is important to create an environment where
However, in the case of experiencing using HMD (Head Mounted Display), which is a personalized device in the case of virtual reality training as in the prior art, since an individual can view contents by himself / herself through personalized HMD equipment, It is impossible to provide a more effective educational environment because it can be confirmed only by the monitor connected to the outside, and it is impossible to intervene between the educator and the trainee in the virtual reality space, so there is a limit to immerse in education.
SUMMARY OF THE INVENTION The present invention has been conceived to solve the above-mentioned problems, and it is an object of the present invention to provide a system and method for providing a virtual reality service in which a plurality of users are connected to a central control server through an image transmission system via an HMD (Head Mounted Display) To use virtual reality content.
In addition, the present invention allows an administrator to view a classroom internal image transmitted in real time from the bottom of a virtual reality content by moving his or her gaze so that an administrator (educator) The problem that the information can not be obtained is resolved so that the manager (educator) monitors various various situations that may occur in the education space in real time without removing the wearing of the HMD (Head Mounted Display) And to provide a more effective educational environment.
In addition, the present invention allows a user to take control of all or part of the virtual reality contents and control the virtual reality contents, so that the user can learn more efficiently through the movement of the free eye within the virtual reality contents do.
A virtual reality multiple access monitoring system according to an embodiment of the present invention for solving the above-mentioned problems includes a 3D depth camera or a motion detection sensor that transmits a control signal generated by sensing a control operation of an administrator; A central control server for providing virtual reality contents controlled by the control signal; An administrator HMD (Head Mounted Display) for implementing a virtual reality using the virtual reality contents provided from the central control server and providing the virtual reality to the administrator; A user HMD (Head Mounted Display) for implementing a virtual reality using a virtual reality content provided from the central control server and providing the virtual reality to a user; And a camera for photographing users wearing the user HMD. The central control server matches the images of the users photographed through the camera to the virtual reality contents and provides the images to the administrator HMD.
According to another embodiment of the present invention, the central control server receives the control signal of the manager generated through the 3D Depth Camera or the motion sensing sensor to control the virtual reality contents, HMD or the user HMD.
According to another embodiment of the present invention, the camera may be a CCTV camera that photographs a space where users wearing the user HMD are photographed.
According to another embodiment of the present invention, the central control server can provide a picture taken by the camera on the virtual reality contents in the form of Picture In Picture (PIP).
According to another embodiment of the present invention, the central control server may control the camera on the area moved to the lower end of the virtual reality contents by controlling the 3D depth camera or the motion detection sensor. Or a UI (User Interface) for controlling the virtual reality contents.
A virtual reality multiple access monitoring method according to an exemplary embodiment of the present invention includes a first step of transmitting a control signal generated by a 3D depth camera or an operation detection sensor by sensing a control operation of an administrator; A second step of the central control server providing virtual reality contents controlled by the control signal; And a third step of implementing a virtual reality by using a virtual reality content provided by the central management server and providing a manager HMD (Head Mounted Display) and a user HMD (Head Mounted Display) to an administrator and a user, respectively, The second step is a camera photographing step of photographing users wearing a user's HMD by a camera; And a content providing step in which the central control server provides the virtual reality contents matching the images of the users photographed through the camera to the administrator HMD.
According to another embodiment of the present invention, in the second step, the central control server receives the control signal of the manager generated through the 3D depth camera or the motion sensing sensor, Can be controlled and provided.
According to another embodiment of the present invention, the camera photographing step photographs users wearing the user HMD via a CCTV camera, and the contents providing step may include a step of photographing the CCTV The image captured by the camera can be provided in a PIP (Picture In Picture) format.
According to another embodiment of the present invention, in the content providing step, the central control server controls the 3D depth camera (3D Depth Camera) or the region moving to the lower end of the virtual reality content A UI (User Interface) for controlling the images of the users photographed through the camera or the virtual reality contents.
According to the embodiment of the present invention, when a virtual reality is provided, a plurality of users are connected to each other through an HMD (Head Mounted Display) through a video transmission system to a central control server, and virtual reality contents can be used in real time in the same virtual space have.
In addition, according to the embodiment of the present invention, the manager moves his or her gaze so that the inside image of the classroom transmitted in real time at the bottom of the virtual reality contents can be confirmed, By solving the problem of not getting information outside reality contents, manager (educator) monitors various various situations that can occur in educational space in real time without removing the wearing of HMD (Head Mounted Display) It is possible to prevent an accident from occurring and to provide a more effective educational environment.
In addition, according to the embodiment of the present invention, a user can control all or a part of the virtual reality contents by taking control of the virtual reality contents, so that the user can learn more efficiently This has the advantage.
1 is a diagram illustrating a virtual reality multiple access monitoring system according to an embodiment of the present invention.
2 is a view for explaining a method of matching images of users on virtual reality contents according to an embodiment of the present invention.
3 is a flowchart illustrating a method of monitoring a virtual reality multiple access according to an exemplary embodiment of the present invention.
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions are not described in detail to avoid unnecessarily obscuring the subject matter of the present invention. In addition, the size of each component in the drawings may be exaggerated for the sake of explanation and does not mean a size actually applied.
FIG. 1 is a diagram illustrating a virtual reality multiple access monitoring system according to an exemplary embodiment of the present invention. FIG. 2 is a flowchart illustrating a method for matching images of users on a virtual reality content according to an exemplary embodiment of the present invention. FIG.
Hereinafter, a virtual reality multiple access monitoring system according to an embodiment of the present invention will be described with reference to FIG.
A virtual reality multiple access monitoring system according to the present invention is a system in which a group of users can receive training within the same space and allows a user who is an educator to view a screen controlled by an educator who is an administrator (operator) It is possible to experience being educated in.
1, a virtual reality multiple access monitoring system according to an exemplary embodiment of the present invention includes a
In providing such a virtual reality, a plurality of
The 3D depth camera (3D Depth Camera) 111 and the
The contents of the
More specifically, the
Accordingly, the administrator HMD (Head Mounted Display) 130 can implement the virtual reality using the
In addition, the
At this time, the
More specifically, the
As shown in FIG. 2, the
2, the
In addition, the
Accordingly, the present invention allows the
Meanwhile, according to an embodiment of the present invention, the
The
3 is a flowchart illustrating a method of monitoring a virtual reality multiple access according to an exemplary embodiment of the present invention.
Hereinafter, a virtual reality multiple access monitoring method according to an embodiment of the present invention will be described with reference to FIG.
In the virtual reality multiple access monitoring method according to an embodiment of the present invention, a 3D depth camera or a motion sensor senses a control operation of an administrator and transmits a control signal generated in operation S310.
Thereafter, the central control server can provide the virtual reality content controlled by the control signal.
More specifically, the camera captures the users wearing the user HMD (S320), and the central control server can provide the virtual reality contents matching the images of the users photographed through the camera to the manager HMD (S330).
To this end, the central control server provides the virtual reality contents, and in order to control the provided virtual reality contents, the manager performs a control operation on the 3D depth camera or motion detection sensor to transmit the control signal .
More specifically, the user shoots a user wearing a user's HMD using the CCTV camera as the camera, and the central control server provides a picture taken by the CCTV camera in the form of PIP (Picture In Picture) on the virtual reality contents .
Accordingly, a manager HMD (Head Mounted Display) and a user HMD (Head Mounted Display) can implement the virtual reality using the virtual reality contents provided from the central control server and provide the virtual reality to the administrator and the user, respectively (S340).
Therefore, according to the embodiment of the present invention, when a virtual reality is provided, a plurality of users are connected to each other through an HMD (Head Mounted Display) through a video transmission system to a central control server, Can be used.
In addition, according to the embodiment of the present invention, the manager moves his or her gaze so that the inside image of the classroom transmitted in real time at the bottom of the virtual reality contents can be confirmed, By solving the problem of not getting information outside reality contents, manager (educator) monitors various various situations that can occur in educational space in real time without removing the wearing of HMD (Head Mounted Display) It is possible to prevent an accident from occurring and to provide a more effective educational environment.
In addition, according to the embodiment of the present invention, a user can take over control functions of all or a part of virtual reality contents to control the virtual reality contents, thereby enabling a user to perform more efficient learning This has the advantage.
In the foregoing detailed description of the present invention, specific examples have been described. However, various modifications are possible within the scope of the present invention. The technical spirit of the present invention should not be limited to the above-described embodiments of the present invention, but should be determined by the claims and equivalents thereof.
111: 3D depth camera
112: motion detection sensor
120: Central control server
125: Virtual Reality Content
130: Manager HMD
132: Users video
131: Manager
140: User HMD
141: User
150: camera
151: Users video
155: General Situation Room
160: Monitor
Claims (9)
A central control server for providing virtual reality contents controlled by the control signal;
An administrator HMD (Head Mounted Display) for implementing a virtual reality using the virtual reality contents provided from the central control server and providing the virtual reality to the administrator;
A user HMD (Head Mounted Display) for implementing a virtual reality using a virtual reality content provided from the central control server and providing the virtual reality to a user; And
A camera for photographing users wearing the user HMD;
Lt; / RTI >
Wherein the central control server matches the images of the users photographed through the camera to the virtual reality contents and provides the images to the administrator HMD.
The central control server,
And receiving the control signal of the manager generated through the 3D depth camera or the motion detection sensor to control the virtual reality contents and provide the controlled virtual reality contents to the administrator HMD or the user HMD.
The camera comprises:
And a CCTV camera for photographing a space in which users wearing the user HMD are photographed.
The central control server,
And providing a video captured by the camera on the virtual reality content in the form of a PIP (Picture In Picture).
The central control server,
The control unit controls the video of the users photographed through the camera or the virtual reality contents on the area moved to the lower end of the virtual reality contents by the control through the 3D depth camera or the motion detection sensor A virtual reality multiple access monitoring system that provides a user interface (UI)
A second step of the central control server providing virtual reality contents controlled by the control signal; And
And a third step of providing an administrator HMD (Head Mounted Display) and a user HMD (Head Mounted Display) to a manager and a user by implementing virtual reality using virtual reality contents provided from the central control server, respectively,
The second step comprises:
A camera photographing step of photographing users wearing the user HMD by a camera; And
And providing the virtual reality contents matching the images of the users photographed by the central control server with the administrator HMD to the administrator HMD.
The second step comprises:
And the central control server receives the control signal of the manager generated through the 3D depth camera or the motion detection sensor to control and provide the virtual reality contents.
In the camera photographing step,
Capturing users wearing the user HMD via a CCTV camera,
The content providing step may include:
And providing the video captured by the CCTV camera in the form of a PIP (Picture In Picture) on the virtual reality contents provided by the central control server.
The content providing step may include:
The central control server transmits the video of the users photographed through the camera on the area moved to the lower end of the virtual reality contents by the control through the 3D depth camera or the motion detection sensor, A virtual reality multiple access monitoring method that provides a user interface (UI) for controlling virtual reality contents.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160077285A KR20170143264A (en) | 2016-06-21 | 2016-06-21 | Virtual reality access monitoring system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020160077285A KR20170143264A (en) | 2016-06-21 | 2016-06-21 | Virtual reality access monitoring system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| KR20170143264A true KR20170143264A (en) | 2017-12-29 |
Family
ID=60939110
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020160077285A KR20170143264A (en) | 2016-06-21 | 2016-06-21 | Virtual reality access monitoring system and method |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR20170143264A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020070630A1 (en) * | 2018-10-02 | 2020-04-09 | Within Unlimited, Inc. | Methods, systems and devices supporting real-time shared virtual reality environment |
| KR20200135100A (en) * | 2019-05-22 | 2020-12-02 | 주식회사 듀코젠 | System and method for VR(Virtual Reality) learning service enabling cooperative work |
| KR20220133553A (en) * | 2021-03-25 | 2022-10-05 | 주식회사 네비웍스 | Controlling apparatus for virtul training, and control method thereof |
| KR102513148B1 (en) * | 2021-12-31 | 2023-03-23 | 주식회사 메타에듀시스 | Training Method for negligent accident Response using Virtual Reality |
| KR20230171663A (en) | 2022-06-14 | 2023-12-21 | 이루고월드 주식회사 | Apparatus for accessing to 3d virtual world through multiple device and method thereof |
-
2016
- 2016-06-21 KR KR1020160077285A patent/KR20170143264A/en not_active Application Discontinuation
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2020070630A1 (en) * | 2018-10-02 | 2020-04-09 | Within Unlimited, Inc. | Methods, systems and devices supporting real-time shared virtual reality environment |
| US11870972B2 (en) | 2018-10-02 | 2024-01-09 | Within Unlimited, Inc. | Methods, systems and devices supporting real-time shared virtual reality environment |
| KR20200135100A (en) * | 2019-05-22 | 2020-12-02 | 주식회사 듀코젠 | System and method for VR(Virtual Reality) learning service enabling cooperative work |
| KR20220133553A (en) * | 2021-03-25 | 2022-10-05 | 주식회사 네비웍스 | Controlling apparatus for virtul training, and control method thereof |
| KR102513148B1 (en) * | 2021-12-31 | 2023-03-23 | 주식회사 메타에듀시스 | Training Method for negligent accident Response using Virtual Reality |
| KR20230171663A (en) | 2022-06-14 | 2023-12-21 | 이루고월드 주식회사 | Apparatus for accessing to 3d virtual world through multiple device and method thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20170143264A (en) | Virtual reality access monitoring system and method | |
| CN106791485B (en) | Video switching method and device | |
| WO2018165041A8 (en) | Mixed reality viewer system and method | |
| WO2018182321A1 (en) | Method and apparatus for rendering timed text and graphics in virtual reality video | |
| JP6822410B2 (en) | Information processing system and information processing method | |
| US10771739B2 (en) | Information processing device and information processing method | |
| CN109964481B (en) | Experience sharing system | |
| US20130215214A1 (en) | System and method for managing avatarsaddressing a remote participant in a video conference | |
| US20150244984A1 (en) | Information processing method and device | |
| KR20200116649A (en) | Simulated aviation Cockpit Procedure Training simulator system using Head Mounted Display based mixed reality technology | |
| JP6822413B2 (en) | Server equipment, information processing methods, and computer programs | |
| JP2006330464A (en) | Attendance status discriminating device, method, and program | |
| KR101757420B1 (en) | The system for remote video communication and lecture based on interaction using transparent display | |
| KR20210097268A (en) | Distance education system using virtual reality | |
| KR20110006976A (en) | Mutimedia syncronization control system for display space from experience space | |
| US20210377514A1 (en) | User Interface Module For Converting A Standard 2D Display Device Into An Interactive 3D Display Device | |
| JP7465737B2 (en) | Teaching system, viewing terminal, information processing method and program | |
| WO2017068926A1 (en) | Information processing device, control method therefor, and computer program | |
| Papara et al. | Virtual reality as cost effective tool for distance healthcare | |
| JP4479414B2 (en) | Video distribution system and video receiver | |
| KR20160074072A (en) | real time education system for a deaf-mute school | |
| WO2017068928A1 (en) | Information processing device, control method therefor, and computer program | |
| US20170147177A1 (en) | Method of transmitting information via a video channel between two terminals | |
| CN206164744U (en) | Use real -time 3D virtual reality surgery operation broadcast system that high definition 3D wore display | |
| TW201742034A (en) | Remote control method of virtual reality interactive learning e-book and system thereof where the student wears a virtual reality device to allow a teacher to remotely control the device and experience the e-book teaching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E902 | Notification of reason for refusal | ||
| E601 | Decision to refuse application |