KR101839118B1 - A multi-access virtual space provisioning system linked with a multi-user real space location system - Google Patents

Abstract

The present invention relates to a multi-access virtual space providing system linked to a position in real space of multiple users, which comprises: a service server unit (100) consisting of a stream server (110) storing VR content data including 360-degree video data to deliver the VR content data to a plurality of HMD clients in real time and a management server (120) accessed by the HMD clients and the manager client to transmit commands of the manager client to the HMD clients; the manager client (200) receiving commands on selection and execution of content by a manager to manage execution of the VR content; and a multi HMD client (300) composed of a plurality of HMD clients disposed in the same real space, wherein the manager client (200) processes information on a position in real space of a plurality of users participating in execution of the corresponding VR content previously stored or set by a manager as a type of a command and then transmits the commands to the management server (120), and the management server (120) generates information on a position in virtual space of the VR video, which corresponds to the information on a position in real space of a plurality of users in response to the received commands, and then transmits the same to the plurality of HMD clients of the multi HMD client (300). The present invention is able to precisely control a position in virtual space.

Description

[0001] The present invention relates to a multi-access virtual space provisioning system and a multi-access virtual space provisioning system,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multiple access virtual space provision system and a multiple access virtual space provision method, and more particularly, to a multiple access virtual space provision system in which a plurality of users are located, System and a method for providing 3D virtual reality images in a multiple access virtual space.

Virtual Reality refers to a specific environment or situation, or technology itself, that is similar to the reality produced by artificial technology using computers, but not actual. At this point, the virtual reality (imagined) environment or situation Stimulates the user's five senses and allows them to experience the same spatial and temporal experiences as they do in real life.

Immersive Virtual Reality allows people to feel sensational effects such as touching and seeing through special equipment such as HMD (Head Mounted Display), data glove, data suit, System has been widely used as a HMD (Head Mounted Display), and a system for providing a 3D virtual reality image in the form of a 360-degree image view has been widely used in connection with 3D display technology or 360-degree video technology.

However, in general, an HMD without a positioning function or a space detection function can not change its position in a virtual space by recognizing its position according to the motion of an HMD user wearing the HMD, It is not possible to precisely control the position in the virtual space by performing functions in a limited space such as a classroom or a learning space in which a plurality of users are located due to the problem of positioning itself.

In addition, even if equipment having a precise space detection function is developed, it is difficult to realize realistic cost due to increase in specification and price in order to commercialize it as a system for education or training which is used simultaneously by a large number of users such as a student or a trainee , The recognition of other users and the display in the virtual space are still not possible, and they have the same technical and realistic problems.

In particular, even if a location function or a space detection function is included, it is not possible to recognize the location of another user when a multi-user virtual space in which a plurality of users gathered in the same physical space access and participate in the virtual space is implemented.

Open Patent Publication No. 10-2017-0013653 (entitled " HMD type virtual reality content monitoring and control system "

There is provided a system for providing a multiple access virtual space and a method for providing a 3D virtual reality image in a multiple access virtual space interlocked with a physical space coordinate such as a classroom or a study space as a limited space where a plurality of users are located.

Even if an HMD without a space detection function or a positioning function is used, it is possible to grasp a user's real position in a limited space such as a classroom or a learning space where a large number of users are located and precisely control the position in the virtual space, And a method for providing a 3D virtual reality image in a multiple access virtual space.

Furthermore, a high-specification HMD device including a space detection function or a positioning function, which is applied to a system for educational or training purposes in which a plurality of users, such as a student or a trainee, And a method for providing a 3D virtual reality image in a multiple access virtual space without intervention of the introduction of a virtual reality space, And to provide the above objects.

To this end, the present invention relates to a system for providing a multiple access virtual space in cooperation with a position of a multi-user in a real space, which stores VR contents data including 360-degree moving picture data, A service server unit (100) including a stream server (110) for delivering a plurality of HMD clients and an administrator client, and a management server (120) for connecting to a plurality of HMD clients with commands of an administrator client; An administrator client (200) which receives a command related to selection and progress of contents of an administrator and manages the progress of VR contents; And a plurality of HMD clients 300 arranged in the same physical space, the manager client 200 includes a plurality of HMD clients 300 that are pre-stored or participating in the progress of the VR contents set by the administrator The management server 120 processes the location information of the user in the form of a command in the form of a command and transmits the virtual information of the VR image corresponding to the location information of the plurality of users to the management server 120 according to the received command. And transmits the generated position information to a plurality of HMD clients of the multiple HMD client (300).

Preferably, the management server 120 controls connection between a plurality of HMD clients and an administrator client through a wired / wireless communication interface, and transmits client information connected through the login information of the plurality of connected HMD clients and the manager client A client connection management unit 121 for managing user information of the connected HMD client and transmitting the user information of the connected HMD client to the connected HMD client via the wired / wireless communication interface 127, a command and message received from the manager client, A content information management unit 123 for storing and managing the storage location and access information of VR content data transmitted to the HMD client, a command / message processing unit 122 for transmitting the command received from the HMD client to the connected HMD client, According to the present invention, An HMD position information processing unit 124 for generating position information in a virtual space of a VR image corresponding to image position information and transmitting the generated position information to a plurality of HMD clients of the multiple HMD client 300 via a wired / And a communication I / F control unit 125 for controlling the operation of the wired / wireless communication interface 127.

Preferably, the management server 120 receives viewing angle information from a plurality of HMD clients connected via the wired / wireless communication interface 127, and transmits the viewing angle information of the received connected HMD client to another connected HMD client And a viewing angle information processing unit 126 for transmitting the information through the wired / wireless communication interface 127.

Preferably, the management server 120 receives the avatar information of the user from a plurality of HMD clients connected through the wired / wireless communication interface 127, and the client connection management unit 121 receives the avatar information of the connected HMD client And transmits the avatar information of the user to another HMD client connected as user information of the connected HMD client through the wired / wireless communication interface 127.

Preferably, the manager client 200 generates a command including information on a plurality of users' physical space positions related to a physical space position of a plurality of users participating in the progress of the VR content, Lt; / RTI >

The administrator client 200 preferably includes a client setting / managing unit 210 for setting and managing user information of a plurality of users participating in the progress of the VR contents and device information of the HMD client, an administrator client 200, A control unit 220 for controlling the operation of each component of the VR content, a controller 220 for setting and managing the information of the VR content, receiving input related to the selection and playback of the VR content which proceeds through the user interface 270, A content setting / playback control unit 230 for generating a command related to playback, a controller 230 for receiving a selection of a manager about a physical space position of a plurality of users participating in the progress of the VR content, An HMD generating unit for generating a command including positional information on the physical space of a plurality of users in association with the positional information of the HMD client apparatus, A command / message processing unit 250 for processing commands and messages generated by the client location setting / controlling unit 240 and the administrator client 200 and transmitting the processed commands and messages to the management server 120 or the plurality of HMD clients through the wired / ), And a preset message required for the progress of the VR contents, and displays an input window for inputting a message of an administrator through the user interface 270, receives an administrator's message, The HMD client location setting / controlling unit 240 includes a message setting / transmission control unit 260 for generating a visualized real space through which the VR contents are progressed through the user interface 270, Enter the administrator's choice of physical location of multiple users participating in the progress of the content Receive.

Preferably, the plurality of HMD clients of the multiple HMD client 300 includes a wired / wireless communication interface 310 for transmitting / receiving data to / from the service server unit 100 or the administrator client 200 through wired / VR contents data through the display unit 310 and receives the operation signal of the user sensed by the sensor unit of the headset unit 330 to generate viewing angle information to generate a 3D virtual reality image according to the viewing angle information, A VR contents processing unit 320 for outputting the 3D virtual reality image generated by the VR contents processing unit 320 to the VR contents processing unit 320 and outputting the 3D virtual reality image generated according to the viewing angle information, The VR contents processing unit 320 includes the VR contents processing unit 330 and the VR contents processing unit 320. The VR contents processing unit 320 receives the VR contents from the management server 120 through the wired / It can generate the 3D virtual reality image on the basis of this, to receive the location information in the virtual space on the VR image corresponding to the user in the real space, the position information.

Preferably, the VR contents processing unit 320 transmits the viewing angle information to the management server 120 through the wired / wireless communication interface 310, receives viewing angle information of another user from the management server 120, And generates a 3D virtual reality image as a basis.

Preferably, the VR contents processing unit 320 receives the avatar information of another user and generates a 3D virtual reality image so that the avatar is displayed in the virtual space of the VR image according to the received location information of the corresponding user.

Preferably, the VR contents processing unit 320 receives the avatar information of the other user and displays the avatar in the virtual space of the VR image according to the received location information and the viewing angle information of the corresponding user, And generates an image.

 Preferably, the VR contents processing unit 320 transmits avatar information of the user selected by the user to the management server 120 through the wired / wireless communication interface 310, receives the avatar information of another user, The 3D virtual reality image is generated so that the avatar is displayed in the virtual space of the VR image according to the position information and the viewing angle information of the user.

According to another aspect of the present invention, there is provided a method for providing a 3D virtual reality image in a multiple access virtual space, comprising: connecting a plurality of HMD clients and clients connected to the service server by a manager client to a server (S100); A content selection / progress step (S200) for generating VR content to be proceeded through an administrator client and generating and outputting 3D virtual reality images by transmitting VR content data selected by the service server to a plurality of HMD clients; And a content viewing and action step (S300) in which a plurality of HMD clients receive VR content data through the wired / wireless communication interface (310) to generate viewing angle information and generate and output 3D virtual reality images in accordance with the viewing angle information do.

Preferably, in the content selection / advance step S200, the manager client processes the position information on the physical space of a plurality of users participating in the progress of the VR content set in advance or set by the administrator in the form of a command The service server generates location information in a virtual space of a VR image corresponding to the real space position information of a plurality of users according to the received command and transmits the generated location information to the plurality of HMD clients, In the viewing and action step S300, the HMD client receives the location information and generates a 3D virtual reality image based on the received location information.

Preferably, in the content selection / advance step S200, the service server receives the viewing angle information from a plurality of HMD clients connected through the wired / wireless communication interface 127, and obtains the viewing angle information of the received connected HMD client The HMD client receives the viewing angle information of the other user and generates a 3D virtual reality image based on the received viewing angle information in the content viewing and action step S300.

Preferably, the service server receives the avatar information of the user from a plurality of HMD clients connected through the wired / wireless communication interface 127, and transmits the avatar information of the user of the received connected HMD client to another connected HMD client In the content viewing and action step S300, the HMD client generates a 3D virtual reality image based on viewing angle information and avatar information of another user.

As described above, according to the present invention, there is provided a multiple access virtual space providing system interlocked with a physical space coordinate such as a classroom or a study space, which is a limited space where a plurality of users are located, and a method of providing 3D virtual reality images in a multiple access virtual space Can be provided.

In addition, a method for providing a 3D virtual reality image in a multiple access virtual space providing system and a multiple access virtual space providing system cooperating with a physical space coordinate system of the present invention, It is possible to precisely control the position in the virtual space by transmitting the position information to the HMD client by grasping the real position of the user in a limited space such as a classroom or a learning place located in the manager client.

Furthermore, according to an embodiment of a system for providing a multiple access virtual space and a method for providing a 3D virtual reality image in a multiple access virtual space linked to a physical space coordinate of the present invention, a plurality of users, It is not necessary to introduce a high-specification HMD equipment including a space detection function or a positioning function, which is applied to a system for training or training to view the same VR content, Information and avatar information are used, or viewing angle information is transmitted to the HMD client in addition to the position information and the avatar information transmitted to the HMD client, thereby enabling efficient recognition of other users and their positions and display in the virtual space .

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a configuration diagram of a multiple access virtual space providing system in accordance with the present invention. FIG.
2 is a diagram for explaining a configuration of a multiple access virtual space service server unit according to an embodiment of the present invention;
3 is a configuration diagram of a management server of a service server unit according to an embodiment of the present invention;
4 is a configuration diagram of an administrator client according to an embodiment of the present invention;
5 is a configuration diagram of an HMD client according to an embodiment of the present invention;
6 is a flowchart of a method for providing a 3D virtual reality image in the multiple access virtual space of the present invention
FIG. 7 is a flow chart of the connection and termination of the management server of the method for providing 3D virtual reality images in the multiple access virtual space of the present invention,
8 is a flowchart of a temporal example of a processing procedure in an administrator client of a method of providing a 3D virtual reality image in the multiple access virtual space of the present invention
9 is a flowchart of a temporal example of a process in a management server of a method of providing a 3D virtual reality image in a multiple access virtual space according to the present invention
10 is a flowchart of a temporal example of a process in the HMD client of a method of providing a 3D virtual reality image in the multiple access virtual space of the present invention
FIG. 11 is a view for explaining the physical space position of the present invention and the display of the visualized real space and the position coordinates in the virtual space;
12 and 13 are diagrams for explaining the angle information in the virtual space of the present invention

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different, but need not be mutually exclusive. For example, certain features, structures, and characteristics described herein may be implemented in other embodiments without departing from the spirit and scope of the invention in connection with an embodiment. It is also to be understood that the position or arrangement of the individual components within each disclosed embodiment may be varied without departing from the spirit and scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense, and the scope of the present invention is to be limited only by the appended claims, along with the full scope of equivalents to which the claims are entitled, if properly explained. In the drawings, like reference numerals refer to the same or similar functions throughout the several views.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, so that those skilled in the art can easily carry out the present invention.

FIG. 1 is a configuration diagram of a multiple access virtual space providing system interworking with a multi-user real space position of the present invention, FIG. 2 is a diagram for explaining a configuration of a multiple access virtual space service server unit according to an embodiment of the present invention .

Referring to FIGS. 1 and 2, a multiple access virtual space providing system interworking with a multi-user real space location of the present invention includes a multiple access virtual space service server unit 100 (hereinafter referred to as a service server unit 100) An administrator client 200 that receives an instruction regarding selection and progress of contents of an administrator and manages the progress of the VR contents; And a plurality of HMD clients 300 arranged in the same physical space.

VR contents are video contents that can be output in the form of VR images by HMD, and include not only 360 degree pictures and 360 degree videos but also fixed pictures or videos. The user of the system of the present invention uses the avatar system to select a view he or she wants to be displayed in a virtual environment, The virtual avatar of the other party in the virtual space specific position can be viewed and the other party can be viewed in a position relative to the 3D space at a specific position.

In the present invention, the administrator client 200 processes the position information on the physical space of a plurality of users participating in the progress of the VR contents, which are stored in advance or set by the administrator, in the form of a command and transmits the information to the management server 120, The management server 120 generates location information in a virtual space of a VR image corresponding to the real space position information of a plurality of users according to the received command and transmits the position information to the plurality of HMD clients 300 of the multiple HMD client 300 To the mobile station.

The service server unit 100 manages the HMD client and the manager client and manages the contents. The main function is to manage the client connection state by managing the client through the network.

Both the HMD device and the manager device are connected to the server as clients. There are two kinds of clients: an HMD client (student) and an administrator client (professor). When the HMD client is connected, the number of users and the network connection status can be transmitted to the manager client.

The function of the service server section includes a function of transmitting a packet, and includes transmitting a packet transmitted from an administrator client to an HMD client or transmitting an HMD client packet to all clients. Among the contents of the packet is an instruction packet, And manages content management.

Types of commands include content selection, content start, content end, content pause, content restart, content specific section move, message transmission, and the like. In the status packet, the operation state of the client, the connection type of the client (the HMD client (student), the administrator client (professor)), the selected content information, the appearance of the avatar, the position change in the space of the avatar, Function.

In addition, the service server stores and manages the state of education conducted in each class when the database is connected and has a storage management function and is implemented as an education system. In addition, the state of the HMD client connected to the class and the content and the progress of the reproduced contents Time, etc., and at this time, the stored educational status data can be implemented to be displayed through the manager client.

Among the functions of the service server, the content download function first has an application download function. When the client accesses the server, the program version is automatically determined as to whether or not there is new content. In addition, when a new module is updated in a specific application due to an app module download function, the related module can be downloaded and implemented.

In addition, when viewing a 360-degree image through a download function, the data is stored in the server, the data is received in real time, and the HMD client watches the data. In the case of watching the 360- Therefore, it can not be stored in the client, so that related data can be streamed and transmitted and viewed.

The service server unit 100 includes a stream server 110, a management server 120, a download server 130, and a database 140.

The stream server 110 stores VR contents data including 360-degree moving picture data and delivers VR contents data to a plurality of HMD clients in real time. When the service server 100 operates, it operates as a web service, a streaming server, a file sharing system, or the like in the system.

The management server 120 accesses a plurality of HMD clients and an administrator client and transmits an instruction of an administrator client to the plurality of HMD clients. When the service server 100 operates, a server program is started to operate to perform a function of waiting for a connection of TCP / IP, UDP, and receiving / transmitting data.

The download server 130 stores the program of the latest client and allows the client to upgrade the latest program file. When the service server is activated, the web service or the file sharing system operates while the system is operating.

The database 140 stores content execution information, client connection information, and avatar information of a client and provides a read function. When the service server 100 operates, the database 140 operates in the background, Stores related data, and reads related data from a file by a data read command.

3 is a configuration diagram of a management server of a service server unit according to an embodiment of the present invention.

3, the management server 120 controls connection between a plurality of HMD clients and an administrator client through a wired / wireless communication interface, and connects a plurality of HMD clients and an administrator client A client connection management unit 121 for managing client information connected through information and transmitting user information of the connected HMD client to another connected HMD client through a wired / wireless communication interface 127, A contents information management unit 123 for storing and managing the storage location and access information of VR contents data transmitted to the HMD client, According to a command received from the client 200, Generates HMD position information in the virtual space of the VR image corresponding to the user's physical space position information, and transmits HMD position information to the plurality of HMD clients of the multiple HMD client (300) through the wired / wireless communication interface A communication I / F control unit 125 for controlling the operation of the processing unit 124, the wired / wireless communication interface 127, and a plurality of HMD clients connected via the wired / wireless communication interface 127, And a viewing angle information processing unit 126 for transmitting the viewing angle information of the HMD client to another connected HMD client through the wired / wireless communication interface 127. [

In the present embodiment, the management server 120 receives the user's avatar information from a plurality of HMD clients connected via the wired / wireless communication interface 127, and the client connection management unit 121 acquires the avatar information of the received HMD client Through the wired / wireless communication interface 127 to the connected HMD client as the user information of the connected HMD client.

4 is a configuration diagram of an administrator client according to an embodiment of the present invention.

The administrator client 200 has a function of generating a command including information on a plurality of users' real space positions related to a physical space position of a plurality of users participating in the progress of VR contents and transmitting the command to the management server 120 And can be configured in the form of a tablet PC having a touch screen type user interface and a client software installed and driven thereon.

4, the administrator client 200 includes a client setting / managing unit 210 for setting and managing user information of a plurality of users participating in the progress of VR content and device information of the HMD client, A control unit 220 for controlling the operation of each constituent part of the administrator client 200, setting and managing information of the VR contents, receiving input related to selection and reproduction of VR contents proceeding through the user interface 270 A content setting / playback control unit 230 for generating a command related to selection and playback of VR content, a controller 230 for receiving a selection of a manager about a physical space position of a plurality of users participating in the progress of the VR content, An instruction word that includes positional information on the physical space of a plurality of users in association with the positional information of the HMD client device that generates spatial positional information The HMD client location setting / controlling unit 240 for controlling the HMD client location setting / controlling unit 240 and the administrator client 200 to transmit the command / message to the management server 120 or a plurality of HMD clients through the wired / And an input window for inputting a message of an administrator through the user interface 270. The manager receives a message from the manager and receives the message through an HMD And a message setting / transmission control unit 260 for generating a message to be transmitted to the client.

The administrator client 200 can select video contents, adjust image contents (start a content, end a content, pause a content, restart a content, move a content-specific section), transmit a message, Progress state management, and the like, and receives a selection input of position setting and position movement related to positioning and position movement of the HMD client as an input related to a plurality of users' physical space positions.

It can be implemented in the form of a command of the PC of the tablet, which is an administrator client, as follows.

Client coordinate setting command

CLIENT_POSITITON_SET: (ID, POSX, POSY, POSZ) = CMD_CPC, client1, 10.3, 1.1, 4.5

Move client coordinates

CLIENT_POSITITON_CHANGE: (ID, POSX, POSY, POSZ) = CMD_CPC, client1, 10.3, 1.1, 6.5

Content Selection

CONTENTS_SELECT: (CONTENTS_NAME, Time Position) = CMD_CS, movie.avi, 10.0

Video content adjustment

MOVIE: (START | STOP | PAUSE | REPLAY | JUMP_SEC), Time Position = CMD_MOVIE, START, 10.0

Send message

MESSAGE: (message string ...) = CMD_MSG, Hello everybody ... .

Force client termination

CLIENT_DISCONNECT: (ID) = CMD_DISCON, client1

Progress management

STATE: (READY | RUN | STOP |) = CMD_STATE, RUN

According to an embodiment, the HMD client location setting / controlling unit 240 displays a visualized real space where the VR contents are progressed through the user interface 270, thereby displaying the reality of a plurality of users participating in the progress of the VR contents The manager's selection of the spatial position can be input.

 FIG. 11 is a view for explaining a real space position and a visualization of a real space according to the present invention and a position coordinate in a virtual space. Referring to FIG. 11, the real space position in the present embodiment is a limited space, (Height Y = 0) on the plane having the relative real space-space 1M between the seat of the student such as the seat of the student and the position of the manager client example contemporary tablet PC (Tablet1) as the reference position, (0,0,0), the position value of HMD Client1 is (-2,0,2), the position value of HMD Client2 is (0,0,2), the position of HMD Client3 The position value of HMD Client4 is (2,0,2), the position of HMD Client4 is (-2,0,4), the position of HMD Client5 is (0,0,4) 4), the position value of HMD Client7 is (-2,0,6), the position value of HMD Client8 is (0,0,6), and the position value of HMD Client9 is (2,0,6) As position coordinates on the virtual space, 11, the real space is visualized in a simple form and displayed on the screen of the tablet PC, and the client and the HMD client are displayed in a character or an avatar form as shown in this embodiment, And displays the visualized real space on the user interface 270. In this way, a character or an avatar type indicating the manager client and the HMD client are positioned in the real space space of the plurality of users participating in the progress of the VR contents The location of the client and the HMD client can be set or changed by receiving the input of the manager's selection regarding the location.

5 is a configuration diagram of an HMD client according to an embodiment of the present invention.

5, a plurality of HMD clients of the multiple HMD client 300 includes a wired / wireless communication interface 310 for transmitting / receiving data to / from the service server unit 100 or the administrator client 200 through wired / Receives the VR contents data through the wired / wireless communication interface 310 and receives the operation signal of the user sensed by the sensor unit of the headset unit 330 to generate viewing angle information, generates a 3D virtual reality image according to the viewing angle information, A VR contents processing unit 320 for transmitting the VR contents to the VR contents processing unit 330 and outputting the VR contents to the VR contents processing unit 320 and receiving the 3D virtual reality images generated according to the viewing angle information, And a headset unit 330 for outputting the HMD device and a software application for driving the HMD device.

The VR contents processing unit 320 receives position information in the virtual space of the VR image corresponding to the position information on the real space of a plurality of users including itself from the management server 120 through the wired / wireless communication interface 310 And generates a 3D virtual reality image on the basis thereof.

The VR contents processing unit 320 transmits the viewing angle information to the management server 120 through the wired or wireless communication interface 310 and receives the viewing angle information of the other user from the management server 120, And may generate the 3D virtual reality image so that the avatar is displayed in the virtual space of the VR image according to the received location information of the corresponding user by receiving the avatar information of the other user.

In this embodiment, the avatar information of another user is received and a 3D virtual reality image is generated so that the avatar is displayed in the virtual space of the VR image according to the received position information and viewing angle information of the corresponding user.

In this way, with the aid of the tablet, the coordinates can be precisely shifted, and a plurality of HMD wearers connected to the server can watch specific contents while watching the behavior in the same space.

For this, the VR contents processing unit 320 transmits avatar information of the user selected by the user to the management server 120 through the wired / wireless communication interface 310, receives the avatar information of the other user, Position information and viewing angle information.

In this embodiment, the image forming the avatar may be downloaded in advance and stored in the HMD client. In this case, the avatar information includes only information for identifying the avatar.

The viewing angle information and the avatar information may be included in the transmission data of the HMD client and transmitted periodically to the service server in the following manner.

Username: CLIENT_HMD_1

Position Coordinates: X, Y, Z

Field of view: X (pitch), Y (yaw), Z (roll)

Avatar Info: Avarta N

Action Information: Hand waving (1), Greetings (2),

Clap (3), one hand (4)

class ClientData {

  float posX;

  float posY;

  float posZ;

  float viewX;

  float viewY;

  float viewZ;

  Int ActionID;

}

12 and 13 are diagrams for explaining the angle information in the virtual space of the present invention. Referring to FIG. 12, the manager client (Tablet 1) at the real position (height Y = 0) The view center of each HMD client based on the view center of the HMD client is defined as the view angle of each HMD client. 12, the viewing angle of the manager client (Tablet 1) is 0, the viewing angle of the HMD Client 4 is +10 degrees, and the viewing angle of the HMD Client 6 is -60 degrees.

13, in the present embodiment, the viewing angle in the three-dimensional plane is obtained as viewing angle information in the form of Vector Rotation (x, y, z) through the operation signal of the user sensed by the sensor unit of the headset 330 And a 3D virtual reality image is generated according to the viewing angle information. The viewing angle information of another client received from the service server is obtained by extracting the rotation rotation (Y) of the viewing angle in the X and Z planes as viewing angle information and combining with the avatar information The rotation of the head portion of the avatar of another user in the virtual space of the 3D virtual reality image can be displayed.

5, the VR contents processing unit 320 of the HMD client includes a control unit 321 for controlling the operation of the HMD client, a VR processing unit 320 for receiving data transmitted from the service server through the wired / An HMD position information receiving unit 324 for receiving the data transmitted from the service server and extracting the position information of the HMD client and the position information of other HMD clients, receiving the data transmitted from the service server, An HMD viewing angle information receiving unit 325 for extracting viewing angle information of another HMD client, and a display unit 325 for generating the viewing angle information of the user through an operation signal of the user sensed by the sensor unit, A viewing angle information generating unit 326 for transmitting the VR contents data to the service server, A VR image generating unit for receiving the 3D information, the 3D information, and the viewing angle information and generating a 3D virtual reality image based on the 3D information and transmitting the 3D virtual reality image to the headset unit 330 and outputting the 3D virtual reality image, The control unit may transmit the command and the message to the 3D virtual reality image generated by the VR image generation unit, or may control the operation of the VR image generation unit to control the reproduction of the content.

The headset unit 330 includes a user interface for receiving a user's operation, a voice output unit for outputting voice of a 3D virtual reality image, a VR image display unit for outputting a 3D virtual reality image, The sensor unit may include an operation sensor such as a magnetic sensor for sensing a change in the position of the wearer's head or eyes. In some embodiments, the sensor unit senses movement of the user's eyes A visual sensor, and a position sensor for sensing the position of the wearer's hand.

Meanwhile, according to another aspect of the present invention, there is provided a method for providing a 3D virtual reality image in a multi-access virtual space, the multi-connection virtual space providing system interworking with the multi- .

6 is a flowchart illustrating a method of providing a 3D virtual reality image in a multiple access virtual space according to the present invention. Referring to FIG. 6, a method of providing a 3D virtual reality image in a multiple access virtual space includes a plurality of HMD clients, A step (S100) in which clients connecting to the service server connect to the server; A content selection / progress step (S200) for generating VR content to be proceeded through an administrator client and generating and outputting 3D virtual reality images by transmitting VR content data selected by the service server to a plurality of HMD clients; And a content viewing and action step (S300) in which a plurality of HMD clients receive VR content data through the wired / wireless communication interface (310) to generate viewing angle information and generate and output 3D virtual reality images in accordance with the viewing angle information do.

In the content selection / advance step S200, the manager client processes the position information on the physical space of a plurality of users, which are stored in advance or set by the administrator, in the progress of the VR content in the form of a command, The service server generates location information in a virtual space of a VR image corresponding to a plurality of users' physical space location information according to the received command, transmits the generated location information to the plurality of HMD clients, In step S300, the HMD client receives the location information and generates a 3D virtual reality image based on the received location information.

Here, in the content selection / advance step S200, the service server receives viewing angle information from a plurality of HMD clients connected through the wired / wireless communication interface 127, and transmits the viewing angle information of the received connected HMD client to the connected In the content viewing and action step S300, the HMD client receives the viewing angle information of another user and generates a 3D virtual reality image based on the viewing angle information, and the service server transmits the 3D virtual reality image to the HMD client via the wired / Receives the avatar information of the user from a plurality of HMD clients connected through the wired / wireless communication interface 127, transmits the avatar information of the user of the connected HMD client to the connected HMD client via the wired / wireless communication interface 127 , In the content viewing and action step S300, the HMD client sets the viewing angle of the other user Based on the information and the avatar it can be done to create a 3D virtual reality images.

FIG. 7 is a flow chart of a connection and termination of a management server of a method of providing a 3D virtual reality image in a multiple access virtual space of the present invention, FIG. 9 is a flowchart of a temporal example of a process in a management server of a method of providing a 3D virtual reality image in a multiple access virtual space of the present invention, and FIG. 10 Is a flowchart of a temporal example of a process in the HMD client of a method of providing a 3D virtual reality image in the multiple access virtual space of the present invention.

Embodiments of the respective processes will be described below in the range not overlapping with the above description.

Referring to FIG. 7, the connection and termination of the management server of the present invention is performed including a waiting step, a client connecting step, a client managing step, and a client terminating step, as shown in FIG. 7 (a) Connection and termination are performed as shown in FIG. 7 (b), including an initialization step of initializing various variables for server connection, a server connection step, a content execution step, and an end step.

8, the processing in the administrator client includes a server connecting step 810, a client information setting step 822, and a client location setting step 821, which are performed by the above-described respective configurations of the administrator client And a client avatar setting process 823 for setting an avatar of the client according to an embodiment.

Next, a content setting process 830, a client position changing process 841, a content reproduction control process 842, a message generating process 843, a command / message generating process, A transmission process 850, and a client termination step 860. [

9, the processing procedure in the management server includes a server connecting step 910 of clients, a command / message receiving step 921 for receiving an instruction and / or a message from an administrator client, The message delivery process 922 extracts the content selection information from the command and / or message received from the manager client, extracts the changed location information of the client from the command and / or message received from the manager client that delivers the content selection information to the HMD client, A content reproduction control command delivery process 942 for extracting a content reproduction control command from a command and / or message received from an administrator client and delivering the command to a HMD client, Viewing angle information from And a database storing process 961 for storing a record of a viewing angle information reception / transmission process 950, a client termination process 961, a client connection record, and a content reproduction related record, which are received and transmitted to another HMD client, .

10, the process in the HMD client includes a server connection step 1010, an avatar information receiving process 1021 for receiving avatar information of an avatar selected by a user of another HMD client, an avatar selecting process An avatar information server transmission process 1023 for transmitting the avatar information of the selected avatar to the service server 1023, a selected content receiving process 1030 for receiving the storage location of the selected VR content data and the connection information, A stream preparation process 1041 for preparing a stream of VR contents data in accordance with a storage location of the selected VR contents data and access information, a stream preparation completion transmission process 1042 for completing preparation of a stream and notifying the service server thereof, A client location information reception process 1051 for receiving location information of an administrator client and an HMD client, A VR image generation process 1061, a viewing angle information detection process 1062, a viewing angle information transmission process 1063, and a client viewing angle information reception process 1053 for receiving the viewing angle information of another HMD client, A receiving step 1054 of receiving a client change position information command for receiving a change position information command, and a content ending process 1070.

As has been described above, specific combinations of configurations or steps of the present invention have been described in detail by way of the above embodiments, but other combinations of such configurations and steps are likewise possible. The present invention is not limited to the specific embodiments disclosed herein, and such other combinations are within the scope of the present invention. Therefore, the present invention is not limited to the above-described embodiments, and various modifications and changes may be made thereto by those skilled in the art to which the present invention belongs.

100: Multiple access virtual space service server unit
200: Administrator Client
300: HMD client

Claims (15)

delete 1. A system for providing a multiple access virtual space interlocking with a physical space position of a multiuser,
A stream server 110 for storing VR content data including 360-degree video data and delivering VR content data to a plurality of HMD clients in real time, a plurality of HMD clients and an administrator client, A service server unit 100 including a management server 120 for transmitting the management server 120 to an HMD client of the HMD;
An administrator client (200) which receives a command related to selection and progress of contents of an administrator and manages the progress of VR contents; And
And a multi HMD client (300) composed of a plurality of HMD clients arranged in the same real space,
The manager client 200 processes the position information on the physical space of a plurality of users participating in the progress of the VR contents, which are stored in advance or set by the administrator, in the form of a command and transmits the processed information to the management server 120,
The management server 120 generates position information in a virtual space of a VR image corresponding to a plurality of users' real space spatial position information according to the received command and outputs the position information in a plurality of HMDs 300 of the multiple HMD client 300 To the client,
The management server (120)
A control unit for controlling connection of a plurality of HMD clients and an administrator client through a wired / wireless communication interface, managing client information connected through login information of the connected HMD clients and an administrator client, A client connection management unit 121 for transmitting to the other HMD clients via the wired / wireless communication interface 127,
A command / message processing unit 122 for processing commands and messages received from an administrator client and transmitting the processed commands and messages to an HMD client connected via a wired / wireless communication interface,
A content information management unit 123 for storing and managing the storage location and access information of the VR content data transmitted to the HMD client,
Generates position information in a virtual space of a VR image corresponding to a plurality of users' real space spatial position information according to an instruction received from the administrator client 200, and transmits the position information to a plurality of HMD clients of the multiple HMD client (300) An HMD position information processing unit 124 for transmitting via the communication interface 127,
And a communication I / F control unit (125) for controlling the operation of the wired / wireless communication interface (127). The method of claim 2,
The management server (120)
A viewing angle information processing unit for receiving viewing angle information from a plurality of HMD clients connected via the wired / wireless communication interface 127 and transmitting the received viewing angle information of the connected HMD client to another connected HMD client through the wired / (126). The system of any one of claims 1 to 8, further comprising: The method of claim 3,
The management server (120)
The avatar information of the user of the connected HMD client is received by the client connection management unit 121 from the plurality of HMD clients connected through the wired / wireless communication interface 127, and the avatar information of the user of the connected HMD client is received as the user information of the connected HMD client To the connected other HMD client through the wired / wireless communication interface (127). delete delete The method of claim 2,
A plurality of HMD clients of the multiple HMD client (300)
A wired / wireless communication interface 310 for transmitting / receiving data to / from the service server unit 100 or the administrator client 200 through wired /
Receives the VR contents data through the wired / wireless communication interface 310, receives the operation signal of the user sensed by the sensor unit of the headset unit 330, generates viewing angle information, and generates a 3D virtual reality image according to the viewing angle information A VR contents processing unit 320 for transmitting the VR contents to the headset unit 330,
And a headset unit 330 for transmitting the user's operation signal detected by the sensor unit to the VR contents processing unit 320 and receiving and outputting the 3D virtual reality image generated according to the viewing angle information,
The VR contents processing unit 320,
From the management server 120 via the wired / wireless communication interface 310, positional information in the virtual space of the VR image corresponding to the position information on the real space of a plurality of users including itself, and generates a 3D virtual reality image Wherein the virtual space is located at a position corresponding to a physical space of the multi-user. The method of claim 7,
The VR contents processing unit 320,
And transmits the viewing angle information to the management server (120) via the wired / wireless communication interface (310), receives the viewing angle information of the other user from the management server (120) A system for providing multiple access virtual space linked with a user's physical space location. The method of claim 7,
The VR contents processing unit 320,
And a 3D virtual reality image is generated so that the avatar is displayed in a virtual space of the VR image according to the received location information of the corresponding user by receiving the avatar information of another user. A multi-access virtual space provision system. The method of claim 8,
The VR contents processing unit 320,
And generating a 3D virtual reality image so that the avatar is displayed in the virtual space of the VR image according to the received location information and viewing angle information of the user receiving the avatar information of the other user, A system for providing multiple access virtual space linked with location. The method of claim 8,
The VR contents processing unit 320,
Transmits the avatar information selected by the user to the management server 120 through the wired / wireless communication interface 310, receives the avatar information of the other user, and displays the avatar information of the VR image And a 3D virtual reality image is generated such that the avatar is displayed in the virtual space. delete delete delete delete

Images