KR20210084248A - Method and apparatus for providing a platform for transmitting vr contents - Google Patents

Abstract

A VR content relay platform providing method is provided. According to one embodiment of the present invention, the VR content relay platform providing method includes the steps of: obtaining 3D content; obtaining a plurality of VR images by capturing the 3D content; generating VR video data by extracting audio data included in the 3D content and mapping the audio data with the plurality of VR images; converting the VR video data into a video streaming format to obtain VR video streaming data; and transmitting the VR video streaming data to a streaming transmission server.

Description

VR content relay platform providing method and device { METHOD AND APPARATUS FOR PROVIDING A PLATFORM FOR TRANSMITTING VR CONTENTS }

The present invention relates to a method and apparatus for providing a VR content relay platform.

Domestic e-sports players have global competitiveness, but foreign content is more mainstream than domestic content. Therefore, there is a need to present a new paradigm for e-sports.

Usually, when watching basketball or soccer, there is a limit that you cannot see scenes that are out of the camera's field of view. VR, which has been mainly used in the field of games, is expected to change the form of existing media as it is also used for watching movies, dramas, and sports broadcasts. In-game streaming technology, when installed in the form of an object in a 3D virtual space, acquires 360 VR video in real time from the location and transmits the video to the VR streaming server. difference can be seen. Among 3D games that are currently being serviced but do not support 3D VR field spectator mode, a packaged plug-in service is required so that it can be easily applied to games using Unity 3D and Unreal Engine.

In addition, high-speed and large-capacity data are essential to convert movie or drama images into VR. VR requires a total of 720 million pixels of information consisting of about 30,000 horizontally and 24,000 vertically based on a still screen, and if you take the left and right rotation into consideration, it has to handle about 2.5 billion pixel information. Therefore, VR video generally requires about four times more data than conventional video, and a transmission speed of 800Mbps or higher is required. In order to experience various sports events, drama viewing, and game operation in VR realistically, it is necessary to provide high-definition video as well as high-FPS video. In order to implement VR video at 60FPS, it is necessary to transmit within 16.67ms between end-to-end video frames.

The above-mentioned background art is technical information possessed by the inventor for derivation of the present invention or acquired in the process of derivation of the present invention, and cannot necessarily be said to be a known technique disclosed to the general public prior to filing of the present invention.

Embodiments of the present invention are based on low-latency broadband 5G communication, through in-game streaming technology and 360 VR telepresence technology, a method of providing a VR content relay platform that allows you to experience real game play through VR HMD in 3D VR admission spectator mode, and provide that device.

A method for providing a VR content relay platform according to an embodiment of the present invention includes: acquiring 3D content; acquiring a plurality of VR images by capturing the 3D content; and extracting audio data included in the 3D content to obtain the plurality of VR images. Generating VR video data by mapping with a VR image of a video streaming format, converting the VR video data into a video streaming format to obtain VR video streaming data, and transmitting the VR video streaming data to a streaming transmission server can

In an embodiment, transmitting the VR video streaming data to the streaming transmission server may further include transmitting the VR video streaming data to a user terminal.

In an embodiment, the streaming transmission server may receive an audio stream for the VR video streaming data, combine the audio stream and the VR video streaming data, and transmit it to the user terminal.

In an embodiment, the acquiring of the plurality of VR images may include acquiring the plurality of VR images by capturing the 3D content in real time.

In an embodiment, the acquiring of the plurality of VR images may include acquiring the plurality of VR images by capturing the 3D content in 360 mono and stereo formats.

In an embodiment, the generating of the VR video data may include generating the VR video data by encoding the plurality of VR images based on audio data included in the 3D content and input data received from a microphone module. may include

In an embodiment, the obtaining of the VR video streaming data includes transmitting the VR video data to a media server using RTMP (Real-Time Messaging Protocol), and receiving VR video streaming data converted by the media server. may include steps.

In an embodiment, the media server may convert the VR video data into at least one of an HTTP Live Streaming (HLS) format and an MPEG-DASH format.

A VR content relay platform providing system according to another embodiment of the present invention includes a streaming transmission server and a VR content relay platform providing server, wherein the VR content relay platform providing server includes a processor, wherein the processor provides 3D content acquiring, capturing the 3D content to obtain a plurality of VR images, extracting audio data included in the 3D content and mapping it with the plurality of VR images to generate VR video data, and video streaming the VR video data It is possible to obtain VR video streaming data by converting to a format and transmit the VR video streaming data to the streaming transmission server.

In an embodiment, the VR content relay platform providing system may further include a user terminal, and the streaming transmission server may transmit the VR video streaming data to the user terminal.

In an embodiment, the streaming transmission server may receive an audio stream for the VR video streaming data, combine the audio stream and the VR video streaming data, and transmit it to the user terminal.

In an embodiment, the processor may acquire the plurality of VR images by capturing the 3D content in real time.

In an embodiment, the processor may acquire the plurality of VR images by capturing the 3D content in 360 mono and stereo formats.

In an embodiment, the processor may generate the VR video data by encoding the plurality of VR images based on audio data included in the 3D content and input data received from a microphone module.

In an embodiment, the system for providing a VR content relay platform further includes a media server, wherein the processor transmits the VR video data to the media server using Real-Time Messaging Protocol (RTMP), and is converted in the media server. One VR video streaming data can be received.

In an embodiment, the media server may convert the VR video data into at least one of an HTTP Live Streaming (HLS) format and an MPEG-DASH format.

Other aspects, features and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

1 is a diagram for explaining a system for providing a VR content relay platform according to an embodiment of the present invention.
2 is a diagram for explaining the configuration and operation of hardware included in the system for providing a VR content relay platform according to an embodiment of the present invention.
3 is a flowchart of a method for providing a VR content relay platform according to an embodiment of the present invention.
4 and 5 are diagrams for explaining an embodiment of a method for providing a VR content relay platform.

The terms used in the present embodiments have been selected as currently widely used general terms as possible while considering the functions in the present embodiments, which may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. have. In addition, in a specific case, there is a term arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the relevant part. Therefore, the terms used in the present embodiments should be defined based on the meaning of the term and the contents throughout the present embodiments, rather than the simple name of the term.

Since the present embodiments may have various changes and may have various forms, some embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present embodiments to a specific disclosed form, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present embodiments. The terms used herein are used only for description of the embodiments, and are not intended to limit the present embodiments.

Unless otherwise defined, terms used in the present embodiments have the same meanings as commonly understood by those of ordinary skill in the art to which the present embodiments belong. Terms such as those defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings in the context of the related art, and unless explicitly defined in the present embodiments, they have an ideal or excessively formal meaning. should not be interpreted.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS [0023] Reference is made to the accompanying drawings, which show by way of illustration specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the present invention. It should be understood that the various embodiments of the present invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented with changes from one embodiment to another without departing from the spirit and scope of the present invention. In addition, it should be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the present invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be taken as encompassing the scope of the claims and all equivalents thereto. In the drawings, like reference numerals refer to the same or similar elements throughout the various aspects.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings in order to enable those of ordinary skill in the art to easily practice the present invention.

1 is a diagram for explaining a system for providing a VR content relay platform according to an embodiment of the present invention.

Conventionally, in order to enjoy 3D games or e-sports games, two-dimensional content consumption by playing on a small mobile client or watching broadcasts through large-screen media such as TV/monitor, and direct viewing of games played by professional gamers by visiting the stadium. Passive content consumption was done. VR content relay platform according to some embodiments of the present invention is based on low-latency broadband 5G communication, and through In-Game Streaming technology and 360 VR Telepresence technology, VR in 3D VR admission spectating mode Through the HMD, you can walk around and enjoy the virtual space where the actual game play is taking place.

In addition, the VR content relay platform according to an embodiment of the present invention allows multiple game screens to float in the air at the same time in a virtual VR space and to watch together in a virtual space with other users who are physically disconnected from the real space. , it is possible to enable three-dimensional content consumption through a 360VR camera installed in an e-sports stadium or a video streamed in real-time from a virtual VR e-sports stadium.

Embodiments of the present invention provide e-sports with a thrilling VR spectating mode through 5G streaming, suggesting a new paradigm different from existing e-sports, and preference through expansion of domestic and foreign partner contents that support 5G streaming and reconsidering awareness can increase

3D VR multi-viewing relay technology according to some embodiments of the present invention is a real-time streaming game server technology, which can receive real-time 360 VR images from an in-game streaming object through a low-latency broadband 5G communication network and retransmit them to a VR spectator client.

In the case of a 3D game, a 360VR image generated from the position of the camera is transmitted, and in the case of a 2D game, a general 2D image is transmitted instead of a 360VR image. Streaming can be provided at the same time.

Embodiments of the present invention can process 60 to 120 frames per second at a transmission speed of 800 Mbps or more using a 5G communication network, thereby minimizing the afterimage generated when moving the screen, and providing high-definition video as well as a realistic experience. It can provide high FPS-based video.

The network environment of FIG. 1 shows an example including a VR content relay platform server 100 , a streaming transmission server 110 , a media server 120 , a user terminal 130 , and a network. 1 is an example for the description of the invention, and the number of user terminals or the number of servers is not limited as in FIG. 1 .

The VR content relay platform server 100 may be provided in an open studio for content creators or influencers and an e-sports competition booth. That is, the VR content relay platform according to an embodiment provides an open studio service capable of producing 360VR images and independent content generated from 3D game contents based on a container platform to activate the VR e-Sports platform for 5G-based 3D game contents. can be used for

In one embodiment, it is a win-win by activating secondary content production in which video content produced by the VR content relay platform and the ideas of content creators/influencers are fused, and by providing another attraction to visitors who visit the experiential booth. You can build a service system.

The VR content relay platform holds e-sports relay events at all times and produces core contents for e-sports such as 3D games, AR/VR spo edutainment content play videos, competitions, and strategy by subject, and famous professional gamers and creators. It can induce continuous content production through collaboration with

The VR content relay platform server 100 may acquire 3D content and capture the 3D content to acquire a plurality of VR images. The VR content relay platform server 100 may extract audio data included in the 3D content and map it to the plurality of VR images to generate VR video data.

The streaming transmission server 110 may receive an audio stream for VR video streaming data, combine the audio stream and the VR video streaming data, and transmit it to the user terminal 130 .

That is, the media server 120 and/or the streaming transmission server 110 according to some embodiments of the present invention transmits 360 VR and relay broadcasting of the 3D game e-sports game being serviced to the user terminal 130, and In order to easily move to regions and event sites, and to install and broadcast within a short period of time, a booth with the same structure and shape as an e-sports real stadium is produced using containers. The manufactured containers allow players to view images of players or in-game games as real-time 3D images on the user terminal 130 .

The user terminal 130 may be a fixed terminal implemented as a computer device or a mobile terminal. Examples of the user terminal 130 include a smart phone, a mobile phone, a navigation system, a computer, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, and the like. For example, the user terminal 130 may communicate with other user terminals and/or the streaming transmission server 110 through a network using a wireless or wired communication method.

The communication method is not limited, and not only a communication method using a communication network (eg, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network may include, but also short-range wireless communication between devices may be included. For example, the network is a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. may include any one or more of the networks of Further, the network may include, but is not limited to, any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, and the like. .

2 is a diagram for explaining the configuration and operation of hardware included in the system for providing a VR content relay platform according to an embodiment of the present invention.

In FIG. 2 , the internal configuration of the VR content relay platform server 100 , the streaming transmission server 110 , and the media server 120 according to an embodiment of the present invention will be described in detail.

In an embodiment, the VR content relay platform server 100, the streaming transmission server 110 and the media server 120 are the memories 101, 111, 121, the processors 102, 112, 122, and the communication modules 103, 113. , 123) and input/output interfaces 104, 114, and 124.

The memories 101 , 111 , and 121 are computer-readable recording media, and may include random access memory (RAM), read only memory (ROM), and permanent mass storage devices such as disk drives. have. In addition, the memories 101 , 111 , and 121 include program codes and settings for controlling the VR content relay platform server 100 , the streaming transmission server 110 and the media server 120 , 3D content, VR image or VR video data. may be temporarily or permanently stored.

The processors 102 , 112 , and 122 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Instructions may be provided to the processor 102 , 112 , 122 by the memory 101 , 111 , 121 or the communication module 103 , 113 , 123 . For example, the processors 102 , 112 , 122 may be configured to execute received instructions according to program codes stored in a recording device such as the memories 101 , 111 , 121 . In an embodiment, the processor 102 of the VR content relay platform providing server 100 acquires 3D content, captures the 3D content to acquire a plurality of VR images, and extracts audio data included in the 3D content to generate VR video data by mapping the plurality of VR images, convert the VR video data into a video streaming format to obtain VR video streaming data, and transmit the VR video streaming data to the streaming transmission server.

The communication modules 103 , 113 , and 123 may provide a function for communicating through a network. For example, a request generated by the processor 102 of the VR content relay platform server 100 according to a program code stored in a recording device such as the memory 101 is controlled by the communication module 103 through the network through the media server ( 120) can be transferred. Conversely, a control signal, command, content, file, etc. provided under the control of the processor 122 of the media server 120 may be received by the VR content relay platform server 100 through the communication module 123 through the network. can For example, a control signal or command received through the communication module 103, 113, 123 may be transmitted to the processor 102, 112, 122 or the memory 101, 111, 121, and contents or files The VR content relay platform server 100 , the streaming transmission server 110 , and the media server 120 may be stored as a storage medium that may further include.

In addition, the communication modules 103 , 113 , and 123 may communicate through a network. Although the communication method is not limited, the network may be a local area wireless network. For example, the network may be a Bluetooth (Bluetooth), BLE (Bluetooth Low Energy), or Wifi communication network.

The input/output interfaces 104 , 114 , and 124 may be means for interfacing with an input/output device. For example, the input device may include a device such as a keyboard or mouse, and the output device may include a device such as a display for displaying a communication session of an application. As another example, the input/output interfaces 104 , 114 , and 124 may be means for an interface with a device in which functions for input and output are integrated into one, such as a touch screen. As a more specific example, when the processor of the user terminal processes the command of the computer program loaded in the memory 211 , the service screen or content configured using the data provided by the streaming transmission server 110 or the media server 120 is displayed. It can be displayed on the display through the input/output interface.

In addition, in other embodiments, the VR content relay platform server 100 , the streaming transmission server 110 , and the media server 120 may include more components than those of FIG. 2 . However, there is no need to clearly show most of the prior art components. For example, the VR content relay platform server 100, the streaming transmission server 110, and the media server 120 may include a battery and a charging device for supplying power to internal components, and among the above-described input/output devices, It may be implemented to include at least a portion or may further include other components such as a transceiver, a global positioning system (GPS) module, various sensors, and a database.

3 is a flowchart of a method for providing a VR content relay platform according to an embodiment of the present invention.

In step S110, the VR content relay platform providing server may acquire 3D content. The VR content relay platform according to an embodiment of the present invention may provide the VR 360 spectating mode in the form of a package and a plug-in to 3D content that does not support the VR 360 spectating mode.

In step S120, the VR content relay platform providing server may acquire a plurality of VR images by capturing the 3D content. The VR content relay platform providing server may acquire the plurality of VR images by capturing 3D content in real time. For example, the VR content relay platform providing server may capture 3D content in real time in VR 360 mode through the provided package and plug-in described above. Also, in an embodiment, the VR content relay platform providing server may acquire the plurality of VR images by capturing 3D content in 360 mono and stereo formats.

In step S130, the VR content relay platform providing server may extract audio data included in the 3D content and map it to the plurality of VR images to generate VR video data. More specifically, the VR content relay platform providing server may generate the VR video data by encoding the plurality of VR images based on audio data included in the 3D content and input data received from the microphone module.

For example, the VR content relay platform providing server can encode VR images captured in real time together with sound and microphone input in 3D content to create a video format. The above-described video format may be, for example, an MP4 format.

In step S140, the VR content relay platform providing server converts the VR video data into a video streaming format to obtain VR video streaming data.

In an embodiment, the VR content relay platform providing server may transmit the VR video data to a media server using Real-Time Messaging Protocol (RTMP) and receive VR video streaming data converted by the media server. In the present embodiment, the media server may convert VR video data into at least one video streaming format of an HLS (HTTP Live Streaming) format and an MPEG-DASH format.

For example, the VR content relay platform providing server can transmit VR 360 video created in MP4 format to the media server through the RTMP protocol. In addition, the VR 360 video in MP4 format transmitted to the media server can be converted into a video streaming format with HLS (HTTP Live Streaming) format and MPEG-DASH format in the media server.

In step S150, the VR content relay platform providing server may transmit the VR video streaming data to the streaming transmission server. In an embodiment, the VR content relay platform providing server may transmit the VR video streaming data to the user terminal. In an embodiment, the streaming transmission server may receive an audio stream for the VR video streaming data, combine the audio stream and the VR video streaming data, and transmit the combined VR video streaming data to a user terminal. For example, the VR content relay platform providing server can transmit the converted video streaming to the user's mobile VR HMD and streaming transmission server such as Youtube through the 5G network.

Hereinafter, an embodiment of a method for providing a VR content relay platform will be described with reference to FIGS. 4 and 5 .

The method of providing a VR content relay platform according to an embodiment of the present invention can use containers to build a movable VR 360 e-sports stadium and provide it to audiences in areas without an e-sports stadium who want to watch e-sports. In this embodiment, the container may include a VR content relay platform server.

Container esports venues will use one container per team for players, allowing them to be added or removed depending on the number of teams. The VR content relay platform server 100 provided in the container for players may configure and provide a hardware system that players can use for game play.

Container booths for moderators and commentators for relaying e-sports events are separately produced and placed together with the players’ container booths so that the audience can watch the game together with the moderators and commentators. The VR content relay platform server 100 provided in the container booth for moderators and commentators can construct an observer system that generates a 3D game observer mode as a 360 VR video stream and sends it to the media server.

The VR content relay platform providing server 100 may acquire a plurality of VR images by capturing a 3D game. The VR content relay platform providing server may acquire a plurality of VR images by capturing 3D content in real time. For example, the VR content relay platform providing server may capture a 3D game in real time in VR 360 mode through the provided package and plug-in described above. In addition, in an embodiment, the VR content relay platform providing server may acquire a plurality of VR images by capturing 3D content in 360 mono and stereo formats.

The real-time video stream transmitted from the VR content relay platform server 100 provided in the container to the outside is a broadcast video stream for transmitting 2D broadcast relay to the streaming transmission server 110 and a VR 360 video stream including 3D content content. There is a VR 360 video stream that is sent to the media server 120 in the cloud or IDC.

In one embodiment, the VR content relay platform server 100 supports the VR 360 spectating mode for 3D content that does not support the VR 360 spectating mode, to capture the 3D content content in real time, and a cubemap to the camera in the 3D content. A shader and an object that create a sequence are added, and the added object can be stored in the physical texture memory area by converting the cubemap sequence into a VR 360 image form of 4K or higher in real time when 3D content is executed.

In this embodiment, the stored texture memory area with a resolution of 4K or higher of the VR content relay platform server 100 is H.264/H. 265 compression codec method, it can be saved in the form of a file after conversion in real time.

The VR content relay platform providing server 100 may extract audio data included in the 3D game and map it to a plurality of VR images to generate VR video data. More specifically, the VR content relay platform providing server may generate VR video data by encoding a plurality of VR images based on audio data included in the 3D content and input data received from the microphone module.

In addition, in the VR content relay platform server 100, the game sound, which is an important element constituting the content in the 3D content, and the comments of the moderator and commentator, which are one of the important elements of the e-sports game, are also stored in the form of a WAV file through a real-time encoding process. . The saved VR 360 video file, the saved game sound, and the WAV file in which the comments of the moderator and narrator are saved can be saved after merging in the form of an MP4 video/audio file.

The VR content relay platform providing server 100 may obtain VR video streaming data by converting the VR video data into a video streaming format. Referring to FIG. 4 , the finally generated video/audio file in MP4 format is transmitted to the media server 120 supporting the RTMP protocol using RTMP (Real-Time Messaging Protocol).

The media server 120 may convert the VR video data into at least one video streaming format of an HTTP Live Streaming (HLS) format and an MPEG-DASH format. The MP4 file stream transmitted to the media server 120 is converted into a real-time live video stream of HLS (HTTP Live Streaming) and MPEG-DASH format in the web server application in the media server to ensure low latency and smooth live viewing, After being stored in the SSD storage device of the media, it is distributed to a cloud-based CDN (Content Delivery Network). Through this, the VR 360 live stream file stored in the SSD of the media server 120 or distributed in the cloud can be viewed by selecting the live game that the audience wants to watch through the VR HMD on the cloud 5G-based mobile device. The VR content relay platform providing server 100 may transmit the VR video streaming data to the streaming transmission server 110 . In addition, referring to FIG. 5 , the media server 120 also stores the video stream in the SSD and distributes the video stream to the cloud CDN, and at the same time distributes the video stream to the streaming transmission server 110 .

On the other hand, those of ordinary skill in the art related to the present embodiment will understand that it can be implemented in a modified form within a range that does not deviate from the essential characteristics of the above description. Therefore, the disclosed methods are to be considered in an illustrative rather than a restrictive sense. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the scope equivalent thereto should be construed as being included in the present invention.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

The software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computer systems, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible from the above description by those skilled in the art. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (17)

obtaining 3D content;
acquiring a plurality of VR images by capturing the 3D content;
extracting audio data included in the 3D content and mapping it with the plurality of VR images to generate VR video data;
converting the VR video data into a video streaming format to obtain VR video streaming data; and
Transmitting the VR video streaming data to a streaming transmission server; Containing,
How to provide a VR content relay platform.
According to claim 1,
The step of transmitting the VR video streaming data to the streaming transmission server,
Further comprising the step of transmitting the VR video streaming data to a user terminal,
How to provide a VR content relay platform.
3. The method of claim 2,
The streaming transmission server,
receiving an audio stream for the VR video streaming data, combining the audio stream and the VR video streaming data and transmitting it to a user terminal,
How to provide a VR content relay platform.
According to claim 1,
The step of acquiring the plurality of VR images includes:
Comprising the step of capturing the 3D content in real time to obtain the plurality of VR images,
How to provide a VR content relay platform.
5. The method of claim 4,
The step of acquiring the plurality of VR images includes:
capturing the 3D content in 360 mono and stereo formats to obtain the plurality of VR images,
How to provide a VR content relay platform.
According to claim 1,
The generating of the VR video data includes:
Encoding the plurality of VR images based on audio data included in the 3D content and input data received from a microphone module to generate the VR video data,
How to provide a VR content relay platform.
According to claim 1,
Acquiring the VR video streaming data comprises:
Transmitting the VR video data to a media server using Real-Time Messaging Protocol (RTMP), and receiving VR video streaming data converted by the media server,
How to provide a VR content relay platform.
8. The method of claim 7,
The media server,
Converting the VR video data into at least one video streaming format of HLS (HTTP Live Streaming) format and MPEG-DASH format,
How to provide a VR content relay platform.
streaming transmission server; and
VR content relay platform providing server; including,
The VR content relay platform providing server,
processor; including,
The processor is
Obtaining 3D content, capturing the 3D content to obtain a plurality of VR images, extracting audio data included in the 3D content and mapping it with the plurality of VR images to generate VR video data, and generating VR video data converting to a video streaming format to obtain VR video streaming data, and transmitting the VR video streaming data to the streaming transmission server,
VR content relay platform providing system.
10. The method of claim 9,
User terminal; further comprising,
The streaming transmission server;
transmitting the VR video streaming data to the user terminal,
VR content relay platform providing system.
11. The method of claim 10,
The streaming transmission server,
receiving an audio stream for the VR video streaming data, combining the audio stream and the VR video streaming data and transmitting it to a user terminal,
VR content relay platform providing system.
10. The method of claim 9,
The processor is
capturing the 3D content in real time to obtain the plurality of VR images,
VR content relay platform providing system.
13. The method of claim 12,
The processor is
Capturing the 3D content in 360 mono and stereo format to obtain the plurality of VR images,
VR content relay platform providing system.
10. The method of claim 9,
The processor is
Encoding the plurality of VR images based on audio data included in the 3D content and input data received from a microphone module to generate the VR video data,
VR content relay platform providing system.
10. The method of claim 9,
Media server; further comprising,
The processor is
Transmitting the VR video data to the media server using RTMP (Real-Time Messaging Protocol), and receiving VR video streaming data converted by the media server,
VR content relay platform providing system.
16. The method of claim 15,
The media server,
Converting the VR video data into at least one video streaming format of HLS (HTTP Live Streaming) format and MPEG-DASH format,
VR content relay platform providing system.
A computer program stored in a recording medium for executing the method of any one of claims 1 to 8 using a computer.

Images