KR101764063B1 - Method and system for analyzing and pre-rendering of virtual reality content - Google Patents

Abstract

A method and system for analyzing and pre-rendering VR content are disclosed. A method implemented by a computer includes a step of generating a plurality of rendering units rendered by converting content of a plurality of viewpoints into a polyhedron with regard to virtual reality (VR) content; and a step of analyzing a request size by collecting user data about consumption of a corresponding rendering unit for each of the rendering units with respect to the VR content. Therefore, it is possible to accumulate and utilize the user data when streaming only a field of view area (FOV) of the VR content.

Description

[0001] METHOD AND SYSTEM FOR ANALYZING AND PRE-RENDERING OF VIRTUAL REALITY CONTENT [0002]

The following description relates to a technology for accumulating and utilizing user data for VR (virtual reality) contents.

As interest in VR (virtual reality) has increased, interest in VR content has also increased.

The VR content is a panorama image of 360 degree panorama, and stereoscopic viewing that can not be provided by the existing video is possible, and the user can select a desired direction at 360 degrees in all directions, not depending on the specific viewpoint of the photographer.

Korean Patent No. 10-0653200 (registered on Nov. 27, 2006) discloses a technology for rendering a panoramic image using geometric information about tilting and warping. .

A method and system for storing and utilizing user data in a process of streaming only a field of view (FOV) of a user to VR content is provided.

A method and system for effectively analyzing VR content to accumulate user data for VR content.

A method and system for accurately storing user data for an object by adjusting a size of a rendering unit in consideration of a main object are provided.

A computer-implemented method, comprising: generating a plurality of rendering units in which a plurality of contents at a plurality of viewpoints are transformed into a polyhedron by rendering virtual reality (VR) contents; And analyzing the request size by collecting user data that consumes a corresponding rendering unit for each of the rendering units for the VR content.

According to an aspect of the present invention, the generating step may convert the VR contents into a pyramid format to generate a rendered rendering unit.

According to another aspect, the generating step may generate the rendering unit by projecting spherical contents onto a plane constituting a pyramid.

According to another aspect, the generating step may determine at least one of resolution, shape, and size of the rendering unit according to an object recognition result through object recognition in an image.

According to another aspect of the present invention, the generating step may generate the rendering unit in a form or size that does not truncate a corresponding object at a time when a specific object is included through recognition of an object in the image.

According to another aspect, the method may further include providing a rendering unit corresponding to a field of view (FOV) of the user terminal among the plurality of rendering units, It is possible to analyze the request size of the rendering unit by accumulating the number of times or times provided to the rendering unit.

According to another aspect, the analyzing may include accumulating the user data by matching with the profile information of the user.

According to another aspect, the method may further include calculating a rank of the rendering unit using the request scale for each rendering unit.

According to another aspect, the method may further include determining a rendering unit to be targeted in the VR content using the request scale for each rendering unit.

According to another aspect, the method may further include determining a rendering unit to provide the VR content to a requesting user terminal using the request scale for each rendering unit, or determining a rendering unit to expose the advertisement.

According to another aspect of the present invention, the method may further include determining a resolution of the rendering unit using the request scale for each rendering unit.

According to another aspect of the present invention, there is provided an image processing method comprising the steps of: And analyzing the popularity tag by matching the request size of the rendering unit with the tag of the corresponding area.

A computer program stored in a computer-readable medium for executing a virtual reality (VR) content analysis method, the method comprising the steps of: converting a plurality of contents at a plurality of viewpoints into a polyhedron Generating a plurality of rendering units; And analyzing a request scale by collecting user data that consumes a corresponding rendering unit for each of the rendering units with respect to the VR content. The present invention provides a computer program stored in a computer-readable medium.

A computer-implemented system, comprising: a content manager for generating and maintaining a plurality of rendering units rendered by rendering a plurality of viewpoints of a plurality of viewpoints into a polyhedron with respect to virtual reality (VR) content; And a content analyzer for collecting user data consuming a rendering unit for each of the rendering units and analyzing a request size for the VR content.

According to embodiments of the present invention, in the course of streaming only the field of view (FOV) area of the VR content, user data related to content consumption can be accumulated to utilize the accumulated user data in various forms.

According to embodiments of the present invention, user data on VR content can be accumulated effectively by analyzing VR content using an analysis technique based on a pre-tagging image.

According to embodiments of the present invention, the size of the rendering unit of the VR content is adjusted in consideration of the main object, so that the user data for the object can be accumulated more accurately. In addition, adaptive streaming environment such as data capacity and network environment can be provided by adjusting the rendering size based on an object, and content can be serviced without truncation of objects, thereby improving user service satisfaction have.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
2 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention.
FIGS. 3 to 7 are exemplary diagrams illustrating a process of converting spherical VR content into a polyhedron in accordance with an embodiment of the present invention.
FIG. 8 is a diagram illustrating an example of a component that a processor of a server according to an embodiment of the present invention may include.
FIG. 9 illustrates an example of a process of managing VR content by a server according to an embodiment of the present invention. Referring to FIG.
10 is an exemplary diagram for explaining contents rendered in a pyramid shape in an embodiment of the present invention.
11 to 12 illustrate examples of a process of analyzing VR contents and utilizing analysis results according to a method that can be performed by a server according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. 1 shows an example in which a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170 are included. 1, the number of electronic devices and the number of servers are not limited to those shown in FIG.

The plurality of electronic devices 110, 120, 130, 140 may be a fixed terminal implemented as a computer device or a mobile terminal. A display device such as a head mounted display (HMD), a virtual reality (VR) player, a smart phone, a cellular phone, a TV, a navigation device, A computer, a notebook, a terminal for digital broadcasting, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and a tablet PC. For example, the electronic device 1 110 may communicate with other electronic devices 120, 130, 140 and / or the servers 150, 160 via the network 170 using a wireless or wired communication scheme.

The communication method is not limited, and may include a communication method using a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 may include, as well as a short-range wireless communication between the devices. For example, the network 170 may be a personal area network (LAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN) , A content delivery network (CDN), a network such as the Internet, and the like. The network 170 may also include any one or more of a network topology including a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network, It is not limited.

Each of the servers 150 and 160 is a computer device or a plurality of computers that communicate with a plurality of electronic devices 110, 120, 130 and 140 through a network 170 to provide commands, codes, files, Lt; / RTI > devices.

In one example, the server 160 may provide a file for installation of the application to the electronic device 1 (110) connected via the network 170. [ In this case, the electronic device 1 (110) can install an application using a file provided from the server (160). The server 150 is connected to the server 150 in accordance with an operating system (OS) included in the electronic device 1 110 or under control of at least one program (for example, a browser or an installed application) I can receive contents. For example, when the electronic device 1 (110) transmits a service request message to the server 150 via the network 170 under the control of the application, the server 150 transmits a code corresponding to the service request message to the electronic device 1 The first electronic device 110 can provide contents to the user by displaying and displaying a screen according to the code according to the control of the application.

2 is a block diagram illustrating an internal configuration of an electronic device and a server according to an embodiment of the present invention. In FIG. 2, an internal configuration of the electronic device 1 (110) as an example of one electronic device and the server 150 as an example of one server will be described. Other electronic devices 120, 130, 140 or server 160 may have the same or similar internal configurations.

The electronic device 1 110 and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223 and input / output interfaces 214 and 224. The memories 211 and 221 may be a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), and a disk drive. The memory 211 or 221 may store an operating system or at least one program code (for example, a code for a browser or an application installed and operated in the electronic device 110). These software components may be loaded from a computer readable recording medium separate from the memories 211 and 221. [ Such a computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, and a memory card.

Processors 212 and 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212 and 222 by the memories 211 and 221 or the communication modules 213 and 223. For example, the processor 212, 222 may be configured to execute a command received in accordance with a program code stored in a recording device, such as the memory 211, 221.

The communication modules 213 and 223 may provide functions for the electronic device 1 110 and the server 150 to communicate with each other through the network 170 and may provide functions for communicating with other electronic devices (for example, the electronic device 2 120) Or to communicate with another server (e.g., server 160).

The input / output interfaces 214 and 224 may be means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard or a mouse, and the output device may include a device such as a display for displaying a communication session of the application. As another example, the input / output interface 214 may be a means for interfacing with a device having integrated functions for input and output, such as a touch screen. More specifically, the processor 212 of the electronic device 1 (110) uses the data provided by the server 150 or the electronic device 2 (120) in processing commands of the computer program loaded in the memory 211 A service screen or contents can be displayed on the display through the input / output interface 214. [

Also, in other embodiments, electronic device 1 110 and server 150 may include more components than the components of FIG. However, there is no need to clearly illustrate most prior art components. For example, electronic device 1 110 may be implemented to include at least a portion of input / output devices 215 described above, or may be implemented with other components such as a transceiver, Global Positioning System (GPS) module, camera, Elements. More specifically, when the electronic device 1 (110) is a VR player, an accelerometer, a magnetic sensor, a gyro sensor, a camera, various physical buttons, buttons using a touch panel, input / output ports, It is understood that various components such as a vibrator and the like may be further included in the electronic device 1 (110).

Embodiments of the present invention relate to a technique for accumulating and utilizing user data for VR content, which is a service field for providing services using VR content such as a video service, a broadcast service, a virtual experience environment, And the like.

Embodiments, including those specifically disclosed herein, can accumulate and utilize user data for VR content, thereby achieving significant advantages in terms of efficiency, convenience, cost savings, and the like.

In the present specification, the VR content may be a panoramic image that is photographed at a plurality of angles at one position and can be viewed in a wider direction than a general image. The VR content may include panoramic images photographed or manufactured in a spherical or cylindrical shape with an image of an omnidirectional 360 degree viewpoint. The VR content may be stitched by stitching two or more images as well as a panorama, It can be applied in all cases.

Rendering VR content to spherical requires more cost (network, data storage, etc.) than regular video. However, if the dynamic streaming technique of converting 360 degree spherical VR contents into polyhedrons such as pyramids or cubes is used, it is possible to provide a user experience similar to the spherical shape .

In the present specification, a rendering unit may refer to a content unit that converts spherical or cylindrical VR content into a polyhedral shape (e.g., a pyramid, etc.) for rendering.

A plurality of rendering units are created in advance for the spherical VR contents, and for example, a pyramid in which an image is reproduced is prepared in advance at various points of time, and a pyramid corresponding to a time point requested by the user according to user head tracking is prepared. Can be provided. Using the result of user request by pyramid, which is a rendering unit, can be utilized for various VR content analysis and rendering.

The present invention provides a method and system for analyzing VR content and content pre-rendering according to a result of a user request for each rendering unit.

First, a process of converting spherical VR contents into a pyramid shape and rendering it will be described. Hereinafter, the pyramid is described as a representative example of the rendering unit, but the present invention is not limited thereto, and all polyhedral shapes capable of reducing data cost can be applied.

The spherical VR contents can be represented by a spherical coordinate system, and a spherical coordinate system is shown in FIG. Referring to Fig. 3, the spherical coordinate system can be expressed by (rho, [theta], [phi]) (rho = r in FIG. Here, ρ ≥ 0, 0 ≤ ≤ π, 0 ≤ φ ≤ 2π.

The pyramid shape to convert the spherical VR contents can be represented by an orthogonal coordinate system, and the orthogonal coordinate system representing the pyramid is shown in Fig. In this implementation, the top vertex and the square portion of the pyramid can be constructed as shown in FIG. 4 so as to meet the sphere (ρ = 1) in order to simplify the formula.

Referring to FIG. 4, the FOV of a user corresponds to a rectangular portion of the pyramid, and is defined as y = 1, which is defined as 'Front'. Then, the height of the pyramid becomes y = 2.

The front, left, and right sides of the pyramid each contain the following areas:

And the top and bottom of the pyramid can be divided as follows:

이다.At this time, since it is a unit sphere,

to be.

The pyramid encoding of the spherical VR contents is a process of laying out spherical images in a pyramid. An example of a pyramid encoding process is as follows.

1. Convert the sphere of the spherical coordinate system around the origin to the pyramid of the rectangular coordinate system by projecting them on the {Left | Right} - {Top | Bottom} plane respectively (spherical-pyramid transformation).

(1) Left-Top

The left-top plane of the Cartesian coordinate system that meets the pyramid can be summarized as follows.

: When there are three points A (1, 1, 0), B (0,1,1), C (0,1,0) , 0) is equal to {AB x AC = (2, -1, 2)}.

: 2x-y + 2z + d = 0, that is, d = -1 when the plane ax + ay + cz + d = 0 with the normal vector AB x AC is equal to d = The plane equation is equal to {2x - y + 2z - 1 = 0}.

일 때, Left-Top 평면에 투영하는

를 유도할 수 있다.-

Projected on the Left-Top plane

Lt; / RTI >

를 대입한 뒤

로 정리하면

와 같다.: 2x - y + 2z - 1 = 0

After substituting

In summary,

.

를 사용하여 Left-Top 평면에 맺혀있는 x', y', z'를 다시 계산하면 해당 영역의 투영 결과를 얻을 수 있다.-

, We can obtain the projection result of the area by recalculating x ', y', z 'which are concatenated on the Left-Top plane.

(2) Front-Top

영역을 Front 평면(y=1)에 투영하여 x', y', z'를 계산한다.-

The area is projected onto the Front plane (y = 1) to calculate x ', y', z '.

:

일 경우 Left-Top에 투영해야 한다.- However, if you leave the bottom area of the pyramid

, It should be projected on the Left-Top.

(3) Pyramids can be generated from spheres by applying the same method to the front-bottom, left-bottom, right-bottom, and right-top planes.

2. {Left | Right} - {Top | Bottom} is projected onto the Front plane, and then each area is transformed into a method of symmetry in the corner direction of the square (pyramid-rectangle transformation).

(1) Left-Top

- Project the left-top plane of the pyramid onto the y = 1 plane (see FIG. 5).

(X ', y') (see FIG. 6) by performing a symmetry operation on the z = 1 - x straight line when A (x, y) is present.

: x '= ((1 - a ^ 2) x + 2 ay - 2 ab) / (1 + a ^ 2)

: y '= (2ax - (1-a ^ 2) y + 2b) / (1 + a ^ 2)

(2) For the Left-Bottom, Right-Bottom, and Right-Top planes, a rectangle is generated in the same manner as above, and finally, Front is projected (see FIG.

(3) Thus, by converting the pyramid generated from the sphere into a rectangle, the pyramid can be unfolded into an area visible to the user.

3. Bilinear interpolation.

In the method of converting an input image of a spherical shape into an output image of a pyramid shape, since the pixels are not matched one-to-one, the method of symmetric operation used in the pyramidal- Function can be solved by deriving an inverse function and using it to obtain pixels from the input image based on the coordinates of the output image. By applying the bilinear interpolation method based on the coordinates of the input image, a high quality image can be obtained .

The server 150 can create the spherical VR contents in a pyramid-like rendering unit according to the viewpoint using the above-described principle. When the user selects the first electronic device 110 (e.g., an HMD or a VR player) It is possible to stream the rendered pyramid at the user's point of view.

Hereinafter, a method and system for accumulating and utilizing user data for VR content in a dynamic streaming process of converting and rendering spherical VR content into a pyramid format will be described.

FIG. 8 is a diagram illustrating an example of a component that a server processor according to an exemplary embodiment of the present invention may include; FIGS. 9, 11, and 12 are views Fig. 2 is a flow chart showing an example of a method that can be performed.

As shown in FIG. 8, the processor 222 of the server 150 may include a content management unit 810, a content analysis unit 820, and a content providing unit 830 as components. These components of processor 222 and processor 222 may control server 150 to perform the steps involved in the method of Figures 9, 11 and 12. At this time, the components of the processor 222 and the processor 222 may be implemented to execute instructions according to the code of the operating system and the code of at least one program that the memory 221 contains. In addition, components of processor 222 may be representations of different functions performed by processor 222 in accordance with control commands provided by the operating system or by at least one program. For example, the content management unit 810 may be used as a functional representation in which the processor 222 manages the VR content according to the control command described above.

9 and 11 and 12 may not occur in the order shown and some of the steps may be omitted or further steps may be included.

FIG. 9 shows an example of a process of managing VR contents according to an embodiment of the present invention.

In step S910, the content management unit 810 may register the VR content produced in a spherical or cylindrical shape. For example, a content provider (CP) or a user can upload a 360-degree image of an equirectangular layout to the server 150, and the content management unit 810 uploads the uploaded 360- 150).

In operation S920, the content management unit 810 may generate a plurality of rendering units in which the contents at different viewpoints are converted into polygons, for example, pyramid shapes, for the VR contents registered on the server 150 . The content management unit 810 can generate a plurality of rendering units having a plurality of view points for spherical VR contents using the pyramid encoding method described above with reference to FIGS.

For example, the content management unit 810 may divide the resolution of the VR content into a plurality of steps in advance, and may generate a plurality of rendering units having different viewpoints for each resolution step. For example, it is possible to generate 150 images having different resolutions or views for one VR content by creating 30 pyramids having different resolutions at predetermined resolutions by setting five resolutions in advance.

As another example, in generating a plurality of rendering units having different viewpoints, the content managing unit 810 may determine at least one of resolution, shape, and size of the rendering unit according to the recognition result through object recognition in the image. For example, if a weight is assigned to each object in the image or if there is a predetermined main object, the main object can be identified through object recognition, and the pyramid corresponding to the time when the main object is included can be classified into a size . Changing the size and shape of the pyramid can be implemented by the principle of pyramid encoding as described above with reference to Figures 3-7. In addition, a pyramid in which a main subject (such as a subject judged as a size and a semantic) is arranged can be rendered with high image quality in comparison with a pyramid in which other subjects are arranged. In addition, according to the object recognition result, a pyramid having a low importance can be made into a pyramid having a low quality, thereby reducing data cost. For example, the resolution can be determined by dividing the importance of each pyramid in consideration of the importance and the number of objects included in the corresponding region. Accordingly, in generating a plurality of rendering units having different viewpoints for one VR content, rendering units can be rendered differently according to rendering units, and resolution, size, and shape can be optimized according to the importance of the space.

In step S930, when a streaming service for VR content is requested by a user terminal (for example, the electronic device 1 110 or the like), the content provider 830 selects a user It is possible to provide a rendering unit at a time corresponding to the FOV of the terminal. Rather than real-time encoding the VR content in response to a user's request, the pre-rendered pyramid can be streamed at a time of pre-generated video, that is, at the time of user's request. The content providing unit 830 provides a pyramid read corresponding to the user's point of view among the rendering units prepared in advance for the corresponding VR content while tracking the user's point of view in the course of consuming the VR content (for example, head tracking) can do.

In this way, when a view-dependent adaptive bit rate streaming that adaptively provides content at a user's point of view is applied, when a user moves the perspective, a new pyramid is provided that uses the corresponding face as a viewport . In particular, the pyramid applied as a rendering unit in the present invention has a region other than the viewport 1001 due to the geometric structure of the pyramid, as shown in FIG. 10, so that even if the pyramid fails to fetch a new pyramid according to the network conditions, The FOV can not be seen, and the satisfaction of the user can be improved. However, unlike the hexahedron which processes all faces equally, the polyhedron applicable to the rendering unit has a full-resolution FOV. However, in the case of the pyramid shape, only the portion corresponding to the viewport supports the full resolution, The image quality of the image is gradually reduced toward the direction, which can be more effective in cost reduction.

11 illustrates an example of a process of analyzing VR contents and utilizing analysis results in an embodiment of the present invention.

In step S1110, the content analyzer 820 may analyze the request size by collecting user data that consumes the corresponding area for each rendering unit of the VR content. In this specification, the request scale may mean an index indicating the popularity of the user response. For example, the content analyzer 820 may accumulate the number of times provided to the user for each of the rendering units, and analyze the request scale for each rendering unit. In other words, the content analyzing unit 820 can grasp the number of times, the viewpoint, the consumption time, etc. requested by the individual rendering unit as the user data, and store the user data of the user in the profile information (e.g., sex, And so on).

In step S1120, the content analyzing unit 820 may calculate the ranking of the rendering unit using the request scale for each rendering unit with respect to the VR content. In other words, the content analyzing unit 820 can calculate the rendering unit request ranking and the like through the analysis result of the VR content.

In step S1130, the content providing unit 830 may utilize the ranking of the rendering unit in the service providing environment for the VR content. For example, the content providing unit 830 may use the ranking of the rendering unit to determine a service target. For example, when the user requests the streaming service for the VR content, the content providing unit 830 may provide the most popular rendering unit by users having the same sex or age as the user. In addition, the content providing unit 830 may expose the advertisement to the most popular rendering unit among the rendering units of the content in the process of providing the VR content to the user. As another example, the content providing unit 830 may use the ranking of the rendering unit to determine the resolution of each rendering unit. The content providing unit 830 can transmit the ranking of the rendering unit to the content managing unit 810 with respect to the VR content, and the content managing unit 810 can adjust and maintain the resolution of each rendering unit according to the ranking of the rendering unit. For example, a higher-level rendering unit applies a higher resolution, and a lower-order rendering unit has a lower resolution.

The content providing unit 830 can adaptively control the content quality of each rendering unit by grasping the request log in real time for each rendering unit with respect to the VR content. A rendering unit with a low request by a user or a rendering unit with a short consumption time (e.g., a scene in which a user's gaze does not stay for a long time, etc.) applies a basic low-quality rendering, . When a user stays in a specific rendering unit for a long time, the quality of the rendering unit can be continuously (or stepwise) increased to the highest level and rendered. The content providing unit 830 can also adjust the image quality by grasping the request log in real time for each side of the rendering unit.

In addition, the server 150 may calculate the ranking of the rendering unit using the result of analyzing the document on the web or the SNS related to the VR content, and may prepare the rendering unit in advance by dividing the resolution according to the ranking. For example, in the case of a video in which a singer girl group appears, it is determined by a web / SNS analysis that a certain person is the most popular member, and the pyramid including the person is the highest image quality, The pyramid is the intermediate image quality, and background and other areas can be rendered with the lowest image quality.

FIG. 12 illustrates another example of a process of analyzing VR contents and utilizing analysis results in an embodiment of the present invention.

In step S12100, the content management unit 810 may generate a plurality of rendering units in which content at different viewpoints are converted into polygons, for example, a pyramid shape, and rendered on the VR contents registered on the server 150 . The content management unit 810 may generate a plurality of rendering units having different viewpoints of spherical VR contents using the pyramid encoding method described above with reference to FIGS.

In step S1220, the content management unit 810 may tag information related to the corresponding region in units of rendering units for the VR content. For example, the content management unit 810 can automatically tag major objects, characters, events, and the like of the corresponding region in each of the rendering units.

In operation S1230, the content analyzer 820 may analyze the request size by collecting user data on a VR content basis for each rendering unit. In this specification, the request scale may mean an index indicating the popularity of the user response. For example, the content analyzer 820 may accumulate the number of times provided to the user for each of the rendering units, and analyze the request scale for each rendering unit. In other words, the content analyzing unit 820 can grasp the number of times, the time and the consumption time requested for the individual rendering units, and stores the user data in association with the profile information (for example, sex, And can be accumulated and matched.

In operation S 1240, the content analyzer 820 may analyze the popularity tag by matching the request size and the tag with respect to the VR content by the rendering unit. The content analyzing unit 820 can analyze the popularity tag according to the request scale for the tag set in the VR content by correlating the request scale analysis result for each of the rendering units with the tag of the rendering unit and calculate the tag ranking. Therefore, it is possible to analyze the size of the request by accumulating the user data on the pre-tagging image, and analyze the popularity tag based on the result of the request analysis. At this time, the tag ranking according to the popularity tag or the request scale can be utilized in related services such as recommendation and search of VR contents or rendering units in the contents.

As described above, according to the embodiments of the present invention, in the course of streaming only the field of view (FOV) area of the VR content, the accumulated user data can be utilized in various forms by accumulating user data related to content consumption. According to embodiments of the present invention, user data for VR content can be accumulated effectively by analyzing VR content using an analysis technique based on a pre-tagging image. In addition, according to embodiments of the present invention, user data for an object can be accumulated more accurately by adjusting the size of a rendering unit of VR contents in consideration of a main object. Adaptive streaming environment such as data capacity and network environment can be provided by adjusting the rendering size based on the object, and content can be serviced without truncation of the object, thereby improving the service satisfaction of the user.

The apparatus described above may be implemented as a hardware component, a software component, and / or a combination of hardware components and software components. For example, the apparatus and components described in the embodiments may be implemented as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit, a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For ease of understanding, the processing apparatus may be described as being used singly, but those skilled in the art will recognize that the processing apparatus may have a plurality of processing elements and / As shown in FIG. For example, the processing unit may comprise a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of the foregoing, and may be configured to configure the processing device to operate as desired or to process it collectively or collectively Device can be commanded. The software and / or data may be embodied in any type of machine, component, physical device, computer storage media, or device for interpretation by a processing device or to provide instructions or data to the processing device have. The software may be distributed over a networked computer system and stored or executed in a distributed manner. The software and data may be stored on one or more computer readable recording media.

The method according to an embodiment may be implemented in the form of a program command that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions to be recorded on the medium may be those specially designed and configured for the embodiments or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. For example, it is to be understood that the techniques described may be performed in a different order than the described methods, and / or that components of the described systems, structures, devices, circuits, Lt; / RTI > or equivalents, even if it is replaced or replaced.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (20)

In a computer implemented method,
Generating and maintaining a plurality of rendering units rendered by rendering a plurality of viewpoint contents into a polyhedron with respect to virtual reality (VR) contents; And
Collecting user data consuming a corresponding rendering unit for each of the rendering units for the VR content, and analyzing the request size
Lt; / RTI >
Wherein the generating and maintaining comprises:
Generating a plurality of rendering units having different viewpoints for the VR content, rendering the rendered content by converting the content of the corresponding point of view into a polyhedron at each viewpoint,
≪ / RTI > The method according to claim 1,
Wherein the generating and maintaining comprises:
Generating a rendering unit in which the VR contents are converted into a pyramid shape and rendered;
≪ / RTI > The method according to claim 1,
Wherein the generating and maintaining comprises:
A step of generating the rendering unit by projecting spherical contents onto a plane constituting a pyramid
≪ / RTI > The method according to claim 1,
Wherein the generating and maintaining comprises:
Determining at least one of resolution, shape, and size of the rendering unit according to an object recognition result through object recognition in a video
≪ / RTI > The method according to claim 1,
Wherein the generating and maintaining comprises:
Generating the rendering unit in a form or size such that the object is not truncated with respect to a time when a specific object is included through recognition of an object in the image
≪ / RTI > The method according to claim 1,
Providing a rendering unit corresponding to a field of view (FOV) of the user terminal among the plurality of rendering units
Further comprising:
Wherein the analyzing comprises:
And accumulating the number of times or times provided to users for each of the rendering units and analyzing the request size of the rendering unit
≪ / RTI > The method according to claim 1,
Wherein the analyzing comprises:
Accumulating the user data by matching with the profile information of the user
≪ / RTI > The method according to claim 1,
Calculating a rank of the rendering unit using the request scale for each rendering unit
≪ / RTI > The method according to claim 1,
Determining a rendering unit to be targeted in the VR content using the request scale for each rendering unit
≪ / RTI > The method according to claim 1,
Determining a rendering unit to provide the VR content to the requesting user terminal using the request scale for each rendering unit, or determining a rendering unit to expose the advertisement
≪ / RTI > The method according to claim 1,
Determining a resolution of the rendering unit using the request scale for each rendering unit
≪ / RTI > The method according to claim 1,
Tagging information related to a corresponding region in each rendering unit; And
Analyzing the popularity tag by matching the request size of each rendering unit with the tag of the corresponding region
≪ / RTI > A computer program stored in a computer readable medium for executing a virtual reality (VR) content analysis method,
The VR contents analyzing method includes:
Generating and maintaining a plurality of rendering units rendered by rendering a plurality of viewpoint contents converted into a polyhedron with respect to VR contents; And
Collecting user data consuming a corresponding rendering unit for each of the rendering units for the VR content, and analyzing the request size
Lt; / RTI >
Wherein the generating and maintaining comprises:
Generating a plurality of rendering units having different viewpoints for the VR content, rendering the rendered content by converting the content of the corresponding point of view into a polyhedron at each viewpoint,
A computer program stored on a computer readable medium. In a computer implemented system,
A content management unit for previously generating and maintaining a plurality of rendering units rendered by rendering content of a plurality of viewpoints into a polyhedron with respect to virtual reality (VR) contents; And
A content analyzing unit for collecting user data consuming a corresponding rendering unit for each of the rendering units for the VR content and analyzing a request size,
Lt; / RTI >
The content management unit,
A plurality of rendering units having different viewpoints for the VR content are generated, and rendering units rendered by rendering the contents at a corresponding point in time are converted into polyhedrons
Lt; / RTI > 15. The method of claim 14,
The content management unit,
The VR contents are converted into a pyramid form to generate a rendered rendering unit
Lt; / RTI > 15. The method of claim 14,
The content management unit,
Determining at least one of resolution, shape, and size of the rendering unit according to an object recognition result through object recognition in an image
Lt; / RTI > 15. The method of claim 14,
A content providing unit for providing a rendering unit corresponding to a field of view (FOV) of the user terminal among the plurality of rendering units;
Further comprising:
Wherein the content analyzer comprises:
And accumulating the number of times or times provided to users for each of the rendering units and analyzing the request size of the rendering unit
Lt; / RTI > 15. The method of claim 14,
A content providing unit for providing a rendering unit corresponding to a field of view (FOV) of the user terminal among the plurality of rendering units;
Further comprising:
The content providing apparatus,
Determining a rendering unit to provide the VR content to a requesting user terminal using the request scale for each rendering unit, or determining a rendering unit to expose the advertisement
Lt; / RTI > 15. The method of claim 14,
The content management unit,
And determining a resolution of the rendering unit using the request scale for each rendering unit
Lt; / RTI > 15. The method of claim 14,
The content management unit,
Tagging information related to a corresponding region in each rendering unit,
Wherein the content analyzer comprises:
And analyzing the popular tag by matching the request size of each rendering unit with the tag of the corresponding area
Lt; / RTI >

Images