KR20190066892A - Method for providing virtual reality service, device and server - Google Patents

Abstract

A method for providing a virtual reality experience service in a real space including a plurality of pre-configured moving paths may comprise the steps of: receiving, from each photographing apparatus positioned in each moving path, a 360 ° photographed image, photographing information, and moving path information collected at each of a plurality of photographing points in the moving paths; generating a virtual reality (VR) image of each photographing point based on the photographing information and moving path information and using the 360 ° photographed image collected at each photographing point; generating a virtual space corresponding to the real space, on the basis of the plurality pieces of photographing information collected at each moving path; creating, for each moving path, VR content for each moving path; and providing the VR content for each moving path to a user terminal.

Description

METHOD FOR PROVIDING VIRTUAL REALITY SERVICE, DEVICE AND SERVER,

The present invention relates to a method, a terminal and a server for providing a virtual reality experience service.

A virtual reality experience service using virtual reality (VR) technology is evolving from a service where a user experiences a virtual reality at a fixed position of a real space,

In a conventional service for experiencing a plurality of VR spaces, when a screen is switched from a VR space to a different space, a method in which an image for the first space is artificially changed to an image for the second space A method in which a user who is experiencing a space moves from the first space to the second space in an instant and experiences the second space). This has led to a problem that screen switching is not smooth.

Korean Patent Laid-Open Publication No. 2015-0011705 discloses a configuration in which a camera is moved in accordance with a photographing guide to take a panoramic image including a moving path of an object and display the photographed panoramic images in a time sequence according to the moving path of the object Lt; / RTI >

A virtual space corresponding to the real space is created by using the shooting information of the image photographed in a predetermined plurality of movement paths of the real space, and VR contents are generated for each movement path for each movement path, Content. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to a first aspect of the present invention, there is provided a method for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths, Receiving a 360 ° photographed image, photographing information, and movement route information at each of a plurality of photographing points from a photographing apparatus; Generating a VR (Vritual Reality) image at each photographing point using a 360 ° photographing image at each photographing point based on the photographing information and the movement route information; Creating a virtual space corresponding to the real space based on a plurality of pieces of photographing information in each movement path; Generating VR contents for each movement route for each movement route; And providing the VR content for each route to the user terminal.

A user terminal for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths according to the second aspect of the present invention includes a movement path selection unit for selecting one of a plurality of movement paths; A location information providing unit for monitoring location information of a user terminal and transmitting the monitored location information to a server; And a VR content output unit for receiving VR content for the selected one movement route based on the location information from the server and outputting the VR content, wherein the VR content includes VR (Vritual) Reality) image, and the VR image may be generated using a 360 ° photographed image at each photographing point based on photographing information and movement route information at each of the plurality of photographing points.

A virtual reality experience service providing server for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths according to the third aspect of the present invention is characterized in that the virtual reality experience service providing server for each of the plurality of travel paths A receiving unit for receiving a 360 ° photographed image, photographing information, and moving route information from a photographing apparatus; A VR image generating unit for generating a VR (Vritual Reality) image at each photographing point using a 360 ° photographing image at each photographing point based on the photographing information and the movement route information; A virtual space generation unit for generating a virtual space corresponding to the real space based on a plurality of pieces of photographing information in each movement path; A VR content generation unit for generating VR contents for each movement route for each movement route; And a VR content providing unit for providing the VR content for each route to the user terminal.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-mentioned objects of the present invention, a virtual space corresponding to a real space is created using shooting information of an image photographed in a predetermined plurality of movement paths of the real space, and moving It is possible to provide the VR content for each route by generating the VR content for each route. In addition, since the FOV of the VR contents is changed in real time according to the movement path selected by the user, the user can feel the moving in the continuous space.

1 is a configuration diagram of a virtual reality experience system according to an embodiment of the present invention.
2 is a block diagram of a virtual reality experience service providing server shown in FIG. 1 according to an embodiment of the present invention.
3A and 3B are views for explaining a 360 ° photographed image according to an embodiment of the present invention.
4A and 4B are views for explaining six degrees of freedom (6 DOF) information according to an embodiment of the present invention.
5A to 5B are diagrams for explaining a method of creating a virtual space according to an embodiment of the present invention.
6 is a diagram illustrating a VR image mapped to each node according to an embodiment of the present invention.
7 is a flowchart illustrating a method for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths, according to an embodiment of the present invention.
8 is a flowchart illustrating a method of generating a VR image at each photographing point, according to an embodiment of the present invention.
9 is a flowchart illustrating a method of creating a virtual space according to an embodiment of the present invention.
10 is an operational flowchart illustrating a method of providing a virtual reality experience service through a real space including a predetermined plurality of movement paths, according to an embodiment of the present invention.
Figure 11 is a block diagram of the user terminal shown in Figure 1, in accordance with one embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a configuration diagram of a virtual reality experience system according to an embodiment of the present invention. Referring to FIG. 1, the virtual reality experience system may include a virtual reality experience service providing server 100 and a user terminal 110. However, since the virtual reality experience system of FIG. 1 is only one embodiment of the present invention, the present invention is not limited to FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention .

Generally, the components of the virtual reality experience system of FIG. 1 are connected through a network 120. The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. The network includes a local area network (LAN), a wide area network (WAN), a wide area network (WWW) Wide Web, wired / wireless data communication network, telephone network, wired / wireless television communication network, and the like. Examples of wireless data communication networks include 3G, 4G, 5G, 3GPP, LTE, WIMAX, Wi-Fi, Bluetooth, infrared, Communications, Visible Light Communication (VLC), LiFi, and the like.

The virtual reality experience service providing server 100 can provide the virtual reality experience service through the real space including the predetermined plurality of travel paths.

The virtual reality experience service providing server 100 may receive and store information about a photographed image photographed along a plurality of predetermined movement paths in a real space from a photographing device (not shown) or a storage device (not shown). Specifically, the virtual reality experience service providing server 100 receives the 360 ° photographed image photographed at each of the plurality of photographing points on each movement route, the photographing information about the photographed image, and the photographed route information from the photographing apparatus or the storage device . Here, the photographing information may include photographing time information of the photographing point and six degrees of freedom (6 DOF) information.

The virtual reality experience service providing server 100 can create a virtual space corresponding to the real space on the basis of a plurality of pieces of photographing information on each movement route.

The virtual reality experience service providing server 100 generates a VR (Vritual Reality) image at each photographing point on the basis of the photographing information and the movement route information using the 360 ° photographing image at each photographing point, It is possible to generate VR contents for each route. For example, the virtual reality experience service providing server 100 can map the VR image and time information at each photographing point to respective positions of the virtual space corresponding to each photographing point on the moving path of the real space.

The virtual reality experience service providing server 100 may provide the VR content for each route to the user terminal 110. [

The user terminal 110 can select one of the plurality of movement paths of the VR contents from the user.

The user terminal 110 may monitor the location information of the user terminal 110 and transmit the monitored location information to the virtual reality experience service providing server 100. [

The user terminal 110 can receive and output the VR contents for one travel route selected by the user terminal 110 from the virtual reality experience service providing server 100 based on the location information of the user terminal 110. [

Hereinafter, the operation of each component of the virtual reality experience system of FIG. 1 will be described in more detail.

2 is a block diagram of the virtual reality experiencing service providing server 100 shown in FIG. 1 according to an embodiment of the present invention.

2, the virtual reality experience service providing server 100 includes a storage unit 200, a VR image generation unit 210, a virtual space generation unit 220, a VR content generation unit 230, (240). The VR image generation unit 210 includes a stitching unit 212 and the virtual space generation unit 220 includes a node setting unit 222, a point setting unit 224, and a movement path setting unit 226 The VR contents providing unit 230 includes a mapping unit 232 and the VR contents providing unit 240 includes a moving route determining unit 242, a location information receiving unit 244, and a VR contents transmitting unit 246 . However, the virtual reality experience service providing server 100 shown in FIG. 2 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

Hereinafter, description will be made with reference to FIG. 2 and FIGS. 3A to 6.

The storage unit 200 may receive and store 360 ° photographed images, photographing information, and movement route information at each of a plurality of photographing points on the moving path for each moving path in the real space from the photographing device or the storage device. Here, the photographing information may include photographing time information of the photographing point and six degrees of freedom (6 DOF) information. The movement route information may include location information of a start point and a destination of the photographing. 6DOF information will be described later with reference to FIG. 4A.

For example, the storage unit 200 receives a 360 ° photographed image photographed by the photographing apparatus on the first movement path moving from the first point to the second point in the real space from the photographing apparatus or the storage apparatus, A 360 ° photographed image photographed on a second moving path from the second point to the first point may be received from the photographing apparatus or the storage apparatus. Here, the 360-degree photographed image photographed on the first moving route is divided into a plurality of six-directional photographed images taken at the second point in each of the plurality of photographings set for each predetermined distance interval on the first movement route, And the 360 ° photographed image photographed on the second movement route includes a plurality of images photographed toward the first point in each of the plurality of photographings set for each predetermined distance interval on the second movement route with the second point as a starting point And can include images in six directions.

The VR image generating unit 210 may generate a VR image at each photographing point using the 360 ° photographing image at each photographing point based on the photographing information and the movement route information. Here, the 360 ° photographed image has a directionality as shown in FIG. When the front FOV 300 to be displayed to the user for the first time in the 360 ° photographing image is determined, the left FOV 302, the right FOV 304, the rear FOV 306, and the like are determined based on the front FOV 300 do. Referring to FIG. 3B, when a 360 ° photographed image is transformed into a cube, the left FOV 302, the right FOV 304, the rear FOV 306, the downward FOV 308, Is more clearly shown. This directionality is not a problem when one VR image is expressed, but in the case that connectivity is indicated according to the movement route in a plurality of VR images, it is absolutely necessary to consider the directionality in the VR image.

A specific space is photographed as a VR image irrespective of a projection method such as a cube or a forward method, and the FOV that the user looks at in the photographed image can be moved in the same direction so that the user determines that the VR image has connectivity. In other words, assuming that VR images are taken at the A and B points at intervals of 1 meter, the VR images taken at the two points can be sensed to move from point A to point B in the same direction. If the direction of the point of view from point A suddenly changes at point B, it is difficult to feel that the point is moving in a continuous space. Therefore, it is necessary to connect the photographed images using the directionality and the directionality of the FOV viewed from the point of the photographed image to express the mobility of the space.

Referring to FIG. 4A, the 6 DOF information includes six motion direction information for an object. Specifically, the 6 DOF information includes a linear motion 402 of X, a linear motion 400 of Y, a linear motion 404 of Z, a rotational motion 408 of X, a rotational motion 406 of Y, (410). It is impossible to take a photograph in consideration of the photographing direction and the moving path direction at the photographing site, so that the taken 360 ° photographing image can be corrected using the 6DOF information.

Through the 6 DOF information, the 360 ° photographed image can be corrected corresponding to the photographing direction and the moving path direction on the virtual space, and the mobility for the FOV in the virtual space can be calculated using the 6 DOF information. For example, the photographing direction is represented by rotational motions of X, Y, and Z axes in 6 DOF information, and the direction of travel path can be expressed by a linear motion of X, Y, and Z axes.

Referring to FIG. 4B, when 6DOF information is photographed from the first point 412 on the X axis toward the second point 414 and the third point 416 on the X axis is shot toward the second point 414 It is assumed that each FOV center point of the 360 ° photographed image photographed at the third point 416 on the X axis is corrected by the angle 418 of the rotational motion of the changed X, Whereby an error in which the photographing direction is changed according to the photographing position can be minimized.

The stitching unit 212 can determine the forward FOV of the 360-degree shot image in consideration of the movement path corresponding to the movement path information.

The stitching unit 212 may stitch the 360 ° photographed image into one image based on the determined forward FOV, and generate a VR image by matching the stitched one image in six directions based on the forward FOV.

The virtual space creating unit 220 can create a virtual space corresponding to the real space based on a plurality of pieces of photographing information in each movement path. Referring to FIG. 5A, the virtual space generation unit 220 may generate a virtual space using the position information and the photographing time information of the FOV photographed at a plurality of photographing points for each movement route. The calculation of the position information of the FOV will be described later with reference to FIG. 5B. The node setting unit 222 can set a plurality of nodes corresponding to at least a part of the plurality of photographing points on the virtual space. Here, the plurality of nodes may be a point at which a VR image photographed at a photographing point corresponding to each node is provided. The point setting unit 224 can set some of the plurality of nodes as points. Here, the point may be a node corresponding to the departure point and a node corresponding to the destination in each movement route. The movement path setting unit 226 can set a movement path between points. The movement path setting unit 226 can set a movement path between a point corresponding to a source node and a point corresponding to a destination node.

를 이용한 각도(500)의 계산을 통해 산출될 수 있다. 예를 들면, 전방 FOV(502)에서 우측 FOV(504)로 이동할 때의 각도가 90도이므로 우측 FOV(504)의 위치 정보는 전방 FOV(502)로부터 전방 FOV(502)와 우측 FOV(504) 간의 거리의 θ/90도의 비율만큼 이동한 거리에 위치한 값일 수 있다. 이와 마찬가지로 X축과 Z축 상에서의 FOV 위치 정보는

를 통해 계산될 수 있고, Y축과 Z축 상에서의 FOV 위치 정보는

를 통해 계산될 수 있다. Referring to FIG. 5B, when the photographing apparatus photographs while moving in the Y-axis on the X-axis, the positional information of the FOV due to the photographing movement is obtained at the mid-

Can be calculated through the calculation of the angle 500 using < RTI ID = 0.0 > The positional information of the right FOV 504 is transmitted from the front FOV 502 to the front FOV 502 and the right FOV 504 since the angle when moving from the front FOV 502 to the right FOV 504 is 90 degrees, / RTI > of the distance between the < / RTI > Similarly, the FOV position information on the X axis and the Z axis is

And the FOV position information on the Y-axis and the Z-axis can be calculated through

Lt; / RTI >

The VR content generation unit 230 may generate VR content for each movement route.

The mapping unit 232 may map the 360 ° photographed image corresponding to each of the plurality of nodes and the image of the 360 ° photographed image corresponding to each of the plurality of nodes to each of the plurality of nodes set on each movement route. Referring to FIG. 6, in the case of a plurality of nodes 600, 602, and 604 located on a movement path in the same direction, the forward FOV of the 360 ° captured images 606, 608, and 610 does not change, The forward FOV of the 360 ° photographed image 614 is changed from (612).

The VR contents providing unit 240 may provide VR contents for each route to the user terminal 110.

The movement route determining unit 242 can receive information from the user terminal 110 to select one of a plurality of movement routes.

The location information receiver 244 may receive the location information of the user terminal 110.

The VR content transmitting unit 246 may transmit the VR content for one route selected from the user terminal 110 to the user terminal 110 based on the location information of the user terminal 110. For example, when the user terminal 110 is moving, the VR contents transmitting unit 246 transmits only the image (forward FOV) of the 360 ° photographed image corresponding to each of the plurality of nodes of the selected one moving route to the user terminal 110 ). When the user terminal 110 is stopped, the VR content transmitting unit 246 transmits the 360 ° captured image (FOV of each direction) corresponding to the node where the user terminal 110 is stopped to the user terminal 110 110). When the user is moving, since the user gazes forward, the user does not feel a sense of heterogeneity even if only the image that is wider than the front FOV is output. On the other hand, when the user stops at a specific node, it is necessary to output a 360 ° photographed image because there is a high probability of looking at a space other than the front.

Those skilled in the art will recognize that the storage unit 200, the VR image generation unit 210, the stitching unit 212, the virtual space generation unit 220, the node setting unit 222, the point setting unit 224, The VR contents generation unit 230, the mapping unit 232, the VR contents providing unit 240, the movement route determining unit 242, the position information receiving unit 244, and the VR contents transmitting unit 246 May be implemented separately, or one or more of them may be implemented in unison.

7 is a flowchart illustrating a method for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths, according to an embodiment of the present invention.

Referring to FIG. 7, in step S701, the virtual reality experience service providing server 100 may store 360 ° photographed images, photographing information, and moving route information at each of a plurality of photographing points on the moving route for each moving route. Here, the photographing information may include photographing time information of the photographing point and 6 DOF information.

In step S703, the virtual reality experience service providing server 100 can generate a VR image at each photographing point using the 360-degree photographing image at each photographing point based on the photographing information and the movement route information.

In step S705, the virtual reality experience service providing server 100 can create a virtual space corresponding to the real space based on the plurality of pieces of photographing information on each movement path.

In step S707, the virtual reality experience service providing server 100 may generate VR contents for each movement route.

In step S709, the virtual reality experience service providing server 100 may provide VR content for each route to the user terminal 110. [

In the above description, steps S701 to S709 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

8 is a flowchart illustrating a method of generating a VR image at each photographing point, according to an embodiment of the present invention.

Referring to FIG. 8, in step S801, the virtual reality experience service providing server 100 may determine the forward FOV of the 360 ° photographed image in consideration of the moving path corresponding to the moving path information at each of the plurality of photographing points.

In step S803, the virtual reality experiencing service providing server 100 may stratify the 360 ° photographed image into one image based on the forward FOV.

In step S805, the virtual reality experience service providing server 100 may generate a VR image by matching one image in six directions based on the forward FOV.

In the above description, steps S801 to S805 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

9 is a flowchart illustrating a method of creating a virtual space according to an embodiment of the present invention.

Referring to FIG. 9, in step S901, the virtual reality experience service providing server 100 may set a plurality of nodes corresponding to at least a part of a plurality of photographing points on a virtual space.

In step S903, the virtual reality experience service providing server 100 can set some of a plurality of nodes as points. Here, the point may be a node corresponding to the departure point and a node corresponding to the destination in each movement route.

In step S905, the virtual reality experience service providing server 100 can set a movement path between points.

In the above description, steps S901 to S905 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

10 is an operational flowchart illustrating a method of providing a virtual reality experience service through a real space including a predetermined plurality of movement paths, according to an embodiment of the present invention.

Referring to FIG. 10, in step S1001, the user terminal 110 selects one of the plurality of movement paths from the user, and transmits information on the selected movement route to the virtual reality experience service providing server 100 in step S1003.

In step S1005, the virtual reality experience service providing server 100 may receive location information of the user terminal 110 from the user terminal 110. [

In step S1007, the virtual reality experience service providing server 100 may determine whether the user terminal 110 is moving based on the location information of the user terminal 110. [

In step S1009, when the user terminal 110 is moving, the virtual reality experience service providing server 100 may transmit an image of the 360 ° photographed image corresponding to the selected travel route to the user terminal 110. [

In step S1010, when the user terminal 110 is in a stopped state, the virtual reality experience service providing server 100 may transmit a 360 ° photographed image corresponding to the selected travel path to the user terminal 110. [

In the above description, steps S1001 through S1010 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

FIG. 11 is a block diagram of the user terminal 110 shown in FIG. 1, in accordance with an embodiment of the present invention.

11, the user terminal 110 may include a route selection unit 1100, a location information provision unit 1110, and a VR content output unit 1120. [ However, the user terminal 110 shown in FIG. 11 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The movement path selection unit 1100 can select one of the plurality of movement paths in the virtual space from the user. For example, the movement path selection unit 1100 may receive a movement path including a starting point and a destination point selected by the user.

The location information providing unit 1110 may monitor the location information of the user terminal 110 and transmit the monitored location information to the virtual reality experience service providing server 100.

The VR content output unit 1120 may receive and output the VR content for one route selected by the user from the virtual reality experience service providing server 100 based on the location information of the user terminal 110. [ Here, the VR content is generated based on the VR images photographed at each of a plurality of shooting points of each movement path included in the real space, and the VR image is generated based on shooting information and movement route information at each of the plurality of shooting points And can be generated using a 360 ° photographed image at the photographing point. Here, the photographing information may include photographing time information of the photographing point and 6 DOF information.

The VR content output unit 1120 can receive and output an image of a 360 ° photographed image from the virtual reality experience service providing server 100 when the user terminal 110 is moving. At this time, the image of the 360 ° photographed image may be an image corresponding to the forward FOV.

When the user terminal 110 is stopped, the VR content output unit 1120 can receive the 360 ° photographed image from the virtual reality experience service providing server 100 and output the FOV corresponding to the viewing direction of the user.

Those skilled in the art will appreciate that the movement path selection unit 1100, the position information providing unit 1110, and the VR contents output unit 1120 may be implemented separately or at least one of them may be integrated .

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer readable medium may include both computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: virtual reality experience service providing server
110: User terminal
120: photographing apparatus

Claims (17)

A method for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths,
Storing 360 ° photographed images, photographing information, and moving route information at each of a plurality of photographing points on the moving route for each moving route;
Generating a VR (Vritual Reality) image at each photographing point using a 360 ° photographing image at each photographing point based on the photographing information and the movement route information;
Creating a virtual space corresponding to the real space based on a plurality of pieces of photographing information in each movement path;
Generating VR contents for each movement route for each movement route; And
Providing VR content for each movement route to a user terminal
The virtual reality experience service providing method comprising:
The method according to claim 1,
Wherein the photographing information includes photographing time information of a photographing point and six degrees of freedom (6 DOF) information.
The method according to claim 1,
The step of generating a VR (Vritual Reality) image at each of the photographing points
Determining a forward FOV of the 360-degree photographic image in consideration of a movement path corresponding to the movement path information;
Stitching the 360 ° photographed image into one image based on the forward FOV; And
Matching the one image in six directions based on the forward FOV
The virtual reality experience service providing method comprising:
The method according to claim 1,
The step of creating the virtual space
Setting a plurality of nodes corresponding to at least a part of the plurality of shooting points on the virtual space; And
Setting a portion of the plurality of nodes as a point
The virtual reality experience service providing method comprising:
5. The method of claim 4,
The step of creating the virtual space
Setting a movement path between the points
The virtual reality experience service providing method according to claim 1, further comprising:
6. The method of claim 5,
The step of generating the VR contents for each movement route by each movement route
Mapping the 360 ° photographed image corresponding to each of the plurality of nodes and the image of the corresponding 360 ° photographed image
The virtual reality experience service providing method comprising:
The method according to claim 6,
The step of providing the VR content for each movement route to the user terminal
Receiving information for selecting one of the plurality of movement paths from the user terminal;
Receiving location information of the user terminal;
Transmitting the VR content for the selected one movement route to the user terminal based on the location information of the user terminal
The virtual reality experience service providing method comprising:
8. The method of claim 7,
The step of transmitting the VR contents for the selected one movement route to the user terminal
Transmitting an image of the corresponding 360 ° photographic image to the user terminal when the user terminal is moving; And
When the user terminal is at a standstill, transmitting the corresponding 360 ° photographic image to the user terminal
The virtual reality experience service providing method comprising:
A user terminal for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths,
A movement path selection unit that selects one of the plurality of movement paths;
A location information providing unit for monitoring location information of a user terminal and transmitting the monitored location information to a server; And
A VR contents output unit for receiving VR contents for the selected one movement route based on the location information from the server and outputting the received VR contents,
Lt; / RTI >
The VR content is generated based on a VR (Vritual Reality) image at each of a plurality of shooting points of each movement path,
Wherein the VR image is generated using 360 ° photographed images at each photographing point based on photographing information and movement route information at each of the plurality of photographing points.
A virtual reality experience service providing server for providing a virtual reality experience service through a real space including a predetermined plurality of movement paths,
A storage unit for storing 360 ° photographed images, photographing information, and moving route information at each of a plurality of photographing points on the moving route for each moving route;
A VR image generating unit for generating a VR (Vritual Reality) image at each photographing point using a 360 ° photographing image at each photographing point based on the photographing information and the movement route information;
A virtual space generation unit for generating a virtual space corresponding to the real space based on a plurality of pieces of photographing information in each movement path;
A VR content generation unit for generating VR contents for each movement route for each movement route; And
A VR content providing unit for providing the VR content for each moving route to the user terminal
And a virtual reality experience service providing server.
11. The method of claim 10,
Wherein the photographing information includes photographing time information of a photographing point and six degrees of freedom (6 DOF) information.
12. The method of claim 11,
The VR image generating unit determines a forward FOV of the 360 ° photographed image in consideration of a moving path corresponding to the moving route information, stitches the 360 ° photographed image into one image based on the forward FOV, A stitching unit for matching the one image in six directions based on the FOV,
And a virtual reality experience service providing server.
12. The method of claim 11,
Wherein the virtual space creating unit comprises: a node setting unit for setting a plurality of nodes corresponding to at least a part of the plurality of shooting locations on the virtual space; And
A point setting unit for setting a part of the plurality of nodes as a point,
And a virtual reality experience service providing server.
14. The method of claim 13,
The virtual space generating unit may include a movement path setting unit
Wherein the virtual reality experience service providing server further comprises:
15. The method of claim 14,
The VR content generation unit may include a mapping unit for mapping a 360 ° photographed image corresponding to each of the plurality of nodes and an image of the corresponding 360 ° photographed image,
And a virtual reality experience service providing server.
16. The method of claim 15,
Wherein the VR contents providing unit comprises: a travel route determining unit for receiving information for selecting one of the plurality of travel routes from the user terminal;
A location information receiver for receiving location information of the user terminal; And
A VR content transmitting unit for transmitting VR content for the selected one movement route to the user terminal based on the location information of the user terminal,
And a virtual reality experience service providing server.
17. The method of claim 16,
Wherein the VR content transmitting unit transmits the image of the corresponding 360 ° photographic image to the user terminal when the user terminal is moving,
And transmits the corresponding 360 ° photographed image to the user terminal when the user terminal is at a standstill.

Images