KR102176805B1 - System and method for providing virtual reality contents indicated view direction - Google Patents

Abstract

A VR content providing system and method in which a view direction is displayed are provided. The VR content providing method in which the view direction is displayed is performed by a computer, the method comprising: acquiring floor plan-based spatial data; Acquiring a plurality of 360 degree image data related to the spatial data; Mapping 360 degree image data corresponding to each position of the spatial data; Receiving a specific location of the spatial data from a user as a starting point; Providing VR content by using 360-degree image data corresponding to the starting point, and providing VR content with a mini-map indicating a user's view direction on the top of the VR content; And synchronizing the view direction of the user and the view direction on the minimap whenever the view direction of the user viewing the VR content changes.

Description

VR content providing system and method in which the view direction is displayed {SYSTEM AND METHOD FOR PROVIDING VIRTUAL REALITY CONTENTS INDICATED VIEW DIRECTION}

The present invention relates to a system and method for providing VR content in which the view direction of a user viewing VR content is displayed.

Virtual Reality (VR) is a virtual space created through a computer, and a space that gives reality through 3D visual effects. The technology for realizing virtual reality is a technology that enables users to feel as if they are in the real world by processing user input in real time, and is a next-generation technology that goes beyond multimedia.

Recently, the current virtual reality (VR) technology has been applied to various fields such as Web 3D, simulation, game, design, education, medical care, and military. Among these virtual reality technologies, VR technology using 360-degree images is a camera. It is a real-life VR technology that is produced by taking and attaching images captured using a photorealistic VR technology.This production method rotates the landscape or indoors (360° horizontally or vertically) and connects the captured images through a processing process and attaches them to a sphere or It is implemented so that it can be viewed while rotating, zooming in/zooming out, and moving the image around the nodal point through the process of mapping the cylindrical shape.

However, since the conventional VR technology using 360-degree images generally maps real-life images to a virtual sphere space and renders them again like CG, there are many calculations in the process of mapping real-life images to the virtual space. There is a problem that processing is required.

In addition, when a user views VR content using a 360-degree image, the view direction continuously changes according to the user's movement. However, the conventional VR technology using a 360-degree image has a problem in that it is not possible to inform a user by applying a continuously changing view direction.

Unexamined Patent Publication No. 10-2018-0106549, 2018.10.01

The problem to be solved by the present invention is not to create VR contents using 360-degree images stitched through external software, but to stitch 360-degree images through its own software and to produce VR contents. It is to provide a system and method for providing displayed VR content.

In addition, to provide a VR content providing system and method in which a view direction capable of producing VR content including a mini-map displayed by applying a view direction continuously changed according to a user's movement in real time is displayed.

The problems to be solved by the present invention are not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention for solving the above-described problem, a method of providing VR content in which a view direction is displayed performed by a computer includes: obtaining spatial data based on a plan view; Acquiring a plurality of 360 degree image data related to the spatial data; Mapping 360 degree image data corresponding to each position of the spatial data; Receiving a specific location of the spatial data from a user as a starting point; Providing VR content using 360-degree image data corresponding to the starting point, wherein a mini-map indicating a user's view direction is provided at the top of the VR content; And synchronizing the view direction of the user and the view direction on the minimap whenever the view direction of the user viewing the VR content changes.

In addition, in an embodiment, the 360-degree image data is raw data obtained by connecting two 180-degree images captured using two fisheye lenses.

In addition, in an embodiment, the providing of the VR content includes the step of stitching the 360-degree image data, which is the state of the raw data, into processed data.

In addition, in an embodiment, one or more 360 degree image data is mapped to each location of the spatial data.

In addition, in an embodiment, the step of receiving a specific location of the spatial data as a starting point from the user includes, when there are a plurality of 360-degree image data mapped to the starting point, among a plurality of 360-degree image data from the user. And receiving a selection input of one.

In addition, in an embodiment, the mini-map has a reduced plan view.

In addition, according to an embodiment, the mini-map provides the user's view direction using a direction chart.

In addition, in an embodiment, the mini-map is rotated according to the user's view direction to provide the user's view direction.

A VR content providing program displaying a view direction according to another embodiment of the present invention for solving the above-described problem executes a VR content providing method in which the view direction is displayed by being combined with a computer that is hardware, and stored in a medium. do.

Other specific details of the present invention are included in the detailed description and drawings.

According to the present invention, it is not possible to produce VR contents using 360-degree images stitched through external software, but by stitching 360-degree images and producing VR contents through its own software, thereby calculating VR contents production. There is an effect that can reduce the process.

In addition, by displaying a mini-map displayed in the VR content by applying a view direction that continuously changes according to the user's movement in real time, there is an effect that the user can accurately know the location and the viewing direction that the user is currently viewing.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a block diagram of a VR content providing system in which a view direction is displayed according to an embodiment of the present invention.
2 is a flowchart of a method of providing VR content in which a view direction is displayed according to an embodiment of the present invention.
3 is an exemplary diagram of spatial data based on a plan view according to an embodiment of the present invention.
4 is an exemplary diagram of 360 degree image data according to an embodiment of the present invention.
5 is an exemplary diagram of VR content in which a view direction is displayed according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, It is provided to fully inform the technician of the scope of the present invention, and the present invention is only defined by the scope of the claims.

The terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used in the specification, “comprises” and/or “comprising” do not exclude the presence or addition of one or more other elements other than the mentioned elements. Throughout the specification, the same reference numerals refer to the same elements, and “and/or” includes each and all combinations of one or more of the mentioned elements. Although "first", "second", and the like are used to describe various elements, it goes without saying that these elements are not limited by these terms. These terms are only used to distinguish one component from another component. Therefore, it goes without saying that the first component mentioned below may be the second component within the technical idea of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used as meanings that can be commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not interpreted ideally or excessively unless explicitly defined specifically.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a VR content providing system in which a view direction is displayed according to an embodiment of the present invention.

Referring to FIG. 1, a service providing server 100 is connected to a user terminal 200 through a network 300.

The service providing server 100 is software that produces VR content and provides it to a user, and produces VR content using spatial data based on a two-dimensional plan view and 360-degree image data for each location of the plan view.

According to an embodiment, the service providing server 100 may capture images in all directions (360 degrees) around a camera using a panoramic 360 and stitch the captured images to produce VR content. .

According to another embodiment, the service providing server 100 installs and shoots multiple cameras at various locations using a free viewpoint, and generates a 3D model through analysis of the captured image to provide VR content. You can also make it.

When a selection for a specific location is received from the user terminal 200, the service providing server 100 provides VR content to the user terminal 200 using the specific location as a starting point 10. At this time, the service providing server 100 matches (synchronizes) the view direction in which the user views the 360-degree image from the starting point 10 using the user terminal 200 (synchronizes), and provides the user with a view direction. Provides displayed VR content. A detailed description of a method of providing VR content in which the view direction is displayed will be described later.

The user terminal 200 is a computer, a tablet PC, a smart phone, and the like, and refers to a smart device capable of viewing VR content provided by the service providing server 100. In this case, the user terminal 200 may be connected to a head mounted display (HMD), and the user can watch VR content provided to the user terminal 200 by wearing the HMD.

The network 300 does not select wired or wireless, and various communication methods may be applied.

A method of providing VR content in which a view direction is displayed according to an embodiment of the present invention will be described with reference to FIGS. 2 to 5.

2 is a flowchart of a method for providing VR content in which a view direction is displayed according to an embodiment of the present invention, FIG. 3 is an exemplary diagram of plan-based spatial data according to an embodiment of the present invention, and FIG. 4 is Is an exemplary diagram of 360-degree image data according to an embodiment of the present invention, and FIG. 5 is an exemplary diagram of VR content in which a view direction is displayed according to an embodiment of the present invention.

The VR content providing method in which the view direction is displayed according to an embodiment of the present invention is performed by the service providing server 100 (computer).

The service providing server 100 acquires floor plan-based spatial data (S10). As shown in FIG. 3, spatial data is generated based on a plan view that is a two-dimensional image. In the spatial data, each location is separated and stored, and each location may include identification information for distinguishing each location.

According to an embodiment, an identification number is assigned to each location of the spatial data, and when a user touches a specific identification number through the user terminal 200 or holds a mouse, description information on the location may be provided.

The service providing server 100 acquires a plurality of 360 degree image data related to the spatial data (S20). The service providing server 100 obtains a plurality of 360-degree image data for spatial data and determines which position of each 360-degree image data corresponds to the spatial data.

According to an embodiment, the 360-degree image data is raw data in which two 180-degree images photographed using two fisheye lenses are connected. Referring to FIG. 4, it can be seen that two 180-degree images are connected to each other to obtain one 360-degree image data. The service providing server 100 acquires 360-degree image data in an unprocessed state, that is, in an unstitched state.

The service providing server 100 maps 360 degree image data corresponding to each location of the spatial data (S30). That is, the service providing server 100 determines which location of the spatial data corresponds to each of the 360-degree image data in step 20, and then maps the 360-degree image data to the corresponding location.

According to an embodiment, one or more 360 degree image data may be mapped to each location of the spatial data.

The service providing server 100 receives a specific location of the spatial data from a user as a starting point 10 (S40). The user may select and input one of a plurality of locations in spatial data through the user terminal 200. For example, referring to FIG. 3, in spatial data to which an identification number is assigned to each location, the user may input number 13 as the starting point 10. Then, the service providing server 100 provides 360-degree image data mapped to the selected input starting point 10.

According to an embodiment, when there are a plurality of 360-degree image data mapped to the starting point 10 selected and input by the user, the service providing server 100 requests the user to select one of the plurality of 360-degree image data. I can. The service providing server 100 provides the selected 360-degree image data to the user terminal 200 when one of a plurality of 360-degree image data is selected by the user. According to another embodiment, when there are a plurality of 360 degree image data mapped to the starting point 10 selected and input by the user, the service providing server 100 is a plurality of 360 degree images mapped to the starting point 10. May be sequentially provided to the user terminal 200.

The service providing server 100 provides VR content by using 360-degree image data corresponding to the starting point 10 (S50). In this case, the service providing server 100 provides the user to view 360-degree image data based on the starting point 10 through the user terminal 200. For example, when the user selects the starting point 10 shown in FIG. 3, the user can view a 360-degree image based on the starting point 10 as shown in FIG. 4.

According to an embodiment, the service providing server 100 may provide VR content to a user by stitching 360-degree image data, which is a state of raw data, into processed data. The conventional method of producing 360-degree VR content is that when the process of stitching together two 180-degree images through external software is completed, the VR content production software creates VR content using the processed 360-degree image. If it was a method, the VR content providing method according to the present invention acquires a 360-degree image in the form of raw data from outside the service, and converts the 360-degree image in the form of raw data into processed data in the service providing server 100 to convert the VR content. Because it is production, the process of producing VR contents can be made more efficiently.

In addition, according to an embodiment, the service providing server 100 also provides a minimap 20 displaying the user's view direction on the top of the VR content. When a user views VR content, the view direction changes from time to time according to the user's gaze movement, so the service providing server 100 determines the view direction of the user and the view direction on the minimap 20 provided on the top of the VR content in real time. By synchronizing to (S60), it is possible to generate and provide VR content in which the view direction is synchronized to the user terminal 200 in real time. In this case, as shown in FIG. 5, the mini-map 20 may be displayed in a reduced form of a 2D plan view.

According to an embodiment, the service providing server 100 may provide VR content indicating a view direction in which a user views a 360-degree image by using an azimuth included in the mini-map 20.

In addition, according to another embodiment, the service providing server 100 may provide VR content that displays the user's view direction by rotating the minimap 20 according to the view direction in which the user views a 360-degree image.

The VR content providing method in which the view direction is displayed according to the embodiment of the present invention described above may be implemented as a program (or application) to be executed in combination with a computer, which is hardware, and stored in a medium.

The above-described program includes C, C++, JAVA, Ruby, which can be read by a processor (CPU) of the computer through the device interface of the computer, in order for the computer to read the program and execute the methods implemented as a program. It may include a code (Code) coded in a computer language such as machine language. Such code may include a functional code related to a function defining necessary functions for executing the methods, and a control code related to an execution procedure necessary for the processor of the computer to execute the functions according to a predetermined procedure. can do. In addition, such code may further include additional information required for the processor of the computer to execute the functions or code related to a memory reference to which location (address address) of the internal or external memory of the computer should be referenced. have. In addition, when the processor of the computer needs to communicate with any other computer or server in the remote in order to execute the functions, the code uses the communication module of the computer to determine how It may further include a communication-related code for whether to communicate or what information or media to transmit and receive during communication.

The stored medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. Specifically, examples of the storage medium include, but are not limited to, ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like. That is, the program may be stored in various recording media on various servers to which the computer can access, or on various recording media on the user's computer. Further, the medium may be distributed over a computer system connected through a network, and computer-readable codes may be stored in a distributed manner.

In the above, embodiments of the present invention have been described with reference to the accompanying drawings, but those skilled in the art to which the present invention pertains can be implemented in other specific forms without changing the technical spirit or essential features. You can understand. Therefore, the embodiments described above are illustrative in all respects, and should be understood as non-limiting.

100: service providing server
200: user terminal
300: network

Claims (9)

As a method of providing VR content in which a viewing direction performed by a computer is displayed,
Acquiring floor plan-based spatial data;
Acquiring a plurality of 360 degree image data, which is a state of raw data related to the spatial data;
Mapping 360 degree image data, which is a state of raw data, corresponding to each position of the spatial data;
Receiving a specific location of the spatial data from a user as a starting point;
Stitching 360-degree image data, which is a state of raw data mapped to the specific location input as the starting point, into processed data;
VR content that produces VR content at the starting point by using the 360-degree image data converted into the processed data and provides it to the user, but is provided with a mini-map indicating the user's view direction at the top of the VR content. Providing a; And
Providing VR content in which a view direction performed by a computer is displayed, including the step of synchronizing the view direction of the user with the view direction on the minimap whenever the view direction of the user watching the VR content changes Way. The method of claim 1,
The 360-degree image data is a sequence of two 180-degree images captured using two fisheye lenses, and a method for providing VR content in which a view direction performed by a computer is displayed. delete The method of claim 1,
VR content providing method in which a view direction performed by a computer is displayed, in which at least one 360 degree image data is mapped to each location of the spatial data. The method of claim 4,
The step of receiving a specific location of the spatial data from the user as a starting point,
When there are a plurality of 360-degree image data mapped to the starting point, a method for providing VR content in which a view direction performed by a computer is displayed, comprising the step of receiving a selection input from a user from among a plurality of 360-degree image data. The method of claim 1,
The mini-map is a method of providing VR content in which the view direction performed by a computer is displayed in a reduced plan view. The method of claim 1,
The mini-map provides a user's view direction using an azimuth chart, a method for providing VR content in which a view direction performed by a computer is displayed. The method of claim 1,
The mini-map is rotated according to the user's view direction to provide the user's view direction, wherein the view direction performed by a computer is displayed. A VR content providing program that is combined with a computer as hardware and stored in a medium to execute the method of any one of claims 1, 2, 4 to 8, and displays a view direction.

Images