KR20180098912A - Method and system for providing visualization service by interworking between panorama view of 360-degree image and map view - Google Patents

Abstract

Disclosed are a method for providing a visualization service by linking a panorama view of a 360-degree image and a map view and a system thereof which can provide various virtual reality services. According to an embodiment of the present invention, the method for providing a visualization service by linking a panorama view of a 360-degree image and a map view comprises: a step of using collected images to generate a 360-degree image; a step of synchronizing position information and posture information collected with the images with the 360-degree image; a step of visualizing the synchronized 360-degree image in a panorama view; a step of using the position information and the posture information to overlay terrain feature addition information on the visualized panorama view; and a step of linking the panorama view and a map based on the position information of the 360-degree image visualized in the panorama view and the posture information of the 360-degree image corresponding to an area seen by a user in the panorama view, and visualizing the map in a map view.

Description

TECHNICAL FIELD [0001] The present invention relates to a service providing method and system for visualizing a panoramic view and a map view of a 360-

The present invention relates to a service providing method and system for visualizing a panorama view and a map view of a 360-degree image in cooperation with each other, and more particularly, to a panorama view and a map view using position information and attitude information synchronized with a 360- And more particularly, to a system and method for providing a service that can be interworked.

With increasing interest in 360-degree images and virtual reality services using them, technology development for processing and providing 360-degree images is becoming more and more active.

An existing method of providing a 360-degree image (for example, a 360-degree video service of YouTube) allows the user to switch between up, down, left, and right directions to view an image. However, the conventional method of providing a 360-degree image does not have accurate geospatial position and posture information, so it is only a level of appreciation.

The object of the present invention is to provide a service for accurately displaying the additional information of a feature item contained in a 360-degree image on a panoramic view of a 360-degree image by synchronizing position information and attitude information with the 360-degree image.

According to another aspect of the present invention, there is provided a service linking a map view corresponding to a panoramic view in which a 360-degree image is visualized using position information and attitude information of the 360-degree image.

The technical objects to be achieved by the present disclosure are not limited to the above-mentioned technical subjects, and other technical subjects which are not mentioned are to be clearly understood from the following description to those skilled in the art It will be possible.

According to an aspect of the present disclosure, there is provided a service providing method for visualizing a panoramic view and a map view of a 360-degree image in association with each other, the method comprising: generating a 360- Synchronizing the information with the 360-degree image, visualizing the synchronized 360-degree image in a panorama view, position information of the 360-degree image visualized in the panorama view, and 360 And linking the panoramic view and the map on the basis of the posture information of the image, and visualizing the map in the map view.

The features briefly summarized above for this disclosure are only exemplary aspects of the detailed description of the disclosure which follow, and are not intended to limit the scope of the disclosure.

According to the present disclosure, by synchronizing the position information and the attitude information with the 360-degree image, the additional information of the feature included in the 360-degree image can be accurately displayed in the panoramic view of the 360-degree image, .

In addition, according to the present disclosure, it is possible to provide a service in which a panoramic view in which a 360-degree image is visualized and a map view service can be interlinked and switched.

The effects obtainable from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below will be.

FIG. 1 is a block diagram illustrating a service providing system for visualizing a panoramic view and a map view of a 360-degree image in accordance with an embodiment of the present invention.
2 is a flowchart illustrating a service providing method for visualizing a panoramic view and a map view of a 360-degree image in accordance with an embodiment of the present invention.
FIG. 3 is a view for explaining a service linking a drones view and a map view using a 360-degree image collected by a flight device according to an embodiment of the present disclosure.
4 is a view for explaining a service for linking a ground view and a map view using a 360-degree image collected on the ground according to an embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, which will be easily understood by those skilled in the art. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein.

In the following description of the embodiments of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present disclosure rather unclear. Parts not related to the description of the present disclosure in the drawings are omitted, and like parts are denoted by similar reference numerals.

In the present disclosure, when an element is referred to as being "connected", "coupled", or "connected" to another element, it is understood that not only a direct connection relationship but also an indirect connection relationship May also be included. Also, when an element is referred to as " comprising "or" having "another element, it is meant to include not only excluding another element but also another element .

In the present disclosure, the terms first, second, etc. are used only for the purpose of distinguishing one element from another, and do not limit the order or importance of elements, etc. unless specifically stated otherwise. Thus, within the scope of this disclosure, a first component in one embodiment may be referred to as a second component in another embodiment, and similarly a second component in one embodiment may be referred to as a first component .

In the present disclosure, the components that are distinguished from each other are intended to clearly illustrate each feature and do not necessarily mean that components are separate. That is, a plurality of components may be integrated into one hardware or software unit, or a single component may be distributed into a plurality of hardware or software units. Thus, unless otherwise noted, such integrated or distributed embodiments are also included within the scope of this disclosure.

In the present disclosure, the components described in the various embodiments are not necessarily essential components, and some may be optional components. Thus, embodiments consisting of a subset of the components described in one embodiment are also included within the scope of the present disclosure. Also, embodiments that include other elements in addition to the elements described in the various embodiments are also included in the scope of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

FIG. 1 is a block diagram illustrating a service providing system 100 (hereinafter, referred to as a service providing system) for visualizing a panoramic view and a map view of a 360-degree image in accordance with an embodiment of the present disclosure.

1, the service providing system 100 includes an image collecting unit 110, a position / posture collecting unit 120, a side information input unit 130, a 360 degree image generating unit 140, A panoramic image visualizer 150, a 360 degree panoramic visualizer 160, a map visualizer 170, and an additional information overlay 180.

The image collection unit 110 may be a camera rig combined with a plurality of cameras. Here, the image collecting unit 110 may collect and store images for each camera.

The position / posture collecting unit 120 may collect and store positional information and posture information on which the image is collected (or photographed) by the image collecting unit 110. [ Here, the position / posture collecting unit 120 may include a GPS (Global Positioning System) to collect position information. The position / posture collecting unit 120 may include an INS (Inertial Navigation System) or an IMU (Inertial Measurement Unit) and an Attitude and Heading Reference System (AHRS) to collect attitude information.

Here, the position information may include the latitude and longitude information, and the attitude information may include at least one of the azimuth information, the slope information, and the field of view (FOV).

The additional information input unit 130 can receive and store the additional information of the feature around the place where the image is collected. For example, the additional information input unit 130 may automatically receive additional information of nearby features from an external server or an application program interface (API) having a database for storing additional information of the feature. In addition, the additional information input unit 130 may manually receive additional information of nearby features from a user and store the additional information.

Examples of the additional information of the feature item include a road name, a building name, a public office information, and a living facility information.

The 360 degree image generating unit 140 stitches each camera image collected by the image collecting unit 110 into any one of spherical, cylinder, or cubic shapes, A 360 degree image can be generated by correcting the brightness difference and color difference between images of each camera. Also, the 360-degree image generation unit 140 can generate a 360-degree image by correcting the shaking of the image due to the vibration upon image collection.

The position / posture synchronization unit 150 may synchronize and store the position information and posture information collected by the position / posture collection unit 120 corresponding to each frame of the 360 degree image. The position / posture synchronization unit 150 may store the synchronized position information and attitude information in the 360-degree image itself or separately store the 360-degree image separately from the 360-degree image.

The 360-degree panoramic visualization unit 160 can visualize the 360-degree panoramic image synchronized with the positional information and the attitude information as a panoramic view so that the user can observe the entire range around the photographing point vertically and horizontally.

The map visualization unit 170 can visualize a map linked with the panoramic view in which a 360-degree image is visualized in a map view. Specifically, the map visualization unit 170 analyzes the position information of the 360-degree image being visualized in the current panoramic view and the attitude information of the area that the user is viewing, and displays the 360-degree image panorama visualization unit (160).

Here, the map may be any one of a two-dimensional map in the form of an index map and a three-dimensional map in a three-dimensional sense, which are displayed in a plane.

The additional information overlay unit 180 can overlay the additional information of the peripheral feature of the image input to the additional information input unit 130 on the panoramic view in which the 360 degree image is visualized. Here, the additional information overlay unit 180 can overlay the additional information of the feature item on the panoramic view by analyzing the position information of the 360-degree image being visualized in the current panoramic view and the attitude information of the area that the user is viewing.

The additional information overlay unit 180 may overlay the additional information of the peripheral feature on the map view visualized by the map visualization unit 170.

On the other hand, the additional information overlay unit 180 may display additional information of the feature item in the form of at least one of an icon, a pop-up, a text photograph, and a moving image.

2 is a flowchart illustrating a service providing method for visualizing a panoramic view and a map view of a 360-degree image in accordance with an embodiment of the present invention. Here, it is assumed that the service providing method of FIG. 2 is provided by the service providing system 100 of FIG. 1. However, the present invention is not limited thereto and may be provided by a system or equipment other than the service providing system of FIG. .

Referring to FIG. 2, the service providing system may generate a 360-degree image using each camera-specific image collected by a camera rig composed of a plurality of cameras (S210).

Then, the service providing system may synchronize the position information and the attitude information collected together with the collected image to the 360-degree image (S220). Here, the location information may be the latitude and longitude information of the point where the image is collected (or photographed).

The attitude information may be at least one of azimuth information, tilt information, and field of view (FOV) of each camera in the camera league.

Then, the service providing system can visualize the synchronized 360-degree image as a panorama view (S230). Here, an embodiment of a panoramic view in which a 360-degree image is visualized may be the drones view of FIG. 3 or the ground view of FIG.

Then, the service providing system may overlay the feature supplementary information on the visualized panoramic view using the positional information and the attitude information (S240). Specifically, the service providing system can overlay the additional information of the feature on the panoramic view by analyzing the position information of the 360-degree image being visualized in the current panoramic view and the attitude information of the region that the user is viewing.

The service providing system may link the panorama view and the map based on the position information of the 360-degree image visualized in the panorama view and the attitude information of the 360-degree image corresponding to the area viewed by the user in the panorama view, The map can be visualized in the map view (S250). Specifically, the service providing system analyzes the position information of the 360-degree image and the attitude information of the area that the user is viewing in the current panoramic view, and can operate the map view in real time so that the user can see the same area on the map.

Here, the map may be any one of a two-dimensional map in the form of an index map and a three-dimensional map in a three-dimensional sense, which are displayed in a two-dimensional plane.

FIG. 3 is a view for explaining a service linking a drones view and a map view using a 360-degree image collected by a flight device according to an embodiment of the present disclosure.

3, the flight device 310 combines the camera rig 320, the GPS sensor 330, and the INS sensor 340, which are configured by a combination of a plurality of cameras, to generate a 360-degree image and position / Can be collected.

The 360-degree image collected by the camera rig 320 can then be visualized as a drones view 350, which is an example of a panoramic view.

The position / attitude information 360 collected by the GPS sensor 330 and the INS sensor 340 is synchronized with the 360-degree image so that the additional information 370 of the feature included in the 360- ). ≪ / RTI >

On the other hand, the three-dimensional map view 380 can be visualized in correspondence with the area viewed by the user in the drones, interoperating with the three-dimensional map. The 3D map view 380 can also overlay the additional information 370 of the feature item in the same manner as the drones view.

4 is a view for explaining a service for linking a ground view and a map view using a 360-degree image collected on the ground according to an embodiment of the present disclosure.

4, the tripod 410 may be used to combine the camera rig 420, the GPS sensor, and the INS sensor 440 with moving means to collect 360 degree images and position / attitude information from the ground.

The 360 degree image collected by the camera rig 420 may then be visualized as a ground view 450, which is an example of a panoramic view.

The position / attitude information 460 collected by the GPS sensor 430 and the INS sensor 440 is synchronized with the 360-degree image so that the additional information 470 of the feature included in the 360- ). ≪ / RTI >

On the other hand, the three-dimensional map view 480 can be visualized in correspondence with an area viewed by the user in the ground view by mutually interacting with the three-dimensional map. The 3D map view 480 may also overlay additional information 470 of features as well as a terrestrial view.

Meanwhile, FIGS. 3 and 4 illustrate a method of providing a service for visualizing a 360-degree view of a dragon view and a ground view, respectively, based on images collected from the air and images collected from the ground. However, And provide a visualization service.

As described above, a service providing method and system for visualizing a panoramic view and a map view of a 360-degree image interlockingly according to an aspect of the present disclosure have been described.

The service providing method and system according to an aspect of the present disclosure can synchronize position information and attitude information with a 360-degree image, so that additional information of the feature included in the 360-degree image can be accurately displayed on a 360- . ≪ / RTI >

In addition, according to the present disclosure, a panorama view in which a 360-degree image is visualized and a map view service can be interlocked with each other to provide a service that can be interchanged, thereby enabling the convenience of the user.

According to an aspect of the present disclosure, software or computer-readable medium having executable instructions for performing a service providing method for visualizing a panoramic view of a 360-degree image and a map view, readable medium may be provided. The executable instructions may include generating a 360-degree image using the collected image, synchronizing position information and attitude information collected with the image to the 360-degree image, Overlaying the visual feature supplementary information on the visualized panoramic view using the positional information and the attitude information, and generating positional information of the 360-degree visualized in the panoramic view, Linking the panorama view and the map on the basis of the attitude information of the 360-degree image corresponding to the region viewed by the viewer, and visualizing the map in the map view.

Although the exemplary methods of this disclosure are represented by a series of acts for clarity of explanation, they are not intended to limit the order in which the steps are performed, and if necessary, each step may be performed simultaneously or in a different order. In order to implement the method according to the present disclosure, the illustrative steps may additionally include other steps, include the remaining steps except for some steps, or may include additional steps other than some steps.

The various embodiments of the disclosure are not intended to be all-inclusive and are intended to illustrate representative aspects of the disclosure, and the features described in the various embodiments may be applied independently or in a combination of two or more.

In addition, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. In the case of hardware implementation, one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays A general processor, a controller, a microcontroller, a microprocessor, and the like.

The scope of the present disclosure is to be accorded the broadest interpretation as understanding of the principles of the invention, as well as software or machine-executable instructions (e.g., operating system, applications, firmware, Instructions, and the like are stored and are non-transitory computer-readable medium executable on the device or computer.

Claims (1)

A service providing method for visualizing a panoramic view of a 360-degree image and a map view in cooperation with each other,
Generating a 360-degree image using the collected image;
Synchronizing position information and attitude information collected with the image to the 360-degree image;
Visualizing the synchronized 360 degree image in a panoramic view;
Overlaying the feature supplementary information to the visualized panoramic view using the positional information and the attitude information; And
The panorama view and the map are interlocked based on the positional information of the 360-degree image visualized in the panoramic view and the attitude information of the 360-degree image corresponding to the area viewed by the user in the panoramic view, and the map is visualized in the map view A method for providing a service, comprising:

Images