KR20120133011A - System and method for providing to storytelling type area information of panorama image base - Google Patents

Abstract

PURPOSE: A storytelling type area information providing method based on a video panorama and a system thereof are provided to receive a service from a storytelling system provided from a content provider by supplying specific storytelling type area information including various contents through panorama video providing technology. CONSTITUTION: A converting unit(230) converts GPS(Global Positioning System) coordinate data and bearing data of a photographed viewpoint inputted through an input unit into a metadata file of an XML(eXtensible Markup Language) format. A first storage unit(240) stores a panorama video encoded in an encoding unit. A second storage unit(250) stores the metadata file which is converted in the converting unit. A providing unit(260) provides a storytelling type panorama viewpoint video generated in an auxiliary server to one or more client terminals through a HTTP(Hyper Text Transfer Protocol). [Reference numerals] (210) Input unit; (220) Encoding unit; (230) Converting unit; (240) First storage unit; (250) Second storage unit; (260) Providing unit

Description

System and method for providing to storytelling type area information of panorama image base}

The present invention relates to a video panorama based storytelling type local information providing method, in particular, by providing a storytelling specific local information including a variety of content utilizing a panorama video providing technology, users can tell the storytelling provided by the content provider The present invention relates to a method and a system for providing a storytelling type local information based on a video panorama that can be freely viewed by a user's intention at a certain point while being provided with a service.

Generally, the viewing point of view services such as street view and road view service provided by NHN Co., Ltd., which is a large domestic portal site company, and Daum Communications, are provided by a predetermined camera. Map-based location using 360 still pictures taken at 360 ° and using this still picture and Global Positioning System (GPS) information to link with the map so that the desired location can be displayed through the user's device. Information service is provided.

Such a service must be a useful information providing service to date because the view of the location is provided to the user's terminal through the web without directly visiting the corresponding site.

However, the above-described conventional panoramic viewing point service provides various and sufficient information to the user's terminal through web only simple still pictures of the surroundings based on the road displayed on the map, not the realistic dynamic image of the specific area. There is a limitation in providing contents including information data to a user.

That is, for example, after photographing a panorama video using a camera at a place such as a specific tourist destination from a service provider's point of view, the photographed panorama video is provided as a storytelling type viewing viewpoint service. There is a limit in that the content provider cannot present a desired story to the user due to the changing of the viewing viewpoint by the user's direction control.

Storytelling, also referred to as digital storytelling, is a concept first used at the Digital Storytelling Festival in Colorado, USA in 1995 and refers to story creation technology for digital media-based content production.

Storytelling, or storytelling, is the transmission of events and stories through words, images, and sounds. Stories or narratives have shared entertainment, means of education, cultural preservation, and moral values in all cultures, and stories include plots, characters, and viewpoints.

Therefore, in the future, if a system using the panorama video providing service is provided for the storytelling tourist information service, a high quality service including storytelling through video and user interaction can be provided. Can be provided to

An object of the present invention devised to solve the above problems is to provide a storytelling specific local information including various contents utilizing a panorama video providing technology, so that users are provided with a storytelling system provided by a content provider. At the same time, to provide a video panorama based storytelling type local information providing method and system that can freely view the surroundings by their intention at a specific point.

In order to achieve the above object, the present invention provides a storytelling type region information based on a video panorama, comprising: GPS (Global Positioning System) coordinate data of a photographing point and a viewpoint Panorama video shooting step in which a predetermined region is taken as a panoramic video by a camera in which bearing data is stored in real time; a panorama in which the panoramic video shot by the camera is encoded and stored as a file in a server In the video storing step, the GPS coordinate data and the view point bearing data of the specific region photographed by the camera are transmitted to the server as a metadata file in XML (eXtensible Markup Language) format. Storing the stored metadata file, the panorama video stored in the server A storytelling panorama video generation step in which the metadata file is generated as a storytelling panorama viewing point of view video file by a predetermined map-based storytelling panorama content authoring tool, wherein the storytelling type A storytelling panoramic video providing step of providing a panoramic video to at least one or more of the following client terminals through a Hyper Text Transfer Protocol (HTTP) and receiving the storytelling panoramic video to the client terminal.

The storytelling panoramic video is provided to the client terminal through a streaming service.

The step of receiving the storytelling panoramic video to the client terminal may include the first receiving step of receiving the metadata file to the client terminal through the server and the storytelling panoramic video file provided through the server. And a second receiving step received at the client terminal.

In a system for providing a storytelling type region information based on a video panorama, GPS (Global Positioning System) coordinate data and a photographing time point of a photographing point are recorded by real-time shooting a specific region in a panorama form. Camera that stores bearing data of a viewpoint in real time, a panoramic video captured by the camera is input in a file format, and bearings of the GPS (Global Positioning System) coordinate data and a viewpoint are taken. An input unit for inputting data, an encoding unit for encoding and encoding the panoramic video inputted through the input unit, a coordinate of the GPS (Global Positioning System) coordinate data inputted through the input unit and a view point (viewpoint) a conversion unit for converting (bearing) data into a metadata file in XML (eXtensible Markup Language) format; A first storage unit storing the panorama video compressed and encoded by the encoding unit, a second storage unit storing the metadata file converted by the conversion unit, and the following storytelling panorama generated by the sub-server A server having a providing unit for providing a viewing point of view video to at least one or more of the following client terminals through a Hyper Text Transfer Protocol (HTTP), and the panorama stored in the first storage unit and the second storage unit, respectively. The secondary server and the story provided by the server and the metadata file is generated as a storytelling panoramic viewing point of view video file by a predetermined map-based storytelling panorama content authoring tool (tool) It includes a client terminal that receives a telling-type panoramic viewing point of view video. The.

The storytelling panoramic viewing point of view video is provided to the client terminal through a streaming service.

The present invention can provide dynamic images of tourist attractions with a lot of attractions, rather than static simple surrounding still-based panoramas based on the roads displayed on the map through the web, and thus surpass the existing limited panoramic viewing viewpoint service. There is an advantage that a service is created and provided to a user.

In addition, the present invention provides a storytelling panorama content authoring tool (tool) to users via the web, a plurality of users can participate in the storytelling of a specific region taken as a video panorama can be utilized as a collaborative storytelling system There is an advantage.

In addition, the present invention is to change the point of view automatically through the advertisement for the shop of the location, etc., the effect of providing an advertisement service in the state of viewing the actual location and surroundings, rather than the existing pop-up advertising on the web. There is.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate preferred embodiments of the invention and, together with the description, serve to further the understanding of the technical idea of the invention, And shall not be construed as interpretation.
1 is a flowchart showing a video panorama based storytelling type local information providing method according to an embodiment of the present invention;
2 is a view for explaining a storytelling panorama content authoring tool in a video panorama based storytelling type local information providing method according to an embodiment of the present invention;
FIG. 3 is a schematic flowchart illustrating a process of processing a panoramic viewing time service in a client terminal of a user in a video panorama based storytelling type local information providing method according to an embodiment of the present invention;
FIG. 4 is an exemplary view illustrating a panorama viewing viewpoint service performed on a client terminal of a user in a video panorama based storytelling type local information providing method according to an embodiment of the present invention;
5 is a schematic diagram illustrating a storytelling type local information providing system based on a video panorama according to an exemplary embodiment of the present invention.

Hereinafter, a preferred embodiment of a video panorama based storytelling type local information providing method and system according to the present invention will be described in detail.

1 is a flowchart illustrating a video panorama based storytelling type local information providing method according to an exemplary embodiment of the present invention. Referring to FIG. 1, in the video panorama based storytelling type local information providing method according to an exemplary embodiment of the present invention, first, GPS (Global Positioning System) coordinate data of a photographing point and bearing of a photographing view point are obtained. Predetermined specific regions are captured by the camera storing data in real time as a panoramic video (step S100).

In this case, the panoramic video photographed by the camera is encoded and encoded (step S120), and the GPS (Global Positioning System) coordinate data and bearing data of the viewpoint of capturing the view point are XML (eXtensible Markup Language). Is converted into a metadata file (step S140).

Then, the compression-encoded panoramic video file and the metadata file of the XML (eXtensible Markup Language) format are stored in a server (step S200).

Then, the panorama video and the metadata file respectively stored in the server are converted into a storytelling panoramic viewing point of view video file by using a map-based storytelling panoramic content authoring tool. Create (step S300).

Next, the storytelling panoramic video is provided to at least one or more of the following client terminals through HTTP (Hyper Text Transfer Protocol) (step S400).

Finally, the storytelling panoramic video is received by the client terminal (step S500).

In this case, the storytelling panoramic video is preferably provided to the client terminal through a streaming service.

Here, the streaming service is a wireless internet multimedia file format standard and describes element technology related to generation, transmission, and storage of multimedia data including video, and the like. MPEG-4 and H.264 storage for video are described. It describes voice media storage methods such as AAC (Advanced Audio Coding) audio, Adaptive Multi-Rate (AMR), Enhanced Variable Rate Coder (EVRC), 13k QCELP and Selectable Mode Vocoder (SMV).

Meanwhile, to implement a storytelling tourism system, the following procedure is followed.

First, shooting and information gathering (GPS, defense information), generating a basic meta file for the service, storing the meta-file for storytelling, and finally provides a storytelling viewing service.

Here, the shooting and information collection, after planning the story in the same way as the existing video production, and shoot the panorama video according to the shooting line. At this time, in addition to the panorama video shooting, the GPS information and the orientation information is stored together periodically (for example, 1 second unit).

In addition, the basic meta file for the service is generated, and the panorama video is stored using the existing video compression method (mp4, h.264, etc.), and the collected GPS information and the bearing information are in the XML format as shown in the following formula. Stored in a separate file from the video in the form of data.

<? xml version = "1.0" encoding = "UTF-8"?>

<FrameMetadata>

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "30“ timestamp = "0" />

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "30“ timestamp = "1" />

</ FrameMetadata>

(gps_X, gps_Y: GPS coordinates, orientation: azimuth, timestamp: duration of the video)

The saved video files and meta files are used for storytelling content authoring and viewer system.

The meta information storage for storytelling utilizes a panorama content authoring tool to generate a metafile for storytelling.

2 is a view for explaining a storytelling panorama content authoring tool in a video panorama based storytelling type local information providing method according to an embodiment of the present invention. Referring to FIG. 2, the content authoring tool may be provided based on a map and utilizing already stored GPS information and bearing information.

By using the recorded panorama video and metafile (periodically stored GPS, bearing information), the panorama image viewed at the corresponding position of the path and the predetermined interval (eg, 1 second unit) that captured the panorama image as shown in FIG. The bearing information can be expressed on the authoring tool.

For example, if the location (x1, y1) with a time of 3 seconds and the location information (x2, y2) to be viewed are stored in the DB, when the video panorama reaches the point of 3 seconds in the panorama service viewer (x1, y1) You can find the angle of rotation to look at (x2, y2) based on).

The linked information is stored in the authoring tool by adding the information of the point viewed in the metafile as shown in the following formula.

<? xml version = "1.0" encoding = "UTF-8"?>

<FrameMetadata>

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "10“ timestamp = "0" />

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "20“ timestamp = "1" />

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "90“ timestamp = "2" />

<KeyFrame gps_X = "126.xxx" gps_Y = "37. ***" orientation = "300“ timestamp = "3" view_X = "126.xxx" view_Y = "37.xxxxxx" />

</ FrameMetadata>

(gps_X, gps_Y: GPS coordinates, orientation: azimuth, timestamp: duration of the video), (view_X, view_Y: GPS coordinates of the point to be viewed)

FIG. 3 is a schematic flowchart illustrating a process of processing a panoramic viewing time service in a client terminal of a user in a video panorama based storytelling type local information providing method according to an embodiment of the present invention. Referring to FIG. 3, the step of receiving the storytelling panoramic video at the client terminal includes a first reception step of receiving the metadata file through the server and the storytelling provided through the server; A second panoramic video file is received by the client terminal.

That is, in the storytelling viewing service, the service viewer receives metadata generated by the content authoring tool before receiving the panorama video. GPS metadata, direction information, and GPS location information of the location to be viewed are acquired through metadata.

FIG. 4 is an exemplary view illustrating a panorama viewing viewpoint service performed on a client terminal of a user in a video panorama based storytelling type local information providing method according to an embodiment of the present invention. Referring to FIG. 4, when the panorama video is received through streaming, the view point may be automatically changed to refer to the metadata file to look at a specific location. The viewpoint change can be easily obtained by calculating the rotation angle toward the viewing direction from the current position and the camera initial viewing direction, using FIG. 6 and the following equation.

5 is a schematic diagram illustrating a storytelling type local information providing system based on a video panorama according to an exemplary embodiment of the present invention. Referring to FIG. 5, a video panorama based storytelling type local information providing system according to an exemplary embodiment of the present invention includes a camera 100, a server 200, an auxiliary server 300, and a client terminal 400. Comprised of components and described in detail as follows.

The camera 100 captures a predetermined region in real time as a video in a panorama form, and stores GPS (Global Positioning System) coordinate data and bearing data of a viewing point in real time.

The server 200 includes an input unit 210, an encoding unit 220, a conversion unit 230, a first storage unit 240, a second storage unit 250, and a provision unit 260.

The input unit 210 receives a panorama video captured by the camera 100 in a file format, and inputs GPS coordinate data and bearing data of a viewpoint.

The encoding unit 220 compressively encodes the panoramic video input through the input unit 210.

The conversion unit 230 is a GPS (Global Positioning System) coordinate data input through the input unit 210 and bearing (bearing) data of the view point (Viewpoint) is a metadata file of the ML (eXtensible Markup Language) format ( metadata file).

The first storage unit 240 stores the panoramic video compressed and encoded by the encoding unit 220.

The second storage unit 250 stores the metadata file converted by the conversion unit 230.

The providing unit 260 provides a storytelling type viewing point of view video generated by the auxiliary server 300 to at least one or more client terminals 400 through Hyper Text Transfer Protocol (HTTP).

The auxiliary server 300 is a storytelling panorama content authoring tool based on a predetermined map based on a map and the metadata file stored in the first storage unit 240 and the second storage unit 250, respectively. To create a storytelling panoramic viewing point (Viewing Point of view) video file.

The client terminal 400 is provided with the storytelling panoramic view point of view video provided by the server 200.

In this case, the storytelling panoramic viewing point of view video is provided to the client terminal 400 through a streaming service.

In the above, the present invention has been described based on the preferred embodiments, but the technical idea of the present invention is not limited thereto, and modifications or changes can be made within the scope of the claims. It will be apparent to those skilled in the art, and such modifications and variations will belong to the appended claims.

100: camera 200: server
210: input unit 220: encoding unit
230: conversion unit 240: first storage unit
250: second storage unit 260: providing unit
300: secondary server 400: client terminal

Claims (5)

In the method of providing a video panorama based storytelling type region information,
a) a panoramic video photographing step in which a predetermined specific region is photographed as a panoramic video by a camera storing GPS (Global Positioning System) coordinate data of a photographing point and bearing data of a photographing point in real time;
b) a panoramic video storing step of compressing and encoding the panoramic video photographed by the camera and storing the file as a file in a server;
c) Capture point GPS coordinate data and view point bearing data of the specific region captured by the camera are stored in the server as a metadata file in XML (eXtensible Markup Language) format. Storing a metadata file;
d) A story in which the panorama video and the metadata file respectively stored in the server are generated as a storytelling panoramic viewing point of view video file by a predetermined map-based storytelling panoramic content authoring tool. Generating a telling panorama video;
e) providing a storytelling panoramic video in which the storytelling panoramic video is provided to at least one or more of the following client terminals through a Hyper Text Transfer Protocol (HTTP); And
and f) receiving the storytelling panoramic video at the client terminal. The method of claim 1,
The storytelling panoramic video is a video panorama based storytelling type local information providing method, characterized in that provided to the client terminal through a streaming (streaming) service. The method of claim 1,
The step of receiving the storytelling panoramic video to the client terminal,
A first receiving step of receiving the metadata file to the client terminal through the server; And
And a second receiving step of receiving, by the client terminal, the storytelling panoramic video file provided through the server. In the system for providing a storytelling type region information based on video panorama,
A camera for capturing a predetermined specific region in real time as a video in a panorama form, and storing GPS coordinate data of a point to be photographed and bearing data of a view point;
A panoramic video captured by the camera is input in the form of a file, and an input unit for inputting GPS (Global Positioning System) coordinate data and bearing data of a view point, and the panorama input through the input unit An encoding unit for compressing and encoding a moving image, and the GPS (Global Positioning System) coordinate data input through the input unit and bearing data of a view point are metadata of an XML format (eXtensible Markup Language). A conversion unit for converting to a metadata file, a first storage unit for storing the panorama video compressed and encoded by the encoding unit, a second storage unit for storing the metadata file converted in the conversion unit, Write down the storytelling Viewing Point of view video generated by the secondary server through Hyper Text Transfer Protocol (HTTP) Providing one comprising a server provided to at least one client terminal;
The panoramic video and the metadata file respectively stored in the first storage unit and the second storage unit are storytelling panoramic viewing viewpoints by a predetermined map-based storytelling panoramic content authoring tool. A secondary server generated as a video file; And
A video panorama based storytelling type local information providing system comprising a client terminal provided with the storytelling type panoramic view point of view video provided by the server. 5. The method of claim 4,
The storytelling panoramic view point of view video is a video panorama based storytelling type local information providing system, characterized in that provided to the client terminal through a streaming (streaming) service.

Images