KR102542507B1 - Method and Apparatus for Providing Additional Information - Google Patents

Abstract

The present invention relates to a method for providing additional content information and an apparatus therefor, wherein, when providing a virtual reality (VR) video streaming service based on a panoramic video or 360 VR video, video content and a plurality of additional information according to the video content are provided. An image displaying additional information is produced by transmitting different video streams to the video reproducing device and displaying additional information corresponding to the viewing coordinates and playback time currently viewed by the user on a part of the screen where the video content is being played. The storage space for storage can be reduced, and even if the additional information is changed, only the additional information stream needs to be changed and sent, thereby reducing data traffic.

Description

Method and Apparatus for Providing Additional Information

The present invention relates to a method for providing additional content information and an apparatus therefor, and more particularly, when providing a VR (Virtual Reality) video streaming service based on a panoramic image or a 360 VR image, viewing coordinates of a content that a user is watching. and a method and apparatus for providing additional information according to reproduction time information.

The contents described in this part merely provide background information on the present embodiment and do not constitute prior art.

Recently, demand for virtual reality (VR) services that can experience what is possible inside a software program of a computer as if it were real through human senses such as vision and hearing using special glasses and gloves is increasing. there is.

In particular, as cameras that can shoot 360-degree videos have recently been developed and spread, interest in 360-degree VR services has become active. The use of the service is rapidly expanding.

However, in the current 360 video streaming service, when providing additional information according to the user's gaze, the entire content image had to be changed, so a large amount of server storage space is required to store all 360 video including additional information at each point of view. There was a problem.

In addition, whenever the user's viewpoint changes and additional information to be provided to the user changes, video content is changed and streamed, resulting in an increase in the amount of traffic.

Korean Patent Publication No. 10-2009-0030658 (Title: Additional information display method and video device thereof, 2009.03.25.)

The present invention has been proposed to solve the above problems, and video content including a panoramic image and additional information of the video content are separated and stored, and when a video reproducing device plays the content, the user currently watches and stores the content. It is intended to provide a method for providing additional content information and an apparatus therefor, which extracts additional information based on viewing coordinates and playback time information of video content, and displays the extracted additional information on one side of a screen on which video content is played. .

However, the object of the present invention is not limited to the above object, and other objects not mentioned will be clearly understood from the description below.

In order to achieve the above object, a method for providing additional content information according to an embodiment of the present invention is a method for providing additional content information in an image reproducing apparatus receiving video content including a panoramic image from a streaming server, including: Receiving and playing video content including a panoramic video requested by the video reproducing device from the streaming server, transmitting viewing coordinate information and playback time information of the currently playing video content to the streaming server, The method may include requesting transmission of additional information matched with coordinate information and play time information, and receiving and outputting the additional information transmitted from the streaming server according to the request.

In this case, the outputting may be performed by overlaying the reproduced video content screen according to the output location information included in the additional information, and the outputting may be performed after dividing the screen of the video reproducing device into two or more screens. , the additional information can be output on any one of the two or more screens.

In the outputting, the additional information may be output when a difference between the play time information of the received additional information and the current play time of the video content is within a certain range.

In order to achieve the above object, a method for providing additional content information according to the present invention is a method for providing additional content information in a streaming server that provides video content including a panoramic image to an image reproducing apparatus, wherein the video playback Upon receiving a transmission request for video content including a panoramic image from the device, providing the video content to the video reproducing device and based on viewing coordinate information and playback time information of the video content received from the video reproducing device. and extracting additional information and transmitting the extracted additional information to the video reproducing apparatus.

In this case, the method may further include storing additional information related to the video content by dividing it into viewing coordinate information and playback time information, wherein the additional information is displayed on the entire screen of the video reproducing device. It may include output location information indicating the location.

Meanwhile, the above-described method for providing additional content information may be provided as a computer-readable recording medium in which a program for executing the above-described method is recorded, and implemented to execute the above-described method and stored in a computer-readable recording medium. It may also be provided as a computer program.

A video reproducing apparatus according to the present invention for achieving the above object is a video reproducing apparatus receiving video contents including a panoramic image from a streaming server, which transmits and receives data with the streaming server in conjunction with a communication network. When video content including a panoramic image is requested and received from the first communication module and the streaming server, the video content is played, viewing coordinate information and playback time information of the currently played video content are transmitted, and the streaming A control module for requesting a server to transmit additional information matching the viewing coordinate information and play time information, and receiving and outputting the additional information according to the request.

In this case, a second communication module for transmitting and receiving data with the auxiliary video reproducing device may be further included, and the control module may play the video content through the auxiliary video reproducing device and output the additional information.

A streaming server according to the present invention for achieving the above object is a streaming server for providing video content including a panoramic image to a video reproducing apparatus, which transmits and receives data with the video reproducing apparatus in conjunction with a communication network. The communication module and the video reproducing device provide video content including a panoramic image requested by the video reproducing device, receive viewing coordinate information and playback time information of the video content from the video reproducing device, and display the viewing coordinate information and playback time information. Based on this, a control module for extracting additional information and controlling transmission of the extracted additional information to the video reproducing apparatus may be included.

According to the present invention, video content and a plurality of additional information according to the video content are transmitted to a video reproducing apparatus as different video streams, and viewing coordinates and viewing coordinates currently viewed by a user are displayed on a part of the screen on which the video content is being reproduced. By displaying the additional information corresponding to the playback time, the storage space for storing the video displaying the additional information can be reduced, and even if the additional information is changed, only the additional information stream needs to be changed and sent, thereby reducing data traffic. there is.

In addition, various effects other than the above effects may be disclosed directly or implicitly in detailed descriptions according to embodiments of the present invention to be described later.

1 is a diagram showing the main configuration of a system for providing additional content information according to an embodiment of the present invention.
Figure 2 is a block diagram for explaining the main configuration of the video reproducing apparatus according to the present invention.
Figure 3 is a block diagram for explaining the main configuration of the streaming server according to the present invention.
4 is a data flow diagram illustrating an embodiment of a method for providing additional content information according to the present invention.
5A to 6 are exemplary diagrams for explaining an embodiment according to the present invention.

In order to clarify the characteristics and advantages of the problem solving means of the present invention, the present invention will be described in more detail with reference to specific embodiments of the present invention shown in the accompanying drawings.

However, detailed descriptions of well-known functions or configurations that may obscure the gist of the present invention will be omitted in the following description and accompanying drawings. In addition, it should be noted that the same components are indicated by the same reference numerals throughout the drawings as much as possible.

The terms or words used in the following description and drawings should not be construed as being limited to a common or dictionary meaning, and the inventor may appropriately define the concept of terms for explaining his/her invention in the best way. It should be interpreted as a meaning and concept consistent with the technical idea of the present invention based on the principle that there is. Therefore, the embodiments described in this specification and the configurations shown in the drawings are only one of the most preferred embodiments of the present invention, and do not represent all of the technical ideas of the present invention. It should be understood that there may be equivalents and variations.

In addition, embodiments within the scope of the present invention include computer-readable media having or conveying computer-executable instructions or data structures stored thereon. Such computer readable media can be any available media that can be accessed by a general purpose or special purpose computer system. By way of example, such computer readable media may be in the form of RAM, ROM, EPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage, or computer executable instructions, computer readable instructions or data structures. physical storage media such as, but not limited to, any other medium that can be used to store or convey any program code means in a computer system and which can be accessed by a general purpose or special purpose computer system. .

In the following description and claims, it is assumed that an image transmitted according to the present invention is a 360-degree VR (Virtual Reality) image.

However, even if it is not a 360 video, if it is video content such as a panoramic video, in which viewing coordinates or viewpoints of the user can be changed according to the user's input, any video can be transferred from the streaming server to the video playback device according to the embodiment of the present invention. It can be a video to be transmitted.

Meanwhile, viewing coordinates described in the present invention may be expressed based on various types of coordinate systems. For example, in one embodiment, it may be expressed in a three-dimensional orthogonal coordinate system and transmitted in the form of (x, y, z), or it may be transmitted as angle information based on a spherical coordinate system. In addition, in the present invention, viewing coordinates are information representing a region viewed by a viewer in a 360-degree video, and may be defined as center coordinates of an image being played in the video reproducing apparatus 300.

In the present invention, for convenience of description, it is described that information of an angle corresponding to viewing coordinates is transmitted to a streaming server.

However, when transmitted in the form of (x, y, z), the streaming server may change the coordinates into angle information.

On the other hand, the viewing coordinates described in the present invention indicate how far a viewing point of a 360 video currently viewed by a user is from an image reference point in the x-axis, y-axis, and z-axis, respectively.

In general, the image reference point may be an origin coordinate of viewing coordinates, that is, (0,0,0), and may correspond to 0 degrees as a viewing angle.

Now, a content providing method according to an embodiment of the present invention will be described in detail with reference to the drawings.

1 is a diagram showing the configuration of a system for providing additional content information in a streaming service according to an embodiment of the present invention.

Referring to FIG. 1 , a system for providing additional content information according to the present embodiment may include a video reproducing device 200 and a streaming server 300, and the video reproducing device 200 and the streaming server (300) can transmit and receive data through the communication network (100).

Then, with reference to FIG. 1, each component will be schematically described.

First, the communication network 100 serves to transmit data for data transmission and reception between the video playback device 200 and the streaming server 300, and depending on the system implementation method, Ethernet, xDSL (ADSL, VDSL), HFC (Hybrid Fiber Coaxial Cable), FTTC (Fiber to The Curb), FTTH (Fiber To The Home), etc. Wireless communication methods such as Wimax, High Speed Downlink Packet Access (HSDPA), Long Term Evolution (LTE), and Long Term Evolution Advanced (LTE-A) may be used. In addition to the above communication methods, other widely known or future It can include all types of communication methods to be developed.

The video reproducing device 200 refers to a user's device capable of transmitting and receiving various data to and from the streaming server 300 through the communication network 100 according to a user's manipulation.

Such an image reproducing apparatus 200 can perform voice or data communication through the communication network 100, a memory for storing programs and protocols for transmitting and receiving and processing data, and a microcomputer for calculating and controlling various programs by executing them. A processor or the like may be provided. In addition, the video reproducing apparatus 200 of the present invention may be implemented in various forms. For example, the video reproducing apparatus 200 described herein is a mobile terminal such as a smart phone, a tablet PC, a personal digital assistant (PDA), a portable multimedia player (PMP), or an MP3 player. Of course, a fixed terminal such as a smart TV, a laptop computer, or a desktop computer may be used, and any device capable of transmitting and receiving data according to the present invention may be used as an embodiment of the present invention. It can be used as the video reproducing apparatus 200 according to.

Meanwhile, the video reproducing apparatus 300 according to the present invention requests the streaming server 400 to transmit video contents including a panoramic video according to a user's input, and provides the contents in a streaming method from the streaming server 400 can be received and played.

Further, while receiving content from the streaming server 400, requesting transmission of additional information matching the viewing coordinates and playback time of the currently playing video content, receiving the additional information, together with the video content provided through the streaming method. can be displayed

Finally, the streaming server 300 streams content data such as videos stored in the streaming server 300 or received from an external device such as a video recording device (not shown) through the communication network 100 to a video playback device. It is a device for transmitting to (200).

In particular, the streaming server 300 according to the present invention transmits video content in a streaming manner according to the request of the video reproducing device 200 to stream 360 video content, and viewing coordinate information and playback time from the video reproducing device 200. When information is received, additional information matching the received viewing coordinate information and playback time information may be extracted, and the extracted additional information may be transmitted to the video reproducing apparatus 200 .

Here, the additional information may be information about a playback time of video content viewed by the user and an object appearing in viewing coordinates, or information about a region or place appearing in the playback time and viewing coordinates.

For example, if a celebrity or an athlete is appearing in the video content of the viewing coordinates and playback time currently watched by the user, information about the celebrity or athlete may be present, and the clothes worn by the celebrity or athlete or a watch It may be information about an accessory such as

In addition, information about the video content area may be output as additional information, such as converting information such as viewing coordinates of the video content currently viewed by the user, playback time, and quality of the corresponding video content into text and outputting the information as additional information.

In addition, information about the background appearing in the video content at the viewing coordinates and playback time currently viewed by the user may be output as additional information.

For example, if the 'Alps Mountains' of 'Switzerland' are reproduced in the video content of the viewing coordinates and playback time currently watched by the user, additional information about 'Switzerland' or 'Alps Mountains' is displayed. can be output.

Similarly, if the user watches a baseball game during a sports game, information on the field and club where the current baseball game is played can be output as additional information, and if the viewing coordinates of the user are toward the first-base spectator seat, the first-base spectator seat It is also possible to output additional information such as the number of spectators filling the room and the current status of empty seats.

Hereinafter, detailed operation procedures of the video reproducing apparatus 200 and the streaming server 300 according to the present invention will be described later.

2 is a block diagram for explaining the configuration of the video reproducing apparatus 200 according to the present invention.

Referring to FIG. 2 , the image reproducing apparatus 200 may include an input module 210, an output module 230, a storage module 250, a communication module 270, and a control module 290.

The input module 210 receives various information such as numbers and text information, and transfers input signals to the control module 290 in relation to setting various functions and controlling functions of the video reproducing apparatus 200 .

In particular, in the present invention, the input module 210 detects a change in user's behavior or an arbitrary input, and sends a signal to the control module 290 to receive additional information according to the viewpoint of the image output through the output module 230. convey

The output module 230 displays information about a series of operation states and operation results generated while the video reproducing apparatus 200 performs functions. Also, the output module 230 may display the menu of the image reproducing apparatus 200 and user data input by the user.

In particular, in the present invention, the output module 230 outputs the viewpoint of the video transmitted from the streaming server 300 through the communication module 270 under the control of the control module 290, and at the same time, from the streaming server 300 Outputs the additional information provided.

The storage module 250 may store streaming content received through the communication module 270 .

The communication module 270 may be divided into a first communication module 271 and a second communication module 273. The first communication module 271 transmits and receives data with the streaming server 300 through the communication network 100. and the second communication module 273 is for transmitting and receiving data with an auxiliary video reproducing device (not shown) through short-distance wireless communication or wired communication.

The auxiliary video reproducing device is to assist the output module 230 of the video reproducing device 200, and instead of the output module 230 or together with the output module 230, the video content requested by the user is transmitted from the auxiliary video reproducing device. can be printed out.

At this time, the auxiliary video reproducing device may be connected to the video reproducing device 200 through short-range wireless communication such as Bluetooth or Zigbee, and may reproduce the video by changing the viewpoint of the content according to the user's input or movement, Additional information provided by the streaming server 300 may be received and output through the video reproducing device 200 .

These auxiliary video reproducing devices may include VR devices such as virtual reality glasses.

The control module 290 is a device for controlling the overall operation process of the video reproducing apparatus 200 according to the present invention, and transmits a content streaming request and current user viewing coordinate information and playback time information to the streaming server 300, Control may be performed to display additional information matching the viewing coordinate information and play time information together with video content.

Specifically, the video reproducing device 200 requests the streaming server 300 to stream video contents including panoramic images, and upon receiving the requested video contents from the streaming server 300, outputs the video contents. It is reproduced through the module 230 or an auxiliary video playback device (not shown).

And the user's viewing point, that is, information about the viewing coordinates and playback time of the currently played video content is transmitted to the streaming server 300 to request transmission of additional information matching the viewing coordinate information and playback time information, When additional information is received from the streaming server 300 according to the request, it is output together with video content.

At this time, in order to output the additional information together with the video content, the video reproducing apparatus 200 divides the screen on which the video content is reproduced into two or more screens, and outputs the additional information to any one of the two or more divided screens. and output video content to any other screen.

In addition, if the viewing point of the user is changed or the playback time is changed as time passes and the playback time without additional information comes, the divided screens can be merged into one and only the video content can be output on the entire screen.

In addition to the method of dividing the screen to output the additional information together with the video content, the additional information received from the streaming server 300 may be overlaid and output while the video content is displayed on the entire screen.

At this time, the position where the additional information is overlaid may be fixed to the lower right corner of the entire screen, but may be dynamically changed and overlaid on a part of the entire screen according to the characteristics of the additional information and the video content currently being played. , In this case, the output location information included in the additional information may be extracted, and the additional information may be dynamically overlaid on a location indicated by the output location information according to the output location information.

On the other hand, there may occur a case in which additional information is received by the video reproducing apparatus 200 after a point in time at which it should be displayed has elapsed due to a network state or a user's quick change of point of view.

For example, the streaming server 300 was requested to transmit additional information matching the coordinates (x1, y1, z1) corresponding to an angle of 120 degrees from the video reference point and the playback time of 53 minutes and 03 seconds, If the additional information was received around 55 minutes due to a bad network condition, or immediately after the user quickly changed the viewpoint and sent the request, any coordinate (x2, y2, z2) corresponding to an angle of 180 degrees from the video reference point If the coordinates are changed, outputting the received additional information may cause more confusion to the user.

Therefore, in order to prevent such a case, the video playback device 200 compares the playback time information of the additional information received from the streaming server 300 with the current playback time of the video content, and if the difference is within a certain range, the It is possible to output additional information and control not to output additional information when out of the range.

Similarly, the video reproducing apparatus 200 compares the viewing coordinate information of the additional information with the current viewing coordinates of the video content, outputs the additional information if the difference is within a certain range, and outputs the additional information if the difference is out of the range. You can control not to do that.

In the above, the main components of the video reproducing apparatus 200 in the content supplementary information providing system according to the present invention have been reviewed.

Hereinafter, a look at the main configuration of the streaming server 300 according to the present invention.

Figure 3 is a block diagram showing the main configuration of the streaming server 300 according to the present invention.

Referring to FIG. 3 , the streaming server 300 may include a storage module 310 , a communication module 330 and a control module 350 .

The storage module 310 is a device for receiving and storing a captured image from an external device such as an image capture device (not shown), and may store 360 image content and additional information according to each image content.

At this time, the storage module 310 may store additional information related to video content by dividing it into viewing coordinate information and playback time information.

The communication module 330 is for transmitting and receiving data with the video reproducing apparatus 200 through the communication network 100, and streams 360 video contents and additional information thereof to the video reproducing apparatus 200, or the video reproducing apparatus 200 ), a streaming request, viewing coordinate information, and playback time information may be received.

Meanwhile, the communication module 330 may receive a 360 video or panoramic image captured by an external device such as an image capturing device (not shown), and may receive additional information according to the video from the external device.

The control module 350 is a device for controlling the overall operation process of the streaming server 300 according to the present invention.

Looking at the overall operation process of the streaming server 300 operated by the control module 350, the streaming server 300 responds to a transmission request of video content including a panoramic video from the video reproducing device 200. , The video content is provided to the video reproducing apparatus 200 .

Thereafter, based on the viewing coordinate information and playback time information of the video content transmitted by the video reproducing apparatus 200, additional information matching the extracted additional information is extracted, and the extracted additional information is transmitted to the video reproducing apparatus 200.

At this time, the additional information transmitted to the video reproducing apparatus 200 includes viewing coordinate information at which the additional information should be displayed, reproduction time information, and an output position indicating a location on the entire screen of the video reproducing apparatus 200 where the additional information is to be output. information, and such viewing coordinate information, playback time information, and output location information can be classified and controlled to be stored in the storage module 310 .

Above, the main configuration of the streaming server 300 according to the present invention has been looked at.

Hereinafter, a method for providing additional content information according to an embodiment of the present invention will be described in detail.

4 is a data flow diagram illustrating a method for providing additional content information according to an embodiment of the present invention, and FIG. 5 is an embodiment of matching and storing additional information according to video content with viewing coordinates, play time information, and output location information. 6A to 6D are diagrams for explaining an embodiment in which additional information is displayed together with video content.

First, referring to FIG. 4 , the video reproducing apparatus 200 requests the streaming server 300 to stream video contents including panoramic images such as 360 video contents (S101), and the streaming server 300 streams the corresponding content to the video reproducing device 200 according to the request (S103).

Then, the video reproducing apparatus 200 receiving the video contents in a streaming manner outputs the video contents (S105).

Thereafter, the video reproducing device 200 requests additional information from the streaming server 300. At this time, viewing coordinate information and playback time information of the video content currently being played are transmitted together to view the viewing coordinate information and playback time information. Request to transmit additional information matching with (S107).

Upon receiving the request, the streaming server 300 extracts additional information matching the viewing coordinate information and playback time information received along with the request, and transmits the extracted additional information to the video reproducing device 200 (S109), the streaming server 300 may separately store viewing coordinates, playback time, output location, etc. to which each additional information should be displayed, as shown in FIG. Additional information corresponding to viewing coordinate information and playback time information received from the playback device 200 may be extracted and transmitted to the video playback device 200 .

이고, 재생 시간 정보가 '1:10:05'라면 스트리밍 서버(300)는 'B타자'에 관한 부가 정보를 추출하여, 영상 재생 장치(200)에 전송한다.For example, viewing coordinate information received from the video reproducing apparatus 200 is (

, and if the playback time information is '1:10:05', the streaming server 300 extracts additional information about 'B' and transmits it to the video playback device 200.

Also, the video reproducing apparatus 200 receiving the additional information may overlay the received additional information on the screen on which the video content is displayed and output it (S111).

In this case, the additional information to be overlaid may be fixedly output to a designated area of the screen on which video content is output.

Referring to FIG. 6A, a location for outputting additional information 500 is designated on the lower right side of the entire screen 400 where video content is output, and accordingly, the video reproducing apparatus 200 exposes the additional information at the designated location. ) can be controlled.

In addition to this, the position of the additional information can be dynamically adjusted. In this case, as shown in the table of FIG. 5, output position information indicating the position to output the additional information for each additional information according to the characteristics and configuration of the video content to be output. is matched and stored for each additional information, and when the streaming server 300 provides the additional information, the video reproducing device 200 extracts the output location information included in the additional information and reproduces the output location information according to the output location information. It can be overlaid on the video content screen.

이고, 재생 시간 정보가 '1:10:05'라면, 스트리밍 서버(300)는 이러한 정보를 영상 재생 장치(200)로부터 수신하고, 이에 따라, B 타자 부가 정보를 영상 재생 장치(200)에 제공하며, B타자 부가 정보에 포함된 출력 위치 정보의 좌표(x2, y2, z2)에 따라, 영상 컨텐츠 전체 화면(400) 중, (x2, y2, z2)에 대응하는 위치에 B타자 부가 정보(500)를 오버레이하여 출력한다.Specifically, referring to FIGS. 5, 6B, and 6C, the viewing coordinates of the video content that the user is watching in FIG. 6B are (

, and if the play time information is '1:10:05', the streaming server 300 receives this information from the video reproducing apparatus 200, and accordingly, provides B batter additional information to the video reproducing apparatus 200. And, according to the coordinates (x2, y2, z2) of the output location information included in the additional information for typing B, the additional information for typing B at a position corresponding to (x2, y2, z2) of the entire screen 400 of the video content ( 500) is overlaid and output.

이고, 재생 시간 정보가 '1:20:07'이라면, 스트리밍 서버(300)는 영상 재생 장치(200)에 D투수 부가 정보를 제공하고, 영상 재생 장치(200)는 D 투수 부가 정보의 출력 위치 정보인 (x4, y4, z4)의 좌표에 따라, 전체 화면(400) 중, (x4, y4, z4)에 대응하는 위치에 D 투수 부가 정보를 오버레이하여 출력함으로써, 부가 정보 출력 위치를 동적으로 구성할 수 있다.Now, looking at Figure 6c, the viewing coordinates of the video content that the user is watching (

And, if the playback time information is '1:20:07', the streaming server 300 provides D pitcher additional information to the video reproducing device 200, and the video reproducing device 200 outputs the D pitcher additional information. According to the coordinates of information (x4, y4, z4), D pitcher additional information is overlaid and output at a position corresponding to (x4, y4, z4) in the entire screen 400, thereby dynamically outputting additional information. can be configured.

Meanwhile, other than the method of outputting additional information by overlaying it on the entire screen 400, after dividing the entire screen 400 into two or more, outputting additional information on one of the two or more screens, and then displaying the additional information on any other screen. In contrast, as an example through FIG. 6D, when the video reproducing apparatus 200 receives the additional information of type B, the entire screen 400 is divided into two screens left and right. Later, additional information 500 may be output on the right screen, and video content may be output on the left screen.

On the other hand, due to the delay time required for the video reproducing device 200 to request additional information and receive it from the streaming server 300 when the network condition is poor or the viewpoint of the 360 video being watched by the user changes quickly. However, there may occur a case in which additional information is received after a time to output the already requested additional information has elapsed.

For example, the user watches with the viewpoint of batter B and requests additional information about batter B, but due to the delay time, the additional information is received after the user changes the viewpoint to pitcher D, or B In this case, additional information about batter B is received after the batter is replaced by batter A.

In this case, if the additional information of batter B is output as it is, it may increase confusion to the user, so it may be better not to output the additional information of batter B.

Accordingly, when receiving additional information from the streaming server 300, the video reproducing apparatus 200 compares the reproduction time information of the received additional information with the reproduction time output by the video reproducing apparatus 200, and determines the difference between the two times. The received additional information may be output when is within a certain range, and the additional information may not be output when it is out of a certain range.

Similarly, the video reproducing apparatus 200 compares the viewing coordinate information of the received additional information with the viewing coordinates of the video content being output by the video reproducing apparatus 200, and when the difference between the two viewing coordinates is within a certain range, the received Additional information may be output, and the additional information may not be output when it is out of a certain range.

That is, if the difference between the set playback times is 30 seconds and the video reproducing apparatus 200 receives the additional information for the player B of FIG. 5 and the playback time of the current video content is '1:10:40', the additional information for the player B Since there is a difference of 35 seconds from '1:10:05', which is the playback time information of ', and a difference of more than 30 seconds, the video reproducing apparatus 200 does not output additional information for typing B. If the playback time of the current video content is '1:10:20', there is a difference of 15 seconds and is included within a certain range of 30 seconds, so the video reproducing apparatus 200 will output additional information for typing B.

As another example, if the certain range of the viewing coordinates set by converting to angular coordinates is 30 degrees, and the difference between the viewing coordinates of the currently played video content and the viewing coordinate information of the additional information of type B is 25 degrees, the video reproducing apparatus 200 If the difference between the viewing coordinates of the current video content and the viewing coordinates of the additional information of the other player B is 50 degrees, the video reproducing apparatus 200 outputs the additional information of the other player B and the additional information of the other player B is out of 30 degrees. do not output

As set forth above, while this specification contains many specific implementation details, they should not be construed as limiting as to the scope of any invention or claimables, but rather as may be specific to a particular embodiment of a particular invention. It should be understood as a description of the features.

Further, while operations are depicted in the drawings in a specific order, it should not be understood that all illustrated operations must be performed or that those operations must be performed in the specific order shown or in sequential order to obtain desired results. In certain cases, multitasking and parallel processing can be advantageous. Further, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. You have to understand that you can.

The present description presents the best mode of the invention and provides examples to illustrate the invention and to enable those skilled in the art to make and use the invention. The specification thus prepared does not limit the invention to the specific terms presented. Therefore, although the present invention has been described in detail with reference to the above-described examples, a person skilled in the art may make alterations, changes, and modifications to the present examples without departing from the scope of the present invention.

Therefore, the scope of the present invention should not be determined by the described embodiments, but by the claims.

The present invention relates to a method for providing additional content information and an apparatus therefor, and more particularly, when providing a VR (Virtual Reality) video streaming service based on a panoramic image or a 360 VR image, viewing coordinates of a content that a user is watching. and a method and apparatus for providing additional information according to reproduction time information.

According to the present invention, video content and a plurality of additional information according to the video content are transmitted to a video reproducing apparatus as different video streams, and viewing coordinates and viewing coordinates currently viewed by a user are displayed on a part of the screen on which the video content is being reproduced. By displaying the additional information corresponding to the playback time, the storage space for storing the video displaying the additional information can be reduced, and even if the additional information is changed, only the additional information stream needs to be changed and sent, thereby reducing data traffic. there is.

Therefore, it is possible to contribute to the development of the streaming service industry through the above method of providing additional content information, and in addition, the present invention has industrial applicability because it has a sufficient possibility of commercialization or business and can be clearly implemented in reality.

100: communication network 200: video playback device 300: streaming server
210: Input module of video playback device 230: Output module of video playback device
250: storage module of video playback device 270: communication module of video playback device
290: control module of video playback device 310: communication module of streaming server
330: storage module of streaming server 350: control module of streaming server

Claims (12)

A method for providing additional content information in a video reproducing apparatus receiving panoramic or 360-degree VR video contents from a streaming server,
receiving, from the streaming server, panorama or 360-degree VR video content requested by the video reproducing device, and playing the video content;
transmitting, by the video reproducing device, viewing coordinate information and playing time information of currently played video content, and requesting transmission of additional information matching the viewing coordinate information and playing time information to the streaming server; and
Receiving and outputting additional information transmitted from the streaming server according to the request;
including,
wherein the outputting of the additional information overlays the reproduced image content screen according to the output location information included in the additional information. delete The method of claim 1, wherein the outputting
and dividing the screen of the video reproducing device into two or more screens and then outputting the additional information on one of the two or more screens. The method of claim 1, wherein the outputting
and outputting the additional information when a difference between the playback time information of the received additional information and the current playback time of the video content is within a predetermined range. A method for providing additional content information in a streaming server that provides panoramic or 360-degree VR video content to a video reproducing device,
providing the video content to the video playback device when the streaming server receives a transmission request for panoramic or 360-degree VR video content from the video playback device; and
extracting additional information based on viewing coordinate information and playback time information of the currently played video content received from the video reproducing device, and transmitting the extracted additional information to the video reproducing device;
including,
The additional information providing method of claim 1 , wherein the additional information includes output position information indicating a position where the additional information is output on the entire screen of the video reproducing apparatus. According to claim 5,
The method of providing additional content information, further comprising dividing the additional information related to the image content into viewing coordinate information and playback time information and storing the additional information. delete A computer-readable recording medium in which a program for executing the method according to any one of claims 1, 3 to 6 is recorded. A computer program implemented to execute the method according to any one of claims 1, 3 to 6 and stored in a computer-readable recording medium. In a video playback device receiving panoramic or 360 degree VR video content from a streaming server,
A first communication module for transmitting and receiving data to and from the streaming server in conjunction with a communication network; and
When panoramic or 360-degree VR video content is requested and received from the streaming server, the video content is played, and viewing coordinate information and playback time information of the video content currently being played are transmitted to the streaming server to view the viewing coordinate information and A control module that requests transmission of additional information matching playback time information, receives the additional information in response to the request, and controls to overlay and output the image content screen being played according to output location information included in the additional information. ;
Video playback device comprising a. According to claim 10,
a second communication module for transmitting and receiving data to and from the auxiliary image reproducing device;
Further comprising, the control module
The video reproducing device characterized in that the video content is reproduced through the auxiliary video reproducing device and controlled to output the additional information. In a streaming server that provides panoramic or 360 degree VR video content to a video reproducing device,
a communication module interworking with a communication network to transmit/receive data with the video reproducing device; and
Provides panoramic or 360-degree VR video content requested by the video playback device, receives viewing coordinate information and playback time information of the video content currently being played from the video playback device, and based on the viewing coordinate information and playback time information a control module for extracting additional information and controlling transmission of the extracted additional information to the video reproducing apparatus;
including,
The streaming server of claim 1, wherein the additional information includes output position information indicating a position where the additional information is to be output on the entire screen of the video reproducing apparatus.

Images