KR20170045633A - Method for providing panoramic video service, panoramic video providing server and system - Google Patents

Method for providing panoramic video service, panoramic video providing server and system Download PDF

Info

Publication number
KR20170045633A
KR20170045633A KR1020150145530A KR20150145530A KR20170045633A KR 20170045633 A KR20170045633 A KR 20170045633A KR 1020150145530 A KR1020150145530 A KR 1020150145530A KR 20150145530 A KR20150145530 A KR 20150145530A KR 20170045633 A KR20170045633 A KR 20170045633A
Authority
KR
South Korea
Prior art keywords
partial image
fov
stream
user device
area
Prior art date
Application number
KR1020150145530A
Other languages
Korean (ko)
Inventor
허윤범
김이길
백규태
천왕성
Original Assignee
주식회사 케이티
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 케이티 filed Critical 주식회사 케이티
Priority to KR1020150145530A priority Critical patent/KR20170045633A/en
Publication of KR20170045633A publication Critical patent/KR20170045633A/en

Links

Images

Classifications

    • H04N5/232—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H04N5/23238—
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2624—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects for obtaining an image which is composed of whole input images, e.g. splitscreen

Abstract

A method of providing a panoramic video service performed by a panoramic image processing server includes dividing a whole output region of a panoramic image having a reproduction length T into a plurality of FOV (Field Of View) regions, Generating at least one stream having a reproduction length T * N by combining N of each partial image having a reproduction length T, and transmitting at least one stream to the user device.

Description

TECHNICAL FIELD [0001] The present invention relates to a panoramic video service providing method, a panoramic video providing server, and a method for providing a panoramic video service,

The present invention relates to a panoramic video service providing method, a panoramic video providing server and a system, which are performed in a panoramic image processing server.

Along with the growth of the media industry, the requirements of users who watch TV are also changing. There has been an increasing demand for realistic contents (panoramic video images) that users are experiencing directly by watching TV through a conventional TV screen viewing and by not watching broadcast contents.

On the other hand, the panoramic video image is a multi-view video image, for example, a 360-degree direction image. Panoramic video images can be generated by geometric correction and spatial synthesis of images taken by one or more cameras. A panoramic video image can contain, for example, a 360-degree video image based on a camera.

Such a panoramic video image has a much wider range than the angle of view of a general image, and it is possible to produce a more realistic image than a general image by using a special device and a method of moving a viewpoint.

However, there are technological and economic difficulties in processing a large-capacity image such as sensible contents through a conventional digital broadcasting system and a set-top box.

Korean Patent Publication No. 2012-0058763 discloses a video apparatus that receives image data, divides the image into a plurality of regions, sets numbering or coordinates in the divided regions, and the video apparatus sequentially selects divided regions , And encodes the selected area at the maximum resolution that supports it.

A total output area of the panoramic image is divided into a plurality of FOV (Field Of View) areas, and a plurality of FOV areas are combined to generate a stream and transmit it to the user device. In addition, when the user moves the viewpoint, the user device pre-decodes a plurality of FOV areas adjacent to the current viewing area to perform screen switching of the panoramic image without delay. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to a first aspect of the present invention, there is provided a method for providing a panoramic video service performed by a panoramic image processing server, the method comprising: Generating at least one stream having a reproduction length T * N by combining N of each partial image having a reproduction length T corresponding to each FOV area; And transmitting one stream to the user device.

According to a second aspect of the present invention, there is provided a panoramic video providing system including a panoramic video providing server and a user device, wherein the panoramic video providing server includes a panoramic video providing server (FOV) area, and N pieces of partial images each having a reproduction length T corresponding to each FOV area are combined to generate at least one stream having a reproduction length T * N Wherein the user device comprises a transceiver for receiving the at least one stream from the panoramic video providing server, an output for outputting the stream, and a transmitter for transmitting the at least one stream to the user device, And an interface unit for receiving user input for the stream.

The panoramic video providing server providing the panoramic video service according to the third aspect of the present invention divides the entire output region of the panoramic image having the reproduction length T into a plurality of FOV (Field Of View) regions A stream generating unit for generating at least one stream having a reproduction length T * N by combining N of each partial image having a reproduction length T corresponding to each divided FOV area, and a transmitting unit for transmitting the at least one stream to the user device And a transmission / reception unit.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-described objects of the present invention, a whole output area of a panoramic image is divided into a plurality of FOV (Field Of View) areas, a plurality of FOV areas are combined to generate a stream, To the device. In addition, when the user moves the viewpoint, the user device can decode a plurality of FOV areas adjacent to the current viewing area in advance to perform screen switching of the panoramic image without delay, thereby minimizing the quality degradation due to the screen break.

1 is a configuration diagram of a panoramic video providing system according to an embodiment of the present invention.
FIG. 2 is a block diagram of the panoramic video providing server shown in FIG. 1 according to an embodiment of the present invention.
3 is a block diagram of a user device, in accordance with an embodiment of the invention.
4 is a diagram for explaining a method of dividing a panoramic image into FOV regions according to an embodiment of the present invention.
5A and 5B are diagrams for explaining a method of generating a stream for a panoramic image according to an embodiment of the present invention.
6A and 6B are views for explaining a method of selecting a plurality of partial images according to a viewpoint movement of a panoramic image, according to an embodiment of the present invention.
7 is a flowchart illustrating a method of providing a panoramic video service performed by a panoramic image processing server according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.

1 is a configuration diagram of a panoramic video providing system according to an embodiment of the present invention.

Referring to FIG. 1, the panoramic video providing system may include a panoramic image processing server 100 and a user device 110. However, since the panoramic video providing system of FIG. 1 is only one embodiment of the present invention, the present invention is not limited to FIG. 1 and may be configured differently from FIG. 1 according to various embodiments of the present invention. It is possible.

The panoramic image processing server 100 may provide a field of view (FOV) in a panoramic image, and may be a server that provides a partial image according to a user's viewpoint in real time according to a user's input request.

More specifically, the panoramic image processing server 100 can divide the entire output region of the panoramic image into a plurality of FOV regions.

The panoramic image processing server 100 can generate at least one stream by combining the partial images corresponding to the respective FOV regions.

The panoramic image processing server 100 may transmit at least one stream to the user device 110. [

The panoramic image processing server 100 transmits the partial image and the partial image adjacent to the partial image to the user device 110 according to a request for outputting a partial image included in the stream received from the user device 110 .

The user device 110 may receive at least one stream from the panoramic video providing server 100.

The user device 110 can output the stream received from the panoramic video providing server 100. [

User device 110 may receive user input for the stream.

The user device 110 may transmit a partial image output request to the panoramic image processing server 100 when the user requests input of a partial image.

The user device 110 receives the partial image requested by the user from the panoramic image processing server 100 and the partial image adjacent to the partial image, and can decode the received partial image in advance.

In general, the components of the panoramic video providing system of FIG. 1 are connected through a network 120. A network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. An example of such a network is a wired LAN, a 3rd Generation Partnership Project (3GPP) Term Evolution, World Interoperability for Microwave Access (WIMAX), Wi-Fi, 3G, 4G, and 5G.

Hereinafter, the operation of each component of the panoramic video providing system of FIG. 1 will be described in more detail.

FIG. 2 is a block diagram of the panoramic video providing server 100 shown in FIG. 1, according to an embodiment of the present invention.

2, the panoramic video providing server 100 includes a segmentation unit 200, a stream generation unit 210, a transceiver unit 220, a partial image selection unit 230, and a DB 240 . However, the panoramic video providing server 100 shown in FIG. 2 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The division unit 200 can divide the entire output region of the panoramic image having the reproduction length T into a plurality of FOV (Field Of View) regions.

In this regard, a method of dividing the FOV area will be described with reference to FIG. 4 for a while.

4 is a diagram for explaining a method of dividing a panoramic image into FOV regions according to an embodiment of the present invention.

Referring to reference numeral 40, the entire output image of the panoramic image of the panoramic image processing server 100 can be divided into a predetermined width 400 and a length 401. In this case, each of the divided regions may correspond to the FOV region, but is not limited thereto. For example, a plurality of areas may correspond to the FOV area.

Referring to reference numeral 41, the panoramic image processing server 100 can set the starting point 402 of the screen in the entire output image. Here, the starting point 402 of the screen may be set by the user.

The panoramic image processing server 100 determines the size of the FOV area 403 and determines the maximum area in which the FOV area 403 can move in the area divided by the predetermined width 400 and the length 401 Can be obtained. For example, an area where the FOV area 403 can move based on the starting point 402 can be calculated as shown in equation (1).

[Equation 1]

 0 <i <(W - uW) / x, 0 <j <(H - uH) / y

Here, H (415) is the height of the entire output image, W (414) is the width of the entire output image, uH is the height of the user view, uW is the width of the user view, x (416) is the maximum horizontal shift number of the FOV region, j (417) is the maximum vertical shift number of the FOF region

Referring to reference numeral 42, the panoramic image processing server 100 may assign a unique value to a position in a plurality of divided FOV regions. For example, when the entire output image is divided into a matrix of 7 x 3, the panoramic image processing server 100 assigns index 1 to index 7 (407 to 412) to each of the divided images of the entire output image , Indexes A to C (404 to 406) may be allocated to the divided vertical parts of the entire output image, and position information may be allocated to a plurality of FOV areas.

Referring again to FIG. 2, the stream generating unit 210 generates at least one stream having a reproduction length T * N by combining N (N is a natural number) of each partial image having a reproduction length T corresponding to each FOV area can do. Here, each partial image may be an image associated with the position information of each FOV region. In addition, each partial image may be an encoded image.

The stream generating unit 210 may insert an end of file (EOF) indicating the end of the panoramic image in the last frame of each partial image.

In this regard, a brief description will be given of a stream generation method with reference to Figs. 5A and 5B.

5A and 5B are diagrams for explaining a method of generating a stream for a panoramic image according to an embodiment of the present invention.

Referring to FIG. 5A, the stream generating unit 210 generates each partial image having the reproduction length T corresponding to each FOV area, sequentially from one side of the entire output area in the divided order, based on the position information of each FOV area A single stream having a playback length T * N can be generated. In addition, the stream generating unit 210 may insert an EOF 504 indicating the end of the panoramic image in each of the last frames of each partial image.

For example, the stream generating unit 210 connects each partial image corresponding to each FOV area on the horizontal A 500 in the entire output area 50 of the panoramic image, ), And a single stream 51 can be generated by connecting each partial image corresponding to each FOV region on the horizontal C (502) in succession.

For example, when the reproduction length of the panoramic image is one hour, the stream generating unit 210 can generate a single stream 51 by combining 21 partial images whose reproduction length is one hour. Here, the playback length of the single stream 51 may be 21 hours.

Referring to FIG. 5B, the stream generating unit 210 reproduces each partial image having the reproduction length T corresponding to each FOV area on the same line segmented from one side of the entire output area, based on the position information of each FOV area A plurality of streams having a length T * N can be generated. In addition, the stream generating unit 210 may insert an EOF 504 indicating the end of the panoramic image in each of the last frames of each partial image.

For example, the stream generating unit 210 may generate a plurality of streams 52 by connecting the partial images corresponding to the respective FOV regions on the same horizontal line in the entire output region 50 of the panoramic image have.

For example, the stream generating unit 210 may generate a single stream 500 by connecting each partial image corresponding to each FOV area on the horizontal A 500. The stream generating unit 210 may generate a single stream 510 by connecting the partial images corresponding to the respective FOV regions on the horizontal B 501. In addition, the stream generating unit 210 may generate a single stream 520 by connecting the partial images corresponding to the FOV regions on the horizontal C 502. Thereby, three streams 500, 510 and 520 can be generated.

5, it is described that the stream generating unit 210 generates a plurality of streams (three streams in FIG. 5B) by concatenating each of the partial images corresponding to the respective FOV regions on a single stream or on the same horizontal plane , But is not limited thereto.

Referring again to FIG. 2, in another embodiment of the present invention, the stream generating unit 210 may generate each partial image corresponding to each FOV region in the entire output region of the panoramic image, as each stream. In this case, 21 streams can be generated.

The transceiver 220 may transmit at least one stream to the user device 110.

For example, the transceiving unit 220 may transmit a plurality of streams generated by combining the partial images corresponding to the FOV area on the same horizontal (or vertical) line of the entire output area of the panoramic image to the user device (110).

For example, the transmitting and receiving unit 220 can transmit a plurality of streams generated in partial images corresponding to the FOV area to the user device 110 in a multi-stream manner.

Meanwhile, the transmission / reception unit 220 may receive a request for outputting a partial image corresponding to the first FOV area from the user device 110. [ Here, the output request of the partial image may include the information of the reproduction time point.

The partial image selecting unit 230 may select a transmission start point of the partial image included in the stream based on the reproduction time information of the partial image requested to be output from the user device 110. [

In this regard, a method of selecting a partial image will be described with reference to FIGS. 6A and 6B.

6A and 6B are views for explaining a method of selecting a plurality of partial images according to a viewpoint movement of a panoramic image, according to an embodiment of the present invention.

Referring to FIG. 6A, when a panoramic image is transmitted as a single stream 51 to the user device 110, the output of the first partial image 601 corresponding to the first FOV region from the user device 110 The partial image selection unit 230 selects the first partial image 601 corresponding to the first FOV region of the partial image included in the stream 51, A second partial image 602 corresponding to a second FOV region that is the right region of the first FOV region, a third partial image 603 corresponding to a third FOV region that is a left region of the first FOV region, The fourth partial image 604 corresponding to the fourth FOV region which is the lower region and the fifth partial image 605 corresponding to the fifth FOV region which is the upper region of the first FOV region.

The transmitting and receiving unit 220 transmits the first partial image 601, the second partial image 602, the third partial image 603, the fourth partial image 604 and the fifth partial image 605 to the user device (110). Specifically, the transceiving unit 220 reproduces the first partial image 601, the second partial image 602, the third partial image 603, the fourth partial image 604, and the fifth partial image 605 To the user device 110 from a time point (corresponding transmission start point).

If the user device 110 receives the FOV area change request from the user device 110 to the second FOV area during the transmission of the first partial image 601 corresponding to the first FOV area to the user device 110, The second partial image 602 corresponding to the second FOV region of the partial image included in the stream 600 and the second partial image 602 corresponding to the sixth region 602 corresponding to the right region of the second FOV region, A sixth partial image 606 corresponding to the FOV area, a seventh partial image 607 corresponding to the seventh FOV area that is the lower area of the second FOV area, and a seventh partial image 607 corresponding to the eighth FOV area that is the upper area of the second FOV area The user can select the eighth partial image 608 to be displayed.

Thereafter, the transmission / reception unit 220 maintains transmission of the first partial image 601 and the second partial image 602, and transmits the third partial image 603, the fourth partial image 604, 605 can be stopped. The transmitting and receiving unit 220 may transmit the sixth partial image 606, the seventh partial image 607 and the eighth partial image 608 to the user device 110 from the reproduction point (transmission start point).

6B, when the user device 110 is transmitting the panoramic image to the multi-streams 605 to 607, the user device 110 transmits the panoramic image corresponding to the first FOV region of the second stream 501 When receiving the output request of the first partial image 601, the partial image selector 230 selects the first partial image 601 corresponding to the first FOV region among the partial images included in the second stream 501, The second partial image 602 corresponding to the second FOV region adjacent to the first FOV region and the third partial image 603 corresponding to the third FOV region adjacent to the first FOV region can be selected. The partial image selecting unit 230 may select the fourth partial image 604 corresponding to the fourth FOV region of the first stream 500 adjacent to the first FOV region of the second stream 501. The partial image selector 230 can select the fifth partial image 605 corresponding to the fifth FOV region of the third stream 502 adjacent to the first FOV region of the second stream 501.

The transmitting and receiving unit 220 includes a first partial image 601, a second partial image 602 and a third partial image 603 included in the second stream 501 and a second partial image 602 included in the first stream 500 The fourth partial image 604 of the third stream 502 and the fifth partial image 605 of the third stream 502 to the user device 110 from the corresponding transmission start point (playback point).

If the FOV region change request from the user device 110 to the second FOV region of the second stream 501 is received, the partial image selector 230 selects the second FOV region from the second stream 501 The sixth partial image 606 corresponding to the adjacent sixth FOV area can be selected.

The partial image selector 230 selects the seventh partial image 607 corresponding to the seventh FOV region of the first stream 500 adjacent to the second FOV region of the second stream 501, The eighth partial image 608 corresponding to the eighth FOV region of the third stream 502 adjacent to the second FOV region of the stream 501 can be selected.

The transmission and reception unit 220 maintains transmission of the first partial image 601 and the second partial image 602 and transmits the third partial image 603, the fourth partial image 604, 605 can stop transmission.

The transceiver 220 may also start transmitting the sixth partial image 606, the seventh partial image 607, and the eighth partial image 608 to the user device 110.

2, the DB 240 stores input and output data between the respective components in the panoramic video providing server 100, and stores the input and output data between the panoramic video providing server 100 and the panoramic And stores data input and output between components external to the video providing server 100. For example, the DB 240 can store a stream generated by the stream generating unit 210. [ In addition, the DB 240 may store the partial image of each stream in association with the position information of the FOV area. One example of such a DB 240 includes a hard disk drive, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, a memory card, and the like existing in or outside the panoramic video providing server 100 do.

Those skilled in the art will recognize that the division unit 200, the stream generation unit 210, the transmission / reception unit 220, the partial image selection unit 230, and the DB 240 may be separately implemented, As will be appreciated by those skilled in the art.

3 is a block diagram of a user device 110, in accordance with an embodiment of the invention.

3, the user device 110 may include a transceiver 300, an output unit 310, an interface unit 320, a decoder 330, and a memory 340. However, the user device 110 shown in FIG. 3 is only one embodiment of the present invention, and various modifications are possible based on the components shown in FIG.

The transmitting / receiving unit 300 may receive at least one stream from the panoramic video providing server 100. [ Here, the stream may be generated by dividing the entire output area of the panoramic image into the FOV area, and combining the partial images corresponding to each FOV area. In addition, the stream may be a single stream of a panoramic image, or may be a multi-stream.

The output unit 310 may output the stream received from the panoramic video providing server 100 to the display device.

The interface unit 320 may receive user input for the stream.

For example, the interface unit 320 may receive an output request for one of the partial images included in the stream through a user input (e.g., input through a remote control key).

The transmission / reception unit 300 may transmit an output request of the partial image received from the user to the panoramic video providing server 100. Here, the output request of the partial image may include the information of the reproduction time point.

The decoder 330 can decode the partial image (the partial image requested by the user and the partial images adjacent to the partial image) received from the panoramic video providing server 100 from the reproduction time point.

The decoder 330 may decode the partial image corresponding to the FOV area requested by the user and may decode the partial images adjacent to the FOV area requested by the user in advance.

The output unit 310 can output the partial image from the reproduction time point.

Next, an output method of the partial image requested by the user will be described with reference to FIG. 6A.

6A, when a request for outputting a partial image corresponding to the first FOV area 603 is received from the user, the transceiver 300 transmits an output request of a partial image corresponding to the first FOV area 603 To the panoramic video providing server 100. The panoramic video providing server 100 may be configured to transmit the video information to the panoramic video providing server 100. [

The transmitting and receiving unit 300 receives a first partial image corresponding to the first FOV region 603 and a second partial image corresponding to the second FOV region 602 adjacent to the first FOV region 603 from the panoramic video providing server 100 The second partial image and the third partial image corresponding to the third FOV region 604 adjacent to the first FOV region 603.

The decoder 330 may decode the first partial image, the second partial image, and the third partial image from the reproduction time point. The reason why the decoder 330 decodes the second partial image and the third partial image at this time is to prevent the screen from being interrupted by switching the screen immediately upon request of the FOV area change from the user.

The output unit 310 may output the first partial image from the reproduction time point.

If the FOV area change request to the second FOV area 602 is received at a reproduction time point of the first partial image, the output unit 310 outputs a second partial area corresponding to the second FOV area decoded in advance It can be directly output to the display device.

The transmitting and receiving unit 300 may transmit a request for changing the FOV area to the second FOV area 602 to the panoramic video providing server 100.

The transmitting and receiving unit 300 receives the fourth partial image corresponding to the fourth FOV area 601 adjacent to the second FOV area 602 of the partial images included in the stream from the panoramic video providing server 100 . In this case, the transmission of the third partial image by the panoramic video providing server 100 is stopped, and the transmission of the first partial image and the second partial image can be maintained.

The decoder 330 can previously decode the fourth partial image corresponding to the fourth FOV area 601 received from the panoramic video providing server 100 from a reproduction time point.

3, the memory 340 stores data that is input and output between each of the components within the user device 110 and stores the data between the user device 110 and the components external to the user device 110 And stores the input and output data. For example, the memory 340 may temporarily store the stream received from the panoramic video providing server 100. For example, One example of such a memory unit 340 includes a hard disk drive, a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, a memory card, and the like that are present inside or outside the user device 110.

Those skilled in the art will appreciate that the transceiver 300, the output unit 310, the interface unit 320, the decoder 330, and the memory 340 may be separately implemented, or at least one of them may be integrated Will be fully understood.

7 is a flowchart illustrating a method of providing a panoramic video service performed by a panoramic image processing server according to an exemplary embodiment of the present invention.

The method of providing a panoramic video service according to the embodiment shown in FIG. 7 is performed by the panoramic image processing server 100 and the user device 110 according to the embodiment shown in FIGS. 1 to 6, / RTI &gt; Therefore, even if omitted in the following description, the contents described with respect to the panoramic image processing server 100 and the user device 110 of FIGS. 1 to 6 are provided in the form of a panoramic video service according to the embodiment shown in FIG. Method.

Referring to FIG. 7, in step S701, the panoramic image processing server 100 may divide the entire output region of the panoramic image having the reproduction length T into a plurality of FOV regions.

In step S703, the panoramic image processing server 100 can generate at least one stream having a reproduction length T * N by combining N of each partial image having the reproduction length T corresponding to each FOV area. Here, each partial image may be an image associated with the position information of each FOV area. EOF (End Of File) indicating the end of the panoramic image may be inserted into the last frame of each partial image.

The panoramic image processing server 100 may transmit at least one stream to the user device 110 in step S705.

Although not shown in FIG. 7, in step S703, the panoramic image processing server 100 divides each partial image having the reproduction length T corresponding to each FOV area into one partial image of the entire output area The stream having the reproduction length T * N can be generated.

Although not shown in FIG. 7, after step S705, the panoramic image processing server 100 may receive a request for outputting a partial image corresponding to the first FOV area from the user device 110. FIG.

Although not shown in FIG. 7, after step S705, the panoramic image processing server 100 determines, based on the position information of each FOV region, a first partial image corresponding to the first FOV region The second partial image corresponding to the second FOV region adjacent to the first FOV region, and the third partial region corresponding to the third FOV region adjacent to the first FOV region. In addition, the panoramic image processing server 100 may transmit the selected first partial image, the second partial image, and the selected third partial image to the user device 110.

Although not shown in FIG. 7, after step S705, the panoramic image processing server 100 may receive the FOV area change request from the user device 110 to the second FOV area. Further, the panoramic image processing server 100 selects a fourth partial image corresponding to the fourth FOV region adjacent to the second FOV region among the partial images included in the stream, based on the position information of each FOV region , And transmit the selected fourth partial image to the user device 110. In this case, the panoramic image processing server 100 can stop the transmission of the third partial image and maintain the transmission of the first partial image and the second partial image.

In the above description, steps S701 to S705 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.

One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .

100: Panoramic Video Serving Server
110: User device

Claims (18)

A method for providing a panoramic video service performed by a panoramic image processing server,
Dividing the entire output region of the panoramic image having the reproduction length T into a plurality of FOV (Field Of View) regions;
Generating at least one stream having a reproduction length T * N by combining N of each partial image having a reproduction length T corresponding to each FOV area; And
Transmitting the at least one stream to a user device
The method comprising the steps of:
The method according to claim 1,
Wherein each partial image is associated with location information of each FOV region.
3. The method of claim 2,
Wherein the generating the stream comprises:
Each partial image having a reproduction length T corresponding to each FOV area is sequentially connected in order from one side of the entire output area on the basis of the position information of each FOV area to generate a stream having the reproduction length T * N The method comprising the steps of:
3. The method of claim 2,
Wherein the transmitting the stream to a user device comprises:
Receiving an output request of a partial image corresponding to a first FOV area from the user device;
A first partial image corresponding to the first FOV region, a second partial image corresponding to a second FOV region adjacent to the first FOV region, and a second partial image corresponding to the first FOV region, And selecting a third partial region corresponding to a third FOV region adjacent to the first FOV region; And
Transmitting the first partial image, the second partial image, and the third partial image to the user device
The method comprising the steps of:
5. The method of claim 4,
The output request of the partial image includes information of a reproduction time point,
Wherein the transmitting the first partial image, the second partial image, and the third partial image to the user device comprises:
And transmitting the first partial image, the second partial image, and the third partial image from the playback point to the user device.
5. The method of claim 4,
Receiving a FOV region change request from the user device to the second FOV region;
Selecting a fourth partial image corresponding to a fourth FOV area adjacent to the second FOV area among the partial images included in the stream based on the position information of each FOV area; And
Transmitting the fourth partial image to the user device,
The transmission of the third partial image is stopped, and the transmission of the first partial image and the second partial image is maintained.
The method according to claim 1,
Wherein an end of file (EOF) indicating the end of the panoramic image is inserted into the last frame of each partial image.
In a panoramic video providing system,
A panoramic video providing server; And
User device
&Lt; / RTI &gt;
Wherein the panoramic video providing server comprises:
A division unit dividing the entire output region of the panoramic image having the reproduction length T into a plurality of FOV (Field Of View) regions;
A stream generating unit for generating at least one stream having a reproduction length TXN by combining N of each partial image having a reproduction length T corresponding to each FOV area; And
A transmitting and receiving unit for transmitting the at least one stream to the user device,
Lt; / RTI &gt;
The user device comprising:
A transmitting and receiving unit for receiving the at least one stream from the panoramic video providing server;
An output unit outputting the stream; And
An interface for receiving user input for the stream;
The system comprising:
9. The method of claim 8,
Wherein each partial image is associated with location information of each FOV area.
10. The method of claim 9,
In the user device,
The interface unit receives an output request of a partial image corresponding to the first FOV area,
Wherein the transmission / reception unit transmits a request for outputting a partial image corresponding to the first FOV area to the panoramic video providing server.
11. The method of claim 10,
Wherein the panoramic video providing server comprises:
A partial image selection unit for selecting a partial image included in the stream,
Further comprising:
Wherein the partial image selecting unit is configured to select, based on the position information of each FOV area, a first partial image corresponding to the first FOV area and a second partial image corresponding to the first FOV area, And a third partial area corresponding to a third FOV area adjacent to the first FOV area,
Wherein the transceiver transmits the first partial image, the second partial image, and the third partial image to the user device.
12. The method of claim 11,
The output request of the partial image includes information of a reproduction time point,
Wherein the transmission / reception unit transmits the first partial image, the second partial image, and the third partial image to the user device from the reproduction time point.
13. The method of claim 12,
In the user device,
And a decoder for decoding the first partial image, the second partial image, and the third partial image from the reproduction time point,
And the output unit outputs the first partial image from the reproduction time point.
14. The method of claim 13,
In the user device,
Wherein the interface unit receives a FOV area change request to the second FOV area at a reproduction time point of the first partial image,
Wherein the output unit outputs a second partial area corresponding to the decoded second FOV area,
Wherein the transmitting / receiving unit transmits a FOV area change request to the second FOV area to the panoramic video providing server.
15. The method of claim 14,
In the user device,
Wherein the transceiver receives a fourth partial image corresponding to a fourth FOV region adjacent to the second FOV region among the partial images included in the stream from the panoramic video providing server,
The transmission of the third partial image is stopped, and the transmission of the first partial image and the second partial image is maintained.
16. The method of claim 15,
In the user device,
And wherein the decoder decodes the fourth partial image from any reproduction point.
9. The method of claim 8,
Wherein an End Of File (EOF) indicating the end of the panoramic image is inserted into the last frame of each partial image.
A panoramic video providing server for providing a panoramic video service,
A division unit dividing the entire output region of the panoramic image having the reproduction length T into a plurality of FOV (Field Of View) regions;
A stream generating unit for generating at least one stream having a reproduction length T * N by combining N of each partial image having a reproduction length T corresponding to each FOV area; And
A transmitting and receiving unit for transmitting the at least one stream to a user device,
The server comprising:
KR1020150145530A 2015-10-19 2015-10-19 Method for providing panoramic video service, panoramic video providing server and system KR20170045633A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150145530A KR20170045633A (en) 2015-10-19 2015-10-19 Method for providing panoramic video service, panoramic video providing server and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150145530A KR20170045633A (en) 2015-10-19 2015-10-19 Method for providing panoramic video service, panoramic video providing server and system

Publications (1)

Publication Number Publication Date
KR20170045633A true KR20170045633A (en) 2017-04-27

Family

ID=58702755

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150145530A KR20170045633A (en) 2015-10-19 2015-10-19 Method for providing panoramic video service, panoramic video providing server and system

Country Status (1)

Country Link
KR (1) KR20170045633A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110944239A (en) * 2019-11-28 2020-03-31 重庆爱奇艺智能科技有限公司 Video playing method and device
CN112287155A (en) * 2020-10-30 2021-01-29 维沃移动通信有限公司 Picture processing method and device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110944239A (en) * 2019-11-28 2020-03-31 重庆爱奇艺智能科技有限公司 Video playing method and device
CN112287155A (en) * 2020-10-30 2021-01-29 维沃移动通信有限公司 Picture processing method and device
CN112287155B (en) * 2020-10-30 2024-03-22 维沃移动通信有限公司 Picture processing method and device

Similar Documents

Publication Publication Date Title
US10893278B2 (en) Video bitstream generation method and device for high-resolution video streaming
KR101844032B1 (en) Method for sending video in region of interest from panoramic-video, server and device
EP3556100B1 (en) Preferred rendering of signalled regions-of-interest or viewports in virtual reality video
US9148646B2 (en) Apparatus and method for processing video content
JP6305279B2 (en) Video compression device and video playback device
US20200092571A1 (en) Scalability of multi-directional video streaming
SA515360719B1 (en) Multi-resolution decoded picture buffer management for multi-layer video coding
KR20170005366A (en) Method and Apparatus for Extracting Video from High Resolution Video
US20200084516A1 (en) Device and method for processing high-definition 360-degree vr image
CN112602329A (en) Block scrambling for 360 degree video decoding
JP6006680B2 (en) Video distribution apparatus and video distribution program
EP2676446B1 (en) Apparatus and method for generating a disparity map in a receiving device
US11457053B2 (en) Method and system for transmitting video
KR20170045633A (en) Method for providing panoramic video service, panoramic video providing server and system
CN104038776A (en) Video processing apparatus and video processing method
US20170078355A1 (en) Encoding device, decoding device, computer program product, and streaming system
US20220329886A1 (en) Methods and devices for handling media data streams
JP2018011197A (en) Video distribution device, video coding device, video distribution method, video coding method, video distribution program and video coding program
US20150062296A1 (en) Depth signaling data
JP6224522B2 (en) Video distribution device, video distribution method, and video distribution program
KR101954298B1 (en) Hybrid streaming method, streaming server and system
JP2012222426A (en) Video distribution system, video transmission device and video reproduction device
KR20120057034A (en) System and method for adaptively streaming of images having multi component