KR102002037B1 - Method for watching multi-view video, method for providing multi-view video and user device - Google Patents
Method for watching multi-view video, method for providing multi-view video and user device Download PDFInfo
- Publication number
- KR102002037B1 KR102002037B1 KR1020150153603A KR20150153603A KR102002037B1 KR 102002037 B1 KR102002037 B1 KR 102002037B1 KR 1020150153603 A KR1020150153603 A KR 1020150153603A KR 20150153603 A KR20150153603 A KR 20150153603A KR 102002037 B1 KR102002037 B1 KR 102002037B1
- Authority
- KR
- South Korea
- Prior art keywords
- image
- track
- output
- frame
- time
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/189—Recording image signals; Reproducing recorded image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
- H04N13/351—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for displaying simultaneously
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
A multi-view image viewing method using a multi-track image performed by a user terminal includes receiving a multi-track image including a plurality of track images corresponding to images at respective view points from a streaming server, And outputting a first track image corresponding to a first point in time of the multi-track image, and outputting a second track image at a first point in time during the output of the first track image And outputting a second track image corresponding to a second point in time of the multi-track image from a first output time.
Description
The present invention relates to a multi-view image viewing method and a multi-view image providing method using a multi-track image.
The time slice service is a service for photographing a subject at various viewpoints using a plurality of cameras, and editing various points of view of the subject at a specific time in a single image.
The conventional time slice service has a problem in that although the viewer views the scene at various points of view, the image touched by the viewer has no freedom of view selection as an edited image.
In Korean Patent Publication No. 2005-0121345, video data captured by a plurality of video cameras are edited and divided into a main screen track portion constituting a main screen and a sub-screen track portion constituting a plurality of sub-screens, And the data of the main screen track part and one or more sub screen track parts are integrated into one or two or more pieces of data in accordance with the time synchronization part in accordance with the operation of the viewer.
When a request for outputting an image for a specific time point is received from among a plurality of track images corresponding to images at each time point, a track image corresponding to the time point is output, and while the track image is being output, It is desired to output a track image corresponding to another point in time. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.
According to an aspect of the present invention, there is provided a multi-view image viewing method using a multi-track image performed by a user terminal, the multi-view image viewing method including: Receiving a request for outputting an image at a first point in time of the multi-track image, and outputting a first track image corresponding to the first point in time of the multi-track image, Receiving a request for outputting an image at a second time point from a first output time during the output of the first track image, and outputting a second track image corresponding to the second time point from the first output time .
According to a second aspect of the present invention, there is provided a multi-track image providing method using multi-track images performed in a streaming server, the method comprising: receiving images of a plurality of viewpoints from a plurality of cameras photographed at different viewpoints; The method comprising: generating a first multi-track image including a plurality of track images corresponding to respective images of the track, transmitting the first multi-track image to a user terminal, receiving a request for an integrated image of each track from the user terminal Generating a second multi-track image including the integrated image, and transmitting the second multi-track image to the user terminal.
A user terminal providing a multi-track image using a multi-track image according to the third aspect of the present invention includes a transceiver for receiving a multi-track image including a plurality of track images corresponding to images at respective view points from a streaming server, And an output unit for outputting a track image corresponding to the input time point of the multi-track image, wherein the multi-track image includes time information of each track image, A header area including time information of each frame included in the track image, and a frame area including the plurality of track images.
The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.
According to any one of the above objects, when a request for outputting a video image at a specific time point is received from among a plurality of track images corresponding to images at each time point, a track image corresponding to the time point is output , And when a request for outputting an image at another time point is received while the track image is being output, the track image corresponding to another time point can be output.
1 is a configuration diagram of a multi-view image providing system according to an embodiment of the present invention.
FIG. 2 is a view showing images of a plurality of viewpoints received from a plurality of cameras according to an embodiment of the present invention.
3 is a block diagram of the user terminal shown in FIG. 1, in accordance with one embodiment of the present invention.
4 is a diagram illustrating a structure of a multi-track image according to an embodiment of the present invention.
5 is a diagram illustrating interface information mapped at each viewpoint according to an embodiment of the present invention.
6 is a diagram for explaining a method for viewing a multi-view image in a user terminal according to an embodiment of the present invention.
7 is a view for explaining a method of providing an integrated image of each track according to an embodiment of the present invention.
FIG. 8 is a flowchart illustrating a multi-view image viewing method using a multi-track image performed in a user terminal according to an exemplary embodiment of the present invention.
FIG. 9 is a flowchart illustrating a multi-view image providing method using a multi-track image performed in a streaming server according to an exemplary embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.
Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.
In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.
In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings.
1 is a configuration diagram of a multi-view image providing system according to an embodiment of the present invention.
Referring to FIG. 1, the multi-view image providing system may include a
The
Specifically, the
2, an image at a plurality of viewpoints received from a plurality of cameras will be described for a moment.
FIG. 2 is a view showing images of a plurality of viewpoints received from a plurality of cameras according to an embodiment of the present invention.
Referring to FIG. 2, a plurality of
For example, the
The
1, the
For example, the
The
The
For example, the
When the
The
Generally, the components of the multi-view image providing system of FIG. 1 are connected through the
Hereinafter, the operation of each component of the multi-view image providing system of FIG. 1 will be described in more detail.
3 is a block diagram of the
3, the
The transmission /
The structure of the first multi-track image will be described with reference to FIG.
4 is a diagram illustrating a structure of a multi-track image according to an embodiment of the present invention.
4, the first multi-track image includes a
For example, the
The
For example, the first sub-frame region 402-1 may include N frames 403 extracted one by one from each of the first track image to the N-th track image. Here, the N frames 403 may be frames corresponding to the same first time (time interval). In addition, the first sub-frame region 402-1 may include first audio data corresponding to a first time (time interval).
Referring again to FIG. 3, the
Referring to FIG. 5, the point-in-time information mapped at each point in time will be described briefly.
5 is a diagram illustrating interface information mapped at each viewpoint according to an embodiment of the present invention.
5, the
For example, the
The
Also, the
In addition, the
In addition, the
The
Referring again to FIG. 3, the
The
The
The
Based on the time information of each frame included in the header area of the first multi-track image, the
If the output request of the integrated image of each track is input at the second output time during the output of the second track image, the transmission /
Thereafter, the
The
Those skilled in the art will appreciate that the
6 is a diagram for explaining a method for viewing a multi-view image in a user terminal according to an embodiment of the present invention.
Referring to FIG. 6, each
For example, when the
When the
7 is a view for explaining a method of providing an integrated image of each track according to an embodiment of the present invention.
7, if the
When the
Specifically, the streaming
The streaming
The streaming
The
FIG. 8 is a flowchart illustrating a multi-view image viewing method using a multi-track image performed in a user terminal according to an exemplary embodiment of the present invention.
The multi-view image viewing method according to the embodiment shown in FIG. 8 includes steps that are processed in a time-series manner in the
Referring to FIG. 8, in step S801, the
In step S803, the
In step S805, the
In step S807, the
In step S809, the
Although not shown in FIG. 8, in step S805, the
Although not shown in FIG. 8, in step S809, based on the time information of each frame included in the header area, the
Although not shown in FIG. 8, after step S809, the
Although not shown in FIG. 8, after step S809, the
Although not shown in FIG. 8, after step S809, the
Although not shown in FIG. 8, after step S809, the
In the above description, steps S801 to S809 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.
FIG. 9 is a flowchart illustrating a multi-view image providing method using a multi-track image performed in a streaming server according to an exemplary embodiment of the present invention.
The multi-view image providing method according to the embodiment shown in FIG. 9 includes the steps of the
Referring to FIG. 9, in step S901, the streaming
In step S903, the streaming
In step S905, the streaming
In step S907, the streaming
In step S909, the streaming
In step S911, the streaming
Although not shown in FIG. 9, in step S909, the streaming
Although not shown in FIG. 9, in step S909, the streaming
In the above description, steps S901 to S911 may be further divided into additional steps, or combined in fewer steps, according to an embodiment of the present invention. Also, some of the steps may be omitted as necessary, and the order between the steps may be changed.
One embodiment of the present invention may also be embodied in the form of a recording medium including instructions executable by a computer, such as program modules, being executed by a computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, the computer-readable medium may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes any information delivery media, including computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transport mechanism.
It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.
It is intended that the present invention covers the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents. .
100: user terminal
110: streaming server
Claims (16)
Receiving a multi-track image including a plurality of track images corresponding to images at respective viewpoints from a streaming server;
Receiving an output request of an image at a first time point of the multi-track image; And
Outputting a first track image corresponding to the first time point among the multitrack images;
Receiving an output request of an image at a second time point from a first output time point during the output of the first track image; And
Outputting a second track image corresponding to the second point in time of the multi-track image from the first output time
, ≪ / RTI &
Receiving an output request for an integrated image at a second output time during the output of the second track image;
Transmitting an output request for the integrated image to the streaming server and receiving the integrated image from the streaming server;
Further comprising the step of outputting the integrated image,
Wherein the integrated image is a video generated by sequentially arranging frames corresponding to the second output time of the frame other than the second track video and the frame corresponding to the second output time of the second track video, How to view multi - view video.
Wherein the multi-track image includes a view area of each track image, a header area including time information of each frame included in each track image, and a frame area including the plurality of track images. Way.
Wherein the frame region includes a plurality of sub-frame regions, and each sub-frame region includes frames at the same time in each track image.
Wherein the outputting of the first track image comprises:
And outputs the frame of the first track image included in each of the sub-frame areas based on time information of each frame included in the header area.
The step of outputting the second track image from the first output time
And outputs a frame of the second track image after the first output time out of the frames of the second track image included in each sub frame region based on the time information of each frame included in the header area , A method for viewing a multi-view image.
Receiving images of a plurality of viewpoints from a plurality of cameras photographed at different viewpoints;
Generating a first multi-track image including a plurality of track images corresponding to the images of the plurality of viewpoints;
Transmitting the first multi-track image to a user terminal;
Receiving a request for an integrated image of each track from the user terminal;
Generating a second multi-track image including the integrated image; And
Transmitting the second multi-track image to the user terminal
, ≪ / RTI &
Wherein the request for the integrated video includes information on a current output track and a current output time,
Wherein the integrated image is a video generated by sequentially arranging a frame corresponding to the current output time of the currently output track and a frame corresponding to the current output time of a track other than the currently output track Point image providing method.
Wherein the first multi-track image includes a view area information of each track image, a header area including time information of each frame included in each track image, and a frame area including the plurality of track images. Image providing method.
Wherein the frame region includes a plurality of sub-frame regions, and each sub-frame region includes frames at the same time in each track image.
Wherein the generating of the second multi-track image including the integrated image comprises:
Extracting a plurality of frames corresponding to the current output time of a track other than the track currently being output; And
Inserting the extracted plurality of frames into a frame subsequent to the current output time of the currently output track
The method of claim 1,
A transmission / reception unit for receiving a multi-track image including a plurality of track images corresponding to images at each viewpoint from a streaming server;
An interface unit receiving a selection of one of the viewpoints; And
An output unit for outputting a track image corresponding to the input time point of the multi-
, ≪ / RTI &
Wherein the multi-track image includes a view area information of each track image, a header area including time information of each frame included in each track image, and a frame area including the plurality of track images,
Wherein the transmission / reception unit transmits an output request of the integrated image to the streaming server when receiving an output request of the integrated image during the output of the track image corresponding to the input time point, receives the integrated image from the streaming server,
Wherein the output unit outputs the received combined image,
Wherein the integrated image is a video image generated by sequentially arranging frames corresponding to the output request time of the integrated video image of the output track image and the output request time of the video image other than the output track image, User terminal.
Wherein the frame region includes a plurality of sub-frame regions, and each sub-frame region includes a frame at the same time in each track image.
Wherein the output unit outputs a frame of the track image included in each sub-frame area based on time information of each frame included in the header area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020150153603A KR102002037B1 (en) | 2015-11-03 | 2015-11-03 | Method for watching multi-view video, method for providing multi-view video and user device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| KR1020150153603A KR102002037B1 (en) | 2015-11-03 | 2015-11-03 | Method for watching multi-view video, method for providing multi-view video and user device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| KR20170051913A KR20170051913A (en) | 2017-05-12 |
| KR102002037B1 true KR102002037B1 (en) | 2019-07-19 |
Family
ID=58740783
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| KR1020150153603A KR102002037B1 (en) | 2015-11-03 | 2015-11-03 | Method for watching multi-view video, method for providing multi-view video and user device |
Country Status (1)
| Country | Link |
|---|---|
| KR (1) | KR102002037B1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102362513B1 (en) | 2017-12-04 | 2022-02-14 | 주식회사 케이티 | Server and method for generating time slice video, and user device |
| KR101950852B1 (en) * | 2017-12-06 | 2019-02-21 | 서울과학기술대학교 산학협력단 | The apparatus and method for using multi-view image acquisition camers |
| KR102313309B1 (en) * | 2019-09-23 | 2021-10-15 | 김성현 | Personalized live broadcasting system |
| KR20210110097A (en) * | 2020-02-28 | 2021-09-07 | 삼성전자주식회사 | The method for streaming a video and the electronic device supporting same |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100430272B1 (en) * | 1999-09-27 | 2004-05-06 | 엘지전자 주식회사 | User profile and method of multi view display based on user preference |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8872888B2 (en) * | 2010-10-01 | 2014-10-28 | Sony Corporation | Content transmission apparatus, content transmission method, content reproduction apparatus, content reproduction method, program and content delivery system |
-
2015
- 2015-11-03 KR KR1020150153603A patent/KR102002037B1/en active IP Right Grant
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100430272B1 (en) * | 1999-09-27 | 2004-05-06 | 엘지전자 주식회사 | User profile and method of multi view display based on user preference |
Also Published As
| Publication number | Publication date |
|---|---|
| KR20170051913A (en) | 2017-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10778951B2 (en) | Camerawork generating method and video processing device | |
| US10334275B2 (en) | Panoramic view customization | |
| US10271082B2 (en) | Video distribution method, video reception method, server, terminal apparatus, and video distribution system | |
| EP3316589B1 (en) | Video synchronization device and video synchronization method | |
| US11729465B2 (en) | System and method providing object-oriented zoom in multimedia messaging | |
| KR102002037B1 (en) | Method for watching multi-view video, method for providing multi-view video and user device | |
| US10277832B2 (en) | Image processing method and image processing system | |
| US20150208103A1 (en) | System and Method for Enabling User Control of Live Video Stream(s) | |
| CN104301769B (en) | Method, terminal device and the server of image is presented | |
| CN104012106A (en) | Aligning videos representing different viewpoints | |
| KR20140118605A (en) | Server and method for transmitting augmented reality object | |
| KR20170086203A (en) | Method for providing sports broadcasting service based on virtual reality | |
| JP2020522926A (en) | Method and system for providing virtual reality content using captured 2D landscape images | |
| WO2017193830A1 (en) | Video switching method, device and system, and storage medium | |
| US20130097649A1 (en) | Method and apparatus for providing image to device | |
| US11924397B2 (en) | Generation and distribution of immersive media content from streams captured via distributed mobile devices | |
| CN114189696A (en) | Video playing method and device | |
| US20200213631A1 (en) | Transmission system for multi-channel image, control method therefor, and multi-channel image playback method and apparatus | |
| JP2014116922A (en) | Video playback device and video distribution device | |
| WO2015194082A1 (en) | Image processing method and image processing system | |
| CN112804471A (en) | Video conference method, conference terminal, server and storage medium | |
| KR101910609B1 (en) | System and method for providing user selective view | |
| KR102559011B1 (en) | Method for providing virtual reality service, device and server | |
| WO2015182034A1 (en) | Image shooting method, image shooting system, server, image shooting apparatus, and image shooting program | |
| KR102459768B1 (en) | Cooperation broadcasting method using crowd sourcing, cooperation broadcasting server and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A201 | Request for examination | ||
| E902 | Notification of reason for refusal | ||
| AMND | Amendment | ||
| E601 | Decision to refuse application | ||
| AMND | Amendment | ||
| X701 | Decision to grant (after re-examination) | ||
| GRNT | Written decision to grant |