KR101910609B1 - System and method for providing user selective view - Google Patents

Abstract

A system for providing a user selectable image capable of more efficiently compressing a plurality of pieces of image data photographed at a plurality of points by using a plurality of prediction methods may comprise: an image encoder receiving a plurality of pieces of image data from a plurality of image cameras, encoding image data belonging to the same group among the received image data by a first prediction method, encoding the image data belonging to different groups by a second prediction method, and transmitting the encoded video data; and an image decoder receiving the encoded image data, receiving a user input for selecting at least one piece of image data the image data photographed by the image cameras, and decoding the encoded image data based on the user input to output the decoded image data.

Description

[0001] SYSTEM AND METHOD FOR PROVIDING USER SELECTIVE VIEW [0002]

The present invention relates to a system and method for providing a user-selectable image.

A stereoscopic image (3D image) means a three-dimensional image simultaneously providing shape information on depth and space. In the case of stereoscopic images, stereoscopic images are provided at different viewpoints on the left and right eyes, while stereoscopic images provide the same images viewed from different directions each time the viewer views them. Therefore, in order to generate stereoscopic images, images taken at various view points are required.

Generally, according to a multi-view high efficiency video coding (HEVC) process, an actual scene is captured using two or more cameras to encode a MVV (Multi-View Video) sequence, Is transmitted to the MV-HEVC through the receiver, and then the 3D image can be displayed by decoding.

In this process, the amount of data that is taken at various viewpoints to generate a stereoscopic image is enormous. Therefore, in consideration of the network infrastructure and the terrestrial bandwidth for realizing the stereoscopic image, a single-view video coding such as MPEG-2, H.264 / AVC, or a conventional encoding apparatus optimized for MVV compression There are many limitations on the spherical phenomenon even if it is compressed by using.

However, since the images taken at each viewpoint of the observer are related to each other, there is a lot of overlapping information. Therefore, it is possible to improve the transmission efficiency and data transmission efficiency by using a coding apparatus optimized for multi-view image, which can eliminate the inter-view redundancy and consider the motion estimation (ME) of the space-time axis .

Conventionally, although an actual scene can be photographed by two or more cameras, and captured image data can be acquired, due to a restriction of a network infrastructure, a broadcast bandwidth, etc., the user terminal can only use a camera image unilaterally provided from a broadcasting station But only to the extent of receiving and outputting. Therefore, the user can be assured of diversity of channel selection, but the choice of the camera image in the same channel can not be guaranteed.

The background technology of the present application is disclosed in Korean Patent Laid-Open Publication No. 2017-0044637 (Publication Date: 2017.04.25).

SUMMARY OF THE INVENTION It is an object of the present invention to provide a user selectable image providing system and method capable of compressing a plurality of image data photographed at multiple points more efficiently using a plurality of prediction methods .

In addition, the present invention has been made to solve the above-mentioned problems of the related art, and it is an object of the present invention to provide a method and apparatus for selecting a desired one of images from various viewpoints and decoding the encoded data, And an image providing system and method.

It should be understood, however, that the technical scope of the embodiments of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to another aspect of the present invention, there is provided a user-selectable image providing system for receiving a plurality of image data from a plurality of image cameras, And a second predictive method to encode video data belonging to different groups to transmit the encoded video data, and a video encoding device for receiving the encoded video data, and a plurality of video cameras And an image decoding device for decoding the encoded image data based on the user input and outputting the decoded image data.

According to an embodiment of the present invention, the image encoding apparatus may encode the image data using a first prediction method when the similarity degree of the shooting time between the plurality of image data is equal to or greater than a predetermined value, Is less than a preset value, it can be encoded by the second prediction method.

Also, according to an embodiment of the present invention, the first prediction method may be MVC inter prediction, and the second prediction method may be simulcast inter prediction.

According to an aspect of the present invention, there is provided a user-selected type image encoding apparatus including a video data receiving unit receiving a plurality of video data captured by a plurality of video cameras, An encoding unit for encoding the image data of the different groups in a first prediction method and a second prediction method of image data of different groups and a transmission unit for transmitting the encoded image data.

In addition, according to an embodiment of the present invention, the encoding unit may encode a first prediction method when there is redundancy of a viewpoint of the plurality of image data.

According to an embodiment of the present invention, the encoding unit may encode the plurality of image data using a first prediction method when the similarity degree between the plurality of image data is equal to or greater than a predetermined value, If it is less than the set value, it can be encoded by the second prediction method.

Also, according to an embodiment of the present invention, the first prediction method may be MVC inter prediction, and the second prediction method may be simulcast inter prediction.

According to an embodiment of the present invention, the encoding unit encodes video data belonging to the same group among the plurality of received video data using a first prediction method in accordance with the positional proximity of the plurality of video cameras, Can be encoded by the second prediction method.

According to an aspect of the present invention, there is provided a user-selectable image decoding apparatus including a receiving unit for receiving a plurality of encoded image data, a user receiving a user input for selecting at least one of the plurality of image data, And a decoding unit decoding the encoded image data based on the user input, and outputting the decoded image data, wherein the encoded plurality of image data includes at least one of a plurality of image data captured by a plurality of image cameras, The first predictive method can be coded between the video data and the second predictive method can be encoded between the video data belonging to different groups.

According to an embodiment of the present invention, the decoding unit may decode and output selected first image data among a plurality of encoded image data based on the user input.

According to an embodiment of the present invention, the decoding unit may decode all the encoded image data, and output the selected first image data based on the user input.

Also, according to an embodiment of the present invention, the first prediction method may be MVC inter prediction, and the second prediction method may be simulcast inter prediction.

According to an embodiment of the present invention, the decoding unit may include a first image camera associated with the first image data selected from the plurality of image data based on the received user input, and an image belonging to the same group as the first image camera The image data of the camera can be decoded.

According to another aspect of the present invention, there is provided a method for providing a user-selected image, the method comprising: receiving a plurality of image data taken by a plurality of image cameras; Encoding the image data belonging to different groups using a first prediction method and encoding the image data belonging to different groups using a second prediction method, transmitting the encoded image data, inputting at least one of the plurality of image data, Receiving the encoded image data, decoding the encoded image data, and transmitting the decoded image data.

According to an embodiment of the present invention, the decrypting step decrypts the first image data selected from the plurality of image data based on the user input, and the step of outputting the image data includes receiving the decrypted first image data Can be output.

According to an embodiment of the present invention, the decoding step may decode all the encoded image data, and the step of outputting the image data may output the first image data selected based on the user input.

In addition, according to an embodiment of the present invention, the encoding may be performed by a first prediction method when there is redundancy of a viewpoint of a view between the plurality of image data.

According to an embodiment of the present invention, in the encoding step, when the similarity degree of the shooting time between the plurality of video data is equal to or larger than a preset value, If the similarity is less than a preset value, the second prediction method can be coded.

Also, according to an embodiment of the present invention, the first prediction method may be MVC inter prediction, and the second prediction method may be simulcast inter prediction.

The above-described task solution is merely exemplary and should not be construed as limiting the present disclosure. In addition to the exemplary embodiments described above, there may be additional embodiments in the drawings and the detailed description of the invention.

According to the present invention, it is possible to provide a user-selectable image providing system and method that can compress a plurality of image data photographed at multiple points more efficiently using a plurality of prediction methods.

According to the present invention, there is provided a system and method for providing a user-selectable image capable of providing an image at a more optimized speed by allowing a user to select a desired one of images from various viewpoints and decoding only the corresponding image can do.

In addition, according to the above-mentioned problem solving means of the present invention, a plurality of video prediction methods can be simultaneously or selectively used to increase the efficiency of multi-point compression and to optimize the speed between the encoder and the decoder, It is possible to provide a system and method for providing a selectable image.

1 is a diagram schematically illustrating a configuration of a user-selected type image providing system according to an embodiment of the present invention.
2 is a diagram schematically showing an example of classifying a plurality of image data in one embodiment of the present invention.
FIG. 3A is a diagram illustrating an MVC inter prediction pattern as a first prediction method according to an embodiment of the present invention.
FIG. 3B is a diagram illustrating a simulcast inter prediction pattern, which is a second prediction method according to an embodiment of the present invention.
4 is a block diagram illustrating a schematic configuration of a video encoding apparatus and an image decoding apparatus according to an embodiment of the present invention.
5 is a flowchart schematically illustrating a first embodiment of a method for providing a user-selected image according to an embodiment of the present invention.
FIG. 6 is a flowchart schematically illustrating a second embodiment of a method for providing a user-selectable image according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. It should be understood, however, that the present invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, the same reference numbers are used throughout the specification to refer to the same or like parts.

Throughout this specification, when a part is referred to as being "connected" to another part, it is not limited to a case where it is "directly connected" but also includes the case where it is "electrically connected" do.

It will be appreciated that throughout the specification it will be understood that when a member is located on another member "top", "top", "under", "bottom" But also the case where there is another member between the two members as well as the case where they are in contact with each other.

Throughout this specification, when an element is referred to as "including " an element, it is understood that the element may include other elements as well, without departing from the other elements unless specifically stated otherwise.

FIG. 1 schematically shows a configuration of a user-selectable image providing system 100 according to an embodiment of the present invention. FIG. 2 schematically illustrates an example of classifying a plurality of image data in an embodiment of the present invention 3A shows an MVC inter prediction pattern as a first prediction method according to an embodiment of the present invention. FIG. 3B illustrates a simulcast inter prediction pattern as a second prediction method according to an embodiment of the present invention. Fig.

1, the user-selected type image providing system 100 may include an image encoding apparatus 110, an image decoding apparatus 120, a plurality of cameras 200, and a user terminal 300. In addition, although not shown in FIG. 1, the user-selectable image providing system 100 may further include, for example, a broadcast server and an apparatus, a device for receiving a broadcast signal propagated in a broadcast station, and the like. In addition, some of the configurations of the user-selected type image providing system 100 may be provided in one device or server. For example, the video decoding apparatus 120 and the user terminal 300 may be included in one apparatus.

The plurality of cameras 200 may be image cameras that photograph images at a plurality of positions. Illustratively, the plurality of video cameras 200 may be video cameras that photograph a plurality of areas or persons in a wide range of venues, concerts, and the like. For example, the arrangement of the plurality of cameras 200 may be one-dimensional parallel, two-dimensional parallel, one-dimensional arrangement, or the like, and may be an image camera that captures an image at a predetermined interval. The video camera may include a camera capable of capturing images such as a binocular camera, a camera using a horizontal rig, and a camera using an orthogonal rig.

The video encoding apparatus 110 can receive a plurality of video data photographed from each of the plurality of video cameras 200. The video encoding device 110 receives the video data from the plurality of video cameras 200 in accordance with the characteristics of the video data, the degree of zoom-in / zoom-out, the view of the video camera, And the like can be received. For example, the characteristics of the image data may include resolution, color, similarity of the background, number of pixels, number of image frames, and the like.

The video encoding apparatus 110 can encode the video data received from the video camera 200. [ In addition, the video encoding apparatus 110 may encode the received video data according to the characteristics of the received video data, the viewpoint of the video camera, the degree of zoom-in / zoom-out, The encoding method can be determined.

The video encoding apparatus 110 may encode video data belonging to the same group among a plurality of received video data using a first prediction method and encode video data belonging to different groups using a second prediction method. According to one embodiment of the present invention, the meaning that the image data belongs to the same group means that, for example, when there is redundancy of the shooting view between the received image data, it is determined that the plurality of image data belongs to the same group . More specifically, the image encoding apparatus 110 may judge that the same point in time is image data photographed when the similarity degree of the imaging point of time between image data is equal to or greater than a predetermined value, and judge that they belong to the same group. For example, the calculation of the degree of similarity at the time of photographing may include the degree of similarity of the background included in the image data. Or the degree of zoom-in / zoom-out for the same object 1 including the image data of the same object 1 is equal to or greater than a preset value, May be determined to belong to the group.

As another example, it can be determined whether each image data belongs to the same group according to the positional proximity of each image camera. For example, when the difference between the respective image cameras or the difference in the photographing direction or the photographing angle is less than a predetermined reference value, the photographed image data of the corresponding image camera can be judged to belong to the same group. The distance between each image camera can be judged on the basis of the position value of each camera, the gps value and the like, and the photographing direction or photographing angle can be judged on the basis of the angle or the like rotated on the basis of the preset reference line.

The video encoding apparatus 110 can encode video data belonging to the same group using a first prediction method. It is necessary to compress all the images acquired from the plurality of cameras 200 to transmit them, but the amount of data acquired from the plurality of cameras 200 may be very large. In the case of coding the image data belonging to the same group using the first prediction method, since there is temporal and spatial redundancy between the image data of the cameras belonging to the same group and motion estimation is possible, a first prediction The compression efficiency can be increased. On the other hand, when there is no redundancy between the image data belonging to another group, that is, the view of the image data, if the similarity degree between the image data at the shooting time is less than a predetermined value, , And can be encoded by a second prediction method with a relatively low compression efficiency. As described above, the video encoding apparatus 110 of the present invention can improve the compression efficiency and the compression rate by selectively encoding the plurality of image data, and selectively applying the encoding method according to the degree of similarity and correlation between the image data.

According to one embodiment of the present invention, the image encoding apparatus 110 encodes a plurality of pieces of image data by using a first prediction method when the similarity degree of the shooting time point between the plurality of pieces of image data is equal to or larger than a predetermined value, If it is less than the set value, it can be encoded by the second prediction method. At this time, the photographing time point may include the angle of view or the viewpoint or the degree of zoom-in / zoom-out in view of the objective observer. Illustratively, the similarity at the time of photographing can be preset to a value of 30%. If the similarity degree between the first image data and the second image data at the time of photographing is equal to or greater than a predetermined value (for example, 30%) through image analysis between each image data, the first prediction method can be performed. On the other hand, if the similarity degree between the third image data and the fourth image data is less than a preset value (for example, 30%), the second prediction method can be performed.

Illustratively, the first prediction method may be MVC inter prediction and the second prediction method may be simulcast inter prediction. MVC inter prediction, which is a first prediction method, can be a method of increasing compression efficiency through inter prediction between multi-view video coding as well as inter-frame prediction on a time axis, as well as prediction between image data of adjacent cameras. Simulcast inter prediction, which is a second prediction method, excludes prediction of the time between adjacent camera image data, and a coding method using only interframe prediction on a domain of a camera image based on existing H.264 / AVC and H.265 / HEVC Lt; / RTI >

According to an embodiment of the present invention, when the redundancy or similarity between a plurality of image data is equal to or greater than a predetermined value, the image encoding apparatus 110 encodes the image data using a first prediction method of referring to each image data frame, The second prediction method of performing prediction using only one frame of a camera image without reference to neighboring image data can be selectively used to increase the compression rate when there is no redundancy or similarity among a plurality of image data or less than a predetermined value . The Simulcast inter prediction method can be used when the inter-frame similarity is relatively low because the Inter frame comparison is less than the MVC inter prediction method. When there are a plurality of video cameras, a plurality of cameras that capture relatively similar images are grouped, and the video of cameras belonging to the same group is compressed using the MVC inter prediction method, Can be compressed using the Simulcast inter prediction method. According to one embodiment of the present invention, the Simulcast inter prediction method and the MVC inter prediction method are selectively applied according to the degree of similarity between frames of a plurality of camera images, The efficiency and the compression speed can be improved.

According to an embodiment of the present invention, MVC inter prediction, which is a first prediction method, may be a prediction structure used for effectively compressing and encoding an image obtained using two or more cameras. Referring to FIGS. 3A and 3B, Sm represents camera or image data at the m-th time point, and Tn may represent an n-th screen or an image frame temporally. An arrow may refer to a predictive reference relationship between neighboring views. (I frame) is referred to as an I frame, and the point of time at which the predictive encoding is performed with reference to only one time point after coding is referred to as P point (P frame ), And a point of time at which the predictive encoding is performed with reference to both of the two viewpoints (forward and backward viewpoints) is referred to as a B viewpoint (B frame). For example, it is assumed that the time point S0 corresponds to the time point I, the time points S2, S4, S6, and S7 correspond to the time point P, and the time points S1, S3, and S5 correspond to the time point B. In the predictive structure thus determined, the I viewpoint is encoded first, the P viewpoint is encoded, and then the B viewpoint is encoded. For example, the sign encoding can be performed in the order of S0-S2-S1-S4-S3-S6-S5-S7. Place the reference screen at regular intervals for random access. This reference picture can be encoded using only inter-view prediction. Inter prediction is an encoding technique based on similiarities between consecutive frames in a video sequence. A technique of encoding an image by estimating and compensating motion in a current frame using one or more reference frames on a block-by-block basis. A block similar to the current frame is searched in the reference frame and the motion vector is extracted. By compressing the residue between the current block and similar blocks in the reference frame, the compression rate of the image encoding can be increased. In this case, since a motion vector is required to decode an encoded image according to inter prediction, a motion vector is also encoded.

According to one embodiment of the present disclosure, the second prediction method may be simulcast inter prediction. In Inter Frame Coding, a P frame is a prediction frame that refers to a past frame, and may be a form in which a certain portion (pixel) moves instead of a change of the frame between frames as a whole. The second prediction method may be a coding method using only inter-frame prediction on a domain based on the existing H.264 / AVC and H.265 / HEVC, in which the prediction between views is excluded. In the second prediction method, only difference values of the preceding and following frames are encoded.

3A and 3B correspond to an embodiment, and the MVC inter prediction of the first prediction method and the image reference order of the simulcast inter prediction, which is the second prediction method, and the prediction combination of the respective image frames can be changed .

In addition, the video encoding apparatus 110 can transmit a plurality of encoded and compressed video data to the video decoding apparatus 120. According to one embodiment of the present invention, a plurality of image data may be compressed into at least one bit-stream and transmitted to the image decoding apparatus 120 through a network.

The image decoding apparatus 120 can receive the encoded image data. In addition, according to one embodiment of the present invention, the image decoding apparatus 120 can decode and output the encoded image data based on a user input. According to an embodiment of the present invention, the image decoding apparatus 120 can decode only the first image data selected by the user based on the user input among the plurality of encoded image data and output the decoded first image data. The image decoding apparatus 120 may receive a user input for selecting at least one image data among a plurality of image data captured by the plurality of image cameras 200. [ The user input may include location data of a camera, an identifier of a camera, an image selection input based on a flag, and the like. The image decoding apparatus 120 may extract only the image data associated with the selected camera from the bit stream received from the image encoding apparatus 110 through the camera position data or flag selected by the user and decode the extracted image data alone. Accordingly, the image decoding apparatus 120 can improve the decoding efficiency and speed by decoding only the image data selected by the user from among the plurality of encoded image data.

Also, the image decoding apparatus 120 decodes the image data of the image camera belonging to the group such as the first image camera and the first image camera linked to the selected first image data among the plurality of image data based on the received user input can do. For example, the image decoding apparatus 120 can extract and decode only the image data having the MVC inter prediction relationship with the selected first image data and the first image data.

For example, referring to FIG. 2, the camera associated with the first image data may be the first image camera 211. The first image camera 211 may be a camera belonging to the first group 210. The image cameras belonging to the same group as the first image camera may be the second image camera to the third image camera 212 to 213. Since the redundancy and the similarity at the shooting time are equal to or greater than predetermined values between the video data belonging to the group such as the first video camera and the first video camera associated with the selected first video data based on the user input, The spatial redundancy can be utilized to provide a high compression efficiency and a decryption efficiency.

For example, when there are a plurality of image cameras, the images of the video cameras 211 to 213 of the first group 210 that capture a relatively similar screen are compressed using the MVC inter prediction method, Compression can be performed between the video images of the video cameras 211 to 213 of the first group 210 having a low similarity and the video images of the video cameras 221 to 223 of the second group 220 using the Simulcast inter prediction method.

According to another embodiment of the present invention, the image decoding apparatus 120 can decode both the encoded image data and output all of the decoded image data. The decoded image data may be output to the user terminal 300. The image decoding apparatus 120 can output each image data in association with the identifier of each image camera 200. Also, the video decoding apparatus 120 or the user terminal 300 may receive an input for selecting one of the plurality of video data desired by the user. Illustratively, the user may perform an input to select only one image desired by the user out of the images output to the user terminal 300. The image decoding apparatus 120 may output only the selected image out of the decoded image data based on the user input and stop outputting the image data that does not receive the user input.

The user terminal 300 can receive input of a user who selects at least one image data among a plurality of image data photographed by a plurality of cameras. The user terminal 300 can receive the decoded image data from the image decoding apparatus 120. [ The user can use the input interface. For example, the user can select at least one image data among a plurality of images using a remote controller or a touch screen, but the present invention is not limited thereto.

As described above, according to one embodiment of the present invention, the user can select and view only the image data of the image camera desired to be viewed among the image data captured by the plurality of image cameras through the user terminal 300. [

Illustratively, the user terminal 300 is a device that interacts with the video decoding apparatus 100 through a network, for example, a smart phone, a smart pad, a tablet PC, a wearable device, Communication System, GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication) -2000, CDMA (Code Division Multiple Access) -2000, W-Code Division Multiple Access (W-CDMA), and Wireless Broadband Internet (Wibro) terminals, desktop computers and smart TVs.

A network may be used for image data sharing between the respective components of the image providing system 100. An example of a network for sharing image data includes a LAN (Local Area Network), a wireless LAN (Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), a Wi- , NFC (Near Field Communication) network, 3G, Long Term Evolution (LTE), 5G network, and WIMAX (World Interoperability for Microwave Access) network.

4 is a block diagram illustrating a schematic configuration of a video encoding apparatus and an image decoding apparatus according to an embodiment of the present invention.

Referring to FIG. 4, the user-selected type image providing system 100 may include an image encoding apparatus 110 and an image decoding apparatus 120. The video encoding apparatus 110 may include a video data receiving unit 111, an encoding unit 112, and a transmission unit 113. The image decoding apparatus 120 may include a user input unit 121, a decoding unit 122, and a receiving unit 123.

The video data receiving unit 111 can receive a plurality of video data photographed by the plurality of video cameras 200. The video data receiving unit 111 can receive a plurality of video data photographed by each of the plurality of video cameras. The characteristics of the plurality of image data image data, the viewpoint and position of the image camera, and the like may be different from each other.

The encoding unit 112 may encode video data belonging to the same group among a plurality of received video data using a first prediction method and encode video data belonging to different groups using a second prediction method.

The encoding unit 112 may encode the image data using the first prediction method when there is redundancy in the viewpoint of a plurality of image data. Since a plurality of similar images or frames exist in a plurality of image data having redundant view, compression efficiency can be increased during image data compression through a first prediction method referring to a plurality of camera images during data compression.

The encoding unit 112 can encode the image data using the first prediction method when the similarity degree of the shooting time between the plurality of image data is equal to or larger than a predetermined value. The encoding unit 112 can encode the image data with the second prediction method when the similarity degree of the shooting time between the plurality of image data is less than a preset value.

For example, the similarity between the plurality of image data at the shooting time point may mean that the background is similar. For example, the similarity degree at the time of photographing may be 30%. The encoding unit 112 may encode the image data using the first prediction method when the similarity degree of the shooting time (background) between the plurality of image data is 30% or more. 2, a plurality of video cameras 211, 212, 213 included in the first group 210 or a plurality of video cameras 221, 222, 223 included in the second group 220, The similarity degree may be relatively high. On the other hand, the similarity degree between the shooting time (background) taken by the first group 210 and the shooting time (background) taken by the second group 220 may be relatively low.

The encoding unit 112 can encode video data belonging to the same group among a plurality of video data received according to the positional proximity of the plurality of video cameras 200 by a first prediction method. The encoding unit 112 can encode video data belonging to different groups among a plurality of video data received according to the positional proximity of the plurality of video cameras 200 by a second prediction method. The location proximity of the plurality of video cameras 200 may refer to the degree of proximity between the cameras. If the positions of the first camera and the second camera are adjacent to each other, there may exist image data photographed at the same point in time. Illustratively, referring to FIG. 2, a plurality of cameras in the first group 210 may be a group of a plurality of image data whose positional proximity is close to each other. For example, a plurality of cameras belonging to the first group 210 may be arranged at regular intervals. The camera arrangement of the plurality of video cameras 300 belonging to the same group can be arranged in one-dimensional parallelism, one-dimensional convergence, one-dimensional arcs, two-dimensional parallelism, two-dimensional arrangement, or the like. Since similar images can be simultaneously photographed using a plurality of cameras adjacent to each other in the same group, correlation between the viewpoints can be high since they contain almost the same information except for the time difference and slight illumination difference. On the other hand, the image data photographed by the image cameras of the first group 210 and the second group 220 may be image data belonging to different groups. The positional proximity between the video cameras 211 to 213 included in the first group 210 and the video cameras 221 to 223 included in the second group 220 is longer than the distance included in each group , The degree of similarity or correlation of the image (background) can be low, and can be encoded by the second prediction method.

The transmitting unit 113 can transmit the encoded video data. The transmitting unit 113 may transmit the image data encoded by the encoding unit 112 to the image decoding apparatus 120.

The user input receiving unit 121 may receive a user input for selecting at least one image data among a plurality of image data. The user input receiving unit 121 may transmit the user input information to the decoding unit 122.

The decoding unit 122 may decode the image data encoded by the encoding unit 112. [

The decoding unit 122 may decode all the image data encoded by the first prediction method and the second prediction method in the encoding unit 120 according to an embodiment of the present invention. According to another embodiment of the present invention, the decoding unit 122 may decode only the selected video data (first video data) based on the user input information received by the user input receiving unit 121. [

The receiving unit 123 can receive a plurality of encoded video data. The receiving unit 123 can receive all of the plurality of video data encoded by the encoding unit 112 from the transmitting unit 113. [

5 is a flowchart schematically illustrating a first embodiment of a method for providing a user-selected image according to an embodiment of the present invention. 5 can be performed by the operation of the user-selectable image system 100 described with reference to FIGS. 1 to 4. FIG. Therefore, the description of the user-selectable type image system 100 described with reference to FIGS. 1 to 4 is applied to FIG. 4 as well, so that detailed description thereof will be omitted.

Referring to FIG. 5, according to one embodiment of the present invention, in step S510, a plurality of cameras 200 may transmit a plurality of image data photographed by a plurality of image cameras to the image encoding apparatus 110. FIG. In operation S520, the image encoding apparatus 110 may receive a plurality of image data transmitted from the plurality of cameras 200. [

In step S530, the image encoding apparatus 110 can determine the encoding method of the received image data according to the characteristics of the received image data, the viewpoint and the position of the image camera, and the like. In addition, the video encoding apparatus 110 encodes video data belonging to the same group among a plurality of video data received according to the characteristics of the video data, the viewpoint and the position of the video camera using the first prediction method, The data can be encoded by the second prediction method. For example, the first prediction method may be MVC inter prediction and the second prediction method may be simulcast inter prediction.

In step S540, the image encoding apparatus 110 may transmit the encoded image data to the image decoding apparatus 120. [ In step S550, the video decoding apparatus 120 can receive a plurality of encoded video data.

In step S560, the image decoding apparatus 120 may receive a user input for selecting at least one of the plurality of image data. In step S570, the image decoding apparatus 120 may decode the first image data selected by the user among the plurality of image data encoded by the image encoding apparatus 110 based on the user input information.

In step S580, the image decoding apparatus 120 can output decoded image data (first image data). According to an embodiment of the present invention, the image decoding apparatus 120 may be configured to receive all the decoded images and output only images selected by the user

FIG. 6 is a flowchart schematically illustrating a second embodiment of a method for providing a user-selectable image according to an embodiment of the present invention. The method for providing a user-selected image shown in FIG. 6 may be performed by the operation of the user-selectable image system 100 described with reference to FIGS. Therefore, the description of the user-selectable image system 100 described with reference to FIGS. 1 to 4 will be applied to FIG. 6 as well, so that detailed description thereof will be omitted.

According to another embodiment of the present invention, in step S610, the plurality of cameras 200 may transmit a plurality of photographed image data to the image encoding apparatus 110. [ In operation S620, the image encoding apparatus 110 may receive a plurality of image data transmitted from the plurality of cameras 200. [

In step S630, the image encoding apparatus 110 can determine the encoding method of the received image data according to the characteristics of the received image data, the viewpoint and the position of the image camera, and the like. The video encoding apparatus 110 may encode video data belonging to the same group among a plurality of received video data using a first prediction method. The video encoding apparatus 110 can encode video data belonging to different groups using a second prediction method. 1 prediction method may be MVC inter prediction, and the second prediction method may be simulcast inter prediction.

In step S640, the image encoding apparatus 110 may transmit the encoded image data to the image decoding apparatus 120. [ In step S650, the video decoding apparatus 120 can receive a plurality of encoded video data. The image decoding apparatus 120 can receive all of the plurality of image data encoded by the image encoding apparatus 110. [

In step S660, the image decoding apparatus 120 can decode all of the plurality of encoded image data. In step S670, the image decoding apparatus 120 may receive user input. The video decoding apparatus 120 outputs all of the encoded video data to the user terminal 300 and the video decoding apparatus 120 can receive an input for selecting the video data desired by the user.

In step S680, the video decoding apparatus 120 may output the selected video data based on the user input. The image decoding apparatus 120 may stop outputting the remaining image data that has not received user input and may output only the selected image data according to the user input.

The method for providing a user-selected image according to an exemplary embodiment of the present invention may be implemented in the form of a program command that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

It will be understood by those of ordinary skill in the art that the foregoing description of the embodiments is for illustrative purposes and that those skilled in the art can easily modify the invention without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be interpreted as being included in the scope of the present invention.

100:
110: a video encoding device
111:
112: encoding section
113:
120: Image decoding device
121: user input section
122: decoding section
123: Receiver
200: Multiple video cameras
300: user terminal

Claims (20)

A computer-readable recording medium storing a computer-readable program for causing a computer to execute the steps of: receiving a plurality of image data from a plurality of image cameras; calculating a similarity degree of a shooting time point among the plurality of image data among the plurality of received image data, Wherein when the positional proximity is less than or equal to a preset reference value, the plurality of image data is classified into image data belonging to the same group, the image data belonging to the same group is encoded with the first prediction method, 2 prediction method and transmitting the encoded image data; And
Receiving the encoded image data, receiving a user input for selecting at least one image data among a plurality of image data captured by the plurality of image cameras, decrypting the encoded image data based on the user input An image decoding device for outputting,
, ≪ / RTI &
The similarity calculation at the time of photographing may include a background included in the plurality of image data, a degree of including image data related to the same object, and a zoom-in / zoom-out -out < / RTI >
The positional proximity is determined by taking into consideration the difference between the distance between the image cameras, the photographing direction and the photographing angle,
Wherein the distance between the image cameras is determined based on a position value of each camera, and the photographing direction or photographing angle is judged based on an angle that is rotated based on a preset reference line. delete The method according to claim 1,
Wherein the first prediction method is MVC inter prediction and the second prediction method is simulcast inter prediction. A video data receiving unit for receiving a plurality of video data photographed by a plurality of video cameras;
Wherein when the degree of similarity is equal to or greater than a predetermined reference value and the positional proximity of each of the plurality of image cameras is equal to or less than a predetermined reference value, An encoding unit that classifies image data into the same group, encodes image data belonging to the same group using a first prediction method, and encodes image data belonging to different groups using a second prediction method; And
A transmitting unit for transmitting the encoded image data,
, ≪ / RTI &
The similarity calculation at the time of photographing may include a background included in the plurality of image data, a degree of including image data related to the same object, and a zoom-in / zoom-out -out < / RTI >
The positional proximity is determined by taking into consideration the difference between the distance between the image cameras, the photographing direction and the photographing angle,
Wherein the distance between the image cameras is determined based on the position value of each camera, and the photographing direction or photographing angle is judged based on a rotated angle based on a preset reference line. delete delete 5. The method of claim 4,
Wherein the first prediction method is MVC inter prediction and the second prediction method is simulcast inter prediction. delete A receiving unit for receiving a plurality of encoded video data;
A user input unit for receiving a user input for selecting at least one image data among the plurality of image data; And
A decoding unit decoding the encoded image data based on the user input and outputting the decoded image data,
, ≪ / RTI &
Wherein the plurality of encoded video data are generated in such a manner that the similarity degree of the shooting time between the plurality of video data among the plurality of video data photographed by the plurality of video cameras is equal to or greater than a preset reference value, The image data belonging to the same group is coded by the first prediction method and the image data belonging to the different group is coded by the second prediction method Coded,
The similarity calculation at the time of photographing may include a background included in the plurality of image data, a degree of including image data related to the same object, and a zoom-in / zoom-out -out < / RTI >
The positional proximity is determined by taking into consideration the difference between the distance between the image cameras, the photographing direction and the photographing angle,
Wherein a distance between the image cameras is judged based on a position value of each camera, and a photographing direction or photographing angle is judged based on a rotated angle with reference to a preset reference line. 10. The method of claim 9,
Wherein the decoding unit decodes the selected first image data among a plurality of encoded image data based on the user input and outputs the decoded first image data. 10. The method of claim 9,
Wherein the decoding unit decodes all the encoded image data and outputs the selected first image data based on the user input. 10. The method of claim 9,
Wherein the first prediction method is MVC inter prediction and the second prediction method is simulcast inter prediction. 10. The method of claim 9,
Wherein the decoding unit decodes image data of a first image camera associated with the selected first image data and a video camera belonging to the same group as the first image camera based on the received user input, A user-selectable image decoding apparatus. The method comprising: receiving a plurality of image data photographed by a plurality of image cameras;
Wherein when the degree of similarity is equal to or greater than a predetermined reference value and the positional proximity of each of the plurality of image cameras is equal to or less than a predetermined reference value, Encoding the image data into image data belonging to the same group, encoding the image data belonging to the same group using a first prediction method, and encoding image data belonging to different groups using a second prediction method;
Transmitting the encoded image data;
Receiving a user input for selecting at least one of the plurality of image data;
Decoding the encoded image data; And
Outputting the decoded image data;
, ≪ / RTI &
The similarity calculation at the time of photographing may include a background included in the plurality of image data, a degree of including image data related to the same object, and a zoom-in / zoom-out -out < / RTI >
The positional proximity is determined by taking into consideration the difference between the distance between the image cameras, the photographing direction and the photographing angle,
Wherein the distance between the image cameras is determined based on the position value of each camera, and the photographing direction or photographing angle is judged based on a rotated angle with reference to a preset reference line. 15. The method of claim 14,
Wherein the decrypting step decrypts the first image data selected from the plurality of image data based on the user input,
Wherein the step of outputting the image data outputs the decoded first image data. 15. The method of claim 14,
Wherein the decoding step decodes all the encoded image data,
Wherein the step of outputting the image data outputs the first image data selected based on the user input. delete delete 15. The method of claim 14,
Wherein the first prediction method is MVC inter prediction and the second prediction method is simulcast inter prediction. A computer-readable recording medium storing a program for causing a computer to execute the method of any one of claims 14 to 16 and 19.

Images