KR20180070234A - Apparatus and user device for providing time slice video - Google Patents

Abstract

An apparatus for providing a time slice image with a high degree of freedom comprises: an image reception unit receiving a plurality of images photographed from a plurality of cameras; a selection unit selecting an area of interest from at least one image among the plurality of images; a coordination restoring unit restoring multidimensional center coordinates based on the selected area of interest and position relationship information on the plurality of cameras; and a generation unit extracting each image from the plurality of images based on the restored multidimensional center coordinates and generating a time slice image using each of the obtained images.

Description

[0001] APPARATUS AND USER DEVICE FOR PROVIDING TIME SLICE VIDEO [

The present invention relates to an apparatus and a user terminal for providing a time slice image.

The time slice technique is a technique in which a plurality of cameras are set so that they face the subject at various angles and instantaneously simultaneously photographed, and then the pictures are connected by using a computer so that the still motion of the subject is seen as if it was taken with a movie camera . Time slices not only give a three-dimensional representation of the subject, but also provide a sense of time and space.

In connection with this time slice technique, Korean Unexamined Patent Publication No. 2007-0000994 discloses a system and method for recording and reproducing images.

Recently, the time slice technique is applied during the sports competition, so that it is possible to analyze or comment on the sports game through the detailed screen composed of multiple points. However, in the case of a conventional sports game, an incorrect time slice image is produced because a point at which an event is to be manually generated by the time slice image producer must be selected in advance. Also, since the event occurs randomly during the sporting event, it has a disadvantage that it is difficult to predict the point where the event occurs.

In the case of a sporting event, it is difficult to set an area for an event occurrence point by randomly generating an event occurrence point, but by instantly processing it, it is possible to provide a time slice image applicable to a sports game, . Conventionally, a time slice image can not be generated around an object which can be tracked. However, the present invention can provide a time slice image with high degree of freedom by making it possible to generate a time slice image around an arbitrary point. To provide a user terminal. An apparatus for providing an interactive time slice image for providing a time slice image for a selected arbitrary area when a user selects an arbitrary area, and a user terminal. It is to be understood, however, that the technical scope of the present invention is not limited to the above-described technical problems, and other technical problems may exist.

According to an aspect of the present invention, there is provided an image processing apparatus including an image receiving unit configured to receive a plurality of images captured by a plurality of cameras, a selection unit configured to select a region of interest from at least one of the plurality of images, A coordinate restoration unit for restoring the multi-dimensional center coordinates based on the selected region of interest and the positional relationship information for the plurality of cameras, and a controller for extracting each image from the plurality of images on the basis of the restored multi- And a generation unit that generates a time slice image using each of the obtained images.

According to another aspect of the present invention, there is provided an image processing apparatus including an image transmission unit for transmitting a plurality of images taken by a plurality of cameras to a user terminal, a receiving unit for receiving an interest region selected from at least one image among the plurality of images, A coordinate restoration unit for deriving a multi-dimensional center coordinate based on the selected region of interest and the positional relationship information for the plurality of cameras, extracts each image from the plurality of images on the basis of the restored multi-dimensional center coordinate, A generation unit generating a time slice image using each image, and a transmission unit transmitting the generated time slice image to the user terminal.

According to another embodiment of the present invention, there is provided an image processing apparatus including an image receiving unit for receiving a plurality of images photographed from a plurality of cameras from a time slice image providing apparatus, a selecting unit for selecting an area of interest from at least one of the plurality of images, And a transmitting unit for transmitting the ROI to the time slice image providing apparatus, wherein the image receiving unit receives the multi-dimensional center coordinates reconstructed from the time slice image providing apparatus based on the ROI and the positional relationship information for the plurality of cameras, Wherein the time slice image is generated using each of the acquired images, the time slice image being generated based on the extracted time slice image, each image being extracted from the plurality of images around the restored multi-dimensional center coordinate, A user terminal can be provided.

The above-described task solution is merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and the detailed description of the invention.

According to any one of the above-described objects of the present invention, in the case of a sporting event, since an event occurrence point occurs at random, it is difficult to set an area for an event occurrence point, but by immediately processing it, It is possible to provide a device and a user terminal capable of providing a time slice image as much as possible. Conventionally, a time slice image can not be generated around an object which can be tracked. However, the present invention can provide a time slice image with high degree of freedom by making it possible to generate a time slice image around an arbitrary point. A user terminal can be provided. An apparatus and a user terminal providing an interactive time slice image for providing a time slice image for a selected region when a user selects an arbitrary region.

1 is a configuration diagram of a time slice image providing system according to an embodiment of the present invention.
2 is a configuration diagram of a time slice image providing apparatus according to an embodiment of the present invention.
FIG. 3 is an exemplary diagram illustrating a process of selecting a region of interest in a plurality of images according to an exemplary embodiment of the present invention. Referring to FIG.
FIGS. 4A and 4B are exemplary diagrams for explaining a process of setting an angle of view region by extending an area from an image center coordinate according to an embodiment of the present invention.
5A and 5B are exemplary diagrams illustrating a process of restoring the multi-dimensional center coordinates according to an embodiment of the present invention.
FIG. 6 is an exemplary diagram for explaining a process of extracting an image around a projection coordinate and generating a time slice image according to an embodiment of the present invention. Referring to FIG.
7 is a flowchart illustrating a method of providing a time slice image in a time slice image providing apparatus according to an embodiment of the present invention.
8 is a configuration diagram of a time slice image providing apparatus according to another embodiment of the present invention.
9 is a flowchart illustrating a method of providing a time slice image in a time slice image providing apparatus according to another embodiment of the present invention.
10 is a configuration diagram of a user terminal according to an embodiment of the present invention.
11 is a flowchart illustrating a method of providing a time slice image in a user terminal according to an exemplary embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, which will be readily apparent to those skilled in the art. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "including" an element, it is to be understood that the element may include other elements as well as other elements, And does not preclude the presence or addition of one or more other features, integers, steps, operations, components, parts, or combinations thereof.

In this specification, the term " part " includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be implemented using two or more hardware, or two or more units may be implemented by one hardware.

In this specification, some of the operations or functions described as being performed by the terminal or the device may be performed in the server connected to the terminal or the device instead. Similarly, some of the operations or functions described as being performed by the server may also be performed on a terminal or device connected to the server.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a time slice image providing system according to an embodiment of the present invention. Referring to FIG. 1, a time slice image providing system 1 may include a plurality of cameras 110, a time slice image providing apparatus 120, and a user terminal 130. A plurality of cameras 110, a time slice image providing apparatus 120, and a user terminal 130 illustratively illustrate components that can be controlled by the time slice image providing system 1.

Each component of the time slice image providing system 1 of FIG. 1 is generally connected via a network. For example, as shown in FIG. 1, the time slice image providing apparatus 120 may be connected to the plurality of cameras 110 and the user terminal 130 at the same time or at intervals.

The network refers to a connection structure in which information can be exchanged between each node such as terminals and servers. An example of such a network is 3G, 4G, 5G, Wi-Fi, Bluetooth, , A LAN (Local Area Network), a Wireless LAN (Local Area Network), a WAN (Wide Area Network), a PAN (Personal Area Network), and the like.

The plurality of cameras 110 may photograph a sports competition image or a performance image at a sports arena or a venue, and may transmit the photographed image to the time slice image providing device 120. For example, the plurality of cameras 110 may be installed at predetermined intervals in a sports arena or in a performance hall.

The time slice image providing apparatus 120 can receive a plurality of images photographed from the plurality of cameras 110 and transmit the received plurality of images to the user terminal 130. [ The time slice image providing device 120 can derive the positional relationship information based on the internal parameters and the external parameters for the plurality of cameras 110. [ The internal parameter may include a focal length of the plurality of cameras 110, an image center value and a camera distortion value, and the external parameter may include position information relative to the reference coordinates of the plurality of cameras 110.

The time slice image providing apparatus 120 can select a region of interest from at least one of a plurality of images. For example, the time slice image providing apparatus 120 can select a region of interest by receiving a region of interest selected from at least one of the plurality of images from the user terminal 130. Specifically, the time slice image providing apparatus 120 may select a region of interest by allowing the user terminal 130 to select an arbitrary point on at least one of the plurality of images and set the coordinates as an image center coordinate.

The time slice image providing apparatus 120 may restore the multidimensional center coordinates based on the selected region of interest and the positional relationship information for the plurality of cameras 110. [ For example, when the image center coordinates of at least two of the plurality of images are set, the time slice image providing apparatus 120 may restore the multi-dimensional center coordinates based on at least two image center coordinates and positional relationship information. For example, when the image center coordinate of one of the plurality of images is set, the time slice image providing apparatus 120 may extend the camera center of view corresponding to the image center coordinates set based on the positional relationship information, The point of contact with a plane equation including a straight line and an arbitrary point can be restored to a multi-dimensional center coordinate. When the image center coordinates of one of the plurality of images are set, the time slice image providing apparatus 120 may be configured to provide a time slice image to the time slice image providing apparatus 120, It is possible to restore the multi-dimensional center coordinates by reflecting the depth value of the background including the arbitrary point.

The time slice image providing device 120 can extract the projected coordinates from each of the plurality of images by projecting the restored multi-dimensional center coordinates on the plurality of images. At this time, the time slice image providing device 120 can set the field angle area by extending the area from the image center coordinates set by the additional input.

The time slice image providing apparatus 120 may extract each image from a plurality of images on the basis of the restored multi-dimensional center coordinates, and may generate a time slice image using each of the obtained images. In addition, the time slice image providing apparatus 120 may extract each image from a plurality of images around the extracted projected coordinates, and generate a time slice image using each of the obtained images. For example, the time slice image providing apparatus 120 may reflect an image of a field of view set around the extracted projected coordinates on a plurality of images, and extract an image corresponding to a field of view reflected from the plurality of images. At this time, the time slice image providing device 120 can correct the angle of view area centered on the extracted projected coordinates by using the positional relationship information, and reflect it on a plurality of images.

The time slice image providing apparatus 120 may transmit the generated time slice image to the user terminal 130. [

The user terminal 130 can receive a plurality of images photographed from the plurality of cameras 110 from the time slice image providing device 120. [

The user terminal 130 may select a region of interest from at least one of the plurality of images and transmit the selected region of interest to the time slice image providing apparatus 120. For example, the user terminal 130 selects a region of interest by selecting an arbitrary point from at least one image among a plurality of images and setting the region as an image center coordinate, and transmits the selected region of interest to the time slice image providing apparatus 120 .

The user terminal 130 may set an angle of view area by extending the area from the image center coordinates set by the additional input and transmit the set angle of view area to the time slice image providing device 120. [ For example, the user terminal 130 may set the angle of view range by extending from the set image center coordinates to the area input by the drag input and the inverted area.

The user terminal 130 can receive the time slice images generated based on the reconstructed multi-dimensional center coordinates based on the region of interest and the positional relationship information of the plurality of cameras 110 from the time slice image providing device 120 .

2 is a configuration diagram of a time slice image providing apparatus according to an embodiment of the present invention. 2, the time slice image providing apparatus 120 includes a positional relationship deriving unit 210, an image receiving unit 220, a selecting unit 230, a coordinate restoring unit 240, a projection coordinate extracting unit 250, And a generating unit 260.

The positional relationship derivation unit 210 can derive the positional relationship information based on the internal parameters and the external parameters for the plurality of cameras 110. [ The internal parameter may include at least one of the focal length, the image center value, and the camera distortion value of the plurality of cameras 110, and the external parameter may include positional information relative to the reference coordinates of the plurality of cameras 110. For example, when a plurality of cameras 110 are installed in a sports arena, the positional relationship derivation unit 210 may calculate the positional relationship of the plurality of cameras 110 with respect to the plurality of cameras 110 using the observable features such as the corners of the sports arena, The positional relationship information can be derived based on the parameter and the external parameter. For example, the positional relationship derivation unit 210 may derive the positional relationship information based on internal parameters and external parameters for the plurality of cameras 110 using a structure from motion (SFM) technique. The SFM technique refers to a technique of detecting 3D structure information and camera motion from an image having different viewpoints.

The process of finding the positional relationship information of the plurality of cameras 110 is performed after a plurality of cameras 110 are disposed in a sports arena or a venue. When the positions of the plurality of cameras 110 are changed, Lt; RTI ID = 0.0 > 110 < / RTI >

The image receiving unit 220 can receive a plurality of images photographed by the plurality of cameras 110. [

The selecting unit 230 may select a region of interest from at least one of the plurality of images. The selecting unit 230 can select a region of interest by selecting an arbitrary point from at least one of the plurality of images and setting the coordinates as an image center coordinate. An arbitrary point can be the point where the object is located, but it can also be the point where the object is not located. Thus, the present invention has the advantage that no tracking is required on the object to select the region of interest. That is, according to one embodiment of the present invention, the time slice image providing apparatus 120 can directly select the region of interest according to the input of the user.

The process of selecting the region of interest will be described in detail with reference to FIG.

FIG. 3 is an exemplary diagram illustrating a process of selecting a region of interest in a plurality of images according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 3, a region of interest may be selected from a plurality of images to generate a time slice image for a baseball game.

For example, when a time slice image for a baseball game is to be generated, the selecting unit 230 selects an arbitrary point 311 for the batter positioned at the batter in the first image 310 among the plurality of images, An arbitrary point can be set to the image center coordinate (X) to select the region of interest. The selecting unit 230 selects an arbitrary point 321 for the batter positioned on the batter in the second image 320 of the plurality of images to set the selected arbitrary point as the image center coordinate X ' Can be selected.

2, the selector 230 may set an angle of view region by extending an area from the image center coordinate set in the additional input. For example, the field angle area may be set by extending the area input by the drag input inputted through the user terminal 130 from the set image center coordinate and the inverted area. The process of extending the area from the image center coordinates to set the field angle area will be described in detail with reference to FIGS. 4A and 4B.

FIGS. 4A and 4B are exemplary diagrams for explaining a process of setting an angle of view region by extending an area from an image center coordinate according to an embodiment of the present invention.

FIG. 4A is an exemplary diagram illustrating a process of setting a field angle area according to an embodiment of the present invention. Referring to FIG. Referring to FIG. 4A, when an arbitrary point is selected from at least one image among a plurality of images in the selecting unit 230, an image center coordinate for a selected arbitrary point can be set. The image center coordinate may correspond to the (xc, yc) coordinate 410 of 'key down'.

The selection unit 230 may select the region of interest based on the selected image center coordinates. The region of interest may be, for example, an area corresponding to the (x, y) coordinate 402 of 'key up' from a coordinate (xc, yc) 410 of 'key down' (-X, -y) coordinate 401 of the 'key up' in which the coordinate 402 is inverted.

In this case, when the drag input is input through the user terminal 130, the image center coordinates and the view angle area may be set at the same time. For example, when the drag input is inputted through the user terminal 130, the angle of view area is changed from the (-x, -y) coordinate 401 of 'key up' to the (x, y) 402 and the image center coordinate 410 may be set.

4B is an exemplary diagram showing a plurality of images in which a field angle region is set according to an embodiment of the present invention. 4B, a first field of view region 421 for a first arbitrary point X selected in the first image 420 can be set and a second arbitrary point X 'May be set.

The first image 420 may be set to have a horizontal and vertical length of 'w ₀ ' and 'h ₀ ', respectively, and the second image 430 may have a horizontal and vertical length of 'w _n ', and' h _n ', respectively.

The horizontal and vertical ratios of the original image are maintained and the size of the field of view of the intermediate image (width: w _k , length: h _k ) located between the first image 420 and the second image 430 is Can be linearly interpolated based on Equation (1).

Referring back to FIG. 2, the coordinate restoring unit 240 may restore the multidimensional center coordinates based on the selected region of interest and the positional relationship information of the plurality of cameras 110. The coordinate restoring unit 240 may restore the multi-dimensional center coordinates differently according to the set number of image center coordinates among the plurality of images. The process of restoring the multidimensional center coordinates according to the set number of image center coordinates will be described in detail with reference to FIGS. 5A and 5B.

5A and 5B are exemplary diagrams illustrating a process of restoring the multi-dimensional center coordinates according to an embodiment of the present invention.

FIG. 5A is an exemplary diagram for explaining a process of restoring a multi-dimensional center coordinate when at least two image center coordinates of a plurality of images are set according to an embodiment of the present invention. Referring to FIG. 5A, when at least two image center coordinates of a plurality of images are set, the coordinate restoration unit 240 may linearly restore the multi-dimensional center coordinates based on at least two image center coordinates and positional relationship information have.

For example, when two image center coordinates are set, the coordinate restoring unit 240 may perform triangulation from X (510) and X '(511) of two image center coordinates based on the positional relationship information Dimensional center coordinate 500 can be linearly restored.

FIG. 5B is an exemplary diagram for explaining a process of restoring the multi-dimensional center coordinates when one of the plurality of images has an image center coordinate set according to an embodiment of the present invention. Referring to FIG. 5B, when one of the image center coordinates 520 of the plurality of images is set, the coordinate restoring unit 240 sets the image center coordinate 520, which is set based on the positional relationship information, The contact point 540 with the plane equation including the straight line 521 and the arbitrary point 520 extending the image center coordinate 520 can be restored to the multidimensional center coordinates.

For example, the coordinate restoring unit 240 may include an arbitrary point on a straight line 521 extending from the viewpoint of the camera corresponding to the image center coordinate 520 set based on the positional relationship information and the set image center coordinates 520 Dimensional center coordinate 540 by reflecting the depth value 530 of the background. Here, the depth value of the background may be precomputed.

2, the projection coordinate extraction unit 250 may extract the projection coordinates from each of the plurality of images by projecting the restored multidimensional center coordinates on the plurality of images. The projection coordinate extraction unit 250 extracts the projection coordinates by projecting the restored multidimensional center coordinates on a plurality of images having different viewpoints.

The generating unit 260 may extract each image from a plurality of images on the basis of the restored multi-dimensional center coordinates, and may generate a time slice image using each of the obtained images. The generation unit 260 may extract each image from a plurality of images centering on the projected coordinates extracted by the projection coordinate extraction unit 250 and generate a time slice image using the acquired image. A process of generating a time slice image centered on a projection coordinate will be described in detail with reference to FIG.

FIG. 6 is an exemplary diagram for explaining a process of extracting an image around a projection coordinate and generating a time slice image according to an embodiment of the present invention. Referring to FIG. 6, the projection coordinate extraction unit 250 extracts projection coordinates (X, 600) from each of a plurality of images 601 to 605 by projecting the restored multi-dimensional center coordinate (X, 600) on the plurality of images 601 to 605, To 615 can be extracted.

The generation unit 260 reflects a plurality of images with the image angle region set around the extracted projected coordinates 611 to 615 and extracts images corresponding to the image angle regions 621 to 625 reflected from the plurality of images, Images can be generated. At this time, the generating unit 260 can correct the view angle areas 621 to 625 centered on the extracted projective coordinates 611 to 615 by using the positional relationship information, and reflect them on a plurality of images.

The time slice image generated through this process has an advantage that it is possible to project an obscured position that is not shaken and can not be traced by projecting a multi-dimensional center coordinate to a plurality of images.

7 is a flowchart illustrating a method of providing a time slice image in a time slice image providing apparatus according to an embodiment of the present invention. The method of providing the time slice image performed by the time slice image providing apparatus 120 shown in FIG. 7 is the same as that of the time slice image providing system 1 shown in FIGS. 1 to 6, ≪ / RTI > Therefore, the present invention is also applied to a method of providing a time slice image performed by the time slice image providing apparatus 120 according to the embodiment shown in FIGS. 1 to 6 even if omitted below.

In step S710, the time slice image providing apparatus 120 may receive a plurality of images photographed from the plurality of cameras 110. [

In step S720, the time slice image providing apparatus 120 may select a region of interest from at least one of the plurality of images.

In step S730, the time slice image providing apparatus 120 may restore the multi-dimensional center coordinates based on the selected region of interest and the positional relationship information for the plurality of cameras 110. [

In step S740, the time slice image providing device 120 may extract each image from a plurality of images on the basis of the reconstructed multi-dimensional center coordinates, and generate a time slice image using each of the obtained images.

In the above description, steps S710 to S740 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some of the steps may be omitted as necessary, and the order between the steps may be switched.

8 is a configuration diagram of a time slice image providing apparatus according to another embodiment of the present invention. 8, the time slice image providing apparatus 120 may include an image transmitting unit 810, a receiving unit 820, a coordinate restoring unit 830, a generating unit 840, and a transmitting unit 850 .

The image transmitting unit 810 can transmit a plurality of images photographed from the plurality of cameras 110 to the user terminal 130.

The receiving unit 820 may receive the selected region of interest from at least one of the plurality of images from the user terminal 130. The region of interest may be, for example, an area input by the drag input entered through the user terminal 130 from the set image center coordinates. That is, according to one embodiment of the present invention, the time slice image providing apparatus 120 can receive from the user terminal 130 without direct selection of the region of interest.

The coordinate restoring unit 830 may derive the multi-dimensional center coordinates based on the selected region of interest and positional relationship information for the plurality of cameras 110. [

The generating unit 840 may extract each image from the plurality of images on the basis of the restored multi-dimensional center coordinates, and may generate a time slice image using each of the obtained images.

The transmitting unit 850 may transmit the generated time slice image to the user terminal 130.

9 is a flowchart illustrating a method of providing a time slice image in a time slice image providing apparatus according to another embodiment of the present invention. A method of providing a time slice image performed by the time slice image providing apparatus 120 according to the embodiment shown in FIG. 9 is the same as that of the time slice image providing system 1 according to the embodiment shown in FIGS. 1 to 8 And includes steps in which the time is thermally processed. Accordingly, the present invention is also applied to a method of providing a time slice image performed by the image providing server 120 according to the embodiment shown in FIGS.

In step S910, the time slice image providing apparatus 120 may transmit a plurality of images photographed by the plurality of cameras 110 to the user terminal 130. [

In step S920, the time slice image providing apparatus 120 may receive the selected region of interest from at least one of the plurality of images from the user terminal 130. [

In step S930, the time slice image providing device 120 may derive the multi-dimensional center coordinates based on the selected region of interest and positional relationship information for the plurality of cameras 110. [

In step S940, the time slice image providing device 120 may extract each image from the plurality of images on the basis of the restored multi-dimensional center coordinates, and generate a time slice image using each of the obtained images.

In step S950, the time slice image providing apparatus 120 may transmit the generated time slice image to the user terminal 130. [

In the above description, steps S910 to S950 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some of the steps may be omitted as necessary, and the order between the steps may be switched.

10 is a configuration diagram of a user terminal according to an embodiment of the present invention. Referring to FIG. 10, the user terminal 130 may include an image receiving unit 1010, a selecting unit 1020, and a transmitting unit 1030.

The image receiving unit 1010 can receive a plurality of images photographed by the plurality of cameras 110 from the time slice image providing apparatus 120. [ In addition, the image receiving unit 1010 receives the time slice images generated based on the restored multi-dimensional center coordinates based on the region of interest and the positional relationship information of the plurality of cameras 110 from the time slice image providing apparatus 120 .

The selection unit 1020 may select a region of interest from at least one of the plurality of images. For example, the selection unit 1020 may select a region of interest from at least one of the plurality of images, and set the coordinates as an image center coordinate.

The selection unit 1020 may set an angle of view range by extending an area from the image center coordinates set by the additional input. For example, the selection unit 1020 may set the field angle region by extending from the region input by the drag input from the set image center coordinates and the region in which the region is inverted.

The transmitting unit 1030 may transmit the selected region of interest to the time slice image providing apparatus 120.

The user terminal 130 may further include a generation unit that generates a time slice image based on the region of interest selected by the user without interlocking with the time slice image providing apparatus 120 as needed.

11 is a flowchart illustrating a method of providing a time slice image in a user terminal according to an exemplary embodiment of the present invention. The method of providing the time slice image performed by the user terminal 130 according to the embodiment shown in FIG. 11 is similar to that of the time slice image providing system 1 according to the embodiment shown in FIGS. 1 to 10, Lt; / RTI > Accordingly, the present invention is also applied to a method of providing a time slice image performed by the user terminal 130 according to the embodiment shown in FIGS.

In step S1110, the user terminal 130 may receive a plurality of images photographed from the plurality of cameras 110 from the time slice image providing device 120. [

In step S1120, the user terminal 130 may select a region of interest from at least one of the plurality of images.

In step S1130, the user terminal 130 may transmit the selected region of interest to the time slice image providing apparatus 120. [

In step S1140, the user terminal 130 receives a time slice image generated based on the restored multi-dimensional center coordinates based on the region of interest and the positional relationship information of the plurality of cameras 110 from the time slice image providing device 120 can do.

In the above description, steps S1110 to S1140 may be further divided into further steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some of the steps may be omitted as necessary, and the order between the steps may be switched.

The method of providing the time slice image in the time slice image providing apparatus and the user terminal described with reference to Figs. 1 to 11 is a form of a recording medium including a computer program stored in a medium executed by the computer or a command executable by the computer . ≪ / RTI > In addition, the method of providing time slice images in the time slice image providing apparatus and the user terminal described with reference to FIGS. 1 to 11 may be implemented in the form of a computer program stored in a medium executed by a computer.

Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. The computer-readable medium may also include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

It will be understood by those skilled in the art that the foregoing description of the present invention is for illustrative purposes only and that those of ordinary skill in the art can readily understand that various changes and modifications may be made without departing from the spirit or essential characteristics of the present invention. will be. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

110: Multiple cameras
120: time slice image providing device
130: User terminal
210: Position relationship derivation unit
220:
230:
240: coordinate restoring unit
250: projection coordinate extracting unit
260:
810:
820:
830:
840:
850:
1010:
1020:
1030:

Claims (16)

An apparatus for providing a time slice image,
An image receiving unit for receiving a plurality of images photographed from a plurality of cameras;
A selection unit for selecting a region of interest in at least one of the plurality of images;
A coordinate restoring unit for restoring the multi-dimensional center coordinates based on the selected region of interest and the positional relationship information for the plurality of cameras; And
Extracting each image from the plurality of images on the basis of the restored multidimensional center coordinates, and generating a time slice image using each of the obtained images,
The time slice image providing apparatus comprising:
The method according to claim 1,
Further comprising a positional relationship derivation unit for deriving the positional relationship information based on an internal parameter and an external parameter for the plurality of cameras.
3. The method of claim 2,
Wherein the internal parameter includes at least one of a focal length, an image center value, and a camera distortion value of the plurality of cameras,
Wherein the external parameter includes positional information relative to a reference coordinate of the plurality of cameras.
The method of claim 3,
Wherein the selecting unit selects the region of interest by selecting an arbitrary point on at least one of the plurality of images and setting the selected point to the center coordinates of the image.
5. The method of claim 4,
Wherein the coordinate restoration unit restores the multidimensional center coordinates based on the at least two image center coordinates and the positional relationship information when at least two image center coordinates of the plurality of images are set.
6. The method of claim 5,
Wherein the coordinate restoration unit restores the coordinates of the center of the camera corresponding to the set image center coordinates based on the positional relationship information when the image center coordinate of one of the plurality of images is set, And restoring the point of contact with the plane equation including the coordinates of the time slice image to the multidimensional center coordinates.
6. The method of claim 5,
Wherein the coordinate restoration unit restores the coordinates of the center of the camera corresponding to the set image center coordinates based on the positional relationship information and a straight line extending the set image center coordinate, And restoring the multi-dimensional center coordinates by reflecting a depth value of the background including the depth value.
5. The method of claim 4,
A projection coordinate extracting unit extracting projection coordinates from each of the plurality of images by projecting the restored multi-dimensional center coordinates on the plurality of images;
Further comprising:
Wherein the generator extracts each image from the plurality of images around the extracted projected coordinates, and generates a time slice image using each of the acquired images.
9. The method of claim 8,
Wherein the selection unit sets an angle of view area by extending an area from the set image center coordinates by an additional input.
10. The method of claim 9,
Wherein the generation unit reflects the set angle of view area around the extracted projected coordinates on the plurality of images and extracts an image corresponding to the reflected angle of view area from the plurality of images.
11. The method of claim 10,
Wherein the generation unit corrects the set angle of view area with the positional relationship information around the extracted projective coordinates and reflects the corrected angle of view area on the plurality of images.
An apparatus for providing a time slice image,
A video transmitting unit for transmitting a plurality of videos photographed from a plurality of cameras to a user terminal;
A receiver for receiving a selected region of interest from at least one of the plurality of images from the user terminal;
A coordinate reconstruction unit for deriving a multi-dimensional center coordinate based on the selected region of interest and positional relationship information for the plurality of cameras;
A generating unit that extracts each image from the plurality of images based on the restored multi-dimensional center coordinates, and generates a time slice image using each of the obtained images; And
A transmission unit for transmitting the generated time slice image to the user terminal,
The time slice image providing apparatus comprising:
A user terminal for providing a time slice video,
An image receiving unit for receiving a plurality of images photographed by a plurality of cameras from a time slice image providing apparatus;
A selecting unit for selecting a region of interest from at least one of the plurality of images; And
And a transmitting unit for transmitting the selected region of interest to the time slice image providing apparatus,
Wherein the image receiving unit receives a time slice image generated based on the reconstructed multi-dimensional center coordinates based on the ROI and the positional relationship information for the plurality of cameras from the time slice image providing apparatus,
Each image is extracted from the plurality of images around the restored multidimensional center coordinates,
Wherein the time slice image is generated using each of the acquired images.
14. The method of claim 13,
Wherein the selection unit selects the region of interest by selecting an arbitrary point on at least one of the plurality of images and setting the selected point as an image center coordinate.
15. The method of claim 14,
Wherein the selection unit extends an area from the set image center coordinates by an additional input to set a field angle area.
16. The method of claim 15,
Wherein the selection unit sets the field angle region by extending from the set image center coordinates to the region input by dragging input and the region inverted.

Images