KR102105510B1 - Server, method and user device for providing time slice video - Google Patents

Abstract

The server that provides the time slice image is an image transmission unit that transmits any one of a plurality of images photographed by a plurality of cameras requested to be played by a user to the user terminal of the user, by the user from the transmitted images Based on the request information requested from the user terminal to generate a time slice image for the selected object, coordinate information for the selected object in the playing image, and location relationship information for the plurality of cameras, to the selected object. A coordinate extraction unit for extracting center coordinates for an image, an angle of view selection unit for selecting an angle of view region for the plurality of images based on the extracted center coordinates, the selected angle of view region, and an image region in which the plurality of images are displayed on a screen An angle of view to correct the selected angle of view based on the positional relationship Each image is extracted from the plurality of images according to the correction unit and the corrected angle of view, a time slice image is generated using the extracted images, and the generated time slice image is provided to the user terminal. It includes a time slice image providing unit.

Description

Server, method and user terminal for providing time slice video {SERVER, METHOD AND USER DEVICE FOR PROVIDING TIME SLICE VIDEO}

The present invention relates to a server, a method for providing a time slice image, and a user terminal.

With the time slice technique, multiple cameras are installed to face the subject at various angles, and instantaneous shots are taken at the same time, and then the photos are connected using a computer to make the motion of the subject appear as if it were taken with a movie camera. Refers to the video technique. Time slices can not only describe a subject in three dimensions, but also provide a feeling that transcends time and space.

In connection with this time slice technique, Korean Patent Publication No. 2007-0000994, which is a prior art, discloses a system and method for recording and reproducing images.

Recently, by providing a video with a time slice technique applied during a sports game relay, it is possible to specifically analyze or comment on a sports game through a detailed screen composed of multi-view points. However, in the case of a conventional sports game, an inaccurate time slice image was produced in that a point where an event will be manually selected by a time slice image maker must be selected in advance. In addition, since the event occurs randomly during a sports event, it has a disadvantage that it is difficult to predict the point where the event will occur.

In the case of a sports event, an event occurrence point is randomly generated, so it is difficult to set an area for the event occurrence point, but by immediately processing it, a server, method, and method for providing a time slice image applicable to a sports event and It is intended to provide a user terminal. It is intended to provide a server, a method and a user terminal for a user to directly select an object by touching or clicking a mouse and providing a time slice image for the selected object. If it is difficult to generate a time slice image for an object, an object of the present invention is to provide a server, method, and user terminal for generating a time slice image for an object by correcting an angle of view. However, the technical problems to be achieved by the present embodiment are not limited to the technical problems as described above, and other technical problems may exist.

As a means for achieving the above-described technical problem, an embodiment of the present invention, an image transmission that transmits any one of the plurality of images photographed by a plurality of cameras requested to be played by the user to the user terminal of the user The requesting unit is requested to generate a time slice image for the object selected by the user from the transmitted image, from the user terminal, to the coordinate information for the selected object in the playing image and the plurality of cameras. A coordinate extraction unit for extracting center coordinates for the selected object based on positional relationship information, an angle of view selection unit for selecting an angle of view region for the plurality of images based on the extracted center coordinates, the selected angle of view region, and the The plurality of images are displayed based on the positional relationship between the image regions displayed on the screen. An angle of view correction unit for correcting the selected angle of view area, and extracting each image from the plurality of images according to the corrected angle of view area, generating a time slice image using each of the extracted images, and the generated time slice A time slice image providing server including a time slice image providing unit providing an image to the user terminal may be provided.

According to another embodiment of the present invention, a request unit requesting reproduction of any one of a plurality of images photographed by a plurality of cameras by the time slice image providing server, the requested image from the time slice image providing server Requests the generation of the time slice image for the selected object to the receiving image receiving unit, the image playing unit for playing the received image, the object selecting unit for selecting an object from the playing image, and the time slice image providing server , A time slice image providing unit for receiving the time slice image from the time slice image providing server, and reproducing the received time slice image, wherein the time slice image is extracted from each of the plurality of images according to an angle of view Is created using the image of the above Each region is selected for the plurality of images based on the center coordinates extracted for the selected object, and the selected angle of view region is corrected based on a positional relationship between image regions in which the plurality of images are displayed on the screen, and the The center coordinates may provide a user terminal that is extracted based on coordinate information for the selected object in the playing image and positional relationship information for the plurality of cameras.

According to another embodiment of the present invention, transmitting any one of a plurality of images photographed by a plurality of cameras requested to be played by a user to the user terminal of the user, selected by the user from the transmitted images Requesting generation of a time slice image for a received object from the user terminal, centering on the selected object based on coordinate information for the selected object in the playing image and positional relationship information for the plurality of cameras Extracting coordinates, selecting an angle of view region for the plurality of images based on the extracted center coordinates, and based on a positional relationship between the selected angle of view region and an image region in which the plurality of images are displayed on a screen Compensating the selected field of view, the image according to the corrected field of view Providing a time slice image, comprising extracting each image from a plurality of images, generating a time slice image using each extracted image, and providing the generated time slice image to the user terminal. Can provide a method.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present invention. In addition to the exemplary embodiments described above, there may be additional embodiments described in the drawings and detailed description of the invention.

According to any one of the above-described problem solving means of the present invention, in the case of a sports event, since the event occurrence point is randomly generated, it is difficult to set an area for the event occurrence point, but by immediately processing it, it is also applied in a sports event An apparatus and a user terminal capable of providing a possible time slice image may be provided. A user may directly select an object by touching or clicking a mouse, and provide a server, method, and user terminal that provides a time slice image for the selected object. When it is difficult to generate a time slice image for an object, it is possible to provide a server, method, and user terminal for generating a time slice image for an object by correcting an angle of view region.

1 is a configuration diagram of a time slice image providing system according to an embodiment of the present invention.
2 is a configuration diagram of a user terminal according to an embodiment of the present invention.
3 is a flowchart of a method for providing a time slice image in a user terminal according to an embodiment of the present invention.
4 is a configuration diagram of a time slice image providing server according to an embodiment of the present invention.
5A to 5D are exemplary views for explaining a process of extracting center coordinates for an object according to an embodiment of the present invention.
6A to 6C are exemplary views for explaining a process of selecting an angle of view region for a plurality of images based on center coordinates according to an embodiment of the present invention.
7A to 7D are exemplary views illustrating a process of correcting an angle of view based on a positional relationship between an angle of view region and an image region in which a plurality of images are displayed on a screen according to an embodiment of the present invention.
FIG. 8 is an exemplary diagram for explaining a process of generating a time slice image according to whether the number of images determined to be settable among a plurality of images according to an embodiment of the present invention is continuous over a threshold value.
9A and 9B are exemplary views for explaining a process of correcting a selected field of view area such that the size of an object is uniformly displayed in each of a plurality of images according to an embodiment of the present invention.
10 is a flowchart of a method of providing a time slice image in a time slice image providing server according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art to which the present invention pertains can easily practice. However, the present invention can be implemented in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present invention in the drawings, parts irrelevant to the description are omitted, and like reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . Also, when a part is said to “include” a certain component, it means that the component may further include other components, not to exclude other components, unless otherwise stated. However, it should be understood that the existence or addition possibilities of numbers, steps, actions, components, parts or combinations thereof are not excluded in advance.

In the present specification, the term “unit” includes a unit realized by hardware, a unit realized by software, and a unit realized by using both. Further, one unit may be realized by using two or more hardware, and two or more units may be realized by one hardware.

Some of the operations or functions described in this specification as being performed by a terminal or device may be performed instead on a server connected to the corresponding terminal or device. Similarly, some of the operations or functions described as being performed by the server may be performed in a terminal or device connected to the corresponding server.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a time slice image providing system according to an embodiment of the present invention. Referring to FIG. 1, the time slice image providing system 1 may include a plurality of cameras 110, a user terminal 120, and a time slice image providing server 130. The plurality of cameras 110, the user terminal 120, and the time slice image providing server 130 exemplarily show components that can be controlled by the time slice image providing system 1.

Each component of the time slice image providing system 1 of FIG. 1 is generally connected through a network. For example, as shown in FIG. 1, the time slice image providing server 130 may be connected to the plurality of cameras 110 and the user terminal 120 simultaneously or at a time interval.

The network means a connection structure capable of exchanging information between each node such as terminals and servers, and an example of such a network is 3G, 4G, 5G, Wi-Fi, Bluetooth, and the Internet. , Local Area Network (LAN), Wireless Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), and the like.

The plurality of cameras 110 may photograph a sports game image or a performance image at a sports stadium or a performance venue, and transmit the captured image to the time slice image providing server 130. For example, the plurality of cameras 110 may be installed at predetermined intervals in a sports stadium or a performance hall.

The user terminal 120 requests a time slice image providing server 130 to play a single image among a plurality of images photographed by the plurality of cameras 110, and requests from the time slice image providing server 130 The received video can be received.

The user terminal 120 plays the received image, and may select any one object for the image being played by the user.

The user terminal 120 may request generation of a time slice image for the object selected by the time slice image providing server 130. The user terminal 120 provides a time slice image providing server together with frame information, camera viewpoint and 2D coordinate information for the selected object, along with a request to generate a time slice image for the object selected by the time slice image providing server 130 ( 130).

The user terminal 120 may receive the time slice image from the time slice image providing server 130 and reproduce the received time slice image. The user terminal 120 may receive information on the field of view corrected with the time slice image and information on the cropped region from a plurality of images from the time slice image providing server 130.

The time slice image providing server 130 may transmit any one of a plurality of images photographed by the plurality of cameras 110 requested to be played by the user to the user terminal 120.

The time slice image providing server 130 may be requested from the user terminal 120 to generate a time slice image for an object selected by the user from the transmitted image. The time slice image providing server 130 may receive the frame information, the camera viewpoint information, and the 2D coordinate information of the selected object along with the request to generate the time slice image from the user terminal 120.

The time slice image providing server 130 may extract center coordinates of the selected object based on coordinate information for the selected object in the image being played and positional relationship information for the plurality of cameras 110.

The time slice image providing server 130 may select an angle of view region for a plurality of images based on the extracted center coordinates. For example, the time slice image providing server 130 derives coordinate information for an object in each image by projecting central coordinates on a plurality of images, and an angle of view of a predetermined size in each image based on the derived coordinate information You can select an area.

The time slice image providing server 130 may correct the selected angle of view region based on the positional relationship between the selected angle of view region and the image region where a plurality of images are displayed on the screen.

Specifically, the time slice image providing server 130 determines whether it is possible to set the angle of view region according to a ratio of the angle of view out of the image region of each image, and corrects the angle of view selected for the image according to the determination result can do. For example, the time slice image providing server 130, if the ratio of the angle of view area outside the image area for the selected angle of view area does not exceed a preset ratio, coordinate information for the object according to the angle of view area deviating from the image area By resetting, the selected field of view can be corrected to be included in the image area. For another example, the time slice image providing server 130 may determine that it is impossible to set the angle of view region when the angle of view area deviating from the image area exceeds a preset ratio for the selected angle of view area.

In addition, the time slice image providing server 130 further corrects the selected field of view area such that the size of the object is uniformly displayed in each of the plurality of images based on the location relationship information for the plurality of cameras 110 and the distance between the center coordinates. You can.

The time slice image providing server 130 may extract each image from a plurality of images according to the corrected field of view, and generate a time slice image using each extracted image. The time slice image providing server 130 may crop the selected angle of view region for each image and generate a time slice image by adjusting the cropped region to a predetermined size. For example, when the field of view is corrected, the time slice image providing server 130 may set the field of view if the number of images determined to be possible to set the field of view among a plurality of images is continuous over a threshold value. A time slice image may be generated using the image extracted from the image determined to be.

The time slice image providing server 130 may provide the generated time slice image to the user terminal 120. At this time, the time slice image providing server 130 may provide information on the corrected angle of view region and the cropped region from a plurality of images to the user terminal 120 together with the generated time slice image.

2 is a configuration diagram of a user terminal according to an embodiment of the present invention. Referring to FIG. 2, the user terminal 120 may include a requesting unit 210, an image receiving unit 220, an image playback unit 230, an object selection unit 240, and a time slice image providing unit 250. have.

The requesting unit 210 may request reproduction of any one of a plurality of images photographed by the plurality of cameras 110 to the time slice image providing server 130. The plurality of images photographed by the plurality of cameras 110 may be, for example, images photographed as multi-viewpoints in a sports stadium or a performance hall.

The image receiving unit 220 may receive the image requested from the time slice image providing server 130.

The image reproducing unit 230 may reproduce the received image.

The object selection unit 240 may select an object from an image being played. For example, the object selector 240 may select an object through a touch input of any one of a plurality of objects included in an image being played by a user.

The time slice image providing unit 250 may request generation of a time slice image for the object selected by the time slice image providing server 130. The time slice image providing unit 250, when requesting the generation of the time slice image, provides the time slice image providing server together with frame information, camera viewpoint information, and 2D coordinate information for the object selected by the time slice image providing server 130 (130).

The time slice image providing unit 250 may receive the time slice image from the time slice image providing server 130. For example, the time slice image providing unit 250 may receive information on the corrected field of view from the time slice image providing server 130 and information on the cropped region from a plurality of images.

3 is a flowchart of a method for providing a time slice image in a user terminal according to an embodiment of the present invention. A method of providing a time slice image performed by the user terminal 120 shown in FIG. 3 includes steps performed in time series in the time slice image providing system 1 according to the embodiment shown in FIGS. 1 and 2. Includes. Therefore, even if it is omitted below, it is also applied to a method of providing a time slice image performed by the user terminal 120 according to the embodiment illustrated in FIGS. 1 and 2.

In step S310, the user terminal 120 may request reproduction of any one of a plurality of images captured by the plurality of cameras 110 to the time slice image providing server 130.

In step S320, the user terminal 120 may receive the image requested from the time slice image providing server 130.

In step S330, the user terminal 120 may play the received image.

In step S340, the user terminal 120 may select an object from the image being played.

In step S350, the user terminal 120 may request generation of a time slice image for the object selected by the time slice image providing server 130.

In step S360, the user terminal 120 may receive the time slice image from the time slice image providing server 130. The time slice image is generated using each image extracted according to the field of view from the plurality of images, the field of view is selected for the plurality of images based on the center coordinates extracted for the selected object, and the selected field of view is multiple The image of the image is corrected based on the positional relationship between image regions displayed on the screen, and the center coordinates are extracted based on the coordinate information for the selected object in the image being played and the positional relationship information for the plurality of cameras 110. You can.

In step S370, the user terminal 120 may play the received time slice image.

In the above description, steps S310 to S370 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted if necessary, and the order between the steps may be switched.

4 is a configuration diagram of a time slice image providing server according to an embodiment of the present invention. Referring to FIG. 4, the time slice image providing server 130 includes an image transmission unit 410, a request unit 420, a coordinate extraction unit 430, an angle of view selection unit 440, an angle of view correction unit 450, and time A slice image providing unit 460 may be included.

The image transmitting unit 410 may transmit any one of the plurality of images photographed by the plurality of cameras 110 requested to be played by the user to the user terminal 120 of the user. The plurality of images photographed by the plurality of cameras 110 may be, for example, images photographed as multi-viewpoints in a sports stadium or a performance hall.

The requesting unit 420 may be requested from the user terminal 120 to generate a time slice image for an object selected by the user from the transmitted image. When the requester 420 is requested to generate a time slice image for an object from the user, the request unit 420 may receive frame information, camera viewpoint information, and 2D coordinate information for the selected object together.

The coordinate extracting unit 430 may extract the center coordinates of the selected object based on the coordinate information for the selected object in the image being played and the positional relationship information for the plurality of cameras 110.

The angle of view selection unit 440 may select a field of view for a plurality of images based on the extracted center coordinates. The angle-of-view selection unit 440 may derive coordinate information for an object in each image by projecting the center coordinates on a plurality of images, and select an angle of view region having a predetermined size in each image based on the derived coordinate information.

The angle of view correction unit 450 may correct the selected angle of view area based on the positional relationship between the selected angle of view area and the image area where a plurality of images are displayed on the screen.

Specifically, the angle of view correction unit 450 may determine whether the angle of view area can be set according to a ratio of the angle of view out of the image area of each image, and may correct the angle of view selected for the corresponding image according to the determination result. have.

The angle of view correction unit 450 may determine whether the angle of view area can be set using Equation 1 below.

For example, the angle of view correction unit 450 resets the coordinate information for the object according to the angle of view area deviating from the image area when the ratio of the angle of view area deviating from the image area does not exceed a preset ratio for the selected angle of view area. The selected angle of view can be corrected to be included in the image area. For another example, the angle of view correction unit 450 may determine that it is impossible to set the angle of view if the angle of view deviating from the image area exceeds a predetermined ratio for the selected angle of view.

The angle of view correction unit 450 may further correct the selected angle of view area so that the size of the object is uniformly displayed in each of the plurality of images based on the positional relationship information for the plurality of cameras 110 and the distance between the center coordinates.

Conventionally, when generating a time slice image for an object, a time slice image having different object sizes has been provided because the distance between the plurality of cameras 110 and the object is not considered. Due to this, when the user views the time slice image of the object, it has a disadvantage that the immersion feeling is reduced.

) 하므로, 복수의 카메라(110)와 객체의 거리에 반비례되도록 적용하여 객체의 크기가 일정하게 표시되도록 화각 영역을 더 보정할 수 있다. To improve this, the angle of view correction unit 450 is inversely proportional to the distance between the plurality of cameras 110 and the object.

), The angle of view can be further corrected so that the size of the object is displayed uniformly by applying inversely to the distance between the plurality of cameras 110 and the object.

The time slice image providing unit 460 extracts each image from a plurality of images according to the corrected field of view, generates a time slice image using each extracted image, and generates the time slice image by the user terminal ( 120). For example, the time slice image providing unit 460 may crop the selected field of view area for each image to become one independent image, and adjust the cropped region to a predetermined size to generate a time slice image.

When the angle of view area is corrected, the time slice image providing unit 460 determines that it is possible to set the angle of view area when the number of images determined to be possible to set the angle of view among a plurality of images is continuous over a threshold value. A time slice image may be generated using an image extracted from the image. In this case, the time slice image providing unit 460 may provide information on the field of view corrected with the generated time slice image and information on the cropped region from a plurality of images to the user terminal 120.

5A to 5D are exemplary views for explaining a process of extracting center coordinates for an object according to an embodiment of the present invention.

5A is an exemplary diagram for explaining a process of requesting generation of a time slice image for an object according to an embodiment of the present invention. Referring to FIG. 5A, the user terminal 120 is an object of any one of a plurality of objects included in the playing hockey image 500 during playback of the hockey image 500 photographed by a plurality of cameras By selecting 510, generation of a time slice image for the selected object 510 may be requested to the time slice image providing server 130.

5B is an exemplary diagram for explaining a process of modeling an image being played in real time in a user terminal according to an embodiment of the present invention. Referring to FIG. 5B, the time slice image providing server 130 may model 520 the corresponding scene in real time by mapping 3D coordinates to the scene in which the object is selected from the user terminal 120.

FIG. 5C is an exemplary diagram for explaining a process of mapping coordinates for a selected object and modeled 3D coordinates in a playing image according to an embodiment of the present invention. Referring to FIG. 5C, the time slice image providing server 130 displays 3D coordinates 530 where an object in the modeled scene is located and 2D coordinates 510 where an object in the scene in which the object is selected in the user terminal 120 is located. Can be mapped.

5D is an exemplary diagram for explaining a process of extracting center coordinates according to an embodiment of the present invention. Referring to FIG. 5D, the time slice image providing server 130 may extract center coordinates for the selected object based on coordinate information 530 for the mapped object and location relationship information for the plurality of cameras 540. have. For example, the time slice image providing server 130 may extract the center coordinates of the object from each of the plurality of images by projecting the center coordinates of the extracted object onto a plurality of images having different viewpoints. have.

6A to 6C are exemplary views for explaining a process of selecting an angle of view region for a plurality of images based on center coordinates according to an embodiment of the present invention.

6A is an exemplary diagram illustrating a screen in which a field of view of a predetermined size is selected in each image according to an embodiment of the present invention. Referring to FIG. 6A, the time slice image providing server 130 derives coordinate information for an object in each image by projecting center coordinates on a plurality of images, and a predetermined size in each image based on the derived coordinate information You can select the field of view of.

6B is an exemplary diagram for explaining a process of selecting an angle of view area from any one image according to an embodiment of the present invention. Referring to FIG. 6B, the time slice image providing server 130 may select an angle of view area having a predetermined size based on a center coordinate for an object. The time slice image providing server 130 may select, for example, an upper and lower region corresponding to 'FOV_H' and a left and right region corresponding to 'FOV_W' as the field of view region 610 from the center coordinate 600 of the object.

6C is an exemplary diagram illustrating a generated time slice image according to an embodiment of the present invention. Referring to FIG. 6C, the time slice image providing server 130 crops a selected field of view region for each image, and adjusts the cropped region to a predetermined size to generate a time slice image.

7A to 7D are exemplary views illustrating a process of correcting an angle of view based on a positional relationship between an angle of view region and an image region in which a plurality of images are displayed on a screen according to an embodiment of the present invention.

FIG. 7A is an exemplary diagram illustrating a screen when an angle of view area is deviated from an image area according to an embodiment of the present invention. Referring to FIG. 7A, the time slice image providing server 130 determines whether an angle of view region can be set according to a ratio of an angle of view deviating from an image region of each image, and an angle of view selected for the image according to the determination result The area can be corrected.

7B is an exemplary diagram for explaining a process of correcting an angle of view region according to an embodiment of the present invention. Referring to FIG. 7B, the time slice image providing server 130 coordinates for an object according to an angle of view area deviating from the image area when a ratio of an angle of view area deviating from the image area does not exceed a preset ratio for a selected angle of view area By resetting the information, the selected field of view can be corrected to be included in the image area. At this time, when the angle of view area deviating from the image area exceeds the predetermined ratio for the selected angle of view area, it may be determined that the angle of view area cannot be set.

For example, referring to FIG. 7C, when the coordinates for the object are (Rx, Ry) and the selected field of view is separated by (MW, MH) from the image area, the time slice image providing server 130 may be configured for the object. By reflecting the distance (MW, MH) away from the coordinates, the coordinates for the object can be changed to (Rx + MW, Ry + MH) to correct the field of view to select.

7D is an exemplary diagram for describing a corrected field of view according to an embodiment of the present invention.

FIG. 8 is an exemplary diagram for explaining a process of generating a time slice image according to whether the number of images determined to be settable among a plurality of images according to an embodiment of the present invention is continuous over a threshold value.

Referring to FIG. 8, since the time slice image providing server 130 needs to continuously show the time slice image as a multi-view image, the number of images determined to be capable of setting the view angle region after correction of the view angle region is greater than or equal to a threshold value A time slice image may be generated for a continuous case, and if the number of consecutive images is less than a threshold, a time slice image may not be generated.

For example, suppose that there are a total of 10 views, and the threshold is set to 6.

For example, when it is impossible to set an angle of view area in the image at the time of point 5 (or when cropping is impossible), the time slice image providing server 130 is left: 4, right based on the image 810 at the point 5 : Since 5 viewpoint images are continuous, a time slice image cannot be generated because it is less than the threshold value of '6'.

For another example, when it is impossible to set an angle of view area (or cropping is impossible) in the images 820 of the 2nd and 3rd views, the time slice image providing server 130 displays the 4th to 10th views of the image 830 ) Is continuous with a total of '7' viewpoint images, so a time slice image can be generated because it is greater than or equal to the threshold value of '6'.

For another example, when cropping of the field of view is not possible in the image 840 at the second and third views 840 and the image 850 at the tenth views, the time slice image providing server 130 views 4 to 9 times Since the image 860 is continuous with a total of '6 viewpoint images', a time slice image can be generated because the threshold value is '6' or more.

9A and 9B are exemplary views for explaining a process of correcting a selected field of view area such that the size of an object is uniformly displayed in each of a plurality of images according to an embodiment of the present invention.

9A is an exemplary diagram illustrating a time slice image for a conventional object. Referring to FIG. 9A, the conventional time slice image does not reflect the distance between the center coordinates 900 and the plurality of cameras 910, so that the position of each camera is farther from the center coordinates 900, the smaller the size of the object. You can see that it is losing.

9B is an exemplary diagram illustrating a time slice image in which an angle of view region is corrected according to an embodiment of the present invention. Referring to FIG. 9B, since the size of an object is inversely proportional to the position of each camera and the distance between the center coordinates 900 for the object, the time slice image providing server 130 is based on the center coordinates 900 for the object and each camera The time-slice image may be generated such that the size of the object is uniformly displayed by correcting the field of view by applying the position in inverse proportion.

10 is a flowchart of a method of providing a time slice image in a time slice image providing server according to an embodiment of the present invention. A method of providing a time slice image performed by the time slice image providing server 130 according to the embodiment shown in FIG. 10 is performed in the time slice image providing system 1 according to the embodiment shown in FIGS. 1 to 9B. It includes steps processed in time series. Therefore, even if it is omitted below, it is also applied to a method for providing a time slice image performed by the time slice image providing server 130 according to the embodiment shown in FIGS. 1 to 9B.

In step S1010, the time slice image providing server 130 may transmit any one of the plurality of images photographed by the plurality of cameras 110 requested to be played by the user to the user terminal 120 of the user.

In step S1020, the time slice image providing server 130 may be requested from the user terminal 120 to generate a time slice image for the object selected by the user from the transmitted image.

In step S1030, the time slice image providing server 130 may extract center coordinates for the selected object based on coordinate information for the selected object in the image being played and positional relationship information for the plurality of cameras 110.

In step S1040, the time slice image providing server 130 may select a field of view for a plurality of images based on the extracted center coordinates.

In operation S1050, the time slice image providing server 130 may correct the selected angle of view region based on the positional relationship between the selected angle of view region and the image region where a plurality of images are displayed on the screen.

In step S1060, the time slice image providing server 130 may extract each image from a plurality of images according to the corrected field of view.

In step S1070, the time slice image providing server 130 may generate a time slice image using each extracted image.

In step S1080, the time slice image providing server 130 may provide the generated time slice image to the user terminal 120.

In the above description, steps S1010 to S1080 may be further divided into additional steps or combined into fewer steps, according to an embodiment of the present invention. In addition, some steps may be omitted if necessary, and the order between the steps may be switched.

The method for providing a time slice image in the time slice image providing server and the user terminal described with reference to FIGS. 1 to 10 is in the form of a computer program stored in a medium executed by a computer or a recording medium including instructions executable by a computer Can also be implemented as In addition, the method for providing the time slice image in the time slice image providing server and the user terminal described with reference to FIGS. 1 to 10 may also be implemented in the form of a computer program stored in a medium executed by a computer.

Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The above description of the present invention is for illustration only, and a person having ordinary knowledge in the technical field to which the present invention pertains can understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is indicated by the following claims rather than the above detailed description, and it should be interpreted that all changes or modified forms derived from the meaning and scope of the claims and equivalent concepts thereof are included in the scope of the present invention. do.

110: multiple cameras
120: user terminal
130: time slice video providing server
210: request unit
220: video receiver
230: video playback unit
240: object selection unit
250: Time slice video providing unit
410: video transmission unit
420: request unit
430: coordinate extraction unit
440: angle of view selector
450: angle of view correction unit
460: Time slice image providing unit

Claims (19)

In the server that provides the time slice image,
An image transmitting unit which transmits any one of a plurality of images photographed by a plurality of cameras requested to be played by a user to the user terminal of the user;
A requesting unit that is requested from the user terminal to generate a time slice image for the object selected by the user from the transmitted image;
A coordinate extracting unit for extracting center coordinates for the selected object based on coordinate information for the selected object in the playing image and positional relationship information for the plurality of cameras;
An angle of view selection unit for selecting an angle of view for the plurality of images based on the extracted center coordinates;
An angle of view correction unit for correcting the selected angle of view area based on a positional relationship between the selected angle of view area and the area of the image in which the plurality of images are displayed on a screen; And
A time slice extracting each image from the plurality of images according to the corrected field of view, generating a time slice image using the extracted images, and providing the generated time slice image to the user terminal Video provider
To include,
The angle of view selection unit derives coordinate information for the object in each image by projecting the center coordinates on the plurality of images, and selects an angle of view area having a predetermined size in each image based on the derived coordinate information. The time slice video providing server.
According to claim 1,
The request unit,
A time slice image providing server that receives at least one of frame information, camera viewpoint information, and 2D coordinate information for the selected object from the user terminal.
delete According to claim 1,
The time slice image providing unit crops the selected field of view for each image, and adjusts the cropped region to a predetermined size to generate the time slice image.
The method of claim 4,
The angle of view correction unit determines whether it is possible to set the angle of view area according to a ratio of the selected angle of view from the image area of each image, and corrects the selected angle of view area for the corresponding image according to the determination result, Time slice video providing server.
The method of claim 5,
The angle of view correction unit resets the coordinate angle of the object according to the angle of view area deviating from the image area when the ratio of the angle of view area deviating from the image area does not exceed a predetermined ratio for the selected angle of view area. The time slice image providing server is to correct an area to be included in the image area.
The method of claim 6,
The angle of view correction unit determines that it is impossible to set the angle of view area when the angle of view area deviating from the image area exceeds a preset ratio for the selected angle of view area.
The method of claim 7,
When the number of images determined to be capable of setting the field of view of the plurality of images continues to be greater than or equal to a threshold value, the time slice image providing unit uses images extracted from images determined to be capable of setting the field of view of the plurality of images. The time slice image providing server that generates the time slice image.
In the server that provides the time slice image,
An image transmitting unit which transmits any one of a plurality of images photographed by a plurality of cameras requested to be played by a user to the user terminal of the user;
A requesting unit that is requested from the user terminal to generate a time slice image for the object selected by the user from the transmitted image;
A coordinate extracting unit for extracting center coordinates for the selected object based on coordinate information for the selected object in the playing image and positional relationship information for the plurality of cameras;
An angle of view selection unit for selecting an angle of view for the plurality of images based on the extracted center coordinates;
An angle of view correction unit for correcting the selected angle of view area based on a positional relationship between the selected angle of view area and the area of the image in which the plurality of images are displayed on a screen; And
A time slice extracting each image from the plurality of images according to the corrected field of view, generating a time slice image using the extracted images, and providing the generated time slice image to the user terminal Video provider
To include,
The angle of view correction unit further corrects the selected angle of view area so that the size of the object is uniformly displayed in each of the plurality of images based on the positional relationship information for the plurality of cameras and the distance between the center coordinates. Video providing server.
The method of claim 4,
The time slice image providing unit provides information on the corrected angle of view region and information on a region cropped from the plurality of images to the user terminal.
In the user terminal for providing a time slice image,
A requesting unit requesting reproduction of any one of a plurality of images photographed by a plurality of cameras by the time slice image providing server;
An image receiving unit receiving the requested image from the time slice image providing server;
An image reproducing unit reproducing the received image;
An object selector that receives an object from the playing image; And
A time slice image request requesting generation of a time slice image for the selected object from the time slice image providing server, receiving the time slice image from the time slice image providing server, and playing the received time slice image. study
Including,
The time slice image is generated by using each image extracted according to the field of view from the plurality of images,
The field of view area is selected for the plurality of images based on the center coordinates extracted for the selected object, and the selected field of view area is corrected based on a positional relationship between image areas in which the plurality of images are displayed on the screen,
The center coordinates are extracted based on coordinate information for the selected object in the image being played and positional relationship information for the plurality of cameras.
In the selected field of view, coordinate information for the object in each image is derived by projecting the center coordinates on the plurality of images, and an angle of view of a predetermined size is selected in each image based on the derived coordinate information. That is, the user terminal.
The method of claim 11,
The time slice image providing unit transmits at least one or more of frame information, camera viewpoint information and 2D coordinate information for the selected object to the time slice image providing server.
The method of claim 12,
The time slice image providing unit receives information about the corrected angle of view region and the cropped region from the plurality of images from the time slice image providing server.
In the method for providing a time slice image performed in the time slice image providing server,
Transmitting any one of the plurality of images photographed by the plurality of cameras requested to be played by the user to the user terminal of the user;
Receiving a request from the user terminal to generate a time slice image for an object selected by the user from the transmitted image;
Extracting center coordinates for the selected object based on coordinate information for the selected object and positional relationship information for the plurality of cameras in the playing image;
Selecting an angle of view region for the plurality of images based on the extracted center coordinates;
Correcting the selected view angle area based on a positional relationship between the selected view angle area and an image area where the plurality of images are displayed on a screen;
Extracting respective images from the plurality of images according to the corrected field of view;
Generating a time slice image using each of the extracted images; And
Providing the generated time slice image to the user terminal
To include,
In the selected field of view, coordinate information for the object in each image is derived by projecting the center coordinates on the plurality of images, and an angle of view of a predetermined size is selected in each image based on the derived coordinate information. The method of providing a time slice image.
In the method for providing a time slice image performed in the time slice image providing server,
Transmitting any one of the plurality of images photographed by the plurality of cameras requested to be played by the user to the user terminal of the user;
Receiving a request from the user terminal to generate a time slice image for an object selected by the user from the transmitted image;
Extracting center coordinates for the selected object based on coordinate information for the selected object and positional relationship information for the plurality of cameras in the playing image;
Selecting an angle of view region for the plurality of images based on the extracted center coordinates;
Correcting the selected view angle area based on a positional relationship between the selected view angle area and an image area where the plurality of images are displayed on a screen;
Extracting respective images from the plurality of images according to the corrected field of view;
Generating a time slice image using each of the extracted images; And
Providing the generated time slice image to the user terminal
To include,
Compensating the selected field of view,
Determining whether it is possible to set the angle of view according to a ratio of the selected angle of view from the image area of each image, and correcting the selected angle of view for the image according to the determination result, providing a time slice image Way.
The method of claim 15,
Compensating the selected field of view,
When the ratio of the angle of view area deviating from the image area does not exceed a preset ratio for the selected angle of view area, the selected view angle area is reset by resetting coordinate information for the object according to the angle of view area deviating from the image area. A method for providing a time slice image, which is corrected to be included in an area.
The method of claim 16,
Compensating the selected field of view,
When the angle of view area deviating from the image area exceeds the preset ratio for the selected angle of view area, it is determined that the setting of the angle of view area is impossible.
The method of claim 17,
The step of generating the time slice image,
When the number of images determined to be capable of setting the field of view of the plurality of images continues to be greater than or equal to a threshold value, the time slice image is generated using an image extracted from images determined to be possible to set the field of view of the field. The time slice video providing method.
In the method for providing a time slice image performed in the time slice image providing server,
Transmitting any one of the plurality of images photographed by the plurality of cameras requested to be played by the user to the user terminal of the user;
Receiving a request from the user terminal to generate a time slice image for an object selected by the user from the transmitted image;
Extracting center coordinates for the selected object based on coordinate information for the selected object and positional relationship information for the plurality of cameras in the playing image;
Selecting an angle of view region for the plurality of images based on the extracted center coordinates;
Correcting the selected view angle area based on a positional relationship between the selected view angle area and an image area where the plurality of images are displayed on a screen;
Extracting respective images from the plurality of images according to the corrected field of view;
Generating a time slice image using each of the extracted images; And
Providing the generated time slice image to the user terminal
To include,
Compensating the selected field of view,
Compensating the selected field of view so that the size of the object is consistently displayed in each of the plurality of images based on the positional relationship information for the plurality of cameras and the distance between the center coordinates.
That includes, a time slice image providing method.

Images