KR102054116B1 - Customized Stage Video Delivery System - Google Patents

Abstract

The present invention relates to a customized stage image providing system. According to the present invention, the customized stage image providing system comprises: an image management interface having a camera group consisting of a plurality of cameras installed at various positions on a stage and an image output module storing and outputting images captured by each of the cameras; and a user terminal having a camera selection module allowing a user to select at least one camera in the camera group and an image playing module receiving images captured by the camera selected in the camera selection module from the image output module and playing the images through a screen.

Description

Customized Stage Video Delivery System

The present invention provides a customized stage image providing system to the user terminal by providing a stage image of the stage taken from a variety of angles using a plurality of cameras to the user's terminal, can show the performance more three-dimensional and effective The present invention relates to a customized stage image providing system.

In general, a large number of cameras are mobilized to photograph a stage such as a concert or a musical, and these cameras move from time to time, such as moving up and down, left and right, and photographing a performer in close proximity, and photographing a performance on a stage with various motions. At this time, in order to capture the performance on the stage more lively and interesting, techniques such as moving cameras by manned or unmanned, installation of special cameras such as Jimmy's house, and wearing special lenses are required.

At this time, Korean Patent No. 10-1617238 (name of the invention: a method of producing an image for an opera or a musical performance) is registered as a prior art for producing an image of a stage.

The prior art is a person image acquiring step of acquiring a 3D person image obtained by using a 3D stereoscopic camera to perform a performance of an actor appearing in the opera or musical; A background image acquisition step of acquiring a background image produced corresponding to the opera or musical; Location information of the 3D stereoscopic camera when capturing the 3D person image when the 3D person image is projected on a screen of a performance hall where the image is actually displayed so that the size of the person displayed on the screen is the same as the actual size of the actor; A person image adjusting step of comparing position information of a projector when projecting the 3D person image in the performance hall, and scaling the 3D person image according to a comparison result; A background image adjusting step of scaling the background image based on the screen size; And generating a video object by synthesizing the scaled 3D person image in the person image adjusting process and the background image scaled in the background image adjusting process. Suggesting.

Although the prior art has taken a stage three-dimensionally using a 3D stereoscopic camera, only the image provided by the camera is provided and the user cannot select the desired angle and position to intensively view the image, and provide such an image to the user's terminal. There is a problem that the configuration does not exist so that the user's personal interests and tastes are not considered.

Therefore, in order to solve the problems described above, by using a plurality of cameras by providing a stage image photographed on a stage from a variety of angles to the user's terminal, you can watch the stage according to the user's taste, and show the performance more three-dimensional and effective There is a need to develop a customized stage image providing system.

The present invention has been made to overcome the problems of the above technology, by providing a stage image photographing the stage from a variety of angles using a plurality of cameras to the terminal of the user can watch the stage according to the taste of the user, and the performance Its main purpose is to provide a more lively and stereoscopic system.

Another object of the present invention is to provide a picture in picture (PIP) function to divide the screen into a plurality of areas to simultaneously provide images captured from various angles.

Still another object of the present invention is to assign a camera for intensively photographing each performer when there are a plurality of performers on the stage so that the user can concentrate more on the image according to the selection reflecting the user's taste.

A further object of the present invention is to help induce interests and interests of users by adding and editing various visual effects on an image.

In order to achieve the above object, the customized stage image providing system according to the present invention, a camera group consisting of a plurality of cameras installed in various positions of the stage, and an image output module for storing and outputting the image taken by each of the cameras; An image management interface; A camera selection module for allowing a user to select at least one camera of the camera group, and an image captured by the camera selected by the camera selection module is received from the image output module and reproduced through a display having a screen And a user terminal having an image reproducing module.

The display may include a picture in picture (PIP) function to divide the screen into a plurality of areas, and the camera selection module may include a multi-selection unit for allowing a user to select at least two cameras. The playback module may include a PIP output unit configured to receive images captured by the camera selected by the multi selector from the image output module and to play the images through the area of the screen.

In addition, the camera selection module includes a simultaneous reproducing unit for simultaneously reproducing images captured by each of the cameras in a plurality of the regions of the screen, wherein the image reproducing module includes at least one of the regions due to a user. When selected, it is characterized in that it comprises an area enlargement unit to enlarge the area to play on the screen.

According to the customized stage image providing system according to the present invention,

1) You can watch the stage according to the user's taste by providing the stage image of the stage photographed from various angles to the user's terminal, can show the performance more lively and three-dimensional,

2) PIP (picture in picture) function can provide images taken from various angles simultaneously.

3) By assigning and shooting a camera that focuses on each performer, it is possible not only to focus more on the video depending on the user's preference.

4) By adding and editing various visual effects on the video, it is possible to give effects that can help induce interest and interest of users.

delete

1 is a block diagram schematically showing a configuration relationship of the present invention.
2 is a block diagram showing a detailed configuration of a system of the present invention.
3 is a conceptual diagram showing an example showing a PIP function of the present invention.
4 is a conceptual diagram illustrating an example showing the performer selection and the concentrated output of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. The accompanying drawings are not drawn to scale, and like reference numerals in each of the drawings refer to like elements.

1 is a block diagram schematically showing the configuration of the present invention, Figure 2 is a block diagram showing the detailed configuration of the system of the present invention.

The customized stage image providing system 1 of the present invention provides a stage image photographed from various angles to a user, an image management interface 100 responsible for capturing, storing, and outputting an image, and a user reproducing the captured image. It is based on including the terminal 200.

Here, the image management interface 100 refers to a main server, and may include a CPU and a storage means in a state where a communication unit and a transmission means for transmitting the captured image and its information are provided.

In addition, the user terminal 200 is a PC possessed by the user. As a terminal such as a smartphone or a tablet PC, an environment in which an application is installed or an access to a web page should be provided in order to receive an image from the stage image providing system of the present invention. There is no limit.

In other words, the development of the existing stage image providing system to perform the function of photographing the stage image from various angles and then providing it to the user terminal 200.

In the present invention, the image management interface 100 is provided with a communication unit to communicate with the user terminal 200, the central processing unit based on hardware having a central processing unit (CPU) and storage means such as memory and hard disk A program that can be executed in the software, that is, the software is installed and can execute this software. A series of specific configurations for such software will be described later as the unit of the module and the unit.

In this case, the image management interface 100 may include a random access memory (RAM) and a read-only memory (ROM) for temporarily and / or permanently storing signals (or data) processed therein. Not shown), and a processor.

In addition, the image management interface 100 may be implemented in the form of a system on chip (SoC) including at least one of a graphic processor, a RAM, and a ROM.

The processor may include one or more cores (not shown) and connection passages (eg, buses) for transmitting and receiving signals to and from graphics processors (not shown) and / or other components.

The memory may store programs (one or more instructions) for execution and control of a module to a part to be described later. Programs stored in the memory may be divided into a plurality of modules according to their functions.

The steps of a method or algorithm described in connection with an embodiment of the present invention may be implemented directly in hardware, in a software module executed by hardware, or by a combination thereof. Software modules may include random access memory (RAM), read only memory (ROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, hard disk, removable disk, CD-ROM, or It may reside in any form of computer readable recording media well known in the art.

That is, the components of the present invention may be implemented as a program (or an application) and stored in a medium in order to be executed in combination with a computer which is hardware. The components of the present invention may be implemented as software programming or software elements, and likewise, embodiments may include various algorithms implemented in combinations of data structures, processes, routines or other programming constructs, such as C, C ++. It may be implemented in a programming or scripting language such as Java, an assembler, or the like. The functional aspects may be implemented with an algorithm running on one or more processors.

The configuration of the 'module' or 'part' or 'interface' refers to a configuration of software such as FPGA or ASIC or software that is executed through CPU and memory while being installed and stored in the storage means of the main server 10. do. At this time, the configuration of the 'module', 'unit', or 'interface' is not limited to hardware, and may be configured to be in an addressable storage medium or may be configured to reproduce one or more processors. As an example, a 'module' or 'part' or 'interface' may refer to components such as software components, object-oriented software components, class components, and task components, processes, functions, attributes, and the like. Fields, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.

The functionality provided by these 'modules' or 'parts' or 'interfaces' may be combined into a smaller number of components and 'parts' or 'modules' or by additional components and 'parts' or 'modules'. Can be further separated.

In addition, the management interface 100 refers to all kinds of hardware devices including at least one processor, and may be understood as a meaning encompassing a software configuration operating in the hardware device according to an embodiment. For example, a computing device as an example of a server may be understood as including, but not limited to, smartphones, tablet PCs, desktops, notebooks, and user clients and applications running on each device.

In detail, the image management interface 100 may include a camera group and an image output module 110 including a plurality of cameras installed at various locations on a stage, and the user terminal 200 may include a camera selection module 210 and an image. It may include a play module 220.

At this time, the camera group can be installed in various positions such as up, down, up, down, up and down around the stage, and can record performances occurring on the stage. You can also proceed. In addition, the shooting may be manually performed by a person operating the camera, but the camera may be automatically set without the help of a person by setting the system of the camera in advance. In addition, the camera group may be composed of several or dozens of groups, and each camera is assigned a number and may be referred to as a "first camera", a "three camera", or the like.

The image output module 110 stores and outputs an image photographed by each camera. At this time, each photographed image may be one of the stage taken in the 360 ㅀ direction or up and down, less than four to dozens of cameras can be used for multi-angle shooting of the stage. Also, the captured image may be output through various paths through a TV, the Internet, a display installed in a performance hall, and the like.

The camera selection module 210 provides a function for the user to select at least one camera of the camera group. That is, a multi-angle stage image photographed from a plurality of cameras is provided to the user terminal 200, and a user may select a camera photographing at a desired angle among them. For example, if a idol group consisting of a multi-member is performing on stage, if the user's favorite member is performing on the right side of the stage, the user can focus on the favorite member's stage. You can select the camera on the right side of the screen.

The image reproducing module 220 receives the image captured by the camera selected by the camera selection module 210 from the image output module 110 and reproduces the image on the display having the screen. In this case, the stage image may be provided to the user terminal in response to the number of cameras selected by the user. Accordingly, the screen may be divided and multiple stage images may be simultaneously output.

3 is a conceptual diagram showing an example showing a PIP function of the present invention.

In this case, the display may include a picture in picture (PIP) function to divide the screen into a plurality of areas, and the camera selection module 210 may include a multi-selection unit 211. PIP output unit 221 may be provided.

In this case, the PIP function divides and outputs a screen corresponding to the number of cameras selected by the user without distinguishing between the main and sub images. For example, as shown in FIG. 3, when the user selects two cameras, two images may be simultaneously output by dividing the screen into two images, an upper image and a lower image.

The multi-selection unit 211 serves to allow a user to select at least two cameras, and the PIP output unit 221 displays an image photographed by the camera selected by the multi-selection unit 211 in the image output module ( 110 and provide a function of playing through each of the areas of the screen. For example, the user can select "Camera No. 1" which can see the stage as a whole from the front and "Camera No. 3" which can see the stage at a 45 degree angle from the front. It is divided into two screens and the right screen can simultaneously output images taken by both cameras.

In addition, the camera selection module 210 may include a simultaneous reproducing unit 212, and thus the image reproducing module 220 may include an area enlargement unit 222.

The simultaneous reproducing unit 212 plays a role of simultaneously reproducing images captured by the cameras in the plurality of areas of the screen. That is, the image of the camera selected by the user can be simultaneously reproduced on the screen divided through the above-described PIP function. This allows you to watch a stage shot from a different angle at the same time as if you were watching the stage with your own eyes or watching the stage through a normal screen.

When at least one of the areas is selected by the user, the area enlarger 222 enlarges the area and plays the screen on the screen. The images captured by each camera may be displayed on the user's terminal in a small screen, and when the user selects an image to be viewed from the small screen, the image may be enlarged and output to the user's image.

4 is a conceptual diagram illustrating an example showing the performer selection and the concentrated output of the present invention.

As another embodiment, the camera group may allocate a camera for intensively photographing each performer when there are a plurality of performers on the stage, and the camera selection module 210 may include a performer selector 213 and an image playback module ( The 220 may include a concentrated output unit 223 to concentrate more on the image according to the selection reflecting the user's taste.

The performer selector 213 performs a function of receiving a user's selection of the camera photographing a specific performer, and the centralized output unit 223 displays an image photographed by the camera selected by the performer selector. It plays a role of receiving from the screen and playing through the screen. For example, when a five-member idol group is performing on stage, two cameras are assigned to each member to shoot each member. The performance video may also be photographed and provided. At this time, when the user says that the member A group of the idol group is the most favorite, the user can select a camera that photographs the group A through the performer selector 213, and photographs the group A through the concentrated output unit 223. An image is transmitted to the user's terminal so that the user can concentrate on the performance of group A.

In this case, only one performer may be selected, but a plurality of performers may be selected and provided, or may be provided with an entire camera showing all performers.

In this case, the image management interface 100 may further include an image editing module 120. Accordingly, the image output module 120 provides a function of transmitting the image to which the visual effect is applied to the user terminal. By giving a variety of effects to the user can help to attract attention and interest.

The image editing module 120 applies a video editing technique to an image to provide a visual effect. In this case, the visual effect is to process the digital signal by digitizing it, and may be a zoom / rotation / rotation of the screen and brightness / contrast / saturation / color adjustment of the screen, section repetition, fade in / fade out, and the like. Although one may apply one effect to one image, several effects may be applied at the same time. For example, if the performance of a dance group is a performance based on dynamic performance, the screen reduction effect can be used to view the overall performance of the dance performance. In the dance highlighting section, the performance can be emphasized by the interval repeating effect.

In addition, the image editing module 120 includes a video analysis database 121, an editing technique order setting unit 122, and an editing execution unit 123 to apply a three-dimensional technique to the stage image to make the performance more lively and three-dimensional. I can express it.

The image analysis database 121 generates and stores the editing technique type data and the editing technique sequence data after analyzing the type and the sequence of the editing technique of the existing image. For example, the editing technique applied to the existing image is zoomed. When called Tilting-Dissolve-Fade, the editing technique type data is {zoom, tilting, dissolve, fade}, and the editing technique sequence data is {zooming-tilting-dissolve-fade}. Can be.

The editing technique order setting unit 122 provides a function of selecting any one of the editing technique order data and setting the editing technique order of the video. In this case, since the order of the editing techniques applied to a plurality of existing images will vary as much, there will also be a plurality of editing technique order data. Thus, a function of arbitrarily selecting any one of a plurality of editing technique order data and setting the editing technique order of an image is provided.

The editing execution unit 123 serves to generate an image having a visual effect by applying an editing technique to the image according to the set editing technique order. In the following example, the image may be generated by applying an effect to the image according to the editing technique sequence {zum-tilting-dissolve-fade}.

Furthermore, the image editing module 120 may include a camera information input unit 124, a technique order definition database 125, an emphasis keyword extraction unit 126, and an order resetting unit 127. 123 may re-edit the image based on the reset editing technique sequence.

The camera information input unit 124 describes an image of the angle of the camera and serves to receive an image description sentence including a word for emphasizing the characteristics of the angle of the camera. For example, a camera photographing the back of the performer at a distance of 10M from the center of the stage may include camera information such as "180 ° angle" and "10M".

The technique order definition database 125 stores the technique order definition information generated by defining the highlighting effect of the editing technique order data. The highlighting effect of the editing technique order data is a person who views an image due to the editing technique order. It means the visual and psychological effects given to them.

For example, when there is editing technique sequence data of 'slow motion' and 'overlap', the effect of this editing technique sequence is 'slow motion' which shows the performance on stage at a slower rate than before, and before the end of one screen, By overlapping the screen, you can apply the 'overlap' to make the screen disappear gradually first, and create 'natural' information through the 'emotional' and 'overlap' technique through the 'slow motion' technique.

The emphasis keyword extracting unit 126 may identify a frequency of adjectives in the image description sentence and extract an adjective having an appearance frequency exceeding a preset reference value as an emphasis keyword, which will be described later. In 127, the configuration is performed to re-edit the image by reordering the editing technique based on the highlighted keyword.

For example, when there is a video description sentence, 'Emotional acoustic ballad with soft singing power, success in transforming image into naturally emotional ballad in the youngest of dance group, stage of owner A of soft charisma that naturally digests high sound,' The adjectives appearing in the descriptive sentences are 'emotional' and 'naturally'. Here, when the reference value preset by the system administrator of the present invention is 2, 'emotional' and 'naturally' appear twice each time in the video description sentence, and thus may be extracted as an emphasis keyword exceeding the reference value.

The order resetting unit 127 provides a function of resetting the editing technique order by matching an emphasis keyword and the technique order definition information, and newly editing an editing technique order corresponding to the technique order definition information with a matching result. Provides the ability to reset in order of technique.

In the above-mentioned example, when the emotional keywords 'emotional' and 'naturally' are compared to 'emotional' which is the technique order definition information and 'natural', the 'emotional' of the emphasized keyword is matched with the 'emotional' of the technique order definition information. SLOW MOTION 'can be set in the order of editing technique, and since' Natural 'and' Naturality 'of the technique order definition information are matched with each other,' Overlap 'which is the editing technique corresponding to' Naturality ' Can be reset.

As described so far, the configuration and operation of the customized stage image providing system according to the present invention have been represented in the above description and the drawings, but this is merely described, for example, and the spirit of the present invention is not limited to the above description and the drawings. Various changes and modifications are possible without departing from the spirit of the invention.

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

delete

1: System 100: Video Management Interface
110: video output module 120: video editing module
121: video analysis database 122: editing technique sequence setting unit
123: edit execution unit 124: camera information input unit
125: technique order definition database 126: highlight keyword extraction unit
127: sequence reset unit 200: user terminal
210: camera selection module 211: multi selection unit
212: simultaneous playback unit 213: performer selection unit
220: video playback module 221: PIP output unit
222: region enlargement unit 223: concentrated output unit

Claims (11)

As a customized stage image providing system,
A camera group consisting of a plurality of cameras installed at various positions on a stage, an image output module for storing and outputting images captured by each of the cameras, and an image editing module for applying a video editing technique to the image to give a visual effect An image management interface having a;
A camera selection module for allowing a user to select at least one camera of the camera group, and the image output module to which a visual effect is given based on an image photographed by the camera selected by the camera selection module, from the image output module And a user terminal having an image reproducing module for receiving and reproducing through a display having a screen.
The video editing module,
An image analysis database which analyzes the type and sequence of existing editing techniques and generates and saves the editing technique type data and editing technique sequence data;
An editing technique order setting unit which selects any one of the editing technique order data and sets the editing technique order of the video;
An editing execution unit configured to generate an image having a visual effect by applying an editing technique to the image according to the set editing sequence;
A camera information input unit for receiving an image description sentence including a word for emphasizing the characteristics of the image angle to explain the image of the angle of the camera to the photographer;
A technique order definition database storing technique order definition information generated by defining the highlighting effect of the editing technique order data;
An emphasis keyword extracting unit which grasps the frequency of adjectives in the image description sentence and extracts adjectives having an appearance frequency exceeding a predetermined reference value as an emphasis keyword;
And an order resetting unit for resetting the editing technique order by matching the emphasis keyword and the technique order definition information.
The editing execution unit,
And re-editing the image based on the reset sequence of the editing technique. The method of claim 1,
The display,
PIP (picture in picture) function to divide the screen into a plurality of areas,
The camera selection module,
A multi-selection unit for allowing a user to select at least two cameras,
The video playback module,
And a PIP output unit configured to receive images captured by the camera selected by the multi selector from the image output module and to reproduce the images through the area of the screen, respectively. The method of claim 2,
The camera selection module,
And a simultaneous reproducing unit for simultaneously reproducing images captured by the cameras in the plurality of areas of the screen,
The video playback module,
And at least one of the areas selected by the user, the area enlargement unit configured to enlarge the area and play it on the screen. The method of claim 1,
The camera group,
Assign a camera that focuses on each performer when there are multiple performers on stage.
The camera selection module,
A performer selection unit for selecting a camera for photographing a specific performer by a user;
The video playback module,
And a concentrated output unit configured to receive the image photographed by the camera selected by the performer selector from the image output module and reproduce the image through the screen. delete delete delete delete delete delete delete

Images