KR20010036581A - Apparatus and method for separating automatically chroma/luminance key on real time - Google Patents

Abstract

PURPOSE: An apparatus and a method for automatically dividing a real-time background are provided to automatically divide a background and an active object in real time. CONSTITUTION: A camera video selecting unit(40) selects one video information among input video information. A still picture extracting unit(50) extracts a still picture from video information selected in the camera video selecting unit(40). A color distribution rate information analyzing unit(60) analyzes color distribution rate information of the still picture extracted in the still picture extracting unit(50). A last key information calculating unit(70) selects a color in which a color distribution rate is highest as a background and determines a corresponding color value as a background key value. A key information storing unit(30) stores the background key value calculated in the last key information calculating unit(70) in a storing medium such as a memory or a hard disk.

Description

Real-time automatic background separation device and its method {APPARATUS AND METHOD FOR SEPARATING AUTOMATICALLY CHROMA / LUMINANCE KEY ON REAL TIME}

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a background / dynamic object separation system for separating a video signal into a background and a dynamic object. More particularly, the present invention relates to a video input device by adding an image processing function to a background and a dynamic object. A real-time automatic background separation apparatus for automatically separating and storing phosphorus objects, and a method thereof and a computer-readable recording medium recording a program for realizing the method.

Currently, the background / dynamic object separation work (chroma key work) is used as a pronoun for special effects in various fields related to video such as film and broadcasting, and the part corresponding to the dynamic object is mainly used for figures. . In addition, the chroma key method has a tendency to increase the frequency of use in a variety of forms as the special effects are widely introduced in the field of video.

However, the conventional background / dynamic object separation (chroma key work) involves covering the background wall with a blue cloth called chroma cloth or maintaining chroma in order to maintain optimal conditions in indoor studios or specially designed spaces. After painting the walls with blue paint, called paint, they were able to take pictures only after installing a set of lights with a high-voltage powerful light source close to natural lighting, special lighting to cast figures, and special lighting to handle shadows.

In addition, such a conventional method can be photographed only if the performer with a certain dress and the shooting step is provided according to a predetermined plan.

In the conventional method, a chroma key operation is performed by editing an image recorded on a video tape using a switch / mixer used as a broadcasting equipment after photographing in the above manner.

Therefore, the conventional method is not easily accessible to the general public due to the enormous power consumption, broadcasting equipment costing tens of millions of won or hundreds of millions of units, and the need for a large number of manpower to be mobilized. There was a problem that this was necessary.

In addition, the conventional method has to be manually edited by a person with a recorded image, and thus there is a problem that it is impossible to process in real time.

The present invention has been made to solve the above problems, a real-time automatic background separation apparatus for automatically separating the background and the dynamic object in real time and a computer-readable recording medium recording the method and a program for realizing the method The purpose is to provide.

That is, the present invention uses a general lighting such as a fluorescent lamp and separates the background and the dynamic object of the image taken for an unspecified number regardless of the clothes of the subject and the color and skin color of the clothes, and all of these processes are automatically performed. It is an object of the present invention to provide a real-time automatic background separation apparatus for real-time processing, and a method and a computer-readable recording medium recording a program for realizing the method.

1 is a block diagram of an embodiment of a real-time automatic background separation apparatus according to the present invention.

Figure 2 is a detailed configuration diagram of one embodiment of a real-time automatic background separation apparatus according to the present invention.

3 is a flowchart illustrating an embodiment of a real-time automatic background separation method according to the present invention.

4 is a detailed flowchart of an embodiment of a background color determination process (306,307) by analyzing the color distribution ratio of FIG. 3 according to the present invention.

* Explanation of symbols for the main parts of the drawings

10: video signal input unit 20: key information calculation unit

30: key information storage unit 40: camera image selection unit

50: still picture extraction unit 60: color distribution ratio information analysis unit

70: final key information calculation unit

An apparatus of the present invention for achieving the above object, the apparatus for automatically separating the background and the dynamic object of the image in real time, the image signal transmitting means for transmitting the image signal; Key information calculating means for calculating key information for distinguishing a background from a dynamic object by analyzing color distribution of the video signal inputted from the video signal transmitting means; And key information storage means for storing key information generated by the key information calculating means.

On the other hand, the method of the present invention is a real-time automatic background separation method applied to the apparatus for automatically separating the background of the image and the dynamic object in real time, the first step of extracting a still image from the received image signal; A second step of analyzing color distribution of the extracted still image and calculating key information for distinguishing a background from a dynamic object; And a third step of storing the calculated key information.

The method of the present invention may further include a fourth step of repeatedly storing the background key information according to each video signal by repeatedly performing the above steps on the plurality of input video signals.

On the other hand, the present invention, a real-time automatic background separation apparatus having a processor, the first function for extracting a still picture from the received video signal; A second function of analyzing color distribution of the extracted still image to calculate key information for distinguishing a background from a dynamic object; And a computer readable recording medium having recorded thereon a program for realizing a third function of storing the calculated key information.

In addition, the present invention, by repeating the above steps for each of the plurality of video signals to be input to read by a computer recording a program for further realizing a fourth function for storing each background key information according to each video signal Provides a record medium that can be.

In general, the chroma key function refers to a function of calculating a key value of a subject by using a background screen as a default key value by a predetermined script command. Then, after removing the background from the image information, a new background is synthesized to create a new image signal. In this case, the script function may be performed by programming a video input / output and all operations as defined commands.

However, the current chroma key method has the same problems as mentioned in the prior art, and cannot be used to record a person singing at a place such as karaoke or the like and record it on a compact disc (CD) with music.

Therefore, for simple chroma key shooting, karaoke, karaoke, etc., using general lighting such as fluorescent lamps, the background and dynamics of the images taken for an unspecified number regardless of the subject's clothes and the color and skin color of the clothes There is a need for a method of automatically separating objects in real time.

Accordingly, in the present invention, by adding an image processing function through a computer analysis system to the image input equipment, such as a camera, by determining the portion corresponding to the background through color distribution ratio analysis to calculate the final background key value, It is characterized by the automatic separation of objects from the background and dynamic.

The above objects, features and advantages will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of a real-time automatic background separation apparatus according to the present invention.

Real-time automatic background separation apparatus according to the present invention, using a general lighting, such as a fluorescent lamp, and a video signal input unit for transmitting the image information photographed for an unspecified number regardless of the clothes of the subject and the color and skin color of the clothes ( 10) to analyze the color distribution ratio of the image information input through the image signal input unit 10 to determine the most distributed color value as the background key value to calculate the key information for distinguishing the background and the dynamic object An information calculator 20 and a key information storage unit 30 for storing key information of a background generated by the key information calculator 20 are provided.

Looking at the specific configuration and operation of the real-time automatic background separation device having the configuration as described above with reference to FIG.

2 is a detailed configuration diagram of an embodiment of a real-time automatic background separation apparatus according to the present invention.

As shown in FIG. 2, first, image information (using general lighting such as a fluorescent lamp) is used through one or more cameras 10 to target an unspecified number regardless of the clothes of the subject and the color and skin color of the clothes. Image information), the camera image selector 40 selects any one of the input image information. In this case, the image information may be selected in a predetermined order, the image information may be selected in the order input first, or may be selected in a random order.

Thereafter, the still image extractor 50 extracts a still image from the image information selected by the camera image selector 40.

Thereafter, the color distribution ratio information analyzer 60 analyzes the color distribution ratio information of the still image extracted by the still image extractor 50.

Subsequently, the final key information calculating unit 70 designates the color most distributed according to the result analyzed by the color distribution ratio information analyzing unit 60 as the background, that is, selects the color having the largest color distribution ratio as the background. To determine the value of the color as the background key.

Thereafter, the key information storage unit 30 stores the background key value calculated by the final key information calculation unit 70 in a storage medium such as a memory or a hard disk.

By automatically calculating and storing the key information of the background in real time, the color of the clothes worn by the person and the skin color of the person can be automatically recognized to generate and maintain the most appropriate color key value by optimization calculation. The key information may be used to automatically remove the background from the image information input afterwards in real time, and then synthesize a new predetermined background to generate a new image signal.

3 is a flowchart illustrating an embodiment of a real-time automatic background separation method according to the present invention, which illustrates the operation of a program for automatically separating a background / dynamic object mounted in a real-time automatic background separation apparatus in real time.

First, when the power switch of the real-time automatic background separation apparatus is turned on (301), a real-time automatic background separation program through color distribution ratio analysis is loaded (302).

Thereafter, when the loading of the program is finished and a moving object such as a person is located within the viewing angle of the camera (303), a still image is extracted from the image information received through the camera 1 (304, 305).

Thereafter, as shown in FIG. 4 to be described later with respect to the extracted still image, the color distribution ratio is analyzed to determine the color having the largest color distribution ratio as a background, and the value of the color is calculated as the final key value for the background (306,307). ).

Thereafter, after storing the calculated key value in a storage device such as a memory or a hard disk (308), it is determined whether there is an additional camera (309), and if there are more cameras, a new key value analysis space for new key value analysis and storage. After securing (310) is repeated from the process of receiving an image from a new camera (304).

The above process is repeated until there are no more new cameras, and each background key value according to the camera is stored and then terminated.

4 is a detailed flowchart illustrating a background color determination process 306 and 307 through the color distribution ratio analysis of FIG. 3 according to the present invention.

First, by analyzing the color values of the extracted still image (RGB) distribution, which is a color implementation method using red, green, and blue (401), the most distributed value is selected as the background reference value (401). 402).

Then, it is determined whether there are consecutive RGB ratios to the upper and lower centers based on the selected reference value (403), and if there are consecutive RGB ratios, each new RGB ratio is included. After determining the range itself as a new reference value (404), the determination process (403) is repeated.

After repeating the above process, if there is no further continuous RGB value, the reference value at this time is determined as the background key value as the final reference value for the background (405).

In the definition of the continuous value, the difference value less than or equal to 5 on the ALG ratio is determined as the continuous value with respect to the upper and lower reference values, but may vary by more than 10 depending on the actual field situation.

Since the real-time automatic background separation apparatus as described above can be configured not only through a camera but also through any device capable of inputting an image, in this case, it should be considered as the same as the embodiment of the present invention.

The present invention described above is not limited to the above-described embodiments and the accompanying drawings, and various substitutions, modifications, and changes can be made in the art without departing from the technical spirit of the present invention. It will be apparent to those of ordinary knowledge.

As described above, the present invention is not burdened with expensive equipment and labor costs, and by automating the whole process, anyone can easily and easily separate the background of the image and the dynamic object in real time at a low cost, in real time. It has the effect of realizing various images by synthesizing the live image and the prepared background image.

In addition, the present invention, without the need for special lighting, such as a lighting set having a strong light source close to natural lighting, a portrait light and a shadow processing light, using a general lighting such as a fluorescent lamp, and the clothes and colors of the clothes Regardless of skin color, there is an effect that can be used for images shot on an unspecified number of places such as a singing practice hall.

Claims (12)

In the device for automatically separating the background of the image and the dynamic object in real time, Video signal transmitting means for transmitting a video signal; Key information calculating means for calculating key information for distinguishing a background from a dynamic object by analyzing color distribution of the video signal inputted from the video signal transmitting means; And Key information storage means for storing key information generated by the key information calculating means Real time automatic background separation device including. The method of claim 1, The video signal transmitting means, A real-time automatic background separation apparatus using general lighting and transmitting image signals acquired for an unspecified number regardless of the clothes of the subject and the color and skin color of the clothes. The method of claim 2, The video signal transmitting means, Real-time automatic background separation apparatus comprising at least one camera. The method according to any one of claims 1 to 3, The key information calculating means, Color distribution ratio analyzing means for analyzing a color distribution ratio of the still image extracted from the video signal input from the video signal transmitting means; And Final key information calculating means for selecting a color having the largest color distribution ratio as a background and calculating the value of the corresponding color as a background key value according to the result analyzed by the color distribution ratio analyzing means. Real time automatic background separation device including. The method of claim 4, wherein The color distribution ratio analysis means, Video signal selecting means for selecting any one of video signals input from said video signal transmitting means; Still picture extracting means for extracting a still picture from the video signal selected by said video signal selecting means; And Color distribution ratio information analyzing means for analyzing color distribution ratio information of the still image extracted by the still image extracting means Real time automatic background separation device including. In the real-time automatic background separation method applied to the device for automatically separating the background of the image and the dynamic object in real time, Extracting a still picture from an input video signal; A second step of analyzing color distribution of the extracted still image and calculating key information for distinguishing a background from a dynamic object; And A third step of storing the calculated key information Real time automatic background separation method comprising a. The method of claim 6, A fourth step of repeatedly storing the background key information according to each video signal by repeatedly performing the above steps on the plurality of video signals respectively input; Real time automatic background separation method comprising more. The method according to claim 6 or 7, The second step, Analyzing the RGB value distribution by analyzing the color value of the extracted still image, selecting the most distributed value as the background reference value, and then continuously arranging the upper and lower RGB ratios based on the selected reference value. A fifth step of determining whether a value exists; As a result of the determination of the fifth step, if there are consecutive RGB values, a sixth step of selecting a range including each new RGB ratio as a new reference value and then proceeding to the determination step of the fifth step ; And As a result of the determination of the fifth step, if there is no further continuous RGB value, the seventh step of determining the background key value using the reference value at this time as the final reference value for the background Real time automatic background separation method comprising a. The method of claim 8, The input video signal, A method of real-time automatic background separation, characterized in that it is a video signal obtained by using a general illumination and irrespective of the clothes of the subject and the color and skin color of the clothes. In real time automatic background separation device equipped with a processor, A first function of extracting a still picture from an input video signal; A second function of analyzing color distribution of the extracted still image to calculate key information for distinguishing a background from a dynamic object; And A third function of storing the calculated key information A computer-readable recording medium having recorded thereon a program for realizing this. The method of claim 10, A fourth function of repeatedly storing the background key information according to each video signal by repeatedly performing the above steps on the plurality of video signals respectively inputted; A computer-readable recording medium that records a program for further realization. The method of claim 10 or 11, The second function is, Analyzing the RGB value distribution by analyzing the color value of the extracted still image, selecting the most distributed value as the background reference value, and then continuously arranging the upper and lower RGB ratios based on the selected reference value. A fifth function of determining whether a value exists; As a result of the determination in the fifth function, if there is a consecutive RGB value, the sixth step of proceeding to the determination process of the fifth function after selecting a range including each new RGB value as a new reference value; function; And A seventh function of determining a background key value using the reference value at this time as the final reference value for the background when there is no further continuous RGB value as a result of the determination in the fifth function; A computer-readable recording medium having recorded thereon a program for realizing this.