KR101176852B1 - Method for Compositing Image(or Video) - Google Patents

Abstract

The present invention relates to a method of synthesizing an image or an image, the method comprising: extracting a predetermined background image or a background image from a memory unit storing at least one background image or a background video in a mobile phone; Transparently processing a foreground image or a part of the foreground image and superimposing the background image extracted from the memory unit and the partially transparent foreground image in the mobile phone to generate a predetermined composite image, Or generating a predetermined composite video by superimposing a background image extracted from the memory unit and a foreground image which has been partially processed.

Burn, wallpapers

Description

Method for Compositing Image (or Video)

1 is a diagram showing the functional configuration of a wireless terminal for image compositing according to a preferred embodiment of the present invention.

2 is a diagram illustrating a composite image output according to the present invention.

3 is a diagram showing a functional configuration of an image synthesizing module according to a preferred embodiment of the present invention.

4 is a flowchart showing an image combining method according to a preferred embodiment of the present invention in a wireless terminal for image combining.

5 is an exemplary view of outputting a wireless terminal screen using a transparent processing method according to an exemplary embodiment of the present invention.

6 is an exemplary view of outputting a wireless terminal screen through a boundary processing method according to an exemplary embodiment of the present invention.

7 is an exemplary view of outputting a wireless terminal screen through a synthesis processing method according to a preferred embodiment of the present invention.

<Description of main parts of drawing>

100: wireless terminal 105: control unit

110: combining unit 115: boundary processing unit

120: multiplexer 125: reader

130: chroma key generation unit 135: interface unit

140: extraction unit 145: screen output unit

150: image input unit 155: key input unit

160: wireless processing unit 165: voice processing unit

170: memory unit 175: battery

The present invention provides a method of extracting a predetermined background image or a background image from a memory unit for storing at least one background image or background video in a mobile phone, and a part of the foreground image or foreground image in a mobile phone. And transparently superimposing the background image extracted from the memory unit and the foreground image partially processed in the mobile phone to generate a predetermined composite image or the background image extracted from the memory unit. The present invention relates to an image or an image synthesizing method including a step of generating a predetermined composite video by superimposing some transparently processed foreground images.

Due to the rapid technological development in mobile communication field, since the MSM 5x00 chip series of Qualcomm in the US, most of the wireless terminals currently released are basically equipped with a digital camera, and recently the MSM 6x00 chip series has been started to be installed. The camera's functionality has been greatly improved to more than 1 million pixels, and its functions are also converging on the functions of digital cameras on the market.

An image or video compositing technique includes a process of generating a predetermined picture or a fill image through keying to transparently process a part of a predetermined foreground image (or a foreground image). Representative keying methods for generating a fill image or a fill image as described above include a method using a chroma key for transparently processing a region including a specific color in the foreground image (or the foreground image), A method of using a Luminance Key that transparently processes an area including a specific luminance in the foreground image (or the foreground image), and a specific channel in the foreground image (or the foreground image) There is a method of using an external key to be processed. In addition, a method of generating a fill image or a fill image using region division information through object unit encoding And the like.

Among the keying methods, a method using chroma key is a technology used in broadcasting stations (eg, weather forecasts) or movie special effects fields, and includes a predetermined background video and an ultramarine blue (at least two or more cameras). In the studio equipped with Ultramarine Blue series Bluescreen or Greenscreen, each of the foreground video is taken, and the two shot images are superimposed through a predetermined image synthesizing apparatus. To create a composite video. Such a broadcasting station or movie image synthesizing apparatus must automatically process at least 640x480 video images in real time at 25 to 30 frames per second, and is composed of expensive high-performance equipment.

Recently, as a film-like video or image is converted or automatically accumulated into bitmap-based digital data, it has become possible to synthesize at least two videos or images using a predetermined digital image processing program even in a general personal computer. Image compositing consists of at least two bitmap images already stored as digital data, and automatically processes real-time 25-30 frames per second of at least 640x480 video images like the broadcasting station or movie compositing apparatus. It is not possible to achieve the function and performance.

As a result, there is a difficult problem in achieving image synthesis based on the performance of the digital camera and the limited wireless terminal provided in the wireless terminal using the conventional techniques proposed to date. In more detail, only the limited performance and functions provided in the wireless terminal cannot achieve the functions and performances of the broadcasting station or movie image synthesizing apparatus which automatically process the image synthesis through the expensive bulky high-performance equipment. In addition, a limited user interface provided in the wireless terminal (for example, a personal computer includes at least an image pointing device such as a mouse to an image pointing device such as a touch pen for image composition), but the wireless terminal includes such a pointing device. Cannot be used to achieve the image compositing function made on a personal computer.

An object of the present invention to solve the above problems is the step of extracting a predetermined background image or background image from the memory unit for storing at least one or more background image (Background Image) or background image (Background Video) in the mobile phone, Transparently processing a foreground image or a part of the foreground image on the mobile phone, and superimposing a background image extracted from the memory unit on the mobile phone and a partially transparent foreground image to generate a predetermined composite image; Or overlapping a background image extracted from the memory unit with a partially processed foreground image to generate a predetermined composite video.

The image or video composition method according to the present invention comprises the steps of extracting a predetermined background image or a background image from a memory unit for storing at least one background image or background video in the mobile phone, and Transparently processing a foreground image or a part of the foreground image and superimposing the background image extracted from the memory unit and the partially transparent foreground image in the mobile phone to generate a predetermined composite image, Or generating a predetermined composite video by superimposing a background image extracted from the memory unit and a foreground image partially processed.

Hereinafter, with reference to the accompanying drawings and description will be described in detail the operating principle of the preferred embodiment of the present invention. However, the drawings and the following description shown below are for the preferred method among various methods for effectively explaining the features of the present invention, the present invention is not limited only to the drawings and description below. In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the present invention, which may vary according to a user's or operator's intention or custom. Therefore, the definition should be based on the contents throughout the present title.

It is to be understood that both the foregoing general description and the following detailed description of the present invention are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. The configuration is omitted as much as possible, and a functional configuration that should be additionally provided for the present invention is mainly described. If those skilled in the art to which the present invention pertains, it will be easy to understand the functions of the components that are conventionally used among the functional configuration of the wireless terminal omitted and not shown below, and also as described above It will also be clearly understood that the relationship between the omitted wireless terminal component and the component added for the present invention (eg, an image synthesis module).

In addition, a preferred embodiment of the present invention to be implemented in the following various methods for keying (e.g., using a chroma key, a method using a luminensky, a method using an external key, or a method using region division through object-based encoding) Etc.), using a functional configuration using chroma keys, which are easy to explain the technical idea constituting the present invention efficiently, and also effectively the technical idea constituting the present invention among the foreground image or the foreground image read out from the digital camera. A description will be given using a case where a foreground image, which is easy to explain, is processed transparently to generate a fill image. However, the following preferred embodiments are selected to efficiently explain the technical idea of the present invention to those skilled in the art to which the present invention pertains, and the technical spirit of the present invention results in the claims, It is clear that this is by no means limited to.

1 is a diagram showing the functional configuration of a wireless terminal for image combining according to a preferred embodiment of the present invention.

In terms of hardware, the wireless terminal 100 providing a mobile communication service includes an external body, a speaker, a microphone, a keypad, a liquid crystal display (LCD), an antenna, a battery 175, and the like. For example, certain modem chips (for example, MSM series modem chips from Qualcomm, Inc.) that incorporate functions such as a code division multiple access (CDMA) modem, a CPU / MPU (Central Processing Unit / Micro Processing Unit), and a vocoder; , Various memory elements, duplexer filter that separates transmission and reception signals from one antenna, power amplifier to amplify transmission signal, high power amplifier (HPA), isolator to prevent the return of high output transmission signal RF / IF SAW filter to remove the unwanted out-of-band unwanted signals, frequency up-circuit in the transmission path, frequency down-conversion circuit in the receive path, and reference clock source. VCTCXO (Voltage Controlled Temperature Compensated X-tal Oscillator), UHF frequency synthesizer used as local signal of frequency up-down conversion, and codec chip for converting analog voice signal into digital signal. Elements are gradually integrated in the modem chip, and in addition to the core components for the mobile communication service, the modem chip is directly integrated with various functions for various multimedia services and / or additional services.

Functional configuration of the wireless terminal 100 for generating a composite image of the foreground image read out from the digital camera by transparently processing the composite image with a predetermined background image by referring to the hardware characteristics of the wireless terminal 100 as described above. Referring to FIG. 1, the image input unit 150 receives predetermined image information from a digital camera provided in the control unit 105, the screen output unit 145, the key input unit 155, and the wireless terminal 100 as shown in FIG. 1. And a wireless processor 160, a voice processor 165, a memory 170 for storing a predetermined background image, and a battery 175 for supplying power.

The control unit 105 includes a processor and an execution memory including a CPU / MPU provided in the modem chip in hardware, and includes a predetermined program routine for providing a function unique to the wireless terminal 100 from a predetermined memory element. And a bus for inputting and outputting routine and / or program data, and a predetermined electronic circuit (or integrated circuit) provided therefor. Generic term for program routines and / or program data loaded into execution memory and computed by the processor to perform specific functions, and various functions intended to be implemented by the controller 105 in the wireless terminal 100 thereby. Are realized, and also the overall operation of the wireless terminal 100 to realize the above functions. A characterized in that the control and management. In particular, when power is input to the wireless terminal 100 to perform a function of the control unit 105 for controlling and managing the overall operation of the wireless terminal 100, an operating system routine stored in a predetermined memory element, System management routines and / or system variables are loaded into the execution memory and computed by the processor to serve as variables for providing an operating system, system management program, and / or mobile communication service.

The screen output unit 145 is an LCD driver for screen output, and is a key generated through the key input unit 155 by the control unit 105 (for example, a program routine for outputting predetermined information or data to the LCD). LCD for displaying data, various information, signals, and / or contents (eg, text contents, image contents, and / or multimedia contents) extracted and / or generated in the course of performing a predetermined function included in the wireless terminal 100. And a screen output means provided in the wireless terminal 100 through the screen output unit 145 and the LCD.

According to a preferred embodiment of the present invention, the screen output unit 145 may be a predetermined foreground image read from the digital camera, or a fill image in which a part of the foreground image is transparently processed, or the memory unit 170. A predetermined background image to be extracted, or a synthetic image generated by superimposing the fill image and the background image is output, and a predetermined portion required to generate a fill image by transparently processing a part of the foreground image. An interface screen or a predetermined interface screen required to overlap the fill image and the background image, and to adjust the heterogeneity of the overlapped fill image and the background image is output through a predetermined image balancing process.

The image input unit 150 reads raster based CCD image information from a digital camera including a predetermined optical unit and a charge coupled device (CCD) device in a bitmap manner, and inputs the image information to the controller 105. The input image information is output to the output unit 145.

According to the present invention, the image information input through the image input unit 150 includes both a predetermined still image and a video corresponding to a video signal composed of tens of frames at several frames per second, which is relatively described in the embodiments of the present invention. The technical idea of the present invention will be described using this easy still image. However, it will be apparent to those skilled in the art that the still picture may be replaced with a moving picture.

The key input unit 155 may include at least one key data input from a predetermined keypad including a plurality of number keys, character keys, and / or at least one function key. Reads (eg, reads from, for example, a table storing information or signals matching key data) from the predetermined information or signal corresponding thereto, and transmits the predetermined information or signal to the controller 105. Key input means provided in the wireless terminal 100 through a key input unit 155 and a keypad is provided.

According to a preferred embodiment of the present invention, the key input unit 155 transparently processes predetermined key data and / or a partial area of the foreground image that reads a predetermined foreground image from the digital camera through the keypad. Predetermined key data required for generating predetermined keying information (e.g., chroma key) for the predetermined keying information and / or predetermined key required for generating a fill image by transparently adjusting a partial region of the foreground image by adjusting the keying information Predetermined key data and / or predetermined key data required for extracting a predetermined background image from the memory unit 170 and / or predetermined key data and / or overlapping the background image with the fill image generated from the foreground image Inputting predetermined key data required for balancing the overlapped fill image and the background image to the controller 105. It shall be.

The voice processing unit 165 encodes a predetermined sound signal input from a microphone included in the wireless terminal 100 and provides the predetermined sound signal to the control unit 105, or the predetermined control unit 105 extracts and / or generates the predetermined sound signal. The audio signal is decoded and output through a speaker. To this end, the voice processor 165 includes a predetermined vocoder and a codec. Sound input means provided in the wireless terminal 100 is provided through the voice processor 165 and the microphone, or sound output means provided in the wireless terminal 100 through the speaker and the voice processor 165 are provided. Is provided.

The wireless processing unit 160 may be associated with the control unit 105 (eg, a program routine for providing a mobile communication service) and / or register location and / or slot mode and / or power control and / or power. And a mobile communication service including a hand-off and / or call processing procedure. The mobile base station corresponding to an end of a mobile communication network in the process of providing the mobile communication service is provided. And an RF processing function (eg, performing antenna control, modulating, synthesizing, amplifying and / or filtering the radio frequency signal) for performing transmission and reception of the radio frequency signal. In particular, the wireless processing unit 160 processes or processes information or a signal transmitted from the wireless terminal 100 to the mobile base station in a CDMA stack to provide the mobile communication service, or from a CDMA stack received from the mobile base station. It provides a function of reading the information or signal of the.

The memory unit 170 input / output when an operation by a predetermined program routine (or code) and / or program data (eg, program routine (or code)) for controlling the overall operation of the wireless terminal 100 is performed. A general term for a memory device that stores information and / or data, including read only memory (ROM), read / write flash memory (FM), and EEPROM (Electrically Erasable and Programmable Read). Only memory, etc. In general, the ROM stores system information that should not be deleted, and the flash memory stores an operating system routine, a call processing program routine, and / or an application program provided through the wireless terminal 100. Routine, information or data for the routine is stored, and the EEPROM includes parameters related to terminal registration and a telephone number (e.g., , Address book) or at least one information and / or data that is extracted and / or generated while performing an application provided in the wireless terminal 100 is stored.

According to a preferred embodiment of the present invention, the memory unit 170 stores at least one background image to be overlapped with the fill image generated by transparently processing a partial region of the foreground image read from the digital camera. The background image may be taken by a digital camera provided in the wireless terminal 100 beforehand and stored therein, information stored in a digital camera provided in another wireless terminal 100, or a predetermined digital image converting device. It is preferable to include image information generated from a commercially available digital camera or a personal computer associated with a scanner, and received and stored in the wireless terminal 100 through a predetermined communication means.

According to a preferred embodiment of the present invention, the number of pixels in the vertical and horizontal pixels of the background image stored in the memory unit 170 and the image information read from the digital camera is the same, or the aspect ratio of the image information read from the digital camera. It is preferable that the number of pixels is smaller than the number of pixels in the background image.

Referring to FIG. 1, a wireless terminal 100 that generates a composite image in which a partial area of a foreground image read from a digital camera is transparent and synthesizes a predetermined background image is a predetermined background from the memory unit 170. An extraction unit 140 for extracting an image, a reading unit 125 for reading a foreground image from a digital camera provided in the wireless terminal 100, and keying for transparently processing a part of the foreground image. A chroma key generation unit 130 for generating a predetermined chroma key, a multiplexing unit 120 for generating a fill image by transparently multiplexing a part of the foreground image using the generated chroma key, and the extracted And a composition unit 110 for superimposing a background image and the generated fill image to generate a predetermined composite image, wherein the component is digital. The control unit 105 is provided in the controller 105 in the form of a predetermined program routine and / or program data for providing a function of generating a transparent image of a foreground image read from the Mera and generating a transparent image and composing the image with a predetermined background image. It is preferable to be.

In addition, in FIG. 1, in the wireless terminal 100 according to the preferred embodiment of the present invention, the image synthesizing wireless terminal 100 is anti-aliasing in the process of the multiplexing unit 120 generating a fill image. and preferably further comprising a boundary processor 115 for smoothly processing the borders of the fill images through -aliasing and / or chroma suppression and / or Alpha Channel Process. Alternatively, the image synthesizing wireless terminal 100 may include predetermined key data required for the chroma key generating unit 130 to generate a predetermined chroma key from a key input unit 155 provided in the wireless terminal 100; And / or the combining unit 110 further includes an interface unit 135 for interfacing predetermined key data required for balancing the fill image and the background image.

The extractor 140 extracts a predetermined background image from the memory unit 170 of the wireless terminal 100 and provides the extracted background image to the synthesis unit 110. To this end, the extractor 140 The predetermined image information is extracted from at least one or more image information stored in the memory unit 170 through the key input unit 155 provided in the wireless terminal 100 in association with the interface unit 135, and the extracted Image information is defined as a background image and provided to the synthesis unit 110.

The reading unit 125 reads predetermined image information from a digital camera provided in the wireless terminal 100 and an image input unit 150 for inputting predetermined image information from the digital camera, thereby generating the chroma key generation unit 130. And / or to provide to the multiplexer 120, for this purpose, the reader 125 is connected to the interface unit 135, the key input unit 155 provided in the wireless terminal 100 Predetermined image information is read from image information input through the digital camera, and the read image information is defined as a foreground image and provided to the chroma key generator 130 and / or the multiplexer 120.

Referring to FIG. 1 according to a preferred embodiment of the present invention, the wireless terminal 100 includes a chroma key generation unit 130 for generating a predetermined chroma key from the foreground image provided by the reader 125. To this end, the image information read by the reader 125 is preferably photographed by a subject photographed by the digital camera on a monochrome background of a living environment (eg, a monochromatic wall, a blackboard, etc.).

According to another exemplary embodiment of the present invention, the image information read by the reader 125 may be photographed in a non-monochrome background of a living environment. For this purpose, the wireless terminal 100 may include a chroma key generator ( Obviously, it is possible to include a luminensky generator 130 and / or an external key generator 130 and / or an image object generator 130 for dividing a region of an image through object unit encoding. Those skilled in the art to which the present invention pertains are based on the functional configuration of the chroma key generation unit 130 described in the present embodiment below and the luminensky generation unit 130 and / or the external The functions of the key generator 130 and / or the image object generator 130 may be relatively easily understood.

The chroma key generation unit 130 generates a predetermined chroma key corresponding to a key value of chroma to be transparently processed from the foreground image read by the reader 125.

If the chroma key generation unit 130 generates a predetermined chroma key, the foreground image read by the reading unit 125 and the foreground image without generating a predetermined fill image that transparently processes a part of the foreground image are generated. When the background image extracted by the extraction unit 140 is superimposed, the composite image is output as it is.

For example, as shown in FIG. 2, a background image including red (R), green (G), sky blue (C), and violet (V) is extracted by the extractor 140. In the state in which the foreground image composed of blue (B), red (R), green (G), sky blue (C), and purple (V) is read by the reading unit 125, When the background image and the foreground image are superimposed and synthesized without generating a chroma key, the synthesized image is output as it is.

Therefore, when the synthesis unit 110 synthesizes the foreground image and the background image by overlapping, in order to synthesize the pixels such that the foreground image is output to a part of the synthesized image and a part of the background image is output to the rest of the background image, Among the pixels of the foreground image, a key value of a color to be transparently processed (for example, a color key value of the foreground image to be synthesized to expose the pixel of the background image instead of the foreground image) should be generated.

If a predetermined chroma key corresponding to a key value of a color that transparently processes the blue color B among the pixels included in the foreground image of FIG. 2 is generated, and the blue color is transparently processed in the foreground image through the chroma key. After generating the fill image and combining the fill image and the background image in the synthesis unit 110, as shown in (b) of FIG. 2, a pixel region transparently processed in the fill image (for example, a region in which a blue pixel is located in the foreground image) The pixel of the background image is exposed, and the pixel of the fill image is exposed in the pixel region (for example, the region other than the blue pixel in the foreground image) which is not transparently processed.

That is, the chroma key generation unit 130 transparently processes a portion of the foreground image as described above to generate a predetermined chroma key required to generate a predetermined fill image, and the foreground image according to the generated chroma key. It is characterized in that the color or the pixel region to be transparently determined from.

If the chroma key generation unit 130 generates a predetermined chroma key, if the foreground image read from the digital camera is photographed in a studio equipped with perfect lighting facilities, the chroma key generation unit 130 performs the foreground. The chroma key generated to transparently process a part of the image will be made of a predetermined color key value.

However, the technical idea of the present invention is that the foreground image is photographed in a living environment, rather than being photographed and generated in a perfect studio lighting system. In such a living environment, even if the foreground image is a subject of a monochromatic background, the chroma key is fixed to a predetermined color key value, as in the case of the studio, due to the change in lighting caused by the living environment and the irregularities of the background. Rather, the chroma key is a probability distribution of a Hue and / or Saturation and / or Brightness including a predetermined region section based on a specific color key value to a three-dimensional key value. It will be made, including.

Therefore, the chroma key generation unit 130 generates a predetermined chroma key from the read foreground image, in connection with the interface unit 135 provided in the wireless terminal 100, to the wireless terminal 100. Read predetermined key data for reading the probability distribution of hue and / or saturation and / or contrast of the chroma key and the three-dimensional key value of the foreground image photographed in the living environment from the provided key input unit 155, The hue and / or saturation and / or offset and / or gain of the generated chroma key are adjusted using the read key data.

According to a preferred embodiment of the present invention, as described above, the chroma key generation unit 130 generates a pixel corresponding to the chroma key in the foreground image by the chroma key generated to transparently process a partial region of the foreground image. For example, a key value of a pixel to be transparently processed in the foreground image corresponding to a monochromatic background is set to '0', and a key value of a pixel (other than a pixel to be opaquely processed corresponding to a subject in the foreground image) is '1'. And a pixel located at a boundary area between a pixel to be transparently processed in the foreground image and a pixel not to have a key value between '0' and '1'. However, the problem is that in the case of a pixel in the boundary region (eg, a pixel having a key value between '0' and '1'), a part of the color of the background in the foreground image (eg, the subject of the foreground image is blue). If you take a picture from the wall, the color will remain. In general, when the screen resolution of the digital camera provided in the wireless terminal 100 is low, the boundary area as described above may be ignored, but as the resolution of the digital camera provided in the wireless terminal 100 is recently improved, the boundary area may be changed. Smooth processing results in less synthetic images.

The boundary processor 115 transparently processes a partial region of the foreground image (eg, the subject background of the foreground image) by the chroma key generator 130, and then forms a boundary between the subject and the monochrome background of the foreground image. Smooth processing is performed through a predetermined digital image processing process including antialiasing and / or chroma suppression and / or alpha channel editing. To this end, the boundary processor 115 may use a chroma key generated by the chroma key generator 130 to define a boundary region (eg, a key value between '0' and '1') from the foreground image. ), And predetermined digital image processing is performed on the pixels of the read boundary area.

For example, when the boundary processing unit 115 smoothly processes the boundary area through anti-aliasing based digital image processing, the boundary processing unit 115 has a key value of '0' among pixels around the boundary area pixel. The boundary area is smoothed by adding or replacing a pixel corresponding to '' and a pixel including an intermediate color of the color included in the pixel corresponding to '1'.

The multiplexer 120 uses the chroma key provided by the chroma key generator 130 and / or the boundary processor 115 in the foreground image provided by the reader 125. The portion corresponding to the key value '1' on the image retains the pixel of the foreground image as it is, and generates a predetermined fill image that transparently processes the portion corresponding to the key value '0' to the synthesis unit 110. It is characterized by providing.

The synthesizing unit 110 generates a predetermined synthetic image by superimposing a predetermined background image provided from the extracting unit 140 and a predetermined fill image provided from the multiplexing unit 120.

According to a preferred embodiment of the present invention, when the synthesis unit 110 expresses a method of synthesizing the background image and the fill image by using a formula, “Exposure pixel = (fill pixel) x (key value) + (background pixel) x (1? (Key value)) ”, wherein the“ exposed pixel ”corresponds to a pixel that is actually exposed at a specific position in the synthesized image, the pixel corresponds to a pixel of the image at the specific position, and the background pixel corresponds to the pixel. The key corresponds to the pixel of the background image at a specific position, and the key value corresponds to the key value of the chroma key generated by the chroma key generation unit 130. In the formula, if the key value is '1', the fill pixel is exposed to the exposed pixel, and if the key value is '0', the background pixel is exposed to the exposed pixel. By combining the fill image and the background image through the synthesis.

3 is a diagram showing the functional configuration of an image synthesizing module according to a preferred embodiment of the present invention.

In more detail, FIG. 3 shows a case in which a predetermined image synthesizing function provided in the control unit 105 of the wireless terminal 100 is produced by a predetermined module mounted on the wireless terminal 100 in FIG. The functional configuration of the image synthesis module 300 is shown.

According to the exemplary embodiment of the present invention, the image synthesis module 300 of FIG. 3 includes a predetermined integrated circuit (IC) in which arithmetic elements, memory elements, logic elements, and the like including predetermined functions for image synthesis are integrated. The chip may be mounted on the wireless terminal 100 in the form of a chip, or may be mounted on the wireless terminal 100 in the form of a predetermined chip associated with a component provided in the wireless terminal 100. The technical concept of the present invention is not limited by the mounting method of the image synthesis module 300.

In addition, terms or names used in the functional configuration of the image synthesis module 300 were used to match the terms or names so as not to be confused with the components used in FIG. It is intended to efficiently explain the technical idea of the present invention to those skilled in the art, and it is apparent that the technical idea of the image synthesis module 300 is not limited by the above terms or names in FIG. 3.

Referring to FIG. 3, the image synthesis module 300 includes an extracting unit 330 for extracting a predetermined background image from the memory unit 340 of the wireless terminal 100, and the wireless terminal 100. A reading unit 335 for reading out a foreground image from a digital camera, a chroma key generating unit 315 for generating a predetermined chroma key required for keying to transparently process a part of the foreground image, and the chroma key A boundary processor 310 for smoothly processing the boundary of the fill image generated by the multiplexer; a multiplexing unit 305 for transparently multiplexing a part of the foreground image by using the generated chroma key; Predetermined information required in the process of generating a predetermined chroma key by the synthesizer 325 and the chroma key generator 315 which overlap the extracted background image with the generated peeled image to generate a predetermined composite image, orCharacterized in that by overlapping the data with, the synthesis unit 325 is the field image and the background image comprises an interface unit 350 for interfacing a predetermined information or data required to produce a predetermined composite image.

In the image synthesizing module 300, the extractor 330 and / or the reader 335 include the same (or similar) components. According to a preferred embodiment of the present invention, the extractor ( 330 and / or the reading unit 335 is a predetermined buffer (FIFO) for buffering predetermined image information in a first input first output (FIFO) method and a buffer control unit 105 (FIFO CTRL) for controlling the buffer. It is preferable to comprise). However, the buffer of the extractor 330 is connected to the memory unit 340 that stores at least one background image in the wireless terminal 100, and the image information of the buffered background image is combined with the synthesizer 325. The buffer of the reader 335 is connected to a digital camera and / or an image input unit 150 for capturing and inputting a predetermined foreground image in the wireless terminal 100, and the buffering is performed. The image information of the foreground image is provided to the chroma key generation unit 315 and / or the boundary processing unit 310 and / or the multiplexing unit 305.

In the image synthesis module, the chroma key generation unit 315 performs the same function and role as the chroma key generation unit 130 of FIG. 1, and the image of the foreground image buffered in the buffer of the reading unit 335. Regarding the raster based bitmap information included in the array corresponding to the information, the predetermined chroma and / or saturation and / or offset and / or gain provided from the interface unit 345 are referred to as a predetermined chroma. And generating a key value corresponding to the marquee.

According to a preferred embodiment of the present invention, the chroma key generation unit 315 may refer to the chroma key with reference to a predetermined color and / or saturation and / or offset and / or gain provided through the interface unit 345. Preferably, the chroma key is adjusted until the corresponding predetermined key value reaches a satisfactory level (e.g., the chroma key includes all of the areas corresponding to the monochrome background of the foreground image). It is preferable that the connection is performed automatically in conjunction with the key input unit 155 of the wireless terminal 100 through the interface unit 345 or automatically by performing a loop in a predefined order.

In the image synthesizing module 300, the boundary processor 310 performs the same function and role as the boundary processor 115 of FIG. 1, and the image information buffered in the buffer of the reader 335. With respect to the raster-based bitmap information included in the array corresponding to, smoothing the boundary between the region that is transparently processed by the chroma key generated by the chroma key generator 315 and the region that is opaquely processed. It features.

According to a preferred embodiment of the present invention, the boundary processor 310 smoothes the boundary between the region that is transparently processed by the chroma key and the region that is opaquely processed in the raster-based bitmap information in a chroma suppress method. It is preferable to process, and as described above, the process of smoothing the boundary is performed by a predefined algorithm, so that the process of interfacing with the user is unnecessary.

In the image synthesis module 300, the multiplexer 305 performs the same function and role as the multiplexer 120 of FIG. 1. Image information of the foreground image buffered in the buffer of the reader 335 is performed. Based on raster-based bitmap information included in an array corresponding to, based on the chroma key generated by the chroma key generation unit 315 and / or the boundary information of the foreground image smoothly processed by the boundary processing unit 315. It is characterized by generating a predetermined fill image.

According to a preferred embodiment of the present invention, when the multiplexer 305 generates a predetermined fill image, the area to be transparently processed in the foreground image is the chroma key generator 315 and / or the boundary processor 310. The multiplexer 305 is arranged to include a fill image in which at least one array data is transparently processed from raster-based bitmap information included in the array corresponding to the image information of the foreground image. For example, an array that stores raster-based bitmap image bitmaps.

In the image synthesizing module 300, the synthesizing unit 325 performs the same function and role as the synthesizing unit 110 of FIG. 1, and image information of the background image buffered in the buffer of the extracting unit 330. In the raster-based bitmap information included in the array corresponding to the raster-based bitmap information included in the array corresponding to the picture information generated by the multiplexer 120, the same index of the array By applying a formula such as "exposure pixel = (fill pixel) x (key value) + (background pixel) x (1? (Key value))" of FIG. 1 to (Index), a predetermined composite image is superimposed. It characterized in that to generate.

According to a preferred embodiment of the present invention, in the process of the synthesis unit 325 overlapping the fill image on the background image, predetermined information is generated through the interface unit 345 to generate a composite image having less heterogeneity. Alternatively, it is preferable to receive data, and for this purpose, a predetermined key controller 105 is preferably provided between the multiplexer 305 and the combiner 325.

In the image synthesis module 300, the interface unit 345 interfaces the hue and / or saturation and / or offset and / or gain required for the chroma key generation unit 315 to generate a predetermined chroma key. In addition, the synthesis unit 325 is characterized in that the predetermined information or data required to superimpose the fill image and the background image.

According to a preferred embodiment of the present invention, the interface unit 345 is an interface (eg, “Select” in FIG. 3) that selects a keying method when the synthesis unit 325 generates a predetermined composite image. Interface (eg, “Clip” in FIG. 3) that determines the threshold of the interface, interface (eg, “Slope” in FIG. 3) that determines the linearity slope of keying, and the inverse of the input key value. It is preferable to include an interface to be applied (eg, “Inverse” in FIG. 3), and an interface (eg, “On / Off” in FIG. 3) that controls the on / off operation of keying.

In the following living environment, the dog is photographed as a subject on a blackboard having a solid green background, the photographed image information is read as a predetermined foreground image, a predetermined image is generated, and the distance of the living environment is photographed as a subject. In the wireless terminal 100 including the functional configuration described with reference to FIGS. 1 to 2 using a preferred embodiment of generating a superimposed and predetermined composite image by using the image information stored in the memory unit 170 as a background image. The image synthesis method of the present invention made is exemplified and explained.

In addition, in the image synthesis method of the present invention as described above, through the predetermined interface unit 135 provided in the wireless terminal 100, the image composition is semi-automatically by a series of sequential methods (Method) It will be exemplified, but this is only for effectively explaining the technical idea of the present invention to those skilled in the art, and the image synthesizing method is defined in a predetermined sequence. It will be clear that it can be done automatically.

4 is a flowchart showing an image combining method according to a preferred embodiment of the present invention in a wireless terminal 100 for image combining.

Referring to FIG. 4 according to a preferred embodiment of the present invention, the process of synthesizing an image in the image synthesizing wireless terminal 100 may include a single color background of a living environment through a predetermined digital camera provided in the wireless terminal 100. Captures a predetermined subject and sets the wireless terminal 100 to an image synthesis mode (400), or sets a shooting mode of the digital camera included in the wireless terminal 100 to an image synthesis mode and the wireless terminal ( In operation 400, a predetermined subject is photographed by using a predetermined digital camera provided at 100.

When the image compositing is started in the wireless terminal 100 as described above, the wireless terminal 100 is a foreground image (eg, currently photographed through a digital camera) for generating a fill image from the image information photographed through the digital camera. Image information) is read out, and the read foreground image is output on the screen provided in the wireless terminal 100 as shown in FIG.

Referring to (a) of FIG. 5 in which a puppy is photographed as a subject on a monochrome blackboard with a green background, a circular (or rectangular or triangular) pointer for extracting a predetermined color is displayed on the screen on which the foreground image is output. Wherein 500 is located, according to a preferred embodiment of the present invention, the pointer 500 may be moved through a direction key provided in the wireless terminal 100, and an initial value may be from the upper left to the upper right of the screen (generally, life). Since the subject to be photographed in the environment will have a triangular composition, the background is output from the upper left to the upper right.

When the foreground image is outputted on the screen of the wireless terminal 100 as described above, a position to extract the chroma key for keying is selected using the pointer 500 on the output screen (410). If the background of the foreground image is located at the initial value of the pointer 500, click the “OK” button as it is, or move the position of the pointer 500 by using a direction key to position the background of the foreground image. Click the "OK" button.

When the pointer 500 is positioned on the background in the foreground image and clicks the “OK” button as described above, a part of the background of the foreground image is processed and outputted. Referring to (b) of FIG. 5, the green background is displayed. It wasn't neatly transparent. This is because the background of the foreground image is not neatly processed like a studio using an artificial lighting effect and a solid colorless cloth as a background even though the monochrome background is excellent in the living environment. Accordingly, as shown in (d) to (e) of FIG. 5, a predetermined interface (for example, a menu for adjusting the transparent area) provided in the wireless terminal 100 as shown in (c) of FIG. By adjusting the hue and / or saturation and / or offset and / or gain, the chroma key value is manipulated to adjust the transparent area to transparently process the background of the foreground image as shown in FIG. .

If the transparent area to be keyed in the foreground image by manipulating the chroma key value as described above is not adjusted as shown in (5) of FIG. 5, through (C) of FIG. E) repeat the predetermined operation process.

On the other hand, if the adjustment of the transparent area is completed (420) through the manipulation of the chroma key value as described above (420), the wireless terminal 100 is for generating a predetermined picture from the foreground image. The chroma key is generated (425).

By the way, referring to FIG. 5B, even after the chroma key is generated as described above, a predetermined green pixel is conspicuous between the boundary of the subject and the background of the foreground image. Therefore, the wireless terminal 100 selects a predetermined boundary processing method for smoothly processing the boundary as shown in (a) of FIG. Adjust (430).

According to another exemplary embodiment of the present invention, when a predetermined boundary processing method is fixed to the wireless terminal 100, a process of selecting a boundary processing method as shown in FIG. 6A may be omitted. It is possible to transfer from (5) of FIG. 5 to the border processing screen of (6) of FIG.

If the chroma key for the transparent region is generated in the foreground image as described above (425), and / or the transparent boundary is smoothly adjusted (430), the wireless terminal 100 may be configured to process the background of the foreground image transparently. Produces a fill image of 435.

When the fill image is generated as described above, the wireless terminal 100 performs a background from at least one or more image information stored in the memory unit 170 of the wireless terminal 100 as shown in FIG. Predetermined image information to be used as an image is extracted (440), and the extracted background image and the generated fill image are overlapped (445) as shown in FIG.

According to an exemplary embodiment of the present invention, as shown in (b) of FIG. 7, a fill image and a background image may be superimposed, and a predetermined synthetic image may be generated. There is some heterogeneity in hue and / or saturation and / or contrast due to the different lighting effects resulting from.

Accordingly, the wireless terminal 100 defocuss the superimposed images or manipulates a linearity slope through a predetermined interface (for example, a menu for manipulating the superimposed images). Adjust the heterogeneity present (450).

According to the preferred embodiment of the present invention, the process of adjusting the heterogeneity of the background image and the fill image as described above is preferably repeated until the user of the wireless terminal 100 is satisfied. It may be omitted or may be omitted.

If the heterogeneous feeling adjustment between the background image and the fill image is completed (455), the wireless terminal 100 adjusts the predetermined heterogeneity to synthesize the overlapping background image and the fill image to generate a predetermined composite image. The synthesized image generated as described above is stored in the memory unit 170 provided in the wireless terminal 100 or transmitted to a predetermined wired / wireless terminal or a server through a mobile communication network.

According to the present invention, after storing at least one background image in a wireless terminal, using the digital camera provided in the wireless terminal to take a predetermined foreground image on a monochrome background of the living environment, and remove the monochrome background chroma key By using a function to generate a predetermined picture from the foreground image, and combining the picture with the background image, there is an advantage that the image stored through the image synthesis can be used as the background of the wireless terminal.

In addition, by outputting through a predetermined photo printer (Photo Printer) there is an advantage that can produce the same effect as a conventional sticker photo.

Claims (1)

In the image synthesizing method of a mobile phone equipped with a camera, Extracting a background image; Setting or adjusting key data for keying a partial region of the image by selecting at least one of a color, a luminance, and a channel of the image input from the camera according to an environment and lighting around a subject photographed by the camera step; Generating a picture by keying an image input from the camera through the set or adjusted key data; And And synthesizing and outputting the fill image on the background image.

Images