KR20090103982A - Method for providing information image(or video) - Google Patents

Abstract

PURPOSE: A method for providing information image is provided to store a photographed image after compositing the image with a background image by using an image composite function. CONSTITUTION: A method for providing information image comprises the steps of: processing transparently some of a foreground image or foreground video transmitted from a client terminal(160); generating a composite video by superimposing the some of image with the video or generating a composite image by superimposing the background image with the some of foreground image; and transmitting the composite image or video to the client terminal or a second client terminal(165) that the client terminal designates.

Description

How to provide image or video information {Method for Providing Information Image (or Video)}

1 is a diagram illustrating a system for providing an image or video composition service according to a preferred embodiment of the present invention.

2 is a schematic diagram illustrating chroma key principles according to a preferred embodiment of the present invention.

3 is a diagram illustrating a functional configuration of a client terminal providing an image or video composition service according to a preferred embodiment of the present invention.

4 is a diagram illustrating a preferred method for generating a fill image from a foreground image through an image or image synthesis service providing system according to an exemplary embodiment of the present invention.

5 is an exemplary interface screen for selecting a background screen according to an embodiment of the present invention.

6 is an exemplary interface screen for transmitting a background screen according to an embodiment of the present invention.

7 is an exemplary view of a foreground image capturing interface screen according to an exemplary embodiment of the present invention.

8 is an exemplary view of a foreground image transparent interface screen according to an exemplary embodiment of the present invention.

9 is an exemplary view of a boundary processing interface screen according to an embodiment of the present invention.

FIG. 10 illustrates a preferred method for generating a composite image by superimposing a fill image and a background image through an image or image synthesis service providing system according to an exemplary embodiment of the present invention.

11 is an exemplary view of a composite picture generation interface screen according to an embodiment of the present invention.

<Description of main parts of drawing>

100: server 105: synthesis unit

110: transmission unit 115: boundary processing unit

120: multiplexer 125: receiver

130: chroma key generation unit 135: interface unit

140: extractor 145: storage medium

150: providing unit 155: receiving unit (storage medium)

160: client terminal 165: second client terminal

The present invention provides a method of transparently processing a foreground image or a part of a foreground image transmitted from a client terminal in a server, and superimposing a background image selected by the client terminal and a foreground image in which the portion is transparently processed by the server. Generating a predetermined composite image, or generating a predetermined composite video by superimposing a background image selected by the client terminal and a foreground image that has transparently processed the portion; The present invention relates to a method of providing an image or image information comprising transmitting a generated composite image or a composite video to the client terminal or a second client terminal designated by the client terminal.

An image or video synthesis technique uses a keying to transparently process a partial area of a predetermined foreground image (or foreground image), thereby providing a predetermined fill image or fill video. ), And a representative keying method for generating a fill image or a fill image as described above includes a chroma key (10) that transparently processes an area including a specific color in the foreground image (or the foreground image). A method using a chroma key, a method using a luminance key that transparently processes a region including a specific luminance in the foreground image (or a foreground image), and the foreground image (or a foreground image) In addition, there is a method using an external key that transparently processes a specific channel. In addition, a hand-painted image or a written image is obtained by using segmentation information through object-based encoding. And a method for generating a phase.

Among the keying methods, a method using chroma key is a technology used in broadcasting stations (eg, weather forecasts) or movie special effects fields, and includes a predetermined background video and an ultramarine blue (at least two or more cameras). In the studio equipped with Ultramarine Blue series Bluescreen or Greenscreen, each of the foreground video is taken, and the two shot images are superimposed through a predetermined image synthesizing apparatus. To create a composite video. Such a broadcasting station or movie image synthesizing apparatus must automatically process at least 640x480 video images in real time at 25 to 30 frames per second, and is composed of expensive high-performance equipment.

Recently, as film-like video or images are converted or automatically accumulated into bitmap-based digital data, it has become possible to synthesize at least two or more videos or images by using a predetermined digital image processing program even in a general personal computer. It is a field of experts who has accumulated a certain level of expertise and skilled experience in preprocessing, and it is difficult to synthesize a predetermined picture or video even if the general person has the digital image processing program on a personal computer. There is this.

Recently, due to the rapid development of mobile communication technology, since the MSM 5x00 series of Qualcomm's MSM 5x00 chip series, most of the currently released wireless terminals are basically equipped with a digital camera, which is taken with a digital camera provided in the wireless terminal. Combining an image or an image with a predetermined background image or background image is a more difficult problem.

An object of the present invention to solve the above problems is to transparently process a portion of the foreground image or foreground image transmitted from the client terminal in the server, and the background image and the portion selected by the client terminal in the server transparently Superimpose the processed foreground image (superimpose) to generate a predetermined composite image (Composite Image), or a predetermined composite image (Composite Video by overlapping the background image selected by the client terminal and the foreground image transparently processed the portion ) And transmitting the generated composite image or composite video from the server to the client terminal or a second client terminal designated by the client terminal. In providing information.

In the method of providing an image or video information according to the present invention, a process of transparently processing a foreground image or a portion of a foreground image transmitted from a client terminal in a server, and a background image and the portion selected by the client terminal in a server are transparently processed. Superimpose a foreground image to generate a predetermined composite image, or a predetermined composite image by superimposing a background image selected by the client terminal and a foreground image in which the portion is transparently processed. And transmitting the generated composite image or composite video from a server to the client terminal or a second client terminal designated by the client terminal. do.

The method may further include receiving a foreground image or a foreground image and a background image or a background video to be superimposed on the foreground image or the foreground image from the client terminal, and the server. Transparently processing the received foreground image or a portion of the foreground image, and superimposing the received background image and the foreground image on which the portion is transparently processed by the server to a predetermined composite image. Or generating a composite video by superimposing the received background image and the foreground image obtained by transparently processing the portion, and generating the composite image or the composite image by the server. Transmitting a composite video to the client terminal or a second client terminal designated by the client terminal. Characterized in that obtained by box.

The transparent processing of the foreground image or the portion of the foreground image may include generating predetermined keying information required for predetermined keying for transparently processing the foreground image or the portion of the foreground image. The keying information generated for keying the foreground image or the foreground image may further include a chroma key, a luminance key, an external key, and an object unit encoding. Characterized in that it comprises one or more area division information through.

The transparent processing of the foreground image or the portion of the foreground image may further include receiving predetermined key data required to transparently process the foreground image or the portion of the foreground image from the client terminal. It is characterized by.

Hereinafter, with reference to the accompanying drawings and description will be described in detail the operating principle of the preferred embodiment of the present invention. However, the drawings and the following description shown below are for the preferred method among various methods for effectively explaining the features of the present invention, the present invention is not limited only to the drawings and description below. In addition, in the following description of the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. Terms to be described later are terms defined in consideration of functions in the present invention, which may vary according to intentions or customs of users or operators. Therefore, the definition should be based on the contents throughout the present title.

In addition, preferred embodiments of the present invention to be carried out below are provided in each system functional configuration to efficiently describe the technical components constituting the present invention, or system functions that are commonly provided in the technical field to which the present invention belongs. The configuration will be omitted, and described mainly on the functional configuration to be additionally provided for the present invention. If those skilled in the art to which the present invention pertains, it will be able to easily understand the function of the components that are conventionally used among the omitted functional configuration not shown below, and also the configuration omitted as described above The relationship between the elements and the components added for the present invention will also be clearly understood.

In addition, preferred embodiments to be implemented below are various methods for keying (for example, using chroma keys, using luminance skis, using external keys, or using segmentation through object-based encoding). The technical idea constituting the present invention is explained using a chroma key that is easy to explain efficiently (therefore, in the following embodiment, the chroma key generator is used), and the background image or the background image is stored in the storage medium. In order to describe both the case and the case provided from the client terminal, the storage medium will be described as being provided on a network interworking with the server. In addition, in order to effectively describe the technical configuration of the present invention will be described the technical idea of providing an image or video synthesis service using a wireless terminal equipped with a digital camera among a wired terminal and a wireless terminal. However, the following preferred embodiments are selected to efficiently explain the technical idea of the present invention to those skilled in the art to which the present invention pertains, and the technical spirit of the present invention results in the claims, It is clear that this is by no means limited to.

1 is a diagram showing a system for providing an image or video composition service according to a preferred embodiment of the present invention.

In more detail, FIG. 1 illustrates a client terminal 160 that reads a predetermined image or image from a digital camera in the form of digital content and transmits the image or image to a server 100 on a network equipped with the image or image synthesis function, and at least one background. A storage medium 145 for storing an image or a background image and a server 100 for processing a predetermined image or image received from the client terminal 160 as a foreground image or a foreground image and composing the image with the predetermined background image or background image. It is for a system for providing an image or video composition service, including.

The client terminal 160 includes at least one image from a predetermined digital camera (e.g., a digital camera, a digital camcorder, a video camera connected to a personal computer (or laptop), or a digital camera provided in a wireless terminal). Alternatively, an image is read as predetermined digital content (eg, image content or multimedia content), and an image or an image in which a predetermined subject is photographed on a monochromatic background is used as the foreground image or the foreground image.

According to a preferred embodiment of the present invention, the client terminal 160 is a wired network (for example, a foreground image or a foreground image in which a predetermined subject is photographed on a single color background among images or images captured and read by the digital camera). , The Internet) or a wireless network (eg, a mobile communication network, a wireless data communication network) may be transmitted to the server 100.

In addition, the client terminal 160 uses a predetermined image or image, which is not photographed on a single color background, from among images or images photographed and read by the digital camera, as a predetermined background image or a background image, or a predetermined wired network or wirelessly. It is preferable to transmit and store the storage medium 145 on the network through the network.

Referring to FIG. 1 according to a preferred embodiment of the present invention, the storage medium 145 is configured to receive and store a predetermined background image or a background image transmitted from the client terminal 160 at least one or more client terminals 160. And a receiving unit 155 for connecting a predetermined communication session and receiving a predetermined background image or a background image from the client terminal 160 through the communication session, and / or the storage medium 145. In order to provide at least one background image or background image stored in the server 100 to the server 100, a predetermined providing unit 150 is preferably provided.

According to another exemplary embodiment of the present invention, when the storage medium 145 is provided in the server 100, the receiving unit 155 of the storage medium 145 may include a predetermined receiving unit provided in the server 100 ( 125 may be included, and the providing unit 150 of the storage medium 145 may be included in the extracting unit 140 of the server 100.

According to another exemplary embodiment of the present invention, the background image or the background image is not stored in the storage medium 145, and a predetermined foreground image or foreground image is transmitted from the client terminal 160 to the server 100. In the process, the background image or the background image to be synthesized with the foreground image or the foreground image from the client terminal 160 may be directly transmitted to the server 100.

Referring to FIG. 1, a predetermined image or a fill image in which the foreground image or the foreground image received from the client terminal 160 is transparently processed is generated and stored in the storage medium 145 (or the client terminal ( The server 100 for synthesizing the predetermined background image or the background image received from the storage medium 160 may include an extractor 140 which extracts the predetermined background image or the background image from the storage medium 145, and the client terminal ( Receiving unit 125 for receiving a predetermined foreground image or a foreground image from the 160 and a chroma key generation unit 130 for generating a predetermined chroma key required for keying to transparently process a part of the foreground image or the foreground image. And the multiplexing unit 120 and the extraction to generate a fill image or a fill image by transparently multiplexing the foreground image or a portion of the foreground image using the generated chroma key. Background image or a background image with superimposing the generated field picture or a field picture to be characterized by comprising a combining section 105 for generating a predetermined composite image.

In addition, in FIG. 1, the server 100 according to the preferred embodiment of the present invention may have an anti-aliasing and / or chroma system in the process of the multiplexer 120 generating a hand image or a hand image. It is preferable to further include a boundary processing unit 115 for smoothly processing the boundary of the fill image or the fill image through the press (Chroma Suppress) and / or Alpha Channel Process (Alpha Channel Process).

In addition, the server 100 provides a user interface for adjusting the chroma key value to the client terminal 160 when the chroma key generation unit 130 generates a predetermined chroma key and / or the The synthesizing unit 105 synthesizes the foreground image or the foreground image and the background image or the background image to the client terminal 160 to provide a user interface for balancing the fill image or the fill image and the background image or the background image. Preferably, the interface unit 135 further includes an interface unit 135. The interface unit 135 further includes the extractor 140, the receiver 125, the multiplexer 120, and the like. In performing the above, it is preferable to provide an interface between the server 100 and the client terminal 160.

The extractor 140 extracts a predetermined background image or a background image from the storage medium 145 and provides the extracted background image to the synthesis unit 105. For this purpose, the extractor 140 is the interface unit. A user interface for selecting a predetermined background image or background image to be used for synthesis from among at least one background image or background image stored in the storage medium 145 to the client terminal 160 in association with 135. It is desirable to.

The receiving unit 125 may receive a predetermined foreground image or a foreground image from the client terminal 160 and provide the foreground image or the foreground image to the chroma key generation unit 130 and / or the multiplexing unit 120. The receiver 125 is stored in the client terminal 160 in association with the interface unit 135 and / or the foreground image or the foreground image among images or images read out from a digital camera by the client terminal 160. It is preferable to select an image or image to be used and to receive the selected foreground image or the foreground image.

According to a preferred embodiment of the present invention, the foreground image or the foreground image received by the receiver 125 preferably includes a subject photographed on a monochromatic background (eg, a monochromatic wall, a blackboard, etc.) of a living environment. The server 100 is provided with a chroma key generation unit 130 for transparently processing a monochromatic background other than the subject in the foreground image or the foreground image through predetermined keying.

According to another exemplary embodiment of the present invention, the foreground image or the foreground image received by the receiver 125 may be photographed in a place other than a solid background of the living environment. For this purpose, the server 100 may include a chroma key generation unit ( 130) In addition, a luminensky generator for transparently processing an area other than the subject through predetermined keying, and / or an external key generator, and / or an image object generator for dividing an area of an image through object unit encoding. It is possible to be provided. Those skilled in the art to which the present invention pertains, based on the functional configuration of the chroma key generation unit 130 described in the present embodiment below, the luminensky generation unit and / or the external key generation unit and / or The function of the image object generating unit can be understood relatively easily.

The chroma key generation unit 130 generates a predetermined chroma key corresponding to a key value of a chroma to be transparently processed from the foreground image or the foreground image received by the reception unit 125.

If the chroma key generation unit 130 generates a predetermined chroma key and receives the image by the receiving unit 125 without generating a predetermined fill image or a fill image in which the background image of the foreground image or the foreground image is transparently processed. When the foreground image or the foreground image and the background image or the background image extracted by the extractor 140 are superimposed, the composite image will be output as it is.

For example, as shown in FIG. 2, a background image or a background image composed of red (R), green (G), sky blue (C), and violet (V) is generated by the extractor 140. When the foreground image or the foreground image, which is extracted and composed of blue (B), red (R), green (G), sky blue (C), and purple (V), is received by the receiver 125, When the background image or the background image and the foreground image or the foreground image are synthesized without superimposing a chroma key as shown in 2 (a), the synthesized image is output as it is.

Accordingly, the synthesis unit 105 superimposes the foreground image or the foreground image and the background image or the background image, and synthesizes the foreground image or the foreground image pixel on a part of the synthesized image, and the background image or the background on the rest. In order to synthesize a part of the image to be output, a key value of a color to be transparently processed among the pixels of the foreground image or the foreground image (for example, the foreground to be synthesized so that the pixels of the background image or the background image are exposed instead of the foreground image or the foreground image). Color key value of the image or foreground image) should be generated.

If the pixel included in the foreground image or the foreground image of FIG. 2 is generated as a predetermined chroma key corresponding to the key value of the color that transparently processes the blue color (B), and the blue color is applied to the foreground image or the foreground image through the chroma key. After generating a predetermined fill image or a fill image that is transparently processed, and synthesized the fill image or the fill image and a background image or a background image by the synthesis unit 105, the fill image as shown in (b) of FIG. Alternatively, the pixel area of the background image or the background image is exposed in the pixel area transparently processed in the fill image (eg, the foreground image or the area where the blue pixel is located in the foreground image), and the pixel area (eg, foreground image or untransparently processed) is exposed. The pixel of the fill image or the fill image is exposed to the area other than the blue pixel in the foreground image.

That is, the chroma key generation unit 130 shown in FIG. 1 generates a predetermined chroma key required to generate a predetermined fill image or a fill image by transparently processing the foreground image or a part of the foreground image as described above. The color or pixel area to be transparently processed from the foreground image or the foreground image is determined according to the generated chroma key.

If the chroma key generator 130 generates a predetermined chroma key, if the foreground image or the foreground image received from the client terminal 160 is photographed in a studio equipped with perfect lighting facilities, the chroma key generator The chroma key generated by the 130 to process the foreground image or a partial region of the foreground image transparently may be formed with a predetermined color key value.

However, the technical idea of the present invention is that the foreground image or the foreground image is photographed in a living environment, rather than being photographed and generated in a studio with a perfect lighting facility. In such a living environment, even if the foreground image or the foreground image photographs a subject of a monochrome background, the chroma key has a predetermined color key value as in the case of the studio due to the change in lighting caused by the living environment and the unevenness of the background. Rather, the chroma key has a probability distribution of Hue and / or Saturation and / or Brightness, including a predetermined region, based on a specific color key value. This will be done by including the key value.

Therefore, the chroma key generation unit 130 generates a predetermined chroma key from the received foreground image or the foreground image, in connection with the interface unit 135 provided in the server 100, the client terminal 160. Receiving predetermined interface information for reading a 3D key value from a probability distribution of hue and / or saturation and / or contrast of the chroma key of the foreground image or the foreground image photographed in a living environment, and receiving the received The color and / or saturation and / or offset and / or gain of the generated chroma key are adjusted using the interface information.

According to a preferred embodiment of the present invention, as described above, the chroma key generation unit 130 is a chroma key generated to transparently process the background area of the foreground image or the foreground image, and the chroma in the foreground image or the foreground image. The key value of the pixel corresponding to the marquee (e.g., the pixel to be transparently processed in the foreground image or the foreground image) is set to '0', and the pixel value of the pixel (e.g., the foreground image or the foreground image is not applied to the subject). The key value of the pixel to be processed opaque is set to '1', and the pixel located in the boundary region between the pixel to be transparently processed and the pixel not to be processed in the foreground image or the foreground image is' It will have a key value between 0 'and' 1 '. However, the problem is that in the case of a pixel in the boundary region (eg, a pixel having a key value between '0' and '1'), a part of the color of the background (for example, the foreground image or the foreground image) is present. If the subject of the foreground image is photographed on a blue wall, a bluish color remains, and the boundary area is smoothed to obtain a composite image having less heterogeneity.

The boundary processor 115 may transparently process the foreground image or a partial region of the foreground image (eg, the foreground image or the subject background of the foreground image) by the chroma key generator 130, and then the foreground image or the foreground image. It is characterized in that the boundary between the subject and the monochromatic background is smoothly processed through a predetermined digital image processing process including antialiasing and / or chroma suppression and / or alpha channel editing. To this end, the boundary processor 115 may use a chroma key generated by the chroma key generator 130 to display a boundary region (eg, a key value between '0' and '1') from the foreground image or the foreground image. Area), and predetermined digital image processing is performed on the pixels of the read boundary area.

For example, when the boundary processing unit 115 smoothly processes the boundary area through anti-aliasing based digital image processing, the boundary processing unit 115 has a key value of '0' among pixels around the boundary area pixel. The boundary area is smoothed by adding or replacing a pixel corresponding to '' and a pixel including an intermediate color of the color included in the pixel corresponding to '1'.

The multiplexer 120 uses a chroma key provided by the chroma key generator 130 and / or the boundary processor 115 in the foreground image or the foreground image provided by the receiver 125. The portion of the foreground image or the foreground image whose key value is '1' is a predetermined fill image in which the pixel of the foreground image or the foreground image is kept as it is, and the portion of the key value which is '0' is transparently processed. It is characterized in that to generate a fill image to provide to the synthesis unit 105.

The synthesizing unit 105 generates a predetermined synthetic image by superimposing a predetermined background image or background image provided from the extraction unit 140 and a predetermined fill image or fill image provided from the multiplexing unit 120. Characterized in that.

According to a preferred embodiment of the present invention, when the synthesis unit 105 expresses a method of synthesizing the background image or the background image with the fill image or the fill image, “Exposure pixel = (fill pixel) x (key value) + (Background pixel) x (1-(key value)) ”, where the“ exposed pixel ”corresponds to a pixel that is actually exposed at a specific position in the synthesized image, and the pixel is a fill image or a fill image at the specific position. The background pixel corresponds to the pixel of the background image or the background image at the specific position, and the key value corresponds to the key value of the chroma key generated by the chroma key generation unit 130. If the key value is '1' in the formula, the pixel is exposed to the exposed pixel. On the contrary, if the key value is '0', the background pixel is exposed to the exposed pixel. By combining the fill image or the fill image and the background image or the background image through the synthesis.

3 is a diagram illustrating a functional configuration of a client terminal 160 providing an image or video composition service according to a preferred embodiment of the present invention.

In more detail, FIG. 3 is characterized by providing an image or video composition service among the client terminal 160 including a wired terminal or a wireless terminal, and wirelessly equipped with a predetermined digital camera capable of capturing a subject having a monochrome background. A diagram illustrating a functional configuration of a terminal. Those skilled in the art to which the present invention pertains include a wired terminal (eg, a personal computer interoperating with a digital camera) that provides an image or video composition service based on the functional configuration of the wireless terminal illustrated in FIG. It will be easy to understand the functional configuration of the. That is, the client terminal 160 that provides the image or image composition service according to the present invention is not limited to the wireless terminal as shown in FIG. 3, and photographs a predetermined subject on a monochrome background from a predetermined digital camera. It includes all types of wired terminals or wireless terminals capable of reading a predetermined image or image, and processing the read image or image as a predetermined foreground image or foreground image and transmitting the same to the server 100.

In terms of hardware, the wireless terminal includes an external body, a speaker, a microphone, a keypad, a liquid crystal display (LCD), an antenna and a battery, and internally, a code division multiple access (CDMA) modem and a CPU. Transmit / receive signals from certain modem chips (e.g., MSM series modem chips from Qualcomm, Inc.) with built-in functions such as Central Processing Unit / Micro Processing Unit (MPU), Vocoder, etc. Separating duplexer filter, power amplifier to amplify the transmitted signal, high power amplifier (HPA), isolator to prevent the reverse of the high power transmission signal, and remove the unwanted out-of-band unwanted signal VCTCXO (Voltage Controlled Temperature Compens) for RF / IF SAW Filter, Frequency Up-Circuit in Transmit Path, Frequency Down-Conversion Circuit in Receive Path, and Reference Clock Source ated X-tal Oscillator), a UHF frequency synthesizer used as a local signal of frequency up-down conversion, and a codec chip for converting an analog voice signal into a digital signal. In addition, the modem chip is directly integrated with various functions for various multimedia services and / or additional services in addition to the core components for the mobile communication service.

The foreground image or the foreground image read from the digital camera is transmitted to the server 100 by referring to the hardware characteristics of the wireless terminal, and the foreground image or the foreground image is linked to the server 100 to the predetermined background image or Referring to the functional configuration of the wireless terminal (= wireless client terminal 160) synthesized with the background image, the control unit 300, the screen output unit 315, the key input unit 325 and the wireless terminal as shown in FIG. The image input unit 320, the wireless processor 330, the audio processor 335, the memory unit 340 for storing a predetermined background image or a background image, and the power supply for receiving predetermined image information from the provided digital camera. It consists of a battery 345.

The control unit 300 includes a processor and an execution memory including a CPU / MPU provided in the modem chip in hardware, and includes a predetermined program routine for providing functions specific to the wireless terminal from a predetermined memory device; And / or a bus for inputting and outputting program data, and a predetermined electronic circuit (or integrated circuit) provided therefor, and software-programmed from a predetermined memory element and / or chipset to the execution memory. Program routines and / or program data that are loaded and computed through the processor to perform specific functions (hence, recorded in a recording medium of the wireless terminal for predetermined image or image synthesis in conjunction with the server 100). At least one routine comprising a predetermined program is provided in the present control unit As a generic term, various functions to be implemented in the wireless terminal are realized by the controller 300, and to control and manage the overall operation of the wireless terminal in order to realize the above functions. It features. In particular, when power is input to the wireless terminal to perform a function of the control unit 300 for controlling and managing the overall operation of the wireless terminal, an operating system routine, a system management routine, and / or stored in a predetermined memory element System variables are loaded into the execution memory and computed by the processor to serve as variables for providing an operating system, system management program, and / or mobile communication service.

The screen output unit 315 is an LCD driver for screen output, which is generated through the key input unit 325 by the control unit 300 (eg, a program routine for outputting predetermined information or data to the LCD). Outputs key data, various information, signals, and / or contents (eg, text contents, image contents, and / or multimedia contents) extracted and / or generated in the course of performing a predetermined function included in the wireless terminal to the LCD. And a screen output means provided in the wireless terminal through the screen output unit 315 and the LCD.

According to a preferred embodiment of the present invention, the screen output unit 315 is a predetermined image or image read from the digital camera, and / or foreground image or foreground image to be transmitted to the server 100 from the image or image This output is preferably, and / or an intermediate image or video, and / or the foreground image, in which the background is transparently processed on the server 100 in conjunction with the interface unit 135 of the server 100. A fill image or a fill image in which the background of the foreground image is transparent, and / or a predetermined background image or background image overlapping the fill image or the fill image, and / or the fill image or fill image and the background image or background image It is preferable to output a synthesized image or a synthesized image generated by superimposing, and / or the foreground image or in conjunction with the interface unit 135 of the server 100 A user interface screen or a user interface screen for selecting a predetermined background image or a background image to be overlapped with the fill image or the fill image by processing the background of the foreground image transparently to generate a predetermined image or fill image Outputs a user interface screen for creating a predetermined composite image by superimposing an image or a fill image and a background image or a background image, or a user interface screen for adjusting heterogeneity between a background image or a background image and a fill image or a fill image in the synthesized image. It is desirable to.

The image input unit 320 reads raster based CCD image information from a digital camera including a predetermined optical unit and a charge coupled device (CCD) device in a bitmap manner, and inputs the image information to the controller 300. The input image information is output to the output unit 315.

According to the present invention, the image information input through the image input unit 320 includes both a predetermined still image and a video corresponding to a video signal composed of tens of frames at several frames per second. The technical idea of the present invention will be described using a still picture that is easy to explain. However, it will be apparent to those skilled in the art that the still picture may be replaced with a moving picture. When synthesizing the video in the server 100, the step of synchronizing the frame of the fill image and the background image in the synthesis process is further added.

The key input unit 325 may include at least one key input from a predetermined keypad including a plurality of number keys, character keys, and / or at least one function key. Read a predetermined information or signal corresponding to the data from the data (for example, from a table that stores the information or signal matching the key data) and transmits the information or signal to the control unit 300, the key Through the input unit 325 and the keypad is provided a key input means provided in the wireless terminal.

According to a preferred embodiment of the present invention, the key input unit 325 reads a predetermined foreground image or a foreground image from the digital camera through the keypad and transmits the predetermined key data required to transmit to the server 100. Preferably, the image is input to 300, whereby a predetermined image or image read out from the digital camera, and / or an image or image stored in the memory unit 340 is processed into a predetermined foreground image or foreground image. Is sent to the server 100.

In addition, the key input unit 325 generates a chroma key for generating the foreground image or the foreground image as a predetermined image or fill image in association with a user interface provided from the interface unit 135 of the server 100. Required to generate a predetermined composite image or composite image by superimposing predetermined key data and / or the fill image or fill image with a predetermined background image or background image, and / or to adjust heterogeneity of the composite image or composite image It is preferable to input the key data to the controller 300, whereby a predetermined picture or a fill image is generated from the foreground image or the foreground image transmitted to the server 100, and the fill image or the fill image is generated. A predetermined composite image or composite image is generated by overlapping a predetermined background image or background image.

According to another exemplary embodiment of the present invention, the key input function in which the key input unit 325 is interlocked with the user interface provided from the interface unit 135 of the server 100 may be performed by the server 100 in the foreground image or the foreground. A process of generating a predetermined image or a synthesized image from an image and generating a predetermined composite image or a synthesized image by overlapping the image or the image with a predetermined background image or a background image is automatically performed in a predefined order. If so, some functions may be omitted.

The voice processor 335 encodes a predetermined sound signal input from a microphone provided in the wireless terminal and provides the predetermined sound signal to the controller 300 or a predetermined sound signal extracted and / or generated by the controller 300. It is characterized in that the decoding to output through a speaker, for this purpose, the voice processing unit 335 is provided with a predetermined vocoder (Vocoder) and codec (Codec). Sound input means provided in the wireless terminal is provided through the voice processor 335 and a microphone, or sound output means provided in the wireless terminal is provided through the voice processor 335 and a speaker.

The wireless processing unit 330 may be associated with the control unit 300 (eg, a program routine for providing a mobile communication service) for location registration and / or slot mode and / or power control and / or power. And a mobile communication service including a hand-off and / or call processing procedure. The mobile base station corresponding to an end of a mobile communication network in the process of providing the mobile communication service is provided. And an RF processing function (eg, antenna control, modulation, synthesis, amplification, and / or filtering of radio frequency signals) that performs transmission and reception of radio frequency signals. In particular, the wireless processing unit 330 processes the information or the signal transmitted from the wireless terminal to the mobile base station in the CDMA stack to provide the mobile communication service, or predetermined information or information from the CDMA stack received from the mobile base station. It is characterized by providing a function for reading out a signal.

According to another exemplary embodiment of the present invention, when the client terminal 160 illustrated in FIG. 3 is a wired terminal instead of a wireless terminal, the wireless processing unit 330 may be replaced with a predetermined wired network interface.

The memory unit 340 is configured to input and output information when a predetermined program routine (or code) and / or program data (eg, a program routine (or code)) for controlling the overall operation of the wireless terminal is performed. And / or generic terms of memory devices for storing data, including read only memory (ROM), read / write flash memory (FM), and electrically erasable and programmable read only memory (EEPROM). In general, the ROM stores system information that should not be deleted, and the flash memory stores operating system routines, call processing program routines, and / or application program routines provided through the wireless terminal and information for the same or Data and the like are stored in the EEPROM. ) Or at least one information and / or data or the like to be extracted and / or generated while performing the application provided to the wireless terminal and stored.

According to a preferred embodiment of the present invention, the memory unit 340 stores at least one or more images or images read from the digital camera, and the image or image including a subject having a monochromatic background is selected from among the images or images. Used as a foreground image or a foreground image, the remaining image or image is used as a background image or a background image except for the image or image used as the foreground image or the foreground image.

Referring to FIG. 1, the wireless terminal transmits a foreground image or a foreground image stored in the memory unit 340 to the server 100 on a wireless network through the wireless processing unit. And a selection unit 310 for selecting at least one background image or background image to be superimposed on the foreground image or the foreground image through a predetermined user interface provided by the interface unit 135.

According to a preferred embodiment of the present invention, the communication unit 305 receives a predetermined user interface provided by the interface unit 135 of the server 100 through the wireless processing unit 330 and outputs it to the screen output unit. Preferably, and / or transmit predetermined key data input through the key input unit 325 to the server 100 through the wireless processing unit 330 based on the user interface.

In addition, the communication unit 305 is a digital content corresponding to the intermediate image or image, and / or predetermined fill that is changed from a predetermined foreground image or a foreground image to a predetermined image or fill image from the server 100. Digital content corresponding to an image or a fill image, and / or digital content corresponding to a predetermined background image or a background image to be superimposed with the fill image or a fill image, and / or the picture or fill image and the background image or background It is preferable to receive a composite image generated by superimposing images or digital contents corresponding to the composite image and output the synthesized image to the screen output unit 315.

Hereinafter, among the images or images read out from the digital camera included in the wireless terminal, a still image which is easy to explain the technical idea of the present invention efficiently can be transparently generated to generate a predetermined fill image, and the generated fill The technical idea of the present invention will be described through a preferred embodiment in which an image and a predetermined background image are superimposed to generate a predetermined composite image. However, the following preferred embodiments are selected to efficiently explain the technical idea of the present invention to those skilled in the art, and the technical idea of the present invention is not limited to such a political image only. . For example, when a preferred embodiment of the present invention is described using a video, the foreground image may be generated by generating a fill image from a predetermined foreground image, and generating a predetermined composite image by overlapping the fill image and the background image. The frame image may further include a function of synchronizing a frame signal between the fill image and the background image.

4 is a diagram illustrating a preferred method for generating a fill image from a foreground image through an image or image synthesis service providing system according to an exemplary embodiment of the present invention.

In more detail, Figure 4 illustrates a client terminal 160 (for example, a wireless terminal equipped with a digital camera, hereinafter referred to as a wireless terminal) according to a preferred embodiment of the present invention. A server 100 that selects and extracts a predetermined background image from a storage medium 145 on a network that stores an image, photographs a predetermined foreground image through a digital camera included in the wireless terminal, and provides an image synthesis service. By way of example, the preferred method of generating a predetermined fill image to be superimposed with the background image is shown.

Referring to FIG. 4 according to a preferred embodiment of the present invention, the wireless terminal accesses the server 100 through a wireless network (eg, wireless Internet using a mobile communication network or a wireless data communication network) to display a composite picture. A service is generated and selected for transmission to the second client terminal 165 (400).

When the collage generation and transmission service is selected through the server 100 as described above, the server 100 provides an interface screen as shown in FIG. 5 to the wireless terminal, and the wireless terminal stores the storage medium through the interface screen. A predetermined background image to be used as a background of the composite photograph is selected from at least one background image stored in 145 (405).

Referring to FIG. 5 according to a preferred embodiment of the present invention, the storage medium 145 classifies and stores at least one background image according to a predetermined classification criterion, and the server 100 transmits the information to the wireless terminal. A classification item for selecting a predetermined background image from at least one background image stored in the storage medium 145 is presented.

Referring to FIG. 5, the server 100 provides an interface screen for selecting which kind of scenery is used as a background image from a landscape picture as a classification item, and (a) of FIG. , The interface screen for selecting a street landscape photo from a city, street, lake, mountains, valleys, and seascape), and in Figure 5 (b), a country (eg, Korea, the United States, It is an interface screen for selecting the street of Japan, Permanent, France, etc. as a background image, and (C) of FIG. 5 shows which city (for example, New York, Los Angeles, Washington, Chicago, San Francisco) among the cities belonging to the country. Interface screen for selecting the street of the city to use as a background image, Figure 5 (d) is a region of the city (eg, Los Angeles Office) (E.g. City Hall, Parliament, etc.) is an interface screen for selecting whether to use the street of the front street, Beverly Hills street, Westwood street, Koreatown street, etc. as a background image, and (e) of Figure 5 is a ) Is an interface screen for selecting which street to use as a background image in the case where there are a plurality of streets of a selected region through the process of (D), and (bar) of FIG. 5 shows a series of background images as described above. The landscape is finally selected through the selection process.

According to another exemplary embodiment of the present invention, as described above, a wireless terminal accesses the server 100 through a wireless network and uses a background image to be used as a background of a composite picture among at least one background image stored in the storage medium 145. The implementation process of selecting, selects the "photo collage" menu from the menu related to the digital camera provided in the wireless terminal as shown in Figure 6 (a), and stored in the memory of the wireless terminal as shown in Figure 6 (b) Selecting a predetermined background image to be used as a background image from among a plurality of photographs, and connecting to the image synthesizing server 100 and transmitting the selected background image to the server 100 as shown in FIG. It can be done through.

In addition, according to another exemplary embodiment, the above-described process may be performed by mixing the preferred embodiment of FIG. 5 with the other embodiment of FIG. 6 (for example, first connecting to the server 100 as shown in FIG. 5, As shown in FIG. 6, a predetermined picture stored in the wireless terminal may be selected as a background picture and transmitted to the server 100).

The predetermined background image to be used as the background of the composite picture is determined by using the same method as in FIGS. 5 to 6 (for example, selecting from at least one or more background images stored in the storage medium 145, or selecting from among pictures stored in the wireless terminal). When the wireless terminal is transferred to the server 100, the wireless terminal is changed to the foreground image capturing mode as shown in (a) of FIG. 7 (415). The (a) of FIG. As shown in (b), a subject having a solid background is photographed and transmitted to the server 100 as shown in (c) of FIG. 7 (420).

When a predetermined foreground image is received through the process as shown in FIG. 7, the server 100 reads the received foreground image by using a predetermined image reading algorithm, so that the foreground image is displayed on the subject in a monochromatic background. It is determined whether it is a photographed operation (425).

For example, in most cases, the foreground image may be a portrait photograph or a still image, and thus, the subject may include a triangular structure or a long trapezoidal structure in the foreground image. Therefore, the image reading algorithm sets a predetermined image area (e.g., a pixel area of 10x10 size) as a pixel information extraction area at the upper left to the upper right of the received foreground image, and selects predetermined pixel information from the pixel information extraction area. After reading, it is determined whether the subject of the foreground image is photographed on a predetermined monochrome background by reading whether the pixel information is monochromatic or reading whether the channel value of the image region converges to a specific color gamut.

If the foreground image is not a subject photographed on a solid background (430), the server 100 requests the wireless terminal to retake and transmit the foreground image (435), and the wireless terminal responds to the request. The process 420 of capturing a predetermined foreground image and transmitting the predetermined foreground image to the server 100 through the digital camera mounted in the wireless terminal is performed again.

On the other hand, if the foreground image is a subject photographed against a solid background (430), the server 100 performs a transparent process of processing the background area of the precured image according to a pre-defined keying procedure (eg, chroma key generation procedure). A marquee is generated (440), and a predetermined fill image obtained by transparently processing the background of the foreground image is generated using the generated chroma key (445).

When a fill image having a transparent background is generated as described above, the server 100 transmits the generated fill image to the wireless terminal along with a user interface for approval of a predetermined transparent area as shown in FIG. (450).

According to a preferred embodiment of the present invention, a foreground image photographed on a solid background of a living environment is different from a foreground image photographed in a studio with a perfect lighting facility, and a chroma key generated by a keying procedure predefined in the server 100. The background area of the picture is not completely transparent only by generating the picture using the image, thereby allowing the server 100 to approve the transparent area of the picture from the wireless terminal as shown in FIG. It is preferable to transmit to the wireless terminal, including a user interface to be acquired, and the wireless terminal determines whether to use the transparent area of the picture as it is through the transparent area approval user interface.

If the transparent area of the picture is not approved (e.g., if " transparent extension " is selected in (a) of Fig. 8), then the wireless terminal receives predetermined chroma key adjustment information (e.g., Key data corresponding to “transparent extension”) is transmitted to the server 100 (460), and the server 100 transmits the chroma key according to a pre-defined keying procedure corresponding to the chroma key adjustment information. By adjusting (440) to create a fill image that further extends the transparent area of the foreground image background (445), the transparent image is expanded to the wireless terminal with a user interface for approval of a predetermined transparent area as described above The process 450 is repeated.

On the other hand, if the transparent region of the picture is approved (e.g., if "OK" is selected in (b) of Figure 8) (455), the server 100 may define a predefined boundary processing procedure (e.g., anti-aliasing and / or Or adjust the transparent boundary of the handwritten image through chroma suppression and / or alpha channel editing) and transmit it to the wireless terminal together with the transparent interface approval user interface as shown in FIG.

If the transparent border of the picture is not approved (e.g., if "boundary adjustment" is selected in Fig. 9A) (470), the wireless terminal provides predetermined transparent boundary adjustment information (e.g., Key data corresponding to “boundary adjustment”) to the server 100 (475), and the server 100 performs the transparent boundary according to a predefined boundary processing procedure corresponding to the transparent boundary adjustment information. Repeat step 465 of adjusting and transmitting to the wireless terminal.

On the other hand, if the transparent boundary of the picture is approved (for example, if "confirm" is selected in (b) of FIG. 9) (470), the server 100 is the background of the foreground image such as (b) of FIG. A predetermined fill image is processed in which the boundary is transparent (485).

FIG. 10 illustrates a preferred method of generating a composite image by superimposing a fill image and a background image through an image or image synthesis service providing system according to an exemplary embodiment of the present invention.

In more detail, in FIG. 10, a background image selected from the storage medium 145 or a background image transmitted from the wireless terminal is superimposed with a fill image generated by the process as shown in FIG. 4 through the wireless terminal. The preferred method of generating an image is shown.

Referring to FIG. 10 according to a preferred embodiment of the present invention, the server 100 extracts a predetermined background image to be superimposed on the background of a paint image generated through the process of FIG. 4 to generate a predetermined composite image. In operation 1000, the background image selected by the wireless terminal is extracted from at least one or more background images stored in the storage medium 145 through the wireless terminal, or the background image transmitted from the wireless terminal is extracted. .

When the background image is extracted as described above, the server 100 superimposes the peeled image generated through the process of FIG. 3 and the extracted background image in the manner shown in FIG. According to the heterogeneity adjustment procedure, the heterogeneity between the overlapped fill image and the background image is adjusted as described above (1010), and the overlapped image is transmitted to the wireless terminal together with the heterogeneity adjustment user interface as shown in FIG. 11 (1015). .

If the heterogeneity of the superimposed image is to be adjusted (e.g., if "Adjust" is selected in Fig. 11A) (1120), the wireless terminal provides predetermined heterogeneity adjustment information (e.g., Fig. 11A). In step 1025, the server 100 transmits key data corresponding to “adjustment” to the server 100, and the server 100 adjusts the heterogeneity of the superimposed image in response to the heterogeneity adjustment information (1010). As described above, the process of transmitting the adjusted image to the wireless terminal is repeated (1015).

On the other hand, if the heterogeneity of the superimposed images does not need to be adjusted (for example, if “OK” is selected in (b) of FIG. 11) 1120, the server 100 based on the superimposed images of which the heterogeneity is adjusted. The background image and the fill image are combined to produce a predetermined synthetic image.

When the predetermined composite image is generated as described above, the server 100 determines whether to transmit the generated composite image to the predetermined second client terminal 165 (1035). If transmitting to the client terminal 165 (for example, in the process of requesting the composition photo creation and transmission service in FIG. 4, the second client information is input from the wireless terminal (not shown) or after the composition photo is generated. If it is requested to transmit the composite picture from the wireless terminal to the predetermined second client terminal 165 as shown in 11 (c), the server 100 transmits the generated composite image to the predetermined second client terminal ( 165) (1040). For example, the process of transmitting the composite image as described above will be similar to the process of transmitting a predetermined photomail from the wireless terminal or the server 100.

According to the present invention, an image or an image shot on a monochrome background by a predetermined digital camera is stored as a foreground image or a foreground image in a predetermined client terminal, and the foreground image or the foreground image is stored in a predetermined background image or a foreground image in the client terminal. By transmitting to a server on a wired / wireless network having a function of compositing with a background image, after taking a picture on a monochrome background (eg, White Wall or Blackboard / Greenboard) in the living environment, the present invention By using the present image combining function, there is an advantage that it is possible to synthesize the photographed picture with a predetermined background (for example, a beautiful landscape) and store it.

Claims (4)

Transparently processing a part of the foreground image or the foreground image transmitted from the client terminal at the server; The server superimposes the background image selected by the client terminal and the foreground image that has transparently processed the portion to generate a predetermined composite image, or the background image selected by the client terminal and the portion are transparent. Generating a predetermined composite video by superimposing the processed foreground image; And transmitting the generated composite image or composite video from a server to the client terminal or a second client terminal designated by the client terminal. How to Provide. Receiving a foreground image or a foreground image and a background image or a background video to be superimposed on the foreground image or the foreground image from a client terminal at a server; Transparently processing a part of the received foreground image or the foreground image at a server; Superimpose the received background image on the server and the foreground image that has transparently processed the portion to generate a predetermined composite image, or the foreground that transparently processed the received background image and the portion Generating a predetermined composite video by overlapping the images; And transmitting the generated composite image or composite video from a server to the client terminal or a second client terminal designated by the client terminal. How to Provide. The method of claim 1 or 2, wherein the process of transparently processing the foreground image or a part of the foreground image comprises: Generating predetermined keying information required for predetermined keying for transparently processing the foreground image or a portion of the foreground image at a server, Keying information generated for keying the foreground image or the foreground image, A method for providing image or video information, comprising at least one of chroma key, luminance key, external key, and region division information through object unit encoding. The method of claim 1 or 2, wherein the process of transparently processing the foreground image or a part of the foreground image comprises: And receiving a predetermined key data required for transparently processing the foreground image or a portion of the foreground image from the client terminal.

Images