KR200410855Y1 - Camera or mobile terminal with camera module synthesizing the images - Google Patents

Abstract

The present invention provides a lens unit 12, a conversion output unit 14 for converting and outputting an object image optical signal passing through the lens unit 12 into an electrical image pickup signal, and a gain for gain-adjusting the image output image signal. An adjusting unit 16, a converting unit 18 for converting the gain-adjusted signal into a digital signal, an image signal processing unit 20 for outputting the converted digital signal, and an image compression unit for compressing the output digital signal ( 22), a first memory unit 24 for storing the image image compressed by the image compression unit 22, and a third memory unit 28 for temporarily storing the image signal output from the image signal processing unit 20. And a fourth memory unit 60 in which a background image is stored, a second memory unit 26 in which a program operated under the control of the controller 30 is embedded, and a display unit 90 in which the images are displayed. ,

When taking a picture, when selecting a background image stored in the fourth memory unit 60, a specific color portion of the background image is copied to a subject image and displayed on the display unit 90. Regarding the mobile device 1 with a built-in camera,

It is not limited to the area of the image to be synthesized, and the images are combined while overlapping each other, so that they can be composed into various types of images, and all extended vector graphic images can be selected as a background image and synthesized with the captured image. It is not limited to the colors that make up the extended vector graphic image stored in the PC, and it can be combined with the captured image even if it is downloaded and selected as the background image.

Camera, mobile, image, compositing, scaling vector graphics

Description

Camera or mobile terminal with camera module synthesizing the images}

1 is a block diagram of a camera or a mobile device with a built-in camera for synthesizing and storing a captured image according to a preferred embodiment of the present invention.

 2 is a control flowchart of capturing and storing an image in a camera or a mobile device in which a camera is synthesized and synthesized and stored according to an exemplary embodiment of the present invention.

 3 is a detailed control flowchart illustrating a process of overlapping a background image and a captured subject image on a display unit in the control flowchart of FIG. 2.

 4 is a detailed control flowchart of converting a position of a background image according to a background image in the control flowchart of FIG. 2.

 FIG. 5 is a flowchart illustrating steps included in a camera or a mobile device in which the camera is embedded in order to overlap and display a background image and a captured image according to the present invention.

 6 shows an example of a background image.

 7 shows an example of a subject image to be captured.

 8 illustrates an example of a background image and a subject image overlapped and displayed on the display unit.

 9 shows an example of an image obtained by combining a photographed subject image and a background image.

 * Description of the major signs in the drawings

1: Camera or mobile device with built-in camera 12: Lens unit

20: video signal processor 56: interface unit

86: selection unit 90: display unit

The present invention relates to a camera or a mobile device having a built-in camera for synthesizing a captured image, and more specifically, a built-in camera or a camera capable of generating and storing a synthesized image by combining a background image and a photographed subject image. To a mobile device.

 Cameras and mobile phones with built-in cameras capture a subject and store the captured subject image file, play back the stored image, use it as a display screen on the display unit, or, if equipped with an interface unit or a wireless communication unit, use a PC or other mobile phones. Had the ability to transfer to.

 In addition, a certain camera and a mobile phone with a built-in camera may set an image stored in advance in a storage unit, an image downloaded by connecting to a PC through an interface unit, or an image downloaded by wireless connection with an external server through an RF unit as a wallpaper on a display unit, and may be captured. The display unit is displayed on the display unit together with the subject and stored as an image having various background screens. The image capturing and storing method having the background screen as described above is disclosed in Patent 2002-36288.

 However, in the image capturing and storing method as described above, when a user selects an image to be used as a background screen in a camera or a mobile phone having a camera, the background image selected on the display unit is displayed and the image of the selected background image can be entered. The present invention relates to a method of displaying a subject image currently captured in a captured image area. That is, the area in which the subject image captured by the camera can be input is limited among the selected background image areas. Therefore, since the background image area and the captured subject image have overlapping boundaries, the area displaying the captured subject image is limited, and there is a problem that various images cannot be generated and stored by overlapping the background image over the subject image. .

The present invention is to solve the above problems, the camera or a camera having an image synthesizing means capable of generating and storing various types of image files by combining the background image and the subject image while overlapping the background image on the subject image to be captured The purpose is to provide a built-in mobile device.

In order to achieve the above object, a camera or a mobile device having a built-in camera for synthesizing a photographed image according to the present invention includes a lens unit, a conversion output unit for converting and outputting a subject image light signal passing through the lens unit into an electrical image signal; A gain control unit for gain-adjusting the converted output image signal, a conversion unit for converting the gain-adjusted signal into a digital signal, an image signal processing unit for outputting the converted digital signal, and an image for compressing the output digital signal A compression unit, a first memory unit for storing the image image compressed by the image compression unit, a third memory unit for temporarily storing the image signal output from the image signal processing unit, a fourth memory unit for storing the background image, And a second memory unit in which a program operating under the control of the controller is embedded, and a display unit in which the images are displayed. If perishable when selecting the background image stored in the fourth memory portion particular color portion of the background image is a feature that is copied to the subject image displayed on the display unit.

The camera or the mobile device in which the camera is embedded further includes an RF unit or an interface unit. When downloading an image stored in an external server or a PC through the RF unit or the interface unit and storing the image in the fourth memory unit, a specific color of the image is specified. It is characterized by changing to save as,

The image downloaded through the RF unit or the interface unit and stored in the fourth memory unit is an extended vector graphic image, and the background of the extended vector graphic image is changed to a specific color and stored.

The extended vector graphic image, which is copied to the subject image to be photographed and displayed on the display unit, copies the SVG element of the background image, and uses the captured and stored subject image as the background image. Assigning an enable-background field value to new, adding an image element so that the image can be accessed by referring to a stored and captured subject image; By copying the remaining portion, it is synthesized with the captured image and stored in the first memory unit.

delete

 Hereinafter, a preferred embodiment of a camera or a mobile device with a built-in camera for synthesizing and storing a captured image according to the present invention will be described in detail with reference to the accompanying drawings. In the detailed description, the same name is used for a configuration having the same function as the prior art.

 1 is a block diagram illustrating a camera or a mobile device with a built-in camera according to a preferred embodiment of the present invention, Figure 6 is a display unit 90 of the camera or a mobile device with built-in camera according to a preferred embodiment of the present invention 7 shows a subject image 500 displayed on the display unit 90, and FIG. 8 shows a specific color portion of the background image 300. The background image 300 is copied and displayed on the display unit 90.

 As shown in FIG. 1, a camera or a mobile device incorporating a camera according to an exemplary embodiment of the present invention includes a function of capturing an image of a subject, a function of transmitting and receiving an external device, and a function of displaying an image. .

With reference to the contents described in the patent 2002-36288 will be described the specific configuration and operation of the camera or a mobile device with a built-in camera according to a preferred embodiment of the present invention as follows.

 The subject image is applied to the conversion output unit 14 through the lens unit 12, and the subject image optical signal passed through the lens unit 12 by the conversion output unit 14 is an electrical image pickup signal. The converted output image is then subjected to correlation double sampling and gain adjustment by a gain adjusting unit 16 (Correlated Double Sampling / Auto Gain Control). The gain-adjusted signal is applied to a converter 18 (Analog to Digital Converter (ADC)), converted into a digital signal, and output by the image signal processor 20 (Digital Signal Processor). The image signal processing unit 20 processes the captured image signal converted into a digital signal into an image signal, and processes the image signal to the image compression unit 22 (Joint Picture Expert Group (JPEG) compression unit) under the control of the control unit 30. Or the display unit 90 (LCD) to the selection unit 86 for display on the screen.

 The image signal may be NTSC (National Television System Committee) or PAL (Phase Alternation by Line), and the conversion output unit and the gain control unit may also be implemented as a CMOS metal (Complementary Metal Oxide Semiconductor Sensor) chip. In addition, the image signal processor 20 may store the image signal in the first memory unit 24 through the image compressor 22.

 When the camera function of the camera or the mobile device in which the camera is embedded is 'on', the image signal output from the image signal processor 20 is temporarily stored in the third memory unit 28 through the controller 30, and then the controller ( 30) and is displayed on the display unit 90 via a path of the video signal processing unit 20 and the selection unit 86. On the other hand, the background image stored in the fourth memory 60 desired as the background image through the key input unit 58 by the control unit 30, the OSD (82, On Screen Display), the encoder 84, the selection unit 86 It may be displayed on the display unit 90 via a path. In the fourth memory 60 in which the background image is stored, an image stored in a specific server or an image stored in a PC is downloaded through an RF unit 52 or an interface unit 56 and added as a background image. It is possible to do The second memory unit 26 is an area in which a program is stored.

 FIG. 6 is an extended vector graphic image format consisting of a background 310 and an object 330 represented by a vector image method on the background 310 as an example of the background image 300 stored in the fourth memory unit 60. 7 illustrates a background image 300 of FIG. 7, which is output from the image signal processing unit 20 and temporarily stored in the third memory unit 28 through the control unit 30, and then the control unit 30 and the image signal processing unit ( 20 shows the subject image 500 displayed on the display unit 90 via the path of the selector 86.

 When the camera is 'on' or the camera function of the camera moving device is 'on' and the background image 300 stored in the fourth memory unit 60 is selected through the key input unit 58, the background image 300 and the subject image are selected. 500 is overlapped in the display unit 90, and the controller 30 analyzes the color information of the background image 300 to copy a specific color portion of the background image 300 to a subject image to be displayed on the display unit 90. The selector 86 is controlled.

 In the background image 300 in the extended vector graphic image format shown in FIG. 6, the background 310 is a predetermined specific color (eg, RGB (255, 0, 0)) portion and the object 330 is not a specific color. Referring to FIG. 8, the background 310 of the background image 300 is copied and displayed as a subject image, and the object 330 is displayed on the display unit without being copied as a subject image. It is.

As shown in FIG. 8, when the shutter 310 for performing an image capturing command is input on the display unit 90 while the background 310 copied to the subject image 500 and the object 330 are displayed, the image compression unit 22 is input. Converts an image signal, which is a subject image 500 provided by the image, into a JPEG format, compresses the image signal at a predetermined ratio, and stores the image signal in the first memory unit 22. The stored subject image is decompressed again and displayed on the display unit 90. Can be.

 On the other hand, while the image signal converted to JPEG format is stored in the first memory unit 24, the SV element is copied from the background image 300 in the extended vector graphic image format, and the SV To use the subject image as a background image under the element, specify the value of the enable-background field as new, add an image element so that it can be accessed by referring to the subject image. The remaining part of the background image 300 is copied, and the composite image 700 of the new extended vector graphic image format is stored in the first memory unit 24. 9 shows a composite image 700 in the extended vector graphical image format.

 By setting the enable-background field value to new, the subject image is positioned between the background and the object of the extended vector graphic image set as the background image, so as to be synthesized as shown in FIG. After this completion, the synthesized image becomes an extended vector graphic image in which objects overlap on the subject image.

 Referring to the above image synthesis process with reference to the flow chart as follows.

FIG. 2 is a flowchart illustrating a process of generating and storing a composite image according to an exemplary embodiment of the present invention, and FIG. 3 illustrates in detail a process of displaying a background image copied from a background image and a subject image in FIG. 2 on a display unit. FIG. 4 is a detailed flowchart illustrating a process of moving an object when the background image is an extended vector graphic icon image format in FIG. 2, and FIG. 5 is a process of downloading and storing from an external server. A flowchart illustrating the process of changing an extended vector graphic image.

 As shown in FIG. 2, when the camera is in the 'on' state or the camera module of the mobile device in which the camera is embedded is in the 'on' state (S110), when the background image selection command is input through the key input unit 58 Under the control of the controller 30, the background image stored in the fourth memory 60 is displayed in the fourth memory unit 60, the controller 30, the OSD 82, the encoder 84, and the selector 86. The captured subject image, which is displayed on the display unit 90 via a path of the image signal output by the image signal processing unit 20 stored in the third memory unit 28 under the control of the controller 30, is controlled by the controller ( 30), the image signal processor 20 and the selection unit 86 is transmitted. On the other hand, if there is no background image selection, the operation proceeds to the general camera operation mode (S125) and performs the operation in the general camera mode.

 When a part of the background image in the background image matches a predetermined specific color (for example, RGB (255, 0, 0)), the specific color portion is copied to the captured subject image (S130) and displayed on the display unit. (S140). For example, if the preset color is red (RGB (255, 0, 0)), the background image part of red (RGB (255, 0, 0)) is copied to the subject image of the corresponding part and Is displayed.

 When the background image is an image in the extended vector graphic image format, when the background is a predetermined color (for example, RGB (255, 0, 0)) and the object is not a specific color, the background is copied to the subject image and displayed. Since the object is displayed on the background copied from the subject image, the display unit displays an image such that an object of the background image overlaps the subject image.

In the above, when the background image 300 does not have a predetermined portion of a predetermined color (for example, RGB (255, 0, 0)), the background image is not copied to the subject image. The image cannot be confirmed.

 For example, when the background image 300 is an image in the extended vector graphic image format,

First, when the background 310 and the object 330 of the background image 300 are not all preset colors, the background 310 and the object 330 are not copied to the subject image. Cannot be verified,

 Second, when the background 310 and the object 330 of the background image 300 are both preset colors, the background 310 and the object 330 are both copied to the subject image so that the subject image can be checked from the display unit 90. However, the background image 300 may not be confirmed.

 The above problem may occur in the background image pre-stored in the fourth storage unit 60, but is very likely to occur in the image to be used as the background image downloaded from the external server or the PC.

 Therefore, a camera or a mobile device 1 in which a camera is synthesized and stored in accordance with the present invention may be used when the image file is downloaded through the interface unit 56 or the RF unit 52 which transmits and receives wirelessly. Changing specific parts to specific colors,

 Alternatively, the method may further include changing a specific portion of the image to a specific color when displaying the image stored in the fourth storage unit 60 on the display unit 90 to use as a background image.

 In the above, when the background image is an extended vector graphic image, it is preferable that a specific part that changes to a specific color is based on the extended vector graphic image.

On the other hand, if the object is a specific color, it is preferable to further include the step of changing to a non-specific color.

 3 and 5, the method for selecting a background image as shown in FIG. 3 in the camera 1 or the mobile device 1 in which the camera is built according to the present invention is described in detail. ) And determining whether the background of the background image is a specific color between step 130 of copying a specific color portion of the background image to the captured subject image (S122), and if the background of the background image is not a specific color, Changing to a color (S124), that is, changing the background of the background image to a predetermined color (for example, red (RGB (255, 0, 0))) and all or part of the background image object Determining whether or not the index (S126), and if all or part of the object of the background image is a specific color step (S128), that is, all or part of the object of the background image is preset color( For example, if it is red (RGB (255, 0, 0)), all or part of the color may be a color other than a specific color closest to a specific color (for example, RGB (255, 1, 0) or RGB (255, 0). , 1))

 As shown in FIG. 5, in the process of downloading and storing the extended vector graphic image, downloading the extended vector graphic image stored in an external server or a PC through the RF unit 52 or the interface unit 56 ( S210 and determining whether the background of the extended vector graphic image selected as the background image is a specific color (S220) and changing to a specific color if it is not a specific color (for example, RGB (255, 0, 0)). In operation S230, it is determined whether the object of the extended vector graphic image is a specific color (S240), and the color most similar to the specific color (for example, RGB) is the specific color (for example, RGB (255, 0, 0)). Changing to (255, 1, 0) or RGB (255, 0, 1), and storing the expanded vector graphic image in the fourth memory unit 60 (S260). It is preferable to provide.

 In the case of including the above steps (S122, S124, S126, S128), even if the extended vector graphic image stored in the PC connected to the external server or the interface unit is downloaded and selected as the background image, the captured subject image is It is not displayed on the display unit, or the entire background image is copied to the subject image to prevent the problem of being displayed on the display unit.

 The camera having the above steps (S220, S230, S240, S250) or the mobile device 1 with the built-in camera may download any extended vector graphic image stored in a PC connected to an external server or interface unit and photograph the subject. It is possible to composite with the image.

 4 is a detailed diagram illustrating a process including moving the object when the extended vector graphic image selected as the background image is an extended vector graphic icon image capable of moving an object, as shown in FIG. If the image selected as the background image is an extended vector graphic icon image, the control key 58a shown in FIG. 1 is displayed between the step S140 of displaying the background image and the captured subject image and the step S150 of inputting the shutter key. It is possible to move (S144) the object in the background image displayed on the display unit 90 by using the user can move the object to the desired portion of the display unit 90. In more detail, when the background image and the subject image to be captured are displayed on the display unit 90 in step S140, when the left and right moving keys (not shown) of the control keys 58a are input, the control unit 30 inputs the input images. The signal is transmitted to the background image displayed on the display unit 90 to newly set the relative coordinates of the object with respect to the background among the background images so that the object moves on the display unit 90.

 Referring to FIG. 2 again, when the user inputs the shutter key in step S140 in which the background image and the captured subject image are displayed on the display unit 90 (S150), the image signal processor 20 shown in FIG. ) Is temporarily stored in the third memory unit 28, and converts an image signal, which is a subject image displayed on the display unit 90, into a JPEG format, compresses it to a predetermined ratio, and stores it in the first memory unit 24 (S160). ).

The controller 30 copies the SV element of the extended vector graphic image used as the background image and is stored in the first memory unit 24 under the copied SV element. Set the enable-background field value to new to use the subject image file as the background image, and add an image element to access the subject image with reference. The first memory unit 24 stores the data in the first memory unit 24 (S170).

 In FIG. 2, reference numeral 58a illustrates a control key such as up, down, left, and right keys, and 58b illustrates a numeric character input key to be input when a character or a number is displayed on the display unit 90. In the above description, a mobile device having a built-in camera includes a mobile phone having a camera having a camera function, an MP3 having a camera, and the like.

Although the present invention has been described in detail with reference to the embodiments, the protection scope of the present invention is not limited thereto and modifications to the extent that a person having ordinary knowledge in the technical field to which the present invention belongs can easily perform the modification of the present invention. It should be interpreted as being within the scope of protection.

The camera or the mobile device in which the camera is built according to the preferred embodiment of the present invention is synthesized and stored in the form of overlapping images without being limited to the area of the synthesized image. By changing the background of the extended vector graphic image and the color of the object, all extended vector graphic images can be selected as the background image and composited with the captured image. In addition, the extended vector graphic image can be used as the background image stored on the server or PC. Changing the background of the extended vector graphic image to a specific color between downloading and copying the extended vector graphic image, and changing and saving the specific index object to the color most similar to the specific color (S220, S230, S240, S250, Expanded vector graph produced externally by having S260) The image of the object and the background even if there is an effect that is displayed in any color that can be synthesized with the subject image selected by the image pickup, the extension vector graphics image as a background image.

Claims (5)

A lens unit 12, a conversion output unit 14 for converting and outputting a subject image optical signal passing through the lens unit 12 into an electrical image pickup signal, and a gain adjusting unit for gain control of the image output image signal which has been output. 16, a converter 18 for converting the gain-adjusted signal into a digital signal, an image signal processor 20 for outputting the converted digital signal, an image compressor 22 for compressing the output digital signal, and The first memory unit 24 stores the image image compressed by the image compression unit 22, the third memory unit 28 temporarily storing the image signal output from the image signal processing unit 20, and the background. A fourth memory unit 60 in which an image is stored, a second memory unit 26 in which a program operating under the control of the controller 30 is embedded, and a display unit 90 in which the images are displayed, When taking a picture, when selecting a background image stored in the fourth memory unit 60, a specific color portion of the background image is copied to a subject image and displayed on the display unit 90. Mobile device with built-in camera (1). The apparatus of claim 1, wherein the camera or the mobile device in which the camera is embedded further includes an RF unit 52 or an interface unit 56, and is connected to an external server or a PC through the RF unit 52 or the interface unit 56. When the stored image is downloaded and stored in the fourth memory unit 60, a camera or a mobile device with a built-in camera for synthesizing the captured image, characterized in that for changing and storing a specific part of the image to a specific color (1). ). The image of claim 2, wherein the image downloaded through the RF unit 52 or the interface unit 56 and stored in the fourth memory unit 60 is an extended vector graphic image, and the background of the extended vector graphic image is a specific color. A camera or a mobile device with a built-in camera for synthesizing a captured image, characterized by converting and storing. The extended vector graphic image of claim 3, wherein the background is copied to a subject image to be photographed and displayed on the display unit 90, the subject image to be captured and stored as an SVG element of a background image. Copying, setting the enable-background field value to new to use the subject image as a background image, adding an image element for access by referring to the subject image, A mobile device (1) having a camera or a camera for synthesizing the captured image, characterized in that it is stored in the first memory unit (21) by combining with the captured image by copying the rest of the background image down. delete

Images