JP2001346172A - Image transmitter and portable terminal - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a portable terminal that can enhance the image quality and transmits an image similarly to the case with an excellent photographing state even when a photographing state is bad. SOLUTION: A camera 1 photographs an image including a face image and inputs image information, a face signal extract means 2 extracts the face image information and allows an image display means 3 to display the face image. When an image selection means 4 selects correction of the displayed face image, a correction signal generating means 6 generates a difference signal between the face image signal photographed at present from the image extract means 2 and a reference signal being a face mage signal registered in an image registration means 5, generates a correction signal of the face image signal photographed at present from the image extract means 2 on the basis of the difference signal, a signal value control means 7 controls the photographed face signal on the basis of the correction signal and gives the result to a coding means 8, the coding means 8 encodes the controlled face image signal and a transmission means 9 transmits the encoded face image signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method of detecting a signal value of a specific image such as a face portion from an image including a face image captured by a camera, for example, when encoding and transmitting an image captured by a camera. Further, the present invention relates to an image transmission apparatus that feeds back information extracted from a detected signal value to a camera or the like and controls the signal value to be appropriate. A suitable field is a mobile terminal device such as a mobile phone equipped with a moving image input device such as a camera.

[0002]

2. Description of the Related Art When a mobile communication device such as a mobile phone is equipped with a camera for shooting, the image quality may deteriorate under conditions that are not suitable for shooting, such as backlight, nighttime, lack of light in a room, or the like. is there. Therefore, it is necessary to improve the quality of the transmitted image by correcting and encoding the signal of the captured image. In particular, in the field of mobile communication, image transmission is often performed in real time, and in particular, it is necessary to improve the image quality of a specific image such as a face image before transmission.

Here, there is an invention disclosed in Japanese Patent Laid-Open No. 44670/1992 as an example of a conventional technique for detecting a face area of a person in an image and performing image processing intensively on the area to improve the image quality. In the invention described in Japanese Patent Application Laid-Open No. Hei 4-44670, it is described that, when extracting a face region, skin color extraction that is not easily affected by differences in lighting conditions, race, and skin color is performed.

[0004] Incidentally, with reference to the photographed negative film,
Japanese Patent Application Laid-Open No. H11-328359 discloses an invention in which a face area is extracted and a desired flesh color image is reproduced.

[0005]

However, in the prior art described in Japanese Patent Application Laid-Open No. Hei 4-44670, the face image area is extracted only from the image currently being photographed. Also, there is a problem that the image quality deteriorates under conditions that are not suitable for photographing, such as insufficient light amount at night or indoors.

Accordingly, an object of the present invention is to provide an image transmission device and a portable terminal device capable of transmitting an image with improved image quality even when the shooting condition is poor, as in the case of the good shooting condition. I do.

[0007]

According to the present invention, there is provided an image transmitting apparatus for encoding and transmitting image information from a camera, comprising: an image extracting unit for extracting a specific image from the image information; Image registration means for registering a specific image extracted by the extraction means, and correction signal generation means for generating a correction signal from the specific image extracted by the image extraction means and the specific image registered in the image registration means And control means for controlling image information from the camera based on the correction signal generated by the correction signal generation means.

Further, the image processing apparatus further comprises an image selecting means for selecting whether to transmit an image controlled based on the correction signal or to transmit an image without correction.

The specific image is a face image included in image information from the camera.

[0010] Further, there is provided an extraction area designating means for designating an area for extracting a face image from an image including the face image.

Further, the present invention is a portable terminal device having the above-described image transmission device.

[0012]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiment 1 Hereinafter, Embodiment 1 of the image transmission device according to the present invention will be described. This image transmission device is particularly suitable for a portable terminal device that can transmit not only audio but also images. FIG. 1 is a configuration diagram showing Embodiment 1 of the present invention. In FIG. 1, reference numeral 1 denotes a camera that captures an image including a face image and outputs image information, such as a video camera using a CCD (Charge Coupled Device), a digital camera, or a CCD. Reference numeral 2 denotes an image extracting unit for detecting, for example, a face image region as a specific image from image information captured by the camera 1 and extracting face image information. Reference numeral 3 denotes an image captured by the camera 1 or extracted by the image extracting unit 2. An image display means for displaying a displayed face image, such as a liquid crystal or a liquid crystal touch panel.
Reference numeral 4 denotes an image selection means for selecting whether to encode and transmit the corrected image or to encode and transmit the image input from the camera 1 without correction. Reference numeral 5 denotes an image registration unit for selecting and registering a reference face image from the face images displayed on the image display unit 3. 6 is a correction signal generation means for generating a difference signal from the face image signal extracted by the image extraction means 2 and the face image signal registered in the image registration means 5, and generating a correction signal based on the generated difference signal;
Reference numeral 7 denotes signal value control means for inputting image information output from the camera 1 and controlling signal values constituting image information by the correction signal generated by the correction signal generation means 6, and 8 denotes an image including a face image to be transmitted. Encoding means for encoding, 9 is encoding means 8
Is a transmission means for transmitting the information coded in. It should be noted that the present apparatus does not have the camera 1, and the camera 1 may be connected to the present apparatus for use.

Next, the operation will be described with reference to a flowchart. FIG. 2 is a flowchart showing the operation of the first embodiment of the present invention. First, in the first embodiment, as shown in the figure, an image including a face image is photographed by the camera 1 in S1, and image information is input. In S2, the face signal extracting means 2 extracts face image information as a specific image from the image information input in S1. Here, the extraction method of the face image includes
A well-known technique using a flesh color hue is applied. S
At 3, a face image is displayed on the image display means 3 from the face image signal extracted at S2.

In the first embodiment, it is necessary to previously register an image in the image registration means 5 when the photographing state is good, for example, when the light amount is sufficient. This registration process is performed by the above-described S
The same operation as in steps 1 to 3 is performed to extract a face image from the captured image as a specific image, display one or more face images on the image display means 3, and press the registration button (not shown) by the user. Thus, the face image photographed when the photographing state is good is registered. The number of face images to be registered may be one or more.

Next, in the present apparatus, in S4, the image selecting means 4 selects whether to transmit or correct the face image displayed in S3. As a selection method, when the image selection unit 4 is configured by a selection button or the like, the selection button may be pressed, or when the image selection unit 4 is configured by a liquid crystal touch panel or the like on the image display unit 3, the image display is performed. An icon or the like representing a selection button is displayed on the means 3, and the selection is made by operating the icon.

Here, when the user selects the transmission of the currently displayed image as it is via the image selection means 4, the selection command is input to the correction signal generation means 6 and the like, and the correction signal generation means 6 does not generate a correction signal, and the signal value control means 7 does not control the signal value of the image signal from the camera 1 based on the correction signal from the correction signal generation means 6.
Here, it has been described that the user operates the image selection unit 4 to select whether the face image is transmitted after being corrected or transmitted without correction. However, the present invention is not limited to this. 4 detects the light amount and compares it with a predetermined threshold value to determine whether or not the current shooting condition is suitable for the shooting condition. A comparison may be made to automatically determine whether to correct the face image.

As a result, the process proceeds to S7, where the encoding means 8 encodes the face image. Regarding the encoding method used in the encoding means 8, MPEG (Moving Picture E) is used.
xparts Group) -4. Further, in the image transmission apparatus according to the first embodiment, it is desirable to use a luminance signal and a color difference signal in consideration of an encoding method as a signal as information of a face image. Although not shown, the start of encoding in the encoding unit 8 is determined by the overall control circuit to transmit the currently displayed image, and the image information output from the camera 1 to the signal value control unit 7 is corrected. The encoding is input to the encoding means 8 to start encoding. The encoded information is S
The transmission means 9 transmits the data to the communication partner 8.

On the other hand, a face image is displayed on the image display means 3 in S3 under the condition that the current photographing condition is not suitable for photographing such as backlighting, nighttime, lack of light in the room, etc. If you determine that the image quality has deteriorated,
In S4, the user operates the image selecting means 4 or the like to select a case where the face image is corrected and transmitted. In this case, the selection may be made automatically as described above.

Then, the selection command is input from the image selecting means 4 to the correction signal generating means 6 and the like, and the process proceeds to S5, where the correction signal generating means 6 converts the face image signal ( Hereinafter, referred to as a reference signal), and in S6, the correction signal generation unit 6 determines the currently captured face image signal from the image extraction unit 2 and the face image signal registered in the image registration unit 5. A difference signal from the reference signal is generated, and a correction signal of the currently captured face image signal from the image extraction unit 2 is generated based on the difference signal, and output to the signal value control unit 7. The signal value control means 7 controls the signal value of the image information output from the camera 1 to the encoding means 8 based on the correction signal.

Here, the signal value control of the image information based on the correction signal from the correction signal generation means 6 by the signal value control means 7 will be described. In the first embodiment, assuming that the camera 1 to be controlled by the signal value control means 7 is, for example, a video camera (digital camera), the video camera (digital camera) generally has an amount of light, a color temperature, and a focus. There is a function for optimizing etc. For example, CC
AI (Auto Iris) function to optimize the light entering D, electronic shutter operation control function, AF (Auto Foris) to adjust the focus position
cus) function and AWB (Auto White Balance) function. These functions process digital signals obtained by A / D (Analog / Digital) conversion of video signals input from a CCD, and feed back the processing results to various mechanisms inside the camera to perform control. Therefore, the first embodiment
In the following, it is assumed that the camera 1 is a video camera (digital camera) having the above-described functions, and the signal value control unit 7 of the first embodiment converts the correction signal into a signal value immediately after A / D conversion. The signal value is controlled by, for example, addition. In this case, since it is a feedback circuit, signal control is performed so that the circuit does not oscillate.

In a portable telephone or the like, which is a preferred application field of the image transmission apparatus according to the present invention, the camera 1 is not equipped with a video camera having the above functions, and
It may be possible to equip only CCD. In this case, it is necessary to separately provide a circuit for controlling an input signal from the CCD. For example, if the signal value control means 7 is provided, it is functionally equivalent to the control of the video camera described above. Therefore, a well-known technique may be applied to control around the camera, and basically, the signal value control means 7 may control the digital signal after A / D conversion.

Therefore, according to the first embodiment, a case where a face image shot when the shooting condition is good is registered in advance in the image registration means 5, and a new image including the face image is shot and transmitted. In the case where the photographing condition is poor, the photographing is performed when the photographing condition is good, and the image including the face image is transmitted after being corrected using the face image registered in the image registration means 5. Even when the situation is bad, the same image as when the shooting situation is good can be transmitted.

Embodiment 2 FIG . FIG. 3 shows one of the second embodiments.
It is a block diagram showing an example. In the figure, steps 1 to 9 are completely the same as those in the first embodiment, and the description thereof is omitted. Reference numeral 10 denotes a case where the user designates an area where the face image is displayed in the image displayed on the image display means 3 in order to facilitate the extraction when the image extracting means 2 extracts the face image. Extract the image data of the area
An area designating unit for outputting to the image extracting unit 2.

FIG. 4 is a flowchart showing the operation of the second embodiment. In the figure, in S21, an image including a face image is captured by the camera 1 and image information is input. S22
Then, the image input from the camera 1 is displayed on the image display means 3. The image display means 3 is a liquid crystal touch panel. S
In 23, the area of the face image in the image displayed on the image display means 3 in S22 is designated by, for example, a fingertip. The designation method is a rectangle including a face image or a closed curve. S2
In 4, the area specifying means 10 recognizes the area specified in S23 and cuts out image data in the area. In S25, the image extracting means 2 extracts a face image from the cut-out image in which the area is specified by the area specifying means 10 in S24.

Therefore, according to the second embodiment, a user can arbitrarily designate a face image area and extract a face image.

Therefore, according to the second embodiment, the user specifies the face image area arbitrarily by the extraction area specifying means 10, and the image extracting means 2 extracts the face image. If there is no specific image extraction function such as a face image, or if you want to extract only an arbitrary specific image such as a part of a face image even if it does, The image can be corrected based on the image and transmitted.

In the description of the first and second embodiments, it has been described that the image extracting means extracts a face image as a specific image. However, in the present invention, the present invention is not limited to this. Of course, a specific object other than the face image may be used.

[0028]

As described above, according to the present invention, when a specific image is extracted from image information captured by a camera, the extracted specific image is registered, and a new image is captured by the camera. Since a correction signal is generated from a specific image extracted at the time of shooting and a registered specific image, and image information from the camera is controlled based on the correction signal, for example, If the shooting situation is bad, by registering a specific image taken when the shooting condition is good, and correcting using the registered face image,
Even when the shooting condition is poor, the same image as when the shooting condition is good can be transmitted.

Further, since it is possible to select whether to transmit an image controlled based on a correction signal or to transmit an image without correction, a corrected image can be transmitted by a user's selection.

In particular, when a specific image to be extracted is a face image taken by a camera, a face image taken when the shooting condition is good is registered. By correcting the image to be transmitted based on the registered face image, an image similar to the face image in a good shooting condition can be transmitted.

Further, since the area for extracting the face image from the image including the face image is specified, the face image can be easily extracted.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an image transmission device according to a first embodiment of the present invention.

FIG. 2 is a flowchart showing an operation of the first embodiment of the present invention.

FIG. 3 is a configuration diagram of an image transmission device according to a second embodiment of the present invention.

FIG. 4 is a flowchart showing an operation according to the second embodiment of the present invention.

[Description of Signs] 1 Camera 2 Image extraction means 3 Image display means 4 Image selection means 5 Image registration means 6 Correction signal generation means 7 Signal value control means 8 Encoding means 9 Transmission means 10 Extraction area designation means

Continued on the front page F term (reference) 5B057 BA02 BA11 CA01 CA08 CA12 CA16 CB01 CB08 CB12 CB16 CC01 CE09 CE17 CH11 DB02 DB06 DB09 DC33 5C022 AA11 AB68 AC69 CA00 5C064 AA01 AA04 AC02 AC08 AC12 AD02 AD08

Claims (5)

[Claims] 1. An image transmitting apparatus for encoding and transmitting image information from a camera, comprising: an image extracting unit for extracting a specific image from the image information; and an image for registering the specific image extracted by the image extracting unit. Registration means, correction signal generation means for generating a correction signal from the specific image extracted by the image extraction means and the specific image registered in the image registration means, and a correction signal generated by the correction signal generation means Control means for controlling image information from the camera based on the image data. 2. The image according to claim 1, further comprising an image selection unit for selecting whether to transmit an image controlled based on the correction signal or to transmit an image without correction. Transmission equipment. 3. The image transmission device according to claim 1, wherein the specific image is a face image included in image information from the camera. 4. The image transmission apparatus according to claim 3, further comprising an extraction area specifying unit that specifies an area for extracting a face image from an image including the face image. 5. A portable terminal device comprising the image transmission device according to claim 1.