JP5724534B2 - Information processing apparatus and program - Google Patents

Description

  The present invention relates to an information processing apparatus and a program.

  2. Description of the Related Art In recent years, mobile phone terminals with cameras have become widespread as an example of information processing apparatuses including a photography function. In this mobile phone terminal, it is possible to take a picture of a face image of a person (sometimes referred to as a person) or an image that does not include a face image such as a landscape or an object with a built-in camera. The mobile phone terminal also has a voice communication (call) function and an e-mail transmission / reception function.

  Since it is known in the patent literature that the human skin color depends on the melanin content and the hemoglobin content, the human skin color included in the photographed image is obtained by a simple calculation based on the melanin component amount and the hemoglobin component amount. There is a proposal for a skin color correction technique for correcting the skin tone.

JP 2006-41804 A

  By using the skin color correction technology described above, the skin color of the face image photographed with the camera-equipped mobile phone terminal is changed, and a whitening effect is added to the skin color or a facial treatment is performed to remove stains from the face. It is possible to correct the skin beautifully (skin correction).

  In addition, by specifying the face of the registered communication target person in the phone book or address book stored in the camera-equipped mobile phone terminal, only the face image of the communication target person identified by the face recognition technology is corrected. It becomes possible to do.

  However, for example, when an e-mail is sent (distributed or broadcast) to a plurality of communication target persons with a group photo attached, a face image that is not subjected to skin correction is inferior to a face image that is subjected to skin correction. Therefore, it is inevitable that the photograph will be unnatural for a person with a facial image that is not subjected to skin correction.

  The challenge is to provide a technology that enables emails to be sent to at least two communication recipients by limiting the photos containing the face-corrected images to the corresponding recipients when sending emails with attached photos. There is to do.

  In order to solve the above problems, an information processing apparatus includes an image recording unit that records an image and additional information of the image in association with each other, a transmission unit, and a processor. The processor of the information processing apparatus includes a transmission destination identifier of an electronic mail to be transmitted, a correction target person identifier included in additional information recorded in the image recording unit in association with an image attached to the electronic mail, If the transmission destination identifier matches the correction target person identifier, the e-mail attached with the image is transmitted to the transmission unit, and the transmission destination identifier does not match the correction target person identifier. In this case, an e-mail attached with the pre-correction image restored from the image based on the correction information included in the additional information is transmitted to the transmission unit.

  According to the disclosed information processing apparatus, when an e-mail attached with a photo is transmitted to a communication target person, the photo including the image subjected to face correction is transmitted only to the corresponding communication target person, and the non-applicable communication target person is transmitted. Can send a photo including the pre-face correction image.

  Other objects, features and advantages will become apparent upon reading the detailed description set forth below when taken in conjunction with the drawings and the appended claims.

The figure which shows the external appearance structure of the mobile telephone terminal of one embodiment. The block diagram which shows the structure of the mobile telephone terminal of one Embodiment. The flowchart for demonstrating the face correction photography process in one embodiment. The flowchart for demonstrating the face correction photography process in one embodiment. The figure for demonstrating the photograph including the image containing the image before face correction, and the image after face correction in one embodiment. The figure for demonstrating the image additional information format in one Embodiment. The flowchart for demonstrating the face correction photograph transmission process in one embodiment. The flowchart for demonstrating the face correction photograph transmission process in one embodiment.

  Hereinafter, further detailed description will be given with reference to the accompanying drawings. The drawings show preferred embodiments. However, it can be implemented in many different forms and should not be construed as limited to the embodiments set forth herein.

[Configuration and function of mobile phone terminal]
1 and 2 show a mobile phone terminal 1 as an example of an information processing apparatus having a transmission control function of a photograph including a face correction image according to an embodiment of the present invention.

  The mobile phone terminal 1 whose external configuration is shown in FIG. 1 includes a voice communication (call) function via a communication network, an e-mail transmission / reception function in cooperation with an e-mail server (e-mail post) (not shown), a photo shooting function, etc. including. The cellular phone terminal 1 may be a portable information terminal such as a personal computer having the same function.

The mobile phone terminal 1 includes the following elements as a hardware configuration in order to perform these functions. That is, the control function unit is a processor (CPU: Central Processing).
Unit) 5, a RAM (Random Access Memory) 6 as a working memory, and a ROM (Read Only Memory) 7 storing a boot program for startup.

  The communication function unit includes an antenna 10, a wireless transmission / reception unit 11, and an audio input / output unit 12 including a microphone, a speaker, and an ear receiver. The information input / designation function unit includes a numeric keypad 20, various function buttons (keys) 21, a pointing unit 22, and a cursor feed unit 23. The information display function unit includes a display (LCD) 30, and the imaging function unit includes a camera 40.

Further, the information holding function unit includes an OS (Operating System), various application programs such as a transmission control program for a photograph including a face correction image, and a non-volatile flash memory 50 that stores various information (including data) in a rewritable manner. Provide fixed or removable. The flash memory 50 stores a phone book (address book) 51 in which a name, a telephone number, an e-mail address, a photographed face image, and the like are stored in association with each other as information for specifying a communication target person. Has been.

  In this mobile phone terminal 1, it is possible to take a picture of an image that does not include a human face image or a face image such as a landscape or an object, with the built-in camera 40. The face image photographed by the camera 40 is stored in advance in the telephone directory 51 as information for specifying a communication target person.

  In order to logically realize a transmission control function for a photograph including a face correction image, which will be described in detail later, a transmission control program is installed as an application program in the flash memory 50 of the information holding function unit in the mobile phone terminal 1. Thus, triggered by a request from the user, the processor 5 develops this transmission control program in the RAM and executes it.

  The processor 5 executes the transmission control program so that the hardware components such as the control function unit, the communication function unit, the information input / holding function unit, the information display function unit, the imaging function unit, and the information holding function unit In cooperation with each other, the below-described face correction photo shooting process and face correction photo transmission process are performed.

[Photo transmission control function including face-corrected images]
Next, an operation example of the mobile phone terminal 1 according to the embodiment shown in FIGS. 1 and 2 will be described with reference to related drawings.

<Face correction photography process>
In the cellular phone terminal 1, the processor 5 executes the transmission control program, thereby performing the face-corrected photography process according to the following procedure.

  Referring to FIG. 3A, it is determined whether or not the face correction mode is designated when taking a picture with the built-in camera 40 (S1). When the face correction mode is not designated, normal photo shooting processing is performed and the process ends (S2). On the other hand, when the face correction mode is designated, face correction photo shooting processing is performed (S3).

  Here, the face correction mode can be set by sequentially specifying the camera, the photo mode, and the face correction mode after the user (photographer) presses the menu key (button), for example.

  Referring to FIG. 3B, in this face correction photo shooting process, first, an attempt is made to take a photo based on a face photo (face image) of a person selected as a face correction target and registered in advance in the telephone directory 51. The face of the designated person is extracted from the subject. That is, the face of the person to be photographed is recognized from the face authentication data in the telephone book, and a rectangle is displayed on the recognized face (see FIG. 4) (S31, S32). Based on this rectangular display, it is determined that there is selection (designation) of the face to be corrected (S33).

  When it is determined that there is a face to be corrected, the correction degree and correction area of the specified face are recorded in the image file (S34), and the e-mail address of the person corresponding to the specified face (simply described as mail address). May be recorded in the image file (S35). These correction area and e-mail address recording processes are repeated for a plurality of designated faces (S36). Here, the e-mail address of the person corresponding to the designated face is acquired from the telephone directory 51.

  Strictly embedded image additional information recorded as an extension in the image file of the photograph P2 including the face-corrected image shown in FIG. 4 is, for example, an image format EXIF (JIFIDA (Japan Electronics Industry Promotion Association) standardized). Exchangeable Image File Format) can be adopted.

When this image format EXIF is adopted, the image additional information includes the following image data (binary format) (see FIG. 5). In this image additional information, the correction RGB indicating the degree of correction of the designated face and the rectangular display coordinates indicating the correction area of the designated face are recorded in the image file of the photograph P2 including the face-corrected image. The photograph P2 including the image can be restored to the photograph P1 including the pre-face correction image.
(1) EXIF type: ASCII
(2) EXIF ID: bihada (uses other than standard ID)
(3) Correction RGB indicating the correction degree: + a, + b, + c
(4) Correction area 1: Rectangular display coordinates (X1, Y1)-(X2, Y2)
(5) Corrector mail address 1: aaa @ bbb. ne. jp
(6) Correction area 2: Rectangular display coordinates (X3, Y3)-(X4, Y4)
(7) Corrector mail address 2: ccc @ bbb. ne. jp
Subsequent to the process S36, when the user operates the camera 40 to take a face-corrected photograph (S37), the face image of only the designated person is corrected to be beautiful skin. In other words, after the skin component correction of the designated face correction area is performed, the face correction photography process ends (S38).

<Face corrected photo transmission processing>
Next, in the mobile phone terminal 1, the processor 5 executes the transmission control program, thereby performing the face-corrected photo transmission process of the following procedure.

  Referring to FIG. 6A, after a user (e-mail sender) presses a menu key (button), a mail is created (edited), and a photograph including an image obtained by performing face correction on the skin is attached as an attached file. If it is determined based on EXIF ID = bihada in the image additional information recorded as an extension in the image file, the face-corrected photo transmission process is activated (S4, S5). If it is determined that EXIF ID in the image additional information is not bihada, a normal mail transmission process is performed and the process ends (S6).

  Referring to FIG. 6B, in this face correction photo transmission process, first, the mail address of the face corrector is extracted from the image additional information of the image file (S51). By comparing the mail address extracted from the image additional information with the destination mail address of the target mail being edited, it is determined whether the destination mail address corresponds to the face corrector (S52).

  When the transmission destination email address matches the email address of the face corrector recorded in the image additional information of the image file, the email address is added to the first transmission target email attached with the photo including the face corrected image ( S53).

  If the destination mail address is different from the mail address of the face corrector recorded in the image additional information of the image file, the correction degree and the correction area are extracted as correction data from the image additional information (S55). Based on the extracted correction data, a photo including the pre-face correction image is restored, and an e-mail address is added to the second transmission target e-mail attached with the restored photo (S56, S57).

In a state where a plurality of destination mail addresses are set in the mail, after repeating the above classification process (S52, S53, S55, S56, S57) for all the destination mail addresses, The second transmission target mail is transmitted (S54, S58, S59).

  As described above, in the mobile phone terminal 1 according to the embodiment, when a photograph including an image subjected to face correction on a beautiful skin is attached and transmitted to a plurality of people, the image corresponding person subjected to face correction is transmitted to the person. Can send an e-mail attached with a photo including a face-corrected image, and send an e-mail attached with a photo containing a pre-face-corrected image to a person who is not subject to face correction.

  Here, when there are a plurality of recipients of each e-mail, it is broadcast. This broadcast transmission is a service for designating a plurality of addresses (destination mail address or destination mail address) and transmitting the same mail data at a time.

[Modification]
In the embodiment described above, based on the image additional information, the photo including the pre-face correction image is restored by performing reverse correction from the photo including the post-face correction image. However, the pre-correction image is saved during the face correction. However, it may be replaced at the time of mail transmission.

  In the embodiment described above, face correction is performed by attaching a face-corrected image to an image-compatible person who has performed face correction in a state where a plurality of destination mail addresses are set in the mail. It is configured to attach an image before face correction to a person who does not support images, but other embodiments are possible. For example, when there is even one person who does not perform face correction among a plurality of destination email addresses, an image before face correction is attached to the plurality of destination email addresses. Also good. By doing so, since the same image is attached to all the people who are broadcasted, a conversation about the image between the users that occurs when a different image is sent for each user It is possible to prevent inconsistencies.

  Each process in the above-described embodiment may be performed by selecting and combining any plural or all of the processes.

  The processing in the above-described embodiment is provided as a computer-executable program, and can be provided via a recording medium such as a CD-ROM or a flexible disk, and further via a communication line.

1 Mobile phone terminal 5 Processor (CPU)
6 RAM
7 ROM
11 Wireless transceiver 40 Camera 50 Flash memory 51 Telephone book

Claims (4)

Image recording means for recording an image and additional information of the image in association with each other;
A transmission unit;
An information processing apparatus comprising a processor,
The processor is
Comparing the transmission destination identifier of the email to be transmitted with the correction subject identifier included in the additional information recorded in the image recording means in association with the image attached to the email;
When the receiver identifier matches any of the correction subject identifier, the attached electronic mail the image is transmitted to the transmitting unit, the transmission destination identifier does not match any of the correction target identifier In this case, the information processing apparatus transmits an e-mail attached with an uncorrected image restored from the image based on the correction information included in the additional information to the transmitting unit. Wherein the processor is a case where a plurality of transmission destination identifier is set to the electronic mail, when any one of said plurality of receiver identifier does not match with any of the correction subject identifier, the additional The information processing apparatus according to claim 1, wherein an e-mail attached with an uncorrected image restored from the image based on correction information included in the information is transmitted to the transmission unit. The information processing apparatus according to claim 1, wherein the correction information includes RGB information and coordinate information indicating a correction area. Image recording means for recording an image and additional information of the image in association with each other;
A transmission unit;
A program executed by an information processing device comprising a processor,
In the processor,
Comparing the transmission destination identifier of the email to be transmitted with the correction subject identifier included in the additional information recorded in the image recording means in association with the image attached to the email;
When the receiver identifier matches any of the correction subject identifier, the attached electronic mail the image is transmitted to the transmitting unit, the transmission destination identifier does not match any of the correction target identifier In this case, the program causes the transmitting unit to execute a process of transmitting an e-mail attached with an uncorrected image restored from the image based on the correction information included in the additional information.

Images