JP5531646B2 - Mobile terminal image automatic correction system, method and program thereof - Google Patents

Description

The present invention relates to a portable terminal that performs correction on an image acquired from the outside by e-mail or the like based on correction data obtained by analyzing the saturation and contrast of an image photographed by a camera mounted on a portable terminal or the like. Suega image automatic correction system, a method thereof and a program thereof.

  The result of an image photographed by the camera is greatly influenced by the color temperature of the light source at the time of photographing, the light beam state such as forward light or backlight.

  Although an electronic correction can be performed for an image whose color tone or shadow of a subject is unintentional, the correction operation is generally complicated, and particularly difficult for a portable terminal with a limited operation interface.

  Therefore, Patent Documents 1 and 2 recognize the color of a predetermined location in the color image data, notify the user of the color name of the predetermined location in the color image data, or correct the captured image according to artificial lighting. A system is disclosed.

  Patent Document 3 discloses an invention relating to a portable terminal that performs a remote operation on face image data attached to an e-mail using face authentication technology.

  Furthermore, Patent Documents 4 and 5 disclose inventions that perform image correction based on various shooting modes.

JP 2006-270547 A JP 2007-115123 A JP 2006-324800 A JP 2007-306461 A JP 2009-246565 A

  However, these related techniques have a problem that it is necessary for the user to select a correction means in advance, or that an image is not intended by the user because of image correction according to artificial lighting. .

  Furthermore, good and bad image quality often depends on the subjectivity, and the preference of image quality varies depending on the user, so the conditions are often not uniform when general users shoot with the camera, and the same depending on the person taking the image. There are various image quality correction processes even for scene photos, and there is a problem of an unfavorable image regarding the correction process of an image attached to an email received from a friend / acquaintance.

The present invention has been made in view of the above, and based on correction data obtained by analyzing the saturation and contrast of an image captured by a camera mounted on a portable terminal or the like, an image acquired from the outside by e-mail or the like mobile end Suega image automatic correction system for correcting the, and to provide the method and a program.

According to a first aspect of the present invention, there is provided an automatic image correction system for a mobile terminal equipped with a camera function, and at the time of camera shooting, shooting condition setting data from the shot image, scene classification result for the subject, and shooting before correction An image quality parameter extraction unit that extracts image data and creates a setting file that associates the shooting condition setting data with the scene classification result for the subject; the extracted shooting condition setting data; the scene classification result for the subject; A history DB that holds the setting file as a correction condition, a correction condition that corresponds to an image acquired from the outside, is read from the history DB, and a correction process that performs correction processing; the image quality parameter extraction unit; the history DB; and an image analysis engine and a behavior control unit that controls the history utilization unit, the image quality parameter Output unit, when viewing and retaining the image acquired from the external, the extracted image of the scene classification acquired from the outside, notifies the extraction result to the history utilization unit, the history utilization unit, the notification An automatic image correction system is provided in which correction conditions corresponding to the extracted results are read from the history DB and correction processing is performed.

According to a second aspect of the present invention, there is provided a method of automatic image correction of a mobile terminal equipped with a camera function, and at the time of camera shooting, shooting condition setting data from the shot image, scene classification result and correction for the subject. A procedure for extracting the previous captured image data, creating a setting file that associates the shooting condition setting data with the scene classification result for the subject, the extracted shooting condition setting data, the scene classification result for the subject, and Corresponding to the procedure for storing the setting file as a correction condition in the history DB, the procedure for extracting the scene classification of the image acquired from the outside when viewing / holding the image acquired from the outside, and the extracted scene classification a correction condition for reading from the history DB, the automatic image correction method characterized by and a procedure for performing correction processing provided It is.

Further, according to a third aspect of the present invention, there is provided an image automatic correction program for a mobile terminal equipped with a camera function, wherein shooting condition setting data from a captured image, scene classification result for a subject, and correction are performed during camera shooting. Extracting the previous captured image data, creating a setting file that associates the shooting condition setting data with the scene classification result for the subject, the extracted shooting condition setting data, the scene classification result for the subject, and Corresponding to the process of storing the setting file as a correction condition in the history DB, the process of extracting the scene classification of the image acquired from the outside when viewing / holding the image acquired from the outside, and the extracted scene classification A correction condition to be read out from the history DB, and a correction process is executed by a computer. Image automatic correction program is provided.

As described above, according to the present invention, based on correction data obtained by analyzing the saturation and contrast of an image captured by a camera mounted on a portable terminal or the like, an image acquired from the outside by e-mail or the like is obtained. mobile end Suega image automatic correction system for correcting for, it is possible to provide the method and a program.

It is the figure which conceptualized the structure of the portable terminal with a camera which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Here, FIG. 1 is a diagram conceptualizing the configuration of the mobile terminal device according to the embodiment of the present invention.

  According to FIG. 1, a camera-equipped mobile terminal 1 according to an embodiment of the present invention is a mobile terminal equipped with a camera function equivalent to a digital camera having an image analysis engine 2.

  The image analysis engine 2 built in the portable terminal 1 extracts the camera shooting mode, image quality parameters, scene classification result for the subject and shot image data before correction from the shot image, and the camera shooting mode of the camera. And an image quality parameter extraction unit 22 that creates a setting file that associates the image quality parameter with the scene classification result for the subject, and the extracted shooting mode, image quality parameter, scene classification result for the subject, and the setting file as correction conditions. The history DB 23 to be held and the correction conditions corresponding to the image attached to the mail sent from the other terminal are read from the history DB 23, and the history utilization unit 24 for performing the correction process, the image quality parameter extraction unit 22, and the history DB 23 And a behavior control unit 21 that controls the history utilization unit 24.

Image quality parameter extraction unit 22 extracts an image of a scene classification attached to the mail coming sent from another terminal, notifies the extraction result to the history utilization unit 24, the history utilization unit 24 is the notification The correction condition corresponding to the extracted result is read out from the history DB 23 and correction processing is performed.

  With the above configuration, the image analysis engine 2 according to the present embodiment analyzes the characteristics of the captured image at the time of camera shooting with the mobile terminal according to the present embodiment, holds the characteristics in the history DB 23, and the history utilization unit 24. In this engine, it is possible to create an image correction suitable for each user.

Here, the characteristics of the image extracted from the captured image during camera shooting are as follows:
(i): Camera shooting mode (person, landscape, night view, cooking, etc.) or image quality parameters (saturation, white balance, contrast, exposure, etc.)
(ii): Scene classification results for subjects (person, landscape, night view, etc.)
(iii): Image data before correction
(iv): A setting file in which (i) and (ii) and (iii) are associated with each other.

[Operation of this embodiment]
Hereinafter, an operation when camera photographing is performed by the mobile terminal according to the present embodiment will be described with reference to FIG.

  First, when camera photographing is performed by the mobile terminal according to the present embodiment, the feature for the photographed image is extracted by the image quality parameter extraction unit 22 in the image analysis engine 2 and stored in the history DB 23.

As features to be extracted,
(1) Camera shooting mode (person, landscape, night view, cooking, etc.)
(2) Scene classification results for subjects (people, landscapes, night views, etc.)
(3) Image data before correction processing.

  As an example, assume that a night scene is shot in a cooking mode. For the photographed image A at this time, the image quality parameter extraction unit 22 in the image analysis engine 2 extracts the photographing mode of the camera, the scene classification result of the subject, and the image data before correction as features of the dish image Are stored in the history DB 23 together with the setting file associated with the extraction results. In the photographed image A, the photographing mode of the camera is “cooking”, and the subject is “night view”.

  Subsequently, a photographed image B is created by photographing the flower subject in the cooking photography mode, and a photographed image C is created by photographing the person subject in the night view photographing mode. Like the captured image A, the captured images B and C are extracted in the image quality parameter extraction unit 22 and stored in the history DB 23 together with a setting file in which the extraction results are associated.

In the photographed image B, the camera photographing mode is “cooking” and the subject is “flower”, and in the photographed image C, the camera photographing mode is “night view” and the subject is “person”.

  In the above example, it is considered that correction processing of the “cooking mode”, which is high in saturation from the results of the captured images A and B as the image quality of the captured image and is generally flashy, is often performed.

  Further, it is assumed that an image D separately captured by a camera-equipped mobile terminal equipped with a function equivalent to that of the above-described mobile terminal is attached to the mobile terminal and transmitted as an email. At this time, the attached image corresponds to uncorrected image data held in the history DB 23.

  It is assumed that the mobile terminal receives an email attached with a captured image D in which autumn leaves are reflected.

  When viewing and holding the image D attached to the mail, the image quality parameter extraction unit 22 in the image analysis engine 2 analyzes the scene classification “Autumn leaves” and notifies the history utilization unit 24 of the analysis result. The history utilization unit 24 reads the setting file associated with the “cooking mode” appropriate for the photographed image D from the history DB 23 and performs correction processing using the camera photographing mode and image quality parameters associated with the setting file.

  Further, it is assumed that an email attached with a photographed image E showing a person is received from another portable terminal. Here, the image quality parameter extraction unit 22 analyzes the scene classification “person” and notifies the history utilization unit 24 of the analysis result. The history utilization unit 24 reads the setting file associated with the “night scene mode” appropriate for the photographed image E from the history DB 23 and performs correction processing using the camera photographing mode and image quality parameters associated with the setting file.

As described above, in the mobile terminal according to the present embodiment,
1. 1. It is possible to create a picture-making image according to the preference of each user. 2. It is possible to create a uniform image quality under different shooting conditions and cameras. Since the history is collected as the image is taken, the accuracy of the desired image for each user can be improved.

[Other Embodiments of the Present Invention]
In addition to image data, correction information can also be sent to another terminal for correction. Alternatively, the image analysis engine can be provided not on the terminal but on the server side. Furthermore, it is possible for a person with a color vision disorder or the like to perform color correction.

  Although the image correction system for a portable terminal according to the above-described embodiment of the present invention can be realized by hardware, the computer can read a program for causing the computer to function as the image correction system for the portable terminal. It can also be realized by reading from a simple recording medium and executing it.

  The image correction method of the portable terminal according to the above-described embodiment of the present invention can be realized by hardware, but a computer-readable recording program for causing the computer to execute the method is recorded on the computer. It can also be realized by reading from the medium and executing it.

  INDUSTRIAL APPLICABILITY The present invention can be used in a system capable of creating an image according to the preference of each user by applying correction data specialized for each user to the image and performing correction.

DESCRIPTION OF SYMBOLS 1 Mobile terminal with camera 2 Image analysis engine 21 Action control part 22 Image quality parameter extraction part 23 History DB
24 History Utilization Department

Claims (4)

An automatic image correction system for a mobile terminal equipped with a camera function,
At the time of camera shooting, the shooting condition setting data, the scene classification result for the subject, and the pre-corrected shooting image data are extracted from the shot image, and a setting file that associates the shooting condition setting data with the scene classification result for the subject is created. A parameter extractor;
A history DB for holding the extracted shooting condition setting data, a scene classification result for the subject, and the setting file as correction conditions;
A history utilization unit that reads correction conditions corresponding to images acquired from the outside from the history DB and performs correction processing;
An action control unit that controls the image quality parameter extraction unit, the history DB, and the history utilization unit;
Having an image analysis engine with
The image quality parameter extraction unit, when viewing and retaining the image acquired from the external, extracts the scene classification of images acquired from the outside, notifies the extraction result to the history utilization unit,
The automatic history correction system, wherein the history utilization unit reads a correction condition corresponding to the notified extraction result from the history DB and performs a correction process. The shooting condition setting data includes at least one of an image quality adjustment pattern defined for each type of subject as a shooting mode of the camera, and an image quality adjustment item defined as an image quality parameter,
The subject to be defined as a shooting mode of the camera includes at least one of a person, a landscape, a night view, and a dish, and the image quality adjustment items defined as the image quality parameters include saturation, white balance, contrast, exposure The image automatic correction system according to claim 1, wherein the scene classification result for the subject includes at least one of classifications defined as shooting modes. An automatic image correction method for a mobile terminal equipped with a camera function,
A procedure for extracting shooting condition setting data, a scene classification result for a subject and shot image data before correction from a shot image, and creating a setting file for associating the shooting condition setting data with the scene classification result for the subject at the time of camera shooting When,
A procedure of holding the extracted shooting condition setting data, a scene classification result for the subject, and the setting file in the history DB as correction conditions;
A procedure for extracting the scene classification of the image acquired from the outside when browsing / holding the image acquired from the outside ;
A procedure for reading correction conditions corresponding to the extracted scene classification from the history DB and performing correction processing;
Automatic image accessory square method, characterized in that it comprises a. An automatic image correction program for a mobile terminal equipped with a camera function,
Processing for extracting shooting condition setting data, a scene classification result for a subject and shot image data before correction from a shot image, and creating a setting file that associates the shooting condition setting data with the scene classification result for the subject at the time of camera shooting When,
Processing for storing the extracted shooting condition setting data, scene classification result for the subject, and the setting file in the history DB as correction conditions;
When browsing / holding an image acquired from the outside, a process of extracting the scene classification of the image acquired from the outside ,
A correction condition corresponding to the extracted scene classification is read from the history DB and a correction process is performed;
Automatic image complement Seipu program characterized by causing a computer to execute the.

Images