JP2023013621A - Mage processing device, image processing method, and program - Google Patents

Abstract

To make it possible to efficiently adjust the reflection of a subject shown in a captured image.SOLUTION: An image processing device according to one aspect of the present technique adjusts, according to a user's operation, a reflection of each of selected images, which are some captured images selected from among a plurality of captured images obtained by photographing the user as a subject, and reflects, in each unselected image, contents of adjustment of the reflection of the selected images selected, based on the state of a face shown in each selected image, and the state of the face shown in each of unselected images, which are captured images that have not been selected as targets for reflection adjustment. This technique can be applied to a computer installed in a photographing studio.SELECTED DRAWING: Figure 1

Description

The present technology relates to an image processing device, an image processing method, and a program, and more particularly to an image processing device, an image processing method, and a program that enable efficient adjustment of the appearance of a subject in a captured image.

2. Description of the Related Art Photographing devices such as ID photography machines and print sticker machines installed in game arcades allow users to adjust the appearance of a photographed image by themselves. The user can adjust the appearance of the image printed on sticker paper or the like one by one as desired.

JP 2015-118329 A

It is troublesome to adjust the appearance of a large number of images, such as 50 or 100, one by one.

The present technology has been made in view of such a situation, and enables efficient adjustment of the appearance of a subject appearing in a captured image.

An image processing device according to one aspect of the present technology is a method for processing each selected image, which is a part of the photographed images selected from among a plurality of photographed images obtained by photographing a user as a subject, to the user. based on the state of the face appearing in each of the selected images and the state of the face appearing in the unselected image, which is the photographed image that was not selected as a target for image adjustment. and an image processing unit that reflects the content of the adjustment of the appearance of the selected image selected by the above-mentioned image processing unit on each of the unselected images.

In one aspect of the present technology, the appearance of each selected image, which is a part of the photographed images selected from among a plurality of photographed images obtained by photographing the user as a subject, is controlled by the user's operation. adjusted accordingly. Further, the selection selected based on the state of the face appearing in each of the selected images and the state of the face appearing in the unselected image, which is the photographed image that was not selected as a subject of image adjustment. The content of the image appearance adjustment is reflected in each of the unselected images.

According to the present technology, it is possible to efficiently adjust the appearance of a subject appearing in a captured image.

It is a figure which shows the flow of work in a photography studio. FIG. 10 is a diagram showing an example of providing a photographed image; FIG. 4 is a diagram showing an example of file management in a retouching PC; It is a figure which shows the example of an image selection screen. FIG. 10 is a diagram showing an example of a retouch screen; FIG. 11 is a diagram showing an enlarged display of a retouch selection area; FIG. 10 is a diagram showing an example of application of retouching parameters; FIG. 10 is a diagram showing another example of application of retouching parameters; FIG. 10 is a diagram showing an example of application of retouching parameters; FIG. 10 is a diagram showing an example of face ratio calculation; FIG. 4 is a block diagram showing a configuration example of a retouching PC; FIG. 4 is a block diagram showing a functional configuration example of a retouching PC; 10 is a flowchart for explaining retouching processing;

<Flow of work in the shooting studio>
FIG. 1 is a diagram showing the flow of work in a photography studio.

This technology is used, for example, in a photography studio that takes commemorative photographs of coming-of-age ceremonies. This technology can also be applied when taking commemorative photos of various events, such as entrance/graduation commemorative photos, bridal photos, and Shichi-Go-San celebration photos, in a photography studio.

As shown on the left side of FIG. 1, photography in a photography studio is performed by a cameraman. In the example of FIG. 1, a user in furisode, standing in front of a background screen, is taken as a subject. A strobe device that emits light in accordance with the photographing by the photographer is arranged around the user.

Photographing by a cameraman is performed by changing the composition and photographing a large number of still images (photographs) such as 50, 100, or the like. The composition of the still image is determined by the pose of the user, the positional relationship between the user and the photographer, camera parameters such as the focal length, and the like. A photographed image, which is a still image photographed by a cameraman, is transferred to and saved in a PC (not shown) connected to the camera.

After the photography is finished, the user moves to the retouching space prepared in the photography studio and, as shown on the right side of FIG. .

Also, the user selects, for example, the number of photographic images to be finally printed, and retouches them by himself to adjust the appearance of each photographic image. Retouching is performed on a part of the captured images such as 5 or 10 selected from the captured images taken by the cameraman. Retouching (processing) includes various types of image processing for changing the appearance of a captured image.

One or a plurality of retouching PCs 1 are prepared in the retouching space. The photographed image saved in the saving PC is transferred to the retouching PC 1 and displayed on the display 11 of the retouching PC 1 . The retouching PC 1 is installed with a retouching application 1A, which is an application used for retouching images taken by a photographer.

As described above, in the photography studio where the retouching PC 1 to which the present technology is applied is installed, the user himself/herself retouches the photographed image photographed by the cameraman. The user can use the function of the retouching application 1A to retouch the captured image so as to obtain a desired appearance. The retouching application 1A may be installed in a terminal other than a PC, such as a tablet terminal, and used for retouching.

FIG. 2 is a diagram showing an example of providing a captured image.

Photographed images that have been retouched by the retouching application 1A are printed by the operating company of the photography studio and delivered to the user at a later date in the form of an album, for example, as indicated by arrow #1.

Further, the retouched photographed image is uploaded from the retouching PC 1 to the image management server 2 and managed in the image management server 2, as indicated by an arrow #2. The image management server 2 is, for example, a server on the Internet. The image management server 2 is managed by the operating company of the photography studio or by a company different from the operating company of the photography studio.

The user operates his/her mobile terminal 3 such as a smart phone and operates the image management application 3A to view images taken of himself/herself as a subject, as indicated by arrow #3. , can be downloaded. The image management application 3</b>A is an application for browsing captured images managed by the image management server 2 . The image management application 3A is provided, for example, by an operator who manages the image management server 2. FIG.

Photographed images photographed in a photographing studio are provided in the form of an album and appropriately in the form of data. The photographed images may be provided as data at a charge separate from the charge for the album.

The photographic images are provided as data so as to provide not only the photographic images that have been retouched by the user, but also the photographic images that have not been selected by the user to be retouched. Captured images not selected by the user to be retouched are automatically retouched by the retouching application 1A without being operated by the user, as will be described later.

The user can receive, in the form of data, even captured images that have not been selected for retouching. Instead of using the image management application 3A, a browser may be used to access a predetermined site to receive captured images managed by the image management server 2. FIG. For example, by registering as a member of an image providing service provided by the administrator of the image management server 2, the user can view captured images managed by the image management server 2 using the image management application 3A, or It is possible to receive it using a browser.

Instead of the portable terminal 3, another terminal such as a tablet terminal or a PC may be used to receive the captured image.

<About the retouch app>
File Management FIG. 3 is a diagram showing an example of file management in the retouching PC 1. As shown in FIG.

As shown in the balloon in FIG. 3, two folders, an all folder and an album folder, are prepared in association with a user ID, which is user identification information. The all folder is a folder with a folder name of "all", and the album folder is a folder with a folder name of "album".

The captured image files transferred from the storage PC are stored in the all folder. Files of captured images that have been selected for retouching and have been retouched are stored in the album folder. The files stored in the album folder are the files used for printing.

When the user who has finished shooting starts retouching, the user ID is input on the screen of the retouching application 1A. Based on the user ID, the captured image is read by the retouching application 1A, and processing using the captured image is performed. For example, all captured image files stored in the all folder associated with the user ID are read by the retouching application 1A. After the captured images are read, the captured images to be retouched are selected.

- Screen display Fig. 4 is a diagram showing an example of an image selection screen.

A message is displayed above the image selection screen to guide the selection of five shot images. The number of images to be selected is set by, for example, the staff of the photography studio before image selection. When the user applies for a plan to print 5 shot images and receive them as an album, 5 is set as the number of selected images.

A thumbnail display area 21 is formed on the right side of the image selection screen. The thumbnail display area 21 is an area in which thumbnail images of captured images are displayed. For example, when 50 shot images have been shot, thumbnail images of each of the 50 shot images are displayed. Various operations using the screen of the retouching application 1A are performed using a mouse, a keyboard, and the like.

A photographed image selected using a thumbnail image is enlarged and displayed in a display area 22 formed on the left side of the thumbnail display area 21 . In the example of FIG. 4, the thumbnail image of the captured image P1 displayed at the upper left corner of the thumbnail display area 21 is selected, and the captured image P1 is enlarged and displayed in the display area 22 .

A decision button 23 is displayed below the display area 22 . The decision button 23 is a button that is pressed to decide that the captured image displayed in the display area 22 is to be retouched. By selecting a thumbnail image, the user sequentially enlarges and displays each photographed image in the display area 22, and when there is a photographed image that the user likes, presses the decision button 23 to select it as a retouching object. .

The number of remaining selections is displayed above the thumbnail display area 21 . Each time a photographed image to be retouched is selected, the display of the number of selected images is updated.

When five shot images are selected and the end button 24 is pressed, the selection of shot images to be retouched ends. After the selection of the photographic images to be retouched ends, retouching is performed on each of the photographic images selected to be retouched.

FIG. 5 is a diagram showing an example of a retouch screen.

A display area 31 is formed above the center of the retouch screen. A display area 31 is an area in which a photographed image to be retouched is displayed in an enlarged manner. A photographed image selected in the thumbnail display area 32 using the thumbnail image is enlarged and displayed in the display area 31 .

A thumbnail display area 32 is formed at the lower left of the retouch screen. The thumbnail display area 32 is an area in which thumbnail images of captured images selected on the image selection screen are displayed. In the example of FIG. 5, thumbnail images of five shot images P1 to P5 are displayed in the thumbnail display area 32 . A photographed image P1 selected using a thumbnail image is enlarged and displayed in the display area 31 .

A retouch selection area 33 is formed under the retouch screen. The content of retouching is selected using the buttons displayed in the retouching selection area 33 . Each time the content of retouching is selected using the button displayed in the retouching selection area 33 , the selected content is reflected in the display of the display area 31 . While looking at the display in the display area 31 , the user selects the content of retouching to be performed on the photographed image to be retouched by using the display in the retouch selection area 33 .

FIG. 6 is an enlarged view showing the display of the retouching selection area 33. As shown in FIG.

In the retouching selection area 33, the size of the eyes, the shape of the eyes, the intensity of the makeup, the on/off of the bridge of the nose, the skin type, the shape of the face, the feeling of a small face, and the selection of on/off of the styling up. The buttons used for

As the size of the eyes, it is possible to select one of five sizes. "1" for the size of the eye indicates no processing, that is, the original size of the eye is left unchanged. By selecting one of the sizes, the user can adjust the size of his or her eyes appearing in the captured image displayed in the display area 31 .

As the shape of the eyes, it is possible to select any shape from among "round eyes", "sagging eyes", and "cat eyes". By selecting one of the shapes, the user can adjust the shape of his or her eyes appearing in the captured image displayed in the display area 31 . By selecting "no processing", it is possible not to change the shape of the eyes.

It is possible to select three levels of darkness as the darkness of make-up. "1" for the density of makeup indicates that the original density of the makeup is maintained without changing the density of the makeup. The user can adjust the darkness of his or her makeup appearing in the photographed image displayed in the display area 31 by selecting one of the darknesses.

As a nose bridge, it is possible to select ON/OFF. By selecting ON or OFF, the user can select whether to emphasize the highlighted part of the bridge of his/her own nose in the photographed image displayed in the display area 31 or to leave it in the original state. .

It is possible to select one of five levels of strength as skin quality. The skin quality "1" indicates that the skin quality is not changed and the original skin quality is maintained. By selecting one of the strengths, the user can adjust the degree of smoothness of his/her own skin quality appearing in the photographed image displayed in the display area 31 .

As the shape of the face, it is possible to select any shape from among "round", "egg", and "slender". By selecting one of the shapes, the user can adjust the shape of his or her face appearing in the captured image displayed in the display area 31 . By selecting "no processing", it is possible not to change the shape of the face.

It is possible to select five levels of sizes for the feeling of small face. "1" for the feeling of small face indicates that the size of the face is not changed and remains the original size. The user can adjust the size of his or her face appearing in the captured image displayed in the display area 31 by selecting any size from "2" to "4".

As a style enhancement, it is possible to select ON/OFF. By selecting ON or OFF, the user can select whether to increase his or her height in the photographed image displayed in the display area 31 or to keep the original state.

The user can use these various functions to select the content of retouching to be applied to the captured image displayed on the display area 31 . In this way, retouching that can be performed using the retouching application 1A includes at least adjustment of the size and shape of the eyes and adjustment of the size and shape of the face.

The photographed image to be retouched is switched using the display of the thumbnail display area 32, and retouching of each of the photographed images P1 to P5 is sequentially performed. Each file of the retouched captured images P1 to P5 is stored in the album folder.

Returning to the description of FIG. 5, an enlargement/reduction button 34 is provided on the right side of the display area 31 . The enlargement/reduction button 34 is a button operated to enlarge a portion of the photographed image displayed in the display area 31 or to reduce the enlarged portion.

A pre-processing button 35 is provided below the enlargement/reduction button 34 . The pre-processing button 35 is a button that is operated when switching the display of the display area 31 to a state before retouching. While the pre-processing button 35 is being pressed, the captured image before retouching is displayed in the display area 31 . By using the pre-processing button 35, the user can compare the state after retouching and the state before retouching, and confirm whether the degree of retouching is too strong.

At the upper right of the retouching screen, a return button 36 operated to return to the image selection screen and an end button 37 operated to end retouching are displayed. When the content of retouching for each of the captured images P1 to P5 is selected and the end button 37 is pressed, the retouching ends.

Inheritance of Retouching Parameters Retouching parameters are parameters that represent the content of retouching selected using the display of the retouching selection area 33 . When a certain captured image is retouched, the retouch parameters of the captured image to be retouched are changed. Retouching parameters for one captured image are applied as retouching parameters for another captured image.

7 and 8 are diagrams showing examples of application of retouch parameters.

As indicated by an arrow #11 in FIG. 7, when the photographed image P1 is set as the first image to be retouched, the user's operation changes the "eye size" to "3" and the "eye shape" to "cat eyes". , "Make-up density" of "2", . . . are set for the captured image P1. The photographed image P1 after retouching shown in the lower part of FIG. 7 is different from the photographed image P1 before retouching shown in the upper part.

When the retouching of the photographed image P1 is completed and the retouched image is switched from the photographed image P1 to the photographed image P2, as indicated by the arrow #12 in FIG. As the default retouching parameters of P2, the retouching parameters of the retouched captured image P1 are taken over. In the display area 31, the photographed image P2 is displayed in a state in which the same retouching as that of the retouched photographed image P1 is performed. The display of the retouch selection area 33 is also displayed according to the content of the retouch applied to the captured image P2.

The user can start retouching the photographed image P2 based on the photographed image P2 that has undergone the same retouching as the photographed image P1. In the example of FIG. 8, the retouching parameters are represented by "eye size" of "4", "eye shape" of "cat's eyes", "make-up intensity" of "1", and so on. adjusted to the content.

Similarly, when the retouching of the photographed image P2 is completed and the third photographed image to be retouched is selected, as indicated by arrow #14, the default retouching parameters for the third photographed image to be retouched are: The retouch parameters of the captured image P2 are inherited.

In this manner, when a new captured image that has not yet been retouched is selected as a captured image to be retouched, the retouching details of the previous captured image to be retouched are inherited. This allows the user to efficiently retouch each captured image.

Each photographed image to be retouched may be classified according to the composition of the subject, and the retouching parameters of the photographed image having the same composition may be applied. In this case, the composition of each photographed image is analyzed by the retouching application 1A, and each photographed image is photographed with one of a plurality of types of composition such as "close-up", "bust-up", and "whole body". Classified as an image.

"Close-up" is a composition in which the subject's face is enlarged, and "bust-up" is a composition in which the upper half of the subject's body is enlarged. "Whole body" is a composition in which the whole body of the subject is photographed. For example, the face size is analyzed, and the composition is classified according to the face size. The composition may be classified according to not only the size of the face but also the direction of the face, the position of the face, and the like.

For example, if a "close-up" shot image is retouched and then the same "close-up" shot image is selected for retouching, the retouching parameters of the retouched shot image are newly selected as the retouching target. is set as a retouching parameter for the "up" captured image.

Appropriate retouching parameters may be prepared in advance for each composition. When a photographed image is selected as an object to be retouched, retouch parameters prepared in advance for composition of the photographed image are set as retouch parameters for the photographed image newly selected as an object to be retouched.

A recommended button that is operated when applying recommended retouching parameters may be prepared on the retouching screen. When the recommendation button is pressed, retouch parameters prepared in advance for the composition of the captured image are set for the captured image selected as a retouch target.

A recommendation button for each composition may be prepared on the retouch screen. In the case of the above example, recommendation buttons are prepared for each composition of "up", "bust up", and "whole body". For example, information representing the type of composition of the captured image selected as the retouching target is displayed near the display area 31 . The user can set appropriate retouching parameters by checking the composition of the captured image selected as the retouching target and pressing the recommendation button for the same composition.

Retouching parameters may be recorded. For example, retouch parameters set by the user are recorded in association with the user ID together with information on the type of composition of the captured image to be retouched.

An inference model generated by machine learning may be used to suggest suitable retouching parameters. In this case, the retouching application 1A is equipped with an inference function using an inference model that inputs a captured image and outputs retouching parameters.

<Application of retouch parameters to unselected images>
For example, five photographed images that have been retouched according to the user's operation as described above are printed on photographic paper and provided to the user in the form of an album. In addition, the photographed image that has been retouched according to the user's operation is provided in the form of data together with the photographed image that is not selected as a retouch target on the image selection screen (FIG. 4).

Hereinafter, a photographed image that has not been selected as a retouching target will be referred to as an unselected image. A captured image selected as a retouch target is a selected image.

Unselected images are automatically retouched by the retouching application 1A without user operation. An unselected image provided in the form of data also becomes a retouched photographed image.

FIG. 9 is a diagram showing an example of application of retouching parameters.

As shown in FIG. 9, the content of retouching applied to each of the captured images P1 to P5 by the user's operation is reflected in each of the unselected images stored in the all folder. The contents of the retouch applied to each of the captured images P1 to P5 may be reflected only to the unselected images stored in the all folder, or all the captured images stored in the all folder may be retouched. You may make it reflected with respect to.

The state of the face captured in the selected image and the state of the face captured in the unselected image depend on which of the retouched captured images P1 to P5 the content of retouching of the captured image is to be reflected in each unselected image. selected based on A selected image showing a face in a state close to the state of the face shown in each of the unselected images is selected, and the contents of retouching applied to the selected selected image are reflected on the unselected images.

For example, it is possible to use the size of the face as the condition of the face in the selected image and the unselected image. Specifically, for each captured image (selected image and unselected image), the face ratio, which is the ratio of the face size to the size of the captured image, is calculated, and the selected images with similar face ratios are retouched. Each unselected image is retouched so as to reflect the content.

FIG. 10 is a diagram showing an example of face ratio calculation.

FIG. 10A shows an example of calculation of the face ratio of the photographed image P1, which is a horizontally long image. FIG. 10B shows an example of calculation of the face ratio of the photographed image P4, which is a vertically long image.

Face recognition is performed, and the range surrounded by the frame F is recognized as the face range. Also, based on the width X of the frame F and the length Y of the short side of the captured image, the face ratio Z is calculated by the following equation (1), for example.
Face ratio Z = Width X of frame F ÷ Length of short side Y (1)

For the horizontally long photographed image P1 shown in FIG. 10A, the face ratio is calculated based on the width of the frame F and the height of the photographed image indicated by the dashed-dotted arrow. On the other hand, for the vertically long image shown in FIG. 10B, the face ratio is calculated based on the width of the frame F and the width of the image indicated by the dashed-dotted arrow.

A face ratio is calculated for each of the captured images P1 to P5. Also, the face ratio is calculated for each of the unselected images.

For an unselected image, the same retouch content as that applied to the retouched photographed image whose face ratio is calculated to be the closest to the unselected image is reflected.

For example, when 0.30, 0.40, 0.50, 0.60, and 0.70 are calculated as face ratios for each of the photographed images P1 to P5, the unselected image for which the face ratio of 0.32 is calculated is set to the photographed image P1. Retouching with the same content as the content of the applied retouching is performed. Further, the unselected images for which the face ratio of 0.80 has been calculated are subjected to the same retouching as that applied to the photographed image P5.

Usually, in studio shooting, a plurality of shot images are shot with the same composition. When a user selects a photographed image with a certain composition as a retouching target and performs retouching, unselected images include an image with a composition similar to that of the retouched photographed image. By selecting which retouched photographed image to reflect the retouching contents on based on the face condition such as the face ratio, it is possible to apply the retouching according to the user's intention even to the unselected image.

The user can select images one by one and receive unselected images that have been retouched according to his/her intention without manually performing retouching. The user can efficiently adjust the appearance of the captured image.

The face ratio may be obtained by a method other than the method using the above equation (1). For example, the face ratio may be obtained based on the width of the frame F and the length of the long side of the image, or the face ratio may be obtained based on the area of the face range with respect to the area of the image. good.

When a plurality of faces are captured because there are a plurality of users as subjects, the average face ratio of each person may be used as the face ratio of the entire image.

The state of the face in the captured image may be represented by information other than the face ratio, and may be used as a reference for determining which captured image should be retouched. Face conditions such as face position, face orientation, face brightness, number of faces, etc. can be used. A plurality of pieces of information regarding the state of the face may be used in combination. That is, at least one of the size of the face including the face ratio, the position of the face, the orientation of the face, the brightness of the face, and the number of faces can be used as the state of the face.

It is also possible to select which photographed image to be retouched to reflect on the unselected image based on a criterion different from the face condition, such as face ratio. For example, selection may be made based on the condition of the eyes, or may be made based on the gender of the subject. At least one of eye size, eye position, and eye orientation can be used as the eye condition, similarly to the face condition.

It is also possible to select, based on the type of composition described above, which photographed image to be retouched to reflect on the unselected image.

<Configuration and operation of retouching PC 1>
Configuration of Retouching PC 1 FIG. 11 is a block diagram showing a configuration example of the retouching PC 1. As shown in FIG.

A CPU (Central Processing Unit) 101 , a ROM (Read Only Memory) 102 and a RAM (Random Access Memory) 103 are interconnected by a bus 104 .

An input/output interface 105 is further connected to the bus 104 . Input unit 106 , output unit 107 , storage unit 108 , communication unit 109 , and drive 110 are connected to input/output interface 105 .

The input unit 106 is composed of a keyboard, a mouse, and the like.

The output unit 107 is configured by the display 11 and the like.

Storage unit 108 is configured by a hard disk, a non-volatile memory, or the like. The storage unit 108 stores programs such as the retouching application 1A executed by the CPU 101 and various information such as captured images.

A communication unit 109 is an interface for networks such as the Internet and LAN. For example, the communication unit 109 communicates with a PC for storage connected to a camera in a photography studio, and receives a captured image in which a user who is about to start retouching is captured as a subject, which is transmitted from the PC for storage. . Further, the communication unit 109 communicates with the image management server 2 and transmits the retouched photographed image to the image management server 2 .

The drive 110 controls writing of data to the removable medium 111 and reading of data from the removable medium 111 . Captured images may be captured from the PC for storage via the removable media 111 .

FIG. 12 is a block diagram showing a functional configuration example of the retouching PC 1. As shown in FIG.

As shown in FIG. 12, in the retouching PC 1, an image processing section 121 is realized by executing the retouching application 1A. The retouching PC 1 is an image processing device having an image processing section 121 .

The image processing unit 121 includes an image acquisition unit 131 , a retouch processing unit 132 , an output control unit 133 and a display control unit 134 .

The image acquisition unit 131 receives a user's operation on the image selection screen, and acquires, from the storage unit 108, for example, a photographed image selected by the user as a retouch target. The captured image to be retouched acquired by the image acquisition unit 131 is supplied to the retouch processing unit 132 and the display control unit 134 .

Further, when the retouching of each captured image to be retouched is completed, the image acquisition unit 131 acquires an unselected image from the storage unit 108 , for example, and outputs the image to the retouch processing unit 132 .

The retouch processing unit 132 performs face recognition and recognizes the face appearing in the captured image to be retouched. The retouch processing unit 132 analyzes the features of each part of the recognized face, and performs various image processing related to retouching in accordance with the user's operation on the retouch screen. Analysis of features of each part may be performed using an inference model generated by machine learning.

For example, when an operation related to eye size or eye shape adjustment is performed, the retouch processing unit 132 performs image processing such as shifting the position of the eye contour according to the user's selection. Further, when an operation related to adjusting the density of makeup is performed, the retouch processing unit 132 synthesizes an image of blush of a predetermined color on the cheeks, or synthesizes an image of lipstick of a predetermined color on the lips. Image processing such as synthesis is performed.

The retouch processing unit 132 performs image processing such as adjusting the brightness of the skin when an operation related to skin quality adjustment is performed. The retouch processing unit 132 performs image processing such as shifting the position of the outline of the face according to the user's selection when an operation related to adjustment of the size of the face (appearance of a small face) or the shape of the face is performed.

Information representing the result of image processing by the retouch processing unit 132 is supplied to the display control unit 134 and used for displaying the retouch screen.

Further, when the retouching of each captured image to be retouched is completed, the retouch processing unit 132 analyzes each captured image including the unselected image as described above, and performs retouching on the retouched captured image. Apply the content to the unselected image. The captured image retouched by the retouch processing unit 132 is supplied to the output control unit 133 .

The output control unit 133 saves the photographed image that has been retouched according to the user's operation in the album folder.

The output control unit 133 also outputs the retouched captured images (the selected image and the unselected image) to the communication unit 109 and causes the image management server 2 to transmit them.

The display control unit 134 controls display of various screens of the retouching application 1A, such as an image selection screen and a retouching screen.

- Operation of retouching PC 1 The retouching process performed by the retouching application 1A will be described with reference to the flowchart of Fig. 13 .

In step S1, the display control section 134 of the image processing section 121 displays an image selection screen (FIG. 4).

In step S2, the image acquisition unit 131 accepts selection of a captured image to be retouched according to the user's operation on the image selection screen. The image acquisition unit 131 acquires a captured image to be retouched.

In step S3, the image acquisition unit 131 determines whether or not the selection of the captured image to be retouched is finished. If it is determined in step S3 that the selection of captured images to be retouched has not ended, the process returns to step S1 to continue image selection.

For example, when five captured images are selected and the end button 24 is pressed, it is determined in step S3 that the selection of captured images to be retouched is finished.

In step S4, the display control unit 134 displays the retouch screen (FIG. 5). The user uses the retouch screen to retouch the captured image.

In step S5, the retouch processing unit 132 performs image processing according to the user's operation, and retouches the captured image selected as the retouch target.

In step S6, the retouching processing unit 132 determines whether or not the retouching is finished. If it is determined in step S6 that retouching is not finished, the process returns to step S4, and retouching of each captured image selected as a retouching target is continued.

For example, when retouching is performed on all captured images selected as retouching targets and the end button 37 is pressed, it is determined in step S6 that the retouching is to end.

In step S7, the retouch processing unit 132 calculates face ratios of the selected image and the unselected image.

In step S8, the retouch processing unit 132 reflects, on each unselected image, the same retouch as that applied to the selected image for which the face ratio closest to the face ratio of the unselected image was calculated.

In step S9, the output control unit 133 saves the unselected image that has been retouched.

In step S<b>10 , the communication unit 109 transmits the retouched selected image and the unselected image to the image management server 2 . After that, the processing of the retouching application 1A ends.

Through the above processing, the user can adjust the appearance of the photographed image taken by himself/herself as the subject. The user can receive an album of photographed images in which he/she likes.

In addition, by using the mobile terminal 3, the user can automatically retouch the manually adjusted shot image managed by the image management server 2 and the same content as the manually adjusted content. The captured image (unselected image) can be received in the form of data.

<Modification>
・Example of retouching place It is assumed that retouching is performed using a PC installed in a photography studio, but retouching is performed using another device such as the mobile terminal 3 or a PC installed in the user's home. You may make it possible.

When retouching using the mobile terminal 3 is possible, the user who has finished shooting in the shooting studio operates the mobile terminal 3 to start the image management application 3A and retouch on the screen of the image management application 3A. will be performed. The image management application 3A has functions similar to those of the retouching application 1A.

The above-described screen is displayed on the display of the mobile terminal 3 by the image management application 3A, and the captured images uploaded to the image management server 2 are selected and retouched. Photographed images that have been retouched using the function of the image management application 3A are printed and provided to the user in the form of an album, or retouched photographed images are provided to the user as they are in the form of data.

This allows the user to retouch at various places such as home. Also, the user can retouch carefully without worrying about the time.

Switching Screen Display The retouching function described above can also be applied to retouching other captured images such as wedding commemorative photos. A photographed image of a wedding, for example, may include two users, the bride and groom.

In this case, it may be possible to select on the retouch screen whether the person on the left side of the image is to be retouched or the person on the right side is to be retouched. This makes it possible to apply different retouching parameters to the retouching of the groom and the bride. The groom and bride may be retouched simultaneously in one operation.

In this way, the display of the retouching screen and the type of retouching that can be used are switched according to the type of commemorative photo. The type of commemorative photo, such as coming-of-age ceremony photo, wedding photo, etc., may be selected before starting retouching.

・Warning of Overfilling As described above, the user can adjust the image of his/her own face according to his or her preference, and can so-called fill his/her own face in the photographed image. Commemorative photos, such as coming-of-age ceremony photos and wedding photos, are photos that will be remembered for a long time as important photos of life events.

In order to prevent such important photos from becoming too large (retouching degree is too high), if the degree of retouching selected by the user is larger than the threshold degree, a warning to that effect is displayed. may be displayed. The warning of overfilling is displayed on the retouching screen, for example, while the user is retouching.

A combination of retouches that would result in too much is set, and a warning may be displayed when the user tries to select such a retouch.

Uniformity of Image As described above, a predetermined number of photographic images, such as 5 or 10, for which the user has adjusted the image, are printed on photographic paper and provided to the user in the form of an album. If there is variation in the appearance of each photographed image, the uniformity of the album as a whole will be lost.

In order to prevent the uniformity of the album as a whole from being lost, the degree of retouching that can be selected may be limited. For example, one photographed image is selected as a reference, and the degree of retouching that can be selected is limited based on the content of retouching applied to the photographed image.

It may be possible to compare retouched captured images while performing retouching. When a predetermined operation is performed on the retouch screen, for example, retouched captured images are displayed side by side. As a result, it is possible to ensure uniformity in the appearance of each photographed image.

Others Although the number of images to be retouched can be selected as many as the number of prints, it is also possible to select a number of images larger than the number of prints. In this case, the user selects the photographed images that are actually printed and received in the form of an album from among the retouched photographed images.

Although still images are shot in the shooting studio, moving images may be shot. In this case, it is possible for the user to retouch the captured image by using the moving image as the captured image.

- Program The series of processes described above can be executed by hardware or by software. When a series of processes is executed by software, a program that constitutes the software is installed in a computer built into dedicated hardware or a general-purpose personal computer.

The program to be installed is provided by being recorded on removable media 111 shown in FIG. Alternatively, it may be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in the ROM 102 or storage unit 108 .

The program executed by the computer may be a program in which processing is performed in chronological order according to the order described in this specification, or a program in which processing is performed in parallel or at necessary timing such as when a call is made. It may be a program that is carried out.

The effects described herein are only examples and are not limiting, and other effects may also occur.

Embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and processed jointly.

Further, each step described in the flowchart above can be executed by one device, or can be shared by a plurality of devices and executed.

Furthermore, when one step includes a plurality of processes, the plurality of processes included in the one step can be executed by one device or shared by a plurality of devices.

1 retouching PC, 2 image management server, 3 portable terminal, 11 display, 121 image processing unit, 131 image acquisition unit, 132 retouching processing unit, 133 output control unit, 134 display control unit

Claims (9)

adjusting the appearance of each selected image, which is a part of the photographed images selected from among a plurality of photographed images obtained by photographing the user as a subject, according to an operation by the user;
The appearance of the selected image selected based on the state of the face appearing in each of the selected images and the state of the face appearing in the unselected image, which is the photographed image not selected as a subject of image adjustment. an image processing unit that reflects the content of the adjustment in each of the unselected images. 2. The image processing unit according to claim 1, wherein the selected image in which the face is shown in a state close to the state of the face shown in the unselected image is reflected in each of the unselected images. image processing device. 3. The image according to claim 1, wherein the image processing unit selects the selected images by reflecting the content of the adjustment of appearance in each of the unselected images, with the size of the user's face as the state of the face. processing equipment. The image processing unit selects the selected images by reflecting the content of the adjustment of appearance in each of the unselected images, using the ratio of the size of the user's face to the size of the image as the state of the face. 3. The image processing device according to 1 or 2. 5. The image processing apparatus according to any one of claims 1 to 4, further comprising a communication unit that transmits the selected image and the unselected image whose appearance has been adjusted to a server that manages images to be provided to the user. 6. The image processing device according to any one of claims 1 to 5, wherein the adjustment of the appearance of the selected image includes at least adjustment of the size and shape of the eyes and adjustment of the size and shape of the face. The image processing device according to any one of claims 1 to 6, wherein the image processing device is installed in a photography studio in which photography is performed with the user as a subject. The image processing device
adjusting the appearance of each selected image, which is a part of the photographed images selected from among a plurality of photographed images obtained by photographing the user as a subject, according to an operation by the user;
The appearance of the selected image selected based on the state of the face appearing in each of the selected images and the state of the face appearing in the unselected image, which is the photographed image not selected as a subject of image adjustment. an image processing method for reflecting the content of the adjustment in each of the unselected images. to the computer,
adjusting the appearance of each selected image, which is a part of the photographed images selected from among a plurality of photographed images obtained by photographing the user as a subject, according to an operation by the user;
The appearance of the selected image selected based on the state of the face appearing in each of the selected images and the state of the face appearing in the unselected image, which is the photographed image not selected as a subject of image adjustment. A program for executing a process of reflecting the content of the adjustment in each of the unselected images.

Images