KR102424986B1 - Electronic device and method for analysis of face information in electronic device - Google Patents

Abstract

The present invention relates to an electronic device and a method for analyzing face information in an electronic device, wherein at least one face region is detected in an image being photographed through a camera module, the detected at least one face region is photographed in detail, and the The detailed photographed face region may be analyzed according to at least one analysis item, and various other embodiments may be possible.

Description

ELECTRONIC DEVICE AND METHOD FOR ANALYSIS OF FACE INFORMATION IN ELECTRONIC DEVICE

Various embodiments of the present disclosure relate to an electronic device and a method of analyzing face information in the electronic device.

A variety of recently used electronic devices are being developed to use various functions. For example, an electronic device (eg, a smart phone) can provide a function of not only capturing an image but also recognizing a photographed object.

A display unit is provided in such an electronic device to use various functions more effectively. For example, in the case of a recent smart phone, a display unit (eg, a touch screen) in which a front part of the device responds to a touch is provided.

In addition, various applications (eg, also referred to as 'apps') may be installed and executed in the electronic device. In order to execute and control the applications on the electronic device, various input means (eg, a touch screen, a button, a mouse, a keyboard, a sensor, etc.) may be used.

In order to analyze an object (eg, a face region) being photographed, the electronic device may acquire an enlarged or detailed photographed image of the object. Meanwhile, in order to acquire the enlarged or detailed photographed image, the user may check an object to be photographed and check whether a detailed area of each object is in focus, thereby operating a photographing function of the electronic device.

According to various embodiments of the present disclosure, when face information (eg, a face region) is identified, the electronic device that magnifies the identified part or automatically focuses the corresponding part without any user's control operation. A device and a method of analyzing face information in an electronic device may be provided.

A method of analyzing face information in an electronic device according to various embodiments of the present disclosure includes detecting at least one face region among a plurality of face regions in an image being photographed through a camera module of the electronic device, and the at least one identifying at least one facial region corresponding to at least one of an oral region, a nose region, an eye region, a buccal region, and a forehead region on the face region based on a zoom-in or focusing setting of the camera module, the at least one face identifying at least one analysis item corresponding to the identification of the at least one facial region from among a plurality of analysis items based on the identification of the region; based on the identified at least one analysis item, the at least one analysis item Measuring at least one skin condition in the analysis item, acquiring information related to a skin analysis history corresponding to the at least one face region based on the measured at least one skin condition, and the skin analysis history; and displaying related information on a display of the electronic device.

An electronic device according to various embodiments of the present disclosure includes a camera module, a display for displaying an image being photographed through the camera module, and at least one processor electrically connected to the camera module and the display, wherein the at least one The processor of is configured to detect at least one facial region among a plurality of facial regions in the image, and based on a zoom-in or focusing setting of the camera module on the at least one facial region, an oral region, a nose region, an eye region, at least one facial region corresponding to at least one of the buccal region and the forehead region is identified, and based on the identification of the at least one facial region, at least one corresponding to the identification of the at least one facial region from among a plurality of analysis items identify one analysis item, measure at least one skin condition in the at least one analysis item based on the identified at least one analysis item, and determine the at least one skin condition based on the measured at least one skin condition It may be configured to obtain information related to a skin analysis history corresponding to one face region and control the display to display information related to the skin analysis history.

According to an electronic device and a method of analyzing face information in an electronic device according to various embodiments of the present disclosure, a user acquires an image in which a part of the face information is enlarged or photographed in detail through the electronic device without any action, and the acquisition You can check the result of analyzing one image.

1 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure.
2 to 4 are flowcharts illustrating various examples of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure.
5A to 5H are views illustrating various examples of a face region and various examples of a situation in which the face region is partially enlarged or photographed in detail, according to various embodiments of the present disclosure;
6 is a diagram illustrating various examples of face analysis items according to various embodiments of the present disclosure.
7 to 11 are diagrams illustrating various examples of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure.
12 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure.
13A to 13C are diagrams illustrating various examples of screens showing results of face analysis according to various embodiments of the present disclosure;
14 to 18 are diagrams illustrating various examples of screens showing results of skin analysis, according to various embodiments of the present disclosure.
19 is a diagram illustrating an example of a network environment according to various embodiments of the present disclosure.
20A to 20C are diagrams illustrating various examples of situations in which an electronic device performs face analysis, according to various embodiments of the present disclosure.
21 is a flowchart illustrating an example of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure.
22A and 22B are diagrams illustrating various examples of an operation of photographing for face analysis, according to various embodiments of the present disclosure.
23A and 23B are diagrams illustrating various examples of an operation of photographing for face analysis, according to various embodiments of the present disclosure.
24 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure.
25 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure.
26 is a diagram illustrating an example of an application screen for analyzing face information based on a stored image, according to various embodiments of the present disclosure;
27 to 35 are views illustrating various examples of screens showing results of face analysis according to various embodiments of the present disclosure.
36 is a diagram illustrating an example of an application screen showing a history of face information analyzed based on a stored image, according to various embodiments of the present disclosure;
37 to 45 are diagrams illustrating various examples of screens showing a history of analyzed face information, according to various embodiments of the present disclosure.
46 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure.
47A and 47B are views illustrating various examples of screens showing results of skin analysis.

Hereinafter, various embodiments of the present invention will be described in connection with the accompanying drawings. Various embodiments of the present invention can be made various changes and can have various embodiments, specific embodiments are illustrated in the drawings and the related detailed description is described. However, this is not intended to limit the various embodiments of the present invention to specific embodiments, and should be understood to include all changes and/or equivalents or substitutes included in the spirit and scope of various embodiments of the present invention. In connection with the description of the drawings, like reference numerals have been used for like components.

Expressions such as “includes” or “may include” that may be used in various embodiments of the present invention indicate the existence of a disclosed corresponding function, operation, or component, and may include one or more additional functions, operations, or components, etc. are not limited. In addition, in various embodiments of the present invention, terms such as "comprise" or "have" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, It should be understood that it does not preclude the possibility of addition or existence of one or more other features or numbers, steps, operations, components, parts, or combinations thereof.

In various embodiments of the present disclosure, expressions such as “or” include any and all combinations of words listed together. For example, “A or B” may include A, B, or both A and B.

Expressions such as “first,” “second,” “first,” or “second,” used in various embodiments of the present invention may modify various components of various embodiments, but limit the components. I never do that. For example, the above expressions do not limit the order and/or importance of corresponding components. The above expressions may be used to distinguish one component from another. For example, both the first user device and the second user device are user devices, and represent different user devices. For example, without departing from the scope of the present disclosure, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component.

When a component is referred to as being “connected” or “connected” to another component, the component may be directly connected to or connected to the other component, but with the component It should be understood that other new components may exist between the other components. On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it will be understood that no new element exists between the element and the other element. should be able to

Terms used in various embodiments of the present invention are only used to describe specific embodiments, and are not intended to limit various embodiments of the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by those of ordinary skill in the art to which various embodiments of the present invention pertain. Terms such as those defined in commonly used dictionaries should be interpreted as having meanings consistent with the meanings in the context of the related art, and unless explicitly defined in various embodiments of the present invention, ideal or excessively formal terms not interpreted as meaning

An electronic device according to various embodiments of the present disclosure may be a device including a camera module. For example, the electronic device includes a smart phone, a tablet personal computer, a mobile phone, a video phone, an e-book reader, a desktop personal computer, and a laptop. PC (laptop personal computer), netbook computer (netbook computer), PDA (personal digital assistant), PMP (portable multimedia player), MP3 player, mobile medical device, camera, or wearable device (eg: It may include at least one of a head-mounted-device (HMD) such as electronic glasses, an electronic garment, an electronic bracelet, an electronic necklace, an electronic accessory, an electronic tattoo, or a smart watch.

According to some embodiments, the electronic device may be a smart home appliance including a camera module. Smart home appliances include, for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, and a TV. It may include at least one of a box (eg, Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ), game consoles, an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

According to some embodiments, the electronic device includes a camera module, and various medical devices (eg, magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), computed tomography (CT), imagers, ultrasound machines, etc.), navigation ) devices, GPS receivers (global positioning system receivers), EDR (event data recorder), FDR (flight data recorder), automotive infotainment devices, marine electronic equipment (such as marine navigation devices and gyro compasses), avionics It may further include at least one of a device (avionics), a security device, a head unit for a vehicle, an industrial or household robot, an automatic teller's machine (ATM) of a financial institution, or a point of sales (POS) of a store.

According to some embodiments, the electronic device is a part of furniture or a building/structure including a camera module, an electronic board, an electronic signature receiving device, a projector, or various measurement devices. It may include at least one of devices (eg, water, electricity, gas, or radio wave measuring devices, etc.). The electronic device according to various embodiments of the present disclosure may be a combination of one or more of the various devices described above. Also, the electronic device according to various embodiments of the present disclosure may be a flexible device. Also, it is apparent to those skilled in the art that the electronic device according to various embodiments of the present disclosure is not limited to the above-described devices.

According to various embodiments of the present disclosure, facial information that can be analyzed by the electronic device may include skin information around a face region such as eyes, nose, forehead, cheeks, and the like.

According to various embodiments of the present disclosure, the electronic device may analyze skin information according to at least one analysis item. For example, items for analyzing facial information may include items for measuring various skin conditions such as pores, acne, pigmentation, skin tone, dark circles, and wrinkles.

According to various embodiments of the present disclosure, the operation of capturing detailed images by the electronic device may include focusing and enlarging and capturing an area in order to photograph a specific area in detail in a specific image.

Hereinafter, an electronic device according to various embodiments will be described with reference to the accompanying drawings. The term user used in various embodiments may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

1 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure. Referring to FIG. 1 , the electronic device 100 may include at least one of a control unit 110 , a camera module 120 , an input unit 130 , a display unit 140 , and a storage unit 150 .

The control unit 110 may include at least one of an item setting unit 111 , a photographing control unit 112 , an image analysis unit 113 , a region selection unit 114 , or an analysis result generation unit 115 , and the overall An operation of the electronic device 100 may be controlled.

The item setting unit 111 may identify a specific face region in the captured image, and select at least one item to analyze the skin around the identified face region. For example, when the area around the eyes is identified in the photographed image, the item setting unit 111 may set wrinkles or dark circles as items to analyze the skin condition of the area around the eyes. As another example, when the cheek area is identified in the photographed image, the item setting unit 111 may set pigmentation, spots, blemishes, skin tone, etc. as items to analyze the skin condition of the cheek area.

When a specific face region is identified in the shooting mode, the capturing controller 112 may control the camera module 120 to enlarge or capture the identified face region in detail. For example, the photographing control unit 112 sets the focusing or zooming on at least one area identified as the face area in the photographed image checked through the camera module 120 to photograph the camera module 120 . ) can be controlled.

The image analyzer 113 may select at least one item to be analyzed with respect to a specific face area in the image, and analyze the face area for each selected item. For example, the image analyzer 113 may analyze the area around the eyes identified in the photographed image for each selected item (eg, wrinkles or dark circles). For example, the image analysis unit 113 may analyze the depth or number of wrinkles in the identified area around the eyes, or the width or color of dark circles.

The region selector 114 may determine whether a face region is identified in a specific image. According to various embodiments of the present disclosure, when a specific face region is identified, the region selector 114 may control the camera module 120 to focus or zoom on the corresponding face region to take a picture.

The analysis result generation unit 115 may check the result of the face information analyzed by the image analysis unit 113 , and control to generate and display a screen including the verified result.

According to various embodiments of the present disclosure, the analysis result generating unit 115 may generate a screen of analyzed face information by expressing analysis items or analysis results for each face region in various ways. For example, the analysis result generating unit 115 may generate a screen of face information so that each analysis item is divided into colors such as red for acne or blue for pigmentation. In addition, the analysis result generating unit 115 may generate a screen of face information by confirming the previous analysis result, displaying the area of the improved part in green or blue, and displaying the deteriorated face area in red.

According to various embodiments of the present disclosure, when an area corresponding to a specific face area or a color-coded area according to an analysis item or analysis result is selected from a photographed image, the analysis result generating unit 115 is configured to display the selected face area. It is possible to provide detailed photographed or analyzed images for For example, the analysis result generating unit 115 may control the display unit 140 to display the generated image.

The camera module 120 may capture an image. According to various embodiments of the present disclosure, the camera module 120 may be controlled by the controller 110 to focus and enlarge an area identified as a specific face area.

The display unit 140 may display an image being photographed through the camera module.

According to various embodiments of the present disclosure, when a specific area is selected from the displayed image, the display unit 140 may display an enlarged or detailed photographed image for the corresponding area. For example, the enlarged image may be captured by enlarging the selected area as the electronic device selects a specific area. The detailed photographed image may be captured by focusing and enlarging the selected area as the electronic device selects a specific area.

The storage unit 150 may include skin analysis information 151 or user identification information 152 . The skin analysis information 151 may include skin analysis information of a specific face region according to an analysis item.

The skin analysis information 151 may include information obtained by analyzing skin conditions around a specific area for each item. For example, the skin analysis information 151 includes information on which skin deposition, skin tone, spots, or presence of acne in a specific facial region are analyzed, information for each previously analyzed item, or a skin analysis result for each facial region in chronological order. It may include historical information displayed as .

The user identification information 152 may include face information for a specific user. For example, the image analyzer 113 may use the user identification information 152 to compare the 'eye' area identified in the captured image with the previously stored 'eyes' of another user. The user identification information 152 includes, based on the comparison result of the image analysis unit 113, an analysis result for a face region identified in the photographed image in face information about a user including the same face region and stores it. can

For example, the electronic device according to various embodiments of the present disclosure may include a camera module, a display unit for displaying an image being photographed through the camera module, and at least one face region from the image, and the detected at least one face and a controller that controls the camera module to capture a detailed area and analyzes the detailed photographed face area according to at least one analysis item.

The at least one face region according to various embodiments of the present disclosure may include a peripheral region of at least one of eyes, nose, cheeks, mouth, and forehead.

The at least one analysis item according to various embodiments of the present disclosure may include at least one of wrinkles, acne, pigmentation, skin tone, dark circles, and pores.

The controller according to various embodiments of the present disclosure may analyze at least one of a thickness, a size, a number, an area, or a color for each analysis item in the detailed photographed face region.

When detecting that a gesture is input to a specific region in the image, the controller according to various embodiments of the present disclosure may control the display unit to display a detailed photographed image for the region in which the gesture is detected. .

The controller according to various embodiments of the present disclosure may detect a face region for at least one preset analysis item from the image, and analyze the detected face region according to the preset analysis item.

The controller according to various embodiments of the present disclosure may control the display unit to display a screen for the detailed photographed face region while the at least one face region is detected.

When a preset motion is detected, the controller according to various embodiments of the present disclosure may control the camera module to photograph the detected at least one face region in detail.

The preset operation according to various embodiments of the present disclosure may include any one of an operation of executing an application for which a camera module is activated, an operation of activating the electronic device in a locked state, and an operation of positioning the electronic device at a specific angle or direction. may contain one.

The controller according to various embodiments of the present disclosure may check a pre-stored analysis result for a specific face region or analysis item, compare the checked pre-stored analysis result with the analysis result, and compare the result of the comparison. The display unit may be controlled to display a screen including

2 is a flowchart illustrating an example of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure. Referring to FIG. 2 , in operation 210 , the electronic device may detect a face region from a photographed image.

In operation 220, the electronic device may select an analysis item from the photographed face region.

In operation 230, the electronic device may take a detailed photograph of the selected item. For example, the electronic device may focus and enlarge the selected item to take a picture.

In operation 240, the electronic device may analyze a detailed captured image. According to various embodiments of the present disclosure, the electronic device may compare the detailed captured image with a previously stored result value. For example, the electronic device may analyze a face region corresponding to the detailed captured image by comparing it with a previously stored result value.

According to various embodiments of the present disclosure, when a user takes an image including a face region, the image output according to the shooting includes an enlarged or detailed image of each face region included in the captured image, or An image including an analysis result of the enlarged or detailed photographed image may be included. For example, as a user captures a face region, the user acquires an analysis result for the enlarged or detailed image along with an enlarged or detailed photographed image of each face region without performing an additional operation for a separate facial analysis can do.

At least one operation among the operations illustrated in FIG. 2 may be omitted and executed, and at least one other operation may be added between the operations. In addition, the operations of FIG. 2 may be processed in the illustrated order, or the execution order of at least one operation may be changed from the execution order of other operations.

For example, a method for analyzing face information in an electronic device according to various embodiments of the present disclosure includes an operation of detecting at least one face region in an image being photographed through a camera module, and detailing the detected at least one face region. It may include an operation of photographing and an operation of analyzing the detailed photographed face region according to at least one analysis item. The at least one face region may include a peripheral region of at least one of eyes, nose, cheeks, mouth, and forehead. The at least one analysis item may include at least one of wrinkles, acne, pigmentation, skin tone, dark circles, and pores.

The analyzing operation according to various embodiments of the present disclosure may include analyzing at least one of a thickness, a size, a number, an area, or a color for each analysis item in the detailed photographed face region.

In a method for analyzing face information in an electronic device according to various embodiments of the present disclosure, when a gesture is input to a specific region in the image, displaying a detailed photographed image for the region in which the gesture is detected is performed. may include more.

A method of analyzing face information in an electronic device according to various embodiments of the present disclosure includes detecting a face region for at least one preset analysis item in the image, and using the detected face region as the preset analysis item. It may further include an operation of analyzing according to the .

The method of analyzing face information in an electronic device according to various embodiments of the present disclosure may further include displaying a screen in which the detected face region is photographed in detail while the at least one face region is detected.

The method of analyzing face information in an electronic device according to various embodiments of the present disclosure may further include, when a preset motion is sensed, photographing the detected at least one face region in detail. The preset operation may include any one of an operation of executing an application in which the camera module is activated, an operation of activating the electronic device in a locked state, and an operation of positioning the electronic device at a specific angle or direction.

A method of analyzing face information in an electronic device according to various embodiments of the present disclosure includes an operation of checking a pre-stored analysis result for a specific face region or analysis item, and an operation of using the checked pre-stored analysis result of the analysis. The method may further include comparing with the result and displaying the result of the comparison.

3 is a flowchart illustrating an example of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure. Referring to FIG. 3 , in operation 310 , the electronic device may detect a face region from a photographed image.

In operation 320, the electronic device may identify at least one focused area in the photographed face area.

In operation 330, the electronic device may control to enlarge or take a detailed photograph of at least one focused area. For example, as the focused area is enlarged or photographed in detail, the output image may be photographed after a specific area is enlarged or photographed after a specific area is focused and enlarged.

According to various embodiments of the present disclosure, in operation 320, the electronic device starts to check at least one focused region, but as soon as the electronic device detects the face region in the image captured in operation 310, It is also possible to control to enlarge or detail the detected face region. In this case, operation 320 may be omitted.

At least one operation among the operations shown in FIG. 3 may be omitted and executed, and at least one other operation may be added between the operations. Also, the operations of FIG. 3 may be processed in the illustrated order, or the execution order of at least one operation may be changed from the execution order of other operations.

4 is a flowchart illustrating an example of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure. Referring to FIG. 4 , in operation 410 , the electronic device may determine whether any application is executed in the non-capturing mode.

In operation 420, the electronic device may determine whether a preset user input is detected.

As a result of the determination, when a preset user input is not detected, the electronic device may perform operation 410 again.

As a result of the determination, when a preset user input is detected, in operation 430 , the electronic device may control the camera module to operate in the background.

In operation 440, the electronic device may determine whether a face region is identified in the captured image.

As a result of the determination, when the face region is not identified, the electronic device may perform operation 410 again.

When the face region is identified as a result of the determination, in operation 450 , the electronic device may select at least one analysis item for the identified image. For example, the at least one analysis item in the image may include at least one of items for measuring various skin conditions such as pores, acne, pigmentation, skin tone, dark circles, wrinkles, etc. can

In operation 460 , the electronic device may control the camera module to enlarge or detail the selected item.

In operation 470, the electronic device may analyze the detailed captured image.

At least one operation among the operations illustrated in FIG. 4 may be omitted, and at least one other operation may be added between the operations. In addition, the operations of FIG. 4 may be processed in the illustrated order, or the execution order of at least one operation may be changed from the execution order of other operations.

5A to 5H are views illustrating various examples of a face region and various examples of a situation in which the face region is partially enlarged or photographed in detail, according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, it is assumed that the electronic device is capturing the entire face. The electronic device may identify at least one face region in the image 500 being photographed.

Referring to FIG. 5A , in the image 500 being photographed, the electronic device displays a forehead 501 , a right eye 502 , a left eye 506 , a nose 503 , a periphery of a mouth 504 , a cheek 505 or At least one of the faces 507 may be identified.

According to various embodiments of the present disclosure, when checking at least one face region in the image 500 being photographed, the electronic device may zoom the region to capture a partially enlarged or detailed photographed image of the region.

Referring to FIG. 5B , the electronic device may check the forehead 501 in the image 500 being photographed, and zoom the area of the forehead 501 to partially enlarge or take a detailed photograph. The electronic device may acquire skin analysis information based on at least one analysis item from an image obtained by partially magnifying the forehead 501 . For example, the skin analysis information may include information on the wrinkles 501a in the forehead 501 region.

Referring to FIG. 5C , the electronic device may identify the right eye 502 in the image 500 being photographed, and zoom the area of the right eye 502 to partially enlarge or take a detailed photograph. The electronic device may obtain skin analysis information based on at least one analysis item from the image obtained by partially magnifying the right eye 502 region. For example, the skin analysis information may include information about the wrinkle 502a in the right eye 502 region.

Referring to FIG. 5D , the electronic device may identify the nose 503 in the image 500 being photographed, and zoom the area of the nose 503 to partially enlarge or take a detailed photograph. The electronic device may acquire skin analysis information based on at least one analysis item from the image obtained by partially magnifying the nose 503 region. For example, the skin analysis information may include information on the pores 503a in the nose 503 region.

Referring to FIG. 5E , the electronic device may check the periphery of the mouth 504 in the image 500 being photographed, and zoom the region around the mouth 504 to partially enlarge or take a detailed image. The electronic device may acquire skin analysis information based on at least one analysis item from the image obtained by partially magnifying the area around the mouth 504 . For example, the skin analysis information may include information about the skin deposition 504a in the area around the mouth 504 .

Referring to FIG. 5F , the electronic device may identify the ball 505 in the image 500 being photographed, and zoom the area of the ball 505 to partially enlarge or take a detailed photograph. The electronic device may acquire skin analysis information based on at least one analysis item from the image obtained by partially magnifying the cheek area 505 . For example, the skin analysis information may include information on the acne 505a in the cheek 505 region.

Referring to FIG. 5G , the electronic device may identify the left eye 506 in the image 500 being photographed, and zoom the area of the left eye 506 to partially enlarge or take a detailed photograph. The electronic device may obtain skin analysis information based on at least one analysis item from the image obtained by partially magnifying the left eye 506 region. For example, the skin analysis information may include information on the dark circle 506a in the left eye 506 region.

Referring to FIG. 5H , the electronic device may identify a face 507 in the image 500 being photographed, and zoom a region of the face 507 to partially enlarge or take a detailed photograph. The electronic device may obtain skin analysis information based on at least one analysis item from the image obtained by partially magnifying the face 507 region. For example, the skin analysis information may include information about the skin tone 507a in the face 507 region.

6 is a diagram illustrating various examples of face analysis items according to various embodiments of the present disclosure. Referring to FIG. 6 , the electronic device has captured an image 600 including at least one face region, and may identify at least one analysis item in the captured image 600 . For example, the electronic device may identify acne 601 , wrinkles 602 , or pigmentation 603 as an analysis item.

7 is a diagram illustrating an example of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure. Referring to FIG. 7 , the electronic device may analyze the pigmentation 711 among the analysis items in the photographed image 710 .

According to various embodiments of the present disclosure, the electronic device may generate an image 720 in which a color of a pigmented portion in a photographed image is inverted. The electronic device may identify the region in which the color is inverted in the 720 image to identify at least one pigmented portion 721 . For example, according to the number of the at least one pigmented portion, the electronic device may determine whether pigmentation is worse or improved than before.

8 is a diagram illustrating an example of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure. Referring to FIG. 8 , the electronic device may analyze acne 811 among the analysis items in the captured image 810 .

According to various embodiments of the present disclosure, the electronic device may generate an image 820 in which a color of a portion in which acne is identified in a photographed image is inverted. For example, the electronic device may identify at least one pimple 821 by identifying an area in which the color is inverted in the 820 image. For example, the electronic device may determine whether acne has increased or decreased compared to before, according to the number of the at least one acne.

9 is a diagram illustrating an example of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure. Referring to FIG. 9 , the electronic device may analyze the pores 911 among the analysis items in the captured image 910 .

According to various embodiments of the present disclosure, the electronic device may generate an image 920 in which a color of a portion identified as a pore in the photographed image is darkened. For example, the electronic device may identify the at least one pore by checking the darkened region 921 in the 920 image. For example, the electronic device may determine whether the number of pores has increased or decreased compared to before, according to the number of the at least one pores.

10 is a diagram illustrating an example of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure. Referring to FIG. 10 , the electronic device may analyze the wrinkles 1001 among the analysis items in the photographed image 1000 .

According to various embodiments of the present disclosure, the electronic device may cause the wrinkle line 1001 to appear in a portion identified as a wrinkle in the captured image 1000 . For example, the electronic device may check at least one wrinkle line 1001 in the photographed image 1000 to determine whether a wrinkle is present.

According to various embodiments of the present disclosure, the electronic device may check the thickness or number of at least one wrinkle line appearing in a photographed image. For example, the electronic device may determine whether wrinkles are deeper than before according to the thickness of the at least one wrinkle line, and may determine whether wrinkles have increased or decreased compared to before according to the number of wrinkle lines.

11 is a diagram illustrating an example of an operation of analyzing a face analysis item, according to various embodiments of the present disclosure. Referring to FIG. 11 , the electronic device may analyze a skin tone 1101 among analysis items in a photographed image 1100 .

According to various embodiments of the present disclosure, the electronic device may set a part of skin in the captured image 1100 as the skin tone analysis area 1101 . For example, the electronic device may identify at least one skin tone analysis area 1101 in the captured image 1100 and compare it with a previously measured skin tone value or obtain a measurement value for the skin tone analysis area.

According to various embodiments of the present disclosure, the electronic device may analyze the skin tone analysis region 1101 in the captured image. For example, the electronic device may measure the color, contrast, brightness, color temperature, etc. of the corresponding skin tone analysis region to determine whether the skin tone looks duller or brighter than the previously measured skin tone.

12 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure. 12 , it is assumed that the electronic device captures a face region for face analysis.

According to various embodiments of the present disclosure, the electronic device may check characteristics (eg, resolution, image size, white balance, etc.) of an image currently being photographed. The electronic device may compare characteristics of a currently captured image with characteristics of a previously captured image. For example, when characteristics (eg, white balance) of a previously photographed image are not similar, the electronic device may synchronize characteristics of the currently photographed image similarly to before.

Referring to FIG. 12 , the electronic device may display a screen 1210 indicating that white balance is being matched with a previously captured image. Thereafter, when the characteristics of the currently photographed image are synchronized with the characteristics of the previously photographed image, the electronic device may display a screen 1220 informing that white balance synchronization is completed and photographing is possible.

According to various embodiments of the present disclosure, through the screen 1220, the user may confirm that the current photographing situation in the electronic device and the previous photographing situation of the image for face analysis have been set similarly. According to various embodiments of the present invention as described above, it is possible to prevent a situation in which analysis results for face information may be different due to lighting, indoor/outdoor status, weather, etc. despite the same skin condition.

13A to 13C are diagrams illustrating various examples of screens showing results of face analysis according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, when at least one face region is identified in a captured image, the electronic device may control the at least one face region to be enlarged or captured in detail. For example, the electronic device may generate the analysis result screen 1300 including the photographed enlarged or detailed photographed area in the corresponding face area in the photographed image. For example, the analysis result screen 1300 may include an enlarged or detailed photographed area for each of the eyes 1310 , the nose 1320 , and the cheeks 1330 identified as at least one face area.

Referring to FIG. 13A , the user may select an eye 1310 on the analysis result screen 1300 . According to various embodiments of the present disclosure, the electronic device may output an enlarged or detailed photographed image of the eye 1310 . For example, in the enlarged or detailed photographed image of the eye 1310 , a line indicating at least one wrinkle 1310 around the eye may be displayed.

Referring to FIG. 13B , the user may select the nose 1320 on the analysis result screen 1300 . According to various embodiments of the present disclosure, the electronic device may output an enlarged or detailed photographed image of the nose 1320 . For example, in the image in which the nose 1320 is enlarged or photographed in detail, at least one pimple 1321 around the nose may be displayed.

Referring to FIG. 13C , the user may select a ball 1330 from the analysis result screen 1300 . According to various embodiments of the present disclosure, the electronic device may output an enlarged or detailed photographed image of the ball 1330 . For example, in an enlarged or detailed photographed image of the cheek 1330 , the color of at least one pigmented portion 1331 around the cheek may be highlighted and displayed.

14 is a diagram illustrating an example of a screen showing a result of skin analysis, according to various embodiments of the present disclosure; Referring to FIG. 14 , the analysis result screen 1410 may include a skin analysis history view 1411 selection item that compares and shows previous results for each analysis item.

According to various embodiments of the present disclosure, when the skin analysis history view 1411 is selected, the electronic device may switch to the skin analysis history screen 1420 .

The skin analysis history screen 1420 according to various embodiments of the present disclosure includes skin analysis items (eg, skin tone, acne, wrinkles, pigmentation, pores, etc.) measured during a specific period (eg, between June and August). ), the result value for each can be compared with the previous one.

For example, the skin tone measurement result 1421 may show that the skin tone has become brighter than before. The acne measurement result 1422 may show that acne has increased compared to before. The wrinkle measurement result 1423 may show that the number of wrinkles is similar to the previous one. The pigmentation measurement result 1424 may show that the color of the pigmented portion has become lighter as compared to before. The pore measurement result 1425 may show that pores have increased compared to before.

15 is a diagram illustrating an example of a screen showing a skin analysis result, according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, the electronic device may analyze a specific facial region and recommend a method for improving the corresponding facial region according to the analysis result.

Referring to FIG. 15 , the electronic device may check the eye area in a photographed image 1510 , analyze the skin condition around the eye, and display the analysis result. For example, as a result of the analysis, the electronic device may identify new wrinkles around the eyes of a specific user or that the number of wrinkles increases compared to before.

According to various embodiments of the present disclosure, the electronic device may provide a skin care recommendation screen 1520 including a method for improving wrinkles. For example, when the user selects the wrinkle display 1511 from the captured image 1510 , the electronic device may switch the screen displaying the captured image 1510 to the skin care recommendation screen 1520 .

According to various embodiments of the present disclosure, the skin care recommendation screen 1520 is for recommending a cosmetic 1521 good for wrinkles, an execution button 1522 for searching for more eye cream, or a massage method good for wrinkles around the eyes. It may include an action button 1523 . For example, the cosmetic 1521 good for wrinkles may include ** eye cream (1521a), ## cream (1521b), or oo eye cream (1521c), etc. It may further include an action button that can be ordered.

16 is a diagram illustrating an example of a screen showing a skin analysis result, according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, the electronic device may analyze a specific facial region and recommend a method for improving the corresponding facial region according to the analysis result. For example, as a result of the analysis, the electronic device may identify a part in which the skin tone is changed around the cheek of a specific user.

Referring to FIG. 16 , the electronic device may check the periphery of the cheek in the captured image 1610 and display the skin tone analysis area 1611 in which the skin tone for a specific area of the cheek is analyzed.

According to various embodiments of the present disclosure, the electronic device may provide a skin care recommendation screen 1620 including a method for improving skin tone. For example, when the user selects the skin tone analysis area 1611 from the captured image 1610 , the electronic device may convert a screen displaying the captured image 1610 to the skin care recommendation screen 1620 .

According to various embodiments of the present disclosure, the skin care recommendation screen 1620 may include a mask pack 1621 good for skin tone improvement or an execution button 1622 for searching for more mask packs. For example, the mask pack 1621 that is good for skin tone improvement may include a **mask pack 1621a or a ㅁ mask pack 1621b, etc. It may further include an action button for ordering a pack, and the like.

17 is a diagram illustrating an example of a screen showing a result of skin analysis, according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, the electronic device may analyze a specific facial region and provide an advertisement screen of a product capable of improving the corresponding facial region according to the analysis result.

Referring to FIG. 17 , the electronic device may identify at least one pimple around the cheek and around the cheek in a captured image 1710 , and highlight the identified pimple 1711 .

According to various embodiments of the present disclosure, the electronic device may provide an advertisement screen 1720 for advertising a product capable of improving acne. For example, when the user selects the pimple 1711 displayed in the photographed image 1710 , the electronic device may convert a screen displaying the photographed image 1710 to the advertisement screen 1720 .

According to various embodiments of the present disclosure, the advertisement screen 1720 may include a detailed view execution button 1721 that is converted to an advertisement for an acne treatment or an explanation screen for the acne treatment.

18 is a diagram illustrating an example of a screen showing a result of skin analysis, according to various embodiments of the present disclosure;

According to various embodiments of the present disclosure, the electronic device may analyze a specific facial region and recommend a method for improving the corresponding facial region according to the analysis result.

Referring to FIG. 18 , the electronic device may identify a nose in a captured image 1810 and display a pore analysis area 1811 in which the number of pores in the nose is analyzed.

According to various embodiments of the present disclosure, the electronic device may provide a skin care recommendation screen 1820 including a method for reducing the number of pores. For example, when the user selects the pore analysis area 1811 from the captured image 1810 , the electronic device may convert a screen showing the captured image 1810 to the skin care recommendation screen 1820 .

According to various embodiments of the present disclosure, the skin care recommendation screen 1820 may include information 1821 of a dermatology hospital famous for pore treatment or an advertisement 1822 of a specific dermatology hospital. For example, the advertisement 1822 of the dermatology hospital may include a shortcut execution button for switching to a screen displaying the subject of the dermatology or an information screen of the dermatology hospital.

19 is a diagram illustrating an example of a network environment according to various embodiments of the present disclosure. Referring to FIG. 19 , the network environment 1900 may include at least one electronic device 1901 or 1904 or a server 1906 , the at least one electronic device 1901 or 1904 and the server 1906 . ) may be connected via a network 1962 .

The electronic device 1901 may include a bus 1910 , a processor 1920 , a memory 1930 , an input/output interface 1940 , a display 1950 , a communication interface 1960 , and a camera module 1970 .

The bus 1910 may be a circuit that connects the aforementioned components to each other and transmits communication (eg, a control message) between the aforementioned components.

The processor 1920 includes, for example, the above-described other components (eg, the memory 1930 , the input/output interface 1940 , the display 1950 , the communication interface 1960), or the camera module 1970, etc.) may receive a command, decode the received command, and execute an operation or data processing according to the decoded command.

The processor 1920 may control the overall operation of the electronic device 1901 . According to various embodiments of the present disclosure, the processor 1920 may include at least one controller (eg, the controller 110 ).

The memory 1930 is, from the processor 1920 or other components (eg, the input/output interface 1940, the display 1950, the communication interface 1960, the camera module 1970, etc.) may store instructions or data received or generated by the processor 1920 or other components. The memory 1930 may include, for example, programming modules such as a kernel 1931 , middleware 1932 , an application programming interface (API) 1933 , or an application 1934 . Each of the above-described programming modules may be configured by software, firmware, hardware, or a combination of at least two or more thereof.

The kernel 1931 is the other programming modules, for example, the middleware 1932, the API 1933, or system resources used to execute an operation or function implemented in the application 1934 (eg : The bus 1910, the processor 1920, the memory 1930, etc.) can be controlled or managed. In addition, the kernel 1931 may provide an interface for accessing and controlling or managing individual components of the electronic device 1901 from the middleware 1932 , the API 1933 , or the application 1934 . have.

The middleware 1932 may perform an intermediary role so that the API 1933 or the application 1934 communicates with the kernel 1931 to exchange data. In addition, in relation to the work requests received from the application 1934 , the middleware 1932 provides, for example, a system resource (eg: Control (eg, scheduling or load balancing) of work requests is performed using a method such as assigning priorities that can use the bus 1910, the processor 1920, or the memory 1930. can

The API 1933 is an interface for the application 1934 to control functions provided by the kernel 1931 or the middleware 1932, for example, file control, window control, image processing or character control, etc. It may include at least one interface or function (eg, command) for

According to various embodiments, the application 1934 is an SMS/MMS application, an e-mail application, a calendar application, an alarm application, a health care application (eg, an application for measuring the amount of exercise or blood sugar) or an environment information application ( For example: applications that provide barometric pressure, humidity or temperature information, etc.). Additionally or alternatively, the application 1934 may be an application related to information exchange between the electronic device 1901 and an external electronic device (eg, the electronic device 1904). The application related to the information exchange may include, for example, a notification relay application for delivering specific information to the external electronic device, or a device management application for managing the external electronic device. can

For example, the notification delivery application transmits notification information generated by another application (eg, SMS/MMS application, e-mail application, health care application, or environment information application, etc.) of the electronic device 1901 to an external electronic device (eg, electronic device 1904). Additionally or alternatively, the notification delivery application may receive notification information from, for example, an external electronic device (eg, the electronic device 1904) and provide the notification information to the user. The device management application is, for example, a function for at least a part of an external electronic device (eg, the electronic device 1904) that communicates with the electronic device 1901 (eg, the external electronic device itself (or some component parts) ) turn on/off or adjust the brightness (or resolution) of the display), and manage (eg, install) an application running on the external electronic device or a service (eg, call service or message service) provided by the external electronic device , delete or update).

According to various embodiments, the application 1934 may include an application designated according to a property (eg, type of electronic device) of the external electronic device (eg, electronic device 1904). For example, when the external electronic device is an MP3 player, the application 1934 may include an application related to music reproduction. Similarly, when the external electronic device is a mobile medical device, the application 1934 may include an application related to health care. According to an embodiment, the application 1934 may include at least one of an application designated to the electronic device 1901 or an application received from an external electronic device (eg, the server 1906 or the electronic device 1904). .

The input/output interface 1940 receives commands or data input from a user through an input/output device (eg, a sensor, a keyboard, or a touch screen), for example, the processor 1920 and the memory through the bus 1910 . 30 , the communication interface 1960 , or the camera module 1970 . For example, the input/output interface 1940 may provide data on a user's touch input through a touch screen to the processor 1920 . In addition, the input/output interface 1940 is, for example, received from the processor 1920, the memory 1930, the communication interface 1960, or the camera module 1970 through the bus 1910. A command or data may be output through the input/output device (eg, a speaker or a display). For example, the input/output interface 1940 may output voice data processed through the processor 1920 to the user through a speaker.

The display 1950 may display various types of information (eg, multimedia data or text data, etc.) to the user.

The communication interface 1960 may connect communication between the electronic device 1901 and an external device (eg, the electronic device 1904 or the server 1906). For example, the communication interface 1960 may be connected to the network 1962 through wireless communication or wired communication to communicate with the external device. The wireless communication is, for example, Wifi (wireless fidelity), BT (Bluetooth), NFC (near field communication), GPS (global positioning system) or cellular communication (eg, LTE, LTE-A, CDMA, WCDMA, UMTS) , WiBro, GSM, etc.). The wired communication may include, for example, at least one of universal serial bus (USB), high definition multimedia interface (HDMI), recommended standard 232 (RS-232), and plain old telephone service (POTS).

The camera module 1970 is controlled by information obtained from other components (eg, the processor 1920, the memory 1930, the input/output interface 1940, the communication interface 1960, etc.) Accordingly, by zooming the image being photographed, a specific area may be enlarged or photographed in detail.

According to an embodiment, the network 1962 may be a telecommunications network. The communication network may include at least one of a computer network, the Internet, the Internet of things, and a telephone network. According to an embodiment, a protocol (eg, a transport layer protocol, a data link layer protocol, or a physical layer protocol) for communication between the electronic device 1901 and an external device includes an application 1934 , an API 1933 , and the middleware ( 1932), the kernel 1931, or the communication interface 1960 may be supported.

According to various embodiments of the present disclosure, the electronic device may calculate the lighting environment of the image being photographed using an auto white balance function. For example, the electronic device may photograph an image so that a uniform white balance is set using the calculated lighting environment. Also, even in a photographing environment in which there is no external light source, an image may be photographed such that a white balance is set collectively by adjusting a light source (eg, an LED light source) included in the electronic device.

Meanwhile, in the case of photographing by setting the white balance according to the automatic white balance setting function, the face region in the photographed image may be photographed with a different color set according to the white balance set corresponding to each photographed image.

In addition, in order to collectively set the color of the face region for several images, the external light source may be blocked and only the light source included in the electronic device may be used. However, the electronic device including the light source for implementing the method is not portable. It can be large and heavy.

According to various embodiments of the present disclosure, the electronic device may include a front camera or a rear camera. For example, when capturing an image using the front camera, the rear camera may calculate a photographing environment and set a white balance of the image to be photographed so that the image may be photographed in a predetermined photographing environment. A detailed description thereof will be described later with reference to FIGS. 20A to 21 .

20A to 20C are diagrams illustrating various examples of situations in which an electronic device performs face analysis, according to various embodiments of the present disclosure. 20A to 20C , the electronic device may include a front camera 2001 or a rear camera 2002, and the rear camera 2002 may include a color balance card 2003. can

According to various embodiments of the present disclosure, a lighting component of the surrounding environment being photographed may be detected through the color balance card 2003 . For example, the color balance card 2003 may be equipment for photographing an accurate color of lighting using the reflected property of light, or equipment used for color correction. For example, although the color balance card 2003 is exemplified as being included in the rear camera 2002, it may be included in various camera modules interworking with electronic devices.

According to various embodiments of the present disclosure, the electronic device may determine that the brightness of an image acquired through at least one camera module (eg, the front camera 2001 or the rear camera 2002) is abnormal. For example, the case in which it is determined that the brightness of the image is abnormal may include a case in which illumination is brighter or darker than a set value or a case in which a face region cannot be obtained.

According to various embodiments of the present disclosure, when the electronic device determines that the brightness of the image is abnormal, the electronic device determines that it is difficult to acquire the image and uses the camera module (eg, the front camera 2001 or the rear camera 2002). You can control so that the image being shot is not saved.

Also, according to various embodiments of the present disclosure, when it is determined that the brightness of the image is abnormal, the electronic device may control to display a screen indicating that the shooting situation is abnormal or output a sound notification. Accordingly, the user may move the electronic device to a position where normal photographing is possible, and then, when it is determined that normal photographing is possible, the user may control to output a screen or sound indicating that photographing is possible again.

Referring to FIG. 20A , the electronic device may obtain an image including a face region through the front camera 2001 and calculate a lighting component through the color balance card 2003 of the rear camera 2002 .

According to various embodiments of the present disclosure, the electronic device may apply the calculated illumination component to an image obtained by including the face region. For example, the image to which the calculated illumination component is applied may be photographed to correspond to the white balance of the face region of the previously stored image as the white balance is set regardless of the surrounding illumination component.

Referring to FIG. 20B , it is assumed that the electronic device is capturing an image using the front camera 2001 . For example, the electronic device may analyze an image being photographed through the front camera 2001 .

According to various embodiments of the present disclosure, the electronic device may determine whether the lighting environment being photographed is an extreme lighting environment (eg, backlight, low light, or too bright light) according to a result of analyzing the image. For example, when it is determined that the situation being photographed through the front camera 2001 is an extreme lighting environment, the electronic device does not store the image being photographed through the front camera 2001 or controls the front camera 2001 . This can be controlled so that the shooting function is not activated.

According to various embodiments of the present disclosure, when it is determined that the photographing situation through the front camera 2001 is an abnormal lighting environment, the white balance is calculated through the color balance card 2003 and the calculated white balance value is used as the It can be applied to an image being photographed through the front camera 2001 .

Referring to FIG. 20C , it is assumed that the electronic device is capturing an image using the rear camera 2002 . For example, the electronic device may analyze an image being photographed through the rear camera 2002 .

According to various embodiments of the present disclosure, the electronic device may determine whether the lighting environment being photographed is an extreme lighting environment (eg, backlight, low light, or too bright light) according to a result of analyzing the image. For example, when it is determined that the situation being photographed through the rear camera 2002 is an extreme lighting environment, the electronic device does not store the image being photographed through the rear camera 2002 or controls the rear camera 2002 This can be controlled so that the shooting function is not activated.

According to various embodiments of the present disclosure, when it is determined that the situation being photographed through the rear camera 2002 is an abnormal lighting environment, white balance is calculated through the color balance card 2003 and the calculated white balance value is It can be applied to the image being photographed through the rear camera 2002 .

21 is a flowchart illustrating an example of an operation of analyzing skin information in an electronic device, according to various embodiments of the present disclosure. Referring to FIG. 21 , in operation 2110, the electronic device may acquire an image from at least one camera.

In operation 2120, the electronic device may analyze the acquired image.

In operation 2130, the electronic device may determine whether the brightness of the acquired image is abnormal.

As a result of operation 2130, if the brightness of the acquired image is not determined to be abnormal, the electronic device may perform operation 2110 again.

As a result of operation 2130 , when it is determined that the brightness of the acquired image is abnormal, in operation 2140 , the electronic device may determine whether a camera for photographing the acquired image is located in front of the electronic device.

As a result of operation 2140 , when it is determined that the camera is not located in the front, the electronic device may calculate a white balance in operation 2150 . For example, the calculated white balance may be calculated through a module (eg, a color balance card) that can calculate the white balance included in the camera that is not located in the front. Using the white balance calculated in operation 2150, the electronic device may apply the white balance of the photographed image as the calculated white balance in operation 2160 .

Also, as a result of operation 2140 , when it is determined that the camera is positioned at the front, the electronic device may apply the white balance to the photographed image in operation 2160 . For example, the image to which the white balance is applied in operation 2160 according to the result of operation 2140 may be an image to which a pre-stored value of white balance is applied because a color balance card is not included in the front camera.

In operation 2170, the electronic device may store an image. For example, the stored image may be an image to which white balance is applied.

At least one operation among the operations shown in FIG. 21 may be omitted and executed, and at least one other operation may be added between the operations. Also, the operations of FIG. 21 may be processed in the illustrated order, or the execution order of at least one operation may be changed from the execution order of other operations.

22A and 22B are diagrams illustrating various examples of an operation of photographing for face analysis, according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, the electronic device may determine whether an accessory is worn in the face region being photographed.

Referring to FIG. 22A , it is assumed that a high school girl who is a face area photographing target wears glasses.

According to various embodiments of the present disclosure, in the electronic device, the glasses are worn on the face region according to whether a line 2211 corresponding to the frame of the glasses or a portion 2212 that reflects light on the glass is included in the face region being photographed. You can check whether

According to various embodiments of the present disclosure, when it is determined that the glasses are worn in the face region being photographed, the electronic device may instruct to take off the glasses. For example, in the image 2210 being photographed, a phrase such as 'Please take off your glasses and take a picture' may be displayed.

The user of the electronic device according to various embodiments of the present disclosure may check the phrase and take off the glasses. When it is confirmed that the user has taken off the glasses, the electronic device may display a phrase such as 'It is okay to shoot' in the image 2220 being photographed.

Referring to FIG. 22B , it is assumed that a high school girl who is a face area photographing target wears a hat.

According to various embodiments of the present disclosure, the electronic device may determine whether the hat is worn on the face region according to whether a line 2231 corresponding to the shape of the hat is included in the face region being photographed.

According to various embodiments of the present disclosure, when it is determined that the hat is worn in the face region being photographed, the electronic device may instruct to remove the hat. For example, a phrase such as 'Please take off your hat and take a picture' may be displayed in the image 2230 being photographed.

The user of the electronic device according to various embodiments of the present disclosure may check the phrase and take off the hat. When the electronic device confirms that the user has taken off the hat, the electronic device may display a phrase such as 'It is okay to shoot' in the image 2240 being photographed.

23A and 23B are diagrams illustrating various examples of an operation of photographing for face analysis, according to various embodiments of the present disclosure.

According to various embodiments of the present disclosure, in the electronic device, a line 2301 corresponding to the face region may be displayed so that the user can check the direction or size of the face region being photographed.

Referring to FIG. 23A , it is assumed that a high school girl who is a face area photographing target is photographing her face obliquely.

According to various embodiments of the present disclosure, the electronic device may check whether the face region is being photographed from the front according to whether the face region being photographed deviates from the line 2301 .

According to various embodiments of the present disclosure, when it is determined that the face area being photographed deviates from the line 2301 , the electronic device may instruct to position the face in the front. For example, in the image 2311 being photographed, a phrase such as 'Please place your face in front' may be displayed.

The user of the electronic device according to various embodiments of the present disclosure may check the phrase and position the face to match the line 2301 . When the electronic device confirms that the user's face is positioned in front, the electronic device may display a phrase such as 'It is okay to shoot' in the image 2312 being photographed.

Referring to FIG. 23B , it is assumed that a high school girl who is a face area photographing target is photographing her face from a distance.

According to various embodiments of the present disclosure, the electronic device may determine whether the face region being photographed is being photographed from a distance or close, depending on whether the size of the face region being photographed is positioned to match the size of the line 2211 .

According to various embodiments of the present disclosure, when it is determined that the face area being photographed is smaller than the size of the line 2301 area and it is determined that the photograph is being taken from a distance, the electronic device may instruct to position the face closer. For example, in the image 2321 being photographed, a phrase such as 'please place your face closer' may be displayed.

The user of the electronic device according to various embodiments of the present disclosure may check the phrase and position the face to match the line 2301 . When the electronic device confirms that the user's face is located close, the electronic device may display a phrase such as 'It is okay to shoot' in the image 2322 being photographed.

24 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure. Referring to FIG. 24 , in the electronic device, it is assumed that the image 2410 is captured shaking.

According to various embodiments of the present disclosure, the electronic device may operate the hand shake correction function when it is not possible to confirm the shape of the face region in the image being photographed or when it is determined that the electronic device is shaking through a sensor or the like. For example, the hand shake correction function may include a function of controlling the image not to be photographed in a jittery manner by adjusting a shutter speed or an aperture when photographing an image.

According to various embodiments of the present disclosure, after the hand shake correction function is set, the electronic device may display a phrase such as 'It is okay to shoot' on the image 2322 being photographed. For example, the user may take a picture after confirming that an image being photographed by the electronic device can be photographed without shaking.

25 is a block diagram illustrating an example of a configuration of an electronic device according to various embodiments of the present disclosure. The electronic device 2501 may constitute, for example, all or a part of the electronic device 100 or 1901 illustrated in FIG. 1 or FIG. 19 . Referring to FIG. 25 , the electronic device 2501 includes one or more processors (eg, an application processor (AP) 2510 ), a communication module 2520 , a subscriber identification module (SIM) card 2524 , and a memory. 2530, sensor module 2540, input device 2550, display 2560, interface 2570, audio module 2580, camera module 2591, power management module 2595, battery 2596, It may include an indicator 2597 and a motor 2598 .

The AP 2510 may control a plurality of hardware or software components connected to the AP 2510 by driving an operating system or an application program, and may perform various data processing and operations including multimedia data. The AP 2510 may be implemented as, for example, a system on chip (SoC). According to an embodiment, the AP 2510 may further include a graphic processing unit (GPU) (not shown).

The communication module 2520 (eg, the communication interface 1960) is connected to the electronic device 2501 (eg, the electronic device 100 or the electronic device 1901) and other electronic devices (eg, the electronic device 1901) connected through a network. Data transmission/reception may be performed in communication between the electronic device 1904 or the server 1906 . According to an embodiment, the communication module 2520 includes a cellular module 2521, a Wifi module 2523, a BT module 2525, a GPS module 2527, an NFC module 2528, and a radio frequency (RF) module ( 2529) may be included.

The cellular module 2521 may provide a voice call, a video call, a text service, or an Internet service through a communication network (eg, LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro, or GSM). Also, the cellular module 2521 may perform identification and authentication of an electronic device in a communication network using, for example, a subscriber identification module (eg, the SIM card 2524 ). According to an embodiment, the cellular module 2521 may perform at least some of the functions that the AP 2510 may provide. For example, the cellular module 2521 may perform at least a part of a multimedia control function.

According to an embodiment, the cellular module 2521 may include a communication processor (CP). Also, the cellular module 2521 may be implemented as, for example, an SoC. In FIG. 25, components such as the cellular module 2521 (eg, a communication processor), the memory 2530, or the power management module 2595 are shown as separate components from the AP 2510, but one According to an embodiment, the AP 2510 may be implemented to include at least some of the aforementioned components (eg, the cellular module 2521 ).

According to an embodiment, the AP 2510 or the cellular module 2521 (eg, a communication processor) loads a command or data received from at least one of a non-volatile memory or other components connected thereto into a volatile memory ( load) can be processed. Also, the AP 2510 or the cellular module 2521 may store data received from at least one of the other components or generated by at least one of the other components in a non-volatile memory.

Each of the Wifi module 2523, the BT module 2525, the GPS module 2527 or the NFC module 2528 includes, for example, a processor for processing data transmitted and received through the corresponding module. can In FIG. 25, the cellular module 2521, the Wifi module 2523, the BT module 2525, the GPS module 2527, or the NFC module 2528 are each shown as separate blocks, but according to one embodiment, the cellular module ( 2521), at least some (eg, two or more) of the Wifi module 2523, the BT module 2525, the GPS module 2527, or the NFC module 2528 may be included in one integrated chip (IC) or IC package. have. For example, at least some of the processors corresponding to each of the cellular module 2521 , the Wifi module 2523 , the BT module 2525 , the GPS module 2527 or the NFC module 2528 (eg, the cellular module 2521 ) A communication processor corresponding to , and a Wifi processor corresponding to the Wifi module 2523) may be implemented as one SoC.

The RF module 2529 may transmit/receive data, for example, transmit/receive an RF signal. Although not shown, the RF module 2529 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, or a low noise amplifier (LNA). In addition, the RF module 2529 may further include a component for transmitting and receiving electromagnetic waves in free space in wireless communication, for example, a conductor or a conducting wire. In FIG. 25 , the cellular module 2521 , the Wifi module 2523 , the BT module 2525 , the GPS module 2527 and the NFC module 2528 are shown to share one RF module 2529 with each other, but one According to an embodiment, at least one of the cellular module 2521, the Wifi module 2523, the BT module 2525, the GPS module 2527, or the NFC module 2528 performs transmission and reception of an RF signal through a separate RF module. can do.

The SIM card 2524 may be a card including a subscriber identification module, and may be inserted into a slot formed at a specific location of the electronic device. The SIM card 2524 may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, international mobile subscriber identity (IMSI)).

The memory 2530 (eg, the storage unit 150 or the memory 1930 ) may include an internal memory 2532 or an external memory 2534 . The internal memory 2532 is, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.) or non-volatile memory (eg, non-volatile memory). For example, one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, NOR flash memory, etc.) It may include at least one.

According to an embodiment, the internal memory 2532 may be a solid state drive (SSD). The external memory 2534 may be a flash drive, for example, compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), or Memory Stick and the like may be further included. The external memory 2534 may be functionally connected to the electronic device 2501 through various interfaces. According to an embodiment, the electronic device 2501 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 2540 may measure a physical quantity or detect an operating state of the electronic device 2501 , and may convert the measured or sensed information into an electrical signal. The sensor module 2540 may include, for example, a gesture sensor 2540A, a gyro sensor 2540B, a barometric pressure sensor 2540C, a magnetic sensor 2540D, an acceleration sensor 2540E, a grip sensor 2540F, and a proximity sensor. (2540G), color sensor (e.g. RGB (red, green, blue) sensor (2540H)), biometric sensor (2540I), temperature/humidity sensor (2540J), illuminance sensor (2540K) or UV (ultra violet) sensor ( 2540M). Additionally or alternatively, the sensor module 2540 may include, for example, an olfactory sensor (E-nose sensor, not shown), an electromyography sensor (not shown), an electroencephalogram sensor (EEG), and an ECG sensor. The sensor may include an electrocardiogram sensor (not shown), an infrared (IR) sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 2540 may further include a control circuit for controlling at least one or more sensors included therein.

The input device 2550 may include a touch panel 2552 , a (digital) pen sensor 2554 , a key 2556 or an ultrasonic input device 2558 . can The touch panel 2552 may recognize a touch input using, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. Also, the touch panel 2552 may further include a control circuit. In the case of capacitive, physical contact or proximity recognition is possible. The touch panel 2552 may further include a tactile layer. In this case, the touch panel 2552 may provide a tactile response to the user.

The (digital) pen sensor 2554 may be implemented, for example, using the same or similar method as receiving a user's touch input or a separate recognition sheet. The key 2556 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 2558 is a device that can check data by detecting sound waves from the electronic device 2501 with a microphone (eg, the microphone 2588) through an input tool that generates an ultrasonic signal, recognition is possible According to an embodiment, the electronic device 2501 may receive a user input from an external device (eg, a computer or a server) connected thereto using the communication module 2520 .

The display 2560 (eg, the display unit 140 or the display 1950) may include a panel 2562 , a hologram device 2564 , or a projector 2566 . The panel 2562 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 2562 may be implemented, for example, to be flexible, transparent, or wearable. The panel 2562 may be configured as a single module with the touch panel 2552 . The hologram device 2564 may display a stereoscopic image in the air by using light interference. The projector 2566 may display an image by projecting light onto the screen. The screen may be located inside or outside the electronic device 2501, for example. According to an embodiment, the display 2560 may further include a control circuit for controlling the panel 2562 , the hologram device 2564 , or the projector 2566 .

The interface 2570 is, for example, a high-definition multimedia interface (HDMI) 2572 , a universal serial bus (USB) 2574 , an optical interface 2576 , or a D-subminiature (D-sub). ) (2578). The interface 2570 may be included in, for example, the communication interface 1960 illustrated in FIG. 19 . Additionally or alternatively, the interface 2570 may be, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card/multi-media card (MMC) interface, or an infrared data association (IrDA) standard interface. may include.

The audio module 2580 may interactively convert a sound and an electrical signal. At least some components of the audio module 2580 may be included in, for example, the input/output interface 1940 illustrated in FIG. 1 . The audio module 2580 may process sound information input or output through, for example, a speaker 2582 , a receiver 2584 , an earphone 2586 , or a microphone 2588 .

The camera module 2591 is a device capable of capturing still images and moving images, and according to an embodiment, one or more image sensors (eg, a front sensor or a rear sensor), a lens (not shown), an image signal processor (ISP), not shown) or a flash (not shown) (eg, LED or xenon lamp).

The power management module 2595 may manage power of the electronic device 2501 . Although not shown, the power management module 2595 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (IC), or a battery or fuel gauge.

The PMIC may be mounted in, for example, an integrated circuit or an SoC semiconductor. The charging method can be divided into wired and wireless. The charger IC may charge a battery and may prevent an overvoltage or overcurrent from flowing from the charger. According to an embodiment, the charging IC may include a charging IC for at least one of a wired charging method and a wireless charging method. As a wireless charging method, for example, there is a magnetic resonance method, a magnetic induction method, or an electromagnetic wave method, and an additional circuit for wireless charging, for example, a circuit such as a coil loop, a resonance circuit or a rectifier may be added. have.

The battery gauge may measure, for example, the remaining amount of the battery 2596, voltage, current, or temperature during charging. The battery 2596 may store or generate electricity, and may supply power to the electronic device 2501 using the stored or generated electricity. The battery 2596 may include, for example, a rechargeable battery or a solar battery.

The indicator 2597 may display a specific state of the electronic device 2501 or a part thereof (eg, the AP 2510 ), for example, a booting state, a message state, or a charging state. The motor 2598 may convert an electrical signal into mechanical vibration. Although not shown, the electronic device 2501 may include a processing unit (eg, GPU) for supporting mobile TV. The processing device for supporting mobile TV may process media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow, for example.

Each of the above-described components of the electronic device according to various embodiments of the present disclosure may be composed of one or more components, and the name of the corresponding component may vary depending on the type of the electronic device. An electronic device according to various embodiments of the present disclosure may be configured to include at least one of the above-described components, and some components may be omitted or may further include additional other components. In addition, since some of the components of the electronic device according to various embodiments of the present disclosure are combined to form a single entity, the functions of the corresponding components before being combined may be performed identically.

The term “module” used in various embodiments of the present invention may mean, for example, a unit including one or a combination of two or more of hardware, software, and firmware. The term “module” may be used interchangeably with terms such as, for example, unit, logic, logical block, component, or circuit. A “module” may be a minimum unit or a part of an integrally formed component. A “module” may be a minimum unit or a part of performing one or more functions. A “module” may be implemented mechanically or electronically. For example, a “module” according to various embodiments of the present invention may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable logic that performs certain operations, known or to be developed in the future. It may include at least one of a programmable-logic device.

According to various embodiments, at least a portion of an apparatus (eg, modules or functions thereof) or a method (eg, operations) according to various embodiments of the present disclosure may be computer-readable in the form of, for example, a programming module. It may be implemented as a command stored in a computer-readable storage media. When the instruction is executed by one or more processors (eg, the controller 110 or the processor 1920), the one or more processors may perform a function corresponding to the instruction. The computer-readable storage medium may be, for example, the storage unit 150 or the memory 1930 . At least a part of the programming module may be implemented (eg, executed) by, for example, the controller 110 or the processor 1920 . At least a portion of the programming module may include, for example, a module, a program, a routine, a set of instructions or a process for performing one or more functions.

The computer-readable recording medium includes a magnetic medium such as a hard disk, a floppy disk, and a magnetic tape, and an optical recording medium such as a CD-ROM (Compact Disc Read Only Memory) and DVD (Digital Versatile Disc). Media), magneto-optical media such as a floptical disk, and program instructions such as read only memory (ROM), random access memory (RAM), flash memory, etc. (e.g. programming a hardware device specially configured to store and perform the module). In addition, the program instructions may include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operations of various embodiments of the present invention, and vice versa.

A module or a programming module according to various embodiments of the present disclosure may include at least one or more of the above-described components, some may be omitted, or may further include additional other components. Operations performed by a module, a programming module, or other components according to various embodiments of the present disclosure may be performed sequentially, in parallel, iteratively, or in a heuristic method. Also, some operations may be executed in a different order, omitted, or other operations may be added.

According to various embodiments of the present disclosure, in a storage medium storing instructions, when the instructions are executed by at least one processor, the at least one processor is configured to perform at least one operation, and the at least one An operation of detecting at least one face region in an image being photographed through a camera module, an operation of capturing the detected at least one face region in detail, and analyzing the detailed photographed face region as at least one analysis item It may include an operation of analyzing according to the

According to various embodiments of the present disclosure, the at least one operation may include an operation of detecting a face region from at least one stored image and an operation of analyzing the detected at least one face region according to at least one analysis item. may include

According to various embodiments of the present disclosure, the operation of analyzing face information may be performed based on a previously stored image. For example, the stored image may be taken according to a preset distance or angle according to a preset fixed focus value. When the user's face is at a position corresponding to the set distance or angle, the electronic device may capture a face image or display a screen requesting the user to take a photograph corresponding to the distance or angle.

According to various embodiments of the present disclosure, the stored image may be captured and stored in a preset situation without the user performing a photographing operation. For example, a situation in which the user gazes at the electronic device for more than a preset time (eg, when checking a web browser or watching a media file (eg, video)) or an angle at which the electronic device can capture a user's face image (eg, a situation in which the user's face can be photographed in the front direction according to the angle of the front camera), etc., the electronic device may execute the camera module in the background to photograph the user's face image.

According to various embodiments of the present disclosure, the electronic device checks a stored image, removes an unnecessary part (eg, shadow or hair) from the image, and sets at least one reference point in an area from which the unnecessary part is removed. Thus, the face region can be determined. For example, the reference point is set on the entire face region in the image, and based on a pre-analyzed database or a previously analyzed face image of a specific user, each face region (eg, C zone, M zone, U zone, eyes, nose, cheek, or mouth).

According to various embodiments of the present disclosure, when a face region is determined from a previously stored image, the electronic device may output a skin condition analysis result for each region through the analysis result screen.

According to various embodiments of the present disclosure, the operation of analyzing face information may be performed based on a previously stored image. For example, the electronic device may set at least one reference point in the image and determine the face region based on the set reference point.

According to various embodiments of the present disclosure, when a face region is determined from a previously stored image, the electronic device may output a skin condition analysis result for each region through the analysis result screen.

26 is a diagram illustrating an example of an application screen for analyzing face information based on a stored image, according to various embodiments of the present disclosure;

Referring to FIG. 26 , when an application for analyzing face information is executed, the execution screen 2610 is a gallery button 2611 for executing a gallery displaying images stored in the electronic device or a screen for capturing an image by activating a camera module It may include a camera button 2622 for switching to .

According to various embodiments of the present disclosure, images displayed when the gallery button 2611 is selected include a selection item for the user to select, or images stored in the electronic device that have facial information filtered into images that can be analyzed. it could be The image in which the face information can be analyzed may be an image in which a face region in the image is photographed corresponding to a preset angle or size.

According to various embodiments of the present disclosure, when the gallery button 2611 is selected, an image selection screen 2620 for selecting at least one image for analyzing face information may be displayed. For example, images displayed on the image selection screen 2620 may be displayed in an order of being recently photographed or stored.

According to various embodiments of the present disclosure, when the user selects at least one of the images included in the image selection screen 2620 as an image to analyze face information, an analysis result screen ( 2630) may be displayed.

According to various embodiments of the present disclosure, the analysis result screen 2630 includes an area 2631 displaying the result of analyzing face information as an image, an area 2632 displaying the result of analyzing face information as a numerical value or a graph, or Buttons for selecting an analysis result for each analysis item may be included, and various other items related to face analysis may be included. For example, the buttons for selecting the analysis result for each analysis item include a summary button 2633a for displaying analysis results for the entire face region, a wrinkle button 2633b for displaying analysis results on wrinkles, and analysis results for troubles. may include a trouble button 2633c for displaying or a pigmentation button 2633d for displaying analysis results related to pigmentation, and may include selection items for displaying analysis results for various other analysis items. .

27 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 27 , the analysis result screen 2700 is an image area 2710 displaying an analyzed face area, an analysis result area 2720 displaying an analysis result, or an analysis for selecting an analysis result for each detailed analysis item. An item selection area 2730 may be included.

In the image area 2710 , a face area may be detected from an image stored in the electronic device, and at least one reference point 2711 may be set in the detected face area. Based on the at least one reference point 2711 , a facial region to be analyzed (eg, 2711 , 2712 , 2713 , 2714 , 2715 or 2716 ) may be set according to at least one analysis item. The area 2712 may be a C zone, and may include an area of the outer portion of both eyes, number 2713 may include a nose area, reference numeral 2714 may include a cheek area, reference numeral 2715 may include an area next to the nose, and reference numeral 2716 may include a region around the mouth. .

According to various embodiments of the present disclosure, each of the face regions may be selected as a user input (eg, a touch gesture) is input, and a screen analyzed for the selected face region may be enlarged and displayed. have.

In the analysis result area 2720 , a result of analyzing the skin condition may be displayed as a numerical value (eg, a score 2722 ) or as a graph 2721 . For example, the graph 2721 may analyze a specific facial region for each analysis item to indicate a score for a skin condition for each analysis item. The score 2722 is an average of scores for each analysis item for a specific face region, and a higher score may indicate a better skin condition.

The analysis item selection area 2730 may include at least one button for displaying an analysis result for each analysis item, and an analysis result for a specific face region is displayed on the image 2710 or the analysis result according to the selected button. It may be displayed through the area 2720 . For example, when the 'summary' button is selected, the entire face region among the face regions may be displayed through the image 2710 , and an analysis result for the entire face region may be displayed through the analysis result region 2720 .

28 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 28 , the analysis result screen 2800 may include an image area 2810 , an analysis result area 2820 , or an analysis item selection area 2830 in which at least one of the analyzed face areas can be selected.

According to various embodiments of the present disclosure, the Wrinkle button 2831 is selected in the analysis item selection area 2830, and the result of the analysis of wrinkles among various analysis items is the image area 2810 or the analysis result. It may be displayed through the area 2820 .

In the image area 2810 , an analysis result of at least one facial area (eg, C zone or U zone area) analyzed for wrinkles based on images stored in the electronic device may be displayed as an image. For example, the color of each face region is displayed differently depending on the skin condition, so that the user can check the skin condition with the displayed color.

In the analysis result area 2820, a graph 2821 comparing the results of analysis on wrinkles with the average score for each C zone or M zone or a score 2822 for the entire face area for wrinkles may be displayed. .

According to various embodiments of the present disclosure, when the user inputs the user input 2811 to a specific area (eg, the left zone C area) to check the enlarged or detailed analysis result, the area to which the user input is input (eg, An enlarged screen 2812 in which the left zone C region) is analyzed in detail may be displayed.

According to various embodiments of the present disclosure, the analysis result area 2820 may provide a history of wrinkle changes for the entire face area. For example, the analysis result area 2820 is a graph 2823 comparing the wrinkle state one month ago with the currently measured wrinkle state or a graph 2824 indicating how much the wrinkle state of each C zone or M zone has improved compared to the previous one. may include.

29 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 29 , the user has selected the wrinkle button 2931 in the analysis item selection area, and accordingly, the analysis result screen 2900 may include an image analyzed for wrinkles or the analysis result area 2920 .

In the analysis result area 2920, the score of the wrinkle state for each of the detailed areas (eg, the left (CL)/right (CR) of the C zone or the left (ML)/right (MR) of the M zone) or the entire face area The wrinkle state in can be expressed as a score.

According to various embodiments of the present disclosure, a user may select a region to check an enlarged or detailed screen among the analyzed face regions. For example, when “left zone C area” is selected through the user input 2901 , a screen 2910 in which the left area of zone C on the face is enlarged may be displayed. When the region to the left of the nose is selected through the user input 2902 , a screen 2920 in which the region to the left of the nose is enlarged on the face may be displayed.

30 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 30 , when the user selects the trouble button 3031 in the analysis item selection area 3030 of the analysis result screen 3000 , the analysis result screen 3000 is displayed for trouble among various analysis items. The analyzed result may be displayed through the image area 3010 or the analysis result area 3020 .

In the image area 3010, at least one facial area (eg, right (R), left (L), upper (T), or lower (B) area) analyzed for a problem based on images stored in the electronic device. The analyzed result may be displayed as an image. For example, the color of each face region is displayed differently according to the skin state, so that the user can check the skin state of the corresponding face region with the displayed color.

In the analysis result area 3020, the analysis result for trouble is compared with the average score for each of the right (R), left (L), upper (T), or lower (B) areas in a graph 3021 or trouble. A score 3022 for the entire face region for .

According to various embodiments of the present disclosure, when the lower part of the face is selected through the user input 3011 , an enlarged screen 3012 in which the lower region is analyzed in detail may be displayed. For example, the user can check, through the enlarged screen 3012 , specifically where the trouble is in the lower area and what the size of the trouble is.

According to various embodiments of the present disclosure, the analysis result area 3020 may provide a history of trouble changes for the entire face area. For example, the analysis result area 3020 is a graph 3023 comparing the trouble state one month ago with the trouble state currently measured or each area (eg, right (R), left (L), upper (T) or lower (T) B) may include a graph 3024 indicating how much the trouble state of the region) has improved compared to before.

31 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 31 , the user has selected the trouble button 3131 in the analysis item selection area, and accordingly, the analysis result screen 3100 may include an image analyzed for the trouble or the analysis result area 3120 .

According to various embodiments of the present disclosure, a user may select a region to check an enlarged or detailed screen among the analyzed face regions. For example, when the left cheek region is selected through the user input 3101 , a screen 3110 in which the left cheek of the face is enlarged may be displayed. When the lower side is selected through the user input 3102 , a screen 3120 in which the lower side of the face is enlarged may be displayed.

32 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 32 , when the user selects the pigmentation button 3231 in the analysis item selection area 3230 of the analysis result screen 3200, the analysis result screen 3200 displays pigmentation among various analysis items. A result of analysis for ? may be displayed through the image area 3210 or the analysis result area 3220 .

In the image area 3210, at least one facial area (eg, right (R), left (L), upper (T), or lower (B) area) analyzed for pigmentation based on images stored in the electronic device. ), the analyzed result may be displayed as an image. For example, the color of each face region is displayed differently according to the skin state, so that the user can check the skin state of the corresponding face region with the displayed color.

In the analysis result area 3220, a graph 3221 or a graph comparing the results of the analysis on pigmentation with the average score for each of the right (R), left (L), upper (T), or lower (B) areas. A score 3222 for the entire facial area for deposition may be displayed.

According to various embodiments of the present disclosure, when the left cheek is selected through the user input 3201, an enlarged screen 3202 in which the left area is analyzed in detail may be displayed. For example, the user can check, through the enlarged screen 3202 , specifically where pigmentation is generated and the size of the pigmented area in the left region 3201 .

According to various embodiments of the present disclosure, the analysis result area 3220 may provide a history of changes in pigmentation for the entire face area. For example, the analysis result region 3220 is a graph 3223 comparing the pigmentation state one month ago and the currently measured pigmentation state or each region (eg, right (R), left (L), upper (T) or It may include a graph 3224 indicating how much the state of pigmentation in the lower (B) region has improved compared to before.

33 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 33 , the user selects the pigmentation button 3331 in the analysis item selection area, and accordingly, the analysis result screen 3300 may include an image analyzed for pigmentation or an analysis result area.

According to various embodiments of the present disclosure, a user may select a region to check an enlarged or detailed screen among the analyzed face regions. For example, when the left cheek is selected through the user input 3301 , a screen 3310 in which the left side L of the face is enlarged may be displayed. When the nose is selected through the user input 3302 , a screen 3320 in which the upper (T) region is enlarged may be displayed.

34 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 34 , when the user selects the pore button 3431 in the analysis item selection area 3430 of the analysis result screen 3400, the analysis result screen 3400 displays the pores among various analysis items. The analyzed result may be displayed through the image area 3410 or the analysis result area 3420 .

In the image area 3410 , at least one facial area (eg, right (R), left (L), upper (T) or lower (B) area) analyzed for pores based on images stored in the electronic device. The analyzed result may be displayed as an image. For example, the color of each face region is displayed differently according to the skin state, so that the user can check the skin state of the corresponding face region with the displayed color.

In the analysis result area 3420, the results of the analysis on pores are compared with the average score for each of the right (R), left (L), upper (T), or lower (B) areas in the graph 3421 or in the pores. A score 3422 for the entire face region may be displayed.

According to various embodiments of the present disclosure, when the right cheek is selected through the user input 3401 , an enlarged screen 3402 in which the right region of the face is analyzed in detail may be displayed. For example, the user can check, through the enlarged screen 3402, where the pores are specifically created and the size of the generated pores in the right region.

According to various embodiments of the present disclosure, the analysis result area 3420 may provide a history of pore changes for the entire face area. For example, the analysis result area 3420 may include a graph 3423 comparing the pore state one month ago with the currently measured pore state or a graph 3424 indicating how much the pore state of the entire face region has improved compared to the previous one. can

35 is a diagram illustrating an example of a screen showing a result of face analysis according to various embodiments of the present disclosure;

Referring to FIG. 35 , when the user selects a skin tone button 3531 in the analysis item selection area 3530 of the analysis result screen 3500, the analysis result screen 3500 displays the skin tone among various analysis items. The analyzed result may be displayed through the image area 3510 or the analysis result area 3520 .

In the image area 3510, based on the images stored in the electronic device, at least one facial area (eg, forehead (L), cheek (A), or chin (B) area) analyzed for skin tone is analyzed based on the result of the analysis. It can be displayed as an image. For example, the color of each face region is displayed differently according to the skin state, so that the user can check the skin state of the corresponding face region with the displayed color.

In the analysis result area 3520 , a graph 3521 comparing the result of analyzing the skin tone uniformity with the average score for each of the forehead (L), cheek (A), or chin (B) area or the skin tone in the entire face area A score 3522 for uniformity may be displayed.

According to various embodiments of the present disclosure, when the user selects the score 3522 , the analysis result area 3520 may provide a detailed analysis result of skin tone changes for the entire face area. For example, the analysis result area 3520 is a graph comparing the skin tone state one month ago and the currently measured skin tone uniformity state for each face area (eg, forehead (L), cheek (A), or chin (B) area). 3523) or a graph 3524 indicating how much the skin tone uniformity state of each face region has improved compared to the previous one.

36 is a diagram illustrating an example of an application screen showing a history of face information analyzed based on a stored image, according to various embodiments of the present disclosure;

Referring to FIG. 36 , when an analysis result screen 3600 including a result of analyzing face information through an application for analyzing face information is displayed, a menu 3601 including a function related to the analyzed face information is displayed can be For example, when the menu 3601 is selected, the entire image analysis for trially analyzing at least one selected image, the change management 3602 displaying the history of the analyzed face information, or the previously analyzed face information Selection items for selecting a DB initialization function for initializing data may be displayed, and various other functions related to analysis of face information may be included in the menu 3601 .

According to various embodiments of the present disclosure, when the user selects the change management 3602 , the change in the previously analyzed face information is displayed through the image area 3610 or the analysis result area 3620 of the analysis result screen. can For example, the analysis result area 3620 may display the face analysis result according to each analysis item as a graph 3621 during the time period in which the face information is analyzed, and in the image area 3610, the graph 3621 An image obtained by analyzing face information at a specific point in time when a user input is input may be displayed.

37 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure;

Referring to FIG. 37 , a user may select an analysis item or an image region to check a change in the analysis result on the analysis result screen 3700 . For example, the user may select a summary button among analysis items (eg, summary, wrinkle, trouble, or pigmentation) to check a change in the analysis result for pigmentation.

According to various embodiments of the present disclosure, the user inputs a user input (eg, pinch in/out or tap and drag) 3701 to enlarge the size of the image displayed in the image area or move the location of the analysis result. You can set the image area where you want to check the change.

According to various embodiments of the present disclosure, the analysis result screen 3700 displays a set image area, and results of analyzing the displayed image area according to at least one analysis item (eg, pigmentation, trouble or wrinkles) change can be displayed as a graph. For example, the graph shows a time at which the face information was analyzed and an analysis result corresponding to the time, and when a user input is input at a specific time, an image in which the face information is analyzed at that time may be displayed.

38 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure;

Referring to FIG. 38 , the analysis result screen 3800 may include an image area 3810 or an analysis result area 3820 .

According to various embodiments of the present disclosure, a user may select a wrinkle 3831 from among analysis items (eg, summary, wrinkle 3831, trouble or pigmentation) in order to confirm a change in the analysis result regarding wrinkles. .

In the image area 3810 , a result of analyzing wrinkles among the face areas of the image may be displayed. For example, the result of analyzing wrinkles is displayed in the form of a line, and the depth or length of the wrinkles may be indicated according to the thickness or length of the line.

The analysis result area 3820 displays the results of the analysis on the wrinkles in each facial area according to the time previously analyzed (eg, right (CR) or left (CL) of zone C, right (MR) of zone M) or The wrinkle state by left (ML) area) can be represented as a graph.

According to various embodiments of the present disclosure, when the user inputs a user input (eg, tap or swipe) at a specific time in the graph, the image used to analyze the wrinkles at that time is the image region 3810 . is displayed, and in the displayed image, the result of analysis of wrinkles at the corresponding time point may be displayed.

39 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure;

Referring to FIG. 39 , the analysis result screen 3900 may include an image area 3910 or an analysis result area 3920 .

According to various embodiments of the present disclosure, the user may select the trouble 3931 from among the analysis items (eg, summary, wrinkles, trouble 3931 or pigmentation) in order to check a change in the analysis result related to the trouble. .

In the image area 3910 , a result of analyzing troubles among the face areas of the image may be displayed. For example, a result of analyzing a trouble is displayed in a form corresponding to the trouble, and the size or state of the trouble may be indicated according to the size or color of the form.

The analysis result area 3920 contains the results analyzed for the troubles in each face area according to the time previously analyzed (eg, right (R), left (L), upper (T) or lower (B) area). It can represent the problem state by graph.

According to various embodiments of the present disclosure, when the user inputs a user input (eg, tap or swipe) at a specific time in the graph, the image used to analyze the trouble at that time is the image area 3910 . is displayed, and the displayed image may display the result of analyzing the trouble at the time point.

40 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure.

Referring to FIG. 40 , the analysis result screen 4000 may include an image area 4010 or an analysis result area 4020 .

According to various embodiments of the present disclosure, a user may select a pigmentation 4031 among analysis items (eg, summary, wrinkles, troubles, or pigmentation 4031 ) in order to confirm a change in the analysis result regarding pigmentation. can

In the image region 4010 , a result of analyzing pigmentation among the face regions of the image may be displayed. For example, a result of analyzing the pigmentation is displayed in a form corresponding to the pigmentation, and the size or state of the pigmentation may be indicated according to the size or color of the form.

The analysis result area 4020 displays the results of the analysis on the pigmentation according to the time previously analyzed in each facial area (eg, right (R), left (L), upper (T), or lower (B) area). ) of the star pigmentation state can be expressed as a graph.

According to various embodiments of the present disclosure, when the user inputs a user input (eg, tap or swipe) at a specific time in the graph, the image used to analyze the pigmentation at that time is the image area 4010 . is displayed, and in the displayed image, the result of analyzing the pigmentation at the time point may be displayed.

41 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure.

Referring to FIG. 41 , when change management (eg, 3602) is selected from the menu (eg, 3601) of the application that analyzes face information, the analysis result screen 4100 displays the history of analysis results according to various analysis items. can

According to various embodiments of the present disclosure, the analysis result screen 4100 displays the image area 4110 including the image in which the face information is analyzed at a specific point in time for the selected analysis item or the previously analyzed result for each analysis item ( For example, it may include an analysis result area 4120 including a graph representing a skin condition score versus time point analyzed for (pigmentation), trouble, or .

According to various embodiments of the present disclosure, when the user selects the summary 4131 among the analysis items (eg, summary 4131, wrinkles, troubles, or pigmentation), the first time point 4121 among the images analyzed with facial information The analyzed image 4111 may be displayed through the image area 4110 . A result of analyzing the face information for the image 4111 may be displayed as a graph through the analysis result area 4120 .

According to various embodiments of the present disclosure, when a user input 4101 is input to a location corresponding to a specific analysis point of the graph, an image analyzed at the time when the user input is input is displayed in the image area 4110. can For example, in the image area 4110, when a user input 4101 is input to a position corresponding to the second time point 4122, an image 4112 with facial information analyzed at the second time point 4122 is displayed, When a position corresponding to the third time point 4123 is input, an image 4113 in which face information is analyzed at the third time point 4123 may be displayed.

According to various embodiments of the present disclosure, the displayed image 4111 , 4112 or 4113 is a time point at which a user input is input (eg, a first time point 4121 , a second time point 4122 , or a third time point 4123 ). ) is used to analyze the face information, and the results of the analysis for each analysis item at the time point are displayed overlaid on the displayed image, so that the user can check the skin condition for the analysis item.

42 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure;

Referring to FIG. 42 , when change management (eg, 3602) is selected from the menu (eg, 3601) of the application that analyzes face information, in the analysis result screen 4200, according to the analysis item (eg, wrinkles 4231) A history of analysis results may be displayed. For example, the analysis result screen 4200 may include an image area 4210 or an analysis result area 4220 .

According to various embodiments of the present disclosure, the image displayed on the image area 4210 is an image 4211 in which face information is analyzed at a first time point 4221 , and the image 4211 is a user input (eg, pinch-in). /out), the size may be changed (eg, enlarged). For example, the user may check the skin condition in the image analyzed at a specific time point in detail through the image whose size has been changed.

According to various embodiments of the present disclosure, the setting of the image whose size or location is changed according to a user input in the image area 4210 may be maintained at another time point. For example, if the image is enlarged as a user input is input to the 4211 image, the setting of the enlargement may be applied to the image 4212 analyzed at the second time point 4222 and displayed. The image analyzed at the second time point 4222 may be displayed to correspond to a previously enlarged area.

43 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure.

Referring to FIG. 43 , when one of various analysis items is selected on the analysis result screen 4300 , a result according to the selected analysis item may be displayed through the image area 4310 or the analysis result area 4320 .

According to various embodiments of the present disclosure, when the user selects the trouble 4331 among the analysis items (eg, summary, wrinkles, trouble 4331 or pigmentation), the image 4311 analyzed for the trouble is the image area It can be indicated through (4310). A result of analyzing the trouble with respect to the image 4311 may be displayed as a graph 4321 through the analysis result area 4320 .

According to various embodiments of the present disclosure, the displayed image 4311 is used to analyze face information when a user input is input, and a figure corresponding to the analyzed trouble is displayed by being superimposed on the displayed image. The user can check the location or status of the trouble.

According to various embodiments of the present disclosure, the user may input a user input (eg, tap and drag) 4301 to move an area to be checked in the image to the image area 4310 . For example, a result of analyzing a trouble in the moved image area 4312 may be displayed as a graph 4322 through the analysis result area.

According to various embodiments of the present disclosure, the size or position of the image displayed on the image area 4310 may be maintained as a user input is input, and even if a specific time point is selected, the image analyzed at that time point may be displayed according to the changed size or location setting.

44 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure;

Referring to FIG. 44 , in the analysis result screen 4400 , when one of various analysis items (eg, trouble 4431) is selected, the history of face information according to the selected analysis item is displayed in the image area 4410 or the analysis result area. It can be indicated through (4420).

According to various embodiments of the present disclosure, the image area 4410 may be moved or enlarged in a specific image, and the moved or enlarged position may be maintained even when an image analyzed at another time is displayed. For example, the user may input a user input (eg, a touch gesture) to the image area 4410 to move the image area 4410 to a desired area or to enlarge the moved area.

According to various embodiments of the present disclosure, the user may select the trouble 4431 from among the analysis items and position or enlarge the position of the image area 4410 to the left cheek area. Here, in the image area 4410 , an image at the first analyzed time point among the images analyzed for the trouble 4431 may be displayed.

According to various embodiments of the present disclosure, as the user inputs the user input 4401 as the first viewpoint 4421 , in the image area 4410 , the first image 4411 analyzed at the first viewpoint 4421 is ) may be displayed. For example, in response to the user moving or enlarging the image area 4410 , the area at the corresponding moved or enlarged position among the first image 4411 may be displayed.

According to various embodiments of the present disclosure, when a user input 4401 is input as the second time point 4422 , the second image 4412 analyzed at the second time point 4422 is the image area 4410 . can be displayed through For example, in response to the user moving or enlarging the image area 4410 , the area at the corresponding moved or enlarged position among the second image 4412 may be displayed.

According to various embodiments of the present disclosure, when a user input 4401 is input as the third time point 4423 , the third image 4413 analyzed at the third time point 4423 is the image area 4410 . can be displayed through For example, in response to the user moving or enlarging the image area 4410 , the area at the corresponding moved or enlarged position among the third image 4413 may be displayed.

45 is a diagram illustrating an example of a screen showing a history of analyzed face information, according to various embodiments of the present disclosure.

Referring to FIG. 45 , in the analysis result screen 4500 , when one of various analysis items (eg, pigmentation 4531 ) is selected, the history of face information according to the selected analysis item is displayed in the image area 4510 or the analysis result. It may be displayed through the area 4520 .

According to various embodiments of the present disclosure, the image area 4510 may be moved or enlarged in a specific image, and the moved or enlarged position may be maintained even when an image analyzed from another viewpoint is displayed. For example, the user may input a user input (eg, a touch gesture) to the image area 4510 to move the image area 4510 to a desired area or to enlarge the moved area.

According to various embodiments of the present disclosure, the user may select the pigmentation 4531 from among the analysis items and position or enlarge the position of the image region 4510 on the left cheek region. Here, in the image area 4510 , an image at the first analyzed time point among the images analyzed for the pigmentation 4531 may be displayed.

According to various embodiments of the present disclosure, as the user inputs the user input 4501 as the first viewpoint 4521 , in the image area 4510 , the first image 4511 analyzed at the first viewpoint 4521 is displayed. ) may be displayed. For example, in response to the user moving or enlarging the image area 4510 , the area at the corresponding moved or enlarged position among the first image 4511 may be displayed.

According to various embodiments of the present disclosure, when a user input 4501 is input as the second time point 4522 , the second image 4512 analyzed at the second time point 4522 is the image area 4510 . can be displayed through For example, in response to the user moving or enlarging the image area 4510 , the area at the corresponding moved or enlarged position among the second image 4512 may be displayed.

According to various embodiments of the present disclosure, when the user input 4501 is input as the third time point 4523 , the third image 4513 analyzed at the third time point 4523 is the image area 4510 . can be displayed through For example, in response to the user moving or enlarging the image area 4510 , the area at the corresponding moved or enlarged position among the third image 4513 may be displayed.

46 is a diagram illustrating an example of an operation of photographing for face analysis, according to various embodiments of the present disclosure.

Referring to FIG. 46 , the electronic device may acquire a face image of the user by activating a camera module located on the front part of the electronic device. For example, the electronic device may acquire images in various situations, such as when the user's face is photographed at a specific angle at every preset period, when the electronic device is tilted at a specific angle, and the like.

According to various embodiments of the present disclosure, when the user is viewing the web browser screen using the electronic device, the electronic device executes the camera module in the background to image the user's face regardless of the web browser screen. (4600) can be photographed.

According to various embodiments of the present disclosure, the electronic device may identify at least one reference point 4601 in the photographed face image 4600 and identify a face region using the reference point to analyze face information.

47A and 47B are views illustrating various examples of screens showing results of skin analysis.

According to various embodiments of the present disclosure, the analysis result screen 4700 may be configured in various layouts according to the size or rotation direction of the display.

47A and 47B , when the display is horizontally positioned or the electronic device is a tablet PC, the image area 4710 and the analysis item area 4700 may be arranged horizontally on the analysis result screen 4700 . .

According to various embodiments of the present disclosure, when the user selects pigmentation 4722 in the analysis item area 4700, the result of analyzing pigmentation in at least one face area is the image area 4710 or It may be displayed through the analysis result area 4730 .

In the image region 4710 , as the user input 4701 is input to a specific face region (eg, cheek region), the analysis result for the face region to which the user input 4701 is input is enlarged and a separate window 4712 is displayed. ) can be displayed through

According to various embodiments of the present disclosure, as a specific analysis item is selected in the analysis item area 4700 , an analysis result for face information may be displayed through the analysis result area 4730 . For example, the analysis result area 4730 may include an emoticon 4731 for the analysis result for the selected pigmentation, a graph showing scores for each item, or an improvement in pigmentation 4732 compared to the previous one.

According to various embodiments of the present disclosure, when the user selects total 4721 in the analysis item area 4700, the result of analyzing various analysis items in at least one face area is the image area 4710 or It may be displayed through the analysis result area 4730 .

At least one facial region 4713 analyzed according to various analysis items may be displayed in the image region 4710 , and a legend 4714 indicating a skin state corresponding to the color of each facial region may be included. For example, the user may determine the skin condition of the corresponding part by checking the color of each face region.

According to various embodiments of the present disclosure, in the analysis result area 4730, a graph 4733 showing a score by comparing the analysis results for various analysis items (eg, pores, wrinkles, pigmentation or trouble) with the previous analysis results is displayed. may be included.

In addition, the embodiments of the present invention disclosed in the present specification and drawings are merely provided for specific examples to easily explain the technical contents of the present invention according to the embodiments of the present invention and to help the understanding of the embodiments of the present invention. It is not intended to limit the scope. Therefore, in the scope of various embodiments of the present invention, in addition to the embodiments disclosed herein, all changes or modifications derived based on the technical ideas of various embodiments of the present invention should be construed as being included in the scope of various embodiments of the present invention.

Claims (30)

A method for analyzing face information in an electronic device, the method comprising:
detecting at least one face region from among a plurality of face regions in the image being photographed through the camera module of the electronic device;
identifying at least one facial region corresponding to at least one of an oral region, a nose region, an eye region, a buccal region, and a forehead region based on a zoom-in or focusing setting of the camera module on the at least one facial region;
identifying at least one analysis item corresponding to the identification of the at least one facial area from among a plurality of analysis items based on the identification of the at least one facial area;
measuring at least one skin condition in the at least one analysis item based on the identified at least one analysis item;
acquiring information related to a skin analysis history corresponding to the at least one face region based on the measured at least one skin condition; and
and displaying information related to the skin analysis history on a display of the electronic device. delete delete ◈Claim 4 was abandoned when paying the registration fee.◈ The method of claim 1, wherein measuring at least one skin condition in the at least one analysis item comprises:
and analyzing at least one of a thickness, a size, a number, a width, and a color for each one analysis item in the at least one face region,
The at least one analysis item includes at least one of wrinkles, acne, pigmentation, skin tone, dark circles, or pores. ◈Claim 5 was abandoned when paying the registration fee.◈ According to claim 1,
When a gesture is input to a specific region in the image, the method further comprising: displaying an image obtained by magnifying or focusing on the region in which the gesture is detected. ◈Claim 6 was abandoned when paying the registration fee.◈ According to claim 1,
detecting the at least one face region corresponding to the at least one analysis item in the image; and
The method further comprising analyzing the detected face region according to the at least one analysis item. ◈Claim 7 was abandoned when paying the registration fee.◈ According to claim 1,
The method further comprising the operation of displaying a screen obtained by enlarging or focusing the at least one face area. ◈Claim 8 was abandoned when paying the registration fee.◈ According to claim 1,
The method further includes an operation of enlarging or focusing the at least one face region when a preset operation is detected,
The preset operation is
The method comprising any one of an operation of executing an application in which the camera module is activated, an operation of activating the electronic device in a locked state, or an operation of positioning the electronic device at a specific angle or direction. delete ◈Claim 10 was abandoned when paying the registration fee.◈ According to claim 1,
checking a pre-stored analysis result for the at least one face region or the at least one analysis item; and
Comparing the identified pre-stored analysis result with the identified analysis result, and displaying a result of the comparison, the method further comprising: In an electronic device,
camera module,
a display for displaying an image being photographed through the camera module; and
At least one processor electrically connected to the camera module and the display,
the at least one processor,
detecting at least one facial region from among a plurality of facial regions in the image;
identifying at least one facial region corresponding to at least one of an oral region, a nose region, an eye region, a buccal region, or a forehead region based on a zoom-in or focusing setting of the camera module on the at least one facial region;
based on the identification of the at least one facial region, identify at least one analysis item corresponding to the identification of the at least one facial region from among a plurality of analysis items;
measuring at least one skin condition in the at least one analysis item based on the identified at least one analysis item;
acquiring information related to a skin analysis history corresponding to the at least one face region based on the measured at least one skin condition;
The electronic device is configured to control the display to display information related to the skin analysis history. delete delete 12. The method of claim 11,
the at least one processor,
It is set to analyze at least one of thickness, size, number, width, and color for each one analysis item in the at least one face region,
The at least one analysis item is
An electronic device comprising at least one of wrinkles, acne, pigmentation, skin tone, dark circles, or pores. ◈Claim 15 was abandoned when paying the registration fee.◈ 12. The method of claim 11,
the at least one processor,
When it is detected that a gesture is input to a specific region in the image, the electronic device is configured to control the display to display a detailed photographed image for the region in which the gesture is detected. 12. The method of claim 11,
the at least one processor,
detecting the at least one face region corresponding to the at least one analysis item in the image;
The electronic device is configured to analyze the detected face region according to a preset analysis item. ◈Claim 17 was abandoned when paying the registration fee.◈ 12. The method of claim 11,
the at least one processor,
The electronic device is configured to control the display to display a screen obtained by enlarging or focusing the at least one face region. 12. The method of claim 11,
the at least one processor,
When a preset motion is detected, it is set to control the camera module to enlarge or focus the at least one face region,
The preset operation includes any one of an operation of executing an application in which the camera module is activated, an operation of activating the electronic device in a locked state, or an operation of positioning the electronic device at a specific angle or direction. . delete 12. The method of claim 11,
the at least one processor,
Checking a pre-stored analysis result for the at least one face region or the at least one analysis item,
Comparing the confirmed pre-stored analysis result with the confirmed analysis result, the electronic device is configured to control the display to display a screen including the result of the comparison. A method for analyzing face information in an electronic device, the method comprising:
detecting at least one facial region from among a plurality of facial regions in the stored at least one image;
identifying at least one facial region corresponding to at least one of an oral region, a nose region, an eye region, a buccal region, and a forehead region;
identifying at least one analysis item corresponding to the identification of the at least one facial area from among a plurality of analysis items based on the identification of the at least one facial area;
measuring at least one skin condition in the at least one analysis item based on the identified at least one analysis item;
determining an analysis time for each of the at least one stored image in which the at least one face region is analyzed;
displaying an object representing the analysis time on at least a portion of a screen to identify a skin analysis history for the at least one face region;
acquiring an image analyzed at a time point selected according to a user input, the selected point point corresponding to the position of the object; and
and displaying the acquired image on a part different from at least a part of the screen,
The obtained image is an image corresponding to a skin analysis history for the at least one face region, and is generated based on at least one skin condition measured at the time point corresponding to the position of the object. ◈Claim 22 was abandoned when paying the registration fee.◈ 22. The method of claim 21,
The method further comprising: detecting the at least one face region based on at least one reference point set in the stored at least one image. delete delete ◈Claim 25 was abandoned when paying the registration fee.◈ 22. The method of claim 21,
determining whether the electronic device is in a situation for capturing another image; and
According to the determination result, further comprising the operation of taking an image,
The situation includes a case in which the electronic device is positioned at a set angle or a case in which a set user input is input. In an electronic device,
a camera module for taking an image; and
At least one processor electrically connected to the camera module,
the at least one processor,
detecting at least one face region among a plurality of face regions from at least one image captured and stored through the camera module;
at least one facial region corresponding to at least one of an oral region, a nose region, an eye region, a buccal region, or a forehead region;
based on the identification of the at least one facial region, identify at least one analysis item corresponding to the identification of the at least one facial region from among a plurality of analysis items;
measuring at least one skin condition in the at least one analysis item based on the identified at least one analysis item;
determining an analysis time for each of the at least one stored image in which the at least one facial region is analyzed,
displaying an object expressing the analysis time on at least a part of a screen to identify a skin analysis history for the at least one face region;
acquiring an image analyzed at a time point selected according to a user input, the selected point point corresponding to the position of the object;
It is set to display the acquired image on a part different from at least a part of the screen,
The acquired image is an image corresponding to a skin analysis history for the at least one face region, and is generated based on at least one skin condition measured at the time point corresponding to the position of the object. 27. The method of claim 26,
the at least one processor,
The electronic device is further configured to detect the at least one face region based on at least one reference point set in the stored at least one image. delete delete 27. The method of claim 26,
the at least one processor,
Determining whether the electronic device is in a situation for taking another image,
It is set to control the camera module to take an image according to the determination result,
The situation includes a case in which the electronic device is positioned at a set angle or a case in which a set user input is input.

Images