TW201629847A - Electronic device, and method for analyzing face information in electronic device - Google Patents

Abstract

A method for analyzing face information in an electronic device is provided. The method includes detecting at least one face region from an image that is being captured by a camera module, zooming in the at least one detected face region, and analyzing the at least one detected and zoomed in face region according to at least one analysis item.

Description

Electronic device and method for analyzing surface information in electronic device

The present invention relates to an electronic device and a method of analyzing facial information in an electronic device. More specifically, the present invention relates to a method of analyzing facial information in an electronic device, wherein once face information (eg, a face area) is recognized, the identified area can be enlarged or can be on the area during shooting. The focus is automatically set without any user control action.

Various electronic devices have been developed to provide various functions. For example, an electronic device (eg, a smart phone) has been designed to provide not only the function of capturing an image but also the function of recognizing the object being photographed.

The electronic device can be provided with a display to enable the user to use or enjoy various functions more efficiently. For example, the latest smart phones can be provided with front-sensitive touch-sensitive displays (eg, touch screens).

Various applications (or applications) can be installed and run on the electronic device. To run and control the applications in the electronic device, various input units (eg, touch screens, buttons, mice, keyboards, sensors, etc.) can be used.

To analyze an object being photographed (for example, a face area), the electronic device can obtain an image in which the object is enlarged or finely photographed. On the other hand, in order to obtain an enlarged or finely photographed image, the user can determine or recognize the object to be photographed and determine whether to set the focus on the detailed area of each object, thereby taking a photographing function on the electronic device (or shooting Function) empowerment.

The above information is presented as background information only to assist in understanding the present invention. No determination or assertion is made as to whether any of the above is suitable for use as prior art with respect to the present invention.

Aspects of the present invention are to address at least the above problems and/or disadvantages and to provide at least the advantages described. Accordingly, an aspect of the present invention is to provide an electronic device and a method of analyzing facial information in an electronic device, wherein once facial information (eg, a face region) is recognized, the identified region can be enlarged or can be used during shooting. The focus is automatically set on the area without any user control action.

According to an aspect of the present invention, a method of analyzing facial information in an electronic device is provided. The method includes: detecting at least one face region from an image being captured by the camera module; amplifying the at least one detected face region; and analyzing the enlarged face region according to at least one analysis item.

According to another aspect of the present invention, an electronic device is provided. The electronic device includes: a camera module; a display for displaying an image being captured by the camera module; and a controller for: detecting at least one facial region from the image, and controlling the camera module Amplifying the at least one detected face region and analyzing the at least one detected and enlarged face region according to at least one analysis item.

According to still another aspect of the present invention, a method of analyzing facial information in an electronic device is provided. The method includes detecting at least one facial region from at least one stored image; and analyzing the at least one detected facial region based on the at least one analysis item.

According to still another aspect of the present invention, an electronic device is provided. The electronic device includes: a camera module for capturing an image; and a controller for: detecting at least one facial region by at least one image captured and stored by the camera module; and analyzing according to at least one analysis item The at least one detected face area.

Other aspects, advantages, and salient features of the present invention will become apparent to those skilled in the art.

The following description is provided with reference to the accompanying drawings, in which, FIG. The description below includes various specific details to assist in understanding, but the specific details are only considered as exemplary. Therefore, it will be appreciated by those skilled in the art that various changes and modifications can be made in the various embodiments described herein without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.

The words and words used in the following description and claims are not intended to be Therefore, it is to be understood by those skilled in the art that the description of the various embodiments of the present invention are intended to be illustrative only and not to limit the invention as defined by the scope of the appended claims.

It will be understood that the singular forms "a", "the" and "the" Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.

When the term "substantially" is used, it is meant that the characteristics, parameters, or values are not required to be accurately obtained, but variations or variations in amounts that do not exclude the effects that the features are intended to provide may occur (including, for example, familiarity with the art) Known tolerances, measurement errors, measurement accuracy limits, and other factors).

The term "comprise" and "comprising" is used to mean the existence of a function, operation, or component disclosed, but does not exclude the presence or addition of one or more other functions, operations, or components. It will be further understood that the terms "comprising" and "comprising", "," The presence or addition of features, integers, operations, components, components, and/or their ethnic groups.

The term "A or B" or "at least one of A and/or B" as used herein includes any and all combinations of one or more of the associated listed items. For example, "A or B" or "at least one of A or / and B" may include A or include B or both A and B, respectively.

The ordinal numbers used herein (e.g., "first", "second", etc.) may modify various components of the various embodiments of the invention, but are not limiting. For example, the terms do not limit the order and/or importance of the components. These terms are only used to distinguish between components. For example, the first user device and the second user device are user devices that are different from each other. For example, a first component can be represented by a second component, and vice versa, without departing from the scope of the invention, in accordance with various embodiments of the invention.

When a component is "connected" or "coupled" to another component, the component can be directly connected or coupled to the other component, or another (other) component can be interposed therebetween. In contrast, when a component is "directly connected" or "directly coupled" to another component, other intervening components may not be interposed therebetween.

The words used herein are used to describe certain embodiments of the invention, but not to limit the invention.

Unless otherwise defined, all terms including technical and scientific terms used herein have the same meaning meaning meaning meaning It will be further understood that terms (such as those defined in commonly used dictionaries) should be interpreted as having a meaning consistent with their meaning in the relevant technical context, and should not be construed as having the meaning as defined herein. Idealized or overly formal meaning.

An electronic device according to various embodiments of the present invention may be a camera module. For example, the electronic device may include at least one of the following: a smart phone, a personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop personal computer. , laptop personal computer, portable netbook computer, personal digital assistant (PDA), portable multimedia player (PMP), animation expert group stage 1 or stage 2 (MPEG-1 or MPEG-2) Music Picture Experts Group phase 1 or phase 2 audio layer 3 (MP3) player, mobile medical device, camera, or wearable device (for example, head mounted device (head -mounted-device, HMD), such as electronic glasses, electronic clothes, electronic bracelets, electronic necklaces, electronic application accessories (or application accessories), electronic tattoos, smart watches, etc.).

In various embodiments of the invention, the electronic device may be a smart home appliance having a camera module. The smart home appliance may include at least one of the following: for example, a television (television, TV), a digital video disc (DVD) player, an audio player, a refrigerator, an air conditioner, a cleaner, an oven, a microwave oven , washing machine, air purifier, set-top box, TV box (for example, Samsung HomeSync ^TM , Apple TV ^TM or Google TV ^TM ), game consoles, electronic dictionaries, Electronic key, camcorder, or electronic photo frame.

In various embodiments of the invention, the electronic device may include a camera module, and may further include at least one of: various medical devices (eg, magnetic resonance angiography (MRA), magnetic resonance imaging ( Magnetic resonance imaging (MRI), computed tomography (CT), video camera, ultrasonic device, navigation device, global positioning system (GPS) receiver, event data recorder ( Event data recorder (EDR), flight data rocorder (FDR), vehicle-mounted entertainment information device, marine electronic device (eg, ship navigation device, gyrocompass, etc.), avionics, security device , car head unit, industrial or domestic robots, automatic teller's machine (ATM) for banks, and point of sale (POS) for stores.

In various embodiments of the invention, the electronic device can include at least one of: a piece of furniture or a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring instruments (eg, a water meter, An electric meter, a gas meter, a radio wave watch, etc., each of which includes a camera module. An electronic device according to various embodiments of the present invention may be one or a combination of the above devices. Further, an electronic device according to various embodiments of the present invention may be a flexible device. Those skilled in the art will appreciate that electronic devices in accordance with various embodiments of the present invention are not limited to the devices described above.

According to various embodiments of the present invention, facial information that may be analyzed by an electronic device may include skin information of a facial region (eg, eyes, nose, eyebrows, cheeks, etc.).

According to various embodiments of the present invention, the electronic device may analyze the skin information according to at least one analysis item. For example, items for analyzing facial information may include items for measuring various skin conditions, such as pores, acne, pigmentation, skin color, black circles, wrinkles, and the like.

According to various embodiments of the present invention, the operation in which the electronic device performs fine photography may include an operation in which focus is set on the area and the area is enlarged during photographing in order to finely photograph any one of the specific images .

An electronic device according to various embodiments of the present invention will hereinafter be described with reference to the accompanying drawings. The term "user" as used herein may refer to a person using an electronic device or a device using an electronic device (eg, a smart electronic device).

1 is a block diagram illustrating a configuration of an electronic device in accordance with various embodiments of the present invention.

Referring to FIG. 1 , the electronic device 100 may include at least one of a controller 110 , a camera module 120 , an input unit 130 , a display 140 , or a storage 150 .

The controller 110 may include at least one of the item setting unit 111, the photographing controller 112, the image analyzer 113, the area selector 114, or the analysis result generator 115, and may control the overall operation of the electronic device 100.

The item setting unit 111 can recognize a specific face area in the captured image and select at least one item for analyzing the skin condition of the recognized face area. For example, if an area surrounding the eyes is recognized in the captured image, the item setting unit 111 can set wrinkles, black circles, and the like as items for analyzing the skin condition of the area surrounding the eyes. As another example, if the cheek region is recognized in the captured image, the item setting unit 111 can set pigmentation, dark spots, freckles, skin color, and the like as items for analyzing the skin condition of the cheek region.

When a particular face area is recognized in the photography mode, the camera controller 112 can control the camera module 120 such that the identified face area can be zoomed in or fine-shot. For example, the photographing controller 112 can control the camera module 120 to set a focus or enlarge the at least one area recognized as a face area during photographing in the photographed image recognized by the camera module 120. At least one zone.

The image analyzer 113 may select at least one item for analyzing a specific face area in the image, and analyze the face area according to the selected item. For example, the image analyzer 113 can analyze the area around the eye that is recognized in the captured image based on the selected item (eg, wrinkles or black circles). For example, image analyzer 113 can analyze the depth or number of wrinkles or the width or color of the black circles in the identified area around the eye.

The region selector 114 can determine whether a face region is recognized in a particular image. According to various embodiments of the present invention, if a particular face area is recognized, the zone selector 114 may control the camera module 120 to set a focus or enlarge the face zone on the face zone during shooting.

The analysis result generator 115 can determine the result of the face information analyzed by the image analyzer 113, generate a screen including the determined result, and display the generated screen.

According to various embodiments of the present invention, the analysis result generator 115 may represent an analysis item or analysis result of each face area in various ways to generate a screen of the analyzed face information. For example, the analysis result generator 115 can generate a screen of facial information such that each analysis item can be displayed in a different color (eg, acne can be displayed in red and pigmentation can be displayed in blue). Further, by determining the previous analysis result, the analysis result generator 115 can display the improved face area in green or blue and the deteriorated face area in red to generate a screen of face information.

According to various embodiments of the present invention, if a region corresponding to a specific face region or a region distinguished by a different color according to an analysis item or an analysis result is selected from the captured image, the analysis result generator 115 may provide an enlargement or analysis by An image obtained by selecting a face area. For example, the analysis result generator 115 can control the display 140 to display the generated image.

The camera module 120 can capture images. According to various embodiments of the present invention, the camera module 120 may be controlled by the controller 110 to set a focus on an area recognized as a specific face area during shooting and to enlarge the area.

Display 140 can display images being captured by camera module 120.

According to various embodiments of the present invention, if a specific area is selected from the displayed image, the display 140 may display an image obtained by enlarging or finely photographing the area. For example, when the electronic device 100 selects a specific area, the enlarged image may be an image obtained by enlarging and photographing the selected area. When the electronic device 100 selects a specific area, the enlarged image may be an image in which the focus is set on the selected area during the shooting and the selected area is enlarged.

The storage 150 may include skin analysis information 151 or user identification information 152. Skin analysis information 151 can include skin analysis information based on a particular facial region of the analysis item.

The skin analysis information 151 may include information obtained by analyzing the skin condition of a specific area of each item. For example, skin analysis information 151 can include information obtained by determining the presence/absence of pigmentation, skin color problems, dark spots, or acne in a particular facial region, previously analyzed information for each item, or in chronological order. Historical information showing the results of skin analysis for each facial region is shown.

User identification information 152 may include facial information for a particular user. For example, the image analyzer 113 can use the user identification information 152 to compare the "eye" area identified in the captured image with the previously stored "eye" image of another user. For the user identification information 152, based on the comparison result in the image analyzer 113, the analysis result of the face area recognized in the captured image can be stored in the face information about the user including the same face area.

For example, an electronic device according to various embodiments of the present invention may include: a camera module; a display for displaying an image being captured by the camera module; and a controller for detecting at least the image from the image a face area, controlling the camera module to enlarge the at least one detected face area, and analyzing the enlarged face area according to at least one analysis item.

The at least one facial region according to various embodiments of the present invention may include an area surrounding at least one of an eye, a nose, a cheek, a mouth, or an eyebrow.

The at least one analysis item according to various embodiments of the present invention may include at least one of wrinkles, acne, pigmentation, skin color, black circles, or pores.

The controller according to various embodiments of the present invention may analyze at least one of thickness, size, number, width, or color for each analysis item in the enlarged face area.

When an input gesture to a particular zone is detected in the image, the controller in accordance with various embodiments of the present invention can control the display to display an image obtained by amplifying the zone in which the gesture is detected.

The controller according to various embodiments of the present invention may detect a face area of at least one predetermined analysis item from an image and analyze the detected face area according to the predetermined analysis item.

Upon detecting the at least one facial region, the controller in accordance with various embodiments of the present invention can control the display to display a screen of the enlarged facial region.

The controller according to various embodiments of the present invention may control the camera module to finely capture the at least one detected face region upon detecting a predetermined motion.

The predetermined actions according to various embodiments of the present invention may include any of the following: an action of an application in which the camera module is enabled, an action of energizing an electronic device in a locked state, or an electronic The device 100 is positioned at a particular angle or action in a particular direction.

A controller in accordance with various embodiments of the present invention may determine pre-stored analysis results for a particular facial region or analysis item, compare the determined pre-storage analysis results to the results of the analysis, and control the display to display results including the comparison Screen.

2 is a flow chart illustrating an operation of analyzing skin information at an electronic device in accordance with various embodiments of the present invention.

Referring to FIG. 2, in operation 210, the electronic device can detect a face area from the captured image.

In operation 220, the electronic device may select an analysis item from the captured face area.

In operation 230, the electronic device may finely photograph the selected item. For example, the electronic device can set a focus on the selected item and zoom in on the selected item during shooting.

In operation 240, the electronic device can analyze the magnified image. In accordance with various embodiments of the present invention, an electronic device can compare an enlarged image to a previously stored result value. For example, the electronic device can compare the magnified image with previously stored result values to analyze the facial region corresponding to the magnified image.

According to various embodiments of the present invention, if the user captures an image including a face region, the captured output image may include an image obtained by enlarging or finely capturing each face region included in the captured image, or includes An image of the result of an analysis of an enlarged or finely captured image. For example, by photographing a face area, the user can obtain an image obtained by zooming in or finely photographing each face area and a result of analyzing the enlarged or finely-shot image without making any use for the face. Additional actions for analysis.

At least one of operations 210 through 240 shown in FIG. 2 may be omitted, or at least one other operation may be added between operations 210 through 240. Moreover, operations 210 through 240 of FIG. 2 may be performed in the order shown, or at least one of operations 210 through 240 may be changed in order of execution.

For example, a method for analyzing facial information in an electronic device according to various embodiments of the present invention may include: detecting at least one facial region from an image being captured by the camera module, and amplifying the at least one detected facial region And analyzing the enlarged facial area based on at least one analysis item. The at least one facial region can include an area surrounding at least one of an eye, a nose, a cheek, a mouth, or an eyebrow. The at least one analysis item can include at least one of wrinkles, acne, pigmentation, skin tone, black circles, or pores.

The analyzing according to various embodiments of the present invention may include analyzing at least one of thickness, size, number, width, or color for each of the enlarged facial regions.

The method according to various embodiments of the present invention may further include: displaying an image obtained by enlarging an area in which the gesture is detected when an input gesture to a specific area is detected in the image.

The method according to various embodiments of the present invention may further include: detecting a face area of the at least one predetermined analysis item from the image, and analyzing the detected face area according to the predetermined analysis item.

The method according to various embodiments of the present invention may further include displaying a screen obtained by enlarging the detected face region when the at least one face region is detected.

The method according to various embodiments of the present invention may further include amplifying the at least one detected face region upon detecting a predetermined action. The predetermined action may include any of: an action of running an application in which the camera module is enabled, an action of energizing an electronic device in a locked state, and positioning the electronic device at a specific angle or a specific direction Actions.

The method according to various embodiments of the present invention may further comprise: determining a pre-stored analysis result of the particular facial region or analysis item, and comparing the determined pre-stored analysis result with the analyzed result, and displaying the result of the comparison .

3 is a flow chart illustrating an operation of analyzing skin information at an electronic device in accordance with various embodiments of the present invention.

Referring to FIG. 3, in operation 310, the electronic device can detect a face area from the captured image.

In operation 320, the electronic device may recognize at least one focused area in the captured face area.

In operation 330, the electronic device may magnify or finely photograph at least one of the focused regions. For example, when the focused area is enlarged or finely photographed, the output image may be an image obtained by setting a focus on a specific area and/or enlarging the specific area during shooting.

Although the electronic device has performed an operation of recognizing at least one of the focused regions in operation 320 in accordance with various embodiments of the present invention, the electronic device may zoom in or out when detecting the facial region from the captured image in operation 310. Shoot the detected face area. In this case, operation 320 can be omitted.

At least one of operations 310 through 330 shown in FIG. 3 may be omitted, or at least one other operation may be added between operations 310 through 330. Moreover, operations 310 through 330 of FIG. 3 may be performed in the order shown, or at least one of operations 310 through 330 may be changed in order of execution.

4 is a flow chart illustrating an operation of analyzing skin information at an electronic device in accordance with various embodiments of the present invention.

Referring to FIG. 4, in operation 410, the electronic device can determine whether to run any application in the non-photographic mode.

In operation 420, the electronic device can determine whether a predetermined user input is detected.

If it is determined that the predetermined user input is not detected, the electronic device may perform operation 410 again.

If it is determined that the predetermined user input is detected, then in operation 430, the electronic device can control the camera module to operate in the background.

In operation 440, the electronic device can determine whether a face area is recognized in the captured image.

If it is determined that the face area is not recognized, the electronic device may perform operation 410 again.

If it is determined that the face area is identified, then in operation 450, the electronic device can select at least one analysis item of the recognized image. For example, the at least one analysis item in the image can include at least one of items for measuring various skin conditions, such as pores, acne, pigmentation, skin tone, black circles, wrinkles, and the like.

In operation 460, the electronic device can control the camera module to zoom in on the selected item or set a focus on the selected item.

In operation 470, the electronic device can analyze the magnified image.

At least one of operations 410 through 470 shown in FIG. 4 may be omitted, or at least one other operation may be added between operations 410 through 470. Moreover, operations 410 through 470 shown in FIG. 4 may be performed in the order shown, or at least one of operations 410 through 470 may be changed in order of execution.

5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H illustrate a state in which a face area and a face area thereof are partially enlarged or finely photographed, according to various embodiments of the present invention.

Referring to Figures 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H, it is assumed that the electronic device is photographing or photographing the entire face, in accordance with various embodiments of the present invention. The electronic device can recognize at least one facial region in the image 500 being captured.

Referring to FIG. 5A, the electronic device may recognize at least one of the eyebrow 501, the right eye 502, the left eye 506, the nose 503, the edge 504 of the mouth, the cheek 505, or the face 507 in the image 500 being photographed.

According to various embodiments of the present invention, when at least one face region is detected in the image 500 being captured, the electronic device may enlarge the region to capture an image obtained by locally magnifying or finely photographing the region.

Referring to FIG. 5B, when the eyebrows 501 are recognized in the image 500 being photographed, the electronic device may enlarge the area of the eyebrows 501 to locally enlarge or finely photograph the area. The electronic device may obtain skin analysis information based on the at least one analysis item from the captured image obtained by locally magnifying the area of the eyebrows 501. For example, the skin analysis information may include information about the wrinkles 501a in the area of the eyebrows 501.

Referring to FIG. 5C, when the right eye 502 is recognized in the image 500 being captured, the electronic device may enlarge the area of the right eye 502 to locally enlarge or finely photograph the area. The electronic device may obtain skin analysis information based on the at least one analysis item from the captured image obtained by locally enlarging the area of the right eye 502. For example, the skin analysis information can include information about the wrinkles 502a in the region of the right eye 502.

Referring to FIG. 5D, when the nose 503 is recognized in the image 500 being photographed, the electronic device may enlarge the area of the nose 503 to locally enlarge or finely photograph the area. The electronic device may obtain skin analysis information based on the at least one analysis item from the captured image obtained by partially magnifying the area of the nose 503. For example, the skin analysis information can include information about the pores 503a in the region of the nose 503.

Referring to FIG. 5E, when the edge 504 of the exit is recognized in the image 500 being captured, the electronic device may enlarge the area of the edge 504 of the mouth to partially or finely photograph the area. The electronic device can obtain skin analysis information based on the at least one analysis item from the captured image obtained by locally amplifying the area of the edge 504 of the mouth. For example, the skin analysis information can include information about the pigmentation 504a in the region of the edge 504 of the mouth.

Referring to FIG. 5F, when the cheek 505 is recognized in the image 500 being photographed, the electronic device can enlarge the area of the cheek 505 to locally enlarge or finely photograph the area. The electronic device can obtain skin analysis information based on at least one analysis item from the captured image obtained by locally magnifying the area of the cheek 505. For example, skin analysis information may include information about acne 505a in the area of cheek 505.

Referring to FIG. 5G, when the left eye 506 is recognized in the image 500 being captured, the electronic device may enlarge the area of the left eye 506 to locally enlarge or finely photograph the area. The electronic device may obtain skin analysis information based on the at least one analysis item from the captured image obtained by locally enlarging the area of the left eye 506. For example, the skin analysis information can include information about the black circle 506a in the region of the left eye 506.

Referring to FIG. 5H, when the face 507 is recognized in the image 500 being captured, the electronic device may enlarge the area of the face 507 to locally enlarge or finely photograph the area. The electronic device may obtain skin analysis information based on at least one analysis item from the captured image obtained by locally magnifying the area of the face 507. For example, the skin analysis information may include information about the skin color 507a in the area of the face 507.

Figure 6 illustrates a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 6, the electronic device has captured an image 600 including at least one face region, and can recognize at least one analysis item in the captured image 600. For example, the electronic device can identify acne 601, wrinkles 602, or pigmentation 603 as an analytical item.

Figure 7 illustrates an operation of analyzing a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 7, the electronic device can analyze the pigmentation 711 in each analysis item in the captured image 710.

According to various embodiments of the present invention, an electronic device may generate an image 720 obtained by inverting a color of a pigmented portion in a captured image. The electronic device can determine a color-inversed region in image 720, thereby identifying at least one pigmentation portion 721. For example, the electronic device can determine whether the pigmentation has been improved or worsened than before depending on the number of pigmented portions.

Figure 8 illustrates an operation of analyzing a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 8, the electronic device can analyze the acne 811 in each analysis item in the captured image 810.

According to various embodiments of the present invention, the electronic device may generate an image 820 obtained by inverting a color of a portion of the photographed image in which acne is recognized. For example, the electronic device can determine a color reversal zone in image 820, thereby identifying at least one acne point 821. For example, the electronic device can determine whether the acne has increased or decreased according to the number of acne spots.

Figure 9 illustrates an operation of analyzing a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 9, the electronic device can analyze the pores 911 in each analysis item in the captured image 910.

According to various embodiments of the present invention, the electronic device may generate an image 920 obtained by darkening the color of the portion of the captured image in which the pores are recognized. For example, the electronic device can determine a color darkening region 921 in the image 920, thereby identifying at least one pore. For example, the electronic device can determine whether the pores have increased or decreased according to the number of pores.

Figure 10 illustrates an operation of analyzing a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 10, the electronic device can analyze wrinkles in each analysis item in the captured image 1000.

According to various embodiments of the present invention, the electronic device may represent the wrinkle line 1001 in a region in which wrinkles are recognized in the captured image 1000. For example, the electronic device can determine the presence/absence of wrinkles by determining at least one wrinkle line 1001 in the captured image 1000.

According to various embodiments of the present invention, the electronic device may determine the thickness or number of at least one wrinkle line represented in the captured image. For example, the electronic device can determine whether the wrinkles have become deeper than before according to the thickness of the at least one wrinkle line, and can determine whether the wrinkles have increased or decreased according to the number of wrinkles.

Figure 11 illustrates an operation of analyzing a facial analysis item in accordance with various embodiments of the present invention.

Referring to FIG. 11, the electronic device can analyze the skin color in each analysis item in the captured image 1100.

According to various embodiments of the present invention, the electronic device may set a part of the skin as the skin color analysis area 1101 in the captured image 1100. For example, by determining at least one skin color analysis area 1101 in the captured image 1100, the electronic device can compare the value obtained by measuring the at least one skin color analysis area 1101 with the previously measured skin color value. , or the measured value of the skin color analysis area can be obtained.

According to various embodiments of the present invention, the electronic device may analyze the skin color analysis area 1101 in the captured image 1100. For example, the electronic device can measure the color, contrast, brightness, color temperature, and the like of the skin color analysis area, thereby determining whether the measured skin color is darker or brighter than the previously measured skin color.

Figure 12 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention.

Referring to FIG. 12, it is assumed that an electronic device is photographing or photographing a face area for face analysis.

According to various embodiments of the invention. The electronic device can determine characteristics of the image currently being captured (eg, resolution, image size, white balance, etc.). The electronic device can compare the characteristics of the image currently being captured with the characteristics of the previously captured image. For example, if the characteristics of the image currently being captured (eg, white balance) are not similar to the characteristics of the previously captured image, the electronic device can synchronize the characteristics of the image currently being captured with the characteristics of the previously captured image ( Synchronize).

Referring to FIG. 12, the electronic device may display a screen 1210 indicating that the electronic device is matching the white balance of the image currently being captured with the white balance of the previously captured image. After synchronizing the characteristics of the image currently being captured with the characteristics of the previously captured image, the electronic device can display a screen 1220 indicating that photography can be performed because the synchronization of the white balance has been completed.

In accordance with various embodiments of the present invention, the user can determine on screen 1220 that the current photographic condition of the electronic device is set to be similar to the previous photographic condition of the image for facial analysis. Therefore, it is possible to prevent a situation in which the analysis result of the face information may be different due to, for example, lighting, indoor/outdoor environment, weather, etc., although the skin condition is the same.

13A, 13B, and 13C illustrate screens showing the results of facial analysis, in accordance with various embodiments of the present invention.

Referring to FIGS. 13A, 13B, and 13C, in accordance with various embodiments of the present invention, when at least one face region is recognized in the captured image, the electronic device may magnify or finely photograph the at least one face region. For example, the electronic device can generate an analysis result screen 1300 that includes an enlarged or finely photographed region in the face region corresponding to the captured image. For example, the analysis results screen 1300 can include an enlarged or finely photographed area of each of the eye 1310, the nose 1320, and the cheek 1330 that are recognized as at least one facial region.

Referring to Figure 13A, a user can select an eye 1310 on the analysis results screen 1300. According to various embodiments of the present invention, an electronic device may output an image obtained by enlarging or finely photographing an eye 1310. For example, in an image obtained by enlarging or finely photographing the eye 1310, a line representing at least one wrinkle 1311 around the eye 1310 may be displayed.

Referring to FIG. 13B, the user can select the nose 1320 on the analysis result screen 1300. According to various embodiments of the present invention, an electronic device may output an image obtained by enlarging or finely photographing the nose 1320. For example, in an image obtained by enlarging or finely photographing the nose 1320, at least one acne point 1321 around the nose 1320 can be displayed.

Referring to FIG. 13C, the user can select the cheek 1330 on the analysis result screen 1300. According to various embodiments of the present invention, the electronic device may output an image obtained by enlarging or finely photographing the cheek 1330. For example, in an image obtained by enlarging or finely photographing the cheek 1330, the color of at least one pigmentation portion 1331 around the cheek 1330 can be highlighted.

Figure 14 illustrates a screen showing the results of a skin analysis in accordance with various embodiments of the present invention.

Referring to Figure 14, the analysis results screen 1410 can include a selection of View Skin Analysis History 1411 to show a history of skin analysis results for each of the analysis items.

In accordance with various embodiments of the present invention, if the skin analysis history 1411 is selected for viewing, the electronic device can switch to the skin analysis history screen 1420.

Skin analysis history screen 1420 in accordance with various embodiments of the present invention may illustrate skin analysis items (eg, skin color, acne, wrinkles, pigmentation, pores, etc.) measured over a particular period of time (eg, from June to August). The history of skin analysis results for each of them.

For example, the skin tone measurement result 1421 may show that the measured skin tone is brighter than before. The acne measurement result 1422 can show that the measured acne has increased compared to before. The wrinkle measurement result 1423 may show that the number of measured wrinkles is similar to the number of previous wrinkles. The pigmentation measurement result 1424 can show that the color of the pigmented portion is lighter than before. The pore measurement result 1425 can show that the number of pores has increased compared to before.

Figure 15 illustrates a screen showing the results of a skin analysis in accordance with various embodiments of the present invention.

Referring to FIG. 15, in accordance with various embodiments of the present invention, an electronic device may analyze a particular facial region and recommend ways to improve the facial region based on the results of the analysis.

When the area surrounding the eye is recognized in the captured image 1510, the electronic device can analyze the skin condition of the area surrounding the eye and display the analysis result. For example, as a result of the analysis, the electronic device can determine that the number of new wrinkles or wrinkles that are recognized or found around the eyes of a particular user has increased.

According to various embodiments of the invention, the electronic device may provide a skin care recommendation screen 1520 that includes a way to improve wrinkles. For example, if the user selects a wrinkle mark 1511 in the captured image 1510, the electronic device can switch from the screen of the captured image 1510 to the skin care recommendation screen 1520.

The skin care recommendation screen 1520 according to various embodiments of the present invention may include a cosmetic 1521 that is beneficial for wrinkles, a running button (or an execution button) 1522 for searching for more eye creams, or a massage for recommending wrinkles around the eyes. The run button 1523 of the method (massage method). For example, the cosmetic 1521 beneficial to wrinkles may include ** eye cream 1521a, ##霜 1521b, or oo eye cream 1521c, and may further include an operational button that the user can use to evaluate each cosmetic or order a particular cosmetic.

Figure 16 illustrates a screen showing the results of a skin analysis in accordance with various embodiments of the present invention.

Referring to FIG. 16, in accordance with various embodiments of the present invention, an electronic device may analyze a particular facial region and recommend ways to improve the facial region based on the results of the analysis. For example, as a result of the analysis, the electronic device can recognize a portion in which the skin color around the cheek of a particular user changes.

When the area surrounding the cheek is recognized in the captured image 1610, the electronic device can display the skin color analysis area 1611 in which the skin color of the specific area of the cheek is analyzed.

According to various embodiments of the invention, the electronic device may provide a skin care recommendation screen 1620 that includes a way to improve skin tone. For example, if the user selects the skin color analysis area 1611 in the captured image 1610, the electronic device can switch from the screen of the captured image 1610 to the skin care recommendation screen 1620.

Skin care recommendation screen 1620 in accordance with various embodiments of the present invention may include a mask pack 1621 that facilitates skin tone improvement or an operational button 1622 that is used to search for more masks. For example, the facial mask 1621 that is beneficial for improving skin tone may include a ** mask 1621a or a □ □ mask 1621b, and may further include a screen that the user can use to jump to show the characteristics of each mask or a run button that orders a particular mask.

Figure 17 illustrates a screen showing the results of a skin analysis in accordance with various embodiments of the present invention.

Referring to FIG. 17, in accordance with various embodiments of the present invention, an electronic device may analyze a particular facial region and provide an advertising screen that can improve the product of the facial region based on the results of the analysis.

When at least one acne point in the area surrounding the cheek or in the area surrounding the cheek is recognized in the captured image 1710, the electronic device can highlight the identified acne 1711 in a highlighted manner.

In accordance with various embodiments of the present invention, an electronic device may provide an advertising screen 1720 that advertises a product that can improve acne. For example, if the user selects the acne 1711 shown in the captured image 1710, the electronic device can switch from the screen of the captured image 1710 to the advertising screen 1720.

The advertising screen 1720 in accordance with various embodiments of the present invention may include an advertisement for acne treatment or a "more" run button 1721 for switching to a screen that illustrates acne treatment.

Figure 18 illustrates a screen showing the results of a skin analysis in accordance with various embodiments of the present invention.

Referring to FIG. 18, according to various embodiments of the present invention, an electronic device may analyze a specific face area and recommend a manner of improving the face area based on the analysis result.

When the nose is recognized in the captured image 1810, the electronic device can display a pore analysis area 1811 in which the number of pores in the nose is analyzed.

According to various embodiments of the invention, the electronic device may provide a skin care recommendation screen 1820 that includes a way to reduce the number of pores. For example, if the user selects the pore analysis area 1811 in the captured image 1810, the electronic device can switch from the screen of the captured image 1810 to the skin care recommendation screen 1820.

Skin care recommendation screen 1820 in accordance with various embodiments of the present invention may include information 1821 regarding dermatology clinics known for pore treatment or advertisement 1822 for a particular dermatology clinic. For example, an advertisement 1822 for a particular dermatology clinic may include a screen showing a medical department of a dermatology clinic or a shortcut button for switching to an information screen of a dermatology clinic.

Figure 19 illustrates a network environment in accordance with various embodiments of the present invention.

Referring to FIG. 19, network environment 1900 can include at least one electronic device 1901 or 1904 or server 1906. The at least one electronic device 1901 or 1904 can be connected to the server 1906 via the network 1962.

The electronic device 1901 can include a bus bar 1910, a processor 1920, a memory 1930, an input/output (I/O) interface 1940, a display 1950, a communication interface 1960, and a camera module 1970.

Busbars 1910 may be circuits that connect the components to each other and communicate communication information (e.g., control messages) between the components.

The processor 1920 can receive commands from the other components (eg, the memory 1930, the input/output interface 1940, the display 1950, the communication unit 1960, the camera module 1970, etc.) via the bus 1910, for example, to decrypt the received command. And perform operations or data processing based on the decryption command.

The processor 1920 can control the overall operation of the electronic device 1901. According to various embodiments of the invention, the processor 1920 may include at least one controller (eg, the controller 110).

The memory 1930 can store commands received by the processor 1920 or other components (eg, input/output interface 1940, display 1950, communication interface 1960, camera module 1970, etc.) or generated by processor 1920 or the other components or data. The memory 1930 can include a stylized module, such as a core 1931, an intermediate software 1932, an application programming interface (API) 1933, or one or more applications 1934. Each of the above stylized modules can be configured by software, firmware, hardware, or a combination thereof.

The core 1931 can control or manage system resources (eg, bus 1910, processing) for performing operations or functions implemented in other stylized modules (eg, intermediate software 1932, application design interface 1933, or application 1934). 1920, memory 1930, etc.). In addition, the core 1931 can provide an intermediate software 1932, an application programming interface 1933, or an interface for the application 1934 to access various components of the electronic device 1901, and control or manage individual components.

The intermediate software 1932 can function as an intermediary so that the application design interface 1933 or the application 1934 can communicate with the core 1931 to exchange data with each other. Moreover, in response to the work request received from application 1934, intermediate software 1932 can perform control of the work request (eg, scheduling or load balancing), for example, by assigning at least one of application 1934 to The priority of system resources (e.g., bus 1910, processor 1920, memory 1930, etc.) of electronic device 1901 is utilized.

The application design interface 1933 can include at least one interface or function (eg, command) for, for example, file control, window control, image processing, character control, etc., as the application 1934 for controlling the provisioning in the core 1931 or the intermediate software 1932. Functional interface.

According to various embodiments of the present invention, the application 1934 may include a short message service (SMS)/multimedia messaging service (MMS) application, an email application, a calendar application, an alarm clock application, medical A health care application (for example, an application for measuring exercise or blood sugar), or an environmental information application (for example, an application for providing information on pressure, humidity, temperature, etc.). In addition or in the alternative, the application 1934 can be an application associated with the exchange of information between the electronic device 1901 and an external electronic device (eg, the electronic device 1904). The application related to the information exchange may include, for example, a notification relay application for relaying specific information to an external electronic device or a device management application for managing an external electronic device.

For example, the notification relay application may include other applications for the electronic device 1901 (for example, a short message service/multimedia communication service application, an email application, a health care application, an environmental information application, etc.) The generated notification information is passed to the function of an external electronic device (eg, electronic device 1904). Additionally or alternatively, the notification relay application can, for example, receive notification information from an external electronic device (e.g., electronic device 1904) and provide the received notification information to the user. The device management application can, for example, manage (eg, install, delete, or update) functionality of at least one component of an external electronic device (eg, electronic device 1904) in communication with electronic device 1901 (eg, control to turn the external electronic device on/off itself) (or some of its components) or the brightness (or resolution) of the display), managing applications running in external electronic devices, or managing services provided in external electronic devices (eg, call services or messaging services) .

According to various embodiments of the invention, the application 1934 may include an application specified in accordance with the nature of the external electronic device (eg, the electronic device 1904) (eg, the type of electronic device). For example, when the external electronic device is an MP3 player, the application 1934 can include an application related to music playback. Similarly, when the external electronic device is a mobile medical device, the application 1934 can include an application related to healthcare. In one embodiment of the invention, the application 1934 can include at least one of an application specified in the electronic device 1901 or an application received from an external electronic device (eg, the server 1906 or the electronic device 1904).

The input/output interface 1940 can transmit commands or data received from the user via an input/output device (eg, a sensor, a keyboard, or a touch screen) to the processor 1920, the memory 1930, and the communication via, for example, the bus bar 1910. Interface 1960 or camera module 1970. For example, the input/output interface 1940 can provide the processor 1920 with information of the user's touch made on the touch screen. In addition, the input/output interface 1940 can output commands or materials received from the processor 1920, the memory 1930, the communication interface 1960, or the camera module 1970, for example, via the bus 1910 via an input/output device (eg, a speaker or display). For example, the input/output interface 1940 can output voice data processed by the processor 1920 to a user via a speaker.

The display 1950 can display various information (eg, multimedia materials, text materials, etc.) to the user.

The communication interface 1960 can connect communication with the electronic device 1901 to an external device (eg, the electronic device 1904 or the server 1906). For example, the communication interface 1960 can be connected to the network 1962 by wireless communication or wired communication to communicate with an external device. Wireless communication can include at least one of: for example, WiFi, Bluetooth (BT), near field communication (NFC), Global Positioning System (GPS), or cellular communication (eg, long term evolution (long Term evolution, LTE), LTE Advanced (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system ( Universal mobile telecommunications system (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM), etc. The wired communication may include at least one of the following: for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (recommended standard-232, RS) -232) or plain old telephone service (POTS).

The camera module 1970 can be enlarged or refined by enlarging the image being captured by controlling information obtained from other components (eg, processor 1920, memory 1930, input/output interface 1940, communication interface 1960, etc.). Shoot a specific area.

In an embodiment of the invention, network 1962 can be a telecommunications network. The telecommunications network may include at least one of a computer network, an internet, an Internet of Things (IoT), or a telephone network. In one embodiment of the present invention, a protocol for communication between the electronic device 1901 and an external device (eg, a transport layer protocol, a data link layer protocol, or a physical layer protocol) may be applied by the application 1934, the application programming interface 1933. At least one of the intermediate software 1932, the core 1931, or the communication interface 1960 is supported.

According to various embodiments of the present invention, the electronic device may utilize an automatic white balance function (or white balance automatic setting function) to calculate a lighting environment of the image being captured. For example, using the calculated lighting environment, the electronic device can take an image such that a batch white balance can be set. In addition, even in a photographic environment in which an external light source is not present, the electronic device can capture an image by adjusting a light source (for example, a light emitting diode (LED) light source) included in the electronic device. Set batch white balance.

If the white balance is set according to the automatic white balance function during shooting, the face area in the captured image can be set to have a different color according to the white balance set to correspond to each captured image.

In order to batch-set the color of the face area of a plurality of images, only the light source included in the electronic device can be used after blocking the external light source. However, the electronic device including the light source used to implement this method can be large and heavy for the user to carry.

According to various embodiments of the invention, the electronic device may include a front camera or a rear camera. For example, if a front camera is used to capture an image, the rear camera can calculate a photographic environment to set the white balance of the image to be captured so that the image can be captured in a constant photographic environment. This will be described in detail below with reference to FIGS. 20A, 20B, 20C, and 21.

20A, 20B, and 20C illustrate a situation in which an electronic device analyzes a face, in accordance with various embodiments of the present invention.

Referring to FIGS. 20A, 20B, and 20C, the electronic device may include a front camera 2001 or a rear camera 2002, and the rear camera 2002 may include a color balance card 2003.

According to various embodiments of the present invention, the electronic device may use the color balance card 2003 to detect an illumination element (or illumination component) of the surrounding environment in which the electronic device is capturing an image. For example, the color balance card 2003 may be a device that photographs the corrected color of light using the scattered reflection property of light, or may be a device for color correction. Although the color balance card 2003 is installed in, for example, the rear camera 2002, the color balance card 2003 can be installed in various other modules that interact with the electronic device.

According to various embodiments of the present invention, the electronic device may determine that the brightness of the image obtained via the at least one camera module (eg, front camera 2001 or rear camera 2002) is abnormal. For example, a case in which the brightness of the image is determined to be abnormal may include a case where the light is brighter or darker than the set value, or a case where the face area is not obtained.

According to various embodiments of the present invention, if it is determined that the brightness of the image is abnormal, the electronic device may not store the image being captured by the camera module (for example, the front camera 2001 or the rear camera 2002), thereby determining that it is difficult to obtain the image.

Further, according to various embodiments of the present invention, if it is determined that the brightness of the image is abnormal, the electronic device may display a screen indicating that the photographing condition is abnormal, or output an audible alarm indicating that the photographing condition is abnormal. Therefore, the user can move the electronic device to a position where normal photography can be performed. If it is determined that normal photography is possible, the electronic device can output a screen or sound indicating that photography can be performed again.

Referring to FIG. 20A, the electronic device may use the front camera 2001 to obtain an image including a face area, and use the color balance card 2003 of the rear camera 2002 to calculate a lighting element.

According to various embodiments of the invention, the electronic device may apply the calculated illumination element to the acquired image including the facial region. For example, for an image to which the calculated illumination element is applied, since the white balance is set independently of the illumination component of the photographic environment, the image can be captured to correspond to the white balance of the face region of the previously stored image.

Referring to FIG. 20B, it is assumed that the electronic device is photographing or photographing the image using the front camera 2001. For example, the electronic device can analyze the image being captured by the front camera 2001.

According to various embodiments of the present invention, the electronic device may determine, according to the result of analyzing the image, whether the lighting environment in which the electronic device is capturing the image is an extreme lighting environment (eg, backlighting, low illumination, over-illumination, etc.). For example, if the lighting environment in which the electronic device is using the front camera 2001 to capture an image is determined to be an extreme lighting environment, the electronic device may not store the image being captured by the front camera 2001, or control the front camera 2001 so that the photography function may not be performed. Empowerment.

According to various embodiments of the present invention, if the lighting environment in which the electronic device is using the front camera 2001 to capture an image is determined to be an abnormal lighting environment, the electronic device may use the color balance card 2003 to calculate the white balance and calculate the calculated white balance value. Applies to images being captured by the front camera 2001.

Referring to FIG. 20C, it is assumed that the electronic device is using the rear camera 2002 to capture or photograph an image. For example, the electronic device can analyze the image being captured by the rear camera 2002.

According to various embodiments of the present invention, the electronic device may determine, according to the result of analyzing the image, whether the lighting environment in which the electronic device is capturing the image is an extreme lighting environment (eg, backlighting, low illumination, over-illumination, etc.). For example, if the lighting environment in which the electronic device is using the rear camera 2002 to capture an image is determined to be an extreme lighting environment, the electronic device may not store the image being captured by the rear camera 2002, or the camera 2002 may be controlled so that the photography function may not be performed. Empowerment.

According to various embodiments of the present invention, if the lighting environment in which the electronic device is using the rear camera 2002 to capture an image is determined to be an abnormal lighting environment, the electronic device may use the color balance card 2003 to calculate the white balance and calculate the calculated white balance value. Applies to the image being shot by the rear camera 2002.

21 is a flow chart illustrating an operation of analyzing skin information at an electronic device in accordance with various embodiments of the present invention.

Referring to FIG. 21, in operation 2110, an electronic device may obtain an image from at least one camera.

In operation 2120, the electronic device can analyze the obtained image.

In operation 2130, the electronic device can determine whether the brightness of the obtained image is abnormal.

If it is determined in operation 2130 that the brightness of the obtained image is not abnormal, the electronic device may perform operation 2110 again.

If it is determined in operation 2130 that the brightness of the obtained image is abnormal, the electronic device may determine in operation 2140 whether the camera that has taken the obtained image is a camera mounted on the front of the electronic device.

If it is determined in operation 2140 that the camera that has taken the acquired image is not a camera mounted on the front of the electronic device, the electronic device may calculate the white balance in operation 2150. For example, a white balance can be calculated using a module (eg, a color balance card) capable of calculating white balance, the module being disposed in a camera that is not mounted on the front of the electronic device. In operation 2160, the electronic device may apply the white balance of the captured image as the calculated white balance using the white balance calculated in operation 2150.

If it is determined in operation 2140 that the camera that has taken the acquired image is a camera mounted on the front of the electronic device, the electronic device may apply white balance to the captured image in operation 2160. For example, the image to which the white balance is applied in operation 2160 may be a pre-stored image to which the white balance value is applied, because the color balance card is not disposed in the camera mounted on the front of the electronic device.

In operation 2170, the electronic device can store the image. For example, the stored image may be an image to which white balance is applied.

At least one of operations 2110 through 2170 shown in FIG. 21 may be omitted, or at least one other operation may be added between operations 2110 through 2170. Further, operations 2110 through 2170 shown in FIG. 21 may be performed in the order shown, or at least one of operations 2110 through 2170 may be changed in order of execution.

22A and 22B illustrate a photographing operation for face analysis, in accordance with various embodiments of the present invention.

Referring to Figures 22A and 22B, in accordance with various embodiments of the present invention, an electronic device can determine whether an accessory is worn in a face area being photographed.

Referring to Fig. 22A, a high school girl who assumes that the face area is a photographic subject is wearing glasses.

According to various embodiments of the present invention, the electronic device may determine whether the glasses are worn on the face region depending on whether the face region being photographed includes a line 2211 corresponding to the edge of the glasses or a portion 2212 indicating light reflected on the glasses.

According to various embodiments of the present invention, if it is determined that the glasses are worn on the face area being photographed, the electronic device may instruct the user or the high school girl to take off the glasses. For example, the electronic device can display a wording such as "Please take off your glasses before shooting" in the image 2210 being shot.

When the wording is seen, the user of the electronic device according to various embodiments of the present invention can take off the glasses. If the electronic device determines that the user has removed the glasses, the electronic device can display a wording such as "You can shoot" in the image 2220 being shot.

Referring to Fig. 22B, a high school girl who assumes that the face area is a photographic subject is wearing a hat.

According to various embodiments of the present invention, the electronic device may determine whether the cap is worn on the face region according to whether the face region being photographed includes a line 2231 corresponding to the shape of the cap.

According to various embodiments of the present invention, if it is determined that the cap is worn on the face area being photographed, the electronic device may instruct the user or the high school girl to remove the hat. For example, the electronic device can display a wording such as "Please take off your hat before shooting" in the image 2230 being shot.

When the wording is seen, the user of the electronic device according to various embodiments of the present invention can take off the hat. If the electronic device determines that the user has removed the hat, the electronic device can display a wording such as "You can take a picture" in the image 2240 being shot.

23A and 23B illustrate a photographing operation for face analysis, in accordance with various embodiments of the present invention.

Referring to Figures 23A and 23B, in accordance with various embodiments of the present invention, a line 2301 corresponding to a face area may be displayed on an electronic device such that the user can recognize the direction or size of the face area being photographed.

Referring to Fig. 23A, a high school girl who assumes that the face area is a photographic subject is photographing himself and his face is tilted.

According to various embodiments of the present invention, the electronic device may determine whether the face region is being photographed at the correct position depending on whether the face region being photographed is outside the line 2301.

According to various embodiments of the present invention, if it is determined that the face area being photographed is outside the line 2301, the electronic device may instruct the user or the high school girl to place their face in the correct position. For example, the electronic device can display a wording such as "Please put your face at the correct position" in the image 2311 being shot.

When the wording is seen, a user of an electronic device in accordance with various embodiments of the present invention can position his face to conform to line 2301. If the electronic device determines that the user has placed his or her face in the correct position, the electronic device can display a wording such as "You can take a picture" in the image 2312 being shot.

Referring to Fig. 23B, a high school girl who assumes that the face area is a photographic subject photographs herself at a certain distance.

According to various embodiments of the present invention, the electronic device may determine whether the face region is photographed at a certain distance or at a close distance depending on whether the size of the face region being photographed matches the size of the line 2301.

According to various embodiments of the present invention, if it is determined that the face area being photographed is taken at a certain distance because the size of the face area is smaller than the size of the line 2301, the electronic device may instruct the user or the high school girl to position the face closer. . For example, the electronic device can display a wording such as "please place your face closer" in the image 2321 being shot.

When the wording is seen, a user of an electronic device in accordance with various embodiments of the present invention can position his face to conform to line 2301. If the electronic device determines that the user has placed the face closer, the electronic device can display a wording such as "You can take a picture" in the image 2322 being shot.

Figure 24 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention.

Referring to Fig. 24, it is assumed that an image 2410 is captured in a dithered manner in an electronic device.

According to various embodiments of the present invention, the electronic device can stabilize the image when the electronic device cannot recognize the shape of the face region in the image being captured or when the electronic device detects the jitter of the electronic device via the sensor. Operation. For example, the image stabilization function may include a function of preventing an image from being shaken by adjusting a shutter speed or an aperture during image capturing.

According to various embodiments of the present invention, after setting the image stabilization function, the electronic device can display a wording such as "You can take a picture" in the image 2420 being shot. For example, when the wording is seen, the user can take a picture of his face.

FIG. 25 is a block diagram illustrating a configuration of an electronic device according to various embodiments of the present invention.

Referring to FIG. 25, the electronic device 2501 may constitute all or a portion of the electronic device 100 or 1901 as shown, for example, in FIG. 1 or FIG.

The electronic device 2501 can include at least one processor (eg, an application processor (AP) 2510), a communication module 2520, a subscriber identification module (SIM) card 2524, a memory 2530, and a sensing device. Module 2540, input device 2550, display 2560, interface 2570, audio module 2580, camera module 2591, power management module 2595, battery 2596, indicator 2597, and motor 2598.

The application processor 2510 can control a plurality of hardware or software components connected to the application processor 2510 by running an operating system or an application, and can process and calculate various materials including multimedia materials. The application processor 2510 can be implemented as, for example, a system on chip (SoC). In one embodiment of the invention, the application processor 2510 may further include a graphics processing unit (GPU) (not shown).

The communication module 2520 (eg, the communication interface 1960) can be connected to the electronic device 2501 (eg, the electronic device 100 or the electronic device 1901) and other electronic devices (eg, the electronic device 1904 or the server 1906) connected to the electronic device 2501 via the network. Data transmission/reception is performed in communication between). In an embodiment of the present invention, the communication module 2520 may include a cellular module 2521, a Wi-Fi module 2523, a Bluetooth module 2525, a global positioning system (GPS) module 2527, and a near field communication (NFC) module. Group 2528, and radio frequency (RF) module 2529.

The cellular module 2521 can provide voice call services via a communication network (eg, long term evolution, advanced long term evolution, code division multiple access, wideband code division multiple access, universal mobile telecommunications system, wireless broadband, global mobile communication system, etc.) , video calling service, messaging service or internet service. In addition, the cellular module 2521 can perform identification and authentication of the electronic device in the communication network using, for example, a user identification module (eg, the user identification module card 2524). In one embodiment of the invention, the cellular module 2521 can perform at least some of the functions that can be provided by the application processor 2510. For example, the cellular module 2521 can perform at least a portion of the multimedia control functions.

In an embodiment of the present invention, the cellular module 2521 may include a communication porches (CP). In addition, the cellular module 2521 can be implemented as, for example, a system wafer. Although components such as cellular module 2521 (eg, communications processor), memory 2530, or power management module 2595 are shown in FIG. 25 as separate components from application processor 2510, in accordance with the present invention In an embodiment, the application processor 2510 can be implemented to include at least some of the components described above (eg, the cellular module 2521).

In an embodiment of the invention, the application processor 2510 or the cellular module 2521 (eg, a communication processor) can be loaded on the volatile memory from the non-volatile memory or another component connected thereto. Command or data and process the loaded commands or materials. In addition, the application processor 2510 or the cellular module 2521 can store data received from at least one of the other components or generated by at least one of the other components in the non-volatile memory.

Each of Wi-Fi module 2523, Bluetooth module 2525, global positioning system module 2527, or near field communication module 2528 can include, for example, a processor for processing data transmitted or received via a corresponding module. Although the cellular module 2521, the Wi-Fi module 2523, the Bluetooth module 2525, the global positioning system module 2527, or the near field communication module 2528 are shown as separate blocks in FIG. 25, according to the present invention In an embodiment, at least some (eg, two or more) of the cellular module 2521, the Wi-Fi module 2523, the Bluetooth module 2525, the global positioning system module 2527, or the near field communication module 2528 may It is included in an integrated chip (IC) or integrated chip package. For example, at least some of the processors corresponding to the cellular module 2521, the Wi-Fi module 2523, the Bluetooth module 2525, the global positioning system module 2527, or the near field communication module 2528 (eg, with the hive) The communication processor corresponding to the module 2521 or the Wi-Fi processor corresponding to the Wi-Fi module 2523 can be implemented as a system chip.

The RF module 2529 can perform transmission/reception of data, such as transmission/reception of RF signals. The RF module 2529, although not shown, may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, a low noise amplifier (LNA), and the like. The RF module 2529 may further include components (eg, conductors or wires) for transmitting and receiving electromagnetic waves in the free space of wireless communication. Although the cellular module 2521, the Wi-Fi module 2523, the Bluetooth module 2525, the global positioning system module 2527, and the near field communication module 2528 are shown as sharing a radio frequency module 2529 with each other in FIG. 25, According to an embodiment of the invention, at least one of the cellular module 2521, the Wi-Fi module 2523, the Bluetooth module 2525, the global positioning system module 2527 or the near field communication module 2528 can be via a separate radio frequency module. Perform transmission/reception of RF signals.

The subscriber identity module card 2524 can be a card having a subscriber identity module and can be inserted into a slot formed in a particular location of the electronic device. The subscriber identity module card 2524 can include unique identification information (eg, an integrated circuit card identifier (ICCID)) or user information (eg, an international mobile subscriber identity (IMSI)).

Memory 2530 (eg, memory 150 or memory 1930) can include internal memory 2532 or external memory 2534. The internal memory 2532 includes at least one of the following: for example, volatile memory (for example, dynamic random access memory (DRAM), static random access memory (SRAM), synchronization Dynamic random access memory (SDRAM) or non-volatile memory (for example, one time programmable read only memory (OTPROM), programmable read only memory) (programmable ROM, PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask only Read memory, flash read-only memory, reverse (NAND) flash memory, inverse (NOR) flash memory, etc.).

In an embodiment of the invention, the internal memory 2532 can be a solid state drive (SSD). The external memory 2534 may further include a flash drive, for example, compact flash (CF), secure digital (SD), micro security digits, mini security digits, extreme digital (xD), Memory sticks, etc. The external memory 2534 can be functionally connected to the electronic device 2501 via various interfaces. In one embodiment of the invention, the electronic device 2501 may further include a storage device (or storage medium), such as a hard drive.

The sensor module 2540 can measure the physical quantity or detect the operating status of the electronic device 2501, and convert the measured or detected information into an electrical signal. The sensor module 2540 can include at least one of the following: for example, a gesture sensor 2450A, a gyroscope sensor 2540B, a barometer 2540C, a magnetic sensor 2540D, an accelerometer 2540E, a grip sensor 2540F , proximity sensor 2540G, color sensor (eg, red, green, blue (RGB) sensor) 2450H, biosensor 2450I, temperature / humidity sensor 2540J, illumination A sensor 2540K or an ultraviolet (UV) sensor 2540M. Additionally or alternatively, the sensor module 2540 can include, for example, an electronic nasal sensor (not shown), an electromyography (EMG) sensor (not shown), an electroencephalogram (electroencephalogram, EEG) sensor (not shown), electrocardiogram (ECG) sensor (not shown), infrared (IR) sensor (not shown), iris sensor (not shown) , a fingerprint sensor (not shown), and the like. The sensor module 2540 can further include control circuitry for controlling at least one or more sensors belonging thereto.

The input device 2550 can include a touch panel 2552, a (digit) pen sensor 2554, a button 2556, or an ultrasonic input device 2558. The touch panel 2252 can identify the touch input by, for example, at least one of a capacitive, resistive, infrared, or ultrasonic manner. The touch panel 2552 can further include a control circuit. In the case of a capacitive solution, touch panel 2552 can identify physical contacts or proximity. The touch panel 2552 can further include a tactile layer. In this case, the touch panel 2552 can provide tactile or tactile feedback to the user.

The (digital) pen sensor 2554 can be implemented using, for example, the same or similar method of receiving the user's touch input, or by separately identifying the slice. Button 2556 can include, for example, a physical button, an optical button, or a keypad. The ultrasonic input device 2558 is a device for determining data by using an electronic device 2501 to detect sound waves using a microphone (for example, a microphone 2588) via an input tool for generating an ultrasonic signal. The ultrasonic input device 2558 energizes the wireless identification. In one embodiment of the invention, the electronic device 2501 can receive user input from an external device (eg, a computer or server) connected thereto using the communication module 2520.

Display 2560 (eg, display 140 or display 1950) can include panel 2562, holographic device 2564, or projector 2566. The panel 2562 can be, for example, a liquid-crystal display (LCD) panel or an active-matrix organic LED (AM-OLED) panel. Panel 2562 can be implemented, for example, as flexible, transparent, or wearable. The panel 2562 can be implemented as a module together with the touch panel 2552. The hologram device 2564 can display a stereoscopic image in the air using the interference of light. Projector 2566 can display an image by projecting light onto the screen. A screen may be placed on, for example, the inside or the outside of the electronic device 2501. In one embodiment of the invention, display 2560 can further include control circuitry for control panel 2562, holographic device 2564, or projector 2566.

Interface 2570 can include, for example, a high definition multimedia interface (HDMI) 2572, a universal serial bus (USB) 2574, an optical interface 2576, or a D-subminiature (D-sub) interface 2578. Interface 2570 can be included, for example, in communication interface 1960 shown in FIG. Additionally or alternatively, interface 2570 can include, for example, a mobile high-definition link (MHL) interface, a secure multi-media card (MMC) interface, or an infrared data association (infrared). Data association, IrDA) interface.

The audio module 2580 can perform bidirectional conversion between the audio signal and the electrical signal. At least some components of audio module 2580 can be included, for example, in input/output interface 1940 as shown in FIG. The audio module 2580 can process sound information received or output via, for example, the speaker 2582, the receiver 2584, the earphone 2586, or the microphone 2588.

According to an embodiment of the present invention, the camera module 2591 as a device capable of capturing still images and video may include one or more image sensors (for example, a front image sensor or a rear image sensor), and a lens (not Shown), an image signal processor (ISP) (not shown) or a flash (not shown) (eg, a light emitting diode or xenon lamp).

The power management module 2595 can manage the power of the electronic device 2501. Although not shown, the power management module 2595 can include, for example, a power management integrated circuit (PMIC), a charger integrated circuit, or a battery meter or fuel gauge.

The power management integrated circuit can be mounted, for example, in an integrated circuit or a system wafer semiconductor wafer. The charging scheme can be divided into a wired charging scheme and a wireless charging scheme. The charger integrated circuit charges the battery and prevents overvoltage or overcurrent from flowing into the charger. In one embodiment of the invention, the charger integrated circuit may include a charger integrated circuit for at least one of a wired charging scheme or a wireless charging scheme. Wireless charging schemes may include, for example, magnetic resonance schemes, magnetic induction schemes, or electromagnetic schemes. Additional circuitry for wireless charging (eg, coil loops, resonant circuits, rectifiers, etc.) can be added.

The battery meter or fuel gauge can measure, for example, the remaining capacitance of the battery 2596, the charging voltage, the charging current, or the temperature. Battery 2596 can store or generate electricity and supply power to electronic device 2501 using the stored or generated electricity. Battery 2596 can include, for example, a rechargeable battery or a solar battery.

The indicator 2597 can indicate a particular state (eg, an activation state, a message state, a state of charge, etc.) of the electronic device 2501 or a component thereof (eg, the application processor 2510). Motor 2598 converts electrical signals into mechanical vibrations. Although not shown, the electronic device 2501 can include a processing device (eg, a graphics processing unit) for mobile television support. The processing device for mobile TV support can process the media material based on standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media FLO.

Each of the above-described components of the electronic device according to various embodiments of the present invention may be configured with one or more components, and the names of the components may vary depending on the type of the electronic device. An electronic device according to various embodiments of the present invention may include at least one of the above-described components in which some may be omitted, or may further include additional other components. Furthermore, some of the components of the electronic device according to various embodiments of the present invention may be configured as one entity by combination, thereby performing the previous functions of the components in the same manner.

The term "module" as used in the various embodiments of the invention may refer to a unit that includes one or a combination of, for example, a hardware, a software, or a firmware. The term "module" can be used interchangeably with terms such as units, logic, logic blocks, components, or circuits. The module can be the smallest unit of an integrated structural component or its components. A module can be the smallest unit or component thereof used to perform one or more functions. The module can be implemented mechanically or electrically. For example, a module according to various embodiments of the present invention may include an application-specific integrated circuit (ASIC) chip, a field-programmable gate array (FPGA), or a programmable At least one of the logic devices, the modules described above are known or will be developed in the future and the modules perform certain operations.

At least one component (e.g., module or function) or method (e.g., operation) of a device in accordance with various embodiments of the present invention may be stored in a computer readable storage medium in the form of, for example, a stylized module Command to implement. If the command is executed by one or more processors (e.g., controller 110 or processor 1920), the one or more processors can perform functions corresponding to the commands. The computer readable storage medium can be, for example, a storage 150 or a memory 1930. At least a portion of the stylized module can be implemented (e.g., executed) by, for example, controller 110 or processor 1920. At least a portion of the stylized module can include, for example, a module, a program, a routine, a set of instructions, or a processor for performing one or more functions.

Certain aspects of the invention may also be implemented as a computer readable code on a non-transitory computer readable recording medium. A non-transitory computer readable recording medium is any data storage device that can store data that can be read by a computer system. Examples of non-transitory computer readable recording media include Read-Only Memory (ROM), Random-Access Memory (RAM), and CD-ROM (Compact Disc-ROM, CD-ROM), magnetic tape, floppy disk, and optical data storage device. Non-transitory computer readable recording media may also be distributed over network coupled computer systems to store and distribute computer readable code in a distributed manner. Moreover, the functional programs, code and code segments for implementing the present invention can be readily interpreted by a programmer skilled in the art to which the present invention pertains.

In this regard, it should be noted that the various embodiments of the present invention as described above generally relate to the processing of input data and the generation of output data to some extent. This input data processing and output data can be generated in a software that can be implemented in hardware or combined with hardware. For example, specific electronic components can be employed in a mobile device or similar or related circuitry for implementing the functions associated with the various embodiments of the present invention as described above. Alternatively, one or more processors operating in accordance with the stored instructions can implement the functions associated with the various embodiments of the present invention as described above. If this is the case, it is within the scope of the invention to store such instructions on one or more non-transitory processor readable media. Examples of processor readable media include read only memory, random access memory, optical disk read only memory, magnetic tape, floppy disk, and optical data storage devices. The processor readable medium can also be distributed over a network coupled computer system to store and execute the instructions in a distributed fashion. Furthermore, the functional computer programs, instructions, and instruction segments for implementing the present invention can be readily interpreted by a programmer skilled in the art to which the present invention pertains.

A module or stylized module in accordance with various embodiments of the present invention may include at least one of the above-described components, some of which may be omitted, or may further include additional components. The operations performed by modules, stylized modules, or other components in accordance with various embodiments of the present invention may be performed in a sequential, parallel, iterative or heuristic manner. Some operations may be performed in a different order or omitted, or other operations may be added.

According to various embodiments of the present invention, in a storage medium storing instructions, when the instructions are executed by at least one processor, the instructions are set to allow the at least one processor to perform at least one operation. The at least one operation may include: detecting an operation of the at least one face region from an image being captured by the camera module, enlarging an operation of the at least one detected face region, and analyzing the enlarged face according to the at least one analysis item District operation.

According to various embodiments of the present invention, the at least one operation may include an operation of detecting a face area from the at least one stored image, and analyzing an operation of the at least one detected face area according to the at least one analysis item.

According to various embodiments of the present invention, an operation of analyzing facial information may be performed based on previously stored images. For example, the stored image may be an image taken in a preset distance or at a preset angle according to a preset fixed focus value. If the user's face is at a position corresponding to the set distance or angle, the electronic device may take a facial image or display a screen for requesting the user to take a face area to correspond to the distance or angle.

According to various embodiments of the present invention, the stored images may be captured and stored under predetermined conditions such that the user may not perform a photographing operation. For example, in a situation in which the user observes the electronic device for a predetermined time or more (for example, the user determines a web browser or views a media file (eg, video)), or the electronic device is located in the electronic device. In the case of photographing the angle of the user's facial image (for example, in the case where the electronic device can photograph the user's face in the forward direction according to the angle of the front camera), the electronic device can make the camera module in the background Operate to capture the user's facial image.

According to various embodiments of the present invention, an electronic device may determine a stored image, remove a portion (eg, a shadow or a hair) that does not need to be analyzed from the image, and set in an area in which an unnecessary portion is removed. At least one reference point to thereby determine the face area. For example, the reference point can be set on the entire face area in the image, and can be set based on the pre-analysis database or the facial image of the previously analyzed specific user, so that each face area can be recognized (for example, the C area, M area, U area, eyes, nose, cheeks, mouth, etc.).

According to various embodiments of the present invention, when the face area is recognized in the previously stored image, the electronic device may output a result of analyzing the skin condition of each area via the analysis result screen.

According to various embodiments of the present invention, an operation of analyzing facial information may be performed based on previously stored images. For example, the electronic device can set at least one reference point on the image and determine the face area based on the set reference point.

According to various embodiments of the present invention, when the face area is determined in the previously stored image, the electronic device may output a result of analyzing the skin condition of each area via the analysis result screen.

26 illustrates a screen of an application for analyzing facial information based on stored images, in accordance with various embodiments of the present invention.

Referring to FIG. 26, if an application for analyzing facial information is run, the execution screen 2610 may include a gallery button 2611 for running a gallery application to display images stored in the electronic device, or include for the camera The module performs an enabled camera button 2612 to switch to a screen for capturing images.

According to various embodiments of the present invention, the image displayed when the gallery button 2611 is selected may include a selection item that the user can use to select an image, or may include filtering of the face information that can be analyzed in the image stored in the electronic device. image. The image that can be analyzed for the face information may be an image in which the face area is photographed to correspond to a predetermined angle or size.

According to various embodiments of the present invention, if the gallery button 2611 is selected, the image selection screen 2620 can be displayed, and the user can select at least one image on the image selection screen 2620 to analyze the face information. For example, the images displayed on the image selection screen 2620 can be arranged in the final shooting or storage order.

According to various embodiments of the present invention, if the user selects at least one of the images included in the image selection screen 2620 as the image to be analyzed for the face information, the result of displaying the analysis of the selected image may be displayed. Analysis of the results of the screen 2630.

According to various embodiments of the present invention, the analysis result screen 2630 may include a region 2631 in which the result of analyzing the face information is displayed in the image, and a region 2632 in which the result of analyzing the face information is displayed by numbers or in the schema or A button that the user can use to select an analysis result for each analysis item, and can also include various other items related to the face analysis. For example, the button that the user can use to select the analysis result of each analysis item may include a summary button 2633a for displaying the analysis result of the entire face area, a wrinkle button for displaying the analysis result of the wrinkle. 2633b, a Trouble button 2633c for displaying a skin problem, or a Pigmentation button 2633d for displaying an analysis result of pigmentation, and may also include other options for displaying analysis results of various other analysis items. project.

Figure 27 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to FIG. 27, the analysis result screen 2700 may include an image area 2710 in which the analyzed face area is displayed, an analysis result area 2720 in which the analysis result is displayed, or an analysis item selection area 2730 for selecting an analysis result of each analysis item.

In the image area 2710, a face area can be detected from the image stored in the electronic device, and at least one reference point 2711 can be set in the detected face area. Based on the at least one reference point 2711, a face area to be analyzed (eg, 2712, 2713, 2714, 2715, or 2716) may be set based on at least one analysis item. Zone 2712 can include an outer zone of two eyes as a C zone. Zone 2713 can include a nose region, region 2714 can include a cheek region, region 2715 can include a region surrounding the nose, and region 2716 can include a region surrounding the mouth.

According to various embodiments of the present invention, each of the face regions may be selected when a user input (eg, a touch gesture) is performed, and for the selected face region, the screen obtained by analyzing the face region may be Zoomed in and displayed.

In the analysis result area 2720, the results of analyzing the skin condition can be displayed numerically (eg, can be displayed as being in the state of score 2722 or schema 2721). For example, the pattern 2721 may represent a score for the skin condition of each of the analysis items derived by analyzing a particular facial region of each of the analysis items. The score 2722 may be a value obtained by averaging the scores of each analysis item for a specific face area, and the higher the score 2722, the better the skin condition may be.

The analysis item selection area 2730 may include at least one button for displaying an analysis result of each analysis item, and the analysis result of the specific face area may be displayed in the image area 2710 or the analysis result area 2720 according to the selected button. For example, if a summary button is selected, the entire face area can be displayed in the image area 2710, and the analysis result of the entire face area can be displayed in the analysis result area 2720.

Figure 28 illustrates a screen showing facial analysis results in accordance with various embodiments of the present invention.

Referring to FIG. 28, the analysis result screen 2800 can include an image area 2810, an analysis result area 2820, or an analysis item selection area 2830 in which at least one of the analyzed face areas can be selected.

According to various embodiments of the present invention, if the wrinkle button 2831 is selected in the analysis item selection area 2830, the result of analyzing the wrinkles in the various analysis items may be displayed in the image area 2810 or the analysis result area 2820.

In the image area 2810, based on the image stored in the electronic device, the result of analyzing the wrinkles in at least one of the face regions (for example, the region of the C region or the U region) can be displayed in the image. For example, since each face area is displayed in a different color depending on the skin condition, the user can determine the skin condition based on the displayed skin color.

In the analysis result area 2820, a pattern 2821 obtained by comparing the result of analyzing the wrinkles with the average score for each of the C area or the M area or a score of 2282 of the wrinkles in the entire face area may be displayed. .

In accordance with various embodiments of the present invention, if the user makes use of input 2811 in a particular zone (e.g., zone of the left C zone) to determine an analysis result, an enlarged screen 2812 can be displayed, which is analyzed on the enlarged screen 2812. The area entered by the user (for example, the area of the left C area).

According to various embodiments of the invention, the analysis result area 2820 can provide a history of wrinkle changes throughout the facial area. For example, the analysis result area 2820 may include a pattern 2823 obtained by comparing the wrinkle state measured one month ago with the currently measured wrinkle state or a wrinkle state indicating the C area or the M area is improved as before. How much is the drawing 2824.

Figure 29 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to Fig. 29, the user has selected the wrinkle button 2931 in the analysis item selection area. Accordingly, the analysis results screen 2900 can include an image or analysis result area 2920 obtained by analyzing the wrinkles.

In the analysis result area 2920, the wrinkle state of each of the specific area (for example, the left side area CL of the C area or the left side area ML of the M area or the right side area MR of the M area) or the entire face area may be scored. Wrinkle state.

In accordance with various embodiments of the present invention, a user may select an area in the analyzed facial area in which the user desires to determine an enlarged or detailed screen. For example, if the area of the left C area is selected by the user input 2901, the screen 2910 can be displayed, and the left area of the C area in the face on the screen 2910 is zoomed. If the left side area of the nose is selected by the user input 2902, the analysis result area 2920 can be displayed, and the left side area of the nose in the face on the analysis result area 2920 is scaled.

Figure 30 illustrates a screen showing facial analysis results in accordance with various embodiments of the present invention.

Referring to FIG. 30, if the user selects the question button 3031 in the analysis item selection area 3030 of the analysis result screen 3000, the problem in various analysis items can be displayed in the image area 3010 or the analysis result area 3020 of the analysis result screen 3000. Results of the analysis.

In the image area 3010, based on the image stored in the electronic device, at least one face area (for example, the right side area R, the left side area L, the top area T or the bottom area B) analyzed for the problem may be displayed in the image. Results of the analysis. For example, since each face area is displayed in a different color depending on the skin condition, the user can determine the skin condition of the face area based on the displayed skin color.

In the analysis result area 3020, a graph 3021 obtained by comparing the result of analyzing the problem with each of the right side region R, the left side region L, the top region T, or the bottom region B may be displayed or The score for the problem in the entire facial area is 3022.

In accordance with various embodiments of the present invention, if the bottom of the face is selected by user input 3011, the enlarged screen 3012 can be displayed and the bottom region analyzed on the enlarged screen 3012. For example, based on the enlarged screen 3012, the user can determine the location and size of the problem in the bottom zone.

According to various embodiments of the present invention, the analysis result area 3020 may provide a history of problem changes throughout the face area. For example, the analysis result area 3020 may include a schema 3023 obtained by comparing a problem state measured one month ago with a currently measured problem state or representing each zone (eg, the right zone R, the left zone) The problem state of L, the top zone T or the bottom zone B) is more than the pattern 3024 that has been improved before.

Figure 31 illustrates a screen showing facial analysis results in accordance with various embodiments of the present invention.

Referring to Fig. 31, the user has selected the question button 3131 in the analysis item selection area. Accordingly, the analysis results screen 3100 can include an image or analysis result area 3120 obtained by analyzing the problem.

In accordance with various embodiments of the present invention, a user may select an area in the analyzed facial area in which the user desires to determine an enlarged or detailed screen. For example, if the left cheek area is selected by the user input 3101, the screen 3110 can be displayed, and the left cheek of the face on the screen 3110 is enlarged. If the bottom is selected by the user input 3102, the analysis result area 3120 can be displayed, and the bottom of the face is enlarged in the analysis result area 3120.

Figure 32 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to FIG. 32, if the user selects the pigmentation button 3231 in the analysis item selection area 3230 of the analysis result screen 3200, the coloring matter in various analysis items can be displayed in the image area 3210 or the analysis result area 3220 of the analysis result screen 3200. The result of the analysis.

In the image area 3210, at least one face area (for example, the right side area R, the left side area L, the top area T or the bottom area B) analyzed for the pigmentation may be displayed in the image based on the image stored in the electronic device. The result of the analysis. For example, since each face area is displayed in a different color depending on the skin condition, the user can determine the skin condition of the face area based on the displayed skin color.

In the analysis result area 3220, a graph 3221 obtained by comparing the result of analyzing the pigmentation with respect to each of the right side region R, the left side region L, the top region T, or the bottom region B can be displayed. Or a score of 3222 for pigmentation throughout the facial area.

According to various embodiments of the present invention, if the left cheek is selected by the user input 3201, the enlarged screen 3202 may be displayed, and the left cheek region may be analyzed on the enlarged screen 3202. For example, based on the enlarged screen 3202, the user can determine the location and size of the pigmentation point in the left cheek region.

According to various embodiments of the invention, the analysis result area 3220 can provide a history of pigmentation changes throughout the facial area. For example, the analysis result area 3220 can include a pattern 3223 obtained by comparing the pigmentation state measured one month ago with the currently measured pigmentation state or representing each zone (eg, the right zone R, The pigmentation state of the left zone L, the top zone T or the bottom zone B) is somewhat better than the pattern 3224 which has been improved before.

Figure 33 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to Figure 33, the user has selected the pigmentation button 3331 in the analysis item selection area. Accordingly, the analysis result screen 3300 can include an image or analysis result area 3320 obtained by analyzing the pigmentation.

In accordance with various embodiments of the present invention, a user may select an area in the analyzed facial area in which the user desires to determine an enlarged or detailed screen. For example, if the left cheek area is selected by the user input 3301, the screen 3311 can be displayed, and the left cheek of the face on the screen 3311 is enlarged. If the nose region is selected by the user input 3302, the screen 3312 can be displayed and the nasal region on the screen 3312 is enlarged.

Figure 34 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to FIG. 34, if the user selects the Pore button 3431 in the analysis item selection area 3430 of the analysis result screen 3400, it can be displayed in various analysis items in the image area 3410 or the analysis result area 3420 of the analysis result screen 3400. The results of the analysis of the pores.

In the image area 3410, based on the image stored in the electronic device, at least one face area (for example, the right side area R, the left side area L, the top area T or the bottom area B) analyzed for the pores may be displayed in the image. Results of the analysis. For example, since each face area is displayed in a different color depending on the skin condition, the user can determine the skin condition of the face area based on the displayed skin color.

In the analysis result area 3420, a graph 3421 obtained by comparing the result of analyzing the pores with respect to each of the right side region R, the left side region L, the top region T, or the bottom region B may be displayed or The score of the pores in the entire facial area was 3422.

According to various embodiments of the present invention, if the right cheek is selected by the user input 3401, the enlarged screen 3402 may be displayed, and the right cheek region of the face may be analyzed on the enlarged screen 3402. For example, based on the enlarged screen 3402, the user can determine the location and size of the pores in the right cheek region.

According to various embodiments of the invention, the analysis result area 3420 may provide a history of pore changes throughout the facial area. For example, the analysis result area 3420 may include a pattern 3423 obtained by comparing the state of the pores measured one month ago with the state of the currently measured pores or indicating how much the pore state of the entire face area has been improved. Figure 3424.

Figure 35 illustrates a screen showing the results of a face analysis, in accordance with various embodiments of the present invention.

Referring to FIG. 35, if the user selects the Tone button 3531 in the analysis item selection area 3530 of the analysis result screen 3500, various analysis items can be displayed in the image area 3510 or the analysis result area 3520 of the analysis result screen 3500. The result of the analysis of the skin color.

In the image area 3510, based on the images stored in the electronic device, the results of analyzing at least one face region (for example, the eyebrow region L, the cheek region A, or the crotch region B) analyzed for the skin color may be displayed in the image. For example, since each face area is displayed in a different color depending on the skin condition, the user can determine the skin condition of the face area based on the displayed skin color.

In the analysis result area 3520, it can be displayed that the result of analyzing the uniformity of the skin color for each of the eyebrow region L, the cheek region A, or the jaw region B is compared with the average score. The score of the uniformity of the skin color in the pattern 3521 or the entire face area is 3522.

According to various embodiments of the present invention, if the user selects the score 3522, the analysis result area 3520 can provide an analysis result of the skin color change of the entire face area. For example, the analysis result area 3520 can include a chromaticity state (or chromaticity uniformity state) measured one month ago for each face area (eg, eyebrow area L, cheek area A, or sputum area B). A graph 3523 obtained by comparison with the currently measured chromaticity state or a graph 3524 indicating how much the chromaticity state of each face region has been improved.

36 illustrates an application screen showing a history of facial information analyzed based on stored images, in accordance with various embodiments of the present invention.

Referring to FIG. 36, if an analysis result screen 3600 including a result of analyzing facial information using an application for analyzing face information is displayed, a menu 3601 including functions related to the analyzed face information may be displayed. For example, if the menu 3601 is selected, a selection item may be displayed, by which the user can select an Analyze Whole Image function for analyzing at least one selected image based on the experiment, for displaying the analysis. A management change function 3602 of the history of the face information or an initialization DB (Initialize DB) function for initializing the data in the previously analyzed face information. Various other functions related to the analysis of facial information may be included in the menu 3601.

According to various embodiments of the present invention, if the user selects the management change function 3602, the change of the previously analyzed face information may be displayed in the image area 3610 or the analysis result area 3620 of the analysis result screen 3600. For example, the analysis result area 3620 can display the result of the face analysis for each analysis item using the schema 3621 in the time period in which the facial information is analyzed. In the image area 3610, an image obtained by analyzing the face information at a specific time input by the user in the drawing 3621 can be displayed. The display portion of the analysis item 3630 can display analysis items such as summary 3631, wrinkles 3632, question 3633, and pigmentation 3634.

Figure 37 illustrates a screen showing a history of analyzed facial information in accordance with various embodiments of the present invention.

Referring to FIG. 37, the user can select an analysis item or an image area in which the user desires to determine a change in the analysis result on the analysis result screen 3700. For example, to determine changes in the results of the analysis of pigmentation, the user may select a summary button among the various analysis items (eg, summary, wrinkles, problems, or pigmentation).

According to various embodiments of the present invention, the user may perform user input (eg, pinch in/out, or tap-and-drag) 3701 to zoom in/out on the image. The image in the zone, or the image can be moved to set an image area that the user desires to determine a change in the analysis result.

According to various embodiments of the present invention, the analysis result screen 3700 can display the set image area and use the schema to display the results of analyzing the displayed image area according to at least one analysis item (eg, pigmentation, problem, or wrinkles). Variety. For example, the diagram shows the time in which the face information is analyzed, and the analysis result corresponding to the time. If user input is made at a specific time, an image that analyzes the face information at the time can be displayed.

Figure 38 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 38, the analysis result screen 3800 can include an image area 3810 or an analysis result area 3820.

According to various embodiments of the present invention, to determine a change in the analysis result of wrinkles, the user may select wrinkles 3831 in each of the analysis items (eg, summary, wrinkles, problems, or pigmentation).

In the image area 3810, the result of analyzing the wrinkles in the face area of the image can be displayed. For example, the results of the analysis of the wrinkles can be displayed in the form of a line, and the depth or length of the wrinkles can be expressed in terms of the thickness or length of the line.

The analysis result area 3820 may utilize a schema to represent previously analyzed time-based wrinkles of each face region (eg, the right region CR or the left region CL of the C region, or the right region MR or the left region ML of the M region). As a result of analysis of wrinkles.

According to various embodiments of the present invention, if the user performs user input (eg, tapping or sweeping) at a specific time on the drawing, an image for analyzing wrinkles at the time may be displayed in the image area 3810, The result of analyzing the wrinkles at the time can be displayed on the displayed image.

Figure 39 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 39, the analysis result screen 3900 may include an image area 3910 or an analysis result area 3920.

In accordance with various embodiments of the present invention, to determine changes in the analysis results of the problem, the user may select question 3931 in each of the analysis items (eg, summary, wrinkles, problems, or hyperpigmentation).

In the image area 3910, the result of analyzing the problem in the face area of the image can be displayed. For example, the results of analyzing the problem may be displayed in the form of a question, and the size or state of the question may be expressed in terms of the size or color of the question.

The analysis result area 3920 can utilize a schema to represent previously analyzed time-based problem states for each face region (eg, right region R, left region L, top region T, or bottom region B) as a result of analyzing the problem .

According to various embodiments of the present invention, if the user performs user input (eg, tapping or sweeping) at a specific time on the drawing, an image for analyzing the problem at the time may be displayed in the image area 3910. And the result of analyzing the problem at the time can be displayed on the displayed image.

Figure 40 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 40, the analysis result screen 4000 may include an image area 4010 or an analysis result area 4020.

In accordance with various embodiments of the present invention, to determine changes in the results of the analysis of pigmentation, the user may select pigmentation 4031 in each of the analytical items (eg, summary, wrinkles, problems, or pigmentation).

In the image area 4010, the result of analyzing the pigmentation in the face area of the image can be displayed. For example, the results of analysis of pigmentation can be displayed in a form corresponding to pigmentation, and the size or state of pigmentation can be expressed in terms of the size or color of the pigmentation.

The analysis result region 4020 can utilize a pattern to represent the previously analyzed time-based pigmentation state of each facial region (eg, right region R, left region L, top region T, or bottom region B) as an analysis of pigmentation. the result of.

According to various embodiments of the present invention, if the user performs user input (eg, tapping or sweeping) at a specific time on the drawing, an image for analyzing the pigmentation at the time may be displayed in the image area 4010. And the result of analyzing the pigmentation at the time can be displayed on the displayed image.

Figure 41 illustrates a screen showing a history of analyzed facial information in accordance with various embodiments of the present invention.

Referring to FIG. 41, if a management change function (for example, 3602) is selected in a menu (for example, 3601) of an application for analyzing face information, the analysis result screen 4100 may display a history of analysis results of various analysis items.

According to various embodiments of the present invention, the analysis result screen 4100 may include an image area 4110 or an analysis result area 4120, and the image area 4110 includes an image obtained by analyzing the face information at a specific time for the selected analysis item, and analyzing the result area. 4120 includes a graph representing the results of previous analysis as a score of the skin condition as each analysis item (eg, pigmentation, problem, or wrinkle) is analyzed.

According to various embodiments of the present invention, if the user selects the summary 4131 among the analysis items (for example, summary, wrinkles, problems, or pigmentation), the images in the image area 4110 for analyzing the facial information may be displayed in the image. The image 4111 analyzed at the first time 4121. The result of analyzing the face information of the image 4111 can be displayed in the analysis result area 4120 using the schema.

According to various embodiments of the present invention, if the user input 4101 is performed at a position corresponding to the specific analysis time of the drawing, the image analyzed at the time when the user inputs 4101 is performed may be displayed in the image area 4110. For example, in the image area 4110, if the user input 4101 is performed at a position corresponding to the second time 4122, the image 4112 for analyzing the face information may be displayed at the second time 4122, and if it corresponds to the third When the user input 4101 is performed at the position of time 4123, the image 4113 for analyzing the face information can be displayed at the third time 4123.

In accordance with various embodiments of the present invention, facial information is analyzed using the displayed image 4111, 4112, or 4113 at a time when the user input 4101 is made (eg, first time 4121, second time 4122, or third time 4123). Since the result of analyzing each of the analysis items at the time is displayed to overlap with the displayed image, the user can determine the skin condition of the analysis item.

Figure 42 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 42, if a management change function (for example, 3602) is selected in a menu (for example, 3601) of an application for analyzing face information, an analysis item (for example, wrinkles 4231) may be displayed on the analysis result screen 4200. The history of the analysis results. For example, the analysis results screen 4200 can include an image area 4210 or an analysis result area 4220.

According to various embodiments of the present invention, the image displayed in the image area 4210 is the image 4211 that analyzes the face information at the first time 4221, and the image 4211 can be resized according to user input (eg, pinch/open). (for example, zoom in). For example, based on the resized image, the user can determine the skin condition in the image analyzed at a particular time 4223.

In accordance with various embodiments of the present invention, in image area 4210, settings of images in which the size or position changes in response to user input may be maintained at other times. For example, if the image is enlarged when user input is performed on the image 4211, the setting of the zoom can be similarly applied to the image 4212 that analyzes the face information at the second time 4222. An image 4212 that analyzes the facial information at a second time 4222 can be displayed to correspond to an area in which the image was previously magnified. According to various embodiments of the present invention, if the user input 4201 is performed at a position corresponding to the specific analysis time of the drawing, the image analyzed at the time when the user input 4201 is performed may be displayed in the image area 4110. For example, the image 4213 that analyzes the facial information at the third 4223 can be displayed to correspond to the region in which the image 4212 was previously enlarged.

Figure 43 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 43, if one of the various analysis items is selected, the analysis result screen 4300 may display the analysis result of the selected analysis item in the image area 4310 or the analysis result area 4320.

According to various embodiments of the present invention, if the user selects the question 4331 in each analysis item (eg, summary, wrinkles, questions, or pigmentation), the face information may be analyzed for the problem in the image area 4310. Image 4311. The result of analyzing the problem of the image 4311 can be displayed in the analysis result area 4320 using the pattern 4321.

According to various embodiments of the present invention, the displayed image 4311 is an image for analyzing facial information at a time when the user inputs. Since the shape corresponding to the analyzed question is displayed to overlap the displayed image, the user can determine the location or condition of the problem.

According to various embodiments of the present invention, by performing user input (eg, tapping and dragging) 4301, the user can move the area that he or she desires to determine in the image to the image area 4310. For example, the result of analyzing the problem in the image area 4312 can be displayed in the analysis result area 4320 using the pattern 4322.

According to various embodiments of the present invention, for the image displayed in the image area 4310, the setting of the size or position displayed in response to the user input may be maintained, and even if a specific time is selected, the analysis is performed at the time. The image can still be displayed according to the setting whose size or position has been changed.

Figure 44 illustrates a screen showing a history of analyzed facial information in accordance with various embodiments of the present invention.

Referring to FIG. 44, if one of various analysis items (for example, question 4431) is selected, the analysis result screen 4400 may display the history of the face information of the selected analysis item in the image area 4410 or the analysis result area 4420.

According to various embodiments of the present invention, the image area 4410 can be moved or scaled in a particular image, and the position in which the image area 4410 is moved or enlarged can be maintained even when the image analyzed at another time is displayed. For example, the user can perform user input (eg, a touch gesture) in the image area 4410 to move the image area 4410 to the area that the user desires to determine or to enlarge the area to which the image area 4410 is moved.

In accordance with various embodiments of the present invention, the user may select question 4431 in each analysis item and position the image area 4410 or magnify the image area 4410 in the left cheek area. In the image area 4410, the image analyzed at the earliest time among the images analyzed by the question 4431 can be displayed.

According to various embodiments of the present invention, when the user performs the user input 4401 at the first time 4421, the first image 4411 analyzed by the first image 4421 may be displayed in the image area 4410. For example, corresponding to the action in which the user has moved or enlarged the image area 4410, a corresponding one of the positions in which the image area 4410 is moved or enlarged may be displayed in the first image 4411.

According to various embodiments of the present invention, if the user input 4401 is performed at the second time 4422, the second image 4412 analyzed at the second time 4422 may be displayed in the image area 4410. For example, corresponding to the action in which the user has moved or enlarged the image area 4410, a corresponding one of the positions in which the image area 4410 is moved or enlarged may be displayed in the second image 4412.

According to various embodiments of the present invention, if the user input 4401 is performed at the third time 4423, the third image 4413 analyzed at the third time 4423 may be displayed in the image area 4410. For example, corresponding to the action in which the user has moved or enlarged the image area 4410, a corresponding one of the positions in which the image area 4410 is moved or enlarged may be displayed in the third image 4413.

Figure 45 illustrates a screen showing a history of analyzed facial information, in accordance with various embodiments of the present invention.

Referring to FIG. 45, if one of various analysis items (for example, pigmentation 4531) is selected, the analysis result screen 4500 may display the history of the face information of the selected analysis item in the image area 4510 or the analysis result area 4520.

According to various embodiments of the present invention, the image area 4510 can be moved or scaled in a particular image, and the position in which the image area 4510 is moved or enlarged can be maintained even when the image analyzed at another time is displayed. For example, the user can perform user input (eg, a touch gesture) in the image area 4510 to move the image area 4510 to the area that the user desires to determine or to enlarge the area to which the image area 4510 is moved.

According to various embodiments of the present invention, the user may select the pigmentation 4531 in each analysis item and position the image area 4510 or enlarge the position of the image area 4510 in the left cheek area. In the image area 4510, the image analyzed at the earliest time among the images analyzed for the pigmentation 4531 can be displayed.

According to various embodiments of the present invention, when the user performs the user input 4501 at the first time 4521, the first image 4511 analyzed in the first image 4521 may be displayed in the image area 4510. For example, corresponding to the action in which the user has moved or enlarged the image area 4510, a corresponding one of the positions in which the image area 4510 is moved or enlarged may be displayed in the first image 4511.

According to various embodiments of the present invention, if the user input 4501 is performed at the second time 4522, the second image 4512 analyzed at the second time 4522 may be displayed in the image area 4510. For example, corresponding to the action in which the user has moved or enlarged the image area 4510, a corresponding one of the positions in which the image area 4510 is moved or enlarged may be displayed in the second image 4512.

According to various embodiments of the present invention, if the user input 4501 is performed at the third time 4523, the third image 4513 analyzed at the third time 4523 may be displayed in the image area 4510. For example, corresponding to the action in which the user has moved or enlarged the image area 4510, a corresponding one of the positions in which the image area 4510 is moved or enlarged may be displayed in the third image 4513.

Figure 46 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention.

Referring to FIG. 46, the electronic device can obtain a facial image of the user by energizing a camera module mounted on the front of the electronic device. For example, the electronic device may periodically obtain images in various situations, such as a situation in which a user's face is photographed at a specific angle, or a case in which the electronic device is tilted at a specific angle.

According to various embodiments of the present invention, when the user views the web browser screen using the electronic device, the electronic device can cause the camera module to run in the background so that the user's facial image 4600 can be captured independently of the web browser screen.

According to various embodiments of the present invention, the electronic device may determine at least one reference point 4601 in the captured facial image 4600 and use the reference point to identify the facial region thereby analyzing the facial information.

47A and 47B illustrate a screen showing the results of skin analysis, in accordance with various embodiments of the present invention.

According to various embodiments of the invention, the analysis results screen 4700 can be configured in various layouts depending on the size or direction of rotation of the display.

Referring to FIGS. 47A and 47B, if the display is horizontally positioned or the electronic device is a tablet personal computer, the image area 4710 and the analysis item area 4720 may be horizontally arranged on the analysis result screen 4700.

According to various embodiments of the present invention, if the user selects pigmentation 4722 in the analysis item area 4720, the result of analyzing the pigmentation in at least one of the face areas may be displayed in the image area 4710 or the analysis result area 4730.

In the image area 4710, when the user input 4701 is performed in a specific area (for example, a cheek area), the analysis result of the face area in which the user input 4701 is performed can be enlarged and displayed in the separate window 4712.

According to various embodiments of the present invention, when a specific analysis item is selected in the analysis item area 4720, the analysis result of the face information may be displayed in the analysis result area 4730. For example, the analysis result area 4730 can include an emoticon 4731 indicating the analysis result of the selected pigmentation, a pattern showing the score of each item, or a pigmentation compared to the previous improvement 4732.

According to various embodiments of the present invention, if the user selects the total 4721 in the analysis item area 4720, the analysis of various analysis items in the at least one face area may be displayed in the image area 4710 or the analysis result area 4730. result.

In the image area 4710, at least one face area 4713 analyzed according to various analysis items may be displayed, and may include a legend 4714 indicating a skin condition corresponding to the color of each face area. For example, the user can determine the skin condition of a particular portion by determining the color of each facial region.

According to various embodiments of the present invention, the analysis result area 4730 may include a pattern representing a score obtained by comparing analysis results of various analysis items (for example, pores, wrinkles, pigmentation, or problems) with previous analysis results. .

It will be apparent from the foregoing description that aspects of various embodiments of the present invention may provide an electronic device and a method of analyzing facial information in an electronic device, wherein a portion of the facial information that the user can obtain is magnified or finely photographed by the electronic device. An image of any user's motion is not required, and the analysis result of the obtained image can be determined.

Although the present invention has been shown and described with respect to the embodiments of the present invention, it will be understood by those skilled in the art Various changes in form and detail can be made.

100‧‧‧Electronic devices
110‧‧‧ Controller
111‧‧‧Project setting unit
112‧‧‧Photographic controller
113‧‧‧Image Analyzer
114‧‧‧ zone selector
115‧‧‧ Analysis result generator
120‧‧‧ camera module
130‧‧‧Input unit
140‧‧‧ display
150‧‧‧Storage
151‧‧‧ Skin Analysis Information
152‧‧‧User identification information
210, 220, 230, 240‧‧‧ operations
310, 320, 330‧‧‧ operations
410, 420, 430, 440, 450, 460, 470‧‧‧ operations
500‧‧‧ images
501‧‧‧ eyebrows
501a‧‧‧ wrinkles
502‧‧‧ right eye
502a‧‧‧ wrinkles
503‧‧‧ nose
503a‧‧‧pores
504‧‧‧ The edge of the mouth
504a‧‧‧Pigmentation
505‧‧‧ cheeks
505a‧‧‧ acne
506‧‧‧ left eye
506a‧‧‧Black circle
507‧‧‧Face
507a‧‧‧ skin color
600‧‧ images
601‧‧‧ acne
602‧‧‧ wrinkles
603‧‧‧Pigmentation
710‧‧‧ images taken
711‧‧‧Pigmentation
720‧‧ images
721‧‧‧Pigmentation
810‧‧‧ images taken
811‧‧‧ acne
820‧‧ images
821‧‧‧ acne points
910‧‧‧ images taken
911‧‧‧ pores
920‧‧ images
921‧‧‧Color darkening area
1000‧‧‧ images taken
1001‧‧‧ wrinkle line
1100‧‧‧ images taken
1101‧‧‧Skin analysis area
1210‧‧‧ screen
1220‧‧‧ screen
1300‧‧‧ Analysis results screen
1310‧‧‧ eyes
1311‧‧‧ wrinkles
1320‧‧‧ nose
1321‧‧‧ acne points
1330‧‧‧ cheeks
1331‧‧‧Pigmentation
1410‧‧‧Analysis results screen
1411‧‧‧View skin analysis history
1420‧‧‧ Skin Analysis History Screen
1421‧‧‧ skin color measurement results
1422‧‧‧Acne measurement results
1423‧‧‧Wrinkle measurement results
1424‧‧‧Pigmentation measurement results
1425‧‧‧ pore measurement results
1510‧‧‧ images taken
1511‧‧‧Wrinkle mark
1520‧‧‧ Skin Care Recommended Screen
1521‧‧‧Cosmetics for wrinkles
1521a‧‧‧** Eye Cream
1521b‧‧‧##霜
1521c‧‧oo cream
1522‧‧‧Run button (execution button)
1523‧‧‧Run button
1610‧‧‧ images taken
1611‧‧‧ Skin color analysis area
1620‧‧‧ Skin Care Recommended Screen
1621‧‧ ‧ Mask for improving skin tone
1621a‧‧‧** mask
1621b‧‧‧□ Mask
1622‧‧‧Run button
Images taken at 1710‧‧
1711‧‧‧ acne
1720‧‧‧Advertising screen
1721‧‧‧"More" Run Button
Images taken on 1810‧‧
1811‧‧‧ pore analysis area
1820‧‧‧ Skin Care Recommended Screen
1821‧‧‧Information
1822‧‧ Advertising
1900‧‧‧Network environment
1901‧‧‧Electronic device
1904‧‧‧Electronic devices
1906‧‧‧Server
1910‧‧ ‧ busbar
1920‧‧‧ processor
1930‧‧‧ memory
1931‧‧‧ core
1932‧‧‧Intermediate software
1933‧‧‧Application Programming Interface
1934‧‧‧Application
1940‧‧‧Input/Output (I/O) interface
1950‧‧‧ display
1960‧‧‧Communication interface
1962‧‧‧Network
1970‧‧‧ Camera Module
2001 ‧ ‧ front camera
2002 ‧ ‧ rear camera
2003‧‧‧Color Balance Card
2110, 2120, 2130, 2140, 2150, 2160, 2170‧‧‧ operations
2210‧‧‧Image
Line 2211‧‧
Section 2212‧‧‧
2220‧‧ images
2230‧‧ images
2231‧‧‧ line
2240‧‧‧ images
Line 2301‧‧
2311‧‧‧Image
Image of 2312‧‧‧
2321‧‧‧ images
2322‧‧‧Image
2410‧‧ images
2420‧‧ images
2501‧‧‧Electronic device
2510‧‧‧Application Processor
2520‧‧‧Communication Module
2521‧‧‧ Honeycomb Module
2523‧‧ Wi-Fi module
2524‧‧‧User Identification Module (SIM) Card
2525‧‧‧Bluetooth Module
2527‧‧‧Global Positioning System (GPS) Module
2528‧‧‧Near Field Communication (NFC) Module
2529‧‧‧RF Module
2530‧‧‧ memory
2532‧‧‧Internal memory
2534‧‧‧External memory
2540‧‧‧Sensor Module
2540A‧‧‧ gesture sensor
2540B‧‧‧Gyro Sensor
2540C‧‧‧Barometer
2540D‧‧‧Magnetic sensor
2540E‧‧‧Accelerometer
2540F‧‧‧ Holding sensor
2540G‧‧‧ proximity sensor
2540H‧‧‧Color Sensor
2540I‧‧ biosensor
2540J‧‧‧Temperature/Humidity Sensor
2540K‧‧‧illuminance sensor
2540M‧‧‧UV (UV) sensor
2550‧‧‧ Input device
2552‧‧‧Touch panel
2554‧‧‧(digital) pen sensor
2556‧‧‧ button
2558‧‧‧Ultrasonic input device
2560‧‧‧ display
2562‧‧‧ panel
2564‧‧‧All-image device
2566‧‧‧Projector
2570‧‧" interface
2572‧‧‧High Definition Multimedia Interface (HDMI)
2574‧‧‧Common Serial Bus (USB)
2576‧‧‧Optical interface
2578‧‧‧D-Subminiature (D-sub) interface
2580‧‧‧ Audio Module
2582‧‧‧Speakers
2584‧‧‧ Receiver
2586‧‧‧ headphone
2588‧‧‧Microphone
2591‧‧‧ camera module
2595‧‧‧Power Management Module
2596‧‧‧Battery
2597‧‧‧ indicator
2598‧‧‧Motor
2610‧‧‧Executive screen
2611‧‧‧ pattern button
2612‧‧‧ camera button
2620‧‧‧Image selection screen
2630‧‧‧Analysis results screen
2631‧‧‧ District
2632‧‧‧ District
2633a‧‧‧summary button
2633b‧‧‧Wrinkle button
2633c‧‧‧Question button
2633d‧‧‧Pigmentation button
2700‧‧‧Analysis results screen
2710‧‧‧Image area
2711‧‧‧ reference point
2712, 2713, 2714, 2715, 2716‧‧‧Face Area/Zone
2720‧‧‧Analysis results area
2721‧‧‧ schema
2722‧‧‧ score
2730‧‧‧Analysis project selection area
2800‧‧‧Analysis results screen
2810‧‧‧Image area
2811‧‧‧Use input
2812‧‧‧Amplified screen
2820‧‧‧Analysis results area
2821‧‧‧ schema
2822‧‧‧ score
2823‧‧‧ schema
2824‧‧‧Picture
2830‧‧‧Analysis project selection area
2831‧‧‧Wrinkle button
2900‧‧‧Analysis results screen
2901‧‧‧User input
2902‧‧‧User input
2910‧‧‧Screen
2920‧‧‧Analysis results area
2931‧‧‧Wrinkle button
3000‧‧‧Analysis results screen
3010‧‧‧Image area
3011‧‧‧User input
3012‧‧‧Amplified screen
3020‧‧‧Analysis results area
3021‧‧‧ schema
3022‧‧‧ score
3023‧‧‧ schema
3024‧‧‧ schema
3030‧‧‧Analysis project selection area
3031‧‧‧Question button
3100‧‧‧Analysis results screen
3101‧‧‧User input
3102‧‧‧User input
3110‧‧‧Screen
3120‧‧‧Analysis results area
3131‧‧‧Question button
3200‧‧‧ Analysis results screen
3201‧‧‧User input
3202‧‧‧Amplified screen
3210‧‧‧Image area
3220‧‧‧Analysis results area
3221‧‧‧ schema
3222‧‧‧ score
3223‧‧‧ schema
3224‧‧‧ schema
3230‧‧‧Analysis project selection area
3231‧‧‧Pigmentation button
3300‧‧‧Analysis results screen
3301‧‧‧User input
3302‧‧‧User input
3311‧‧‧ screen
3312‧‧‧ screen
3320‧‧‧Analysis results area
3331‧‧‧Pigmentation button
3400‧‧‧Analysis results screen
3401‧‧‧User input
3402‧‧‧Amplified screen
3410‧‧‧Image area
3420‧‧‧Analysis results area
3421‧‧‧ schema
3422‧‧‧ score
3423‧‧‧ schema
3424‧‧‧ schema
3431‧‧‧Mask button
3500‧‧‧Analysis results screen
3510‧‧‧Image area
3520‧‧‧Analysis results area
3521‧‧‧ schema
3522‧‧‧ score
3523‧‧‧ schema
3524‧‧‧Pattern
3530‧‧‧Analysis project selection area
3531‧‧‧chrome button
3600‧‧‧Analysis results screen
3601‧‧‧ menu
3602‧‧‧Management change function
3610‧‧‧Image area
3620‧‧‧Analysis results area
3621‧‧‧ schema
3630‧‧‧Analysis project
Summary of 3631‧‧
3632‧‧‧Wrinkles
3633‧‧ Question
3634‧‧‧Pigmentation
3700‧‧‧Analysis results screen
3701‧‧‧User input
Summary of 3731‧‧
3800‧‧‧Analysis results screen
3810‧‧‧Image area
3820‧‧‧ Analysis Results Area
3831‧‧‧ wrinkles
3900‧‧‧Analysis results screen
3910‧‧‧Image area
3920‧‧‧Analysis results area
3931‧‧ Question
4000‧‧‧Analysis results screen
4010‧‧‧Image area
4020‧‧‧Analysis results area
4031‧‧‧Pigmentation
4100‧‧‧ Analysis results screen
4101‧‧‧User input
4110‧‧‧Image area
4111‧‧‧ images
4112‧‧‧Image
4113‧‧ images
4120‧‧‧Analysis results area
4121‧‧‧First time
4122‧‧‧Second time
4123‧‧‧ third time
Summary of 4131‧‧
4200‧‧‧ Analysis results screen
4201‧‧‧User input
4210‧‧‧Image area
Image of 4211‧‧‧
4212‧‧ images
4213‧‧‧Image
4220‧‧‧Analysis results area
4221‧‧‧First time
4222‧‧‧ Second time
4223‧‧‧Specific time/third time
4231‧‧‧ wrinkles
4300‧‧‧ Analysis results screen
4301‧‧‧User input
4310‧‧‧Image area
Image of 4311‧‧‧
4312‧‧‧Image area
4320‧‧‧ Analysis Results Area
4321‧‧‧ schema
4322‧‧‧ schema
4331‧‧‧Question
4400‧‧‧Analysis results screen
4401‧‧‧User input
4410‧‧‧Image area
4411‧‧‧ first image
4412‧‧‧Second image
4413‧‧‧ Third image
4420‧‧‧Analysis results area
4421‧‧‧First time
4422‧‧‧second time
4423‧‧‧ third time
4431‧‧ Question
4500‧‧‧Analysis results screen
4501‧‧‧User input
4510‧‧‧Image area
4511‧‧‧ first image
4512‧‧‧Second image
4513‧‧‧ Third image
4520‧‧‧Analysis results area
4521‧‧‧First time
4522‧‧‧second time
4523‧‧‧ third time
4531‧‧‧Pigmentation
4600‧‧‧Face image
4601‧‧‧ reference point
4700‧‧‧ Analysis results screen
4701‧‧‧User input
4710‧‧‧Image area
4712‧‧‧ separate window
4713‧‧‧Face area
4714‧‧‧ Legend
4720‧‧‧Analysis project area
4721‧‧‧Total
4722‧‧‧Pigmentation
4730‧‧‧Analysis results area
4731‧‧‧Expression image
4732‧‧‧Improvement
4733‧‧‧ schema
A‧‧‧ cheek area
B‧‧‧Bottom area/颔 area
C‧‧‧ area
CL‧‧‧Left area
CR‧‧‧Right Zone
L‧‧‧Left area/eyebrow area
M‧‧‧ area
ML‧‧‧Left area
MR‧‧‧Right Zone
R‧‧‧Right Zone
T‧‧‧ top area
U‧‧‧ area

The above and other aspects, features, and advantages of the present invention will become more apparent from the aspects of the description of the embodiments of the invention. The block diagram of the configuration. 2, 3, and 4 are flow diagrams illustrating operations for analyzing skin information at an electronic device in accordance with various embodiments of the present invention. 5A, 5B, 5C, 5D, 5E, 5F, 5G, and 5H illustrate a state in which a face area and a face area thereof are partially enlarged or finely photographed, according to various embodiments of the present invention. Figure 6 illustrates a facial analysis item in accordance with various embodiments of the present invention. 7, 8, 9, 10, and 11 illustrate operations for analyzing facial analysis items in accordance with various embodiments of the present invention. Figure 12 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention. 13A, 13B, and 13C illustrate screens showing the results of facial analysis, in accordance with various embodiments of the present invention. 14, 15, 16, 17, and 18 illustrate screens showing the results of skin analysis in accordance with various embodiments of the present invention. Figure 19 illustrates a network environment in accordance with various embodiments of the present invention. 20A, 20B, and 20C illustrate a situation in which an electronic device analyzes a face, in accordance with various embodiments of the present invention. 21 is a flow chart illustrating an operation of analyzing skin information at an electronic device in accordance with various embodiments of the present invention. 22A and 22B illustrate a photographing operation for face analysis, in accordance with various embodiments of the present invention. 23A and 23B illustrate a photographing operation for face analysis, in accordance with various embodiments of the present invention. Figure 24 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention. FIG. 25 is a block diagram illustrating a configuration of an electronic device according to various embodiments of the present invention. 26 illustrates a screen of an application for analyzing facial information based on stored images, in accordance with various embodiments of the present invention. 27, 28, 29, 30, 31, 32, 33, 34, and 35 illustrate screens showing facial analysis results in accordance with various embodiments of the present invention. 36 illustrates an application screen showing a history of facial information analyzed based on stored images, in accordance with various embodiments of the present invention. 37, 38, 39, 40, 41, 42, 43, 44, and 45 illustrate screens showing the history of analyzed facial information, in accordance with various embodiments of the present invention. Figure 46 illustrates a photographic operation for facial analysis in accordance with various embodiments of the present invention. 47A and 47B illustrate a screen showing the results of skin analysis, in accordance with various embodiments of the present invention. Throughout the drawings, the same reference numerals will be understood to refer to the same components, components, and structures.

100‧‧‧Electronic devices

110‧‧‧ Controller

111‧‧‧Project setting unit

112‧‧‧Photographic controller

113‧‧‧Image Analyzer

114‧‧‧ zone selector

115‧‧‧ Analysis result generator

120‧‧‧ camera module

130‧‧‧Input unit

140‧‧‧ display

150‧‧‧Storage

151‧‧‧ Skin Analysis Information

152‧‧‧User identification information

Claims (30)

A method for analyzing facial information in an electronic device, the method comprising: detecting at least one facial region from an image being captured by a camera module; amplifying the at least one detected facial region; and analyzing according to at least one analysis item The at least one detected and enlarged face area. The method of analyzing facial information in an electronic device according to claim 1, wherein the at least one facial region comprises an area surrounding at least one of an eye, a nose, a cheek, a mouth, and an eyebrow. The method of analyzing facial information in an electronic device according to claim 1, wherein the at least one analysis item comprises at least one of wrinkles, acne, pigmentation, skin color, black circles, and pores. The method of analyzing facial information in an electronic device according to claim 3, wherein the analyzing comprises analyzing thickness, size, and number for each of the at least one analysis item in the enlarged facial region. At least one of width, width, and color. The method for analyzing facial information in an electronic device according to claim 1, further comprising: displaying a gesture input to a specific region in the image, displaying the gesture detected by zooming in Images obtained from the district. The method for analyzing facial information in an electronic device according to claim 1, further comprising: detecting a face region of the at least one analysis item from the image; and analyzing the at least one analysis item according to the method The detected face area of at least one analysis item. The method for analyzing facial information in an electronic device according to claim 1, further comprising: displaying a screen obtained by enlarging the detected facial region when the at least one facial region is detected. The method for analyzing facial information in an electronic device according to claim 1, further comprising: enlarging the at least one detected facial region when the motion is detected. The method for analyzing facial information in an electronic device according to claim 8, wherein the action comprises any one of: operating an application in which the camera module is enabled, The action of the electronic device in the locked state to perform an energization, and the action of positioning the electronic device at a specific angle or a specific direction. The method for analyzing facial information in an electronic device according to claim 1, further comprising: determining a pre-storage analysis result of the specific facial region or the analysis item; and determining the determined pre-storage analysis result and the analysis The results are compared and the results of the comparison are shown. An electronic device comprising: a camera module; a display for displaying an image being captured by the camera module; and a controller for: detecting at least one facial region from the image, controlling the camera module Amplifying the at least one detected face region and analyzing the enlarged face region based on at least one analysis item. The electronic device of claim 11, wherein the at least one facial region comprises an area surrounding at least one of an eye, a nose, a cheek, a mouth, and an eyebrow. The electronic device of claim 11, wherein the at least one analysis item comprises at least one of wrinkles, acne, pigmentation, skin tone, black circles, and pores. The electronic device of claim 13, wherein the controller is further configured to analyze thickness, size, number, width, and for each of the at least one analysis item in the enlarged face area. And at least one of the colors. The electronic device of claim 11, wherein the controller controls the display to display the gesture by zooming in when a gesture input to a specific area is detected in the image. Images obtained from the district. The electronic device of claim 11, wherein the controller is further configured to: detect a face region of the at least one analysis item from the image; and analyze the image according to the at least one analysis item The detected face area of at least one analysis item. The electronic device of claim 11, wherein the controller is further configured to control the display to display the screen of the enlarged face area when the at least one face area is detected. The electronic device of claim 11, wherein the controller is further configured to control the camera module to amplify the at least one detected face region when detecting an action. The electronic device of claim 18, wherein the action comprises any one of: operating an application in which the camera module is enabled, and the electronic device in a locked state The action of the device to energize and the action of positioning the electronic device at a particular angle or direction. The electronic device of claim 11, wherein the controller is further configured to: determine a pre-storage analysis result of the specific facial region or the analysis item, and the determined pre-storage analysis result and the analysis result A comparison is made and the display is controlled to display a screen including the results of the comparison. A method of analyzing facial information in an electronic device, the method comprising: detecting at least one facial region from at least one stored image; and analyzing the at least one detected facial region based on at least one analysis item. The method for analyzing facial information in an electronic device according to claim 21, wherein the detecting at least one facial region from the at least one stored image comprises: setting at least one on the at least one stored image The reference point detects the at least one face area. The method for analyzing facial information in an electronic device according to claim 21, further comprising: arranging the previously analyzed image according to an analysis time of the previously analyzed image; and displaying the result by user input The image analyzed at the selected time. The method for analyzing facial information in an electronic device according to claim 23, further comprising: detecting user input for enlarging, reducing or moving the displayed image; and according to the at least one analysis item, Outputting results of analyzing images that have changed in response to the detected user input. The method for analyzing facial information in an electronic device according to claim 21, further comprising: determining whether the electronic device is in a state for capturing an image; and capturing an image according to the determination result, wherein the condition The method includes: the situation where the electronic device is located at an angle, or a situation where the user inputs. An electronic device comprising: a camera module for capturing an image; and a controller for: at least one image captured and stored by the camera module to detect at least one facial region; and analyzing according to at least one analysis item The at least one detected face area. The electronic device of claim 26, wherein the controller is further configured to detect the at least one face region by setting at least one reference point on the at least one stored image. The electronic device of claim 26, further comprising: a display, wherein the controller is further configured to: arrange the previously analyzed image according to an analysis time of the previously analyzed image, and control the The display displays images analyzed at times selected by user input. The electronic device of claim 28, wherein the controller is further configured to: detect a user input for enlarging, reducing, or moving the displayed image; and control the display of the display according to the At least one analysis item analyzes an image that changes in response to the detected user input. The electronic device of claim 26, wherein the controller is further configured to: determine whether the electronic device is in a state for capturing an image, and control the camera module to shoot according to the determination result An image, and wherein the condition comprises: a situation in which the electronic device is at an angle, or a situation in which a user inputs.