KR102356023B1 - Server for matching product with buyer and matching system having the same - Google Patents

Abstract

An electronic device is disclosed. The electronic device includes a communication processor for communicating with one or more user terminals, a camera for acquiring an image, a display for transmitting the acquired image and information to a user, a memory in which a photographed external object is stored, and a processor, the processor acquires a first image related to the user's face through a camera, detects data related to a face shape similar to the user based on the acquired first image, and transmits the detected face shape related data to an external electronic device transmit, receive, from an external electronic device, data on cosmetics and makeup methods with a high preference according to a user's similar face shape by using an artificial neural network, and receive a second cosmetic or makeup method with a high preference according to a user's similar face shape It is characterized in that the image is controlled to be displayed through the display.

Description

Electronic device for product and user matching, and matching system including the same

Various embodiments of the present invention relate to an electronic device for matching a product and a user, and a matching system including the same. Specifically, it relates to an electronic device that helps a user who wants to select cosmetics to select an appropriate product or makeup method, and a matching system including the same.

With the development of augmented reality (AR) technology, interest in an intuitive service for displaying an image or information generated by a computer or electronic device on a projected image of the real world is increasing. In addition, according to the augmented reality, the user can actually see the mapped product, and can directly obtain the result for the product, even if it is not directly used. In 5G communication using mmWave, which has an even faster data transfer rate, the use of augmented reality technology is expected to increase.

Through augmented reality, a user can directly purchase a product based on a product applied result, share an image to which augmented reality is applied in real time, or share an opinion with other people through a stored screen.

With the development of communication technologies and electronic devices, users of electronic devices may purchase items at a shopping mall regardless of place or time. From the seller's point of view, the online shopping mall does not need a space to display products, so space efficiency can be improved. The number of online shopping malls is gradually increasing because users can be freed from the constraints of time and space and space efficiency can be increased for sellers.

In the online shopping mall, advertisements or promotions of products can be made through the evaluation of users on SNS. In particular, young people are accessing shopping malls through applications using smartphones in addition to the existing computers based on information obtained from SNS, etc. With the advent of smartphones, various types of online sales are in progress.

According to various embodiments of the present disclosure, an electronic device for matching a product with a user and a matching system including the same may perform virtual makeup on a user's face and provide a corresponding result through augmented reality. Newcomers who have never experienced makeup have a problem in that they do not have enough information about makeup procedures or products, so it is difficult to apply makeup when necessary.

In addition, since users for makeup have different face shapes and products having effects according to each face shape may be different, it is necessary to provide products in consideration of this.

In the case of an online shopping mall, since the information provided is too extensive, a problem may occur in the user's product selection, so a solution is needed to provide the product by comprehensively considering the user's face shape and skin condition. .

An electronic device according to an embodiment includes a communication processor for communicating with one or more user terminals, a camera for acquiring an image, a display for transmitting the acquired image and information to a user, and a memory for storing the photographed external object; , at least one processor operatively coupled with the communication processor and the memory, wherein the memory stores a plurality of instructions, the plurality of instructions, when executed by the at least one processor, the at least One processor acquires a first image related to the user's face through the camera, detects data related to a face shape similar to the user based on the acquired first image, and includes the detected face shape and Transmitting related data to an external electronic device, and using an artificial neural network to receive data on cosmetics and makeup methods with high preference according to a user's similar face shape, and preference according to a similar face shape to the user from the external electronic device It is possible to control to display a second image to which cosmetics or a cosmetic method having a high value is applied through the display.

An electronic device according to another embodiment includes a foldable housing including a first housing structure connected to a hinge structure and a second housing structure contacting the first housing structure with the hinge structure as an axis, the first housing structure A flexible display extending from one surface to one surface of the second housing structure, a communication processor (CP) for communicating with one or more user terminals, a camera for acquiring an image, and transmitting the acquired image and information to a user and a display, a memory in which the photographed external object is stored, and at least one processor operably coupled to the communication processor and the memory, wherein the flexible display is located in which the hinge structure is located. a folding area corresponding to the area, a first area extending from the folding area to one edge of the first housing structure, and symmetrical about the first housing structure and the hinge structure, and the second area from the folding area a second region extending to an edge of a housing structure, wherein the memory stores a plurality of instructions, wherein the plurality of instructions, when executed by the at least one processor, cause the at least one processor to: A first image related to a user's face is acquired through a camera, data related to a face shape similar to the user is detected based on the acquired first image, and data related to the detected face shape are transmitted to an external electronic device. to receive, from the external electronic device, data on cosmetics and makeup methods with a high preference according to a user's similar face shape by using an artificial neural network, and receive cosmetics or makeup methods with a high preference according to a face shape similar to the user. The applied second image may be controlled to be displayed through the display.

According to various embodiments, an electronic device for matching a product and a user and a matching system including the same may provide product information related to makeup applied to the user's face through augmented reality, and apply products other than the applied product. You can try it, and you can intuitively understand the effect of the product.

Users for makeup have different face shapes, and by applying a product suitable for each face shape, the user can obtain an optimal makeup result, and can order products through the result.

1 is a block diagram of an electronic device and an external electronic device operating in a network environment, according to various embodiments of the present disclosure;
2 is a conceptual diagram of an artificial neural network model constituting an external electronic device according to various embodiments of the present disclosure.
3 is a block diagram of an electronic device according to various embodiments of the present disclosure;
4 is a diagram illustrating a first image in an electronic device according to various embodiments of the present disclosure;
5 is a diagram illustrating a plurality of second images recommended based on a first image in an electronic device according to various embodiments of the present disclosure;
6 is a diagram illustrating product information applied to a second image in an electronic device according to various embodiments of the present disclosure;
7 is a view illustrating a product applied to a second image in an electronic device according to various embodiments in stages.
8 illustrates an electronic device including a flexible display according to various embodiments of the present disclosure.
9 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure;

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

In describing the embodiments, descriptions of technical contents that are well known in the technical field to which the present invention pertains and are not directly related to the present invention will be omitted. This is to more clearly convey the gist of the present invention without obscuring the gist of the present invention by omitting unnecessary description.

For the same reason, some components are exaggerated, omitted, or schematically illustrated in the accompanying drawings. In addition, the size of each component does not fully reflect the actual size. In each figure, the same or corresponding elements are assigned the same reference numerals.

Advantages and features of the present invention, and a method for achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention belongs It is provided to fully inform the possessor of the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

At this time, it will be understood that each block of the flowchart diagrams and combinations of the flowchart diagrams may be performed by computer program instructions. These computer program instructions may be embodied in a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment, such that the instructions performed by the processor of the computer or other programmable data processing equipment are not described in the flowchart block(s). It creates a means to perform functions. These computer program instructions may also be stored in a computer-usable or computer-readable memory that may direct a computer or other programmable data processing equipment to implement a function in a particular manner, and thus the computer-usable or computer-readable memory. It is also possible that the instructions stored in the flow chart block(s) produce an article of manufacture containing instruction means for performing the function described in the flowchart block(s). The computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operational steps are performed on the computer or other programmable data processing equipment to create a computer-executed process to create a computer or other programmable data processing equipment. It is also possible that instructions for performing the processing equipment provide steps for performing the functions described in the flowchart block(s).

Additionally, each block may represent a module, segment, or portion of code that includes one or more executable instructions for executing specified logical function(s). It should also be noted that in some alternative implementations it is also possible for the functions recited in blocks to occur out of order. For example, two blocks shown one after another may be performed substantially simultaneously, or the blocks may sometimes be performed in the reverse order according to a corresponding function.

In this case, the term '~ unit' used in this embodiment means software or hardware components such as field-programmable gate array (FPGA) or ASIC (Application Specific Integrated Circuit), and '~ unit' refers to what role carry out the However, '-part' is not limited to software or hardware. '~' may be configured to reside on an addressable storage medium or may be configured to refresh one or more processors. Accordingly, as an example, '~' indicates components such as software components, object-oriented software components, class components, and task components, and processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. The functions provided in the components and '~ units' may be combined into a smaller number of components and '~ units' or further separated into additional components and '~ units'. In addition, components and '~ units' may be implemented to play one or more CPUs in a device or secure multimedia card.

In describing embodiments of the present invention in detail, an example of a specific system will be mainly targeted, but the main subject matter to be claimed in the present specification is to extend the scope disclosed herein to other communication systems and services having a similar technical background. It can be applied within a range that does not deviate significantly, and this will be possible at the discretion of a person with technical knowledge skilled in the art.

1 is a block diagram of an electronic device operating in a network environment, according to various embodiments of the present disclosure;

The artificial neural network may refer to hardware, software, or a combination thereof for providing a generalized output with respect to an input.

For example, the artificial neural network includes an application for simulating a convolutional neural network (CNN), a Markov chain, or a binarized neural network (BNN), and a processor for executing the application. can work based on

Referring to FIG. 1 , an external electronic device 101 (eg, a neural network device) is a device capable of performing machine learning through training, and may include a device for learning using a model composed of an artificial neural network. . For example, the neural network device 101 may be configured to input, output, build a database, and store information used for data mining, data analysis, and machine learning algorithms (eg, deep learning algorithms). can

The neural network device 101 may transmit/receive data to and from the electronic device 100 through the communication processor 150 , and may derive a result value by analyzing or learning data received from the electronic device 100 . The neural network device 101 may distribute and process the computation of the electronic device 100 .

The neural network device 101 may be implemented as a server. In addition, the neural network device 101 may be configured in plurality to form a neural network device set. Each of the neural network devices 101 may process the operation by distributing it, and may derive a result value through data analysis and learning based on the distributed processed data. The neural network device 101 may transmit a result obtained by using a machine learning algorithm or the like to an external electronic device or another neural network device.

According to various embodiments, the neural network device 101 includes an input unit 110 , a first processor 120 , a first memory 130 , a learning processor 140 , and a communication processor 150 (CP). can do.

According to various embodiments, the input unit 110 may obtain input data for deriving an output value through artificial neural network model learning. The input unit 110 may acquire raw input data. The first processor 120 or the learning processor 140 may preprocess the raw input data to generate training data that can be input to the artificial neural network model learning. The pre-processing may be to extract a feature point from the input data. As described above, the input unit 110 may receive data through the communication processor 150 to obtain input data or pre-process the data.

According to various embodiments, the first processor 120 may collect usage history information from the electronic device 100 and store it in the memory 130 . The first processor 120 may determine the best combination for executing a specific function through the stored usage history information and predictive modeling. The first processor 120 may receive image information, audio information, data, or user input information from the input unit 110 .

According to various embodiments, the first processor 120 collects information in real time, processes or classifies the information, and stores the processed information in the memory 130 , the database of the memory 130 or the learning processor 140 . can

According to various embodiments, when the operation of the electronic device 100 is determined based on data analysis and a machine learning algorithm, the first processor 120 controls the components of the electronic device 100 to execute the determined operation. can In addition, the first processor 120 may control the electronic device 100 according to the control command to perform the determined operation.

When a specific operation is performed, the first processor 120 analyzes historical information indicating the execution of the specific operation through data analysis and machine learning algorithms and techniques, and updates previously learned information based on the analyzed information. can be done The first processor 120 may improve the accuracy of data analysis and machine learning algorithms and performance based on the updated information together with the learning processor 140 .

The first memory 130 may store face shape information 131 , makeup information 132 , purchase information 133 , and an artificial neural network model 134 .

According to various embodiments, the first memory 130 may store the user's face, shape, shape, or color and product information obtained from the communication processor 150 or the input unit 110 in the allocated area. According to various embodiments, the first memory 130 may store input data obtained from the input unit 110 , learned data, or a learning history. The first memory 130 may store a plurality of instructions to be executed by the processor.

According to various embodiments, the artificial neural network model 134 may be stored in a space allocated to the first memory 130 . The space allocated to the first memory 130 stores the artificial neural network model 134 that is being trained or learned through the learning processor 140, and when the artificial neural network model 134 is updated through learning, the updated artificial neural network model 134 is updated. The neural network model 134 may be stored. The space allocated to the first memory 130 may store the learned model by dividing it into a plurality of versions according to a learning time point or learning progress.

According to various embodiments, the first memory 130 may include a database capable of storing and classifying input data obtained from the input unit 110 and the learned data.

According to various embodiments, the learning processor 140 learns the artificial neural network model 134 by directly acquiring data obtained by preprocessing the input data obtained by the first processor 120 through the input unit 110 , or the memory 130 ), it is possible to learn the artificial neural network model 134 by acquiring the preprocessed input data stored in the database. For example, the learning processor 140 may iteratively learn the artificial neural network model 134 using various learning techniques to obtain optimized parameters of the neural network model 134 .

According to various embodiments, the trained model may update the artificial neural network model 134 in the database. The learning processor 140 may be integrated into the neural network device 101 or implemented in the first memory 130 . Specifically, the learning processor 140 may be implemented using the first memory 130 .

According to various embodiments, the learning processor 140 generally identifies, indexes, categorizes, manipulates, stores, retrieves, and outputs data for use in supervised or unsupervised learning, data mining, predictive analytics, or other devices. may be configured to store data in one or more databases for Here, the database may be implemented using the first memory 130 , a memory maintained in a cloud computing environment, or another remote memory location accessible by the terminal through a communication method such as a network stored in the learning processor 140 . The information may be utilized by the first processor 120 using any of a variety of different types of data analysis algorithms and machine learning algorithms. For example, examples of such algorithms include k-recent adjacency systems, fuzzy logic (eg likelihood theory), neural networks, Boltzmann machines, vector quantization, pulse neural networks, support vector machines, maximum margin classifiers, hill climbing, derivation Logical Systems Bayesian Networks, Peritnets (e.g. Finite State Machines, Milli Machines, Moore Finite State Machines), Classifier Trees (e.g. Perceptron Trees, Support Vector Trees, Markov Trees, Decision Tree Forests, Arbitrary Forests), Read Models and systems, artificial fusion, sensor fusion, image fusion, reinforcement learning, augmented reality, pattern recognition, automated planning, and more.

The communication processor 150 may refer to a configuration including a wireless communication unit (not shown) and an interface unit (not shown). That is, the communication processor 150 may be a processor capable of transmitting and receiving data with other devices through wired/wireless communication or an interface.

When the learning model is updated, the updated learning model may be transmitted and loaded to another device such as a terminal or an external device through the communication processor 150 .

The communication processor 150 may communicate with various external terminals. For example, it may perform wired/wireless communication with the electronic device 100 . The communication may be LAN-connected wired communication or wireless communication such as long term evolution (LTE), mmWave, and the like.

The electronic device 100 may be an electronic device capable of communication, for example, a smart phone, a tablet PC, a network-connected computer, or a laptop.

According to various embodiments, the electronic device 100 may establish a communication channel with the communication processor 150 of the external electronic device 101 . The electronic device 100 may transmit the earpiece shape information 131 to the external electronic device 101 through the established communication channel. The electronic device 100 may be a terminal used by a user. The electronic device 100 may store an image captured by the user in a storage device (eg, a memory) in the electronic device 100 . The electronic device 100 may transmit face shape information stored in the storage device to the electronic device 100 through a communication channel established with the electronic device through a communication unit or a communication interface included in the electronic device 100 . The face shape information 131 transmitted to the communication processor 150 may be stored in an allocated area of the memory 130 . The face shape information 131 may include the shape, shape, or color of the user's face.

According to various embodiments, the makeup information 132 may be stored in the first memory 130 . Another external electronic device (not shown) may establish a communication channel with the communication processor 150 of the external electronic device 101 . The other external electronic device may transmit the makeup information 132 to the electronic device 100 through an established communication channel. The other external electronic device may store product information input by a cosmetic manufacturer or a seller in a storage device (eg, a memory) in the other external electronic device. The external electronic device 101 may receive the makeup information 132 stored in the storage device through a communication channel established with the electronic device through the communication unit or communication interface included in the other external electronic device. The makeup information 132 transmitted to the communication processor 150 may be stored in an allocated area of the memory 130 . The makeup information 132 may be information including a color, a makeup sample, or a portfolio input by a cosmetic manufacturer or seller. The makeup information 132 may include not only information input by the seller or the manufacturer, but also information on cosmetics suitable for a face shape determined by an artificial neural network model driven by the learning processor 140 or popular cosmetic information or makeup methods.

According to various embodiments, the makeup information 132 may be directly input through the input unit 110 .

According to various embodiments, an external user terminal (a mobile device similar to the electronic device 100 ) may establish a communication channel with the communication processor 150 of the external electronic device 101 . The electronic device 100 may transmit the purchase information 133 to the external electronic device 101 through the established communication channel. The electronic device 100 may be a terminal used by a user or a purchaser. The electronic device 100 may store purchase information input by the user in a storage device (eg, memory) in the electronic device 100 . The electronic device 100 may transmit purchaser information stored in the storage device to the external electronic device 101 through a communication channel established with the electronic device through a communication unit or communication interface included in the electronic device 100 . The purchase information 133 transmitted to the communication processor 150 may be stored in an allocated area of the memory 130 .

According to various embodiments, the purchase information 133 may be directly input through the input unit 110 . The purchase information 133 may include classification according to face shapes of a plurality of users, product information purchased by users, a history of each user's product evaluation or searched product, and previous purchase details.

An external electronic device or an electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device 100 may include, for example, a portable communication device (eg, a smartphone), a computer device, a server device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include all possible combinations of items listed together in the corresponding one of the phrases. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the element from other elements in question, and may refer to elements in other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is "coupled" or "connected" to another (eg, second) component, with or without the terms "functionally" or "communicatively". When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include software (eg, a storage medium (eg, internal memory) or external memory) readable by a machine (eg, the electronic device 101) including one or more instructions stored in the software ( For example, it can be implemented as a program). For example, the processor (eg, the processor 120) of the device (eg, the electronic device 100 and the external electronic device 101) calls at least one of the one or more instructions stored from the storage medium, can run it This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed online (eg download or upload), directly between smartphones (eg smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

2 is a conceptual diagram of an artificial neural network model constituting an electronic device according to various embodiments of the present disclosure.

Referring to FIG. 2 , a typical convolutional neural network includes feature extraction 11 of input data 210 using a convolutional layer 201 and a pooling layer 202 and input using a fully connected layer 290 . It can be used for classification 12 of data 210 .

According to various embodiments, the convolutional layer 201 may be a layer that extracts meaningful features of the input data 210 through a convolution operation. For example, the convolutional layer 201 may generate new data to be transmitted to the next layer by applying a filter or a kernel (weight) matrix 230 of a specific size to the input data 210 . Such input/output data of the convolutional layer 201 may be referred to as feature maps.

When the data input to the convolutional neural network model is an input image including a plurality of components, such as RGB components, the input data may consist of a plurality of channels. For example, the input/output data of the convolutional layer 201 may include channels in addition to the space of the two-dimensional image, and the feature map of the input/output data may be formed in a three-dimensional form.

According to various embodiments, the pooling layer 202 may reduce input data through sub-sampling. For example, the pooling layer 202 may reduce the size of data by sampling data through pooling techniques such as max pooling and average pooling.

According to various embodiments, the fully connected layer 290 is a layer for performing data classification based on the features transmitted through the convolutional layer 201 and the pooling layer 202 , and a three-dimensional feature map is flattened. One-dimensional data can be input. As described above, the one-dimensional data that has passed through the fully connected layer 290 may be converted into an output signal through an activation function. Convolutional neural networks can use convolutional layers and pooling layers to maintain the three-dimensional shape of feature maps for input data (e.g. input images), thus avoiding loss of information about the associations between pixels or channels in the input image. This can increase the image recognition rate.

According to various embodiments, the first processor 120 may determine the similarity of various images based on the feature points of the feature map. In addition, the first processor 120 may assign different weights to each of the feature points to give more features to the configuration that is important in determining the similarity of the image.

3 is a block diagram of an electronic device 101 according to various embodiments. The electronic device 100 of FIG. 3 may include the electronic device 100 of FIG. 1 . The electronic device 100 according to various embodiments may include at least one of a processor 310 , a memory 320 , a communication processor 330 , a display 340 , and a camera 350 . 2, the processor 310, the memory 320, the communication processor 330, the display 340, and/or the camera 350 are electrically connected to each other by an electronic component such as a communication bus. electronically and/or operably coupled with each other. The type and/or number of hardware components included in the electronic device 101 is not limited to that illustrated in FIG. 2 . The electronic device 100 according to an embodiment may include only some of the hardware components illustrated in FIG. 2 .

The processor 310 of the electronic device 100 according to an embodiment may include a hardware component for processing data based on one or more instructions. Hardware components for processing data may include, for example, an Arithmetic and Logic Unit (ALU), a Field Programmable Gate Array (FPGA), and/or a Central Processing Unit (CPU). The number of processors 310 may be one or more. For example, a plurality of processors 310 may be included in the electronic device 100 based on a dual core, a quad core, or a hexa core.

The memory 320 of the electronic device 100 according to an embodiment may include a hardware component for storing data and/or instructions input and/or output to the processor 310 . The memory 320 may include, for example, volatile memory such as random-access memory (RAM) and/or non-volatile memory such as read-only memory (ROM). have. The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disk, and an embedded multi media card (eMMC). can

In the memory 320 , one or more instructions indicating an operation to be performed by the processor 310 on data may be stored. A set of instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and/or an application. For example, the electronic device 100 and/or the processor 310 of the electronic device 100 executes a set of a plurality of instructions distributed in the form of an application, and uses the image of the user's body One or more actions may be performed to measure dimensions and/or to provide a guide for capturing the image.

The communication processor 330 of the electronic device 100 according to an embodiment provides an electrical connection between the electronic device 100 and an external electronic device distinct from the electronic device 100 (eg, the external electronic device 101 of FIG. 1 ). It may include hardware components to support transmission and/or reception of signals. The external electronic device may include, for example, a server of a service provider that manufactures and/or sells a product. The communication processor 330 may include, for example, at least one of a modem (MODEM), an antenna, and an optical/electronic (O/E) converter. Communication processor 330, Ethernet (ethernet), LAN (Local Area Network), WAN (Wide Area Network), WiFi (Wireless Fidelity), LTE (Long Term Evolution), 5G NR (New Radio) of various types such as Transmission and/or reception of electrical signals may be supported based on the protocol.

The display 340 of the electronic device 100 according to an embodiment may output visualized information to the user. For example, the display 340 is controlled by a controller such as the processor 310 (eg, a graphic processing unit (GPU) included in the processor 310 ) to display information visualized to the user. can be printed out. The display 340 may include a cathode ray tube (CRT), a flat panel display (FPD), and/or electronic paper. The FPD may include a liquid crystal display (LCD), a plasma display panel (PDP), and/or one or more light emitting diodes (LEDs). The LED may include an organic LED (OLED).

Although not shown, the electronic device 100 according to an embodiment may include an output means for outputting information in a form other than a visualized form. For example, the electronic device 100 may include a speaker for outputting an acoustic signal. For example, the electronic device 100 may include a motor for providing haptic feedback based on vibration.

The camera 350 of the electronic device 100 according to an embodiment is configured to operate in the processor 310 and/or the memory 320 based on light from a designated space (eg, a space in front of the camera 350). It is possible to generate an electrical signal having a usable format. For example, the camera 350 may include a plurality of photodiodes (PDs) arranged in two dimensions. The type of wavelength that the camera 350 receives is not limited to visible light, and may include infrared light and/or ultraviolet light. For example, the camera 350 may include a Time of Flight (ToF) sensor that irradiates infrared rays toward a subject and then receives infrared rays reflected from the subject to obtain a depth-map. In this case, the camera 350 may output a frame based on visible light and a depth map corresponding to the frame.

The camera 350 according to an embodiment may output a frame based on an electrical signal of each of the plurality of photodiodes at designated periods. A period in which the camera 350 outputs a frame may be referred to as a frame rate (frames per second, fps). The frame may be transmitted to the processor 310 and/or the memory 320 . The number of cameras 350 included in the electronic device 101 is not limited to the embodiment of FIG. 2 , and may be two or more, for example, a dual camera or a triple camera.

The electronic device 100 according to various embodiments may obtain a frame including one or more subjects from the camera 350 . The one or more subjects may include a body part (eg, the user's face) of the user of the electronic device 100 and/or a subject (eg, an object around the user) that can be used to more accurately measure the size of the body part. ) may be included. In response to identifying the one or more objects in the frame, the electronic device 100 may acquire one or more parameters related to the size of the objects. Alternatively, the electronic device 100 may control the camera 350 to obtain an image having a relatively higher resolution than that of the frame. The electronic device 100 obtaining one or more parameters related to the size of the subject may be performed based on the image.

The electronic device 100 according to an embodiment may output information for changing the composition of the one or more objects in the frame to the user based on the size of the one or more objects identified in the frame. have. For example, if the size of the one or more objects identified within a frame is too small, and/or if the one or more objects do not exist in the center of the frame, the electronic device 100 informs the user of the one or more objects within the frame. Information for adjusting the size and/or position of the above objects may be output.

The electronic device 100 may acquire a ToF map through the camera 350 to acquire a 3D image of a user's body part, and the electronic device 100 may acquire feature points of the 3D image by itself. In addition, the electronic device 100 may transmit 3D image related data to the neural network device (eg, the external electronic device 101 of FIG. 1 ), and may receive data on feature points and similar face shapes processed by the neural network device.

Hereinafter, embodiments implemented by the electronic device 100 or the processor 310 of the electronic device 100 will be described in detail with reference to FIGS. 4 to 8 , and in FIG. 9 , the electronic device 100 or the electronic device 100 . The operation of the processor 310 of the will be described in detail.

4 is a diagram illustrating a first image in an electronic device according to various embodiments of the present disclosure;

The electronic device 100 may be a foldable device. The electronic device 800 includes a foldable housing including a first housing structure connected to a hinge structure, a second housing structure contacting the first housing structure with the hinge structure as an axis, and a flexible display disposed in the foldable housing ( 340) may be included. The flexible display 340 may be formed to extend from one surface of the first housing structure to one surface of the second housing structure. The flexible display 340 may be disposed on one surface of the first housing structure and one surface of the second housing structure in an unfolding state to form a single plane. The flexible display 340 may maintain a folded shape as one surface of the first housing structure and one surface of the second housing structure are disposed to face each other in a folding state. According to another embodiment, the flexible display 340 maintains a shape exposed to the outside as one surface of the first housing structure and one surface of the second housing structure are disposed to face each other outward in a folding state. can

According to various embodiments, the flexible display 340 may include a first area 341 , a second area 342 , and a folded area 343 . The folded area 343 may be an area on the flexible display 340 corresponding to the area where the hinge structure is disposed, and may be an area in which the flexible display is folded. The first region 341 and the second region 342 may be symmetrical about the hinge axis and extend from the folded region 343 .

Referring to FIG. 4 , the electronic device 100 may display a first image 410 including a face, which is a part of the user's body, on the display 340 . The electronic device 100 may display the first image 410 in one of the first area 341 or the second area 342 of the display 340 . The electronic device 100 may acquire the first image 410 related to the user's face through the camera 350 . The camera 350 may include a Time of Flight (ToF) sensor that irradiates infrared rays toward the user's face and then receives the infrared rays reflected from the face to obtain a depth-map. In this case, the camera 350 may output a frame based on visible light and a depth map corresponding to the frame. After extracting the face depth according to the depth, the contour line 420 of the face may be obtained based on the feature point. The obtained face outline 420 may be stored in the electronic device or transmitted to an external electronic device (eg, the external electronic device 101 of FIG. 1 ). The external electronic device may receive the outline 420 or data related to the outline 420 of the face and find a similar facial outline through an artificial neural network model (eg, the artificial neural network model 134 of FIG. 1 ).

The electronic device 100 or a processor included in the electronic device 100 (eg, the processor 310 of FIG. 3 ) is located in the second area 342 in which the first image 410 expressing the user's face is not located. can be displayed. According to another embodiment, when the first image 410 is displayed over the first area 341 and the second area 342 , the palette 480 may be displayed to overlap a part of the first image 410 . can The palette 480 may be formed of various colors. The palette 480 may variously express the type of color of the selected cosmetics, and may express the color of the same type of cosmetics. For example, when there is a product selected by the user, the electronic device 100 may display a palette 480 including colors in which the product can be expressed on the display 340 . As another example, when the user does not select a product, the electronic device 100 may display the palette 480 including all colors of the product input to the server. Thereafter, when the user selects a product, the electronic device 100 may display a palette 480 of the selected product, and when a plurality of products are selected, a palette 480 of a color that the plurality of products can express is displayed. can do. If there are more colors than the number of palettes 480 , there may be buttons 450 around the palette 480 to view other colors. When the button 450 is touched or hovered, the electronic device 100 may change a color included in the palette 480 .

According to various embodiments, through an input device (eg, a stylus pen, a keyboard, a mouse, etc.) capable of exchanging an input signal with the electronic device 100 or an external object (eg, a part of the user's body), the electronic device Reference numeral 100 denotes a color selected by the user from the palette 480 in the first image 410 . For example, after a user selects a color of a palette with an input device or an external object, the color may be expressed through a touch or hovering on a portion 390 of the first image 410 .

For example, the electronic device acquires a first image in which a part of the user's body or face is expressed through a camera (eg, the camera 350 of FIG. 3 ), a Histogram of Oriented Gradient (HOG), a Haar-like feature, Through various algorithms for object feature extraction such as co-occurrence HOG, local binary pattern (LBP), features from accelerated segment test (FAST), etc., the stylus pen (held by the user) in the first image (or the stylus pen outline) can be recognized.

In addition, as an example, the stylus pen may include a first button (eg, may have the shape of a pen tip) formed on the tip of the pen (or the nib or the end of the pen) or the body or the body of the stylus pen. It may include a second button formed on one side of the. For example, when the user presses his or her face with the stylus pen, the first button may be pressed (on the face). At this time, while the first button is pressed, the electronic device may output an image (or makeup result) to which makeup (or cosmetics) is applied to a part of the user's body or face located at a point close to the nib portion of the stylus pen. have. Also, for example, the user may press the second button formed on the main body of the stylus pen or one side of the main body with his/her hand. At this time, while the second button is pressed, the electronic device may output an image (or makeup result) to which makeup (or cosmetics) is applied to a part of the user's body or face located at a point close to the nib of the stylus pen. have.

As another example, if the distance between the stylus pen and the user's body part or face in the first image is close to or less than a predetermined reference value (or positioned near the body part or face), it can be considered that a predetermined input signal has been obtained. have. At this time, while the distance between the stylus pen and the user's body part or face approaches a predetermined reference value or less, the electronic device applies makeup (or An image (or makeup result) to which cosmetics) is applied can be output.

As another example, when the position of the stylus pen in the first image is stopped for a predetermined time, it may be considered that a predetermined input signal is obtained. At this time, the electronic device displays an image (or makeup result) to which makeup (or cosmetics) is applied to a part of the user's body or face located at a point close to the nib portion of the stylus pen while the position of the stylus pen is stopped. can be printed out.

5 is a diagram illustrating a plurality of second images recommended based on a first image in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 5 , the electronic device 100 may display second images 411 and 412 corrected from the first image 410 on the display 340 . The electronic device 100 may transmit the transmitted face outline 420 or data related to the outline 420 . The external electronic device may implement the artificial neural network model described above in FIG. 2 through an artificial neural network model (eg, 134 of FIG. 1 ) based on the received data to extract key points. The external electronic device may find a similar face shape based on the extracted feature points.

According to various embodiments, the external electronic device may store face shape related data in an allocated memory (eg, the first memory 130 of FIG. 1 ). Data related to the face shape may be registered while users use an external electronic device. According to various embodiments, the external electronic device may include users' face shapes, cosmetics selected by users, and user preferences. The external electronic device may match user's preferred cosmetics according to the face shape, and may give priority to the user's cosmetics. Also, the external electronic device may include data including ratings of cosmetics applied according to the face shape.

The electronic device 100 may display a second image 411 to which a product recommended by an external electronic device is applied. The second image 411 may be an image generated by the electronic device 100 based on a product recommended by the external electronic device or an image transmitted to the electronic device 100 by matching a product in the external electronic device. The second image 411 may be a plurality of images, and the displayed order may be exposed in an order according to the preference of previous users.

The display 340 may express a button 415 for switching to the next image in order to display the plurality of second images 411 and 412 . When an input is applied to the button by the user, the second image may be converted from the second image 411 to the second image 412 .

According to various embodiments, the display 340 may display a recommendation icon or phrase 345a or 345b while the second image 411 is displayed. Information input to the recommendation icons 345a and 345b may be used in an external electronic device to determine a user's preference. According to various embodiments, the recommendation icon may initially have an empty color 345a, and may be converted into an icon 345b including a color after a user input. As another example, when the recommendation icons 345a and 345b are clicked, a window for inputting a rating may appear, and the input rating may be transmitted to an external electronic device. According to various embodiments, when the second images 411 and 412 are vertically displayed, the second images 411 and 412 are the first area (eg, the first area 341 of FIG. 4 ) or the second area. (eg, the second area 342 of FIG. 4 ), the palette (eg, the palette 480 of FIG. 4 ), and the recommendation icons 345a and 345b are the first area 341 or the second area Among the 342 , the second images 411 and 412 may be displayed in a non-displayed area.

Based on the delivered rating or the number of recommendations, the artificial neural network model of the external electronic device may sort the cosmetics in the order of preference according to the user's face contour.

According to various embodiments, the electronic device 100 may correct some makeup by a user. For example, the second image 411 may be a second image first received by the user, and hair and eye makeup may be changed by the user's selection. When the user selects the hair side, a different hair shape or color can be expressed at the position where the palette 480 is located, and the user can modify the hair design based on this. The second image 412 may be formed by correcting eye makeup in the same manner. The user may finally select and click the recommendation icon 345b to indicate satisfaction. In this case, the electronic device 100 may create data with a high preference for the second image 411 and high preference for the second image 411 and transmit it to the external electronic device. The external electronic device may store the related content in the storage device, and then use it when recommending cosmetics or make-up methods to other users.

6 is a diagram illustrating product information applied to a second image in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 6 , the user may check information on the product used in the second image 412 through the electronic device 100 . The electronic device 100 may display the second image 412 and the list 430 of makeup products applied to the second image 412 through the display 340 .

According to various embodiments, the electronic device 100 may receive data related to the second image 412 and data related to a product used in the second image 412 from the external electronic device. Data related to the product used in the second image 412 may be listed and displayed on the display 340 . The user may touch 435 the product name displayed on the list or touch 425 a portion of the second image 412 . When a part of the second image 412 or a product name is touched, the electronic device 100 may overlap a window 420 in which a product description is expressed on the second image or may display it in an empty space. The window 420 in which the description of the product is expressed may include product information, a product manufacturer, a price, and the like, and may include an order button. Additionally, it may include a link to obtain detailed product information. When the user wants to check a product applied to another part, he or she may click another product in the product list 430 or select another part of the second image 412 .

According to various embodiments, when the second images 411 and 412 are vertically displayed, the second images 411 and 412 are the first area (eg, the first area 341 of FIG. 4 ) or the second area. (eg, the second area 342 of FIG. 4 ), the window 420 in which a product description is expressed, and the product list 430 are the first area 341 or the second area 342 . Among them, the second images 411 and 412 may be displayed in a non-displayed area.

According to various embodiments, when the user touches 425 a part of the product list 430 or the second image 412 , the processor (eg, the processor 310 of FIG. 3 ) may recognize the input. Based on the recognized input, the processor may provide product information corresponding to the input in the form of a window 420 in which a description of the product popped up on the display 340 is expressed. When the user clicks an order button included in the window 420 , the processor may switch to a window related to an order of the product, and when a product name or manufacturer is clicked, information about the product or information about other products of the manufacturer can be displayed and provided to the user.

7 is a diagram illustrating a product applied to a second image in an electronic device according to various embodiments in stages.

Referring to FIG. 7 , the electronic device 100 displays a second image (eg, second images 411 and 412 of FIG. 5 ) from a first image (eg, the first image 410 of FIG. 4 ) on the display 340 . )), the order of applying makeup to the second image 412 selected by the user may be provided.

According to various embodiments, the electronic device 100 may receive a makeup method applied to a similar face shape obtained through an artificial neural network from an external electronic device. When there are a plurality of makeup methods, the user may select one, and the electronic device 100 may display the selected makeup methods in each step through the display 340 in order. The electronic device 100 may display a window 420 including information related to a makeup method applied in each step, and the window 420 may be opened or closed according to a user's input.

In STEP X, the electronic device 100 may provide a product applied to the ball touch step and an image to which the product is applied. For example, the display 340 may provide the current stage 441 to the first image 410 and one area of the display 340 . The display area of the current step 441 may display STEP X, and information about the product applied in the current step may be provided through the window 420 .

The display 340 may represent the first image 410 by mapping the makeup 442 (eg, a cheek touch) applied in the current step 441 .

In STEP X+1, the electronic device 100 may provide a product applied to the eye makeup step and an image to which the product is applied. The current step 443 may be changed from STEP X to STEP X+1, and the display may provide information about the product applied in the current step 443 through the window 420 . When there are a plurality of products applied in the current stage, information on a plurality of products may be provided through the window 420 .

The display 340 maps the makeup 442 (eg, a cheek touch) applied in STEP X, which is the current previous stage 441 , to the first image 410 , and furthermore, the current stage 443 STEP X+ The makeup 444 (eg, eye makeup) applied in 1 may be mapped and expressed.

According to various embodiments, when the second images 411 and 412 are vertically displayed, the second images 411 and 412 are the first area (eg, the first area 341 of FIG. 4 ) or the second area. (eg, the second area 342 of FIG. 4 ), and the window 420 in which a product description is expressed is the second image 411 of the first area 341 or the second area 342 . , 412) may be displayed in a non-displayed area. According to various embodiments, the representation of the current step 441 , 443 is a first area (eg, the first area 341 of FIG. 4 ), a second area (eg, the second area of FIG. 4 ) of the display 340 . 342 ) and a fold region (eg, fold region 343 in FIG. 4 ). For another example, different from that shown in FIG. 7 , the representation of the current step 441 , 443 may be placed in either the first area 341 or the second area 343 of the display 340 . have.

8 illustrates an electronic device including a flexible display according to various embodiments of the present disclosure.

The electronic device 800 may display the second image 411 to which the makeup is applied and, at the same time, display the chat window 890 , the product list 430 , and the palette 480 in another area on the display 840 .

The electronic device 800 may be a foldable device. The electronic device 800 includes a foldable housing including a first housing structure connected to a hinge structure, a second housing structure contacting the first housing structure with the hinge structure as an axis, and a flexible display disposed in the foldable housing ( 840) may be included. The flexible display 840 may be formed to extend from one surface of the first housing structure to one surface of the second housing structure. The flexible display 840 may be disposed on one surface of the first housing structure and one surface of the second housing structure in an unfolding state to form a single plane. The flexible display 840 may maintain a folded shape as one surface of the first housing structure and one surface of the second housing structure are disposed to face each other in a folding state. According to another embodiment, the flexible display 840 maintains a shape exposed to the outside as the one surface of the first housing structure and the one surface of the second housing structure are disposed to face each other outward in the folding state. can

According to various embodiments, the flexible display 840 may include a first area 841 , a second area 842 , and a folded area 843 . The folded area 843 may be an area on the flexible display 840 corresponding to the area where the hinge structure is disposed, or may be an area in which the flexible display is folded. The first region 841 and the second region 842 may be symmetrical about the hinge axis and extend from the folded region 843 .

According to various embodiments, the processor 310 of the electronic device 100 displays the first image 410 or the second image 411 in the first area 841 or the second area 842 of the flexible display 840 . can be controlled to express In the remaining area of the flexible display 840 , the processor 310 includes a product list 430 including makeup information other than the first image 410 or the second image 411 , a chat window 890 , and a palette 480 . ) can be expressed. For example, the second image 411 and the recommendation icon 345 are expressed in the first area 841 , and the product list 430 , the chat window 890 , and the palette 480 are displayed in the second area 842 . can be expressed When the user selects a product in the product list 430 , product information may be displayed in a pop-up window in the second area 842 . The chat window 890 may output an input of a user of the electronic device 100 and a user connected through the external electronic device 101 or an external server.

9 is a flowchart illustrating an operation of an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 9 , when the electronic device (eg, the electronic device 100 of FIG. 1 ) is executed by at least one processor (eg, the processor 310 of FIG. 3 ), the at least one processor is configured to perform the operation through the camera. A first image related to the user's face is acquired (S910), and data related to a face shape similar to the user is detected based on the acquired first image (S920), and the data related to the detected face shape is detected (S920). It transmits to an external electronic device and receives, from the external electronic device, data on cosmetics and makeup methods with a high preference according to a user's similar face shape by using an artificial neural network (S930), and receives a preference according to a similar face shape to the user (S930). It is possible to control to display a second image to which cosmetics or a makeup method having a high value is applied through the display (S940).

In operation S910 , the electronic device may acquire a first image in which the user's body part or face is expressed through a camera (eg, the camera 350 of FIG. 3 ). The first image may include depth information in order to express the curvature of the face, and may be an in-display camera disposed to overlap under a display (eg, the display 340 of FIG. 3 ). The first image may be an image acquired through the rear camera as well as the front camera.

In operation S920, the electronic device may detect a similar face shape based on the acquired image. According to various embodiments, the electronic device may obtain a feature point from the face shape expressed in the first image, and may determine a similar face based on the feature point. In addition, the electronic device transmits height information and color information included in the acquired image to an external electronic device including an artificial neural network model (eg, the external electronic device 101 of FIG. 1 ) to determine the feature points through the artificial neural network model. By extracting, a similar face type can be found from the previously stored face model.

In operation S930, the electronic device may search for cosmetics and makeup methods according to the face shape. The electronic device may provide cosmetics and makeup methods suitable for a corresponding face shape through its own application or stored data. Also, the electronic device may receive data related to cosmetics and makeup methods suitable for a corresponding face shape from the external electronic device. For example, the external electronic device may determine products recommended by users with a face shape similar to the user's face shape and products used by users, assign weights, evaluate scores, set priorities, and transmit them to the electronic device. In addition, the external electronic device may determine a makeup method recommended by users with a similar face shape and a makeup method applied, set a priority, and transmit it to the electronic device.

In operation S940, the electronic device may express a face to which cosmetics are applied through the display. According to various embodiments, the electronic device may display a second image to which a recommended cosmetic or makeup method is applied to the user. If the user does not like the corresponding cosmetic or makeup method, the user may request a second image to which the next-order cosmetic or makeup method is applied, and the electronic device may provide the next-ordered second image in response to the request. When a user requests a signal related to product information or an order, the electronic device may display a window containing product information or an order link.

The electronic device according to various embodiments described above includes a communication processor for communicating with one or more user terminals, a camera for acquiring an image, a display for transmitting the acquired image and information to a user, and storing the captured external object. a memory, the communication processor, and at least one processor operably coupled to the memory, the memory storing a plurality of instructions, the plurality of instructions comprising: the at least one processor When executed by , the at least one processor acquires a first image related to the user's face through the camera, and based on the acquired first image, detects data related to a face shape similar to the user, and , transmits data related to the detected face shape to an external electronic device, and receives, from the external electronic device, data on cosmetics and makeup methods with high preference according to a user's similar face shape by using an artificial neural network, and the user It is possible to control to display a second image to which a cosmetic or makeup method having a high preference is applied according to a face shape similar to , through the display.

According to various embodiments, when the at least one processor executes the instructions, the processor detects an approach of an external object to the first image, and when there is a specific input through the sensed external object, a display It can be controlled to display in .

According to various embodiments, the external object may be an external electronic device capable of transmitting and receiving signals to and from the electronic device, and the specific input is for expressing an image in which the cosmetic effect is applied to a part of the first image. It can be an input.

According to various embodiments, the data related to the detected face shape may include a user's face shape and color.

According to various embodiments, when the processor exposes the first image or the second image to the outside through the display, a palette including a plurality of colors is applied to a partial region of the first image or the second image. It can be controlled to overlap.

According to various embodiments, the display represents an object for recommendation when the second image is exposed, and the processor controls to transmit the recommendation information to the external electronic device when a signal is input through the object can do.

According to various embodiments, when the first image or the second image is exposed, the display provides a window for communication with another user, and the processor provides the window with the user of the electronic device and It is possible to control an input of a user connected through the external electronic device or an external server to be output.

According to various embodiments, the processor may display a plurality of product lists applied to the second image through the display, and when selecting the product from the plurality of product lists, information related to the product information, price, or order A window may be controlled to be displayed through the display.

An electronic device according to various embodiments of the present disclosure includes a foldable housing including a first housing structure connected to a hinge structure, a second housing structure contacting the first housing structure with the hinge structure as an axis, and one surface of the first housing structure A flexible display extending from one surface of the second housing structure. A communication processor for communicating with one or more user terminals, a camera for acquiring an image, a display for transmitting the acquired image and information to a user, a memory in which the photographed external object is stored, the communication processor and the memory; at least one processor operably coupled to, wherein the flexible display includes a folding area corresponding to an area in which the hinge structure is located, and extending from the folding area to an edge of the first housing structure a first region formed as an axis, and a second region symmetrical about the axis of the first housing structure and the hinge structure, and extending from the folding region to one edge of the second housing structure, wherein the memory includes: store instructions, and when the plurality of instructions are executed by the at least one processor, the at least one processor obtains a first image related to the user's face through the camera, and the obtained first image based on , detects data related to a face shape similar to the user, transmits data related to the detected face shape to an external electronic device, and uses an artificial neural network from the external electronic device to obtain a face shape similar to the user Accordingly, it is possible to receive data on cosmetics and makeup methods with high preference, and control to display a second image to which cosmetics or makeup methods with high preference are applied according to a face shape similar to the user through the display.

According to various embodiments, when the processor exposes the first image or the second image to the outside through the flexible display, the processor displays the first image or the second image on the first area, and A color palette may be controlled to be displayed in the second area.

Methods according to the embodiments described in the claims or specifications of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. One or more programs stored in the computer-readable storage medium are configured to be executable by one or more processors in an electronic device (device). One or more programs include instructions for causing an electronic device to execute methods according to embodiments described in a claim or specification of the present disclosure.

Such programs (software modules, software) include random access memory, non-volatile memory including flash memory, read only memory (ROM), electrically erasable programmable ROM (EEPROM: Electrically Erasable Programmable Read Only Memory), magnetic disc storage device, Compact Disc-ROM (CD-ROM), Digital Versatile Discs (DVDs), or any other form of It may be stored in an optical storage device or a magnetic cassette. Alternatively, it may be stored in a memory composed of a combination of some or all thereof. In addition, each configuration memory may be included in plurality.

In addition, the program is transmitted through a communication network composed of a communication network such as the Internet, Intranet, Local Area Network (LAN), Wide LAN (WLAN), or Storage Area Network (SAN), or a combination thereof. It may be stored on an attachable storage device that can be accessed. Such a storage device may be connected to a device implementing an embodiment of the present disclosure through an external port. In addition, a separate storage device on the communication network may be connected to the device implementing the embodiment of the present disclosure.

In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed in the singular or plural according to the specific embodiments presented. However, the singular or plural expression is appropriately selected for the context presented for convenience of description, and the present disclosure is not limited to the singular or plural element, and even if the element is expressed in plural, it is composed of the singular or singular. Even an expressed component may be composed of a plurality of components.

Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, various modifications are possible without departing from the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments and should be defined by the claims described below as well as the claims and equivalents.

Claims (10)

delete delete delete delete delete delete delete delete In an electronic device,
a foldable housing including a first housing structure connected to the hinge structure and a second housing structure contacting the first housing structure with the hinge structure as an axis;
a flexible display extending from one surface of the first housing structure to one surface of the second housing structure;
a communication processor (CP, communication processor) for communicating with one or more user terminals;
a camera for acquiring images;
a display for transmitting the acquired image and information to a user;
a memory in which the acquired image is stored; and
at least one processor operably coupled to the communication processor and the memory;
The flexible display may include a folding area corresponding to an area in which the hinge structure is located, a first area extending from the folding area to one edge of the first housing structure, and the first housing structure and the hinge structure as an axis. and a second region symmetrical to and extending from the folding region to one edge of the second housing structure,
The memory stores a plurality of instructions,
The plurality of instructions, when executed by the at least one processor, causes the at least one processor to
Obtaining a first image related to the user's face through the camera,
Detecting data related to a face shape similar to the user based on the acquired first image,
transmitting data related to the detected face shape to an external electronic device;
Receives, from the external electronic device, data on cosmetics and makeup methods in which preference is greater than a preset value according to a user's similar face shape by using an artificial neural network,
Controlling to display a second image to which cosmetics or makeup methods having a preference greater than a preset value according to a face shape similar to the user are applied through the display,
The camera includes a Time of Flight (ToF) sensor that irradiates infrared rays toward a subject and then receives infrared rays reflected from the subject to obtain a depth-map,
The at least one processor,
Obtaining a first image related to the user's face through the camera,
Obtaining a ToF map through the camera to obtain a 3D image of the user's face,
The at least one processor,
providing an order of applying makeup to the second image selected from the first image on the flexible display,
When the processor exposes the first image or the second image to the outside through the flexible display, the processor displays the first image or the second image in the first area, and displays a palette including a plurality of colors. control to display in the second area;
When an input signal for selecting a color from the palette is received from an input device capable of exchanging an input signal with the electronic device, the electronic device expresses the selected color in a first image. delete

Images