WO2024091021A1

WO2024091021A1 - Electronic device and operating method therefor

Info

Publication number: WO2024091021A1
Application number: PCT/KR2023/016746
Authority: WO
Inventors: 이헌우; 이동현; 오영학; 한우정
Original assignee: 삼성전자 주식회사
Priority date: 2022-10-26
Filing date: 2023-10-26
Publication date: 2024-05-02

Abstract

An electronic device according to one embodiment of the present disclosure may comprise: a display; a photosensor; a memory for storing instructions; and a processor for controlling operations of the display and the photosensor. When the instructions are executed by the processor, the electronic device can be configured to: identify (for example, determine) user skin color on the basis of sensing data about the user skin color from the photosensor; store user skin color information in a server associated with an account of the user; change the content color of an application so that same corresponds to the user skin color, thereby displaying same on the display; and provide, to a message receiver, the user skin color information stored in the server associated with the account of the user. Other various embodiments are possible.

Description

Electronic devices and methods of operating the same

Embodiments of the present disclosure relate to electronic devices and methods of operating the same.

Electronic devices (e.g. smart watches, wearable electronic devices, AR electronic devices, smart phones, tablet PCs) can display content (e.g. text, shapes, characters, avatars, emoticons, and emojis) when running an application. there is. Each user may have a different skin color, but the user's skin color is not applied (e.g. reflected) to the content of the application, but the content is displayed in the basic color (e.g. default color).

The contents described above are provided only as background information to help understand the embodiments of the present disclosure. No decision has been made, and no claim has been made, as to whether any of the above may apply as prior art in connection with this disclosure.

Electronic devices (e.g. smart watches, wearable electronic devices, AR electronic devices, smart phones, tablet PCs) display content related to the human body (e.g. letters, shapes, characters, avatars, emoticons, and emojis) when running an application. ) as the primary color (e.g. default color) may cause issues of racial discrimination. Since users have different skin colors and biometric characteristics, an electronic device and method of operating the same that can apply (e.g., reflect) this to the content of the application are required.

An embodiment of the present disclosure may provide an electronic device capable of displaying content (e.g., text, figures, characters, avatars, emoticons, and emojis) by applying the user's skin color, and a method of operating the same. One embodiment of the present disclosure applies content (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) of the user. : An electronic device capable of displaying letters, shapes, characters, avatars, emoticons, and emojis) and a method of operating the same can be provided.

One embodiment of the present disclosure displays content (e.g., text, shapes, characters, avatars, emoticons, and emoji) by applying the skin color of another user (e.g., message recipient) and displays content (e.g., text, shape, character, avatar, emoticon, and emoji) by applying the skin color of another user (e.g., message recipient). An electronic device capable of transmitting a message to a user and a method of operating the same may be provided.

One embodiment of the present disclosure includes biometric characteristics of other users (e.g., message recipients) (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape). ) can be applied to provide an electronic device and a method of operating the same that can display content (e.g., text, shapes, characters, avatars, emoticons, and emojis) and transmit messages to other users (e.g., message recipients). .

The technical challenges sought to be achieved in this document are not limited to the technical challenges mentioned above, and other technical challenges not mentioned can be clearly understood by those skilled in the art in the technical field to which this document belongs from the description below. There will be.

An electronic device according to an embodiment of the present disclosure includes a display; optical sensor; memory to store instructions; and a processor that controls operations of the display and the optical sensor. When the instructions are executed by the processor, the electronic device may be set to identify (eg, determine) the user's skin color based on sensing data about the user's skin color from the optical sensor. When the instructions are executed by the processor, the electronic device may be configured to store the user's skin color information on a server associated with the user's account. When the instructions are executed by the processor, the electronic device can be set to change the color of the content of the application to correspond to the skin color of the user and display it on the display. When the instructions are executed by the processor, the electronic device may be configured to provide the message recipient with the user's skin color information stored on a server associated with the user's account.

A method of operating an electronic device according to an embodiment of the present disclosure can sense the user's skin color using an optical sensor. The user's skin color may be identified (eg, determined) based on the user's skin color sensing data from the optical sensor. The user's skin color information may be stored on a server associated with the user's account. The color of the content of the application can be changed and displayed to correspond to the user's skin color. The user's skin color information stored in the server associated with the user's account may be provided to the message recipient.

An electronic device and a method of operating the same according to an embodiment of the present disclosure can display content (e.g., letters, shapes, characters, avatars, emoticons, and emojis) by applying the user's skin color. In addition, the user's biometric characteristics (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) are applied to create content (e.g., text, shape, character). , avatars, emoticons, and emojis) can be displayed.

An electronic device and a method of operating the same according to an embodiment of the present disclosure display content (e.g., letters, shapes, characters, avatars, emoticons, and emojis) by applying the skin color of another user (e.g., a message recipient). You can send messages to other users (e.g. message recipients). Additionally, the biometric characteristics of other users (e.g., message recipients) (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) are applied to the content ( For example, text, shapes, characters, avatars, emoticons, and emojis) can be displayed and messages can be sent to other users (e.g. message recipients).

In a recording medium storing instructions readable by a processor of an electronic device, the instructions, when executed by the processor, may cause the electronic device to sense a user's skin color using an optical sensor. The instructions, when executed by the processor, may cause the electronic device to identify the user's skin color based on the user's skin color sensing data from the optical sensor. The instructions, when executed by the processor, may cause the electronic device to store the user's skin color information on a server associated with the user's account. When executed by the processor, the instructions may cause the electronic device to change the color of the content of the application and display it to correspond to the skin color of the user. The instructions, when executed by the processor, may cause the electronic device to provide the user's skin color information stored on a server associated with the user's account to a message recipient.

The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components.

1 is a block diagram of an electronic device in a network environment according to an embodiment of the present disclosure.

FIG. 2 is a diagram illustrating a method for identifying (eg, determining) a user's skin color in an electronic device including an optical sensor (eg, PPG sensor).

FIG. 3 is a diagram illustrating a method of identifying (e.g., determining) a user's skin color and applying the user's skin color at the time of first setting up an electronic device.

4 to 6 are diagrams showing a method of applying a user's skin color in an application running on an electronic device.

FIG. 7 is a diagram illustrating a method of identifying (e.g., determining) a user's skin color and applying the user's skin color during operation of the electronic device after initial setup of the electronic device.

FIG. 8 is a diagram illustrating a method of applying a user's skin color and user's biometric information when operating an electronic device.

FIG. 9 is a diagram illustrating a method of applying a user's skin color and user's biometric information in an application running on an electronic device.

FIG. 10 is a diagram illustrating a method of applying a user's skin color and user's biometric information in an application running on an electronic device.

FIG. 11 is a diagram illustrating a method of applying a user's skin color and user's biometric information in an application running on an electronic device.

FIG. 12 is a diagram illustrating a method of applying a user's skin color to content related to a person in an application running on an electronic device.

FIG. 13 is a diagram illustrating a method of storing information about the skin color of a user (e.g., the sender of a message) in a user account and sharing it with other users (e.g., the recipient of a message).

Figure 14 is a diagram showing a method of requesting disclosure of biometric information of another user (eg, message recipient).

Figure 15 is a diagram illustrating an example of applying a user's skin color and biometric characteristics to the content of an application.

Figure 16 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 17 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 18 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 19 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 20 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 21 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

Figure 22 is a diagram illustrating an example of applying a user's skin color and/or biometric characteristics to the content of an application.

It should be noted that throughout the drawings, the same reference numbers are used to depict identical or similar elements, features and structures.

The following description, with reference to the accompanying drawings, is provided to facilitate a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It contains various specific details to aid understanding, but should be regarded as illustrative only. Accordingly, those skilled in the art will recognize that various changes and modifications may be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. Additionally, for clarity and conciseness, descriptions of well-known functions and configurations may be omitted.

The terms and words used in the following description and claims are not limited to their meanings in the literature, but are merely used by the applicant to enable a clear and consistent understanding of this document. Accordingly, it should be clear to those skilled in the art that the following description of various embodiments of the present document is provided for illustrative purposes only and not to limit the present document as defined by the appended claims and their equivalents.

The singular form should be understood to include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to a “component surface” may include reference to one or more of such surfaces.

FIG. 1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments.

Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted, or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, coprocessor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself, where artificial intelligence is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access to multiple terminals (massive machine type communications (mMTC)), or ultra-reliable and low-latency (URLLC). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to one embodiment, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band), And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second surface (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external

electronic devices

102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external

electronic devices

102, 104, or 108. For example, when the electronic device 101 must perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smart phones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. can be used A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. . According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or , or one or more other operations may be added.

According to one embodiment, the electronic device 101 shown in FIG. 1 includes a mobile phone (e.g., a smart phone), a personal computer (laptop PC), a tablet PC, a smart watch, and an augmented reality (AR) electronic device. , may include virtual reality (VR) electronic devices, audio electronic devices (e.g., wired earphones, wireless earphones), and/or wearable electronic devices.

According to one embodiment, the sensor module 176 shown in FIG. 1 may include an optical sensor (eg, a photoplethysmogram sensor (PPG sensor)) for sensing the user's skin color.

Optical sensors (e.g. PPG sensors) are widely used in mobile phones (e.g. smart phones), personal computers (laptop PCs), tablet PCs, smart watches, augmented reality (AR) electronic devices, and virtual reality (VR) electronic devices. , audio electronic devices (e.g., wired earphones, wireless earphones), and/or wearable electronic devices.

According to one embodiment, the display module 160 shown in FIG. 1 may include a bar type or plate type display (e.g., an organic light emitting diode (OLED) display). .

According to one embodiment, the display module 160 shown in FIG. 1 may include a flexible display (eg, flexible OLED display) configured to fold or unfold a screen (eg, display screen).

According to one embodiment, the display module 160 shown in FIG. 1 may include a flexible display (eg, flexible OLED display) that is slidably disposed to provide a screen (eg, display screen).

FIG. 2 is a diagram 200 illustrating a method for identifying (eg, determining) a user's skin color in an electronic device including an optical sensor (eg, PPG sensor).

Referring to FIG. 2, in operation 210, the processor (e.g., processor 120 of FIG. 1) uses an optical sensor (e.g., PPG sensor) (e.g., PPG sensor) to determine the user's skin color (e.g., skin type). : The sensor module 176 in FIG. 1 can be operated. An optical sensor (eg, PPG sensor) may operate to sense the user's skin color based on the control of the processor 120.

For example, an optical sensor (e.g., PPG sensor) may include a plurality of light sources (e.g., light emitting diode (LED)) that generate light of different wavelengths, and a light receiver that receives light reflected from the user's skin. there is. For example, the plurality of light sources (e.g., LEDs) may include a first LED that generates light with a wavelength of 540 nm (e.g., green light), and a second LED that generates light with a wavelength of 660 nm (e.g., red light). , a third LED that generates light with a wavelength of 880 nm (e.g., infrared light), and a fourth LED that generates light with a wavelength of 940 nm.

In operation 220, the optical sensor (e.g., PPG sensor) turns on at least two of a plurality of LEDs (e.g., the first LED, the second LED, the third LED, and the fourth LED) for a certain period of time (e.g., 0.1 to 2 seconds). By operating two LEDs, at least two lights can be irradiated to the user's skin. An optical sensor (eg, PPG sensor) may receive light reflected from the user's skin using a light receiver, calculate the absorbance of the received light, and generate an absorbance value of the light. An optical sensor (eg, PPG sensor) may provide absorbance values of light to the processor 120.

In operation 230, the processor 120 may acquire information about the user's skin color by analyzing the absorbance value of lights. For example, the processor 120 may analyze the absorbance value of light to generate a melanin index to identify (eg, determine) the user's skin color.

For example, fitzpatrick skin type classifies skin color into 6 levels for the world's population. Since the factor that has the greatest influence on a person's skin color is melanin, melanin can be indexed and displayed as a melanin index.

At operation 235, processor 120 classifies human skin color into six skin types (e.g., fitzpatrick skin type) and classifies the user's skin color (e.g., skin type) into six skin colors based on the melanin index. You can determine which skin type it corresponds to. For example, the melanin index can have values from 0 to 999, and skin color (e.g., skin type) can be classified by dividing the values from 0 to 999 into 6 levels.

For example, a melanin index value of 0 to 99.9 is classified as the first skin type, a melanin index value of 100 to 149.9 is classified as the second skin type, a melanin index value of 150 to 249.9 is classified as the third skin type, and 250 to 249.9 is classified as the third skin type. A melanin index value of ~349.9 can be classified as the fourth skin type, a melanin index value of 350~749.9 can be classified as the fifth skin type, and a melanin index value of 750~999 can be classified as the sixth skin type.

In operation 240, the processor 120 may display images 245 of skin colors matching the six skin types through a display (eg, the display module 160 of FIG. 1). The processor 120 displays skin color images 245 that match the six skin types on the display 160, and also displays skin color images 245 that match the user's skin color to indicate which of the six skin types the user's skin color corresponds to. An image with appropriate colors applied (e.g., reflected) can be displayed through the display 160.

As an example, the melanin index was divided into 6 levels and the human skin color was classified into 6 skin types to identify (e.g. determine) the user's skin color. However, it is not limited to this, and the user's skin color can be identified (e.g., determined) by dividing the melanin index into 7 to 12 levels and classifying the human skin color into 7 to 12 skin types.

FIG. 3 is a diagram 300 showing a method of identifying (e.g., determining) a user's skin color and applying the user's skin color at the time of first setting up an electronic device.

Referring to FIG. 3, the user's skin color can be determined at the time of unboxing and initial setup of an electronic device (e.g., a smart watch or wearable electronic device) (out of box experience (OOBE)). The user's skin color can be identified (e.g., determined), and the identified user's skin color can be applied to the application operation of an electronic device (e.g., a smart watch or wearable electronic device).

According to one embodiment, an electronic device (e.g., a smart watch or a wearable electronic device) includes a processor (e.g., processor 120 in FIG. 1), memory (e.g., memory 130 in FIG. 1), and a sensor module (e.g. : May include the sensor module 176 of FIG. 1). A sensor module (eg, sensor module 176 in FIG. 1) may include an optical sensor (eg, PPG sensor).

In operation 310, the processor (e.g., processor 120 of FIG. 1) of the electronic device (e.g., smart watch or wearable electronic device) performs initial boot (e.g., initial setup) of the electronic device (e.g., smart watch or wearable electronic device). ) can be executed.

In operation 320, the processor (e.g., processor 120 of FIG. 1) of the electronic device (e.g., smart watch or wearable electronic device) uses the sensor module 176 to detect that the user is using the electronic device (e.g., smart watch or wearable electronic device). It is possible to identify (e.g. determine) whether a device is worn.

If, as a result of the identification (e.g., determination) of operation 320, the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device) (NO), then in operation 330 the processor 120 determines that the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device). When first booting (e.g., initial setup) of a wearable electronic device, the user's skin color is not identified (e.g., determined).

In operation 340, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) operates the optical sensor (e.g., PPG sensor) when an application that operates the optical sensor (e.g., PPG sensor) is executed. Absorbance values can be generated. For example, when a user runs an exercise application and the optical sensor (e.g., PPG sensor) operates, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) operates the optical sensor (e.g., PPG sensor). By operating , the absorbance value of the light can be generated. The processor 120 may obtain information about the user's skin color (eg, melanin index) according to the absorbance value of the light. The processor 120 may determine the user's skin color based on information about the user's skin color (eg, melanin index). For example, the processor 120 may determine which of the six skin types shown in FIG. 2 the user's skin color corresponds to.

As a result of the identification (e.g., determination) of operation 320, if the user is wearing an electronic device (e.g., a smart watch or wearable electronic device) (YES), then in operation 350, the processor 120 detects an optical sensor (e.g., a PPG sensor). By operating, the absorbance value of light can be generated. The processor 120 may generate absorbance values of light by operating an optical sensor (eg, PPG sensor). The processor 120 may identify (eg, determine) the user's skin color based on the melanin index according to the absorbance value of light.

In operation 360, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) displays an image (or images) matching the determined skin color of the user on the display (e.g., the display module 160 of FIG. 1). It can be displayed. The processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) displays an image (or images) to which a color matching (or similar to the user's skin color) is applied (e.g., the display of FIG. 1). By displaying it in the module 160), the user can check whether his/her skin color has been accurately (or similarly) identified (e.g., determined). The processor 120 of the electronic device (e.g., smart watch or wearable electronic device) allows the user to confirm that his or her skin color has been accurately determined and to confirm (YES) whether to apply the identified (e.g., determined) skin color. A user interface can be displayed on a display (eg, the display module 160 in FIG. 1). For example, the processor 120 may display a selection menu for checking whether the determined skin color is the same (or similar) to the user's skin color on a display (e.g., the display module 160 in FIG. 1) through the user interface. can do. For example, the user may select whether to confirm whether the determined skin color is the same (or similar) to the user's skin color through a user interface displayed on a display (eg, the display module 160 of FIG. 1). If the determined skin color is selected to be the same (or similar) to the user's skin color, the processor 120 may allow the determined skin color to be applied to the operation of the electronic device (eg, smart watch, smart phone). Meanwhile, if the determined skin color is selected as not the same as (or similar to) the user's skin color, the processor 120 may re-perform the identification (e.g., determination) operation of the user's skin color.

In operation 370, if the determined skin color is selected to be the same (or similar) to the user's skin color, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) applies the determined skin color as the user's skin color. You can. When the determined skin color is applied as the user's skin color, when executing an application on an electronic device (e.g., a smart watch or wearable electronic device), the processor 120 selects a color that matches the user's skin color (or is similar to the user's skin color). The applied image (or images) may be displayed on a display (eg, the display module 160 of FIG. 1). For example, an image (or images) to which the user's skin color is applied may include at least one of letters, shapes, characters, avatars, emoticons, and emojis.

In operation 380, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may operate a communication module (e.g., the communication module 190 of FIG. 1) when executing a wearable application. The processor 120 operates the communication module 190 to connect an electronic device (eg, a smart watch or a wearable electronic device) and an external electronic device (eg, a smart phone or tablet PC) wired or wirelessly.

In operation 390, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) stores skin color information of the user identified (e.g., determined) in the electronic device (e.g., smart watch or wearable electronic device) into an external electronic device. It can be provided to a device (e.g. a smart phone or tablet PC). The processor of an external electronic device (eg, a smart phone or tablet PC) may apply the user's skin color information provided from the electronic device (eg, a smart watch or a wearable electronic device) to the execution of the application. When running an application, an external electronic device (e.g., a smart phone or tablet PC) displays an image (or images) with a color that matches (or is similar to the user's skin color) applied (e.g., Figure 1 It can be displayed on the display module 160).

At least some of the operations shown in FIG. 3 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 3.

According to one embodiment, the operations shown in FIG. 3 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 3. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 3 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 3 when executed. You can save instructions.

3 and 4, according to one embodiment, when a user requests execution of the health measurement application 410, the processor (e.g., the processor of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) (120)) may execute the health measurement application 410. When the health measurement application 410 is executed and the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) measures the user's health status, the processor 120 matches the user's skin color (or is similar to the user's skin color). The color-applied image 415 may be displayed on a display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of the health measurement application 410, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the health measurement application. (410) can be executed. When the health measurement application 410 is executed to measure the user's health status, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) matches the user's skin color (or is similar to the user's skin color). ) The color-applied image 415 can be displayed on a display (e.g., the display module 160 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC).

According to one embodiment, when a user requests execution of the health sleep application 420, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) executes the health sleep application 420. You can. When the health sleep application 420 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) generates an image 425 with a color that matches the user's skin color (or is similar to the user's skin color). It can be displayed on a display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of the health sleep application 420, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) executes the health sleep application 420. It can be run. When the health sleep application 420 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) generates an image 425 with a color matching the user's skin color (or similar to the user's skin color). can be displayed on the display (e.g., the display module 160 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC).

According to one embodiment, when a user requests execution of a hearable application 430, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may execute the hearable application 430. there is. When the hearable application 430 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) generates an image 435 with a color that matches (or is similar to the user's skin color) applied. It can be displayed on a display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of a hearable application 430, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) executes the hearable application 430. You can. When the hearable application 430 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) generates an image 435 with a color that matches (or is similar to the user's skin color) applied. can be displayed on the display (e.g., the display module 160 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC).

Referring to FIGS. 3 and 5 , according to one embodiment, when a user requests execution of a messenger (or message) application 440, the processor (e.g., FIG. Processor 120 of 1) can execute the messenger application 440. When the messenger application 440 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) displays emoticons (e.g., keyboard) with a color that matches (or is similar to the user's skin color) applied to the user's skin color. My emoticons) can be displayed on the display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of the messenger application 440, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the messenger (or message). ) The application 440 can be executed. When the messenger application 440 is executed, the processor 120 of the external electronic device (e.g., a smart phone or tablet PC) generates emoticons with a color that matches (or is similar to the user's skin color) applied (e.g., Emoticons in the keyboard) can be displayed on the display (e.g., the display module 160 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC).

Referring to FIGS. 3 and 6 , according to one embodiment, when a user requests execution of an augmented reality (AR) application 450, the processor (e.g., FIG. Processor 120 of 1) can execute the AR application 450. When the AR application 450 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) generates an AR emoji 455 with a color that matches (or is similar to the user's skin color) the user's skin color. can be displayed on the display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of the AR application 450, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the AR application 450. ) can be executed. When the AR application 450 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) generates an AR emoji 455 with a color matching the user's skin color (or similar to the user's skin color). ) can be displayed on the display (e.g., the display module 160 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC).

At least some of the operations shown in FIGS. 4 to 6 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIGS. 4 to 6.

According to one embodiment, the operations shown in FIGS. 4, 5, or 6 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device). . For example, the memory (e.g., memory 130 of FIG. 1 ) of an electronic device (e.g., a smart watch or wearable electronic device) may, when executed, be configured by the processor 120 in FIG. 4 , FIG. 5 , or FIG. 6 . Instructions for performing at least some of the illustrated operations may be stored.

According to one embodiment, the operations shown in Figures 4, 5, or 6 may be performed by a processor (eg, processor 120 of Figure 1) of an electronic device (eg, a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) may, when executed, process the processor 120 as shown in FIG. 4, 5, or 6. Instructions for performing at least some operations may be stored.

FIG. 7 is a diagram 700 showing a method of identifying (e.g., determining) a user's skin color and applying the user's skin color during operation of the electronic device after initial setup of the electronic device.

Referring to FIG. 7, after the initial setup of the electronic device (e.g., smart watch or wearable electronic device) is completed, the user's skin color is identified (e.g., determined) during operation of the electronic device (e.g., smart watch or wearable electronic device). can do. The user's skin color can be identified (e.g., determined), and the identified user's skin color can be applied to the application operation of an electronic device (e.g., a smart watch or wearable electronic device).

In operation 710, the first boot (e.g., initial setup) of the electronic device (e.g., smart watch or wearable electronic device) may be performed.

In operation 720, the processor (e.g., processor 120 of FIG. 1) uses the sensor module 176 to identify (e.g., determine) whether the user is wearing an electronic device (e.g., a smart watch or a wearable electronic device). there is.

If, as a result of the identification (e.g., determination) of operation 720, the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device) (NO), then in operation 730 the processor 120 determines that the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device). When first booting (e.g., initial setup) of a wearable electronic device, the user's skin color is not identified (e.g., determined).

In operation 740, the processor 120 may cause a basic color (eg, default color) to be applied when the application is executed.

For example, when executing an application of an electronic device (e.g., a smart watch or wearable electronic device), the processor 120 displays an image (or images) to which a basic color (e.g., default color) is applied (e.g., FIG. 1 It can be displayed on the display module 160).

For example, the processor 120 may cause images to which the same basic color (eg, default color) is applied to each application screen to be displayed on a display (eg, the display module 160 of FIG. 1).

For example, the processor 120 may display images with different basic colors (eg, default colors) applied to each application screen.

For example, an image (or images) displayed on a display may include at least one of letters, shapes, characters, avatars, emoticons, and emojis.

In operation 750, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) operates the optical sensor (e.g., PPG sensor) when an application that operates the optical sensor (e.g., PPG sensor) is executed. Absorbance values can be generated. For example, when a user runs an exercise application and the optical sensor (e.g., PPG sensor) operates, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) operates the optical sensor (e.g., PPG sensor). By operating , the absorbance value of the light can be generated.

In operation 760, the processor 120 may identify (eg, determine) the user's skin color based on the melanin index according to the absorbance value of the light.

Again, returning to operation 720, if the user is wearing an electronic device (e.g., a smart watch or a wearable electronic device) (YES), in operation 760, the processor 120 determines the user's skin condition based on the melanin index according to the absorbance value of the light. Skin color can be identified (e.g., determined).

For example, the processor 120 may determine which of a plurality of preset skin types (eg, six skin types shown in FIG. 2) the user's skin color corresponds to.

In operation 770, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) displays an image (or images) matching the determined skin color of the user on the display (e.g., the display module 160 of FIG. 1). It can be displayed. For example, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may display (e.g., an image (or images) to which a color matching (or similar to) the user's skin color is applied. It can be displayed on the display module 160 of FIG. 1. For example, the processor 120 may display a selection menu for checking whether the determined skin color is the same (or similar) to the user's skin color on a display (e.g., the display module 160 in FIG. 1) through the user interface. can do. An image (or images) with a color that matches the user's skin color (or is similar to the user's skin color) is displayed on the display, allowing the user to check whether his or her skin color has been accurately (or similarly) determined. The processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) displays a display (e.g., a figure) so that the user can confirm that his/her skin color has been accurately determined and confirm (YES) whether to apply the determined skin color. The user interface can be displayed on the display module 160 of 1. The user can apply the determined skin color to the operation of the electronic device (e.g., smart watch, smart phone) through the user interface displayed on the display (e.g., display module 160 of FIG. 1).

In operation 780, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) may apply the identified (e.g., determined) skin color as the user's skin color. When executing an application on an electronic device (e.g., a smart watch or wearable electronic device), the processor 120 displays an image (or images) with a color matching (or similar to the user's skin color) applied to the user's skin color (e.g. : Can be displayed on the display module 160 of FIG. 1.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) creates an image (or images) with a color that matches the user's skin color (or is similar to the user's skin color) for each screen of the application. It can be displayed on a display (e.g., the display module 160 in FIG. 1).

For example, an image (or images) displayed on a display with a color matching the user's skin color (or similar to the user's skin color) includes at least one of letters, shapes, characters, avatars, emoticons, and emojis. It can be included.

At least some of the operations shown in FIG. 7 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 7 .

According to one embodiment, the operations shown in FIG. 7 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, when the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) is executed, the processor 120 performs at least some of the operations shown in FIG. 7. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 7 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 7 when executed. You can save instructions.

FIG. 8 is a diagram 800 showing a method of applying the user's skin color and user's biometric information when operating an electronic device.

Referring to FIG. 8, at the time of first setting up an electronic device (e.g., a smart watch or wearable electronic device), the user's skin color is identified (e.g., determined), and the determined user's skin color is stored in the electronic device (e.g., a smart watch or wearable electronic device). It can be applied to the application operation of wearable electronic devices. In addition, the user's skin color as well as the user's biometric information (information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) are collected by electronic devices, e.g. It can be applied to the application operation of a smart watch or wearable electronic device.

According to one embodiment, an electronic device (e.g., a smart watch or a wearable electronic device) includes a processor (e.g., processor 120 in FIG. 1), a memory (e.g., memory in FIG. 1), and a sensor module (e.g., FIG. 1 sensor module 176). A sensor module (eg, sensor module 176 in FIG. 1) may include an optical sensor (eg, PPG sensor).

In operation 810, the processor (e.g., processor 120 of FIG. 1) of the electronic device (e.g., smart watch or wearable electronic device) performs initial boot (e.g., initial setup) of the electronic device (e.g., smart watch or wearable electronic device). ) can be executed.

In operation 820, the processor (e.g., processor 120 of FIG. 1) of the electronic device (e.g., a smart watch or wearable electronic device) uses the sensor module 176 to detect that the user is using the electronic device (e.g., a smart watch or wearable electronic device). It is possible to identify (e.g. determine) whether a device is worn.

As a result of the identification (e.g., determination) of operation 820, if the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device) (NO), processor 120 determines that the user is not wearing an electronic device (e.g., a smart watch or wearable electronic device). ) may branch to operation 810 without identifying (e.g., determining) the user's skin color.

As a result of the identification (e.g., determination) of operation 820, if the user is wearing an electronic device (e.g., a smart watch or wearable electronic device) (YES), then in operation 830, the processor 120 detects an optical sensor (e.g., a PPG sensor). By operating, the absorbance value of light can be generated. The processor 120 may generate absorbance values of light by operating an optical sensor (eg, PPG sensor). The processor 120 may identify (eg, determine) the user's skin color based on the melanin index according to the absorbance value of light.

In operation 840, it may be determined whether the user's biometric information exists (eg, presence or absence of biometric information). For example, the user's biometric information may include information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape. For example, the user's biometric information may be stored in the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the user's biometric information may be stored in an external electronic device (eg, a smart phone or tablet PC) or a server associated with the external user's account (eg, the server 108 in FIG. 1). For example, the user's biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) is stored on Samsung Health's servers. information) can be stored.

If, as a result of the determination in operation 840, the user's biometric information does not exist, in operation 850, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may apply the determined skin color as the user's skin color. . The processor 120 of the electronic device (e.g., smart watch or wearable electronic device) applies the determined skin color as the user's skin color, and when executing the application of the electronic device (e.g., smart watch or wearable electronic device), the user's skin color is used. An image (or images) to which a color matching (or similar to the user's skin color) is applied may be displayed on a display (eg, the display module 160 of FIG. 1).

If, as a result of the determination in operation 840, the user's biometric information exists, in operation 860, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may obtain (e.g., verify) the user's biometric information. there is. The processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may store the user's biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, and weight). , and information about body type) can be applied to the execution of the application. For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may store the user's biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color). and information about shape, weight, and body type) and biometric characteristics that match (or are similar to) biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, An image (or images) to which weight and body shape) are applied can be displayed on a display (eg, the display module 160 of FIG. 1). This allows the user to accurately (or similarly, information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape). ) You can check whether it has been applied. The processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) allows the user to record his or her biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape). , weight, and body type) can be confirmed to be applied accurately. The processor 120 determines whether to apply the user's biometric information (e.g., information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) ( The user interface can be displayed on a display (e.g., the display module 160 in FIG. 1) so that YES) can be displayed. The user may display the user's biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and Information about shape, weight, and body type) can be applied to the operation (e.g., execution of an application) of an electronic device (e.g., smart watch, smart phone).

In operation 870, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) processes the determined skin color and the user's biometric information (e.g., the user's gender, age, height, eye color and shape, hair color and Information about shape, lip color and shape, weight, and body type) can be applied to the execution of the application. When running an application on an electronic device (e.g., a smart watch or wearable electronic device), a color that matches (or is similar to the user's skin color) and the user's biometric information (e.g., the user's gender, age, height, and eyes) are displayed. information about the user's color and shape, hair color and shape, lip color and shape, weight, and body shape) and biometric characteristics that match (or are similar to the user's biometric information) (e.g., the user's gender, age, height, and eye information) An image (or images) to which color and shape, hair color and shape, lip color and shape, weight, and body shape) are applied can be displayed on a display (eg, the display module 160 of FIG. 1).

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may apply the user's skin color to the image (or images) and apply the user's biometric characteristics (e.g., the user's gender, age, Height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the image (or images). The processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may store the user's skin color and biometric characteristics (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape). , weight, and body type) can be displayed on a display (eg, the display module 160 of FIG. 1).

For example, an image (or images) to which the user's skin color and the user's biometric information are applied may include at least one of letters, shapes, characters, avatars, emoticons, and emojis.

In operation 880, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) allows the electronic device (e.g., a smart watch or wearable electronic device) and an external electronic device (e.g., a smart phone or tablet PC) to communicate. You can determine whether a connection is possible.

For example, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may operate a communication module (e.g., the communication module 190 of FIG. 1) when executing a wearable application. The processor 120 operates the communication module 190 to connect an electronic device (eg, a smart watch or a wearable electronic device) and an external electronic device (eg, a smart phone or tablet PC) wired or wirelessly.

As a result of the determination in operation 880, if the electronic device (e.g., smart watch or wearable electronic device) and an external electronic device (e.g., smart phone or tablet PC) can be connected through communication, the operations shown in FIG. 9 can be performed. .

According to one embodiment, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) processes the user's skin color information and biometric information (e.g., the user) determined by the electronic device (e.g., a smart watch or wearable electronic device). gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be provided to an external electronic device (e.g., a smartphone or tablet PC). The processor of an external electronic device (e.g., a smart phone or tablet PC) collects the user's skin color information and biometric information (e.g., the user's gender, age, height, and pupils) provided by the electronic device (e.g., a smart watch or wearable electronic device). color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the execution of the application. When running an application, an external electronic device (e.g. a smart phone or tablet PC) displays the applied user's skin color and biometric information (e.g. the user's gender, age, height, eye color and shape, hair color and shape, lip color). An image (or images) to which shape, weight, and body type) are applied can be displayed on a display (eg, the display module 160 of FIG. 1).

At least some of the operations shown in FIG. 8 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 8.

According to one embodiment, the operations shown in FIG. 8 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, when the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) is executed, the processor 120 performs at least some of the operations shown in FIG. 8. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 8 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 8. You can save instructions.

FIG. 9 is a diagram 900 showing a method of applying a user's skin color and user's biometric information in an application running on an electronic device.

Referring to FIGS. 8 and 9 , according to one embodiment, when a user requests execution of the health measurement application 910, the processor (e.g., the processor of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) (120)) may execute the health measurement application 910. When the health measurement application 910 is executed and the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) measures the user's health status, the processor 120 matches the user's skin color (or is similar to the user's skin color). An image 915 with biometric characteristics based on color and user's biometric information (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) is applied to the electronic device. It can be displayed on a display (e.g., the display module 160 of FIG. 1) of a device (e.g., a smart watch or wearable electronic device).

According to one embodiment, when a user requests execution of the health measurement application 910, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the health measurement application. (910) can be executed. When the health measurement application 910 is executed to measure the user's health status, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) matches the user's skin color (or is similar to the user's skin color). ) An image 915 with color and biometric characteristics based on the user's biometric information (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) is applied. It can be displayed on a display (e.g., the display module 160 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device).

According to one embodiment, when a user requests execution of the health sleep application 920, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) executes the health sleep application 920. You can. When the health sleep application 920 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) selects a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information (e.g. : An image 925 with biometric characteristics applied according to the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type is displayed on an electronic device (e.g., smart watch or wearable) It can be displayed on the display of an electronic device (e.g., the display module 160 of FIG. 1).

According to one embodiment, when a user requests execution of the health sleep application 920, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) executes the health sleep application 920. It can be run. When the health sleep application 920 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) displays a color matching the user's skin color (or similar to the user's skin color) and the user's biometric information ( Example: An image 925 with biometric characteristics based on the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type is applied to an external electronic device (e.g., smart device). It can be displayed on a display (e.g., the display module 160 of FIG. 1) of a phone or tablet PC.

According to one embodiment, when a user requests execution of a hearable application 930, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may execute the hearable application 930. there is. When the hearable application 930 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) selects a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information (e.g. : An image 935 with biometric characteristics applied according to the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type is displayed on an electronic device (e.g., smart watch or wearable) It can be displayed on the display of an electronic device (e.g., the display module 160 of FIG. 1).

According to one embodiment, when a user requests execution of a hearable application 430, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) executes the hearable application 930. You can. When the hearable application 930 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) displays a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information ( Example: An image 935 with biometric characteristics based on the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type is applied to an external electronic device (e.g., smart device). It can be displayed on a display (e.g., the display module 160 of FIG. 1) of a phone or tablet PC.

At least some of the operations shown in FIG. 9 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 9 .

According to one embodiment, the operations shown in FIG. 9 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, when the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) is executed, the processor 120 performs at least some of the operations shown in FIG. 9. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 9 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 9 when executed. You can save instructions.

8 and 10, according to one embodiment, when a user requests execution of the messenger application 940, the processor (e.g., the processor of FIG. 1) of the electronic device (e.g., a smart watch or wearable electronic device) 120)) can run the messenger application 940. When the messenger application 940 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) stores a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information (e.g., Emoticons (e.g. emoticons in the keyboard) with biometric characteristics based on the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type are applied to electronic devices (e.g. : It can be displayed on the display of a smart watch or wearable electronic device (e.g., the display module 160 in FIG. 1).

According to one embodiment, when a user requests execution of the messenger application 940, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the messenger application 940. ) can be executed. When the messenger application 940 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) displays a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information (e.g. : Emoticons (e.g. emoticons in the keyboard) with biometric characteristics (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) applied to external electronic devices It can be displayed on a display (e.g., display module 160 of FIG. 1) of a device (e.g., a smart phone or tablet PC).

At least some of the operations shown in FIG. 10 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 10 .

According to one embodiment, the operations shown in FIG. 10 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 10. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 10 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 10. You can save instructions.

Referring to FIGS. 8 and 11 , according to one embodiment, when a user requests execution of an augmented reality (AR) application 950, the processor (e.g., FIG. Processor 120 of 1) can execute the AR application 950. When the AR application 950 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) selects a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information 1110. An AR emoji 955 with biometric characteristics applied according to the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type is displayed on an electronic device, e.g. It can be displayed on the display (e.g., the display module 160 of FIG. 1) of a smart watch or wearable electronic device.

According to one embodiment, when a user requests execution of the AR application 950, the processor (e.g., processor 120 of FIG. 1) of an external electronic device (e.g., a smart phone or tablet PC) executes the AR application 950. ) can be executed. When the AR application 950 is executed, the processor 120 of an external electronic device (e.g., a smart phone or tablet PC) displays a color that matches the user's skin color (or is similar to the user's skin color) and the user's biometric information (1110). ) (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) applied to the AR emoji (955) on an external electronic device. It can be displayed on a display (e.g., the display module 160 of FIG. 1) (e.g., a smart phone or tablet PC).

At least some of the operations shown in FIG. 11 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 11 .

According to one embodiment, the operations shown in FIG. 11 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 11. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 11 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 11 when executed. You can save instructions.

FIG. 12 is a diagram 1200 showing a method of applying a user's skin color to content related to a person in an application running on an electronic device.

Referring to FIG. 12 , in operation 1210, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may operate an optical sensor (e.g., a PPG sensor) to generate an absorbance value of light. The processor 120 may identify (eg, determine) the user's skin color based on the melanin index according to the absorbance value of light. For example, the processor 120 may determine which of a plurality of preset skin types (eg, six skin types shown in FIG. 2) the user's skin color corresponds to. The processor 120 may apply the determined user's skin color when executing the application.

In operation 1220, when the user requests execution of the messenger application, the processor 120 of the electronic device (eg, smart watch or wearable electronic device) may execute the messenger application. The processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may display a keyboard emoticon page on a display (e.g., the display module 160 of FIG. 1) when executing a messenger application.

In operation 1230, the processor 120 of the electronic device (eg, a smart watch or wearable electronic device) may apply the user's skin color to display the colors of the contents (eg, emoticons) of the keyboard emoticon page. For example, processor 120 may change the color of content (eg, emoticons) to match (or be similar to) the user's skin color. The processor 120 may display content (e.g., emoticons) whose color has been changed to match (or be similar to) the user's skin color on a display (e.g., the display module 160 of FIG. 1).

In operation 1240, when a user (e.g., a message sender) wants to send a message to another user (e.g., a message recipient) by executing a message application, the processor 120 of the electronic device (e.g., a smart watch or a wearable electronic device) can check whether you (e.g. message sender) and other users (e.g. message recipient) are using your user account (e.g. Samsung account).

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may send a message to a user (e.g., a message sender) if the user (e.g., a message sender) wishes to send a message to another user (e.g., a message recipient). You can check whether the message sender) is using a user account (e.g. Samsung account). Additionally, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may send a message to another user (e.g., a message recipient) when a user (e.g., a message sender) wishes to send a message to another user (e.g., a message recipient). You can check whether the recipient (recipient) is using a user account (e.g. Samsung account). For example, a user (e.g., message sender) may provide (or disclose) information about his or her skin color to another user (e.g., message recipient) through his or her user account (e.g., Samsung account). For example, another user (e.g., a message recipient) provides (e.g., discloses) information about his or her (e.g., message recipient) skin color to a user who sends a message through his or her user account (e.g., a Samsung account). can do.

In operation 1250, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) (e.g., the processor of the electronic device of the user that sent the message) causes another user (e.g., the message recipient) to send the message to itself (e.g. It is possible to determine whether to disclose the skin color information of the message recipient.

As a result of the determination in operation 1250, if the other user (e.g., the message recipient) does not disclose the skin color information of the user (e.g., the message recipient) (NO), the processor 120 determines the skin color of the other user (e.g., the message recipient). Identification (e.g., discrimination) may not be possible (1260). In this case, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) matches the user's skin color (e.g., the skin color of the sender of the message) or the primary color (e.g., the default color) to the content of the application (e.g., people and It can be applied to related content).

For example, if the skin color information of the other user (e.g., the message recipient) is not obtained (or confirmed), the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may detect the other user (e.g., the message recipient). ), you can apply a color that matches (or is similar to the user's skin color) the skin color of the user (e.g., the sender of the message) to the content related to the person. The processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may transmit a message containing colored content that matches (or is similar to the skin color of) the skin color of the user (e.g., the sender of the message) to another user (e.g., sender of the message). (e.g. message recipient) may be transmitted (e.g. to another user's electronic device).

For example, if the skin color information of another user (e.g., the message recipient) is not obtained (or confirmed), the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may transmit the message to the other user. , basic colors (e.g. default colors) can be applied to content related to people. The processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) allows a message containing content with a primary color (e.g., a default color) to be sent to another user (e.g., a message recipient) (e.g., a message recipient). can be transmitted to an electronic device).

As a result of the determination in operation 1250, if another user (e.g., message recipient) has disclosed his/her skin color information (YES), the processor 120 obtains (e.g., confirms) the skin color information of the other user (e.g., message recipient). can do. In operation 1270, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) displays content (e.g., content related to the person) that matches (or is similar to the skin color of) the skin color of another user (e.g., the message recipient). (e.g. emoticons in the form of faces and/or fingers). For example, the processor 120 may cause an emoticon screen to be displayed on the display where the skin color of another user (eg, message recipient) can be selected. The processor 120 may display an emoticon screen and allow a user (eg, message sender) to apply the skin color of another user (eg, message recipient) to the emoticon.

For example, the processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may cause contents (eg, emoticons) of a keyboard emoticon page to be displayed on the display 160. The processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) determines that when a user (e.g., the sender of a message) presses an emoticon for a certain period of time, it matches the skin color of another user (e.g., the message recipient) (or the user's skin color). Colors (similar to skin color) can be applied to human-related content (e.g., face and/or finger emoticons).

For example, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may display a screen for selecting the skin color of another user (e.g., a message recipient). The processor 120 of the electronic device (e.g., a smart watch or a wearable electronic device) displays an emoticon in the form of a face in the skin color of another user (e.g., the message recipient) on a screen for selecting the skin color of another user (e.g., the message recipient). It can be done as much as possible. When a user (e.g., the message sender) presses an emoticon in the form of a face with the skin color of another user (e.g., the message recipient) for a certain period of time, the emoticon that matches the skin color of another user (e.g., the message recipient) (or is similar to the user's skin color) ) Colors can be applied to content related to people.

For example, if a color change is requested for one of the person-related content, processor 120 may change all of the person-related content to a color that matches (or is similar to the skin color of) another user (e.g., message recipient). ) Color can be applied.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may be configured to include colored content that matches (or is similar to) the skin color of another user (e.g., the message recipient). A message may be transmitted (e.g., to another user's electronic device) to another user (e.g., the message recipient).

At least some of the operations shown in FIG. 12 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 12 .

According to one embodiment, the operations shown in FIG. 12 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 12. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 12 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 12 when executed. You can save instructions.

FIG. 13 is a diagram 1300 showing a method of storing information about the skin color of a user (eg, the sender of a message) in a user account and sharing it with other users (eg, the recipient of a message).

Referring to FIG. 13 , in operation 1310, when a user requests execution of a messenger application, the processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may execute the messenger application. The processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may enter the keyboard emoticon page when running a messenger application. When running a messenger application, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) displays the contents (e.g., emoticons) of the keyboard emoticon page on the display (e.g., the display module 160 of FIG. 1). It can be displayed. The processor 120 may perform operation 1360 after operation 1310.

In operation 1320, the processor 120 of the electronic device (eg, smart watch or wearable electronic device) may link a contact and a user account (eg, Samsung account). For example, a contact may include information about a phone number, e-mail address, home address, work address, and/or group classification.

In operation 1330, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) may operate an optical sensor (e.g., PPG sensor) to generate an absorbance value of light. The processor 120 may identify (eg, determine) the user's skin color based on the melanin index according to the absorbance value of light. For example, the processor 120 may determine which of a plurality of preset skin types (eg, six skin types shown in FIG. 2) the user's skin color corresponds to. For example, the processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may apply the determined skin color of the user to the execution of an application.

In operation 1340, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) records (e.g., uploads,) the user's skin color information to the user's (e.g., message sender) user account (e.g., Samsung account). Save) can be done. For example, the processor 120 may store (e.g., upload, record) the skin color information of the user (e.g., the message sender) in a server (e.g., the server's memory) associated with the user's account.

In operation 1350, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) may execute a sharing menu (e.g., sharing with galaxy user menu) of the user (e.g., message sender) account. The processor 120 may set sharing (e.g., provision) of skin color information (e.g., skin type) of the user (e.g., message sender) using the sharing (e.g., provision) menu of the user account. For example, if sharing of skin color information (e.g. skin type) of a user (e.g. message sender) is set in the sharing (e.g. provision) menu of the user account, other users (e.g. message recipient, users saved in contacts) ) may be shared (e.g., provided) with the skin color information (e.g., skin type) of the user (e.g., message sender). For example, when a user (e.g., message sender) sends a group message to a plurality of other users (e.g., message recipients), the processor 120 stores skin color information of the user (e.g., message sender) in a plurality of groups. It can be shared (e.g. provided) to other users (e.g. message recipients).

In operation 1360, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may check whether user accounts are shared between a user (e.g., a message sender) and another user (e.g., a message recipient). there is.

If the user account is shared with another user (e.g., the message recipient), in operation 1370, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) collects the skin color information of the other user (e.g., the message recipient). You can determine whether sharing (e.g. provision) of (e.g. skin type) is set.

As a result of the determination in operation 1370, if the skin color information (e.g., skin type) of another user (e.g., message recipient) is not shared (e.g., provided), the processor 120 determines the skin color information (e.g., skin type) of the other user (e.g., message recipient). Identification (e.g. discrimination) may not be possible (1380). In this case, the processor 120 of the electronic device (eg, smart watch or wearable electronic device) may perform the operations of FIG. 14 .

As a result of the determination in operation 1370, if the skin color information (e.g., skin type) of another user (e.g., message recipient) is shared (e.g., provided), in operation 1390, the electronic device (e.g., smart watch or wearable electronic device) The processor 120 may obtain (eg, confirm) skin color information of another user (eg, message recipient). Processor 120 may apply a color to human-related content that matches (or is similar to the skin color of) another user (e.g., a message recipient).

For example, the processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may cause emoticons from a keyboard emoticon page to be displayed on the display 160. Processor 120 causes a color matching the skin color of another user (e.g., the message recipient) (or similar to the skin color of another user) to be applied to content related to the person when the user (e.g., the message sender) presses the emoticon for a certain period of time. can do.

For example, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may display a screen for selecting the skin color of another user (e.g., a message recipient). The processor 120 of the electronic device (e.g., a smart watch or a wearable electronic device) displays an emoticon in the form of a face in the skin color of another user (e.g., the message recipient) on a screen for selecting the skin color of another user (e.g., the message recipient). It can be done as much as possible. When a user (e.g., message sender) presses an emoticon in the form of a face to which another user (e.g., message recipient)'s skin color is applied for a certain period of time, the processor 120 selects an emoticon that matches the skin color of another user (e.g., message recipient) (or Colors (similar to other users' skin colors) can be applied to content related to people.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may include colored content that matches (or is similar to) the skin color of another user (e.g., the message recipient). A message can be sent (e.g., to another user's electronic device) to another user (e.g., a message recipient).

According to one embodiment, if a user account is shared (e.g., provided) between a user (e.g., a message sender) and another user (e.g., a message recipient), an electronic device (e.g., a smart watch or wearable electronic device) Processor 120 may collect biometric information of other users (e.g., message recipients) (e.g., other users' gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape). information) can be obtained (e.g. confirmed).

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may determine that a color that matches (or is similar to the skin color of another user) the skin color of another user (e.g., a message recipient) is human-related content. It can be applied to . Additionally, the processor 120 may collect biometric information of other users (e.g., message recipients) (e.g., user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape). Biometric characteristics that match (or are similar to other users' biometric information) can be applied to content related to people.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may display a color that matches (or is similar to the skin color of another user) the skin color of another user (e.g., a message recipient) and : Matches the message recipient's biometric information (e.g., information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) (or that of another user). A message containing content to which biometric characteristics (similar to biometric information) are applied can be sent (e.g., to another user's electronic device) to another user (e.g., a message recipient).

At least some of the operations shown in FIG. 13 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 13.

According to one embodiment, the operations shown in FIG. 13 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 13. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 13 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC) causes the processor 120 to perform at least some of the operations shown in FIG. 13 when executed. You can save instructions.

FIG. 14 is a diagram 1400 showing a method of requesting disclosure of biometric information of another user (eg, message recipient).

Referring to FIG. 14, according to one embodiment, when the biometric information of another user (e.g., a message recipient) is set to private, the processor 120 transmits the other user's (e.g., message recipient's) electronic device to the other user's (e.g., message recipient's) electronic device. : A request to disclose (e.g. provide) biometric information of the message recipient can be transmitted.

In operation 1410, when a user (e.g., a message sender) requests execution of a messenger application, the processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) processes the electronic device (e.g., a smart watch or a wearable electronic device). The processor 120 of a smart watch or wearable electronic device can execute a messenger application. The processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may enter the keyboard emoticon page when running a messenger application. When running a messenger application, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) displays the contents (e.g., emoticons) of the keyboard emoticon page on the display (e.g., the display module 160 of FIG. 1). It can be displayed.

In operation 1420, the processor 120 of the electronic device (eg, smart watch or wearable electronic device) may link a contact and a user account (eg, Samsung account). The processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) stores the skin color information of the user (e.g., the message sender) in the user's (e.g., message sender) user account (e.g., Samsung account) (e.g., upload, record). For example, the processor 120 may store (e.g., upload, record) the skin color information of the user (e.g., the message sender) in a server (e.g., the server's memory) associated with the user's account.

According to one embodiment, the processor 120 of an electronic device (eg, a smart watch or a wearable electronic device) may execute a user account sharing menu (eg, sharing with galaxy user menu). The processor 120 may set up sharing (eg, provision) of the user's skin color information (eg, skin type) using the sharing menu of the user account. For example, if sharing (e.g., providing) the user's skin color information (e.g., skin type) is set in the sharing menu of the user account, the skin color information of the user (e.g., the message sender) is shared with other users (e.g., the message recipient). (e.g. skin type) can be shared.

In operation 1430, the processor 120 of the electronic device (e.g., smart watch or wearable electronic device) may determine whether user accounts are shared between the user (e.g., message sender) and another user (e.g., message recipient). .

If, as a result of the determination in operation 1430, the user account is shared with another user (e.g., a message recipient), in operation 1435, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) determines that the other user (e.g., a message recipient) Skin color information (e.g. skin type) of the message recipient can be obtained (e.g. confirmed). Without limitation, if a user account is shared (e.g., provided) with another user (e.g., a message recipient), the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) may be able to access the other user (e.g., a message recipient). Message recipient)'s biometric information (e.g., information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) can be obtained (e.g., verified). there is. The processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may determine the skin color of another user (e.g., a message recipient) and/or biometric information of another user (e.g., a message recipient) (e.g., the user's gender, age). , height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) can be applied to content related to people. The processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may determine the skin color of another user (e.g., a message recipient) and/or biometric information of another user (e.g., a message recipient) (e.g., the user's gender, age). , messages containing content with biometric characteristics based on height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape are sent to other users (e.g. message recipients) ( For example, it can be transmitted to another user's electronic device).

As a result of operation 1430, if the user account has not been shared (e.g., provided, obtained, or confirmed) with another user (e.g., message recipient), identification (e.g., determination) of the skin color of the other user (e.g., message recipient) is not possible. It may be impossible (1440).

In operation 1450, when setting the skin color of the emoticons of the keyboard emoticon page, the processor 120 of the electronic device (e.g., a smart watch or a wearable electronic device) shares (e.g., provides, etc.) the skin color of another user (e.g., a message recipient). A pop-up requesting acquisition or confirmation can be generated.

At operation 1460, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) sends a message to another user (e.g., a message recipient) requesting that another user (e.g., a message recipient) share (e.g., provide, obtain, or confirm) information about skin color. Can be transmitted.

For example, another user's (e.g., message recipient's) electronic device (e.g., smart phone, tablet PC, smart watch, wearable electronic device)) may transmit information from a user (e.g., message sender) to another user (e.g., message recipient). You may receive a message requesting to share (e.g., provide, obtain, or confirm) skin color information (e.g., skin type).

In operation 1470, the processor (e.g., processor 120 of FIG. 1) of the electronic device of another user (e.g., the message recipient) informs the other user (e.g., the message recipient) of the other user's skin color (e.g., the other user's skin color). A pop-up can be generated for sharing (e.g., providing, obtaining, or confirming) information (skin color).

In operation 1480, a user (e.g., message sender) configures (e.g., allows) sharing of skin color information of the user (e.g., message sender) through a pop-up, and another user (e.g., message recipient) configures (e.g., permissions) the user (e.g., message sender) through a pop-up. If you have enabled (e.g., allowed) sharing of skin color of a user (e.g., message recipient), the other user's skin color information will be shared (e.g., message recipient) on both your (e.g., message sender) electronic device and the other user's (e.g., message recipient) electronic device. (e.g., provide, obtain, or verify) may be set (e.g., permitted to share, obtain, or verify).

At operation 1490, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) selects a color that matches (or is similar to the skin color of another user) the skin color of another user (e.g., a message recipient) for content associated with the person. Can be applied to.

For example, the processor 120 of an electronic device (e.g., a smart watch or a wearable electronic device) may display a screen for selecting the skin color of another user (e.g., a message recipient). The processor 120 of the electronic device (e.g., a smart watch or a wearable electronic device) displays an emoticon in the form of a face in the skin color of another user (e.g., the message recipient) on a screen for selecting the skin color of another user (e.g., the message recipient). It can be done as much as possible. If a user (e.g. the sender of a message) presses an emoticon in the form of a face with the skin color of another user (e.g. the message recipient) for a certain period of time, the emoji will match the skin color of another user (e.g. the message recipient) (or Similar) colors can be applied to content related to people.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may include colored content that matches (or is similar to) the skin color of another user (e.g., the message recipient). You can have messages sent to other users (e.g. message recipients).

According to one embodiment, if the user account is shared with another user (e.g., message recipient), biometric information of the user (e.g., message sender) and the other user (e.g., message recipient) is collected in operations 1460 and 1470. For example: You may be asked to share (e.g. provide, obtain, or verify) information about another user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type. .

For example, in operation 1480, a user (e.g., message sender) sets (e.g., allows) sharing of skin color information of the user (e.g., message sender) through a pop-up, and another user (e.g., message recipient) If you have enabled (e.g. allowed) to share your (e.g. message recipient) skin color through a pop-up, you (e.g. message sender) and other users (e.g. message recipients) biometric information (e.g. other user's gender) , age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) can be shared with each other.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may collect biometric information of another user (e.g., a message recipient) (e.g., the user's gender, age, height, eye color and shape, Biometric characteristics that match (or are similar to other users' biometric information) (information about hair color and shape, lip color and shape, weight, and body shape) can be applied to content related to people.

For example, the processor 120 of an electronic device (e.g., a smart watch or wearable electronic device) may display a color that matches (or is similar to the skin color of another user) the skin color of another user (e.g., a message recipient) and : Matches the message recipient's biometric information (e.g., information about the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape) (or that of another user). Messages containing content to which biometric characteristics (similar to biometric information) are applied can be sent to other users (e.g., message recipients).

At least some of the operations shown in FIG. 14 may be omitted. At least some operations mentioned with reference to other drawings in this document may be added and/or inserted before or after at least some of the operations shown in FIG. 14.

According to one embodiment, the operations shown in FIG. 14 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device). For example, when the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) is executed, the processor 120 performs at least some of the operations shown in FIG. 14. You can save instructions to do something.

According to one embodiment, the operations shown in FIG. 14 may be performed by a processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC). For example, the memory (e.g., memory 130 of FIG. 1) of an electronic device (e.g., a smart phone or tablet PC), when executed, causes the processor 120 to perform at least some of the operations shown in FIG. 14. You can save instructions.

FIG. 15 is a diagram 1500 showing an example of applying a user's skin color and biometric characteristics to the content of an application.

Referring to FIG. 15, according to one embodiment, the processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) processes the user's skin color and biometric characteristics (the user's gender and age). , height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the content 1510 of the application. The processor (e.g., processor 120 in FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) processes the user's skin color and biometric characteristics (the user's gender, age, height, eye color and shape, hair color and The content 1510 of the application to which the shape, lip color and shape, weight, and body shape) is applied can be displayed on a display (eg, the display module 160 of FIG. 1).

According to one embodiment, the processor (e.g., the processor 120 in FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) processes the user's skin color and biometric characteristics (the user's skin color and biometric characteristics) when executing the message application 1520. Gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the emoticons on the keyboard emoticon page. For example, a processor (e.g., processor 120 in FIG. 1) of an electronic device (e.g., a smart watch or wearable electronic device) may process the user's skin color and biometric characteristics (the user's gender, age, height, and eye color and shape). , hair color and shape, lip color and shape, weight, and body type) can be applied to content related to a person, allowing messages to be sent to other users (e.g., message recipients).

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., smart watch or wearable electronic device) processes the user's skin color and Biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the image (or images).

For example, an image (or images) to which the user's skin color and biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) are applied. , it may include at least one of a shape, a character, an avatar, an emoticon, and an emoji.

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., a smart watch or a wearable electronic device) processes the user's skin color and biometric characteristics (the user's skin color and biometric characteristics) when executing the AR application 1540. Gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to AR emoji. When the AR application 1540 is executed, the processor 120 of the electronic device (e.g., a smart watch or wearable electronic device) processes the user's skin color and biometric characteristics (the user's gender, age, height, eye color and shape, and hair color). and shape, lip color and shape, weight, and body type) can be displayed on a display (e.g., the display module 160 in FIG. 1).

Referring to FIG. 16, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example does not apply the user's skin color when executing the smart watch application 1610, but displays the image (e.g., default color) in the basic color (e.g., default color). or images) can be displayed. In addition, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example may display the user's biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape) when running the smart watch application 1610. , lip color and shape, weight, and body type) can be displayed in a basic shape (e.g., default shape).

An electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color and biometric characteristics (the user's gender, age, Height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied.

For example, an electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color, gender, and age when running the smart watch application 1620. , height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape can be applied to the content and displayed.

For example, the processor 120 may use the user's biometric characteristics (e.g., the user's gender, age, height, eye color and shape, hair color and shape) based on the user biometric information stored in the user account (e.g., Samsung account). , lip color and shape, weight, and body type) can be applied to content.

Referring to FIG. 17, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example does not apply the user's skin color when running the health application 1710, but displays the image (or images) can be displayed. In addition, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example uses the user's biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, etc.) when running the health application 1710. You can display the image (or images) in its default shape (e.g., default shape) without applying lip color and shape, weight, and body type.

An electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color and biometric characteristics (the user's gender, age, and height) when running the health application 1720. , eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied.

For example, when running the health application 1720, an electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color, user's gender, age, Height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape can be applied to the content and displayed.

Referring to FIG. 18, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example does not apply the user's skin color when executing the wearable application 1810, but displays the image (or images) can be displayed. In addition, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example may display the user's biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, etc.) when running the wearable application 1810. You can display the image (or images) in its default shape (e.g., default shape) without applying lip color and shape, weight, and body shape.

An electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure collects the user's skin color and biometric characteristics (user's gender, age, Height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied.

For example, an electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC) according to an embodiment of the present disclosure may, when running the wearable application 1820, display the user's skin color, user's gender, age, Height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape can be applied to the content and displayed.

Referring to FIG. 19, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example does not apply the user's skin color when executing the hearable application 1910, but uses the basic color (e.g., default color). You can display an image (or images) with . In addition, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example may display the user's biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape) when running the hearable application 1910. , lip color and shape, weight, and body type) can be displayed in a basic shape (e.g., default shape).

For example, an electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color, gender, and age when executing the hearable application 1920. , height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape can be applied to the content and displayed.

Referring to FIG. 20, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example does not apply the user's skin color when running the message application (2010), but displays the keyboard emoticon page with the default color (e.g., default color). Emoticons (2015) can be displayed. In addition, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example records the user's biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, etc.) when running the messaging application (2010). You can display emoticons (2015) from the Keyboard Emoticons page in their default form (e.g., default form) without applying lip color and shape, weight, and body type.

An electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC) according to an embodiment of the present disclosure may display the user's skin color and biometric characteristics (user's gender, age, height) when running the messaging application (2020). , eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the emoticons (2025) on the keyboard emoticon page.

For example, an electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may display the user's skin color, user's gender, age, etc. when running the messaging application (2020). Emoticons (2025) on the keyboard emoticon page with height, eye color and shape, hair color and shape, lip color and shape, weight, and body type can be displayed.

According to one embodiment, an electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC) according to an embodiment of the present disclosure, when running the messaging application (2020), determines the user's skin color and the user's gender, Age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type are applied to the emojis (2025) on the keyboard emoji page, and messages are sent to other users (e.g. message recipients). It can be done as much as possible.

For example, the processor 120 may use the user's biometric characteristics (e.g., the user's gender, age, height, eye color and shape, hair color and shape) based on the user biometric information stored in the user account (e.g., Samsung account). , lip color and shape, weight, and body type) can be applied to the emojis (2025) on the keyboard emoji page.

Referring to FIGS. 20 and 21 , the electronic device (e.g., smart watch, wearable electronic device) of the comparative example is used by a user (e.g., message sender) and/or another user (e.g., message recipient) when executing the message application 2010. ), you can display emoticons (2015) on the Keyboard Emoticon page with the default color (e.g. default color) without applying the skin color. Additionally, the electronic device (e.g., smart watch, wearable electronic device) of the comparative example may use the biometric characteristics of the user (e.g., the message sender) and/or other users (e.g., the message recipient) when running the messaging application (2010). Emoticons on the Keyboard Emoticons page in their default form (e.g. default form) without applying gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type (2015) can be displayed.

An electronic device (e.g., smart watch, wearable electronic device) according to an embodiment of the present disclosure may apply the skin color of the user (e.g., the message sender) to emoticons on the keyboard emoticon page when executing the message application 2110. . The user's skin color can be displayed in the display of emojis on the keyboard emoji page. In addition, an electronic device (e.g., smart watch, wearable electronic device) according to an embodiment of the present disclosure may collect biometric characteristics (user's gender, age, height) of another user (e.g., message recipient) when running the message application 2110. , eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to display emoticons on the keyboard emoticon page. Messages containing emoticons with biometric characteristics (user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) of another user (e.g. message recipient) applied to other users It can be sent to a user (e.g. message recipient).

An electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure may detect the skin color and biometric characteristics of another user (e.g., a message recipient) when running the message application 2120. The user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the emoticons 2125 on the keyboard emoticon page.

For example, an electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC) according to an embodiment of the present disclosure may display the skin color of another user (e.g., message recipient) when running the messaging application (2020). And emoticons (2025) on the keyboard emoticon page to which the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type are applied can be displayed.

According to one embodiment, an electronic device (e.g., a smart watch, a wearable electronic device, a smart phone, a tablet PC) according to an embodiment of the present disclosure sends a message to another user (e.g., a message recipient) when executing the message application 2120. skin color and the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type are applied to the emoticons 2125 on the keyboard emoticon page to be used by other users, e.g. The message can be sent to the message recipient.

For example, the processor 120 may determine the other user's biometric characteristics (e.g., gender, age, height, etc.) of the other user based on user biometric information stored in the user account (e.g., Samsung account) of the other user (e.g., the message recipient). , eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to the emoticons (2125) on the keyboard emoticon page.

Referring to FIG. 22, the comparative example electronic device (e.g., AR electronic device, smart watch, wearable electronic device) does not apply the user's skin color when running the AR (augmented reality) application 2210, but uses the basic color (e.g. : You can display AR emojis in default colors. In addition, the electronic devices of the comparative example (e.g., AR electronic device, smart watch, wearable electronic device) may display the user's biometric characteristics (user's gender, age, height, eye color and shape, hair) when running the AR application 2210. AR emojis can be displayed in their basic form (e.g., default form) without applying color and shape, lip color and shape, weight, and body type.

Electronic devices (e.g., AR electronic devices, smart watches, wearable electronic devices, smart phones, tablet PCs) according to an embodiment of the present disclosure may detect the user's skin color and biometric characteristics (user's gender) when running the AR application 2220. , age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type) can be applied to AR emoji.

For example, an electronic device (e.g., AR electronic device, smart watch, wearable electronic device, smart phone, tablet PC) according to an embodiment of the present disclosure may detect the user's skin color and the user's skin color when running the AR application 2220. AR emojis with gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type can be displayed.

According to one embodiment, the processor (e.g., processor 120 of FIG. 1) of an electronic device (e.g., AR electronic device, smart watch, wearable electronic device, smart phone, tablet PC) runs the AR application 2220 when the AR application 2220 is executed. , colors that match the user's skin color (or are similar to the user's skin color) and biometric characteristics, such as the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body type. ) can be applied to be displayed on a display (e.g., the display module 160 in FIG. 1).

For example, the processor 120 may use the user's biometric characteristics (e.g., the user's gender, age, height, eye color and shape, hair color and shape) based on the user biometric information stored in the user account (e.g., Samsung account). , lip color and shape, weight, and body type) can be applied to AR emoji.

An electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC, AR electronic device) according to an embodiment of the present disclosure includes a display (e.g., “display module 160 of FIG. 1), an optical sensor, (e.g., the sensor module 176 shown in FIG. 1), a memory that stores instructions (e.g., the memory 130 in FIG. 1), and a device that controls the operation of the display 160 and the optical sensor 176. It may include a processor (eg, processor 120 of FIG. 1). When the instructions are executed by the processor 120, the electronic device can be set to identify (e.g., determine) the user's skin color based on sensing data about the user's skin color from the optical sensor 176. there is. When the instructions are executed by the processor 120, the electronic device may be configured to store the user's skin color information on a server associated with the user's account. When the instructions are executed by the processor 120, the electronic device may be configured to change the color of the content of the application to correspond to the user's skin color. When the instructions are executed by the processor 120, the electronic device may be configured to provide the user's skin color information stored in a server associated with the user's account to another user (eg, a message recipient).

According to one embodiment, when the instructions are executed by the processor, the electronic device may be set to obtain (eg, confirm) the user's biometric characteristic information stored in a server associated with the user's account. When the instructions are executed by the processor 120, the electronic device can be set to change the form of the content by applying the user's biometric characteristic information. When the instructions are executed by the processor 120, the electronic device may be set to display the content whose form has been changed.

According to one embodiment, the user's biometric characteristic information may include at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape. there is. When the instructions are executed by the processor 120, the electronic device determines at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape. You can change the form of the content by applying . The processor 120 may be set to display content whose form has been changed on the display.

According to one embodiment, when the instructions are executed by the processor 120, the electronic device may be set to change at least one of the color and shape of content related to the human body.

According to one embodiment, when the instructions are executed by the processor 120, the electronic device stores the other user (e.g., message recipient) on the server associated with the account of the other user (e.g., message recipient) when executing the message application. It is possible to check whether the skin color information of the message recipient (e.g., message recipient) is set to be provided to the user. When provision of skin color information of the other user (eg, message recipient) is set, it may be set to obtain skin color information of the other user (eg, message recipient). When the instructions are executed by the processor 120, the electronic device may be set to change the color of keyboard emoticons of the messaging application by applying the skin color of the other user (eg, message recipient).

According to one embodiment, when the instructions are executed by the processor 120, the electronic device sends a message containing the keyboard emoticons to which the skin color of the other user (e.g., the message recipient) is applied. : Can be set to transmit to the electronic device of the message recipient).

According to one embodiment, when the instructions are executed by the processor 120, the electronic device stores the other user's account on the server associated with the account of the other user (e.g., the message recipient) when the message application is executed. It may be set to check whether the biometric characteristic information of the message recipient (e.g., the message recipient) is set to be provided to the user. When the instructions are executed by the processor 120, the electronic device provides the biometric characteristic information of the other user (e.g., the message recipient) when provision of the biometric characteristic information of the other user (e.g., the message recipient) is set. It can be set to obtain. When the instructions are executed by the processor 120, the electronic device may be set to change the shape of keyboard emoticons of the messaging application by applying biometric characteristic information of the other user (e.g., message recipient).

According to one embodiment, the biometric characteristic information of the other user (e.g., message recipient) includes the other user's (e.g., message recipient) gender, age, height, eye color and shape, hair color and shape, and lip color. and may include at least one of shape, weight, and body type. When the instructions are executed by the processor 120, the electronic device displays the other user's (e.g., message recipient) gender, age, height, eye color and shape, hair color and shape, lip color and shape, It can be set to change the shape of the keyboard emoticons of the messaging application by applying at least one of weight and body shape. When the instructions are executed by the processor 120, the electronic device can be set to display keyboard emoticons with changed shapes on the display.

According to one embodiment, when the instructions are executed by the processor 120, the electronic device sends a message containing the keyboard emoticons to which the biometric characteristics of the other user (e.g., the message recipient) are applied to the other user (e.g., the message recipient). For example, the message may be set to be transmitted to the recipient's electronic device.

According to one embodiment, when the instructions are executed by the processor 120, the electronic device stores the other user (e.g., message recipient) on the server associated with the account of the other user (e.g., message recipient) when executing the message application. For example, it can be set to check whether the skin color information of the message recipient is set to be shared with the user. When the instructions are executed by the processor 120, the electronic device provides the skin color information of the other user (e.g., the message recipient) if provision of the skin color information of the other user (e.g., the message recipient) is not set. It may be set to transmit a message requesting sharing to the electronic device of another user (e.g., message recipient).

According to one embodiment, when the instructions are executed by the processor 120, the electronic device stores the other user's account on the server associated with the account of the other user (e.g., the message recipient) when the message application is executed. It may be set to check whether the biometric characteristic information of the message recipient (e.g., the message recipient) is set to be provided to the user. When the instructions are executed by the processor 120, the electronic device displays the biometric characteristics of the other user (e.g., the message recipient) if provision of biometric characteristic information of the other user (e.g., the message recipient) is not set. It may be set to transmit a message requesting information sharing to the electronic device of the other user (eg, message recipient).

A method of operating an electronic device (e.g., smart watch, wearable electronic device, smart phone, tablet PC, AR electronic device) according to an embodiment of the present disclosure includes sensing the user's skin color using the optical sensor 176. You can. The user's skin color may be identified (eg, determined) based on the user's skin color sensing data from the optical sensor 176. The user's skin color information may be stored on a server associated with the user's account. The color of the application content can be changed to correspond to the user's skin color and displayed on the display. The user's skin color information stored in the server associated with the user's account may be provided to other users (eg, message recipients).

According to one embodiment, the user's biometric characteristic information stored in a server (e.g., server memory) associated with the user's account may be obtained (e.g., confirmed). The form of the content can be changed by applying the user's biometric characteristic information. The content whose form has been changed can be displayed on the display.

According to one embodiment, the user's biometric characteristic information may include at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape. there is. The form of the content can be changed by applying at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape. Content whose form has been changed can be displayed on the display.

According to one embodiment, at least one of the color and shape of content related to the human body can be changed.

According to one embodiment, when running a messaging application, it is checked whether the skin color information of the other user (e.g., the message recipient) stored in the server associated with the account of the other user (e.g., the message recipient) is set to be shared with the user. You can. When provision of skin color information of the other user (eg, message recipient) is set, skin color information of the other user (eg, message recipient) can be obtained. The color of the keyboard emoticons of the messaging application can be changed by applying the skin color of the other user (e.g., the message recipient).

According to one embodiment, a message containing the keyboard emoticons to which the skin color of the other user (e.g., the message recipient) is applied may be transmitted to the electronic device of the other user (e.g., the message recipient).

According to one embodiment, when executing the message application, the biometric characteristic information of the other user (e.g., the message recipient) stored in the server associated with the account of the other user (e.g., the message recipient) is set to be provided to the user. You can check. When provision of biometric characteristic information of the other user (eg, message recipient) is set, the form of keyboard emoticons of the message application can be changed by applying the biometric characteristic information of the other user (eg, message recipient).

According to one embodiment, the biometric characteristic information of the other user (e.g., message recipient) includes the other user's (e.g., message recipient) gender, age, height, eye color and shape, hair color and shape, and lip color. and may include at least one of shape, weight, and body type. The shape of the keyboard emoticons of the messaging application by applying at least one of the gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape of the other user (e.g., message recipient). can be changed. Keyboard emoticons with changed shapes can be displayed on the display.

According to one embodiment, a message containing the keyboard emoticons to which the biometric characteristics of the other user (e.g., the message recipient) are applied may be transmitted to the electronic device of the other user (e.g., the message recipient).

An electronic device and a method of operating the same according to an embodiment of the present disclosure can display content (e.g., letters, shapes, characters, avatars, emoticons, and emojis) by applying the user's skin color.

The electronic device and its operating method according to an embodiment of the present disclosure include the user's biometric characteristics (e.g., the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and Body shape) can be applied to display content (e.g. text, shapes, characters, avatars, emoticons, and emojis).

An electronic device and a method of operating the same according to an embodiment of the present disclosure display content (e.g., letters, shapes, characters, avatars, emoticons, and emojis) by applying the skin color of another user (e.g., a message recipient). You can send messages to other users (e.g. message recipients).

An electronic device and a method of operating the same according to an embodiment of the present disclosure include biometric characteristics (e.g., user's gender, age, height, eye color and shape, hair color and shape, lips) of another user (e.g., message recipient). Color, shape, weight, and body type) can be applied to display content (e.g., text, shapes, characters, avatars, emoticons, and emojis) and send messages to other users (e.g., message recipients).

Claims

In electronic devices,

display;

optical sensor;

memory to store instructions; and

Includes a processor that controls the operation of the display and the optical sensor,

When the instructions are executed by the processor, the electronic device:

Identifying the user's skin color based on sensing data about the user's skin color from the optical sensor,

storing the user's skin color information on a server associated with the user's account,

Changing the color of the content of the application to correspond to the skin color of the user and displaying it on the display, and

configured to provide message recipients with skin color information of the user stored on a server associated with the user's account,

Electronic devices.
According to claim 1,

When instructions are executed by the processor, the electronic device:

Obtain biometric characteristic information of the user stored on a server associated with the user's account,

Change the form of the content by applying the user's biometric characteristic information,

Set to display the content whose form has been changed,

Electronic devices.
The method according to any one of claims 1 to 2,

The user's biometric characteristic information includes at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape,

When the instructions are executed by the processor, the electronic device:

Change the form of the content by applying at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape, and display the content with the changed form. set to display on,

Electronic devices.
According to any one of claims 1 to 3,

When the instructions are executed by the processor, the electronic device:

set to change at least one of the color and shape of the content related to the human body,

Electronic devices.
According to any one of claims 1 to 4,

When the instructions are executed by the processor, the electronic device:

When executing the message application, check whether the message recipient's skin color information stored in the server associated with the message recipient's account is set to be provided to the user,

If provision of skin color information of the message recipient is set,

Obtain skin color information of the message recipient,

Set to change and/or add the color of keyboard emoticons of the message application by applying the skin color of the message recipient,

Electronic devices.
According to any one of claims 1 to 5,

When the instructions are executed by the processor, the electronic device:

Set to transmit a message containing the keyboard emoticons reflecting the skin color of the message recipient to the electronic device of the message recipient,

Electronic devices.
The method according to any one of claims 1 to 6,

When the instructions are executed by the processor, the electronic device:

When executing the message application, check whether the message recipient's biometric characteristic information stored in the server associated with the message recipient's account is set to be provided to the user,

If the provision of biometric characteristic information of the message recipient is set,

Obtain biometric characteristic information of the message recipient,

Set to change the form of keyboard emoticons of the message application by applying biometric characteristic information of the message recipient,

Electronic devices.
The method according to any one of claims 1 to 7,

The biometric characteristic information of the message recipient includes at least one of the message recipient's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape,

When the instructions are executed by the processor, the electronic device:

Change the shape of the keyboard emoticons of the message application by applying at least one of the message recipient's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape, and change the shape of the keyboard emoticons of the message application. Set to display changed keyboard emoticons on the display,

Electronic devices.
The method according to any one of claims 1 to 8,

When the instructions are executed by the processor, the electronic device:

Set to transmit a message containing the keyboard emoticons reflecting the biometric characteristics of the message recipient to the electronic device of the message recipient,

Electronic devices.
According to any one of claims 1 to 4,

When the instructions are executed by the processor, the electronic device:

When executing the message application, check whether the message recipient's skin color information stored in the server associated with the message recipient's account is set to be provided to the user,

When provision of skin color information of the message recipient is not set, a message requesting provision of skin color information of the message recipient is set to be transmitted to the electronic device of the message recipient,

Electronic devices.
According to any one of claims 1 to 4,

When the instructions are executed by the processor, the electronic device:

When executing the message application, check whether the message recipient's biometric characteristic information stored in the server associated with the message recipient's account is set to be provided to the user,

If the provision of biometric characteristic information of the message recipient is not set,

Set to transmit a message requesting provision of biometric characteristic information of the message recipient to the electronic device of the message recipient,

Electronic devices.
In a method of operating an electronic device,

Sensing the user's skin color using an optical sensor,

Identifying the user's skin color based on the user's skin color sensing data from the optical sensor,

storing the user's skin color information on a server associated with the user's account,

Displaying and changing the color of the content of the application to correspond to the skin color of the user,

Providing the message recipient with the user's skin color information stored on a server associated with the user's account,

How electronic devices work.
According to claim 12,

Obtain biometric characteristic information of the user stored on a server associated with the user's account,

Change the form of the content by applying the user's biometric characteristic information,

Displaying the content whose form has been changed on the display,

How electronic devices work.
The method according to any one of claims 12 to 13,

The user's biometric characteristic information includes at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape,

Change the form of the content by applying at least one of the user's gender, age, height, eye color and shape, hair color and shape, lip color and shape, weight, and body shape, and display the content with the changed form. displayed on,

How electronic devices work.
The method according to any one of claims 12 to 14,

Changing at least one of the color and shape of content related to the human body,

How electronic devices work.