WO2022250284A1 - Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci - Google Patents

Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci Download PDF

Info

Publication number
WO2022250284A1
WO2022250284A1 PCT/KR2022/005050 KR2022005050W WO2022250284A1 WO 2022250284 A1 WO2022250284 A1 WO 2022250284A1 KR 2022005050 W KR2022005050 W KR 2022005050W WO 2022250284 A1 WO2022250284 A1 WO 2022250284A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
electronic device
light
user
skin
Prior art date
Application number
PCT/KR2022/005050
Other languages
English (en)
Korean (ko)
Inventor
최형선
오영재
정지운
김준호
Original Assignee
삼성전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자 주식회사 filed Critical 삼성전자 주식회사
Priority to EP22811477.3A priority Critical patent/EP4261527A4/fr
Priority to US17/736,369 priority patent/US20220383605A1/en
Publication of WO2022250284A1 publication Critical patent/WO2022250284A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/314—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry with comparison of measurements at specific and non-specific wavelengths
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/0233—Handheld
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/04—Optical or mechanical part supplementary adjustable parts
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/04—Optical or mechanical part supplementary adjustable parts
    • G01J1/0403—Mechanical elements; Supports for optical elements; Scanning arrangements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/02—Details
    • G01J1/08—Arrangements of light sources specially adapted for photometry standard sources, also using luminescent or radioactive material
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J1/00—Photometry, e.g. photographic exposure meter
    • G01J1/42—Photometry, e.g. photographic exposure meter using electric radiation detectors
    • G01J1/429—Photometry, e.g. photographic exposure meter using electric radiation detectors applied to measurement of ultraviolet light
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/255—Details, e.g. use of specially adapted sources, lighting or optical systems
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/33—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using ultraviolet light
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/90—Determination of colour characteristics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M1/00—Substation equipment, e.g. for use by subscribers
    • H04M1/02—Constructional features of telephone sets
    • H04M1/21—Combinations with auxiliary equipment, e.g. with clocks or memoranda pads

Definitions

  • the present disclosure relates to an electronic device for checking an ultraviolet (UV) blocking component applied to a user's skin and an operating method thereof.
  • UV ultraviolet
  • UV blocking agents As interest in skin health increases, cosmetics containing ultraviolet (UV) blocking agents are widely used.
  • a professional photographing device is required.
  • an ultraviolet camera capable of recognizing reflected light of ultraviolet light may be used.
  • UV cameras are large and expensive, so ordinary users could not easily use them. That is, it was not easy for general users to check the application state of cosmetics including sunscreen.
  • a method for checking the application state of a sunscreen component applied to a user's skin using a camera included in an electronic device is provided.
  • An electronic device includes a camera, a light source unit, a display, and a processor, wherein the processor obtains a first image of the user's skin by the camera in a state in which first light is output through the light source unit. and obtaining a second image of the skin of the user by the camera in a state in which the first light is not output through the light source unit, and calculating a difference between brightness values of the first image and the second image.
  • a third image representing the difference between the first image and the second image is obtained by converting into a first pixel value difference, and an ultraviolet (UV) blocking component applied to the skin of the user based on the third image It can be set to display information about on the display.
  • UV ultraviolet
  • An operating method of an electronic device includes an operation of acquiring a first image of the user's skin by a camera included in the electronic device in a state in which a first light is output through a light source included in the electronic device. , Obtaining a second image including the skin of the user by the camera in a state in which the first light is not output through the light source unit, between brightness values of the first image and the second image, respectively. obtaining a third image representing the difference between the first image and the second image by converting the difference between the first pixel values into a first pixel value difference, and ultraviolet rays applied to the skin of the user based on the third image An operation of displaying information on a (UV) blocking component on a display included in the electronic device may be included.
  • a (UV) blocking component on a display included in the electronic device may be included.
  • An electronic device includes a camera, a display, and a processor, and the processor sends a first control command to the external electronic device such that the external electronic device including at least one light source device outputs first light. and acquires a first image including the user's skin through the camera in a state in which the first light is output, and controls the at least one light source element to the external electronic device so that the first light is not output. 2 Transmits a control command, acquires a second image including the skin of the user through the camera in a state in which the first light is not output, and determines brightness values of the first image and the second image, respectively.
  • a third image representing the difference between the first image and the second image is obtained by converting the difference between the differences into pixel values, and blocking ultraviolet (UV) applied to the skin of the user based on the third image.
  • Information on ingredients can be provided.
  • FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
  • FIGS. 2A, 2B, 2C, and 2D are views illustrating a schematic configuration of an electronic device according to various embodiments.
  • FIG. 3 is a block diagram illustrating a schematic configuration of an electronic device according to various embodiments.
  • FIG. 4 is a flowchart illustrating an operation of obtaining information on a sunscreen component applied to a user's skin by controlling the output of a first light by an electronic device according to various embodiments of the present disclosure.
  • FIG. 5 is a flowchart illustrating an operation of obtaining a third image by controlling an output of a first light by an electronic device according to various embodiments of the present disclosure.
  • FIG. 6 is a flowchart illustrating an operation of obtaining a third image by controlling an output of a first light by an electronic device, according to various embodiments of the present disclosure.
  • FIG. 7 is a diagram for explaining an operation of obtaining a third image based on a brightness difference between a first image and a second image by an electronic device according to various embodiments of the present disclosure.
  • FIG. 8 is a diagram for explaining an operation of obtaining a third image based on a first image and a second image by an electronic device and obtaining an image obtained by visualizing the third image, according to various embodiments of the present disclosure.
  • FIG. 10 is a flowchart for explaining an operation of determining whether to output either a first light or a second light based on a UV blocking component by an electronic device according to various embodiments of the present disclosure.
  • FIG. 11 is a flowchart illustrating an operation of obtaining information on a sunscreen component applied to a user's skin by controlling output of second light by an electronic device, according to various embodiments of the present disclosure.
  • FIG. 12 is a diagram for explaining an operation of obtaining a fourth image by outputting second light and obtaining an image obtained by visualizing the fourth image, by an electronic device, according to various embodiments of the present disclosure.
  • FIG. 13 is a diagram for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • 14A, 14B, and 14C are diagrams for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • 15A, 15B, and 15C are diagrams for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • FIG. 1 is a block diagram of an electronic device 101 within a network environment 100, according to various embodiments.
  • an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or through a second network 199. It may communicate with at least one of the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 .
  • a first network 198 eg, a short-range wireless communication network
  • the server 108 e.g, a long-distance wireless communication network
  • the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or the antenna module 197 may be included.
  • at least one of these components eg, the connection terminal 178) may be omitted or one or more other components may be added.
  • some of these components eg, sensor module 176, camera module 180, or antenna module 197) are integrated into a single component (eg, display module 160). It can be.
  • the processor 120 may include a main processor 121 (eg, a central processing unit or an application processor) or a secondary processor 123 (eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor).
  • a main processor 121 eg, a central processing unit or an application processor
  • a secondary processor 123 eg, a graphic processing unit, a neural network processing unit ( NPU: neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor.
  • NPU neural network processing unit
  • the secondary processor 123 may be implemented separately from or as part of the main processor 121 .
  • the secondary processor 123 may, for example, take the place of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or the main processor 121 is active (eg, running an application). ) state, together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display module 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states.
  • the auxiliary processor 123 eg, image signal processor or communication processor
  • may be implemented as part of other functionally related components eg, camera module 180 or communication module 190). have.
  • the auxiliary processor 123 may include a hardware structure specialized for processing an artificial intelligence model.
  • AI models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself where the artificial intelligence model is performed, or may be performed through a separate server (eg, the server 108).
  • the learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning or reinforcement learning, but in the above example Not limited.
  • the artificial intelligence model may include a plurality of artificial neural network layers.
  • Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the foregoing, but is not limited to the foregoing examples.
  • the artificial intelligence model may include, in addition or alternatively, software structures in addition to hardware structures.
  • the memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101 .
  • the data may include, for example, input data or output data for software (eg, program 140) and commands related thereto.
  • the memory 130 may include volatile memory 132 or non-volatile memory 134 .
  • the program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142 , middleware 144 , or an application 146 .
  • the input module 150 may receive a command or data to be used by a component (eg, the processor 120) of the electronic device 101 from the outside of the electronic device 101 (eg, a user).
  • the input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).
  • the sound output module 155 may output sound signals to the outside of the electronic device 101 .
  • the sound output module 155 may include, for example, a speaker or a receiver.
  • the speaker can be used for general purposes such as multimedia playback or recording playback.
  • a receiver may be used to receive an incoming call. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.
  • the display module 160 may visually provide information to the outside of the electronic device 101 (eg, a user).
  • the display module 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device.
  • the display module 160 may include a touch sensor set to detect a touch or a pressure sensor set to measure the intensity of force generated by the touch.
  • the audio module 170 may convert sound into an electrical signal or vice versa. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device connected directly or wirelessly to the electronic device 101 (eg: Sound may be output through the electronic device 102 (eg, a speaker or a headphone).
  • the sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do.
  • the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a bio sensor, It may include a temperature sensor, humidity sensor, or light sensor.
  • the interface 177 may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device 101 to an external electronic device (eg, the electronic device 102).
  • the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
  • HDMI high definition multimedia interface
  • USB universal serial bus
  • SD secure digital
  • connection terminal 178 may include a connector through which the electronic device 101 may be physically connected to an external electronic device (eg, the electronic device 102).
  • the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).
  • the haptic module 179 may convert electrical signals into mechanical stimuli (eg, vibration or motion) or electrical stimuli that a user may perceive through tactile or kinesthetic senses.
  • the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
  • the camera module 180 may capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.
  • the power management module 188 may manage power supplied to the electronic device 101 .
  • the power management module 188 may be implemented as at least part of a power management integrated circuit (PMIC), for example.
  • PMIC power management integrated circuit
  • the battery 189 may supply power to at least one component of the electronic device 101 .
  • the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.
  • the communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). Establishment and communication through the established communication channel may be supported.
  • the communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication.
  • the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : a local area network (LAN) communication module or a power line communication module).
  • a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, a legacy communication module).
  • the wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199.
  • IMSI International Mobile Subscriber Identifier
  • the wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, NR access technology (new radio access technology).
  • NR access technologies include high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low latency (URLLC)).
  • eMBB enhanced mobile broadband
  • mMTC massive machine type communications
  • URLLC ultra-reliable and low latency
  • -latency communications can be supported.
  • the wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example.
  • the wireless communication module 192 uses various technologies for securing performance in a high frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. Technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna may be supported.
  • MIMO massive multiple-input and multiple-output
  • FD-MIMO full dimensional MIMO
  • array antenna analog beam-forming
  • large scale antenna may be supported.
  • the wireless communication module 192 may support various requirements defined for the electronic device 101, an external electronic device (eg, the electronic device 104), or a network system (eg, the second network 199). According to one embodiment, the wireless communication module 192 may be used to realize Peak data rate (eg, 20 Gbps or more) for realizing 1eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency (for realizing URLLC).
  • Peak data rate eg, 20 Gbps or more
  • loss coverage eg, 164 dB or less
  • U-plane latency for realizing URLLC
  • the antenna module 197 may transmit or receive signals or power to the outside (eg, an external electronic device).
  • the antenna module 197 may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (eg, PCB).
  • the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is selected from the plurality of antennas by the communication module 190, for example. can be chosen A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna.
  • other components eg, a radio frequency integrated circuit (RFIC) may be additionally formed as a part of the antenna module 197 in addition to the radiator.
  • RFIC radio frequency integrated circuit
  • the antenna module 197 may form a mmWave antenna module.
  • the mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first surface (eg, a lower surface) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, array antennas) disposed on or adjacent to a second surface (eg, a top surface or a side surface) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.
  • peripheral devices eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)
  • signal e.g. commands or data
  • commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 .
  • Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 .
  • all or part of operations executed in the electronic device 101 may be executed in one or more external electronic devices among the external electronic devices 102 , 104 , or 108 .
  • the electronic device 101 when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 instead of executing the function or service by itself.
  • one or more external electronic devices may be requested to perform the function or at least part of the service.
  • One or more external electronic devices receiving the request may execute at least a part of the requested function or service or an additional function or service related to the request, and deliver the execution result to the electronic device 101 .
  • the electronic device 101 may provide the result as at least part of a response to the request as it is or additionally processed.
  • cloud computing distributed computing, mobile edge computing (MEC), or client-server computing technology may be used.
  • the electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing.
  • the external electronic device 104 may include an internet of things (IoT) device.
  • Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199 .
  • the electronic device 101 may be applied to intelligent services (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.
  • Electronic devices may be devices of various types.
  • the electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance.
  • a portable communication device eg, a smart phone
  • a computer device e.g., a smart phone
  • a portable multimedia device e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a portable medical device
  • a camera e.g., a camera
  • a wearable device e.g., a smart bracelet
  • first, second, or first or secondary may simply be used to distinguish a given component from other corresponding components, and may be used to refer to a given component in another aspect (eg, importance or order) is not limited.
  • a (e.g., first) component is said to be “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicatively.”
  • the certain component may be connected to the other component directly (eg by wire), wirelessly, or through a third component.
  • module used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logical blocks, parts, or circuits.
  • a module may be an integrally constructed component or a minimal unit of components or a portion thereof that performs one or more functions.
  • the module may be implemented in the form of an application-specific integrated circuit (ASIC).
  • ASIC application-specific integrated circuit
  • a storage medium eg, internal memory 136 or external memory 138
  • a machine eg, electronic device 101
  • a processor eg, the processor 120
  • a device eg, the electronic device 101
  • the one or more instructions may include code generated by a compiler or code executable by an interpreter.
  • the device-readable storage medium may be provided in the form of a non-transitory storage medium.
  • the storage medium is a tangible device and does not contain a signal (e.g. electromagnetic wave), and this term refers to the case where data is stored semi-permanently in the storage medium. It does not discriminate when it is temporarily stored.
  • a signal e.g. electromagnetic wave
  • the method according to various embodiments disclosed in this document may be included and provided in a computer program product.
  • Computer program products may be traded between sellers and buyers as commodities.
  • a computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • a device-readable storage medium eg compact disc read only memory (CD-ROM)
  • an application store eg Play Store TM
  • It can be distributed (eg downloaded or uploaded) online, directly between smart phones.
  • at least part of the computer program product may be temporarily stored or temporarily created in a device-readable storage medium such as a manufacturer's server, an application store server, or a relay server's memory.
  • each component (eg, module or program) of the above-described components may include a single object or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have.
  • one or more components or operations among the aforementioned corresponding components may be omitted, or one or more other components or operations may be added.
  • a plurality of components eg modules or programs
  • the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by a corresponding component of the plurality of components prior to the integration. .
  • the actions performed by a module, program, or other component are executed sequentially, in parallel, iteratively, or heuristically, or one or more of the actions are executed in a different order, or omitted. or one or more other actions may be added.
  • sunscreen herein may mean a cosmetic product having an ultraviolet (UV) blocking function as well as a sunscreen agent.
  • UV ultraviolet
  • FIGS. 2a, 2b, 2c, and 2d are views illustrating a schematic configuration of an electronic device according to various embodiments.
  • electronic devices 201 and 202 may be implemented identically to the electronic device 101 of FIG. 1 .
  • the external electronic devices 204 and 205 may be implemented identically to the electronic device 102 or 104 of FIG. 1 .
  • the electronic device 201 or 202 may capture a user's skin (eg, the user's face) using a camera 240 or 241 .
  • the electronic device 201 or 202 may capture the user's skin by controlling the output of light (eg, ultraviolet light or visible light) through the light source unit 250 or 251 capable of outputting ultraviolet light and visible light.
  • light eg, ultraviolet light or visible light
  • the electronic device 201 acquires a first image by photographing the user's skin in a state in which ultraviolet rays are output through the light source unit 250 or 251, and obtains a first image in a state in which no ultraviolet rays are output (eg, the light source unit 250 or 251 ), the second image may be obtained by photographing the user's skin in a state in which no light is output).
  • the first image may be an image of the user's skin captured by the camera 250 in a state in which the first light is output.
  • the second image may be an image of the user's skin captured by the camera 250 in a state in which the first light is not output.
  • the electronic device 201 or 202 may obtain a third image representing the user's skin to which cosmetics, sunscreen, or sunscreen components are applied, based on the difference between the first image and the second image.
  • the electronic device 201 or 202 may provide information on cosmetics, sunscreen, or sunscreen ingredients applied to the user's skin based on the third image.
  • the electronic device 201 may be implemented as a smart phone, similar to that shown in FIG. 2A .
  • the electronic device 202 may be implemented as a smart mirror, similar to that shown in FIG. 2B.
  • FIG. 2C (a) is a diagram showing the front of the external electronic device 204
  • FIG. 2C (b) is a diagram showing the rear side of the external electronic device 204.
  • the electronic device 201 causes the light source unit 252 or 290 included in the external electronic device 204 or 205 to output light. 205) can be controlled.
  • the electronic device 201 may be mounted on an external electronic device 204 similar to that shown in (b) of FIG. 2C.
  • the external electronic device 204 may be implemented as a smart mirror including a light source unit 252 capable of outputting ultraviolet rays and visible rays.
  • the electronic device 201 may acquire an image by using light incident through the holes 275 while mounted on the external electronic device 204 .
  • the electronic device 201 may be mounted on a cradle 277 located on the rear side of the external electronic device 204 .
  • the electronic device 201 may be connected to an external electronic device 205 similar to that shown in FIG. 2D .
  • the external electronic device 205 may be attached to the electronic device 201 through a detachable means of the external electronic device 205 .
  • the external electronic device 205 may include a light source unit 290 including at least one light source element capable of outputting ultraviolet rays and visible rays.
  • the external electronic device 205 may be implemented as an accessory type device. In this case, the electronic device 201 may not include its own light source unit 250 .
  • an electronic device 201 may be mounted on an external electronic device 204 or attached to an external electronic device 205 using a camera 240.
  • the user's skin may be photographed.
  • the electronic device 201 may photograph the user's skin by controlling the output of light (eg, ultraviolet light or visible light) by the light source unit 252 or 290 included in the external electronic device 204 or 205 .
  • light eg, ultraviolet light or visible light
  • the electronic device 201 acquires a first image by photographing the user's skin in a state in which the light source unit 252 or 290 outputs ultraviolet rays, and in a state in which no ultraviolet rays are output (eg, the light source unit 252 or 290) ) In a state where no light is output), the second image may be obtained by photographing the user's skin.
  • the electronic device 201 may acquire a third image representing the user's skin to which cosmetics, sunscreen, or sunscreen ingredients are applied, based on the difference between the first image and the second image.
  • the electronic device 201 may provide information on cosmetics, sunscreen, or sunscreen components applied to the user's skin based on the third image.
  • FIG. 3 is a block diagram illustrating a schematic configuration of an electronic device according to various embodiments.
  • an electronic device 301 may be implemented identically or similarly to the electronic devices 201 and 202 of FIG. 2 .
  • the electronic device 301 includes a processor 320, a memory 330, a camera 340 (eg, the camera module 180 of FIG. 1 or the camera 240 of FIG. 2), and a light emitting unit. 350 (eg, light emitting portion 250 of FIG. 2 ), display 360 (eg, display module 160 of FIG. 1 ), and communication module 370 (eg, communication module 190 of FIG. 1 ). ) may be included.
  • the processor 320 may control overall operations of the electronic device 301 .
  • the processor 320 may photograph the user's skin through the camera 330 and provide information about cosmetics or sunscreen applied to the user's skin.
  • the processor 320 may control the light output of the light source unit 350 when photographing the user's skin through the camera 330 .
  • the light source unit 350 may include at least one light source element.
  • the light source unit 350 may output light including ultraviolet light and/or visible light.
  • the processor 320 may capture a first image including the user's skin through the camera 340 in a state in which the first light is output through the light source unit 350 . After capturing the first image, the processor 320 may capture a second image including the user's skin through the camera 340 in a state in which the first light is not output from the light source unit 350 . The processor 320 may convert a difference between brightness values of the first image and the second image into a pixel value. The processor 320 may obtain a third image representing a difference between the first image and the second image by using the converted pixel value. For example, the processor 320 may obtain a third image indicating the extent to which the sunscreen ingredients are applied when the sunscreen ingredients are included in cosmetics applied to the user's skin.
  • the processor 320 may display on the display 360 information on the sunscreen component applied to the user's skin based on the third image.
  • the first light may include ultraviolet rays.
  • the information on the sunscreen component may include a visualized image so that information on the sunscreen component (eg, sunscreen agent) applied to the user's skin can be recognized.
  • the visualized image may indicate the extent to which a sunscreen component (eg, sunscreen) is applied to the user's skin through a contrast ratio.
  • the information on the sunscreen component may include a message indicating information on the application of the sunscreen component to the user's skin.
  • the processor 320 may transmit a control command to the external electronic device 304 and/or 305 through the communication module 370 .
  • the processor 320 may control the light output of the light source unit 380 or 390 included in the external electronic device 304 or 305 by transmitting a control command when photographing the user's skin through the camera 330.
  • the light source unit 380 or 390 may include at least one light source element.
  • the light source unit 380 or 390 may output light including ultraviolet rays and/or visible rays.
  • the processor 320 may transmit a first control command to the external electronic device 304 or 305 so that the external electronic device 304 or 305 outputs the first light.
  • the processor 320 may capture a first image including the user's skin through the camera 340 in a state in which the external electronic device 304 or 305 outputs the first light.
  • the processor 320 may transmit a second control command to the external electronic device 304 or 305 so that the external electronic device 304 or 305 does not output the first light.
  • the processor 320 may capture a second image including the user's skin through the camera 340 in a state in which the first light is not output.
  • the processor 320 may convert a difference between brightness values of the first image and the second image into a pixel value.
  • the processor 320 may obtain a third image representing a difference between the first image and the second image by using the converted pixel value.
  • the processor 320 may display information on the sunscreen applied to the user's skin on the display 360 based on the third image.
  • the processor 320 may transmit a third control command to the external electronic device 304 to display information about the sunscreen on the display 385 included in the external electronic device 304 .
  • the processor 320 may also transmit information on the sunscreen to the external electronic device 304 .
  • the processor 320 may check the ingredients or types of sunscreen included in cosmetics used on the user's skin. For example, the processor 320 photographs the cosmetics through the camera 340 and compares the photographed image with data on the cosmetics stored in the memory 330 to determine the ingredients or types of sunscreen contained in the cosmetics. can Alternatively, the processor 320 may receive information about cosmetics (eg, name or ingredient information of sunscreen) from the user, and based on the received information, may identify the ingredients or types of sunscreen included in the cosmetics. Alternatively, the processor 320 may photograph the user's skin before capturing the first image, and determine the component or type of the sunscreen included in the corresponding cosmetic according to whether the user's skin has a white turbidity spot.
  • information about cosmetics eg, name or ingredient information of sunscreen
  • the processor 320 may determine which one of the first light (eg, ultraviolet light) or the second light (eg, visible light) is to be output from the light source unit 350 according to the check result. Alternatively, the processor 320 may determine whether to output either the first light or the second light from the light source unit 350 according to a user's setting.
  • the first light eg, ultraviolet light
  • the second light eg, visible light
  • the processor 320 when the sunscreen included in the cosmetics is a reflective sunscreen (eg, a sunscreen containing a jinkoxide component), transmits the first light and other A second light may be output.
  • the processor 320 may transmit a fourth control command to the external electronic device 304 or 305 so that the external electronic device 304 or 305 outputs the second light.
  • the processor 320 may capture a fourth image including the user's skin through the camera 340 in a state in which the second light is output.
  • the fourth image may be an image of the user's skin captured by the camera 340 in a state in which the second light is output.
  • the processor 320 may display information on the sunscreen applied to the user's skin on the display 360 based on the fourth image.
  • the second light may include visible light.
  • the processor 320 outputs the first light through the light source unit 350 even when the sunscreen included in cosmetics is a reflective sunscreen (eg, a sunscreen containing a jinkoxide component). can make it That is, the method of using the output of the first light can be used regardless of the components of the sunscreen included in cosmetics.
  • a reflective sunscreen eg, a sunscreen containing a jinkoxide component
  • At least some of the operations performed by the electronic device 301 below may be performed by the processor 320 . However, for convenience of description, it will be assumed that the subject of the operation is the electronic device 301.
  • FIG. 4 is a flowchart illustrating an operation of obtaining information on a sunscreen component applied to a user's skin by controlling the output of a first light by an electronic device according to various embodiments of the present disclosure.
  • the electronic device 301 may capture a first image including the user's skin through a camera in a state in which the first light is output.
  • the first light may be output from the light source unit 350 or the external electronic device 304 or 305 .
  • the first light may include ultraviolet rays.
  • the electronic device 301 may capture a second image including the user's skin through the camera in a state in which the first light is not output.
  • the electronic device 301 may obtain a third image representing a difference between the first image and the second image.
  • the electronic device 301 may obtain a third image by converting a difference between brightness values of the first image and the second image into a pixel value.
  • the area to which the sunscreen is applied may be displayed in dark (or black tone).
  • the area to which the sunscreen is not applied may be displayed brightly (or in white tone).
  • the electronic device 301 may provide information about sunscreen components (eg, sunscreen) applied to the user's skin based on the third image.
  • the electronic device 301 may display information about sunscreen components (eg, sunscreen) applied to the user's skin on the display 360 or the display 385 of the external electronic device 304. .
  • the electronic device 301 converts the color space of the third image (eg, converts RGB (red, green and blue) into HSV (hue, saturation and value)) and converts the visualized fifth image into information about the sunscreen can be displayed as Alternatively, the electronic device 301 may apply the contrast characteristics of the third image to the second image, such as a general photograph, and display the visualized sixth image as information on the sunscreen component (eg, sunscreen agent). For example, in the fifth image or the sixth image, the area to which the sunscreen component (eg, sunscreen) is applied is displayed in a dark (or black tone), and the area to which the sunscreen component (eg, sunscreen) is not applied is displayed. It can be displayed brightly (or in white tone).
  • the sunscreen component eg, sunscreen agent
  • FIG. 5 is a flowchart illustrating an operation of obtaining a third image by controlling an output of a first light by an electronic device according to various embodiments of the present disclosure.
  • the electronic device 301 converts a signal corresponding to the brightness of light sensed by an image sensor included in the camera 340 into pixel values to obtain a first image and a second image.
  • the first image and the second image may include a plurality of pixel values.
  • the electronic device 301 may convert a signal corresponding to the sensed brightness of light into pixel values based on a relational expression between a brightness value stored in the memory 330 and a pixel value.
  • the electronic device 301 may convert first pixel values of a first image into first brightness values.
  • the electronic device 301 may convert first pixel values into first brightness values based on a relational expression between a brightness value stored in the memory 330 and a pixel value.
  • the electronic device 301 may convert second pixel values of the second image into second brightness values.
  • the electronic device 301 may convert second pixel values into second brightness values based on a relational expression between a brightness value stored in the memory 330 and a pixel value.
  • the electronic device 301 may convert difference values between the first brightness values and the second brightness values into pixel values. For example, the electronic device 301 may check a difference between each of the first brightness values and each of the second brightness values. The electronic device 301 may determine the checked difference value as the brightness value in the relational expression between the brightness value and the pixel value stored in the memory 330 and check the pixel value corresponding to the determined brightness value. That is, the electronic device 301 determines difference values between the first brightness values and the second brightness values as brightness values of the relational expression between the brightness value and the pixel value, and based on the relational expression between the brightness value and the pixel value. The determined brightness values may be converted into pixel values again.
  • the electronic device 301 may obtain a third image based on the converted pixel values. Through this, the electronic device 301 may acquire an image with enhanced visibility in determining whether to apply the sunscreen. In addition, the electronic device 301 may obtain an image capable of determining whether to apply the sunscreen using a general camera 340 instead of a UV camera.
  • FIG. 6 is a flowchart illustrating an operation of obtaining a third image by controlling an output of a first light by an electronic device, according to various embodiments of the present disclosure.
  • the electronic device 301 may directly check a signal corresponding to the brightness of light sensed by an image sensor included in the camera 340 when capturing the first image and the second image. have.
  • the electronic device 301 in operation 601, the electronic device 301 generates a first image based on a signal corresponding to brightness of light sensed by an image sensor included in a camera 340. It is possible to check the first brightness values of
  • the electronic device 301 sets second brightness values of the second image based on a signal corresponding to the brightness of light sensed by the image sensor included in the camera 340. You can check.
  • the electronic device 301 may convert difference values between the first brightness values and the second brightness values into pixel values. For example, the electronic device 301 may check a difference between each of the first brightness values and each of the second brightness values. The electronic device 301 may determine the checked difference value as the brightness value in the relational expression between the brightness value and the pixel value stored in the memory 330 and check the pixel value corresponding to the determined brightness value. That is, the electronic device 301 determines difference values between the first brightness values and the second brightness values as brightness values of the relational expression between the brightness value and the pixel value, and based on the relational expression between the brightness value and the pixel value. The determined brightness values may be converted into pixel values again.
  • the electronic device 301 may obtain a third image based on the converted pixel values.
  • FIG. 7 is a diagram for explaining an operation of obtaining a third image based on a brightness difference between a first image and a second image by an electronic device according to various embodiments of the present disclosure.
  • the electronic device 301 may store a relational expression 710 between a brightness value and a pixel value in a memory 330 .
  • a pixel value may have a value from 0 to 255 according to brightness.
  • the electronic device 301 converts a signal corresponding to the brightness of light sensed by the image sensor included in the camera 340 into pixel values based on the relational expression 710, and generates a pixel value based on the converted pixel values.
  • a first image IM1 and a second image IM2 may be generated.
  • the electronic device 301 may convert the first pixel value P1 of the first image IM1 into the first brightness value A1 based on the relational expression 710 .
  • the electronic device 301 may convert the second pixel value P2 of the second image IM2 into the second brightness value A2 based on the relational expression 710 .
  • the electronic device 301 may check the difference value D between the first brightness value A1 and the second brightness value A2.
  • the electronic device 301 determines the difference value D as the third brightness value A3 and determines the third pixel value P3 corresponding to the third brightness value A3 based on the relational expression 710. can
  • the electronic device 301 may acquire the third image IM3 based on the third pixel value P3.
  • FIG. 8 is a diagram for explaining an operation of obtaining a third image based on a first image and a second image by an electronic device and obtaining an image obtained by visualizing the third image, according to various embodiments of the present disclosure.
  • the electronic device 301 may capture (or acquire) the first image IM1 in a state in which the first light (eg, ultraviolet light) is output. Thereafter, the electronic device 301 may capture (or acquire) the second image IM2 in a state in which the first light is not output.
  • the first light eg, ultraviolet light
  • the electronic device 301 converts a difference between brightness values between the first image IM1 and the second image IM2 into a pixel value to obtain a third pixel value.
  • An image IM3 may be obtained.
  • the third image IM3 may be a red, green, blue (RGB) based image.
  • the electronic device 301 may visualize the third image IM3 to enhance visibility.
  • the electronic device 301 may convert the color space or color space of the third image IM3 from RGB based on HSV (hue, saturation, and value). That is, the electronic device 301 converts the third image IM3 into images based on hue, saturation, and value, and combines the converted images to form a fifth image IM5. ) can be created.
  • the conversion of the color space of the third image IM3 from RGB to HSV by the electronic device 301 is only exemplary, and the technical spirit of the present invention may not be limited thereto.
  • the electronic device 301 may convert the color space of the third image IM3 to HSV, CMYK (cyan magenta yellow key), CIE xyz, and leave only one color (eg, Blue) in RGB Tuned visualization processing can be performed as well.
  • CMYK cyan magenta yellow key
  • CIE xyz CIE xyz
  • the electronic device 301 may display the fifth image IM5 on the display 360 .
  • the electronic device 301 may transmit a control command to the external electronic device 304 to display the fifth image IM5 on the display 385 of the external electronic device 304 .
  • the fifth image IM5 may be an image with enhanced visibility of the sunscreen 810 applied to the user's skin (eg, face).
  • FIG. 9 is a flowchart for explaining an operation of determining whether to output either a first light or a second light based on cosmetics information by an electronic device according to various embodiments of the present disclosure.
  • the electronic device 301 may check cosmetic information used by the user before photographing the user's skin.
  • the electronic device 301 may photograph cosmetics through the camera 340 and compare cosmetics data stored in the memory 330 with the photographed cosmetics to check cosmetic information.
  • the electronic device 301 may directly obtain cosmetics information (eg, name or ingredients) from the user.
  • the electronic device 301 may check the sunscreen ingredients (and/or types of sunscreen ingredients) included in cosmetics. For example, the electronic device 301 determines whether the UV blocking component is a reflective UV blocking component (eg, a blocker that reflects external UV rays) or an absorption-type UV blocking component (eg, a blocker that absorbs external UV rays). can For example, the electronic device 301 may determine that the sunscreen included in cosmetics is a reflective sunscreen component (or a reflective sunscreen agent) when a zinoxide component is included in the sunscreen.
  • a reflective UV blocking component eg, a blocker that reflects external UV rays
  • an absorption-type UV blocking component eg, a blocker that absorbs external UV rays.
  • the electronic device 301 may determine that the sunscreen included in cosmetics is a reflective sunscreen component (or a reflective sunscreen agent) when a zinoxide component is included in the sunscreen.
  • the electronic device 301 determines whether a first light (ultraviolet ray) or a second light (visible ray) is output based on the ultraviolet ray blocking component (and/or the type of the ultraviolet ray blocking component). can decide For example, the electronic device 301 may determine to output first light when photographing the user's skin when cosmetics include an absorption-type sunscreen component. The electronic device 301 may determine to output the second light when photographing the user's skin when cosmetics include a reflective sunscreen. However, when the cosmetic product includes a reflective UV blocking component, the electronic device 301 may output the first light instead of the second light to photograph the user's skin.
  • the electronic device 301 outputs any one of a first light (ultraviolet ray) or a second light (visible ray) to detect the UV blocking component applied to the user's skin.
  • information can be obtained.
  • the electronic device 301 may output either the first light or the second light to photograph the user's skin when cosmetics include a reflective UV blocking component.
  • which one of the first light and the second light to output when photographing the user's skin may be automatically determined by the user's selection or by the processor 320 .
  • the electronic device 301 may photograph the user's skin by outputting first light when the cosmetics contain an absorption-type sunscreen component.
  • FIG. 10 is a flowchart for explaining an operation of determining whether to output either a first light or a second light based on a UV blocking component by an electronic device according to various embodiments of the present disclosure.
  • the electronic device 301 may photograph the user's skin in order to check cosmetic information used by the user. For example, the electronic device 301 may acquire an image of the user's skin.
  • the electronic device 301 may determine whether a clouding phenomenon is confirmed on the photographed user's skin. For example, the electronic device 301 may determine whether a cloudiness phenomenon is confirmed in an image obtained by capturing the user's skin.
  • the electronic device 301 when a clouding phenomenon is confirmed on the photographed user's skin (yes in operation 1003), in operation 1005, the electronic device 301 outputs second light (eg, visible light) to the user in a mode for outputting second light (eg, visible light). skin can be photographed.
  • the electronic device 301 may photograph the user's skin in a mode in which the first light (eg, ultraviolet light) is output without outputting the second light according to the user's selection or setting. Accordingly, a method for the electronic device 301 to acquire information about the sunscreen applied to the user's skin will be described with reference to FIGS. 11 and 12 .
  • the electronic device 301 outputs first light (eg, ultraviolet light) to the user in a mode for outputting first light (eg, ultraviolet light).
  • first light eg, ultraviolet light
  • skin can be photographed.
  • the electronic device 301 may obtain and provide information on sunscreen applied to the user's skin according to the method described in FIG. 8 .
  • FIG. 11 is a flowchart illustrating an operation of obtaining information on a sunscreen component applied to a user's skin by controlling output of second light by an electronic device, according to various embodiments of the present disclosure.
  • the electronic device 301 displays a second light (eg , a fourth image including the user's skin may be captured through the camera 340 in a state in which visible light (white light) is output.
  • a second light eg , a fourth image including the user's skin may be captured through the camera 340 in a state in which visible light (white light) is output.
  • the electronic device 301 may acquire and provide information on the sunscreen component applied to the user's skin based on the fourth image. For example, the electronic device 301 may visualize the fourth image to enhance the visibility of an area where the UV blocking component is applied (eg, an area where cloudiness occurs). Through this, the electronic device 301 may acquire an image with enhanced visibility in determining whether the reflective UV blocking component is applied.
  • the electronic device 301 may acquire and provide information on the sunscreen component applied to the user's skin based on the fourth image. For example, the electronic device 301 may visualize the fourth image to enhance the visibility of an area where the UV blocking component is applied (eg, an area where cloudiness occurs). Through this, the electronic device 301 may acquire an image with enhanced visibility in determining whether the reflective UV blocking component is applied.
  • FIG. 12 is a diagram for explaining an operation of obtaining a fourth image by outputting second light and obtaining an image obtained by visualizing the fourth image, by an electronic device, according to various embodiments of the present disclosure.
  • the electronic device 301 may capture (or obtain) the fourth image IM4 in a state in which the second light (eg, visible light (white light)) is output.
  • the fourth image IM4 may be a red, green, blue (RGB) based image.
  • the electronic device 301 may visualize the fourth image IM4 to enhance visibility.
  • the electronic device 301 may convert the color space or color space of the fourth image IM4 from RGB based on HSV (hue, saturation, value). That is, the electronic device 301 converts the fourth image IM4 into images based on hue, saturation, and value, and combines the converted images to form a seventh image IM7. ) can be created.
  • the conversion of the color space of the fourth image IM4 from RGB to HSV by the electronic device 301 is only exemplary, and the technical idea of the present invention may not be limited thereto.
  • the electronic device 301 may convert the color space of the fourth image IM4 to cyan magenta yellow key (CMYK) or CIE xyz other than HSV, leaving only one color (eg, Blue) in RGB Tuned visualization processing can be performed as well.
  • CYK cyan magenta yellow key
  • CIE xyz other than HSV leaving only one color (eg, Blue) in RGB Tuned visualization processing can be performed as well.
  • the electronic device 301 may display the seventh image IM7 on the display 360 .
  • the electronic device 301 may transmit a control command to the external electronic device 304 to display the seventh image IM7 on the display 385 of the external electronic device 304 .
  • the seventh image IM7 may be an image with enhanced visibility of the sunscreen 1210 applied to the user's skin (eg, face).
  • FIG. 13 is a diagram for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • the electronic device 301 applies a sunscreen component to the user's skin based on the third image (or fourth image) based on the first and second images or the seventh image based on the fourth image. It is possible to check the degree to which (e.g., sunscreen) is applied.
  • the electronic device 301 may check the degree to which the sunscreen is applied to the user's skin based on the average intensity and change in intensity of the sunscreen applied to the user's skin.
  • the intensity average may refer to a brightness level (eg, average brightness) of an image in which the user's skin is photographed. For example, if the average amount of sunscreen applied to the user's skin is less, the intensity average may be higher. Alternatively, the average strength may be higher as the average amount of sunscreen applied to the user's skin.
  • the change in intensity can represent the difference in sunscreen application between one point and another.
  • the electronic device 301 may determine that less or almost no sunscreen is applied except for some areas of the user's skin. can When it is determined that the average intensity is high and the change in intensity is medium (1320), the electronic device 301 may determine that almost no sunscreen is applied to the skin of the user. When the electronic device 301 determines that the average intensity is high and the change in intensity is low (1330), the electronic device 301 may determine that the sunscreen is not well washed or completely applied to the entire area of the user's skin.
  • the electronic device 301 may determine that the sunscreen has not been erased or applied well in some areas of the user's skin. When it is determined that the average intensity is medium and the change in intensity is medium (1350), the electronic device 301 may determine that the sunscreen is not erased or applied well in the entire area of the user's skin. When the electronic device 301 determines that the average intensity is medium and the change in intensity is low (1360), the electronic device 301 may determine that the sunscreen effect is low even though the electronic device 301 is applied evenly over the entire area of the user's skin.
  • the electronic device 301 may determine that the sunscreen is well applied to the entire area of the user's skin. Alternatively, when the average intensity is low, the electronic device 301 may determine that the sunscreen is well applied to the entire area of the user's skin regardless of the change in intensity.
  • the electronic device 301 may display a message indicating the degree to which the sunscreen is applied through the display 380 .
  • the electronic device 301 may display a message indicating the degree of application of the sunscreen on the display 385 of the external electronic device 304 .
  • 14A, 14B, and 14C are diagrams for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • an electronic device 1401 may photograph a user's face and provide information about the degree of face washing.
  • the electronic device 1401 may display the first object 1410 for starting the face washing level checking function on the display (eg, 360 or 385 in FIG. 3 ).
  • the electronic device 1401 may start a face wash level confirmation function in response to a user input for the first object 1410 .
  • the function of confirming the degree of face washing may be performed by the above-described method of acquiring information about sunscreen components (eg, sunscreen) applied to the user's skin.
  • the electronic device 1401 may determine that the face wash is clean.
  • the electronic device 1401 may display a first screen 1420 including a fifth image (or seventh image) obtained by visualizing the third image (or fourth image). Also, the electronic device 1401 may display a message 1425 indicating the degree of face washing.
  • the electronic device 1401 determines that the average intensity of the sunscreen applied to the user's face is medium (or low) and the change in intensity is high, the electronic device 1401 determines that the sunscreen is applied to a portion of the user's skin. It can be judged that it has not been erased.
  • the electronic device 1401 may display a second screen 1430 including a fifth image (or seventh image) obtained by visualizing the third image (or fourth image). Also, the electronic device 1401 may display a message 1435 indicating the degree of face washing.
  • 15A, 15B, and 15C are diagrams for explaining an operation of an electronic device providing information on a sunscreen component applied to a user's skin, according to various embodiments of the present disclosure.
  • an electronic device 1501 may photograph a user's face and check the application level of cosmetics.
  • the electronic device 1501 may display the second object 1510 for starting the makeup level checking function on the display (eg, 360 or 385 in FIG. 3 ).
  • the electronic device 1501 may start a makeup level checking function in response to a user input for the second object 1510 .
  • the makeup level check function may be performed by the above-described method of obtaining information on sunscreen components (eg, sunscreen) applied to the user's skin.
  • the electronic device 1501 may determine that makeup is evenly applied when it is determined that the average intensity of the sunscreen applied to the user's face is low and the change in intensity is low.
  • the electronic device 1501 may display a third screen 1520 including a fifth image (or seventh image) obtained by visualizing the third image (or fourth image). Also, the electronic device 1501 may display a message 1525 indicating a makeup level.
  • the electronic device 1501 determines that the sunscreen is not applied to some area of the user's skin. can do.
  • the electronic device 1501 may display a fourth screen 1530 including a fifth image (or seventh image) obtained by visualizing the third image (or fourth image).
  • the electronic device 1401 may display a message 1535 indicating a makeup level.
  • An electronic device (eg, the electronic device 301 of FIG. 3 ) according to various embodiments includes a camera, a light source unit including at least one light source element, a display, and a processor, wherein the processor operates through the light source unit.
  • a first image including the skin of the user is obtained through the camera in a state in which first light is output, and a second image including the skin of the user is obtained through the camera in a state in which the first light is not output.
  • obtaining a third image representing a difference between the first image and the second image by converting a difference between brightness values of the first image and the second image into a pixel value; Based on this, it may be set to display information on the sunscreen component applied to the skin on the display.
  • the processor may be configured to check the type of sunscreen component included in the user's cosmetics and determine whether to output the first light according to the check result.
  • the processor may be configured to obtain an image of the cosmetics through the camera and compare the image with pre-stored data to determine the type of sunscreen component included in the cosmetics.
  • the processor outputs a second light different from the first light through the light source unit when the UV blocking component includes a reflective UV blocking component, and outputs the second light through the camera in a state in which the second light is output.
  • a fourth image including the skin may be acquired, and based on the fourth image, information on the sunscreen component applied to the skin may be set to be displayed on the display.
  • the first light may include ultraviolet light
  • the second light may include visible light
  • the processor may be configured to display a fifth image visualized by converting a color space of the third image on the display.
  • the processor may be configured to display a sixth image visualized by applying a contrast characteristic of the third image to the second image on the display.
  • the processor converts first pixel values of the first image into first brightness values, converts second pixel values of the second image into second brightness values, and converts the first brightness values into first brightness values. Differences between the second brightness values may be converted into the pixel values, and the third image may be obtained based on the pixel values.
  • the processor determines first brightness values of the first image, second brightness values of the second image, and converts difference values between the first brightness values and the second brightness values into the pixel values. , and may be set to acquire the third image based on the pixel values.
  • An operating method of an electronic device includes a camera included in the electronic device in a state in which first light is output through a light source included in the electronic device. obtaining a first image including the user's skin through the camera, obtaining a second image including the skin through the camera in a state in which the first light is not output, the first image and the second image Converting the difference between the brightness values of each image into a pixel value to obtain a third image representing the difference between the first image and the second image, and applying the applied skin to the skin based on the third image.
  • An operation of displaying information on the sunscreen component on a display included in the electronic device may be included.
  • the operating method of the electronic device may further include checking the type of sunscreen component included in the user's cosmetics and determining whether to output the first light according to the checking result.
  • the operation of checking the type of the sunscreen ingredient may include an operation of obtaining an image of the cosmetics through the camera and an operation of comparing the image and pre-stored data to determine the type of the sunscreen ingredient included in the cosmetic product.
  • the method of operating the electronic device may include outputting a second light different from the first light through the light source unit when the UV blocking component includes a reflective UV blocking component, in a state in which the second light is output.
  • the method may further include obtaining a fourth image including the skin through the camera, and displaying information on the sunscreen component applied to the skin on the display based on the fourth image. .
  • the first light may include ultraviolet light
  • the second light may include visible light
  • the displaying of the information on the sunscreen component applied to the skin may include displaying a fifth image visualized by converting a color space of the third image on the display.
  • the displaying of the information on the sunscreen component applied to the skin may include displaying a sixth image visualized by applying a contrast characteristic of the third image to the second image on the display. .
  • the obtaining of the third image may include converting first pixel values of the first image into first brightness values, converting second pixel values of the second image into second brightness values,
  • the method may include converting difference values between the first brightness values and the second brightness values into the pixel values, and obtaining the third image based on the pixel values.
  • An electronic device (eg, the electronic device 301 of FIG. 3 ) according to various embodiments includes a camera, a display, and a processor, and the processor includes an external electronic device including at least one light source element to generate a first light source. transmits a first control command to the external electronic device to output a first light, acquires a first image including the user's skin through the camera in a state in which the first light is output, and transmits a second control command to the external electronic device so as not to output first light; acquires a second image including the skin of the user through the camera in a state in which the first light is not output; A third image representing a difference between the first image and the second image is obtained by converting a difference between brightness values of each of the first image and the second image into a pixel value, and the third image is obtained based on the third image.
  • Information on the sunscreen component applied to the user's skin may be provided.
  • the processor may be configured to transmit a third control command to the external electronic device so that information on the UV blocking component is displayed on a display included in the external electronic device.
  • the external electronic device when the external electronic device is implemented as a smart mirror, the electronic device is mounted on the external electronic device, and when the external electronic device is implemented in the form of an accessory, the external electronic device is detachable.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Analytical Chemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Telephone Function (AREA)

Abstract

L'invention concerne un dispositif électronique, qui selon divers modes de réalisation peut comprendre un appareil de prise de vues, une unité source de lumière, un afficheur et un processeur, le processeur étant configuré pour : obtenir une première image comprenant la peau d'un utilisateur par l'intermédiaire de l'appareil de prise de vues tandis qu'une première lumière est délivrée en sortie par l'intermédiaire de l'unité source de lumière ; obtenir une deuxième image de la peau de l'utilisateur par l'appareil de prise de vues tandis que la première lumière n'est pas délivrée en sortie ; convertir une différence entre les valeurs de luminosité de la première image et de la deuxième image en une première différence de valeur de pixel de façon à obtenir une troisième image représentant une différence entre la première image et la deuxième image ; et afficher, sur la base de la troisième image, des informations concernant un composant bloquant des ultraviolets (UV) appliqué sur la peau, sur le dispositif d'affichage.
PCT/KR2022/005050 2021-05-28 2022-04-07 Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci WO2022250284A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP22811477.3A EP4261527A4 (fr) 2021-05-28 2022-04-07 Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci
US17/736,369 US20220383605A1 (en) 2021-05-28 2022-05-04 Electronic device for identifying sunscreen applied to a user's skin and method of operating the same

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020210069094A KR20220160889A (ko) 2021-05-28 2021-05-28 사용자의 피부에 도포된 자외선 차단 성분을 확인하는 전자 장치와 이의 동작 방법
KR10-2021-0069094 2021-05-28

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/736,369 Continuation US20220383605A1 (en) 2021-05-28 2022-05-04 Electronic device for identifying sunscreen applied to a user's skin and method of operating the same

Publications (1)

Publication Number Publication Date
WO2022250284A1 true WO2022250284A1 (fr) 2022-12-01

Family

ID=84228300

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/005050 WO2022250284A1 (fr) 2021-05-28 2022-04-07 Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci

Country Status (2)

Country Link
KR (1) KR20220160889A (fr)
WO (1) WO2022250284A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005321333A (ja) * 2004-05-11 2005-11-17 Shiseido Co Ltd サンスクリーン化粧料の塗布状態判定方法及びサンスクリーン化粧料の洗浄性判定方法と、サンスクリーン化粧料の塗布状態判定装置
US20130300850A1 (en) * 2012-04-12 2013-11-14 Thomas Nathan Millikan Viewing and Processing Multispectral Images
KR20140042359A (ko) * 2012-09-28 2014-04-07 (주)아모레퍼시픽 화장료의 효능 평가 방법
KR20180107821A (ko) * 2017-03-23 2018-10-04 이동익 피부 관리 기능을 구비한 스마트폰
US20200107772A1 (en) * 2018-10-08 2020-04-09 HallStar Beauty and Personal Care Innovations Company Protection and skin damage detection devices and system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005321333A (ja) * 2004-05-11 2005-11-17 Shiseido Co Ltd サンスクリーン化粧料の塗布状態判定方法及びサンスクリーン化粧料の洗浄性判定方法と、サンスクリーン化粧料の塗布状態判定装置
US20130300850A1 (en) * 2012-04-12 2013-11-14 Thomas Nathan Millikan Viewing and Processing Multispectral Images
KR20140042359A (ko) * 2012-09-28 2014-04-07 (주)아모레퍼시픽 화장료의 효능 평가 방법
KR20180107821A (ko) * 2017-03-23 2018-10-04 이동익 피부 관리 기능을 구비한 스마트폰
US20200107772A1 (en) * 2018-10-08 2020-04-09 HallStar Beauty and Personal Care Innovations Company Protection and skin damage detection devices and system

Also Published As

Publication number Publication date
KR20220160889A (ko) 2022-12-06

Similar Documents

Publication Publication Date Title
WO2021075786A1 (fr) Dispositif électronique et procédé de traitement d'une fenêtre surgissante utilisant une multi-fenêtre de celui-ci
WO2021086040A1 (fr) Procédé pour la fourniture de prévisualisation et dispositif électronique pour l'affichage de prévisualisation
WO2020153738A1 (fr) Dispositif électronique et procédé de connexion d'un nœud de masse à un module de caméra
WO2022031032A1 (fr) Dispositif électronique et procédé d'affichage d'informations visuelles dans un contenu thématique
WO2024154920A1 (fr) Dispositif électronique et procédé de changement d'état d'affichage
WO2022075725A1 (fr) Appareil électronique et procédé permettant de mesurer la fluorescence de la peau à l'aide de l'appareil électronique
WO2022177299A1 (fr) Procédé de commande de fonction d'appel et dispositif électronique le prenant en charge
WO2022244970A1 (fr) Procédé de capture d'image de dispositif électronique, et dispositif électronique associé
WO2022250284A1 (fr) Dispositif électronique pour identification de composant bloquant les ultraviolets appliqué sur la peau d'un utilisateur, et procédé pour le fonctionnement de celui-ci
WO2022030921A1 (fr) Dispositif électronique, et procédé de commande de son écran
WO2022114648A1 (fr) Dispositif électronique de paramétrage d'un écran d'arrière-plan et procédé de fonctionnement dudit dispositif
WO2022092580A1 (fr) Procédé de prédiction de température de surface d'un dispositif électronique et ledit dispositif électronique
WO2022231168A1 (fr) Procédé et dispositif de reconnaissance faciale par inversion de couleurs sur un écran
WO2023080495A1 (fr) Dispositif électronique pour capturer des images à plage dynamique élevée, et son procédé de fonctionnement
WO2023101156A1 (fr) Dispositif électronique pour acquérir des données d'éclairement à l'aide d'un capteur d'image
WO2023287012A1 (fr) Procédé de génération de contenu sur la base des performances d'un dispositif externe, et dispositif électronique
WO2023287057A1 (fr) Dispositif électronique permettant de rapidement mettre à jour un écran lorsqu'une entrée est reçue en provenance d'un dispositif périphérique
WO2023106606A1 (fr) Serveur en nuage supportant une édition collaborative entre des dispositifs électroniques et son procédé de fonctionnement
WO2022154410A1 (fr) Procédé et dispositif électronique pour créer un effet de filtre d'image
WO2022245037A1 (fr) Dispositif électronique comprenant un capteur d'image et un capteur de vison dynamique, et son procédé de fonctionnement
WO2023153743A1 (fr) Dispositif électronique, et son procédé de fonctionnement
WO2022065844A1 (fr) Procédé d'affichage d'image de prévisualisation et appareil électronique le prenant en charge
WO2022240183A1 (fr) Procédé de génération de fichier comprenant des données d'image et des données de mouvement, et dispositif électronique associé
WO2023063563A1 (fr) Dispositif électronique comprenant des affichages multiples et procédé pour le faire fonctionner
WO2024071776A1 (fr) Procédé d'affichage d'objet de réalité augmentée et dispositif électronique le prenant en charge

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22811477

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022811477

Country of ref document: EP

Effective date: 20230710

NENP Non-entry into the national phase

Ref country code: DE