WO2021145571A1

WO2021145571A1 - Electronic device for checking calm state, and control method for same

Info

Publication number: WO2021145571A1
Application number: PCT/KR2020/018264
Authority: WO
Inventors: 이동현; 김효길; 강덕균; 박정민; 신상곤; 이준영
Original assignee: 삼성전자 주식회사
Priority date: 2020-01-13
Filing date: 2020-12-14
Publication date: 2021-07-22
Also published as: KR20210090986A

Abstract

An electronic device according to various embodiments comprises: at least one sensor including a photoplethysmogram (PPG) sensor; a processor; and at least one memory, wherein the at least one memory may store instructions that, when executed, cause a processor to: use the PPG sensor to acquire first data; use the PPG sensor to acquire second data on the basis that a heart rate (HR) corresponding to the first data and an acute stress value based on a reference heart rate satisfy a first condition; and check whether a state corresponding to the second data is a calm state on the basis that the ratio of a first intensity, in a first frequency range of heart rate variability (HRV) corresponding to the second data, to a second intensity, in a second frequency range different from the first frequency range, satisfies a second condition.

Description

Electronic device for checking a stable state and method for controlling the same

Various embodiments of the present disclosure relate to an electronic device for checking a stable state and an operating method thereof.

Recently, electronic devices including a sensor capable of measuring a user's biometric information have been developed. The user may measure body-related information by using the electronic device and determine his or her body condition.

The electronic device may measure various kinds of biometric information, such as a user's heart rate, oxygen saturation, stress, and blood pressure, by using a sensor. For example, the electronic device may sense a part of the user's body using the sensor. The electronic device may measure various pieces of biometric information of the user by using the sensing information acquired through the sensor.

As interest in mental health increases, a service for providing information related to stress using sensing information acquired through a sensor included in an electronic device is being developed.

Stress can be largely divided into acute stress and chronic stress, and chronic stress rather than acute stress may adversely affect health. As a conventional method for measuring the level of stress, there is a method of determining a high level of stress when the heart rate is regular using the distribution of the heart rate, but it is difficult to distinguish between acute stress and chronic stress.

In addition, chronic stress is not in sleep, and since a user must measure a biosignal in a stable state to calculate an accurate stress index, for professional measurement, the user maintains a stable state in a space such as a hospital. However, a user in an unfamiliar environment has the inconvenience that a stable state may not be maintained. In addition, there is no disclosure of a method for checking whether the user is in a stable state.

The electronic device and the method for controlling the same according to various embodiments of the present disclosure may identify a stable state based on data for each frequency band of a heart rate variability, and may distinguish a stable state from a user's sleep state.

According to various embodiments, an electronic device includes at least one sensor including a photoplethysmogram (PPG) sensor, a processor, and at least one memory, wherein the at least one memory, when executed, causes the processor to: First data is acquired using a sensor, and based on a heart rate (HR, heart rate) corresponding to the first data and an acute stress value based on a reference heart rate satisfy the first condition, the first data is obtained using the PPG sensor. acquiring 2 data, and a ratio of a first intensity of a first frequency range of a heart rate variability (HRV) corresponding to the second data and a second intensity of a second frequency range different from the first frequency range is a second Based on the satisfaction of a condition, instructions for checking whether a state corresponding to the second data is a calm state may be stored.

According to various embodiments, a method of controlling an electronic device (eg, the electronic device 101 of FIG. 1 ) including a heart rate sensor (PPG sensor, photoplethysmogram) includes: acquiring first data using the PPG sensor; an operation of acquiring second data using the PPG sensor based on a heart rate (HR) corresponding to the first data and an acute stress value based on a reference heart rate satisfying a first condition; the second data Based on a ratio of a first intensity of a first frequency range of a heart rate variability (HRV) corresponding to a and a second intensity of a second frequency range different from the first frequency range satisfying a second condition, the second It may include an operation of determining whether a state corresponding to the data is a stable (calm) state.

According to various embodiments, an electronic device (eg, the electronic device 101 of FIG. 1 ) includes a communication circuit, a processor, and at least one memory, wherein the at least one memory, when executed, causes the processor to: Receive stress information and user state information from an external electronic device through the communication circuit, check a time period in which the user state information corresponds to a stable state, and provide stress information corresponding to the time period to the user You can store instructions to do it.

An electronic device according to various embodiments of the present disclosure may provide an electronic device for checking a stable state in a state in which a user is not aware, and an operating method thereof.

In order to more fully understand the drawings recited in the Detailed Description of the Invention, a detailed description of each drawing is provided.

1 is a block diagram of an electronic device 101 in a network environment, according to various embodiments.

2 is a block diagram of an electronic device according to various embodiments of the present disclosure;

3 is a flowchart illustrating an operation of an electronic device determining a user's stable state, according to various embodiments of the present disclosure;

4 is a diagram illustrating a biosignal according to various embodiments of the present disclosure;

5 is a flowchart illustrating an operation in which an electronic device determines a user's awake state, according to various embodiments of the present disclosure;

6A and 6B are diagrams illustrating heart rate variability according to various embodiments of the present disclosure;

7 is a diagram illustrating heart rate variability according to various embodiments of the present disclosure;

8 is a flowchart illustrating an operation in which an electronic device determines a user's stable state, according to various embodiments of the present disclosure;

9A and 9B are diagrams for explaining a method of providing chronic stress information by an electronic device, according to various embodiments of the present disclosure;

10 is a view for explaining a method of measuring chronic stress in a stable state, according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments. Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input device 150 , a sound output device 155 , a display device 160 , an audio module 170 , and a sensor module ( 176 , interface 177 , haptic module 179 , camera module 180 , power management module 188 , battery 189 , communication module 190 , subscriber identification module 196 , or antenna module 197 . ) may be included. In some embodiments, at least one of these components (eg, the display device 160 or the camera module 180 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 160 (eg, a display).

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be loaded into the volatile memory 132 , process commands or data stored in the volatile memory 132 , and store the resulting data in the non-volatile memory 134 . According to an embodiment, the processor 120 includes a main processor 121 (eg, a central processing unit or an application processor), and a secondary processor 123 (eg, a graphics processing unit, an image signal processor) that can be operated independently or in conjunction with the main processor 121 . , a sensor hub processor, or a communication processor). Additionally or alternatively, the auxiliary processor 123 may be configured to use less power than the main processor 121 or to be specialized for a designated function. The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 may be, for example, on behalf of the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state, or when the main processor 121 is active (eg, executing an application). ), together with the main processor 121, at least one of the components of the electronic device 101 (eg, the display device 160, the sensor module 176, or the communication module 190) It is possible to control at least some of the related functions or states. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system 142 , middleware 144 , or an application 146 .

The input device 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101 . The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display device 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display device 160 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the corresponding device. According to an embodiment, the display device 160 may include a touch circuitry configured to sense a touch or a sensor circuit (eg, a pressure sensor) configured to measure the intensity of a force generated by the touch. there is.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input device 150 , or an external electronic device (eg, a sound output device 155 ) connected directly or wirelessly with the electronic device 101 . The sound may be output through the electronic device 102 (eg, a speaker or a headphone).

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an inertial sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). Among these communication modules, a corresponding communication module is a first network 198 (eg, a short-range communication network such as Bluetooth, WiFi direct, or IrDA (infrared data association)) or a second network 199 (eg, a cellular network, the Internet, or It may communicate with an external electronic device via a computer network (eg, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses the subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified and authenticated.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as a part of the antenna module 197 .

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the

electronic devices

102 and 104 may be the same or a different type of the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be executed by one or more of the external

electronic devices

102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. The one or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the execution result to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

As shown in FIG. 2 , the electronic device 201 according to various embodiments includes a processor 210 , a sensor 220 , a memory 230 , a display 240 , and a communication circuit 250 , and the sensor 220 . ) may include a photoplethysmogram (PPG) sensor 221 and an inertia measurement unit (IMU) sensor 223 .

According to various embodiments, the electronic device 201 may be implemented substantially the same as the electronic device 101 of FIG. 1 . For example, the electronic device 201 may include a wearable device or a smart watch.

According to various embodiments, the processor 210 may control the overall operation of the electronic device 201 . For example, the processor 210 may be implemented the same as or similar to the processor 120 of FIG. 1 .

According to various embodiments, the processor 210 may acquire the first data using the PPG sensor 221 . For example, the processor 210 may generate the first data by receiving the biosignal measured by the PPG sensor 221 . Based on the biosignal, in the time domain, the processor 210 performs the standard deviation of the NN interval (SDNN) indicating a change in heartbeat and a square root of the mean of the sum of the RMSSD (RMSSD) indicating the parasympathetic nerve activity of the heart. square of differences between adjacent NN internals) or pnn50 data. The processor 210 is based on the biosignal, in the frequency domain, total power for a predetermined time indicating the overall activity level of the autonomic nervous system, LF (low frequency) indicating the activity level of the sympathetic nerve, and the parasympathetic nervous system. Data such as HF (high frequency) indicating the degree of activity and LF/HF ratio indicating the overall balance of the autonomic nervous system can be checked. The first data may include data of at least a portion of a heart rate (per minute), an inter beat interval (IBI) in a time domain, and heart rate variability (HRV) in a frequency domain.

According to various embodiments, the processor 210 may obtain the first data to confirm the IBI and the heart rate. For example, the processor 210 may calculate the IBI and the heart rate by determining the time between the peaks of the biosignal using a peak detection algorithm. Meanwhile, the IBI indicates a time difference between adjacent peak signals among biosignals, and the heart rate may indicate the heart rate per minute.

According to various embodiments, the processor 210 may obtain a reference heart rate. For example, the processor 210 may receive the user's reference heart rate from an external electronic device (eg, the server 108 of FIG. 1 ) or from a memory (eg, the memory 130 of FIG. 1 ), and the user Since it is calculated based on the heart rate histogram of , the reference heart rate may be different for each user. When the value measured using the inertial sensor is less than or equal to the first threshold (eg, 60), and the ratio of the current heart rate to the reference heart rate is less than or equal to the second threshold (eg, 1.2) It can be defined as a state of rest. The electronic device 101 may update the reference heart rate by storing the current heart rate as the reference heart rate or transmitting the current heart rate to the external electronic device when the resting state continues for a specific period of time (eg, 3 minutes) or longer.

According to various embodiments, the processor 210 may identify a heart rate corresponding to the first data and an acute stress value based on the reference heart rate. For example, the processor 210 may be configured to perform acute through linear regression of a ratio (currHR/baseHR) of a heart rate (eg, currHR) and a reference heart rate (eg, baseHR) corresponding to the first data and IBI corresponding to the first data. The stress value can be calculated. For example, the acute stress value may be calculated as a value of 0-100. Meanwhile, when it is confirmed that the user is in a sleeping state based on the signal measured by the inertial sensor 223 , the processor 210 may not perform the operation of calculating the acute stress value. According to various embodiments, the processor 210 may cause the user to enter a sleep state (eg, a rapid eye movement (REM) sleep state, a deep sleep state, or a light sleep state) based on information obtained from the inertial sensor 223 . It may be checked whether the device is in a sleep state or not. According to various embodiments, the inertial sensor 233 may include an acceleration sensor, a gyro sensor or a gyroscope, or a combination thereof (eg, a 6-axis sensor). may include. However, the present invention is not limited thereto, and the inertial sensor 233 may include any sensor capable of acquiring information on the user's movement (or the movement of the electronic device 101 worn by the user).

According to various embodiments, when the acute stress value is less than or equal to a threshold value, the processor 210 may acquire the second data using the PPG sensor 221 . For example, the processor 210 may generate the second data by receiving the biosignal measured by the PPG sensor.

According to various embodiments, the processor 210 may check a heart rate variability (HRV) corresponding to the second data. For example, the processor 210 may generate an HRV by frequency-converting the biosignal.

According to various embodiments, the processor 210 may determine a ratio of the first intensity of the HRV in the first frequency range to the second intensity of the second frequency range. For example, the first frequency range of the HRV may be 0.04 Hz to 0.15 Hz, and the second frequency range may be 0.15 Hz to 0.4 Hz. The first frequency range is only a frequency range lower than the second frequency range, but is not limited thereto. For example, the first intensity of the first frequency range may be an indicator indicating the degree of sympathetic activity, and the second intensity of the second frequency range may be an indicator of the activity of the parasympathetic nervous system.

According to various embodiments, when the ratio of the first intensity of the first frequency range to the second intensity of the second frequency range is included in a set range, the processor 210 determines that the state corresponding to the second data is a calm state. You can check whether or not For example, when the user is not sleeping or right before sleep (that is, awake), the activity ratio of the sympathetic nerve and the parasympathetic nerve may appear about 1.1 to 1.2, so the processor 210 is configured in the first frequency range It may be checked whether the ratio of the first intensity of ? and the second intensity of the second frequency range is included in the set range. Accordingly, the processor 210 may determine that the acute stress value is less than or equal to the threshold and the waking state is the stable state.

3 is a flowchart illustrating an operation of an electronic device determining a user's stable state, according to various embodiments of the present disclosure; The embodiment of FIG. 3 will be described in detail with reference to FIG. 4 . 4 is a diagram illustrating a biosignal according to various embodiments of the present disclosure;

Referring to FIG. 3 , according to various embodiments, in operation 301 , an electronic device (eg, the electronic device 101 of FIG. 1 ) may acquire first data using a PPG sensor (photoplethysmogram (PPG)). For example, the electronic device 101 may receive the biosignal measured by the PPG sensor and generate the first data. The first data may include data of at least a portion of a heart rate (per minute), an inter beat interval (IBI) in a time domain, and heart rate variability (HRV) in a frequency domain. For example, a biosignal measured while the electronic device 101 is worn on the user's wrist may be displayed in the time domain as shown in FIG. 4 . In this case, the time between the

adjacent peaks

401 , 403 , 405 , 407 , 409 and 411 may be defined as IBI. The first data may be data based on biosignals corresponding to 20 time intervals (window size: 20) based on a specific time.

According to various embodiments, in operation 303 , the electronic device 101 receives the second data using the PPG sensor based on the heart rate corresponding to the first data and the acute stress value based on the reference heart rate satisfying the first condition. can be obtained For example, the electronic device 101 may calculate the acute stress value by using the ratio of the heart rate corresponding to the first data to the reference heart rate and the IBI. For example, the electronic device 101 uses an acute stress algorithm to generate a ratio (currHR/baseHR) of a heart rate (eg, currHR) corresponding to the first data to a reference heart rate (eg, baseHR) and a corresponding to the first data. Acute stress values can be calculated through linear regression of IBI. Meanwhile, a method for calculating the acute stress value may vary, and is not limited to using an acute stress algorithm. For example, the acute stress value may be expressed as a value of 0-100, and when the acute stress value is less than or equal to a threshold value (eg, 20), the electronic device 101 determines that the acute stress value satisfies the first condition. can be checked For example, when it is confirmed that the acute stress value satisfies the first condition, the electronic device 101 may generate second data based on the biosignal measured by the PPG sensor. The second data may be data based on a biosignal corresponding to 300 time intervals (window size: 300) based on a specific time. The window size of the second data may be, for example, larger than the window size of the first data, but there is no limitation on the number or the size relationship with the window size of the first data.

Meanwhile, the reference heart rate may be stored in a memory or may be received from an external electronic device. The reference heart rate may include, for example, information on heart rates for each user, or may be a value calculated based on a heart rate histogram. When the value measured using the inertial sensor is less than or equal to the first threshold (eg, 60), and the ratio of the current heart rate to the reference heart rate is less than or equal to the second threshold (eg, 1.2), the resting state is defined. can Meanwhile, defining the resting state using both the heart rate and the value measured by the inertial sensor is an example, and the resting state may be defined by any one of the two values. The electronic device 101 may update the current heart rate to the reference heart rate corresponding to the user when the resting state continues for a specific time period (eg, 3 minutes) or longer.

On the other hand, the biosignal measured by the PPG sensor may be logged only in a situation in which there is little movement of the user. Since a 300 window size may be required for conversion to the frequency domain, the electronic device 101 uses a sensor to perform second data having a window size of 300 or more based on information measured in 300 time sections based on a specific time. can create

According to various embodiments, in operation 305 , the electronic device 101 determines that a ratio of a first intensity of a first frequency range of an HRV corresponding to the second data and a second intensity of a second frequency range different from the first frequency is a second value. Based on the satisfaction of the condition, it may be checked whether the state corresponding to the second data is a calm state. the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range corresponds to a value within a predetermined range, and/or the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range When the change in is equal to or less than the threshold value, the electronic device 101 may determine that the second condition is satisfied. For example, if the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range is between 1.0 and 1.2, it may indicate that the user is in an awake state, and the awake state is determined for each user. The ranges indicated may be different. Alternatively, if the change in the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range is equal to or greater than the threshold value, it may be a short sleep of less than 1 hour or just before sleep, which is not detected by the sleep algorithm, so that the first The second condition may be set to be satisfied when the change in the ratio of the first intensity of the frequency range and the second intensity of the second frequency range is less than a threshold value.

If the acute stress value satisfies the first condition and the ratio of the first intensity of the first frequency range to the second intensity of the second frequency range of the HRV satisfies the second condition, the electronic device 101 determines that the user is stable ( calm) state.

Since the electronic device 101 can determine the stable state, chronic stress can be measured without intentionally maintaining the stable state in order to measure the chronic stress.

5 is a flowchart illustrating an operation in which an electronic device determines a user's awake state, according to various embodiments of the present disclosure; The embodiment of FIG. 5 will be described in more detail with reference to FIGS. 6A, 6B, and 7 . 6A and 6B are diagrams illustrating heart rate variability according to various embodiments of the present disclosure; 7 is a diagram illustrating heart rate variability according to various embodiments of the present disclosure;

Referring to FIG. 5 , according to various embodiments, in operation 501 , the electronic device (eg, the electronic device 101 of FIG. 1 ) may obtain a biosignal using a PPG sensor (photoplethysmogram (PPG)). For example, the electronic device 101 may receive a biosignal measured by the PPG sensor.

According to various embodiments, in operation 503 , the electronic device 101 may check heart rate variability (HRV) based on the biosignal. For example, the processor 210 may generate an HRV by converting the biosignal into a frequency domain.

According to various embodiments, in operation 505 , the electronic device 101 may identify a ratio of the first intensity of the HRV in the first frequency range and the second intensity of the second frequency range. The first frequency range may be a low frequency range, for example, 0.04Hz to 0.15Hz, and the second frequency range may be a high frequency range, for example, 0.15Hz to 0.4Hz. The first intensity of the first frequency range may indicate an activity level of the sympathetic nerve, and the second intensity of the second frequency range may indicate the activity level of the parasympathetic nerve. For example, FIG. 6A may be an HRV measured in a lying and resting state, and FIG. 6B may be an HRV measured in an oblique standing state. As shown in FIGS. 6A and 6B , it can be confirmed that the parasympathetic nerve in the lying and resting state ( FIG. 6A ) is more activated than the parasympathetic nerve in the oblique standing state ( FIG. 6B ). In addition, it can be confirmed that the sympathetic nerve in the oblique standing state (FIG. 6B) is more activated than the sympathetic nerve in the lying and resting state (FIG. 6A). The ratio (LF/HF ratio) (1.05) of the first intensity (LF) of the first frequency range and the second intensity (HF) of the second frequency range of the HRV in the supine resting state (Fig. 6a) is the state in which the patient is standing at an angle It can be seen that the LF / HF ratio (3.97) of (Fig. 6b) is smaller. In other words, the LF/HF ratio may vary depending on the user's condition, and the user's condition may be inferred using the LF/HF ratio.

According to various embodiments, in operation 507 , when the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range of the HRV satisfies the second condition, the electronic device 101 is awake. can be judged as The ratio of the first intensity of the first frequency range and the second intensity of the second frequency range may represent an activity ratio of the sympathetic nerve and the parasympathetic nerve, and thus may be different depending on the user's condition. For example, as shown in FIG. 7 , the ratio (LF/HF ratio) of the first intensity (LF) of the first frequency range and the second intensity (HF) of the second frequency range of HRV measured in a state in which the user is awake ) 701 may have a larger value than the LF/HF ratios (703, 705, 707, 709, 711, 713) measured in an awake state. Specifically, FIG. 7 shows an LF/HF ratio 701 of an awake state, a LF/HF ratio 703 of a state just before sleep (WBSO, wake before sleep onset), and a state immediately after sleep (WASO, wake after sleep). onset) of the LF/HF ratio 705, and the LF/

HF ratio

707, 709, 711, 713 of the sleep state (S1, S2, SWS, REMS). The average of the LF/HF ratio in each state may indicate whether the LF/HF ratio has a larger value or a smaller value compared to the LF/HF ratio of a daily mean of a specific user. For example, the LF/HF ratio 701 in an awake state may have a relatively large value by 20% compared to the user's daily average LF/HF ratio. In addition, the LF/HF ratio 703 of the state just before sleep (WBSO, wake before sleep onset) may have a relatively small value by 20% compared to the average daily LF/HF ratio of the user. In addition, the LF/HF ratio (705) of the state immediately after sleep (WASO, wake after sleep onset) and the LF/HF ratio (707, 709, 711, 713) of the sleep state (S1, S2, SWS REMS) are the It may have a relatively low value compared to the average LF/HF ratio. Therefore, although the state just before sleep WBSO is not a sleep state, when the rate of change 715 of the LF/HF ratio exceeds a threshold value, the electronic device 101 determines that the state just before sleep WBSO is not a awake state. can In addition, the LF/HF ratio 701 in the awake state may have a value of, for example, 1.1 to 1.2. When the LF/HF ratio has a value in a set range (eg, 1.1 to 1.2), the electronic device 101 may determine the awake state. The electronic device 101 may determine the awake state when the LF/HF ratio corresponds to a set range and the change in the LF/HF ratio is less than or equal to a threshold value. If the user has a short sleep of less than 1 hour, the sleep algorithm cannot be used to check the user's sleep. Therefore, when the change in the LF/HF ratio exceeds the threshold value, the accuracy of the sleep state determination can be increased by excluding the waking state.

Meanwhile, the electronic device 101 may obtain a representative value of the LF/HF ratio in the awake state. For example, in a waking state, the change rate of the LF/HF ratio according to time is small, and in a state where the user is drowsy or sleeps for less than 1 hour, the change rate of the LF/HF ratio according to time may be large. Accordingly, the dispersion of the LF / HF ratio is small (for example, 0.11 or less), and the user's elevation time and waking time and the value of the LF / HF ratio at a time difference of more than a certain time (for example, 1 hour) are calculated, and the average of the calculated values of the LF/HF ratio can be set as a representative value of the LF/HF ratio in the waking state. The electronic device 101 may set the range including the set representative value of the LF/HF ratio as the range of the LF/HF ratio for determining the awake state.

Referring to FIG. 8 , according to various embodiments, in operation 801 , a photoplethysmogram (PPG) (eg, the PPG sensor 221 of FIG. 2 ) may acquire a first signal. For example, the PPG sensor 820 may measure a biosignal from the user's wrist. For example, the processor 810 (eg, the processor 210 of FIG. 2 ) may receive a bio-signal from the PPG sensor 820 , and the bio-signal is displayed in a window size of 20 times based on a specific time. : 20) may be a signal corresponding to

According to various embodiments, in operation 803 , an acceleration sensor (eg, the inertial sensor 223 of FIG. 2 ) may acquire the second signal. For example, the ACC sensor 830 may measure a change in speed to measure a signal representing information about movement and transmit it to the processor 810 . Meanwhile, operation 803 may be performed after operation 805 or operation 807 is performed, and is not limited as long as it is performed before operation 809.

According to various embodiments, in operation 805 , the processor 810 may identify an acute stress value based on the first signal. The processor 810 uses the first signal to determine a heart rate (HR) indicating a heart rate per minute and an inter beat interval (IBI) indicating a time between adjacent peaks of a heartbeat in the time domain. and check heart rate variability (HRV) in the frequency domain. The processor 810 calculates an acute stress value through linear regression of a ratio (currHR/baseHR) between a heart rate (eg, curr HR) corresponding to the first signal and a reference heart rate (eg, base HR) and IBI corresponding to the first data. can be calculated. For example, the acute stress value may be calculated as a value of 0-100. Meanwhile, the reference heart rate may be received from an external electronic device and calculated based on the user's heart rate histogram, and thus the reference heart rate may be different for each user.

According to various embodiments, in operation 807 , the processor 810 may determine whether the acute stress value is less than a first threshold value. For example, when the maximum value of the acute stress value is 100, the first threshold value may be 20. Since the acute stress value may represent a temporarily high value when the user is surprised, nervous, or the like, a situation in which the user is temporarily stressed can be excluded by stipulating that the acute stress is equal to or less than the first threshold value. According to various embodiments, when the acute stress value is equal to or greater than the first threshold value, the first signal and the second signal may be checked by returning to

operations

801 and 803 .

According to various embodiments, when the acute stress value is less than the first threshold value, in operation 809 , the processor 810 may check a sleep state based on the first signal and the second signal. For example, the processor 810 may determine whether the user is sleeping through a sleep algorithm. According to various embodiments, if it is confirmed that the user is sleeping, the first signal and the second signal may be checked by returning to

operations

801 and 803 .

According to various embodiments, if it is determined that the user is not sleeping, in operation 811 , the PPG sensor 820 may acquire a third signal. For example, the processor 810 may receive a third signal from the PPG sensor 820 , and the third signal may be a signal corresponding to 300 time intervals (window size: 300) based on a specific time.

According to various embodiments, in operation 813 , the processor 810 may acquire the HRV based on the third signal. For example, the processor 810 may calculate the HRV by converting the third signal into a frequency domain.

According to various embodiments, in operation 815 , the ACC sensor 830 may acquire a fourth signal. For example, the ACC sensor 830 may measure a change in speed to measure a signal representing information about movement and transmit it to the processor 810 .

According to various embodiments, in operation 817 , the processor 810 may determine whether the user is sleeping based on the fourth signal through the sleep algorithm. According to various embodiments, if it is confirmed that the user is sleeping, the first signal and the second signal may be checked by returning to

operations

801 and 803 .

According to various embodiments, if it is determined that the user is not sleeping, in operation 819 , the processor 810 may determine whether the user state is an awake state based on the low frequency magnitude value of HRV and the high frequency magnitude value of HRV. there is. For example, when the ratio (LF/HF ratio) of the low-frequency amplitude value to the high-frequency amplitude value of HRV is included in the set range, the processor 810 may determine that the HRV is in an awake state. Meanwhile, in operation 817 , the processor 810 may determine whether it is a waking state or a sleep (REM, DEEP, LIGHT) state using a sleep algorithm. However, the state just before sleep (WBSO, wake before sleep onset) may be determined as the awake state. Accordingly, by using the LF/HF ratio, the state just before sleep can be classified as not the waking state.

According to various embodiments, in operation 821 , the processor 810 may check a calm state. For example, through operation 807, it is confirmed that the acute stress value is less than the first threshold, through operation 817, it is confirmed that the signal measured by the ACC sensor is not sleeping, and through operation 819, it is confirmed that the signal measured by the PPG sensor is By checking in the awake state, it can be confirmed that the state is stable.

9A is a diagram for describing a method of providing chronic stress information by an electronic device, according to various embodiments of the present disclosure; 9B is a diagram for explaining a method of providing chronic stress information by an electronic device, according to various embodiments;

According to various embodiments, the electronic device 101 may identify a time period determined as a calm state. For example, the electronic device 101 may define a state in which the acute stress value is less than or equal to the threshold value and the user is not sleeping as the stable state, and may identify a corresponding time period. The electronic device 101 may provide chronic stress information based on a biosignal measured in a time period determined to be in a stable state. For example, as shown in FIG. 9A , the electronic device 101 may determine October 20 from 17:00 to 18:30 as the stable state, and may display the chronic stress index in the stable state through the display. Alternatively, the electronic device 101 may provide the user with information about the time period determined to be in a stable state. The electronic device 101 may provide not only information about the time period determined to be in a stable state, but also context information (eg, location information, time information, and activity information) corresponding to the time period determined to be in a stable state. . Accordingly, the user may be provided with information on whether the chronic stress index is high at which location or when performing any activity.

According to various embodiments of the present disclosure, when it is determined that the chronic stress index exceeds the first threshold (ie, mentally stressed state), the electronic device 101 may provide content, music, and the like. For example, as shown in FIG. 9B , when it is determined that the chronic stress index exceeds the first threshold value, the electronic device 101 notifies that the chronic stress index is “high” and reproduces a recommended image to reproduce a recommended image. An icon, a recommended music play icon for playing recommended music, and/or a stress information check icon for confirming stress information may be displayed. For example, when the user selects a recommended image playback icon, the electronic device 101 plays a meditation image through an external device (eg, a smart TV in Home IoT) connected through short-range communication, or the electronic device 101 ) through the display of the meditation image can be played. For example, when the user selects a recommended music play icon, the electronic device 101 plays the recommended music through an external device (eg, an AI speaker) connected through short-range communication or uses the speaker of the electronic device 101 . You can play recommended music through

According to various embodiments of the present disclosure, when the time for which the chronic stress index exceeds the second threshold is longer than a set time (ie, when mental stress continues in a high state), the electronic device 101 is configured with a counseling institution (eg, a hospital). ) to request a consultation service, or to send a notification message to a designated contact.

The electronic device 101 may identify a state in which the acute stress value is less than or equal to a threshold value and is not sleeping as a stable state. Referring to FIG. 10 , the chronic stress level measured by the electronic device 101 may be displayed as dots. The electronic device 101 may display a line 1010 connecting only chronic stress values measured in a stable state. That is, since the chronic stress levels not connected by the line 1010 are measured in a non-steady state, the electronic device 101 determines the stable state, thereby increasing the accuracy of chronic stress measurement by not determining the chronic stress level. can be raised

According to various embodiments, the electronic device (eg, the electronic device 101 ) includes at least one sensor including a photoplethysmogram (PPG) sensor, a processor, and at least one memory, wherein the at least one memory is executed At the time, the processor acquires first data using the PPG sensor, and an acute stress value based on a heart rate (HR) and a reference heart rate corresponding to the first data satisfies the first condition. to obtain second data using the PPG sensor, and a first intensity in a first frequency range of a heart rate variability (HRV) corresponding to the second data and a second frequency different from the first frequency range Based on the ratio of the second intensity of the range satisfying the second condition, instructions may be stored to determine whether the state corresponding to the second data is a calm state.

According to various embodiments, the at least one sensor further comprises an inertial sensor, and the instructions, when executed, cause the processor to obtain third data using the inertial sensor, based on the third data. You can check whether you are sleeping or not.

According to various embodiments, the first frequency range is a lower frequency range than the second frequency range, and the instructions, when executed, cause the processor to: When the rate of change of the ratio of the second intensity of the frequency range is equal to or less than the threshold value, it may be confirmed that the second condition is satisfied.

According to various embodiments, the first intensity of the first frequency range may indicate the degree of activation of the sympathetic nervous system, and the second intensity of the second frequency range may represent the degree of activation of the sympathetic nervous system.

According to various embodiments, the instructions, when executed, cause the processor to: identify a time interval corresponding to the steady state, the first intensity of the first frequency range of HRV corresponding to the time interval and the first It is possible to store the ratio of the second intensity of the two frequency ranges.

According to various embodiments, the instructions, when executed, may cause the processor to check context information corresponding to a time interval corresponding to the stable state.

According to various embodiments, the context information may include at least some of location information, time information, and activity information corresponding to a time section corresponding to the stable state.

According to various embodiments, the instructions, when executed, may cause the processor to display a stress index corresponding to a time interval corresponding to the steady state.

According to various embodiments, the instructions, when executed, may cause the processor to determine the reference heart rate, and determine the acute stress value based on the heart rate corresponding to the first data and the reference heart rate. .

According to various embodiments, the reference heart rate may be received from an external electronic device and may be calculated based on a heart rate histogram of a user of the electronic device.

According to various embodiments, a method of controlling an electronic device (eg, the electronic device 101 of FIG. 1 ) including a photoplethysmogram (PPG) sensor includes: acquiring first data using the PPG sensor; An operation of acquiring second data using the PPG sensor based on a heart rate (HR, heart rate) corresponding to the data and an acute stress value based on a reference heart rate satisfying a first condition, corresponding to the second data Based on a ratio of a first intensity of a first frequency range of a heart rate variability (HRV) and a second intensity of a second frequency range different from the first frequency range satisfying a second condition, corresponding to the second data It may include an operation to determine whether the state to be stable (calm) state.

According to various embodiments, the method may further include obtaining third data using an inertial sensor of the electronic device, and determining whether the user is in a sleep state based on the third data.

According to various embodiments, the first frequency range is a lower frequency range than the second frequency range, and the rate of change of the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range is less than or equal to a threshold value. In this case, the method may further include confirming that the second condition is satisfied.

According to various embodiments, the operation of determining a time interval corresponding to the steady state and the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range of the HRV corresponding to the time period It may further include an operation of saving.

According to various embodiments, the method may further include checking context information corresponding to a time interval corresponding to the stable state.

According to various embodiments, a stress index corresponding to a time interval corresponding to the stable state may be displayed.

According to various embodiments, the method may further include an operation of confirming the reference heart rate and an operation of confirming the acute stress value based on a heart rate corresponding to the first data and the reference heart rate.

The master device or the task performing device according to various embodiments disclosed in this document may be various types of devices. The master device or task performing device may include, for example, a computer device, a portable communication device (eg, a smartphone), a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The master device or the task performing device according to the embodiment of the present document is not limited to the above-described devices.

It should be understood that the various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B," "A, B or C," "at least one of A, B and C," and "A , B, or C" each may include any one of, or all possible combinations of, items listed together in the corresponding one of the phrases. Terms such as “first”, “second”, or “first” or “second” may simply be used to distinguish the component from other components in question, and may refer to components in other aspects (e.g., importance or order) is not limited. that one (eg first) component is “coupled” or “connected” to another (eg, second) component with or without the terms “functionally” or “communicatively” When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

As used herein, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include software (eg, one or more instructions stored in a storage medium (eg, internal memory or external memory) readable by a machine (eg, a master device or a task performing device)) Example: program). For example, the processor of the device (eg, a master device or a task performing device) may call at least one of the one or more instructions stored from the storage medium and execute it. This makes it possible for the device to be operated to perform at least one function according to the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not include a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a device-readable storage medium (eg compact disc read only memory (CD-ROM)), or through an application store (eg Play Store™) or on two user devices (eg, It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations are executed in a different order, or omitted. or one or more other operations may be added.

Claims

In an electronic device,

at least one sensor including a photoplethysmogram (PPG) sensor;

processor; and

at least one memory; wherein the at least one memory, when executed, causes the processor to:

Obtaining first data using the PPG sensor,

Obtaining second data using the PPG sensor based on an acute stress value based on a heart rate (HR, heart rate) and a reference heart rate corresponding to the first data satisfies a first condition,

based on a ratio of a first intensity of a first frequency range of a heart rate variability (HRV) corresponding to the second data and a second intensity of a second frequency range different from the first frequency range satisfying a second condition; , an electronic device that stores instructions for checking whether a state corresponding to the second data is a calm state.
According to claim 1,

The at least one sensor further comprises an inertial sensor,

The instructions, when executed, cause the processor to:

acquiring third data using the inertial sensor,

and to determine whether the user is in a sleep state based on the third data.
According to claim 1,

The range of the first frequency is a lower frequency range than the range of the second frequency,

The instructions, when executed, cause the processor to:

and when the rate of change of the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range is equal to or less than a threshold value, it is determined that the second condition is satisfied.
4. The method of claim 3,

The first intensity of the first frequency range represents an activation degree of the sympathetic nervous system, and the second intensity of the second frequency range represents the activation degree of the parasympathetic nervous system.
According to claim 1,

The instructions, when executed, cause the processor to:

Check the time interval corresponding to the steady state,

and store a ratio of the first intensity of the first frequency range and the second intensity of the second frequency range of the HRV corresponding to the time interval.
According to claim 1,

The instructions, when executed, cause the processor to:

Check the situation information corresponding to the time period corresponding to the stable state,

The context information includes at least a portion of location information, time information, and activity information corresponding to a time section corresponding to the stable state.
According to claim 1,

The instructions, when executed, cause the processor to:

to display a stress index corresponding to a time interval corresponding to the stable state.
According to claim 1,

The instructions, when executed, cause the processor to:

Check the reference heart rate,

check the acute stress value based on a heart rate corresponding to the first data and the reference heart rate, wherein the reference heart rate is received from an external electronic device and is calculated based on a heart rate histogram of a user of the electronic device; Device.
A method for controlling an electronic device including a photoplethysmogram (PPG) sensor, the method comprising:

acquiring first data using the PPG sensor;

acquiring second data using the PPG sensor based on a heart rate (HR) corresponding to the first data and an acute stress value based on a reference heart rate satisfying a first condition;

based on a ratio of a first intensity of a first frequency range of a heart rate variability (HRV) corresponding to the second data and a second intensity of a second frequency range different from the first frequency range satisfying a second condition; , the operation of determining whether the state corresponding to the second data is a stable (calm) state; a control method comprising a.
10. The method of claim 9,

acquiring third data using an inertial sensor of the electronic device; and

The control method further comprising; checking whether the sleep state based on the third data.
10. The method of claim 9,

the first frequency range is a lower frequency range than the second frequency range;

and determining that the second condition is satisfied when the rate of change of the ratio of the first intensity of the first frequency range and the second intensity of the second frequency range is equal to or less than a threshold value.
12. The method of claim 11,

A first intensity of the first frequency range represents an activation degree of the sympathetic nervous system, and a second intensity of the second frequency range represents an activation degree of the sympathetic nervous system.
10. The method of claim 9,

checking a time interval corresponding to the stable state; and

and storing a ratio of the first intensity of the first frequency range and the second intensity of the second frequency range of the HRV corresponding to the time interval.
10. The method of claim 9,

Further comprising; checking the context information corresponding to the time period corresponding to the stable state; wherein the context information is at least a portion of location information, time information, and activity information corresponding to the time period corresponding to the stable state Including, a control method.
10. The method of claim 9,

checking the reference heart rate; and

and checking the acute stress value based on the heart rate corresponding to the first data and the reference heart rate.