KR102602426B1 - Method and system for providing health assistant information in conversational format in conjunction with wearable sensor - Google Patents

Abstract

Disclosed is a method and system for providing health assistant information in a conversational format in conjunction with a wearable sensor. A method of providing health assistant information according to an embodiment includes receiving bio-signals measured by a wearable sensor attached to the outside of the user's body, generating health assistant information based on the received bio-signals, and providing the health assistant information. It may include generating interactive expression information for transmission and providing the generated interactive expression information to the user.

Description

Method and system for providing health assistant information in conversational format in conjunction with wearable sensors {METHOD AND SYSTEM FOR PROVIDING HEALTH ASSISTANT INFORMATION IN CONVERSATIONAL FORMAT IN CONJUNCTION WITH WEARABLE SENSOR}

The description below relates to a method and system for providing health assistant information in a conversational format in conjunction with a wearable sensor.

Technology is known for analyzing the input information using an application that receives information on an individual's health status and providing the user with health assistant information on diet or exercise appropriate for each individual.

In addition, in providing health assistant information, there is technology that uses interactive chatbots to provide various information needed to users in real time in a conversational format.

[Prior art document number]

Korean Patent Publication No. 10-2022-0122855

Provides a method and system for providing health assistant information to users in a conversational format in conjunction with wearable sensors.

A method of providing health assistant information by a computer device including at least one processor, comprising: receiving, by the at least one processor, bio-signals measured by a wearable sensor attached to the outside of a user's body; generating, by the at least one processor, health assistant information based on the received biosignal; generating, by the at least one processor, interactive representation information for conveying the health assistant information; and providing, by the at least one processor, the generated interactive expression information to the user.

According to one side, the method of providing health assistant information includes: storing information about a plurality of virtual characters in a storage by the at least one processor; and providing, by the at least one processor, information about the plurality of characters to a user, wherein generating the interactive expression information includes selecting a character selected by the user from among the plurality of characters. It may be characterized by generating the interactive expression information according to.

According to another aspect, at least one of different speech styles and different intensity of expressions is predefined for each of the plurality of characters, and the step of generating the interactive expression information includes predefined speech patterns and expressions for the selected character. The interactive expression information may be generated based on at least one of the strengths of .

According to another aspect, the health assistant information includes information for inducing the user to take action for dieting, and the intensity of the expression is predefined for each of the plurality of characters as the intensity of the expression to induce the action. It can be characterized as:

According to another aspect, the plurality of characters include characters that appear in at least one previously released content, and the speaking style of a first character among the plurality of characters is the first character in the content in which the first character appears. 1 It can be characterized as including the character’s speaking style.

According to another aspect, the step of providing the generated interactive expression information may be characterized by providing the generated interactive expression information to the user using the selected character.

According to another aspect, the step of providing the generated interactive expression information includes linking interactive expression information about health assistant information generated on a date selected in a calendar with the selected date to the user through the selected character. It can be characterized by providing.

According to another aspect, the wearable sensor is a sensor that is attached to the outside of the user's body and measures biological signals for the user by at least one of an optical measurement method, a thermal measurement method, an electromagnetic measurement method, and an acoustic measurement method. It may be characterized as including.

According to another aspect, the biosignal includes at least one biometric information of blood sugar, calories, skeletal muscle mass, body fat mass, number of steps, activity level, body water, and body weight, and the method of providing health assistant information includes: The method may further include displaying, by at least one processor, graph data for the at least one piece of biometric information in association with a calendar for at least one period of date, week, month, and year.

According to another aspect, providing, by the at least one processor, a list of calorie information for each food corresponding to information input by a user; and providing, by the at least one processor, calorie intake information reflecting the calories of the selected specific food in response to the user selecting a specific food from the list.

According to another aspect, the method for providing health assistant information includes determining, by the at least one processor, a location of the user; collecting information about the user's food intake using the determined location and sensor information, by the at least one processor; and providing, by the at least one processor, a notification according to the collected information to the user.

A computer program stored on a computer-readable recording medium is provided in conjunction with a computer device to execute the method on the computer device.

Provided is a computer-readable recording medium on which a program for executing the above method on a computer device is recorded.

At least one processor implemented to execute instructions readable by a computer device, receiving bio-signals measured by a wearable sensor attached to the outside of the user's body by the at least one processor, and performing an operation on the received bio-signals. A computer device may be provided, which generates health assistant information based on the health assistant information, generates interactive expression information for conveying the health assistant information, and provides the generated interactive expression information to the user.

By linking with wearable sensors, health assistant information can be provided to users in a conversational format.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention.
Figure 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention.
Figure 3 is a diagram showing an example of the general appearance of a health assistant information providing system according to an embodiment of the present invention.
Figure 4 is a flowchart showing an example of a method for providing health assistant information according to an embodiment of the present invention.
Figure 5 is a diagram illustrating an example of providing graph data according to an embodiment of the present invention.
Figure 6 is a diagram illustrating an example of providing interactive expression information according to an embodiment of the present invention.
Figure 7 is a flowchart showing an example of a method for providing calorie information of food according to an embodiment of the present invention.
Figure 8 is a diagram illustrating an example of providing calorie information of food according to an embodiment of the present invention.
Figure 9 is a flowchart illustrating an example of a method for providing a notification about food intake based on location, according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the attached drawings. However, various changes may be made to the embodiments, so the scope of the claims of the patent application is not limited or limited by these embodiments. It is to be understood that all changes, equivalents, and substitutes for the embodiments are encompassed by the scope of the claims.

The terms used in the examples are for descriptive purposes only and should not be construed as limiting. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the embodiments belong. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless clearly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

In addition, when describing with reference to the accompanying drawings, identical components will be assigned the same reference numerals regardless of the reference numerals, and overlapping descriptions thereof will be omitted. In describing the embodiments, if it is determined that detailed descriptions of related known technologies may unnecessarily obscure the gist of the embodiments, the detailed descriptions are omitted.

Additionally, in describing the components of the embodiment, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, sequence, or order of the component is not limited by the term. When a component is described as being "connected," "coupled," or "connected" to another component, that component may be directly connected or connected to that other component, but there is no need for another component between each component. It should be understood that may be “connected,” “combined,” or “connected.”

Components included in one embodiment and components including common functions will be described using the same names in other embodiments. Unless stated to the contrary, the description given in one embodiment may be applied to other embodiments, and detailed description will be omitted to the extent of overlap.

The health assistant information provision system according to embodiments of the present invention may be implemented by at least one computer device, and the health assistant information provision method according to embodiments of the present invention may include at least one computer device included in the health assistant information provision system. It can be performed through a computer device. The computer program according to an embodiment of the present invention may be installed and driven in the computer device, and the computer device may perform the method of providing health assistant information according to the embodiment of the present invention under the control of the driven computer program. . The above-described computer program can be combined with a computer device and stored in a computer-readable recording medium to execute the method of providing health assistant information on a computer.

1 is a diagram illustrating an example of a network environment according to an embodiment of the present invention. The network environment in FIG. 1 shows an example including a plurality of electronic devices 110, 120, 130, and 140, a plurality of servers 150 and 160, and a network 170. Figure 1 is an example for explaining the invention, and the number of electronic devices or servers is not limited as in Figure 1. In addition, the network environment in FIG. 1 only explains one example of environments applicable to the present embodiments, and the environment applicable to the present embodiments is not limited to the network environment in FIG. 1.

The plurality of electronic devices 110, 120, 130, and 140 may be fixed terminals or mobile terminals implemented as computer devices. Examples of the plurality of electronic devices 110, 120, 130, and 140 include smart phones, mobile phones, navigation devices, computers, laptops, digital broadcasting terminals, PDAs (Personal Digital Assistants), and PMPs (Portable Multimedia Players). ), tablet PC, etc. For example, in FIG. 1, the shape of a smartphone is shown as an example of the electronic device 110. However, in embodiments of the present invention, the electronic device 110 actually communicates with other devices through the network 170 using a wireless or wired communication method. It may refer to one of various physical computer devices capable of communicating with electronic devices 120, 130, 140 and/or servers 150, 160.

The communication method is not limited, and may include not only a communication method utilizing a communication network that the network 170 may include (for example, a mobile communication network, wired Internet, wireless Internet, and a broadcast network), but also short-range wireless communication between devices. For example, the network 170 may include a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), and a broadband network (BBN). , may include one or more arbitrary networks such as the Internet. Additionally, the network 170 may include any one or more of network topologies including a bus network, star network, ring network, mesh network, star-bus network, tree or hierarchical network, etc. Not limited.

Each of the servers 150 and 160 is a computer device or a plurality of computers that communicate with a plurality of electronic devices 110, 120, 130, 140 and a network 170 to provide commands, codes, files, content, services, etc. It can be implemented with devices. For example, the server 150 may be a system that provides services to a plurality of electronic devices 110, 120, 130, and 140 connected through the network 170.

Figure 2 is a block diagram showing an example of a computer device according to an embodiment of the present invention. Each of the plurality of electronic devices 110, 120, 130, and 140 described above or each of the servers 150 and 160 may be implemented by the computer device 200 shown in FIG. 2.

As shown in FIG. 2, this computer device 200 may include a memory 210, a processor 220, a communication interface 230, and an input/output interface 240. The memory 210 is a computer-readable recording medium and may include a non-permanent mass storage device such as random access memory (RAM), read only memory (ROM), and a disk drive. Here, non-perishable large-capacity recording devices such as ROM and disk drives may be included in the computer device 200 as a separate permanent storage device that is distinct from the memory 210. Additionally, an operating system and at least one program code may be stored in the memory 210. These software components may be loaded into the memory 210 from a computer-readable recording medium separate from the memory 210. Such separate computer-readable recording media may include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, and memory cards. In another embodiment, software components may be loaded into the memory 210 through the communication interface 230 rather than a computer-readable recording medium. For example, software components may be loaded into memory 210 of computer device 200 based on computer programs installed by files received over network 170.

The processor 220 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input/output operations. Commands may be provided to the processor 220 by the memory 210 or the communication interface 230. For example, processor 220 may be configured to execute received instructions according to program code stored in a recording device such as memory 210.

The communication interface 230 may provide a function for the computer device 200 to communicate with other devices (eg, the storage devices described above) through the network 170. For example, a request, command, data, file, etc. generated by the processor 220 of the computer device 200 according to a program code stored in a recording device such as memory 210 is transmitted to the network ( 170) and can be transmitted to other devices. Conversely, signals, commands, data, files, etc. from other devices may be received by the computer device 200 through the communication interface 230 of the computer device 200 via the network 170. Signals, commands, data, etc. received through the communication interface 230 may be transmitted to the processor 220 or memory 210, and files, etc. may be stored in a storage medium (as described above) that the computer device 200 may further include. It can be stored as a permanent storage device).

The input/output interface 240 may be a means for interfacing with the input/output device 250. For example, input devices may include devices such as a microphone, keyboard, or mouse, and output devices may include devices such as displays and speakers. As another example, the input/output interface 240 may be a means for interfacing with a device that integrates input and output functions, such as a touch screen. The input/output device 250 may be configured as a single device with the computer device 200.

Additionally, in other embodiments, computer device 200 may include fewer or more components than those of FIG. 2 . However, there is no need to clearly show most prior art components. For example, the computer device 200 may be implemented to include at least some of the input/output devices 250 described above, or may further include other components such as a transceiver, a database, etc.

Figure 3 is a diagram showing an example of the general appearance of a health assistant information providing system according to an embodiment of the present invention. The health assistant information providing system 300 according to the embodiment of FIG. 3 may include a biometric sensor 310, a user terminal 320, and a biometric information server 330.

The biometric sensor 310 may be a wearable sensor device that collects and provides biometric information of a user using the user terminal 320 from outside the user's body. For example, the biometric sensor 310 may be a patch-type sensor attached to the user's skin or a sensor included in a smart watch placed on the user's wrist, but is not limited thereto. For example, at least one of various types of sensors that can non-invasively acquire a user's biometric information may be used as the biometric sensor 310. Although FIG. 3 shows one biometric sensor 310, multiple biometric sensors may be used. The method by which the biometric sensor 310 collects biometric information may also vary. For example, the biometric sensor 310 may collect the user's biometric information using at least one of an optical measurement method, a thermal measurement method, and an electromagnetic measurement method.

Table 1 below shows an example of a method of non-invasively measuring blood sugar in an in vitro body fluid form as an example of biometric information.

division detailed technology Advantages disadvantage optics
(fusion) Surface Plasmon Resonance (SPR) ·High sensitivity
·Easy to combine with nanotechnology Sensitive to movement, sweat, and body temperature
·Difficult in non-invasive measurement Fluorescence ·Very high blood sugar sensitivity (up to single molecule level)
·High specificity for blood sugar (molecular optical properties)
·No effect on light scattering Vulnerable to interference due to pH changes and oxygen levels
· Potential toxicity issues of biological foreign substances
Short-lived phosphor, vulnerable to self-fluorescence Optical polarity Easy miniaturization of very high resolution optical components Sensitive to temperature changes, movement, and light interference
·Long measurement time (~30 minutes) Otical Coherence Tomography (OCT) ·High resolution, signal-to-noise ratio
·Insensitive to blood pressure, heart rate, and red blood cell volume ·Sensitive to temperature changes and movements of the skin
·Vulnerable to organizational heterogeneity NIRSpectroscopy ·Optical properties with high water permeability
·Relatively advantageous for low price
·Signal intensity directly proportional to blood sugar concentration ·Possible reading errors due to uneven blood sugar distribution
·Difficult to measure accurately at low blood sugar concentration
·Low blood sugar characteristics, high optical scattering MIR Spectroscopy Low light scattering compared to NIR, high blood sugar light absorption
·High light absorption characteristics at specific MIR wavelengths ·Only reflection measurements possible with limited penetration depth
·Strong water absorption, high price tag Raman Spectroscopy ·High specificity
·Low sensitivity to temperature changes and water components
·Measuring scattered light, so it is independent of surface characteristics Interference from other molecules such as hemoglobin
·Sensitive to instability of laser wavelength and intensity
·Long collection time, susceptible to noise interference and fluorescence FIR/THzSpectroscopy ·Low light scattering characteristics compared to NIR and MIR ·Very high water absorption
Very low molecular identification TOF/Thz-TDSSpectroscopy ·Low effect on background noise
·Research over a wide frequency range with a single microwave
·Complicated dielectric constant measurement possible with a single scan ·Long measurement time
·Low spatial/depth resolution Photoacoustic Spectroscopy ·Relatively simple method
·Has little effect on water, salt, cholesterol, and albumin
·No influence from scattered particles ·Influences changes in temperature, pulsation, movement and ambient noise
·Low signal noise ratio
·Measurement data integration time heat Thermal Emission Spectroscopy ·Passive measurement technology (no active elements required)
·Excellent blood glucose wavelength selectivity (9.4μm)
·No risk of damage to living organisms, no need for correction Sensitive to temperature changes and movement
·Radiation intensity sensitive to tissue thickness
·Not suitable for rapid measurement of blood sugar changes Metabolic Heat Conformation ·Easy biometric information measurement ·Sensitive to environmental changes including temperature and sweat electromagnetic Millimeter and Microwave Sensing ·Sufficient signal penetration depth into hyperglycemic tissue
·No ionization risk
Sensitive to changes in blood sugar concentration ·Sensitive to biological differences in blood
·Sensitive to physiological variables such as breathing, sweat, and heart rate
·Low selectivity Electromagnetic Sensing ·Minimize interference from other media when using a single frequency
·No ionization risk ·Very sensitive to temperature Bioimpedance Spectroscopy ·Relatively low cost
·Easy to measure on the skin Sensitive to temperature changes, movement, and sweat
·Sensitive to physiological conditions affecting cell membranes sound Ultrasound ·Less influence on penetration depth and skin color changes Sensitive to air temperature

For example, electromagnetic-based attachable in vitro biosensors include a measurement method using impedance and a method using high-frequency signals. When mm waves or μm waves are used, resonance frequency transitions of S ₁₁ and S ₂₁ and S ₁₁ and S ₂₁ By checking the level shift, biometric information such as glucose concentration can be measured. In addition, optical-based attachable in vitro biosensors include methods such as SPR and Raman Spectroscopy, as previously explained in Table 1. can be used, and the SPR method measures the degree of transition of SPR resonance, and Raman spectroscopy can measure the degree of wavelength shift of Raman scattering light to measure biometric information such as glucose concentration.

In relation to optical-based biosensors, as a more specific example, two types of light in distinct wavelength bands are emitted, the reflected light reflected from the biological tissue is collected by wavelength, and the amount of reflection in the two wavelengths is measured respectively. By calculating the concentration of a sample in a biological tissue with reflection characteristics specific to light in a specific wavelength band of the two wavelength bands according to the ratio between the two reflection amounts, biometric information such as the concentration of glucose can be obtained.

As another example, through an optical module consisting of an SRS (Stimulated Raman Scattering) module that uses two laser lights, a pump light and a Stokes light, as a measurement light source, the output of the optical module, the measured temperature of the subject, and the bioimpedance of the subject are measured. You can also calculate the concentration of the sample using .

Table 1 describes measurement methods for measuring blood sugar (glucose concentration) among various biological information, but in addition to blood sugar, biometric information includes calories, skeletal muscle mass, body fat mass, number of steps, activity level, body water, and/or body weight. It may contain a variety of information, and various sensors may exist to measure each biometric information. Depending on the embodiment, one biometric sensor may measure more than one biometric information.

Meanwhile, the biometric sensor 310 may transmit the measured user's biometric information to the user terminal 320 and/or the biometric information server 330 through the network 170 described with reference to FIGS. 1 and 2. In this case, the user terminal 320 and/or the biometric information server 330 generates health assistant information using the user's biometric information transmitted from the biometric sensor 310 and the health assistant information provision method to be described later to provide the user can be provided to.

The user terminal 320 may be implemented by a physical electronic device such as the computer device 200, and the biometric information server 330 may be implemented by one or more physical electronic devices such as the computer device 200. . An application 321 for receiving services provided by the biometric information server 330 may be installed and run on the user terminal 320, and the user terminal 320 may be operated by the biometric information server (321) under the control of the application 321. You can receive services provided by 330). For example, the user terminal 320 may access the biometric information server 330 through the application 321 and generate health assistant information using the functions provided by the biometric information server 330. As another example, the user terminal 320 may access the biometric information server 330 through the application 321 and receive health assistant information generated by the biometric information server 330.

Figure 4 is a flowchart showing an example of a method for providing health assistant information according to an embodiment of the present invention. The method for providing health assistant information according to this embodiment may be performed by the user terminal 320 or the computer device 200 implementing the biometric information server 330. At this time, the processor 220 of the computer device 200 may be implemented to execute control instructions according to the code of an operating system included in the memory 210 or the code of at least one computer program. Here, assuming that the computer device 200 is the user terminal 120, the computer program may include an application 321 installed and run on the computer device 200. The processor 220 controls the computer device 200 so that the computer device 200 performs steps 410 to 460 included in the method of FIG. 4 according to control instructions provided by code stored in the computer device 200. can do.

In step 410, the computer device 200 may store information about a plurality of virtual characters in storage. At this time, different speaking styles and/or different intensity of expressions may be predefined for each of the plurality of characters. For example, the plurality of characters may include characters that appear in at least one previously released content. In this case, the speech pattern of the first character among the plurality of characters may include the speech pattern of the first character in the content in which the first character appears. In other words, the characters that appear in previously released content are likely to be familiar to users, and each character may have its own speaking style as a characteristic. For each of these characters, the tone and/or intensity of expression may be predefined, and related information about the characters may be stored in storage of the computer device 200.

In step 420, the computer device 200 may provide information about a plurality of characters to the user. For example, the computer device 200 may provide the user with a list of characters from which the user can select. For example, this list may be provided to the user through a screen rendered by the application 321.

In step 430, the computer device 200 may receive bio-signals measured by a wearable sensor attached to the user's body. Here, the wearable sensor may include a sensor that is attached to the outside of the user's body and measures the user's biosignals using at least one of an optical measurement method, a thermal measurement method, an electromagnetic measurement method, and an acoustic measurement method. At this time, the biosignal may include biometric information related to at least one of blood sugar, calories, skeletal muscle mass, body fat mass, number of steps, activity level, body water, and body weight.

In step 440, the computer device 200 may generate health assistant information to provide to the user based on the received biosignal. For example, the computer device 200 provides health assistant information based on biometric information related to at least one of blood sugar, calories, skeletal muscle mass, body fat mass, number of steps, activity level, body water, and body weight included in the biosignal received from the wearable sensor. can be created. This health assistant information may include information to assist the user with his or her health or diet.

In step 450, the computer device 200 may generate interactive expression information for delivering health assistant information generated according to a character selected by the user from among a plurality of characters. For example, the computer device 200 may generate interactive expression information based on at least one of the tone of speech and the intensity of expression of the selected character. As a more specific example, health assistant information may include information to induce the user to take action for dieting. In this case, the intensity of expression can be predefined for each of a plurality of characters as the intensity of expression that induces the above-described behavior. For example, interactive expression information may be generated to include more stimulating expressions for characters whose expression intensity is defined to be higher.

In step 460, the computer device 200 may provide the user with interactive expression information created using the selected character. For example, an image or video of a character selected by the user may be displayed on the screen provided by the application 321, and the voice and tone of speech of the selected character may be displayed through the speaker of the user terminal 320 according to the control of the application 321. Interactive expression information according to may be output in audio form.

Additionally, in step 460, the computer device 200 may display graph data about at least one piece of biometric information on a calendar by at least one period among date, week, and year. In other words, the computer device 200 can not only provide interactive expression information through characters, but also obtain period-specific analysis graph data for various biometric information obtained through biometric sensors. Additionally, in step 450, the computer device 200 may provide interactive representation information of health assistant information generated on a date selected in the calendar to the user through a character selected in connection with the selected date. In other words, in addition to providing the currently obtained interactive expression information in real time through characters, the computer device 200 may also provide interactive expression information obtained for each date through characters.

As such, according to embodiments of the present invention, health assistant information can be provided to the user in a conversational format in conjunction with a wearable sensor. At this time, rather than simply having the virtual character convey information, interactive expression information is created and provided according to the characteristics of each virtual character (speech tone and/or intensity of expression), thereby encouraging user behavior more actively. It can provide various fun elements.

Meanwhile, in the embodiment of FIG. 4, the selective use of a virtual character has been described. However, depending on the embodiment, the user's health may be assisted by generating interactive expression information for health assistant information without the use of a separate virtual character. .

Figure 5 is a diagram illustrating an example of providing graph data according to an embodiment of the present invention. FIG. 5 shows an example of a screen 510 that the user terminal 320 provides to the user through the application 321. Here, the first dotted line box 520 represents an example of displaying a calendar, and the second dotted line box 530 represents an example of displaying weekly graph data including the date selected by the user in the calendar. In the example of Figure 5, weekly graph data for each biometric information of calories, skeletal muscle mass, body fat mass, number of steps, activity level, and body water is displayed. Graph data can be linked to a calendar, and various states, such as positive/negative health or diet, can be displayed visually by period and using color or highlighting. Additionally, the third dotted box 540 shows an example in which the character selected by the user is applied as an icon for the home button.

Figure 6 is a diagram illustrating an example of providing interactive expression information according to an embodiment of the present invention. FIG. 6 shows an example of a screen 610 provided by the user terminal 320 to the user through the application 321. Here, the first dotted box 620 represents an example of the appearance of the character selected by the user. At this time, if there is interactive expression information to be provided in addition to the appearance of the character, the user terminal 320 may output the interactive expression information in audio format using the speaker of the user terminal 320.

Additionally, the application 321 may provide various user interfaces to allow users to easily view previous records. For example, a user can select a specific date in a calendar or quickly access information from a previous or subsequent period (date, week, month, year, etc.) through buttons that can be configured at the top of the screen (510 and 610). A user interface may be provided. The second dotted box 630 represents an example of a user interface that a user can quickly access on a specific date.

Figure 7 is a flowchart showing an example of a method for providing calorie information of food according to an embodiment of the present invention. Steps 710 and 720 shown in FIG. 7 may be provided in parallel with steps 410 to 450 previously described with reference to FIG. 4 .

In step 710, the computer device 200 may provide a list of calorie information for each food corresponding to information input by the user. For example, the computer device 200 may provide a search function that allows a user to obtain information about a specific food by entering a keyword, and may provide calorie information for each of the foods corresponding to the keyword entered through the search function. A list of can be provided to the user.

In step 720, the computer device 200 may provide calorie intake information reflecting the calories of the selected specific food in response to the user selecting a specific food from the list. For example, the computer device 200 may determine that the user selects a specific food from a list as if the user has consumed the food, and based on this determination, the computer device 200 may determine calories reflecting the calories of the food. Intake information can be provided to the user.

Figure 8 is a diagram illustrating an example of providing calorie information of food according to an embodiment of the present invention. FIG. 8 shows examples of screens 810 and 820 provided by the user terminal 320 to the user through the application 321. For example, in order to receive input of calories from food consumed by the user, the user terminal 320 may provide a search interface as shown on the screen 810 through the application 321. At this time, in response to the user entering a specific keyword (“pasta” in the example of FIG. 8), a list of calorie information for each food may be displayed as shown on screen 810. In this case, when the user selects information about a specific food (for example, selecting the plus button displayed in the list on the screen 810), the user terminal 320 displays the first dotted box 830 on the screen 820. Calorie intake information including the calories of the selected food can be provided to the user.

Figure 9 is a flowchart illustrating an example of a method for providing a notification about food intake based on location, according to an embodiment of the present invention. Steps 910 to 930 shown in FIG. 9 may be provided in parallel with steps 410 to 450 previously described with reference to FIG. 4 .

In step 910, the computer device 200 may determine the user's location. For example, the computer device 200 may determine the location of the user terminal 310 as the user's location. This location controls various sensors of the user terminal 310 through information and/or applications 321 obtained through LBS (Location-based service), real-time GPS (Global Positioning System), LCS (LoCation Services), and gyro sensors. It can be determined through the information obtained.

In step 920, the computer device 200 may collect information about the user's food intake using the determined location and sensor information. At this time, sensor information may be collected by the user terminal 310 through the application 321.

In step 930, the computer device 200 may provide a notification to the user according to the collected information. In one example, a notification may include information about food associated with a specific location.

Meanwhile, the biometric sensor described above will be described in more detail below.

For example, the advantage of resonators for electromagnetic (EM)-based sensors is that they can be designed in a variety of shapes and sizes, tuned to different operating frequency bands, and optimized for EM penetration depth and sensitivity. The measurable parameters of an EM sensor representing the level of an analyte, such as glucose, can be reflection-based (S ₁₁ ) or transmission-based (S ₂₁ ) and can take both “magnitude and phase” characteristics into account. Non-invasive analyte measurement from outside the body presents several challenges due to the high reflectivity of the signal in the skin layer and the low penetration depth of the signal. This limits EM interaction with living tissue and reduces sensitivity. Additionally, the temperature inside the body is more stable than outside the body (on the skin). Temperature changes also affect dielectric constant changes. Therefore, implantable EM sensors are more stable and more sensitive for detecting analyte levels.

A biometric sensor may be a sensor that senses a target analyte using electromagnetic waves. For example, a biometric sensor can measure biometric information associated with a target analyte. Hereinafter, the target analyte is a material associated with a living body and may also be referred to as a biological material or an analyte. For reference, in this specification, the target analyte is mainly described as blood sugar, but is not limited thereto. Biometric information is information related to the subject's biological components and may include, for example, the concentration and value of the analyte. If the analyte is blood sugar, the biometric information may include blood sugar levels.

The biometric sensor can measure biometric parameters (hereinafter referred to as 'parameters') associated with the biometric components described above and determine biometric information from the measured parameters. In this specification, a parameter may represent a circuit network parameter used to analyze a biometric sensor, and for convenience of explanation, the scattering parameter is mainly described below as an example, but is not limited thereto. For example, admittance parameters, impedance parameters, hybrid parameters, and transmission parameters may be used as parameters. For scattering parameters, transmission coefficient and reflection coefficient can be used. For reference, the resonance frequency calculated from the above-described scattering parameters may be related to the concentration of the target analyte, and the biosensor can predict blood sugar by detecting changes in the transmission coefficient and/or reflection coefficient.

A biometric sensor may include a resonator assembly (eg, an antenna). Hereinafter, an example in which the resonator assembly is an antenna will mainly be described. The resonant frequency of the antenna can be expressed as a capacitance component and an inductance component as shown in Equation 1 below.

[Equation 1]

In the above-mentioned equation 1, f may represent the resonance frequency of the antenna included in the biometric sensor using electromagnetic waves, L may represent the inductance of the antenna, and C may represent the capacitance of the antenna. The capacitance C of the antenna is the relative dielectric constant as shown in Equation 2 below: It can be proportional to .

[Equation 2]

Relative permittivity of antenna can be affected by the concentration of the target analyte in the surroundings. For example, when an electromagnetic wave passes through a material with a random dielectric constant, changes in amplitude and phase may occur in the transmitted electromagnetic wave due to radio wave reflection and scattering. Since the degree of reflection and/or scattering of electromagnetic waves varies depending on the concentration of the target analyte present around the biosensor, the relative dielectric constant may also vary. This can be interpreted as a biocapacitance being formed between the biosensor and the target analyte due to a fringing field caused by electromagnetic waves radiated by the biosensor including the antenna. Relative permittivity of antenna according to change in concentration of target analyte As this changes, the resonant frequency of the antenna also changes. In other words, the concentration of the target analyte may correspond to the resonance frequency.

As described above, the biometric information sensing system utilizing this EM-based biosensor directly measures biometric information such as the concentration of glucose contained in blood or interstitial fluid (for example, measuring glucose concentration using an electrochemical method). Rather, biometric information such as glucose concentration is estimated based on a pre-characterized relationship between the change in dielectric constant according to the change in glucose concentration. Therefore, in order to characterize the above-mentioned relationship, it is required that the true value of biometric information, such as the concentration of glucose as a standard for each individual, be input. Moreover, the true value of such biometric information is not processed as a one-time input, but is inputted periodically to calibrate the biometric sensor.

As such, according to embodiments of the present invention, health assistant information can be provided to the user in a conversational format in conjunction with a wearable sensor.

The device described above may be implemented with hardware components or a combination of hardware components and software components. For example, the devices and components described in the embodiments include a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), and a programmable logic unit (PLU). It may be implemented using one or more general-purpose or special-purpose computers, such as a logic unit, microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device includes multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. The software and/or data may be embodied in any type of machine, component, physical device, computer storage medium or device for the purpose of being interpreted by or providing instructions or data to the processing device. there is. Software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. At this time, the medium may continuously store a computer-executable program, or temporarily store it for execution or download. In addition, the medium may be a variety of recording or storage means in the form of a single or several pieces of hardware combined. It is not limited to a medium directly connected to a computer system and may be distributed over a network. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, And there may be something configured to store program instructions, including ROM, RAM, flash memory, etc. Additionally, examples of other media include recording or storage media managed by app stores that distribute applications, sites or servers that supply or distribute various other software, etc.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent.

Therefore, other implementations, other embodiments and equivalents of the claims also fall within the scope of the following claims.

Claims (12)

A method of providing health assistant information on a computer device comprising at least one processor, comprising:
storing information about a plurality of virtual characters in a storage, by the at least one processor;
providing, by the at least one processor, a list of characters selectable by the user as information about the plurality of characters to the user;
Receiving, by the at least one processor, bio-signals measured by a wearable sensor attached to the outside of the user's body;
generating, by the at least one processor, health assistant information based on the received biosignal;
generating, by the at least one processor, interactive representation information for conveying the health assistant information; and
providing, by the at least one processor, the generated interactive representation information to the user.
Including,
The plurality of characters include characters that appear in at least one previously released content,
At least one of a different speaking style and a different intensity of expression is predefined for each of the plurality of characters,
The speaking style of each of the plurality of characters includes the speaking style of the character in the content in which the character appears,
The health assistant information includes information to induce the user to take dieting actions,
The intensity of the expression is the intensity of the expression that induces the action and is predefined for each of the plurality of characters,
The step of generating the interactive expression information is,
Visual information for displaying on a screen an image or video of a character selected by the user through the list among the plurality of characters, and the health assistant information according to the intensity of speech and expression predefined for the selected character. Generating interactive representation information including audio information for conveying,
The step of providing the interactive expression information is,
Displaying the visual information on a screen and outputting the audio information through a speaker,
The screen includes a screen rendered by an application installed and running on the computer device,
Providing a home button icon to which the character selected by the user is applied through the screen,
The step of providing the generated interactive expression information includes:
Further comprising providing interactive expression information about health assistant information generated on a date selected in a calendar to the user through the selected character in association with the selected date,
The wearable sensor includes an electromagnetic-based sensor that is attached to the outside of the user's body and measures biosignals of the user using an electromagnetic measurement method,
Due to a fringing field caused by electromagnetic waves radiated by the electromagnetic-based sensor, the relative dielectric constant of the antenna included in the electromagnetic-based sensor changes according to the biocapacitance formed between the electromagnetic-based sensor and the target analyte. , the resonant frequency of the antenna changes according to the change in the relative dielectric constant,
The electromagnetic-based sensor measures the concentration of the target analyte corresponding to a change in the resonance frequency of the antenna as the biosignal.
A method of providing health assistant information, characterized by: delete delete delete delete delete delete According to paragraph 1,
The wearable sensor is a method of providing health assistant information, characterized in that it further includes a sensor that measures bio-signals of the user by at least one of an optical measurement method, a thermal measurement method, and an acoustic measurement method. According to paragraph 1,
The biosignal includes at least one biometric information of blood sugar, calories, skeletal muscle mass, body fat mass, number of steps, activity level, body water, and body weight,
Displaying, by the at least one processor, graph data for the at least one biometric information in connection with a calendar for at least one period of date, week, month, and year.
A method of providing health assistant information further comprising: According to paragraph 1,
providing, by the at least one processor, a list of calorie information for each food corresponding to information input by a user; and
In response to the user selecting a specific food from the list, by the at least one processor, providing calorie intake information reflecting the calories of the selected specific food.
A method of providing health assistant information further comprising: According to paragraph 1,
determining, by the at least one processor, a location of the user;
collecting information about the user's food intake using the determined location and sensor information, by the at least one processor; and
Providing, by the at least one processor, a notification according to the collected information to the user.
A method of providing health assistant information further comprising: A computer program stored in a computer-readable recording medium combined with a computer device to execute the method of any one of claims 1 or 8 to 11 on the computer device.

Images