WO2017142200A1

WO2017142200A1 - Electronic device and operating method therefor

Info

Publication number: WO2017142200A1
Application number: PCT/KR2017/000300
Authority: WO
Inventors: 정선옥; 김동욱; 최원석
Original assignee: 삼성전자주식회사
Priority date: 2016-02-16
Filing date: 2017-01-10
Publication date: 2017-08-24
Also published as: KR20170096366A

Abstract

The present invention relates to an electronic device and an operating method therefor, the method comprising the steps of: acquiring image data by using a camera; recognizing health information from the image data; determining properties corresponding to the health information; and storing the health information associated with an user on the basis of the properties, and being applicable as other examples.

Description

Electronic device and its operation method

The present invention relates to an electronic device and a method of operating the same.

Recently, electronic devices have been developed in various forms such as portable devices such as smart phones and tablet PCs and wearable devices such as smart watches and head mounted devices. Such various types of electronic devices may provide various services and additional functions. For example, health information such as heart rate may be obtained through a smart phone or smart watch. In addition, the smart phone or smart watch may provide health related services using the obtained health information.

This phenomenon occurs to improve the utility value of the electronic device and to satisfy the needs of users who are becoming more diverse. Recently, with the aging of society and the improvement of economic conditions, users have started to pay attention to health. Users want to check a comprehensive health condition using an electronic device and receive a health care service according to the health condition. Thus, there is an increasing demand for electronic devices that provide healthcare services.

According to the prior art, the electronic device may store health information measured by the health measurement equipment. In this case, the user may obtain a variety of health information such as blood pressure, blood sugar, body temperature and the like by using the health measurement equipment, and may have to store the obtained health information in the electronic device.

According to the related art, the electronic device may receive and store health information measured by the health measuring device through wired or wireless communication with the health measuring device. In this case, the inconvenience of connecting the electronic device and the health measurement equipment by wire or wireless communication may occur.

Various embodiments of the present disclosure may obtain health information of a user based on image data obtained from a camera using an electronic device equipped with a camera, and provide a health care service to the user using the obtained health information. .

An operation method of an electronic device according to an embodiment of the present disclosure may include obtaining image data using a camera, recognizing health information from the image data, determining an attribute corresponding to the health information, and Based on an attribute, storing the health information in association with the user.

An electronic device according to an embodiment of the present disclosure includes a camera for acquiring image data and a processor, wherein the processor recognizes the user's health information from the image data and determines a property corresponding to the health information. And store the health information in association with the health information based on the attribute.

As described above, the electronic device and its operation method of the present invention obtain health information of a user based on image data obtained from a camera using an electronic device equipped with a camera, and use the obtained health information to inform the user. Provide health care services. Acquisition of health information may use, for example, optical character recognition (OCR) readings on image data obtained from a camera. Providing a health care service may provide information, such as an exercise guide, a diet guide, and a breathing guide, to a user based on health information, for example. This method can reduce the hassle for collecting health information and can improve user convenience.

1 is a diagram illustrating a network environment including an electronic device according to an embodiment of the present disclosure.

2 is a block diagram illustrating a main configuration of an electronic device according to an embodiment of the present disclosure.

3 is a block diagram illustrating a program module according to an exemplary embodiment.

4 is a block diagram illustrating a main configuration of an electronic device according to an embodiment of the present disclosure.

5 is a flowchart illustrating a method of operating an electronic device according to an embodiment of the present disclosure.

6 is a detailed flowchart illustrating a method of recognizing health information in an electronic device according to an embodiment of the present disclosure.

7 is a detailed flowchart illustrating another method of recognizing health information in an electronic device according to an embodiment of the present disclosure.

8 is a detailed flowchart illustrating a method of performing a corresponding function in an electronic device according to an embodiment of the present disclosure.

9 is a detailed flowchart illustrating a method of performing environment setting in an electronic device according to an embodiment of the present disclosure.

10 is an exemplary screen illustrating a method of identifying equipment for measuring health information according to an exemplary embodiment of the present invention.

11 is an exemplary view illustrating a method of measuring blood glucose according to an exemplary embodiment of the present invention.

12 is an exemplary screen illustrating a method of measuring blood pressure according to an exemplary embodiment of the present invention.

13 is an exemplary view illustrating a method of measuring weight according to an embodiment of the present invention.

14 is a screen diagram illustrating a method of measuring health information corresponding to a current location according to an embodiment of the present invention.

15 is a flowchart illustrating a method of measuring health information according to a health information measurement alarm according to an exemplary embodiment of the present invention.

16 is an exemplary screen illustrating a method of measuring health information according to a health information measuring alarm according to an exemplary embodiment of the present invention.

17 is an exemplary screen illustrating a method of providing additional information when measuring health information according to an exemplary embodiment of the present invention.

18 is an exemplary view illustrating a method of displaying a healthcare result according to an exemplary embodiment of the present invention.

19 is a flowchart illustrating a method of operating an electronic device according to another embodiment of the present disclosure.

20 is a detailed flowchart illustrating a method of recognizing health information in an electronic device according to another embodiment of the present disclosure.

Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. The examples and terms used herein are not intended to limit the techniques described in this document to specific embodiments, but should be understood to include various modifications, equivalents, and / or alternatives to the examples. In connection with the description of the drawings, similar reference numerals may be used for similar components. Singular expressions may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B" or "at least one of A and / or B" may include all possible combinations of items listed together. Expressions such as "first," "second," "first," or "second," etc. may modify the components, regardless of order or importance, to distinguish one component from another. Used only and do not limit the components. When any (eg first) component is said to be "(functionally or communicatively)" or "connected" to another (eg second) component, the other component is said other The component may be directly connected or connected through another component (eg, a third component).

In this document, "configured to" is modified to have the ability to "suitable," "to," "to," depending on the circumstances, for example, hardware or software. Can be used interchangeably with "made to", "doing", or "designed to". In some situations, the expression “device configured to” may mean that the device “can” together with other devices or components. For example, the phrase “processor configured (or configured to) perform A, B, and C” may be implemented by executing a dedicated processor (eg, an embedded processor) to perform its operation, or one or more software programs stored in a memory device. It may mean a general purpose processor (eg, a CPU or an application processor) capable of performing the corresponding operations.

An electronic device according to various embodiments of the present disclosure may be, for example, a smartphone, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a PMP. It may include at least one of a portable multimedia player, an MP3 player, a medical device, a camera, or a wearable device. Wearable devices may be accessory (e.g. watches, rings, bracelets, anklets, necklaces, eyeglasses, contact lenses, or head-mounted-devices (HMDs), textiles or clothing integrated (e.g. electronic clothing), And may include at least one of a body-attachable (eg, skin pad or tattoo), or bio implantable circuit, In certain embodiments, an electronic device may comprise, for example, a television, a digital video disk (DVD) player, Audio, Refrigerator, Air Conditioner, Cleaner, Oven, Microwave Oven, Washing Machine, Air Purifier, Set Top Box, Home Automation Control Panel, Security Control Panel, Media Box (e.g. Samsung HomeSync ^TM , Apple TV ^TM , or Google TV ^TM ) , A game console (eg, Xbox ^™ , PlayStation ^™ ), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include a variety of medical devices (e.g., various portable medical measuring devices such as blood glucose meters, heart rate monitors, blood pressure meters, or body temperature meters), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), cameras or ultrasounds), navigation devices, global navigation satellite systems (GNSS), event data recorders (EDRs), flight data recorders (FDRs), automotive infotainment devices, ship electronics (E.g. marine navigation systems, gyro compasses, etc.), avionics, security devices, vehicle head units, industrial or household robots, drones, ATMs in financial institutions, point of sale (POS) points in stores or Internet of Things devices (eg, light bulbs, various sensors, sprinkler devices, fire alarms, thermostats, street lights, toasters, exercise equipment, hot water tanks, heaters, boilers, etc.). . According to some embodiments, an electronic device may be a part of a furniture, building / structure or automobile, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, water, electricity, Gas, or a radio wave measuring instrument). In various embodiments, the electronic device may be flexible or a combination of two or more of the aforementioned various devices. Electronic devices according to embodiments of the present disclosure are not limited to the above-described devices. In this document, the term user may refer to a person who uses an electronic device or a device (eg, an artificial intelligence electronic device) that uses an electronic device.

Referring to FIG. 1, in various embodiments, an electronic device 101 in a network environment 100 is described.

The electronic device 101 may include a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160, and a communication interface 170. In some embodiments, the electronic device 101 may omit at least one of the components or additionally include other components.

The bus 110 may include circuitry that connects the components 110-170 to each other and transfers communication (eg, control messages or data) between the components.

The processor 120 may include one or more of a central processing unit, an application processor, or a communication processor (CP). The processor 120 may execute, for example, an operation or data processing related to control and / or communication of at least one other component of the electronic device 101.

The memory 130 may include volatile and / or nonvolatile memory. The memory 130 may store, for example, commands or data related to at least one other element of the electronic device 101. According to an embodiment of the present disclosure, the memory 130 may store software and / or a program 140. The program 140 may include, for example, a kernel 141, middleware 143, an application programming interface (API) 145, an application program (or “application”) 147, or the like. . At least a portion of kernel 141, middleware 143, or API 145 may be referred to as an operating system. The kernel 141 may be a system resource (eg, used to execute an action or function implemented in, for example, other programs (eg, middleware 143, API 145, or application program 147). The bus 110, the processor 120, or the memory 130 may be controlled or managed. In addition, the kernel 141 may provide an interface for controlling or managing system resources by accessing individual components of the electronic device 101 from the middleware 143, the API 145, or the application program 147. Can be.

The middleware 143 may serve as an intermediary for allowing the API 145 or the application program 147 to communicate with the kernel 141 to exchange data. In addition, the middleware 143 may process one or more work requests received from the application program 147 according to priority. For example, the middleware 143 may use system resources (eg, the bus 110, the processor 120, or the memory 130, etc.) of the electronic device 101 for at least one of the application programs 147. Prioritize and process the one or more work requests. The API 145 is an interface for the application 147 to control functions provided by the kernel 141 or the middleware 143. For example, the API 145 may include at least the following: file control, window control, image processing, or character control. It can contain one interface or function (eg command). The input / output interface 150 may transmit, for example, a command or data input from a user or another external device to other component (s) of the electronic device 101, or other components of the electronic device 101 ( Commands or data received from the device) can be output to the user or other external device.

Display 160 may be, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical system (MEMS) display, or an electronic paper display. It may include. The display 160 may display, for example, various types of content (eg, text, images, videos, icons, and / or symbols, etc.) to the user. The display 160 may include a touch screen and may receive, for example, a touch, gesture, proximity, or hovering input using an electronic pen or a part of a user's body.

The communication interface 170 may establish communication between the electronic device 101 and an external device (eg, the first external electronic device 102, the second external electronic device 104, or the server 106). Can be. For example, the communication interface 170 may be connected to the network 162 through wireless or wired communication to communicate with an external device (eg, the second external electronic device 104 or the server 106). The wireless communication may be, for example, LTE, LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), or global network (GSM). Cellular communication using at least one of the system and the like. According to an embodiment, the wireless communication may include, for example, wireless fidelity (WiFi), Bluetooth, Bluetooth low power (BLE), Zigbee, near field communication (NFC), magnetic secure transmission, and radio. It may include at least one of a frequency (RF) or a body area network (BAN).

According to an embodiment, the wireless communication may include GNSS. The GNSS may be, for example, a Global Positioning System (GPS), a Global Navigation Satellite System (Glonass), a Beidou Navigation Satellite System (hereinafter referred to as “Beidou”) or Galileo, the European global satellite-based navigation system. Hereinafter, in this document, "GPS" may be used interchangeably with "GNSS". Wired communication may include, for example, at least one of a universal serial bus (USB), a high definition multimedia interface (HDMI), a standard standard232 (RS-232), a power line communication, a plain old telephone service (POTS), and the like. have. The network 162 may comprise a telecommunications network, for example at least one of a computer network (eg, LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 102 and 104 may be a device of the same or different type as the electronic device 101. According to various embodiments of the present disclosure, all or part of operations executed in the electronic device 101 may be executed in another or a plurality of electronic devices (for example, the electronic devices 102 and 104 or the server 106). According to this, when the electronic device 101 needs to perform a function or service automatically or by request, the electronic device 101 may instead execute or execute the function or service by itself, or at least some function associated therewith. May be requested to another device (eg, the electronic devices 102 and 104 or the server 106.) The other electronic device (eg, the electronic devices 102 and 104 or the server 106) may request the requested function or The additional function may be executed and the result may be transmitted to the electronic device 101. The electronic device 101 may provide the requested function or service by processing the received result as it is or additionally. For Cloud computing, distributed computing, or client-server computing techniques can be used.

2 is a block diagram of an electronic device 201 according to various embodiments.

The electronic device 201 may include, for example, all or part of the electronic device 101 illustrated in FIG. 1. The electronic device 201 may include one or more processors (eg, an AP) 210, a communication module 220, a subscriber identification module 224, a memory 230, a sensor module 240, an input device 250, and a display. 260, an interface 270, an audio module 280, a camera module 291, a power management module 295, a battery 296, an indicator 297, and a motor 298.

The processor 210 may control, for example, a plurality of hardware or software components connected to the processor 210 by running an operating system or an application program, and may perform various data processing and operations. The processor 210 may be implemented with, for example, a system on chip (SoC). According to an embodiment, the processor 210 may further include a graphic processing unit (GPU) and / or an image signal processor. The processor 210 may include at least some of the components illustrated in FIG. 2 (eg, the cellular module 221). The processor 210 may load and process instructions or data received from at least one of other components (eg, nonvolatile memory) into the volatile memory, and store the result data in the nonvolatile memory.

It may have the same or similar configuration as the communication module 220 (eg, the communication interface 170). The communication module 220 may include, for example, a cellular module 221, a WiFi module 223, a Bluetooth module 225, a GNSS module 227, an NFC module 228, and an RF module 229. have. The cellular module 221 may provide, for example, a voice call, a video call, a text service, or an internet service through a communication network. According to an embodiment, the cellular module 221 may perform identification and authentication of the electronic device 201 in a communication network by using a subscriber identification module (eg, a SIM card) 224. According to an embodiment, the cellular module 221 may perform at least some of the functions that the processor 210 may provide.

According to an embodiment, the cellular module 221 may include a communication processor (CP). According to some embodiments, at least some (eg, two or more) of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 may be one integrated chip. (IC) or in an IC package. The RF module 229 may transmit / receive a communication signal (for example, an RF signal), for example. The RF module 229 may include, for example, a transceiver, a power amp module (PAM), a frequency filter, a low noise amplifier (LNA), an antenna, or the like. According to another embodiment, at least one of the cellular module 221, the WiFi module 223, the Bluetooth module 225, the GNSS module 227, or the NFC module 228 may transmit and receive an RF signal through a separate RF module. Can be. Subscriber identification module 224 may include, for example, a card or embedded SIM that includes a subscriber identification module, and may include unique identification information (eg, integrated circuit card identifier (ICCID)) or subscriber information (eg, IMSI). (international mobile subscriber identity)).

The memory 230 (eg, the memory 130) may include, for example, an internal memory 232 or an external memory 234. The internal memory 232 may include, for example, volatile memory (for example, DRAM, SRAM, or SDRAM), nonvolatile memory (for example, one time programmable ROM (OTPROM), PROM, EPROM, EEPROM, mask ROM, flash ROM). The flash memory may include at least one of a flash memory, a hard drive, or a solid state drive (SSD) The external memory 234 may be a flash drive, for example, a compact flash (CF) or a secure digital (SD). ), Micro-SD, Mini-SD, extreme digital (xD), multi-media card (MMC), memory stick, etc. The external memory 234 may be functionally connected to the electronic device 201 through various interfaces. Or physically connected.

The sensor module 240 may measure, for example, a physical quantity or detect an operation state of the electronic device 201 and convert the measured or detected information into an electrical signal. The sensor module 240 includes, for example, a gesture sensor 240A, a gyro sensor 240B, an air pressure sensor 240C, a magnetic sensor 240D, an acceleration sensor 240E, a grip sensor 240F, and a proximity sensor ( 240G), color sensor 240H (e.g., red (green, blue) sensor), biometric sensor 240I, temperature / humidity sensor 240J, illuminance sensor 240K, or UV (ultra violet) ) May include at least one of the sensors 240M. Additionally or alternatively, sensor module 240 may include, for example, an e-nose sensor, an electromyography (EMG) sensor, an electrocardiogram (EEG) sensor, an electrocardiogram (ECG) sensor, Infrared (IR) sensors, iris sensors and / or fingerprint sensors. The sensor module 240 may further include a control circuit for controlling at least one or more sensors belonging therein. In some embodiments, the electronic device 201 further includes a processor configured to control the sensor module 240 as part of or separately from the processor 210, while the processor 210 is in a sleep state. The sensor module 240 may be controlled.

The input device 250 may include, for example, a touch panel 252, a (digital) pen sensor 254, a key 256, or an ultrasonic input device 258. The touch panel 252 may use at least one of capacitive, resistive, infrared, or ultrasonic methods, for example. In addition, the touch panel 252 may further include a control circuit. The touch panel 252 may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor 254 may be, for example, part of a touch panel or may include a separate recognition sheet. The key 256 may include, for example, a physical button, an optical key, or a keypad. The ultrasonic input device 258 may detect ultrasonic waves generated by an input tool through a microphone (for example, the microphone 288) and check data corresponding to the detected ultrasonic waves.

Display 260 (eg, display 160) may include panel 262, hologram device 264, projector 266, and / or control circuitry to control them. The panel 262 may be implemented to be, for example, flexible, transparent, or wearable. The panel 262 may be configured with the touch panel 252 and one or more modules. The hologram 264 may show a stereoscopic image in the air by using interference of light. The projector 266 may display an image by projecting light onto a screen. For example, the screen may be located inside or outside the electronic device 201. The interface 270 may include, for example, an HDMI 272, a USB 274, an optical interface 276, or a D-subminiature 278. The interface 270 may be included in, for example, the communication interface 170 illustrated in FIG. 1. Additionally or alternatively, interface 270 may include, for example, a mobile high-definition link (MHL) interface, an SD card / multi-media card (MMC) interface, or an infrared data association (IrDA) compliant interface. have.

The audio module 280 may bidirectionally convert, for example, a sound and an electrical signal. At least some components of the audio module 280 may be included in, for example, the input / output interface 145 illustrated in FIG. 1. The audio module 280 may process sound information input or output through, for example, a speaker 282, a receiver 284, an earphone 286, a microphone 288, or the like. The camera module 291 is, for example, a device capable of capturing still images and moving images. According to an embodiment, the camera module 291 may include one or more image sensors (eg, a front sensor or a rear sensor), a lens, and an image signal processor (ISP). Or flash (eg, LED or xenon lamp, etc.).

The power management module 295 may manage power of the electronic device 201, for example. According to an embodiment, the power management module 295 may include a power management integrated circuit (PMIC), a charger IC, or a battery or fuel gauge. The PMIC may have a wired and / or wireless charging scheme. The wireless charging method may include, for example, a magnetic resonance method, a magnetic induction method, an electromagnetic wave method, or the like, and may further include additional circuits for wireless charging, such as a coil loop, a resonance circuit, a rectifier, and the like. have. The battery gauge may measure, for example, the remaining amount of the battery 296, the voltage, the current, or the temperature during charging. The battery 296 may include, for example, a rechargeable cell and / or a solar cell.

The indicator 297 may display a specific state of the electronic device 201 or a part thereof (for example, the processor 210), for example, a booting state, a message state, or a charging state. The motor 298 may convert electrical signals into mechanical vibrations, and may generate vibrations or haptic effects. The electronic device 201 may be, for example, a mobile TV supporting device capable of processing media data according to a standard such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or mediaFlo ^™ . : GPU). Each of the components described in this document may be composed of one or more components, and the name of the corresponding component may vary according to the type of electronic device. In various embodiments, the electronic device (eg, the electronic device 201) may include some components, omit additional components, or combine some of the components to form a single entity. It is possible to perform the same function of the previous corresponding components.

3 is a block diagram of a program module according to various embodiments of the present disclosure.

According to an embodiment of the present disclosure, the program module 310 (eg, the program 140) may include an operating system and / or various applications running on the operating system for controlling resources related to the electronic device (eg, the electronic device 101). For example, the application program 147 may be included. The operating system may include, for example, Android ^™ , iOS ^™ , Windows ^™ , Symbian ^™ , Tizen ^™ , or Bada ^™ . Referring to FIG. 3, the program module 310 may include the kernel 320 (eg, the kernel 141), the middleware 330 (eg, the middleware 143), and the API 360 (eg, the API 145). And / or an application 370 (eg, an application program 147.) At least a portion of the program module 310 may be preloaded on the electronic device or may be an external electronic device (eg, an electronic device ( 102, 104, server 106, etc.).

The kernel 320 may include, for example, a system resource manager 321 and / or a device driver 323. The system resource manager 321 may perform control, allocation, or retrieval of system resources. According to an embodiment, the system resource manager 321 may include a process manager, a memory manager, or a file system manager. The device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver. .

The middleware 330 may provide various functions through the API 360, for example, to provide functions commonly required by the application 370, or to allow the application 370 to use limited system resources inside the electronic device. May be provided to the application 370. According to an embodiment, the middleware 330 may include a runtime library 335, an application manager 341, a window manager 342, a multimedia manager 343, a resource manager 344, a power manager 345, and a database manager ( 346, a package manager 347, a connectivity manager 348, a notification manager 349, a location manager 350, a graphic manager 351, or a security manager 352.

The runtime library 335 may include, for example, a library module that the compiler uses to add new functionality through the programming language while the application 370 is running. The runtime library 335 may perform input / output management, memory management, or arithmetic function processing. The application manager 341 may manage, for example, the life cycle of the application 370. The window manager 342 may manage GUI resources used on the screen.

The multimedia manager 343 may identify a format necessary for playing the media files, and may encode or decode the media file using a codec suitable for the format. The resource manager 344 may manage space of source code or memory of the application 370. The power manager 345 may manage, for example, the capacity or power of the battery and provide power information necessary for the operation of the electronic device. According to an embodiment of the present disclosure, the power manager 345 may interwork with a basic input / output system (BIOS). The database manager 346 may create, retrieve, or change a database to be used, for example, in the application 370. The package manager 347 may manage installation or update of an application distributed in the form of a package file.

The connectivity manager 348 may manage, for example, a wireless connection. The notification manager 349 may provide the user with events such as, for example, an arrival message, an appointment, a proximity notification, and the like. The location manager 350 may manage location information of the electronic device, for example. The graphic manager 351 may manage, for example, graphic effects to be provided to the user or a user interface related thereto. The security manager 352 may provide system security or user authentication, for example.

According to an embodiment of the present disclosure, the middleware 330 may include a telephony manager for managing a voice or video call function of the electronic device or a middleware module capable of forming a combination of functions of the above-described components. . According to an embodiment, the middleware 330 may provide a module specialized for each type of operating system. The middleware 330 may dynamically delete some of the existing components or add new components. API 360 is, for example, a set of API programming functions, which may be provided in different configurations depending on the operating system. For example, in the case of Android or iOS, one API set may be provided for each platform, and in Tizen, two or more API sets may be provided for each platform.

The application 370 is, for example, a home 371, a dialer 372, an SMS / MMS 373, an instant message (IM) 374, a browser 375, a camera 376, an alarm 377. , Contacts 378, voice dials 379, emails 380, calendars 381, media players 382, albums 383, watches 384, health care (e.g., measures exercise or blood sugar) Or an application for providing environmental information (eg, barometric pressure, humidity, or temperature information). According to an embodiment of the present disclosure, the application 370 may include an information exchange application capable of supporting information exchange between the electronic device and the external electronic device. The information exchange application may include, for example, a notification relay application for delivering specific information to the external electronic device, or a device management application for managing the external electronic device.

For example, the notification delivery application may deliver notification information generated by another application of the electronic device to the external electronic device, or receive notification information from the external electronic device and provide the notification information to the user. The device management application may be, for example, the ability of an external electronic device to communicate with the electronic device (e.g. turn-on / turn-off of the external electronic device itself (or some component) or the brightness (or resolution) of the display). Control), or install, delete, or update an application running on the external electronic device. According to an embodiment of the present disclosure, the application 370 may include an application (eg, a health care application of a mobile medical device) designated according to an attribute of the external electronic device. According to an embodiment of the present disclosure, the application 370 may include an application received from an external electronic device. At least a portion of the program module 310 may be implemented (eg, executed) in software, firmware, hardware (eg, the processor 210), or a combination of at least two or more thereof, and a module for performing one or more functions; It can include a program, routine, instruction set, or process.

As used herein, the term "module" includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, components, or circuits. The module may be an integrally formed part or a minimum unit or part of performing one or more functions. "Modules" may be implemented mechanically or electronically, for example, application-specific integrated circuit (ASIC) chips, field-programmable gate arrays (FPGAs), or known or future developments that perform certain operations. It can include a programmable logic device.

At least a portion of an apparatus (eg, modules or functions thereof) or method (eg, operations) according to various embodiments may be stored on a computer-readable storage medium (eg, memory 130) in the form of a program module. It can be implemented as. When the command is executed by a processor (eg, the processor 120), the processor may perform a function corresponding to the command. Computer-readable recording media include hard disks, floppy disks, magnetic media (e.g. magnetic tape), optical recording media (e.g. CD-ROM, DVD, magnetic-optical media (e.g. floppy disks), internal memory, etc. Instructions may include code generated by a compiler or code executable by an interpreter Modules or program modules according to various embodiments may include at least one or more of the above-described components. In some embodiments, operations performed by a module, a program module, or another component may be executed sequentially, in parallel, repeatedly, or heuristically, or at least, or may include other components. Some operations may be executed in a different order, omitted, or other operations may be added.

Referring to FIG. 4, the electronic device 400 according to the present invention includes a communication unit 410, an input unit 420, a camera 430, an image processing unit 440, a display unit 450, a memory 460, and an audio processing unit ( 470 and a processor 480. According to an embodiment of the present disclosure, the electronic device 400 may be a smart phone, a wearable watch, a tablet, or the like.

The communication unit 410 may perform communication in the electronic device 400. According to an embodiment of the present disclosure, the communication unit 410 may communicate with an external device (not shown) such as a server or another electronic device in various ways. For example, the communication unit 410 may perform at least one of wireless communication or wired communication. The communication unit 410 may access at least one of a mobile communication network and a data communication network. For example, the external device may include an electronic device, a base station, a server, and a satellite. Communication methods are Long Term Evolution (LTE), Wideband Code Division Multiple Access (WCDMA), Global System for Mobile Communications (GSM), Wireless Fidelity (WiFi), Bluetooth (Bluetooth), Bluetooth Low Energy (BLE), and Near Field (NFC) communications (IR) or infrared ray (IR).

The input unit 420 may generate input data in the electronic device 400. The input unit 420 may generate input data in response to a user input of the electronic device 400. The input unit 420 may include at least one input means. The input unit 420 may include, for example, a key pad, a dome switch, a physical button, a touch panel, or a jog & shuttle. The touch panel may sense, for example, coordinate information about a touch detected by a user's finger and an external electronic device (eg, a stylus pen) and transmit the detected information to the processor 480.

The camera 430 may be disposed at a specific position of the electronic device 400 to acquire image data of the subject. To this end, the camera 430 may receive an optical signal. The camera 430 may generate image data from an optical signal. The camera 430 may include a camera sensor and a signal converter. The camera sensor may convert an optical signal into an electrical image signal. The signal converter may convert the analog video signal into digital video data.

The camera 430 may acquire image data including at least one of an appearance, a barcode, a quick response code, a model number of a measuring device, and a name of a measuring device capable of measuring user health information. Can be. The camera 430 may acquire image data including a measurement result of the user's health information displayed on the measuring device. Health information includes your physical information (including height, weight, vision, hearing, skin condition, body temperature, etc.), biometric information (including blood pressure, heart rate, blood sugar, EMG, electroencephalogram, body fat, etc.) Calories, types of exercise, etc.), nutritional information (including diet, meal volume, calories ingested, nutrients, etc.), and the like.

The image processor 440 may process image data. The image processor 440 may process the image data in frame units and output the image data in correspondence with the feature and size of the display unit 450. Here, the image processor 440 may compress the image data in a set manner or restore the compressed image data to the original image data. The image processor 440 may provide the processor 480 with image data processed in units of frames.

The display unit 450 may output a user interface. In this case, the user interface may be an interface according to the execution of the healthcare menu. The display unit 450 may display a message indicating the time for measuring health information under the control of the processor 480. The display unit 450 may include a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a micro electro mechanical system (MEMS). Display and electronic paper display. The display unit 450 may include a plurality of light emitting devices. The display unit 450 may be combined with the input unit 420 to be implemented as a touch screen. The display unit 450 implemented as a touch screen senses movement detected on the surface of the display unit 450, for example, coordinate information about a touch detected by a user's finger and an external electronic device (eg, a stylus pen), and the like. 480).

The memory 460 may store operation programs of the electronic device 400. In this case, the memory 460 may store a program for controlling the user interface according to a user input. The memory 460 may store an application that may provide a health care service. The memory 460 may store user authentication information for logging into a healthcare menu, for example, an application. According to an embodiment of the present disclosure, the user authentication information may include image data, iris data, user voice data, user fingerprint data, password, pattern data, biometric information of the user, for example, heart rate information, electrocardiogram information, or encryption. It may include at least one of the code information.

The memory 460 may map and store categories of health information that can be measured by each device, such as appearances, barcodes, QR codes, model numbers and names of the measurement devices that can measure user health information, and the like. have. The memory 460 may store normal values, danger values, and the like of each category. According to an embodiment of the present disclosure, the memory 460 may store normal values and risk values of blood glucose according to gender and age. The memory 460 may store guide information such as an exercise guide, a diet guide, a breath guide, and the like. The memory 460 may store health information of the user. The health information may be health information previously measured by the user, and may store the medical record of the user received from the hospital server or the like as the health information.

The memory 460 may include, for example, an internal memory or an external memory. The internal memory may be, for example, volatile memory (for example, dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (for example, OTPROM (one). time programmable ROM (PROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drives, Or it may include at least one of a solid state drive (SSD).

The external memory may be a flash drive such as compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (XD), It may further include a multi-media card (MMC) or a memory stick. The external memory may be functionally and / or physically connected to the electronic device through various interfaces.

The audio processor 470 may bidirectionally convert, for example, a sound and an electrical signal. The audio processor 470 may process sound information input or output through, for example, a speaker SPK or a microphone MIC. The audio processor 470 may output an alarm for notifying the time of measuring the health information under the control of the processor 480 through the speaker SPK.

The processor 480 may control overall operations of the electronic device 400. In this case, the processor 480 may perform various functions. To this end, the processor 480 may control the components of the electronic device 400. The processor 480 may execute a healthcare menu, for example, a healthcare application. The processor 480 may perform user authentication to execute a healthcare menu. The processor 480 may register authentication information for user authentication and store the authentication information in the memory 460. The processor 480 may include at least one of image data, iris data, user's voice data, user's fingerprint data, password, pattern data, user's biometric information such as heart rate information, electrocardiogram information, or encrypted code information about a user's face. User authentication may be performed by acquiring.

When the user authentication is completed, the processor 480 may display a user interface according to the health care menu on the display unit 450. The processor 480 may acquire image data of a specific subject by activating the camera 430 according to the execution of the healthcare menu. The processor 480 may confirm that the acquired image data includes at least one of an appearance of a measurement device for measuring health information, a barcode, a QR code, a model number of a measurement device, and a name. The processor 480 may identify a category of health information that may be measured by the measurement device through analysis of the image data. Categories include your blood pressure, heart rate, electrocardiogram, blood sugar, electrocardiogram, electroencephalogram, weight, height, vision, hearing, skin condition, body temperature, body fat, stress response, exercise volume, calories burned, exercise type, diet, meal volume, calories intake It may mean information that may indicate a user's health state, such as nutrients.

The processor 480 may confirm that the acquired image data includes text about a measurement result for a specific category. The processor 480 may check the numerical value for a specific category from the character through OCR reading. The processor 480 may store the confirmed value in the memory 460. The processor 480 may provide a health care service when the measured values for the same category are stored in the memory 460 for a predetermined number of times. The processor 480 may receive a medical record of a user by accessing a hospital server through the communication unit 410. The processor 480 may provide the health care service based on the confirmed numerical value and the medical record of the user received from the hospital server. Health care services can provide information about categories measured over a period of time, average values, exercise guides based on average values, diet guides and breathing guides, hospital information related to categories with risk values, and first aid. have.

According to an embodiment of the present disclosure, the electronic device 400 includes a camera 430 for acquiring image data and a processor 480, and the processor 480 recognizes user's health information from the image data, Determine an attribute corresponding to the information, and based on the attribute, store health information in association with the user.

The processor 480 may recognize a character in the image data and check health information based on the character.

The attribute may include at least one of a category or a unit of health information.

The processor 480 may identify measurement equipment that measures health information from the image data, and determine attributes based on the identified measurement equipment.

The processor 480 may identify the measurement device based on at least one of an appearance, a barcode, a quick response code, a model number, and a name of the measurement device included in the image data.

The processor 480 may determine the attribute based on the time or place where the image data is obtained.

The processor 480 may check attributes of the health information that can be measured at the location of the electronic device 400, recognize a character included in the acquired image data, and check biometric information based on the character.

The display unit 450 may further include a processor 450, and the processor 480 may overlay the health information on the image data and display the health information on the display unit 450.

The processor 480 may overlay the additional information including the past measurement history of the health information and the recommended measurement time of the health information and display the image data on the display unit 450.

The memory 460 may be further included, and the processor 480 may perform authentication on the user and store health information in the memory 460 based on the authentication.

Referring to FIG. 5, when an execution signal for a health care menu is received in operation 501, the processor 480 may perform operation 503. If the execution signal for the healthcare menu is not received in operation 501, the processor 480 may terminate the process. In operation 503, the processor 480 may perform user authentication. When user authentication is completed in operation 503, the processor 480 may perform operation 505. According to an embodiment of the present disclosure, the user authentication may include image data, iris data, voice data of the user, fingerprint data, password, pattern data, biometric information of the user, for example, heart rate information, obtained from the camera 430. , Electrocardiogram information, or encrypted code information.

In operation 505, if a signal for obtaining health information of the user is received, the processor 480 may perform operation 507. In operation 507, the processor 480 may activate the camera 430. In operation 509, the processor 480 may recognize the user's health information using the image data acquired from the activated camera 430. According to an embodiment of the present disclosure, the user's health information may include blood pressure, heart rate, electrocardiogram, blood sugar, electrocardiogram, electroencephalogram, weight, height, vision, hearing, skin condition, body temperature, body fat, stress response, exercise amount, calories burned, exercise, and the like. It may include information that can indicate the user's health status, such as type, diet, amount of meal, calories ingested, and nutrients ingested. Health information recognition for operation 509 will be described in detail with reference to FIGS. 6 and 7.

In operation 511, the processor 480 may store the user's health information recognized in operation 509 in the memory 460. According to an embodiment of the present disclosure, the processor 480 may transmit health information to a server (not shown) located outside the electronic device 400 through the communication unit 410. In operation 513, when the end signal for the healthcare menu is received, the processor 480 may end the above process. If the end signal for the health care menu is not received in operation 513, the processor 480 may return to operation 505 and perform the above operations again.

In operation 505, if a signal for obtaining health information of the user is not received, the processor 480 may perform operation 515. In operation 515, the processor 480 may perform a corresponding function. According to an embodiment of the present disclosure, the function may be a function for providing a health care result using the user's health information accumulated a predetermined number of times, or may be a function for setting environment information on the health care menu. Performing a corresponding function for operation 515 will be described in detail with reference to FIGS. 8 and 9. In addition, in the embodiment of the present invention, for convenience of description, it is described as performing user authentication after executing the healthcare menu, but is not necessarily limited thereto. Performing user authentication may be performed after operation 509 for recognizing health information.

Referring to FIG. 6, in operation 601, the processor 480 may acquire first image data by the camera 430 activated in operation 507 of FIG. 5. In operation 603, the processor 480 may analyze the first image data. According to an embodiment of the present disclosure, the first image data may be preview image data or image data in which a specific frame is captured from the preview image data. In operation 605, the processor 480 may determine whether the numerical value of the health information is possible in the first image data as a result of analyzing the first image data. The processor 480 may check whether or not a character capable of optical character recognition (OCR) is included in the first image data. According to an embodiment of the present disclosure, the processor 480 may determine whether the first image data includes a number indicating a measurement result of the health information. As a result of confirming operation 605, if the first image data does not include a numerical value representing a measurement result, the processor 480 may perform operation 607.

In operation 607, the processor 480 may check the information about the measurement device to measure the user's health information according to the analysis of the first image data. According to an embodiment of the present disclosure, the processor 480 may identify the type of the measurement device from information such as the type of the device included in the first image data, a barcode, a QR code, a model number and a name of the measurement device. According to an embodiment of the present disclosure, the processor 480 may check additional information, such as an FDA approval history and a recall history, for the measurement equipment identified in the first image data. In operation 609, the processor 480 may identify a category and a unit for health information based on the identified measurement equipment. According to an embodiment of the present disclosure, the processor 480 may check a category of health information as blood sugar and check a unit according to the category as mg / dL if the checked measuring device is a blood glucose meter for measuring a user's blood sugar. .

In operation 611, the processor 480 may acquire second image data through the camera 430. In operation 613, the processor 480 may analyze the second image data. According to an embodiment of the present disclosure, the second image data may be image data obtained by photographing a measurement result of the user's health information measured by the measuring device. According to an embodiment of the present disclosure, the second image data may be preview image data, or may be image data in which a specific frame is captured from the preview image data. According to an embodiment of the present disclosure, the processor 480 may analyze a character included in the second image data through OCR reading. In operation 615, the processor 480 may identify the numerical value of the category as a character according to the analysis result of the second image data. Letters can include numbers. According to an embodiment of the present disclosure, if the category checked in operation 609 is blood sugar, the processor 480 may identify that the determined value is a blood sugar level of the user in operation 615. In operation 615, the processor 480 confirming the user value may return to operation 511 of FIG. 5.

As a result of confirming operation 605, when the numerical value of the health information may be confirmed in the first image data, the processor 480 may perform operation 617. In operation 617, the processor 480 may check the numerical value of the health information from the first image data. According to an embodiment of the present disclosure, the first image data may be image data obtained by photographing a measurement result of the user's health information measured by the measuring device. According to an embodiment of the present disclosure, the first image data may be preview image data or image data in which a specific frame is captured from the preview image data. According to an embodiment of the present disclosure, the processor 480 may check the numerical value of the health information by analyzing a character included in the first image data through OCR reading.

In operation 619, the processor 480 may check the attribute. According to an embodiment of the present disclosure, the attribute may include at least one of a category and a unit of health information. The processor 480 may identify a category having a range in which the identified numerical value is included. The processor 480 may check the unit of the category based on the identified category. The processor 480 confirming the attribute may return to operation 511 of FIG. 5. According to an embodiment of the present disclosure, when the measured value is between 20 and 600, the processor 480 may identify that the category is blood sugar, and may determine that the unit is mg / dL. According to an embodiment of the present disclosure, when a category having a measured value between 20 and 600 includes a plurality of categories including blood sugar, the processor 480 may receive a category selected by a user. According to an embodiment of the present disclosure, when the numerical value and the unit are included in the first image data, the processor 480 may identify the unit together when the numerical value is checked. The processor 480 may identify a category from the identified unit.

Referring to FIG. 7, in operation 701, the processor 480 may identify a location of the electronic device 400. The processor 480 may identify the current location of the electronic device 400 using a global positioning system (GPS), triangulation, or the like. In operation 703, the processor 480 may identify a category that may be measured at the current location. According to an embodiment of the present disclosure, if the current location corresponds to a diabetes specialized hospital, the processor 480 may check a measurable category as blood glucose.

In operation 705, the processor 480 may acquire image data by the camera 430 activated in operation 507 of FIG. 5. In operation 707, the processor 480 may analyze the acquired image data. According to an embodiment of the present disclosure, the image data may be image data obtained by photographing a measurement result of the user's health information measured by the measuring device. According to an embodiment of the present disclosure, the image data may be preview image data, or may be image data in which a specific frame is captured in the preview image data. According to an embodiment of the present disclosure, the processor 480 may analyze a character included in the image data through OCR reading. In operation 709, the processor 480 may check the numerical value for the category according to the analysis result of the image data. According to an embodiment of the present disclosure, if the category identified in operation 703 is blood sugar, the processor 480 may perform OCR reading on the image data to check the blood sugar level from a character included in the image data. In operation 709, the processor 480 confirming the numerical value of the user's health information may return to operation 511 of FIG. 5.

Referring to FIG. 8, in operation 801, when a signal for confirming a result of health care is received, the processor 480 may perform operation 803. In operation 803, the processor 480 may output the health care result using the health information of the user accumulated more than a predetermined number of times. According to an embodiment of the present disclosure, the processor 480 may output an exercise guide including an exercise type and an exercise method based on the BMI index determined from the height and weight of the user accumulated over a predetermined number of times. According to an embodiment of the present disclosure, the processor 480 may receive a health trend from an external server (not shown). The processor 480 may output an exercise guide including an exercise type and an exercise method based on the BMI index and the health trend of the user. The processor 480 may output results of exercise guides, diet guides, respiration guides, and the like, from the blood sugar of the user accumulated a predetermined number or more. The processor 480 may check whether or not there is a health abnormality from the user's health information accumulated for a predetermined number of times, and output a hospital guide, an emergency first aid method, an alarm, and the like closest to the current location of the user. According to an embodiment of the present disclosure, the processor 480 may receive a medical record of the user from a hospital server or the like. The processor 480 may output the health care result by integrating the health information and the medical record of the user accumulated more than a predetermined number of times.

In operation 801, the processor 480 may perform operation 805 when a signal for confirming a result of health care is not received. In operation 805, the processor 480 may perform operation 807 when a selection signal for setting an operation environment for the health care menu is received. In operation 807, the processor 480 may set an operating environment for the healthcare menu. According to an embodiment of the present disclosure, the operating environment for the health care menu may include an alarm setting for notifying a unit setting and a measurement time for a specific category. Operation 807 will be described in detail with reference to FIG.

9 is a detailed flowchart illustrating a method of setting an environment in an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 9, in operation 901, when a signal for setting a unit for a specific category is received, the processor 480 may perform operation 903. In operation 903, the processor 480 may identify a current location of the electronic device 400. The processor 480 may identify the current location of the electronic device 400 using GPS, triangulation, or the like. In operation 905, the processor 480 may identify a unit for each category corresponding to the identified position. According to an embodiment of the present disclosure, since different countries use different units for each category, the processor 480 may identify a country from a current location of the electronic device 400. When it is determined that the electronic device 400 is located in Korea, the processor 480 may determine that the unit of weight is kg, the unit of height is cm, and the unit of blood glucose is mg / dL. When it is determined that the electronic device 400 is located in the United States, the processor 480 may determine that the weight unit is pounds, the height unit is feet, the blood sugar unit is mmol / L, or the like.

In operation 907, if a signal for changing a unit of each category is received, the processor 480 may perform operation 909. In operation 909, when the input of the category and the unit of the category to be changed from the user is completed, the processor 480 may perform operation 911. In operation 911, the processor 480 may change and set the input category and the unit of the category, and return to operation 513 of FIG. 5. In operation 907, the processor 480 may return to operation 513 of FIG. 5 if the signal for changing each category and the unit of the category is not received.

In operation 901, if a signal for setting a unit for a specific category is not received, the processor 480 may perform operation 913. In operation 913, if a signal for setting an alarm is received, the processor 480 may perform operation 915. In operation 915, the processor 480 may display a list of categories for setting an alarm. In operation 917, when one category is selected from the list of categories, the processor 480 may perform operation 919. In operation 919, the processor 480 may display an alarm time preset for the category. In operation 917, if one category is not selected from the list of categories, the processor 480 may return to operation 915. According to an embodiment of the present disclosure, when a signal for setting an alarm is received, the processor 480 may display a list of categories such as height, weight, blood sugar, and blood pressure on the display 450. When blood sugar is selected from the category list, the processor 480 may display a preset alarm time (eg, 7:00). The preset alarm time may be a time set when the electronic device 400 is manufactured, or may be the same time as the weather alarm time set by the user or a time when a threshold time elapses (for example, 1 hour) from the weather alarm time. .

In operation 907, the processor 480 may perform operation 909 when a signal for changing an alarm time preset for the category is received. In operation 909, when the alarm time to be changed is input, the processor 480 may perform operation 911. In operation 911, the processor 480 may set the measurement alarm of the corresponding category at the input alarm time and return to operation 513 of FIG. 5. In operation 907, if the signal for changing the alarm time of the corresponding category is not received, the processor 480 may return to operation 513 of FIG. 5.

In operation 913, if the signal for setting the alarm is not received, the processor 480 may return to operation 513 of FIG. 5. In an embodiment of the present invention, a unit setting for a specific category and a measurement alarm setting for a specific category are performed as an example. However, it is not necessarily limited thereto. According to an embodiment of the present disclosure, the processor 480 may perform unit setting and alarm setting in time series.

10 is a screen example for explaining a method of confirming equipment for measuring health information according to an exemplary embodiment of the present invention.

Referring to FIG. 10, when the healthcare menu is executed, the processor 480 may perform user authentication. When the user authentication is completed, the processor 480 may display a message 1000 indicating that the authentication of the user is completed, as shown in FIG. 10A, on the display unit 450. When the authentication of the user is completed, the processor 480 may call basic information including the user's name in the memory 460 and display the message in the message 1000. When the processor 480 generates an input to the “OK” button in the message 1000, the processor 480 may include a user user interface including a display area 1001 to confirm measurement equipment as shown in FIG. 10B. May be displayed on the display unit 450. According to an embodiment of the present disclosure, the processor 480 may display a user user interface including the display area 1001 on the display unit 450 according to a signal for obtaining health information of a user input after user authentication is completed. have. The display area 1001 may be an area where image data acquired by the activated camera 430 is displayed on the rear surface of the electronic device 400.

The processor 480 may display image data acquired by the camera 430 on the display area 1001. The image data may be a preview image acquired by the camera 430, or may be image data in which a specific frame is captured in the preview image. The processor 480 may check the type of the equipment 1003 included in the image data as in operation 607 of FIG. 6. The processor 480 may identify a feature point of the appearance of the equipment 1003 through analysis of the image data. The processor 480 may check the type of the equipment 1003 by comparing the identified feature points and the feature points stored in the memory 460. The processor 480 may identify a category of health information that the user wants to measure from the identified type of equipment 1003. According to an embodiment of the present disclosure, the processor 480 may check the name 1005 included in the image data through the OCR reading of the image data. The processor 480 may identify a category of health information that the user wants to measure from the identified name 1005.

According to an embodiment of the present disclosure, the processor 480 may identify, from an appearance of the apparatus 1003, that the apparatus 1003 is a blood glucose meter for measuring blood glucose. When it is confirmed that the equipment 1003 included in the image data displayed on the display area 1001 is a blood glucose meter, the processor 480 may check the category as blood sugar and check the unit of the category as mg / dL. According to an embodiment of the present disclosure, the processor 480 may identify from the name 1005 of the device 1003 that the device 1003 is a blood glucose meter for measuring blood glucose. When it is confirmed that the equipment 1003 included in the image data displayed on the display area 1001 is a blood glucose meter, the processor 480 may check the category as blood sugar and check the unit of the category as mg / dL.

According to an embodiment of the present disclosure, the processor 480 may identify a category of health information to be measured through information such as appearance, a barcode, a QR code, a model number, and a name 1005 of the equipment 1003. The processor 480 may identify a category using data stored in the memory 460. The processor 480 may transmit image data or information included in the image data to a server (not shown) located outside the electronic device 400 and receive a category from the server. The processor 480 may store, in the memory 460, device information including a feature point about the appearance of the recognized device 1003, a name of the device 1003, and a bioinformation category of the device 1003. The processor 480 may determine whether the acquired image data analysis result is the same as the stored device information. Through this, the processor 480 may improve the recognition accuracy and the recognition speed of the equipment.

When the health care menu is executed, the processor 480 may display the first guide screen 1005 and the second guide screen 1007 as shown in FIGS. 10C and 10D on the display unit 450. Can be. The first guide screen 1005 and the second guide screen 1007 may be screens for guiding a method of photographing a measurement result of the equipment 1003 by the electronic device 400. For example, the processor 480 displays the position of the electronic device 400 corresponding to the device 1003, the angle between the electronic device 400 and the device 1003, etc. on the display unit 450 in the form of animation when acquiring image data. can do. The processor 480 may display the first guide screen 1005 and the second guide screen 1007 on the display unit 450 while performing user authentication. The processor 480 may perform user authentication after displaying the first guide screen 1005 and the second guide screen 1007 on the display unit 450.

11 is a screen example for explaining a method of measuring blood glucose according to an embodiment of the present invention.

Referring to FIG. 11, the processor 480 may display a message 1000 indicating that the authentication of the user is completed, as shown in FIG. 10A, on the display unit 450. When an input is generated to the “OK” button in the message 1000, the processor 480 is displayed on the display area 1001 as shown in FIG. 11A without checking the measurement equipment as shown in FIG. 10B. Can analyze image data. The processor 480 may display a guide line or the like such that the measurement result 1101 is included in the display area 1001. The guide line may be displayed on the display area 1001 such that a display unit (not shown) of the measurement equipment is positioned at a position where the OCR of the image data can be easily read. If the measurement result 1101 is not positioned in the guide line, the processor 480 may display a guide message for changing the position of the camera 430 on the display unit 450.

The image data may be image data obtained from the camera 430 provided on the back of the electronic device 400. The image data may be image data including a measurement result 1101 confirmed by the apparatus 1003 for obtaining health information of the user. The image data may include a measurement result 1101, a measurement unit 1103, and a health information measurement time 1105. The processor 480 is a result of OCR reading of the image data displayed on the display area 1001 as shown in FIG. 11A, and the measurement result 1101 of the health information, the measurement unit 1103, and the measurement time of the health information. (1105) can be confirmed. According to an embodiment of the present disclosure, when the OCR reading result of the image data displayed on the display area 1001 is not confirmed, the processor 480 displays a message on the display 450 to input the measurement time. can do. According to an embodiment of the present disclosure, when the OCR reading result of the image data displayed on the display area 1001 is not confirmed, the processor 480 may measure the current time that is checked by the electronic device 400. I can confirm it visually. According to an embodiment of the present disclosure, when the measurement unit 1103 included in the image data is selected, the processor 480 may set the unit of the category to mg / dL. This may correspond to

operations

617 and 619 of FIG. 6.

The processor 480 may overlay the numerical value 1107 of the measurement result 1101 on a portion of the display area 1001 as shown in FIG. 11B. When there is no information on the appearance of the apparatus 1003 or information on the name 1005 as shown in FIG. 10, the processor 480 may identify the category through the measurement unit 1103 included in the image data. When the processor 480 generates an input to the “OK” button displayed on the display unit 450 in a state where the numerical value 1107 of the health information is displayed on the part of the display area 1001 as shown in FIG. A screen such as (c) of FIG. 11 may be displayed.

The processor 480 may display a category 1109 for measured health information, a measurement result 1111, and a tag 1113 for adding information related to the measured biometric information, as illustrated in FIG. 11C. . Among the tags 1113 shown in FIG. 11C, the General tag is a tag that can be added when the blood glucose is measured in the recommended state for accurate blood sugar measurement, and the Fasting tag is fasting (for example, food or beverage other than water). Is not ingested for 8 hours) tag that can be added when measuring blood sugar, pre-meal tag is tag that can be added when blood sugar is measured before meals, and post-meal is when blood sugar is measured after meals It can be a tag that can be added. When an input is generated to the button 1115 for activating the camera on the screen displayed as shown in FIG. 11C, the processor 480 may activate the camera 430 to acquire the image data again. The processor 480 may store the measurement result 1111, the tag 1113 and information about the ingested food when an input is generated to the “save” button on the screen displayed as shown in FIG. 11C. The processor 480 may store the measurement result 1111, the tag 1113, and the information about the ingested food so as to correspond to Kim Yuna, whose user authentication is completed, as shown in FIG. 10A.

12 is an exemplary screen illustrating a method of measuring blood pressure according to an embodiment of the present invention.

Referring to FIG. 12, the processor 480 may analyze image data displayed on the display area 1001 as shown in FIG. 12A. The image data may include

measurement results

1201, 1203, and 1205 of the user's health information, a measurement unit 1207, and a measurement time 1209 of the health information. The processor 480 is a result of OCR reading of the image data displayed on the display area 1001 as shown in FIG. 12A, and the

measurement results

1201, 1203, 1205, the unit of measurement 1207, and the health of the health information. The measurement time 1209 of the information can be confirmed. According to an embodiment of the present disclosure, when the measurement unit 1207 included in the image data is selected, the processor 480 may set the category unit to bpm.

The processor 480 may overlay the numerical values 1211 for the

measurement results

1201, 1203, and 1205 on a portion of the display area 1001 as shown in FIG. 11B. The processor 480 may identify a category of health information that the user intends to measure from the

measurement results

1201, 1203, 1205, or the measurement unit 1207 of the health information. In an embodiment of the present disclosure, the processor 480 may determine that the category of the health information to be measured by the user from the

measurement results

1201, 1203, 1205, or the measurement unit 1207 of the health information is blood pressure and pulse rate. This may correspond to

operations

617 and 619 of FIG. 6.

When the processor 480 generates an input to the “OK” button displayed on the display unit 450 in a state in which the numerical value 1211 of the health information is overlaid on a part of the display area 1001 as shown in FIG. A screen such as (c) of FIG. 12 may be displayed. The processor 480 may display the identified

categories

1221 and 1225 and the

measurement results

1223 and 1227 as shown in FIG. 12C. The processor 480 may display the identified category and the measurement result 1229 as shown in FIG. 12C. When an input is generated to the button 1231 for activating the camera on the screen displayed as shown in FIG. 12C, the processor 480 may activate the camera 430 to acquire the image data again. The processor 480 may store the

measurement results

1223, 1227, and 1229 when an input is generated to the “save” button on the screen displayed as shown in FIG. 12C. The processor 480 may store information about the

measurement results

1223, 1227, and 1229 to correspond to Kim Yuna, whose user authentication is completed, as shown in FIG. 10A.

13 is an exemplary screen illustrating a method of measuring weight according to an embodiment of the present invention.

Referring to FIG. 13, the processor 480 may analyze image data displayed on the display area 1001 as shown in FIG. 13A. The image data may include a measurement result 1301, a measurement unit 1303, and a category 1305 of health information about the user's health information. The processor 480 is a result of OCR reading of the image data displayed on the display area 1001 as shown in FIG. 13A, and displays the measurement result 1301, the measurement unit 1303, and the category 1305 of health information. You can check it. This may correspond to

operations

617 and 619 of FIG. 6.

The processor 480 may overlay the numerical value 1307 for the measurement result 1301 on a portion of the display area 1001 as shown in FIG. 13B. The processor 480 may determine that the category of the health information to be measured by the user is the weight from a character indicating the unit of measurement 1303 of the health information or the category 1305 included in the image data. When the processor 480 generates an input to the “OK” button displayed on the display unit 450 in a state where the numerical value 1307 of the health information is displayed on the part of the display area 1001 as shown in FIG. 13B, A screen as shown in FIG. 13C may be displayed. The processor 480 may display the identified category 1309 and the measurement result 1311 as shown in FIG. 13C.

The processor 480 may calculate and display the body fat amount 1313 from the measurement result 1311. To this end, the memory 460 may store the height information of the user who has been authenticated. When an input is generated to the button 1315 for activating the camera on the screen displayed as shown in (c) of FIG. 13, the processor 480 may activate the camera 430 to acquire the image data again. The processor 480 may store the measurement result 1311 and the body fat amount 1313 when an input is generated to the “save” button on the screen displayed as shown in FIG. 13C. The processor 480 may store information about the measurement result 1311 and the body fat amount 1313 so as to correspond to Kim Yuna, whose user authentication is completed, as shown in (a) of FIG. 10.

14 is an exemplary screen diagram illustrating a method of measuring health information corresponding to a current location according to an embodiment of the present invention.

Referring to FIG. 14, the processor 480 may perform an operation corresponding to FIG. 7 as shown in FIG. 14. The processor 480 may identify the location of the electronic device 400. The processor 480 may identify the current location of the electronic device 400 using GPS, triangulation, or the like. The processor 480 may display, on the display unit 450, a message 1401 for checking whether the information about the confirmed location and health information is measured as shown in FIG. 14A. According to an embodiment of the present disclosure, if the checked current location of the electronic device 400 is A diabetes specialty hospital, the processor 480 may display a message for checking whether the blood glucose level is measured.

When the input signal for the “OK” button is received in the message 1401, the processor 480 displays the image data 1403 obtained from the camera 430 on the display area 1001 as shown in FIG. 14B. I can display it. The image data 1403 may be image data obtained by photographing the measurement result of the blood glucose meter using the camera 430. The processor 480 may check blood glucose levels by OCR reading the image data 1403 displayed on the display area 1001 as shown in FIG. 14B. Since this has been described in detail in FIG. 11, the description thereof will be omitted.

According to an embodiment of the present disclosure, after the health care menu is executed, the electronic device 400 checks the location of the electronic device 400 and displays the message 1401 as shown in FIG. 14A on the display unit 450 as an example. However, it is not necessarily limited thereto. According to an embodiment of the present disclosure, the processor 480 may identify the location of the electronic device 400 periodically or in real time. When it is determined that the identified location of the electronic device 400 corresponds to a specific hospital, the processor 480 may display a message 1401 as shown in FIG. 14A on the display unit 450. When the input signal for the “OK” button is received in the message 1401, the processor 480 may execute a healthcare menu and activate the camera 430.

Referring to FIG. 15, in operation 1501, the processor 480 may check whether the alarm time set in FIG. 9 has arrived. As a result of confirming operation 1501, when the alarm time arrives, the processor 480 may perform operation 1503. As a result of confirming operation 1501, if the alarm time does not arrive, the processor 480 may wait for the arrival of the alarm time. In operation 1503, the processor 480 may output an alarm message. In operation 1505, if the measurement of health information is selected, the processor 480 may perform operation 1507. In operation 1505, the processor 480 may terminate the process if the measurement of the health information is not selected.

In operation 1507, the processor 480 may execute a healthcare menu. In operation 1509, the processor 480 may activate the camera 430. In operation 1511, the processor 480 may acquire image data through the camera 430. In operation 1513, the processor 480 may analyze the acquired image data. According to an embodiment of the present disclosure, the image data may be image data obtained by photographing a measurement result of the user's health information measured by the measuring device. According to an embodiment of the present disclosure, the image data may be preview image data, or may be image data in which a specific frame is captured in the preview image data. According to an embodiment of the present disclosure, the processor 480 may analyze a character included in the image data through OCR reading.

In operation 1515, the processor 480 may identify the numerical value of the category by a character according to the analysis result of the image data. In operation 1517, the processor 480 may store the confirmed value. According to an embodiment of the present disclosure, the processor 480 may determine that a value obtained after outputting an alarm for measuring blood sugar is a value for blood sugar. The processor 480 may map and store the identified value in a corresponding category, for example, blood sugar.

16 is a screen example for explaining a method of measuring health information according to a health information measuring alarm according to an exemplary embodiment of the present invention.

Referring to FIG. 16, the processor 480 may perform an operation corresponding to FIG. 15 as shown in FIG. 16. The processor 480 may check whether the set alarm time arrives. When the set alarm time arrives, the processor 480 may display a message 1601 indicating that the alarm time has arrived, as shown in FIG. According to an embodiment of the present disclosure, the set alarm may be an alarm set to measure blood glucose levels. When the “OK” button is selected in the message 1601 displayed on the display unit 450, the processor 480 may execute a healthcare menu.

The processor 480 may activate the camera 430 while executing the healthcare menu. The processor 480 may display the image data 1603 obtained by the camera 430 in the display area 1001 as shown in FIG. 16B. The image data 1603 may be image data obtained by photographing the measurement result of the blood glucose meter using the camera 430. The processor 480 may check the blood glucose level by OCR reading the image data 1603 displayed in the display area 1001 as shown in FIG. 16B. Since this has been described in detail in FIG. 11, the description thereof will be omitted.

17 is a screen example illustrating a method of providing additional information when measuring health information according to an exemplary embodiment of the present invention.

Referring to FIG. 17, the processor 480 may provide the user with the numerical value of the measured health information and additional information by using augmented reality (AR). The processor 480 may further display a previously measured value 1703 and a recommended measurement time 1705 most suitable for measuring blood glucose on the display area 1001 of the execution screen of the healthcare menu. According to an embodiment of the present disclosure, the processor 480 may derive a recommended measurement time 1705 suitable for blood sugar measurement by analyzing a user's life pattern. The life pattern may be a weather alarm time set by the user, meal pattern information input from the user, and the like. According to an embodiment of the present disclosure, the processor 480 may derive the recommended measurement time 1705 suitable for blood sugar measurement by analyzing the biometric information of the user. For example, when the blood pressure decreases below a specified reference value or rises above a specified reference value, a time for measuring blood sugar may be set.

18 is a screen diagram illustrating a method of displaying a healthcare result according to an exemplary embodiment of the present invention.

Referring to FIG. 18, the processor 480 may perform an operation corresponding to operation 803 of FIG. 8 as shown in FIG. 18A. The processor 480 may display the healthcare result on the display 450. The health care result includes basic information (1801) such as the user's name, age, and gender, physical information (1803) such as height and weight, biometric information (1805) such as blood sugar, blood pressure, heart rate, electromyogram, and electroencephalogram, basic information ( 1801, body information 1803, and health care tips 1807 based on the biometric information 1805. According to an embodiment of the present disclosure, the processor 480 may graph and display a blood sugar of a specific period, for example, weekly, monthly, quarterly, or yearly. The processor 480 may display the highest blood sugar level and the lowest measured blood sugar level for one week as shown in FIG. 18A. The processor 480 may determine whether the average value is within the normal value based on the average value of the blood sugar level for one week. The processor 480 may simultaneously display health information such as blood sugar, blood pressure, heart rate, and exercise amount measured during a specific period of time.

The processor 480 may provide information, such as a type and method of exercise, a method of adjusting a diet, and a type of a diet, for a user's health care, depending on whether the average value of the health information is included within a normal value. have. When the average value of the health information exceeds a risk value, the processor 480 may guide the hospital located at the nearest location based on the current location of the electronic device 400. According to an embodiment of the present disclosure, the processor 480 may measure an exercise amount of the user. The processor 480 may provide an exercise type and a method based on the exercise amount of the user.

When it is confirmed that the finally measured blood glucose level is abnormal, the processor 480 may schedule a medical treatment at a diabetes-related diabetes hospital as shown in FIG. 18B. The processor 480 may display a message 1809 indicating a medical appointment on the display unit 450 as shown in FIG. 18B. When an input is generated in the message 1809 in the “OK” button, the processor 480 may schedule a medical treatment at a diabetes specialized hospital. According to an embodiment of the present disclosure, the processor 480 may provide an alarm service when the finally measured value or the average value of the measured value for a specific period is abnormal. For example, if it is determined that the abnormality may mean that the difference between the last measured value and the previously measured value is greater than or equal to the threshold value, or the average value is different from the normal value and more than the threshold value. The alarm service may be a service that outputs a warning message by pop-up message, vibration, sound, color change of the display unit 450, or the like. The alarm service may be a service that is set in advance by a user or connects a phone call to a specialized hospital associated with biometric information in which an abnormality has occurred. The alarm service may be a service that provides a user's status to a person located nearby through an acquaintance or a Bluetooth low energy (BLE) set by the user in advance.

Referring to FIG. 19, when an execution signal for a health care menu is received in operation 1901, the processor 480 may perform operation 1903. If the execution signal for the healthcare menu is not received in operation 1901, the processor 480 may terminate the process. In operation 1903, the processor 480 may perform user authentication. When user authentication is completed in operation 1903, the processor 480 may perform operation 1905. According to an embodiment of the present disclosure, the user authentication may include image data, iris data, voice data of the user, fingerprint data, password, pattern data, biometric information of the user, for example, heart rate information, obtained from the camera 430. , Electrocardiogram information, or encrypted code information.

In operation 1905, when a signal for obtaining health information of the user is received, the processor 480 may perform operation 1907. In operation 1907, the processor 480 may set an attribute and perform operation 1909. According to an embodiment of the present disclosure, the attribute may include at least one of a category and a unit of health information. In operation 1909, the processor 480 may activate the camera 430. In operation 1911, the processor 480 may recognize health information of the user. According to an embodiment of the present disclosure, the user's health information may indicate a user's health state such as blood pressure, heart rate, electrocardiogram, blood sugar, electrocardiogram, electroencephalogram, weight, height, vision, hearing, skin condition, body temperature, body fat, and stress response. It may contain information that can be used. Health information recognition for the operation 1911 will be described in detail with reference to FIG.

In operation 1913, the processor 480 may store the health information of the user recognized in operation 1911 in the memory 460. According to an embodiment of the present disclosure, the processor 480 may transmit health information to a server (not shown) located outside the electronic device 400 through the communication unit 410. In operation 1915, when the end signal for the healthcare menu is received, the processor 480 may end the above process. In operation 1915, if the end signal for the healthcare menu is not received, the processor 480 may return to operation 1905 and perform the above operations again.

In operation 1905, if a signal for obtaining health information of the user is not received, the processor 480 may perform operation 1917. In operation 1917, the processor 480 may perform a corresponding function. According to an embodiment of the present disclosure, the function may be a function for checking a health care result using health information of a user accumulated a predetermined number of times, or may be a function for setting environment information for a health care menu. Since the corresponding function for the operation 1917 has been described in detail with reference to FIGS. 8 and 9, the description thereof will be omitted.

Referring to FIG. 20, in operation 2001, the processor 480 may acquire image data by the activated camera 430. In operation 2003, the processor 480 may analyze the acquired image data. According to an embodiment of the present disclosure, the image data may be image data obtained by photographing a measurement result of the user's health information measured by the measuring device. According to an embodiment of the present disclosure, the image data may be preview image data, or may be image data in which a specific frame is captured in the preview image data. According to an embodiment of the present disclosure, the processor 480 may analyze a character included in the image data through OCR reading. In operation 2005, the processor 480 may check the numerical value of the category according to the analysis result of the image data.

In operation 2007, the processor 480 may compare past measurement details stored in the memory 460 with the numerical value confirmed in operation 2005. In operation 2009, the processor 480 may check whether there is a history that is similar to or the same as the value confirmed in operation 2005 among the past measurement details. In operation 2009, the processor 480 may perform operation 2011 when details of the past measurement details that are similar to or identical to the values confirmed in operation 2005 exist. In operation 2011, the processor 480 may check user information that is similar to or identical to the numerical value identified in operation 2005, and may return to operation 1913 of FIG. In operation 2009, the processor 480 may perform operation 1913 of FIG. 19 when there are no details that are similar to or the same as the value confirmed in operation 2005 among the past measurement details.

According to an embodiment of the present disclosure, in the operation method of the electronic device 400, an operation of acquiring image data using the camera 430, an operation of recognizing user's health information from the image data, and an attribute corresponding to the health information may be determined. And storing the health information in association with the user based on the operation and the attribute.

Recognizing the health information may include an operation of recognizing a character in the image data and an operation of identifying the health information based on the character. The attribute may include at least one of a category or a unit of health information.

The determining of the attribute may further include identifying the measuring equipment for measuring health information from the image data and determining the attribute based on the identified measuring equipment.

The operation of identifying the measurement equipment may include identifying the measurement equipment based on at least one of an appearance, a barcode, a quick response code, a model number, and a name of the measurement equipment included in the image data. can do.

The determining of the attribute may further include determining the attribute based on a time or place corresponding to the operation of acquiring image data.

The operation of recognizing the health information may include identifying an attribute of the health information measurable at the location of the electronic device 400, recognizing a character included in the acquired image data, and identifying the health information based on the character. May include an action.

The recognizing the health information may further include displaying the health information by overlaying the health information on the image data. The operation of overlaying and displaying the health information may further include overlaying and displaying the additional information including the past measurement history of the health information and the recommended measurement time of the health information on the image data.

The storing operation may further include performing authentication for the user, and storing the health information based on the authentication.

On the other hand, the embodiments of the present invention disclosed in the specification and drawings are merely presented specific examples to easily explain the technical contents of the present invention and help the understanding of the present invention, and are not intended to limit the scope of the present invention. That is, it will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented.

Claims

In the operating method of the electronic device,

Acquiring image data using a camera;

Recognizing health information from the image data;

Determining an attribute corresponding to the health information; And

Based on the attribute, storing the health information in association with the user;

How to include.
The method of claim 1,

Recognizing the health information,

Recognizing a character in the image data; And

Confirming the health information based on the text;

How to include.
The method of claim 1,

The property is

At least one of the category or unit of health information.
The method of claim 1,

The operation of determining the attribute,

Identifying measurement equipment for measuring the health information from the image data; And

Determining the attribute based on the identified measurement equipment;

How to include more.
The method of claim 4, wherein

Identifying the measurement equipment,

Identifying the measurement device based on at least one of an appearance, a barcode, a quick response code, a model number, and a name of the measurement device included in the image data;

How to include.
The method of claim 1,

The operation of determining the attribute,

Determining the attribute based on a time or place corresponding to the operation of acquiring the image data;

How to include more.
The method of claim 1,

Recognizing the health information,

Identifying an attribute of health information measurable at a location of the electronic device;

Recognizing a character included in the obtained image data; And

Confirming the health information based on the text;

How to include.
The method of claim 1,

Recognizing the health information,

Overlaying and displaying the health information on the image data;

How to include more.
The method of claim 8,

The operation of overlaying and displaying the health information,

Overlaying and displaying additional information including the past measurement history of the health information and a recommended measurement time of the health information on the image data;

How to include more.
The method of claim 1,

The storing operation,

Performing authentication for the user; And

Based on the authentication, storing the health information;

How to include more.
In an electronic device,

A camera for acquiring image data; And

A processor, wherein the processor,

Recognize the health information of the user from the image data,

Determine an attribute corresponding to the health information, and

An electronic device configured to store the health information in association with the user based on the attribute.
The method of claim 11,

The processor,

The electronic device recognizes a character in the image data and checks the health information based on the character.
The method of claim 11,

The property is

And at least one of a category or a unit of the health information.
The method of claim 11,

The processor,

And identifying a measurement device for measuring the health information from the image data and determining the attribute based on the identified measurement device.
The method of claim 14,

The processor,

And an electronic device for identifying the measurement device based on at least one of an appearance, a barcode, a quick response code, a model number, and a name of the measurement device included in the image data.