WO2018123228A1 - Système de traitement d'informations - Google Patents

Système de traitement d'informations Download PDF

Info

Publication number
WO2018123228A1
WO2018123228A1 PCT/JP2017/037989 JP2017037989W WO2018123228A1 WO 2018123228 A1 WO2018123228 A1 WO 2018123228A1 JP 2017037989 W JP2017037989 W JP 2017037989W WO 2018123228 A1 WO2018123228 A1 WO 2018123228A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal device
sphygmomanometer
server
measurement result
measurement
Prior art date
Application number
PCT/JP2017/037989
Other languages
English (en)
Japanese (ja)
Inventor
出野　徹
北村　隆
Original Assignee
オムロンヘルスケア株式会社
オムロン株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オムロンヘルスケア株式会社, オムロン株式会社 filed Critical オムロンヘルスケア株式会社
Priority to CN201780076309.0A priority Critical patent/CN110099606B/zh
Priority to MX2019007044A priority patent/MX2019007044A/es
Priority to RU2019118661A priority patent/RU2731445C1/ru
Publication of WO2018123228A1 publication Critical patent/WO2018123228A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
    • A61B5/021—Measuring pressure in heart or blood vessels
    • A61B5/022—Measuring pressure in heart or blood vessels by applying pressure to close blood vessels, e.g. against the skin; Ophthalmodynamometers

Definitions

  • the present disclosure relates to an information processing system, and more particularly, to an information processing system including a sphygmomanometer, a terminal device, and a server configured to be able to communicate with the terminal device.
  • Various measuring devices for measuring various biological information related to the health condition of the human body such as blood pressure and pulse have been developed.
  • the user's health condition is confirmed by taking it into a terminal device for collecting measurement data of such a measuring instrument.
  • Patent Document 1 discloses a data input device.
  • the data input device includes image acquisition means for obtaining an image of data displayed on the data display unit of the measuring instrument, number reading means for reading the numbers in the obtained image, and display means for displaying the read numbers. .
  • Patent Document 1 discloses that measurement data measured and displayed by a predetermined measurement device and outputting the analysis result to a predetermined processing device, etc., but teaches any technology related to the above needs. Absent.
  • the present disclosure has been made in view of the above, and an object in one aspect is to provide an information processing system that can more accurately grasp the health state of a user of a terminal device.
  • An information processing system includes a sphygmomanometer, a terminal device, and a server configured to be able to communicate with the terminal device.
  • the terminal device transmits an imaging unit, a detection unit that detects a measurement result displayed on the display of the sphygmomanometer from the images of the sphygmomanometer included in the captured image generated by the imaging unit, and the measurement result to the server A terminal transmission unit.
  • the server evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device, and if the evaluation unit evaluates that the reliability of the measurement result is low, the server sends an error notification to the terminal device. And a server transmission unit for transmission.
  • the measurement result includes the measurement date and time when the measurement was performed using a sphygmomanometer.
  • the terminal transmission unit further transmits the imaging date / time of the captured image to the server.
  • the evaluation unit calculates a period from the measurement date to the imaging date and evaluates that the reliability of the measurement result is low when the calculated period is not within the predetermined period.
  • the server transmission unit transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device.
  • the terminal device further includes a location information acquisition unit that acquires location information of the terminal device.
  • the terminal transmission unit further transmits the position information of the terminal device to the server.
  • the evaluation unit determines whether or not the terminal device is present at a predetermined position based on the received position information of the terminal device. If the terminal device is not present at the predetermined position, the reliability of the measurement result is low. And evaluate.
  • the server transmission unit transmits an error notification indicating that the measurement location of the sphygmomanometer is different from the predetermined position to the terminal device.
  • the terminal transmission unit further transmits the captured image to the server.
  • the evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on the received captured image, and evaluates that the reliability of the measurement result is low when the sphygmomanometer is not the predetermined sphygmomanometer To do.
  • the server transmission unit transmits an error notification indicating that the sphygmomanometer is not a predetermined sphygmomanometer to the terminal device.
  • the evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on at least one of the brand, shape, and model of the sphygmomanometer extracted from the received captured image.
  • the captured image further includes a finger image of the person to be measured of the sphygmomanometer.
  • the evaluation unit extracts the first feature information of the finger from the finger image of the measurement subject included in the captured image, the first feature information, and the second feature information of the measurement subject's finger stored in the server in advance. If the first feature information and the second feature information do not match, it is evaluated that the reliability of the measurement result is low.
  • the server transmission unit transmits to the terminal device an error notification indicating that the finger image of the measurement subject included in the captured image is different from the finger image of the measurement subject registered in advance.
  • FIG. 1 is a diagram illustrating a schematic configuration of an information processing system. It is a block diagram showing an example of the hardware constitutions of a terminal device. It is a figure which shows an example of the external appearance of the main-body part of a blood pressure meter. It is a figure which shows the operation
  • FIG. 1 It is a figure which shows an example of the captured image of the scene where the to-be-measured person wears the wrist type blood pressure monitor. It is a block diagram which shows the function structure of a terminal device and a server. It is a flowchart which shows an example of the process sequence of a terminal device and a server. It is a flowchart which shows an example of the reliability evaluation processing procedure according to this Embodiment.
  • FIG. 1 is a diagram illustrating a schematic configuration of the information processing system 1.
  • information processing system 1 includes a plurality of terminal devices 10 ⁇ / b> A and 10 ⁇ / b> B that are user terminals, blood pressure monitors 20 ⁇ / b> A and 20 ⁇ / b> B for measuring a user's blood pressure, a server 30, and a network 40.
  • terminal device 10A is a user A terminal
  • terminal device 10B is a user B terminal.
  • the terminal devices 10A and 10B may be collectively referred to as “terminal device 10”.
  • the sphygmomanometer 20A is a stationary upper arm type sphygmomanometer in which the main body and the cuff (arm band) are separate bodies.
  • the sphygmomanometer 20B is a wristwatch type wrist sphygmomanometer in which a main body and a cuff are integrated.
  • the sphygmomanometer 20B has a function of wearing a wrist for a long time like a wristwatch and measuring a pulsation every beat for 24 hours continuously, a function of always wearing it and measuring by simply pressing a measurement start button, etc. . Thereby, the sphygmomanometer 20B can always measure the blood pressure of the user.
  • the sphygmomanometers 20A and 20B may be collectively referred to as “sphygmomanometer 20”.
  • the terminal device 10 is, for example, a smartphone having a camera and a touch panel.
  • the terminal device 10 has a function of detecting a measurement result displayed on the display of the sphygmomanometer 20 from a captured image generated by imaging the sphygmomanometer 20 using a camera.
  • a smartphone will be described as a representative example of a “terminal device”.
  • the terminal device may be another terminal device having an imaging function such as a foldable mobile phone, a tablet terminal device, or a PDA (Personal Data Assistance).
  • the network 40 for connecting the terminal device 10 and the server 30 to each other includes various networks such as the Internet and a mobile terminal communication network.
  • the server 30 stores various data transmitted from the terminal device 10. Specifically, the server 30 stores the identification information (user ID) of the user and the identification information (terminal ID) of the terminal device 10 in the database 32 in association with each other. The server 30 manages various data transmitted from each terminal device 10 for each user ID (and terminal ID) using the database 32. In the database 32, for example, measurement results such as the blood pressure value of the user A transmitted from the terminal device 10A to the server 30 are stored.
  • FIG. 2 is a block diagram illustrating an example of a hardware configuration of the terminal device 10.
  • the terminal device 10 includes, as main components, a processor 152, a memory 154, an input device 156, a display 158, a wireless communication unit 160, a communication antenna 162, a camera 163, and a memory. It includes an interface (I / F) 164, a communication interface (I / F) 166, a speaker 168, a microphone 170, and a GPS controller 172.
  • the processor 152 is typically an arithmetic processing unit such as a CPU (Central Processing Unit) or an MPU (Multi Processing Unit).
  • the processor 152 functions as a control unit that controls the operation of each unit of the terminal device 10 by reading and executing the program stored in the memory 154.
  • the processor 152 implements each process (step) of the terminal device 10 to be described later by executing the program.
  • the memory 154 is realized by a RAM (Random Access Memory), a ROM (Read-Only Memory), a flash memory, or the like.
  • the memory 154 stores a program executed by the processor 152, data used by the processor 152, and the like.
  • the input device 156 accepts an operation input to the terminal device 10.
  • the input device 156 is realized by a touch panel.
  • the touch panel is provided on a display 158 having a function as a display unit, and is, for example, a capacitance type.
  • the touch panel detects a touch operation on the touch panel by an external object every predetermined time, and inputs touch coordinates to the processor 152.
  • the input device 156 may include a button or the like.
  • the wireless communication unit 160 connects to the mobile communication network via the communication antenna 162 and transmits and receives signals for wireless communication. Thereby, the terminal device 10 can communicate with another communication device (for example, the server 30) via a mobile communication network such as LTE (Long Term Evolution).
  • LTE Long Term Evolution
  • the camera 163 is realized by, for example, a CCD (Charge Coupled Device) method, a CMOS (Complementary Mental Oxide Semiconductor) method, or other methods.
  • CCD Charge Coupled Device
  • CMOS Complementary Mental Oxide Semiconductor
  • Memory interface 164 reads data from external storage medium 165.
  • the processor 152 reads data stored in the storage medium 165 via the memory interface 164 and stores the data in the memory 154.
  • the processor 152 reads data from the memory 154 and stores the data in the external storage medium 165 via the memory interface 164.
  • the storage medium 165 is non-volatile such as CD (Compact Disc), DVD (Digital Versatile Disk), BD (Blu-ray (registered trademark) Disc), USB (Universal Serial Bus) memory, SD (Secure Digital) memory card, etc. Includes media for storing programs.
  • CD Compact Disc
  • DVD Digital Versatile Disk
  • BD Blu-ray (registered trademark) Disc
  • USB Universal Serial Bus
  • SD Secure Digital
  • the communication interface (I / F) 166 is a communication interface for exchanging various data with other devices, and is realized by an adapter or a connector.
  • BLE Bluetooth (registered trademark) low energy
  • the communication method may be a wireless communication method using a wireless LAN or the like, or a wired communication method using USB (Universal Serial Bus) or the like.
  • the speaker 168 converts the audio signal given from the processor 152 into audio and outputs it to the outside of the terminal device 10.
  • the microphone 170 receives an audio input to the terminal device 10 and gives an audio signal corresponding to the audio input to the processor 152.
  • the GPS controller 172 acquires the position information of the terminal device 10 by receiving a GPS signal or a position signal (positioning signal) from the base station.
  • the GPS controller 172 inputs the acquired position information of the terminal device 10 to the processor 152.
  • the terminal device 10 includes various sensors (acceleration sensor and angular velocity sensor), a timer unit for measuring time, and the like.
  • the server 30 only needs to provide information processing as described below as a whole, and a known hardware configuration can be adopted.
  • the server 30 receives a processor for executing various processes, a memory for storing programs and data, a communication interface for transmitting and receiving various data to and from the terminal device 10, and instructions from an administrator. Including an input interface.
  • the sphygmomanometer 20 only needs to provide information processing as described below as a whole, and a known hardware configuration can be adopted.
  • the sphygmomanometer 20 includes a processor for executing various processes, a memory for storing programs and data, a display for displaying measurement data, and an input interface for receiving instructions from a user. (For example, buttons, switches, etc.), a cuff that can be wound around the user's upper arm (or wrist), a cuff pressure adjusting mechanism such as a piezoelectric pump and an exhaust valve, a pressure sensor for detecting the cuff pressure, A time measuring unit for measuring time and a temperature sensor for detecting outside air temperature are included.
  • FIG. 3 is a diagram showing an example of the appearance of the main body of the sphygmomanometer 20A.
  • main body portion 22 of blood pressure monitor 20 ⁇ / b> A includes a display 24, a forward / back button 26, a lamp 27, a user number switch 28, and a blood pressure measurement start / stop button 29.
  • brand information 41 for example, brand “AAA”
  • model information 43 for example, model “XYZ-ABC” of the sphygmomanometer 21 are provided on the outer surface of the main body 22.
  • the user number switch 28 is used when storing measurement results for two persons separately. In the example of FIG. 3, the user with the number “1” is selected.
  • the lamp 27 is a lamp indicating whether the cuff is wound properly, and is shown to be appropriate in the example of FIG.
  • the measurement result is displayed on the display 24. Specifically, the measurement result is displayed in the region 52 with the maximum blood pressure value (for example, 118 mmHg), the minimum blood pressure value (for example, 78 mmHg) and the pulse rate (for example, 70 nights / minute) displayed in the region 50.
  • the measurement date and time for example, July 1, 7:30
  • the user number for example, “1”
  • the current temperature for example, 24 degrees
  • various messages displayed in the area 58 for example, a message indicating the completion of measurement.
  • the measurement result may include information indicating the pulse wave state, information indicating the suitability of the cuff winding method, and the like.
  • FIG. 4 is a diagram showing an outline of the operation of the information processing system 1.
  • FIG. 5 is a diagram showing a screen displayed on the display 158 of the terminal device 10 when the sphygmomanometer 20A is imaged.
  • FIG. 6 is a diagram illustrating an example of an error notification displayed on the display 158 of the terminal device 10.
  • sphygmomanometer 20A measures the blood pressure value (maximum blood pressure value, minimum blood pressure value) and pulse rate of the user, and displays the measurement result on display 24 (sequence SQ10).
  • Terminal device 10 uses camera 163 to image (capture) sphygmomanometer 20A in a state where the measurement result is displayed on display 24 (sequence SQ12).
  • Terminal apparatus 10 detects a measurement result from the captured image (sequence SQ14). For example, as illustrated in FIG. 5, a screen 500 including four corner frames 510 is displayed on the display 158 of the terminal device 10 in the imaging mode. The user takes an image so that the display 24 of the sphygmomanometer 20 ⁇ / b> A fits within the frame 510. Thereby, the terminal device 10 detects the measurement result by analyzing the captured image using a known OCR technique or the like and an image recognition technique or the like.
  • the frame 510 is displayed as a frame indicating the outer four corners of the recognition range (analysis range) in which a character string can be recognized. Therefore, the inside of the frame 510 is a recognition range.
  • the terminal device 10 executes processing for recognizing a measurement result that is captured so as to be within the recognition range. Specifically, the terminal device 10 recognizes various character strings included in the measurement result.
  • the “character” in the present embodiment means a symbol that combines lines, dots, etc. to transmit and record a word (language), and not only alphanumeric characters, kanji, kana characters, etc., but also pictograms In addition, an arbitrary figure such as a stamp is attached with an identification code.
  • the terminal device 10 stores in the memory 154 screen information indicating what information is displayed in which region of the display 24 of the sphygmomanometer 20A. Therefore, for example, when the image is captured so that the display 24 fits within the frame 510 that is the recognition range, the terminal device 10 uses the screen information to determine what information each recognized character string is. Can be identified. For example, in the terminal device 10, a plurality of character strings “118”, “78”, and “70” recognized in the area 50 of the display 24 within the frame 510 are respectively a maximum blood pressure value, a minimum blood pressure value, and a pulse rate. Can be identified.
  • the terminal device 10 receives an instruction from the user and specifies that the subject is the blood pressure monitor 20A.
  • the terminal device 10 extracts the sphygmomanometer characteristic information (shape, model, brand) and the like from the captured image, and compares the extracted characteristic information with the pre-stored characteristic information of each sphygmomanometer. Thus, it may be specified that the subject is the blood pressure monitor 20A.
  • terminal apparatus 10 transmits various information including measurement data and other information to server 30 via network 40 (sequence SQ16).
  • the other information is, for example, the imaging date / time, user ID, terminal ID, and the like.
  • the server 30 evaluates the reliability of the measurement result based on a predetermined evaluation method (sequence SQ18). For example, the server 30 evaluates that the reliability of the measurement result is low when the period from the measurement date to the imaging date is not within a predetermined period. In this case, the server 30 does not store the measurement result in the database 32.
  • a predetermined evaluation method sequence SQ18.
  • the server 30 evaluates that the reliability of the measurement result is low, the server 30 notifies the terminal device 10 of an error (sequence SQ20). For example, since the period from the time of measurement to the time of imaging is too long, the server 30 transmits an error notification indicating that the measurement result is unreliable to the terminal device 10.
  • Terminal apparatus 10 displays the error notification received from server 30 on display 158 (sequence SQ22). For example, as illustrated in FIG. 6, the terminal device 10 has a low reliability such as a message 610 such as “It is a measurement result with low reliability” or “a period from measurement to imaging is too long”.
  • An error notification screen 600 including a message 620 indicating the above is displayed on the display 158.
  • the error notification screen 600 may further include a message prompting the user to perform remeasurement.
  • the server 30 evaluates that the reliability of the measurement data is high (not low) based on a predetermined evaluation method, the server 30 notifies the terminal device 10 that the measurement data is normal. You may send it. In this case, the server 30 stores the measurement data in the database 32.
  • the server 30 evaluates the reliability of the measurement result received from the terminal device 10 according to various evaluation methods.
  • an evaluation method executed by the server 30 will be described.
  • the reliability of the measurement result is evaluated based on the period from the measurement date and time to the imaging date and time.
  • the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20A and the imaging date and time when the sphygmomanometer 20A is captured to the server 30.
  • the server 30 calculates the period from the measurement date and time to the imaging date and time, and evaluates that the reliability of the measurement result is low when the calculated period (calculation period) is not within a predetermined period (for example, within 1 minute). If the calculation period is within the predetermined period, it is evaluated that the measurement result has high reliability. The reason for evaluating the reliability in this way will be described below.
  • the period from the measurement date to the imaging date is not within the predetermined period, it is considered that the user of the terminal device 10 who is the subject does not immediately take a blood pressure monitor using the camera after measuring the blood pressure. . From this, it is impossible to deny the possibility that the measurement results will be tampered with by any method, so that the reliability of the measurement results is evaluated to be low.
  • the calculation period does not fall within the predetermined period even if the blood pressure measurement is performed immediately after the user performs blood pressure measurement using the camera. Since blood pressure fluctuates even during the day, an index (that is, measurement date and time) indicating when (morning or night) during the day is used to accurately grasp the user's health status. It becomes an important factor. From this, when the calculation period is not within the predetermined period, the possibility that the measurement date and time is not accurate cannot be denied, so that it is evaluated that the reliability of the measurement result is low.
  • the reliability of the measurement result is evaluated based on the measurement location.
  • the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20 ⁇ / b> A and the position information of the own device to the server 30.
  • the server 30 determines whether or not the terminal device 10 exists at a predetermined measurement location based on the position information of the terminal device 10.
  • the server 30 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined measurement location, and evaluates that the reliability of the measurement result is high when it exists at the predetermined measurement location.
  • the position information of the predetermined measurement location is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. The reason for evaluating the reliability in this way will be described below.
  • an index indicating whether the measurement location at the time of blood pressure measurement is the same as the usual location (predetermined measurement location) is an important factor in accurately grasping the health condition of the user. From this, when the terminal device 10 does not exist at a predetermined measurement location, the possibility that the blood pressure changes according to the measurement location cannot be denied, and therefore, it is evaluated that the reliability of the measurement result is low.
  • the measurement date and time may be further compared with the reception date and time when the server 30 received the position information in order to more accurately determine that the terminal device 10 was present at the predetermined measurement location at the time of blood pressure measurement.
  • the server 30 performs the blood pressure measurement. Sometimes it is determined that it was present at a predetermined measurement location.
  • the server 30 is present at the predetermined measurement location when blood pressure is measured if the time is not within the predetermined time. Judge that it was not. In this case, the server 30 evaluates that the reliability of the measurement result is low.
  • the reliability of the measurement result is evaluated based on the brand, model and shape of the sphygmomanometer.
  • the terminal device 10 transmits the captured image of the sphygmomanometer 20 ⁇ / b> A to the server 30.
  • the server 30 determines whether or not the sphygmomanometer 20A is an authenticated sphygmomanometer based on the captured image.
  • the server 30 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20A is not an authenticated sphygmomanometer, and evaluates that the reliability of the measurement result is high when the sphygmomanometer 20A is an authenticated sphygmomanometer. Specifically, the server 30 extracts brand information, model, shape, and the like of the sphygmomanometer 20A based on the captured image of the sphygmomanometer 20A. Based on these pieces of information, the server 30 determines whether the sphygmomanometer 20A is an authenticated sphygmomanometer. For example, it is assumed that the blood pressure monitor of brand X is an authenticated blood pressure monitor. In this case, when the extracted brand information indicates brand X, the server 30 determines that the sphygmomanometer 20A is an authenticated sphygmomanometer.
  • evaluation method (Part 4), the reliability of the measurement result is evaluated based on the finger image of the user (measured person).
  • the person to be measured images the blood pressure monitor 20A and his / her finger using the camera 163 of the terminal device 10A.
  • FIG. 7 is a diagram illustrating an example of a captured image including a sphygmomanometer and the finger of the measurement subject.
  • the screen 700 in FIG. 7 shows an image of a measurement subject in which a left finger is brought close to the sphygmomanometer 20A when the sphygmomanometer 20A, which is an upper arm sphygmomanometer, is used to measure the cuff around the left arm. It represents the situation.
  • the terminal device 10A transmits to the server 30 a captured image including an image of the sphygmomanometer 20A and a finger image of the person to be measured as shown on the screen 700.
  • the server 30 extracts finger characteristic information from the finger image of the measurement subject.
  • the server 30 determines whether or not the finger feature information stored in association with the terminal ID (and user ID) of the terminal device 10A matches the extracted finger feature information. If the stored feature information does not match the extracted feature information, the server 30 determines that the person to be measured is not the user A (the user of the terminal device 10A), and the reliability of the measurement result. Is evaluated as low. When these pieces of feature information match, the server 30 determines that the person to be measured is the user A and evaluates that the reliability of the measurement result is high.
  • FIG. 7 shows that the entire five fingers are imaged, but if the finger feature information is comparable, one or more specific fingers (for example, only the index finger) are included. You may image as follows.
  • the palm feature information stored in association with the terminal ID of the terminal device 10A matches the palm feature information of the person to be measured extracted from the captured image, the measurement result is evaluated as highly reliable. When the feature information does not match, it may be evaluated that the reliability of the measurement result is low.
  • the reliability of the measurement result may be evaluated based on the wearing state.
  • FIG. 8 is a diagram illustrating an example of a captured image of a scene in which the measurement subject wears a wrist type sphygmomanometer.
  • a screen 800 in FIG. 8 shows a state in which the measurement subject takes an image of a state in which the sphygmomanometer 20B is worn when the cuff is wrapped around the left wrist using the sphygmomanometer 20B which is a wrist sphygmomanometer. Yes.
  • the terminal device 10 transmits to the server 30 a captured image in a state in which the sphygmomanometer 20B is attached to the wrist of the person to be measured as shown on the screen 800. Specifically, even in the case of a wrist blood pressure monitor, the reliability of the measurement result is evaluated based on the characteristic information of the finger (and palm) of the person to be measured, as in the case of the upper arm blood pressure monitor. Therefore, the terminal device 10 transmits a captured image (captured image as illustrated in FIG. 8) including the sphygmomanometer 20 ⁇ / b> B to the measurement subject's wrist and including the measurement subject's fingers. .
  • the server 30 evaluates that the reliability of the measurement result is low. For example, when the image of the sphygmomanometer 20B and the image of the finger and wrist of the measurement subject are not included in the captured image, the server 30 determines that the sphygmomanometer 20B is not attached. Assess that the reliability of the measurement results is low.
  • the server 30 determines that the sphygmomanometer 20B is attached, does the hand feature information stored in association with the terminal ID of the terminal device 10A match the extracted hand feature information? Further determine whether or not. If the stored feature information does not match the extracted feature information, the server 30 determines that the measurement subject is not the user A and evaluates that the reliability of the measurement result is low. When these pieces of feature information match, the server 30 determines that the person to be measured is the user A and evaluates that the reliability of the measurement result is high.
  • FIG. 9 is a block diagram illustrating functional configurations of the terminal device 10 and the server 30.
  • the terminal device 10 includes an imaging unit 202, a display control unit 204, a detection unit 206, a position information acquisition unit 208, and a terminal communication unit 210.
  • the server 30 includes a server communication unit 252, an evaluation unit 254, and a database 32.
  • the imaging unit 202 of the terminal device 10 captures a subject and generates a captured image.
  • the imaging unit 202 generates a captured image including an image of the sphygmomanometer 20 as a subject.
  • the imaging unit 202 is a function that is realized mainly by the cooperation of the processor 152 and the camera 163.
  • the imaging unit 202 outputs the generated captured image to the display control unit 204, the detection unit 206, and the terminal communication unit 210.
  • the display control unit 204 causes the display 158 to display captured images generated by sequentially capturing images by the imaging unit 202.
  • the detection unit 206 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the image of the sphygmomanometer 20 included in the captured image generated by the imaging unit 202.
  • the measurement result includes, for example, a systolic blood pressure value, a diastolic blood pressure value, a pulse rate, a measurement date and time, an air temperature, a user number, various messages, information indicating whether or not a cuff is wound, and information indicating a pulse wave state.
  • the detection unit 206 outputs the detected measurement result to the terminal communication unit 210.
  • the location information acquisition unit 208 acquires location information of the terminal device 10 based on a GPS signal or a location signal from a base station.
  • the position information acquisition unit 208 is a function mainly realized by the GPS controller 172.
  • the position information acquisition unit 208 outputs the acquired position information to the terminal communication unit 210.
  • the terminal communication unit 210 transmits various information including the measurement result detected by the detection unit 206 and other information to the server 30.
  • Other information includes, for example, the user ID, the terminal ID, the captured image generated by the imaging unit 202, the imaging date and time of the captured image, and the location information of the terminal device 10 acquired by the location information acquisition unit 208.
  • the server communication unit 252 of the server 30 receives various information from the terminal device 10.
  • the server communication unit 252 outputs various types of information to the evaluation unit 254.
  • the evaluation unit 254 evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device 10. When the evaluation unit 254 evaluates that the reliability of the measurement result is low, the server communication unit 252 transmits an error notification to the terminal device 10.
  • the evaluation unit 254 calculates a period from the measurement date to the imaging date and determines whether the calculated period is within a predetermined period. If the calculated period is not within the predetermined period, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device 10.
  • the evaluation unit 254 determines whether or not the terminal device 10 exists at a predetermined position based on the position information of the terminal device 10 received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the terminal device 10 does not exist at the predetermined position. Information indicating the predetermined position is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. In this case, the server communication unit 252 transmits an error notification indicating that the measurement location of the sphygmomanometer 20 is different from the predetermined position to the terminal device 10.
  • the evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the captured image received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20 is not a predetermined sphygmomanometer. More specifically, the evaluation unit 254 extracts at least one of the brand, model, and shape of the sphygmomanometer 20 from the captured image. The evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the extracted information.
  • the server communication unit 252 transmits an error notification that the sphygmomanometer 20 is not a predetermined sphygmomanometer to the terminal device 10.
  • the predetermined sphygmomanometer is, for example, a sphygmomanometer approved by the administrator of the server 30 by satisfying conditions such as measurement accuracy.
  • the evaluation unit 254 extracts the finger feature information Fa from the finger image of the measurement subject included in the captured image.
  • the evaluation unit 254 determines whether or not the feature information Fa matches the feature information Fb of the measurement subject's finger stored in the memory of the server 30 in advance.
  • the evaluation unit 254 evaluates that the reliability of the measurement result is low when the feature information Fa and the feature information Fb do not match.
  • the server communication unit 252 transmits an error notification to the terminal device 10 that the finger image of the measurement subject included in the captured image is different from the finger image of the measurement subject stored in advance.
  • the feature information Fb is stored in the memory of the server 30 in association with the terminal ID and the user ID.
  • the evaluation unit 254 may evaluate the reliability of the measurement result based on the plurality of evaluation items described above. For example, “period from the measurement date to the imaging date” is set as the evaluation item E1, “positional information of the terminal device 10” is set as the evaluation item E2, “sphygmomanometer used for measurement” is set as the evaluation item E3, The included “finger image of the person to be measured” is set as the evaluation item E4. In this case, if any one of the evaluation items E1 to E4 is evaluated that the reliability of the measurement result is low according to the above-described evaluation method, the evaluation unit 254 determines the reliability of the measurement result for the remaining evaluation items. Even if it is not evaluated as low, it is finally evaluated that the reliability of the measurement result is low.
  • the evaluation unit 254 finally evaluates that all of the evaluation items E1 to E4 are high in reliability of the measurement result only when the reliability of the measurement result is not evaluated according to the above-described evaluation method. To do. It should be noted that which evaluation item is used to evaluate the measurement result may be arbitrarily set by an administrator of the server 30 or the like.
  • Evaluation unit 254 outputs the evaluation result to server communication unit 252. When evaluating that the reliability of the measurement result is low, the evaluation unit 254 discards the measurement result without storing it in the database 32. When the evaluation unit 254 evaluates that the reliability of the measurement result is high, the evaluation unit 254 stores the measurement result in the database 32 in association with the terminal ID and the user ID.
  • the server communication unit 252 notifies that the measurement result is normal (for example, that the measurement result is normally stored in the database 32). Notification) may be transmitted to the terminal device 10.
  • the terminal communication unit 210 of the terminal device 10 receives various notifications (for example, error notification and normal notification) transmitted from the server 30.
  • the terminal communication unit 210 outputs the received various notifications to the display control unit 204.
  • the display control unit 204 displays various notifications on the display 158.
  • FIG. 10 is a flowchart illustrating an example of a processing procedure of the terminal device 10 and the server 30.
  • the processor 152 of the terminal device 10 generates a captured image of the sphygmomanometer 20 captured using the camera 163 (step S100).
  • the processor 152 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the captured image (step S102).
  • the processor 152 transmits various information to the server 30 via the wireless communication unit 160 (or communication interface 166) (step S104).
  • the various information includes a measurement result, a user ID, a terminal ID, a captured image, a captured date and time, and position information of the terminal device 10.
  • the measurement result includes a maximum blood pressure value, a minimum blood pressure value, a pulse rate, and a measurement date and time.
  • the processor of the server 30 receives various information transmitted from the terminal device 10 via the communication interface (step S106).
  • the server processor executes a reliability evaluation process of the measurement result based on various information (step S110).
  • FIG. 11 is a flowchart illustrating an example of a reliability evaluation processing procedure.
  • the server processor determines whether or not the period from the measurement date to the imaging date is within a predetermined period (step S202). If the period is not within the predetermined period (NO in step S202), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the period is within the predetermined period (YES in step S202), the server processor determines whether or not the terminal device 10 exists at a predetermined position (step S204).
  • the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If terminal device 10 is present at a predetermined position (YES in step S204), the server processor determines whether or not sphygmomanometer 20 used for measurement is a predetermined sphygmomanometer (step S206).
  • the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the sphygmomanometer 20 is a predetermined sphygmomanometer (YES in step S206), the server processor records the characteristic information of the finger of the person to be measured included in the received captured image and the target stored in the memory of the server 30. It is determined whether or not the feature information of the measurer's finger matches (step S208).
  • step S208 the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If these pieces of feature information match (YES in step S208), the server processor evaluates that the reliability of the measurement result is high (step S210), and ends the reliability evaluation process.
  • the server processor determines whether or not the reliability of the measurement result is evaluated to be low in the reliability evaluation process (step S112).
  • the server processor evaluates that the reliability of the measurement result is low (YES in step S112)
  • the server processor transmits an error notification to the terminal device 10 via the communication interface (step S114).
  • the server processor evaluates that the reliability of the measurement result is high (NO in step S112)
  • the server processor stores the measurement result in the database 32 (step S116). Subsequently, the server processor transmits a notification that the measurement result has been normally stored in the database 32 to the terminal device 10 via the communication interface (step S118).
  • the terminal device 10 receives various notifications from the server 30 via the wireless communication unit 160 (or the communication interface 166) (step S120).
  • the terminal device 10 displays various notifications on the display 158 (step S122) and ends the process.
  • the terminal device 10 may output various notifications as voices via the speaker 168.
  • the reliability of the measurement result transmitted from the terminal device 10 to the server 30 is evaluated, and when the reliability is evaluated to be low, an error notification is transmitted from the server 30 to the terminal device 10. .
  • the user can grasp the reliability of the measurement result in real time.
  • it is possible to reduce the possibility that the user is overconfident in his / her health condition or becomes too concerned about his / her health condition.
  • the server 30 may evaluate the reliability of the measurement result based on information indicating the air temperature included in the measurement result and the information indicating whether or not the cuff is wound. Specifically, the server 30 may determine that the reliability of the measurement result is low when the air temperature is lower than a predetermined temperature or when the cuff winding method is not appropriate.
  • the reliability of the measurement result may be evaluated as follows. Specifically, the evaluation unit 254 of the server 30 determines that the difference between the measurement time Ta1 included in the current measurement result and the measurement time Ta2 included in the past measurement result (for example, yesterday's measurement result) is within a predetermined time. It is determined whether or not (for example, within 5 minutes). For example, the evaluation unit 254 determines whether the measurement on one day and the measurement on another day are performed at substantially the same time. Further, the evaluation unit 254 determines whether or not the difference between the imaging time Tb1 included in the current measurement result and the imaging time Tb2 included in the past measurement result is within a predetermined time. For example, the evaluation unit 254 determines whether or not imaging after measurement on one day and imaging after measurement on another day are performed at approximately the same time.
  • the evaluation unit 254 determines whether or not the sphygmomanometer X1 used in the current measurement is the same as the sphygmomanometer X2 used in the past measurement. For example, the evaluation unit 254 makes the determination by comparing information extracted from the captured image of the sphygmomanometer X1 (brand information, model, shape, etc.) with information extracted from the captured image of the sphygmomanometer X2. .
  • the evaluation unit 254 determines that the difference between the measurement time Ta1 and the measurement time Ta2 is within a predetermined time, the difference between the imaging time Tb1 and the imaging time Tb2 is within a predetermined time, and the sphygmomanometer X1 and the blood pressure It is determined whether or not the condition that the total X2 is the same is satisfied.
  • the measurement value M1 any one of the highest blood pressure value, the lowest blood pressure value, and the pulse rate included in the current measurement result and the past measurement result are included. It is determined whether the difference from the measured value M2 is within a predetermined value.
  • the evaluation unit 254 determines that the difference between the measurement value M1 and the measurement value M2 is not within a predetermined value, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, for example, the server communication unit 252 transmits, as an error notification, a notification that alerts whether impersonation or the like is not performed to the terminal device 10. Alternatively, the server communication unit 252 transmits to the terminal device 10 a notification that it is necessary to pay attention to health conditions such as changes in physical condition and symptoms.
  • a program that causes a computer to function and execute control as described in the above flowchart.
  • a program is recorded on a non-temporary computer-readable recording medium such as a flexible disk attached to the computer, a CD (Compact Disk Read Only Memory), a secondary storage device, a main storage device, and a memory card. It can also be provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.
  • the program may be a program module that is provided as a part of an operating system (OS) of a computer and that calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing.
  • OS operating system
  • the program itself does not include the module, and the process is executed in cooperation with the OS.
  • a program that does not include such a module can also be included in the program according to the present embodiment.
  • the program according to the present embodiment may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. A program incorporated in such another program can also be included in the program according to the present embodiment.
  • the configuration exemplified as the above-described embodiment is an example of the configuration of the present invention, and can be combined with another known technique, and a part thereof is not deviated from the gist of the present invention. It is also possible to change and configure such as omitting. In the above-described embodiment, the processing and configuration described in the other embodiments may be adopted as appropriate.
  • 1 information processing system 10 terminal device, 20 blood pressure monitor, 22 main body, 24, 158 display, 26 forward / back button, 27 lamp, 28 user number switch, 29 stop button, 30 server, 32 database, 40 network, 152 Processor, 154 memory, 156 input device, 160 wireless communication unit, 162 communication antenna, 163 camera, 164 memory interface, 165 storage medium, 166 communication interface, 168 speaker, 170 microphone, 172 controller, 202 imaging unit, 204 display control unit , 206 detection unit, 208 position information acquisition unit, 210 terminal communication unit, 252 server communication unit, 254 evaluation unit.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • Physics & Mathematics (AREA)
  • Vascular Medicine (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • Cardiology (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Ophthalmology & Optometry (AREA)
  • Physiology (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

Système de traitement d'informations (1) pourvu d'un sphygmomanomètre (20A), d'un terminal (10A), et d'un serveur (30) configuré de façon à pouvoir communiquer avec le terminal (10A). Le terminal (10A) comprend une unité d'imagerie (202), une unité de détection (206) qui, à partir de l'image du sphygmomanomètre (20A) inclus dans l'image capturée générée par l'unité d'imagerie (202), détecte les résultats de mesure présentés sur un écran (24) du sphygmomanomètre (20A), et une unité de transmission de terminal (210) qui transmet le résultat de mesure à un serveur (30). Le serveur (30) comprend une unité d'évaluation (254) qui évalue la fiabilité du résultat de mesure en analysant le résultat de mesure reçu en provenance du terminal (10A) et une unité de transmission de serveur (252) qui transmet une notification d'erreur au terminal (10A) si l'unité d'évaluation (254) détermine la fiabilité du résultat de mesure comme étant faible.
PCT/JP2017/037989 2016-12-28 2017-10-20 Système de traitement d'informations WO2018123228A1 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN201780076309.0A CN110099606B (zh) 2016-12-28 2017-10-20 信息处理系统
MX2019007044A MX2019007044A (es) 2016-12-28 2017-10-20 Sistema para procesamiento de informacion.
RU2019118661A RU2731445C1 (ru) 2016-12-28 2017-10-20 Система обработки информации

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016256134A JP6726093B2 (ja) 2016-12-28 2016-12-28 情報処理システム
JP2016-256134 2016-12-28

Publications (1)

Publication Number Publication Date
WO2018123228A1 true WO2018123228A1 (fr) 2018-07-05

Family

ID=62707070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/037989 WO2018123228A1 (fr) 2016-12-28 2017-10-20 Système de traitement d'informations

Country Status (5)

Country Link
JP (1) JP6726093B2 (fr)
CN (1) CN110099606B (fr)
MX (1) MX2019007044A (fr)
RU (1) RU2731445C1 (fr)
WO (1) WO2018123228A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220015737A1 (en) * 2020-07-15 2022-01-20 Echosens System and method for determining a health condition of the liver of a subject

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113096758A (zh) * 2020-01-09 2021-07-09 深圳理邦智慧健康发展有限公司 血压管理方法及系统
JP6864894B1 (ja) * 2020-11-03 2021-04-28 株式会社Ａｒｂｌｅｔ 情報処理システム、サーバ、情報処理方法及びプログラム
JP2022107193A (ja) * 2021-01-08 2022-07-21 オムロンヘルスケア株式会社 センシングデータ管理システム、センシングデータ送信方法、センシング装置、情報通信端末およびプログラム

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001224557A (ja) * 1999-09-09 2001-08-21 Matsushita Electric Ind Co Ltd データ入力装置、データ入力システム、表示データ解析装置および媒体
JP2007328464A (ja) * 2006-06-06 2007-12-20 Sharp Corp 購買活動管理装置、制御方法、制御プログラムおよびそれを記録したコンピュータ読み取り可能な記録媒体
JP2012055415A (ja) * 2010-09-07 2012-03-22 Panasonic Corp 生体情報計測システム
JP2013250681A (ja) * 2012-05-30 2013-12-12 Nec Corp 情報処理装置、および携帯通信端末、それらの制御方法ならびに制御プログラム
JP2014180361A (ja) * 2013-03-19 2014-09-29 Yuwa:Kk 生体データ管理システム

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3838141B2 (ja) * 2002-04-09 2006-10-25 オムロンヘルスケア株式会社 血圧測定装置および運動機器
JP3968522B2 (ja) * 2003-10-06 2007-08-29 ソニー株式会社 記録装置、及び記録方法
US8583139B2 (en) * 2004-12-31 2013-11-12 Nokia Corporation Context diary application for a mobile terminal
CN101296650B (zh) * 2005-10-25 2011-10-19 凯迪科技私人有限公司 用于测量并跟踪至少一个生理参数的系统以及相应的测量装置
US20090241177A1 (en) * 2008-03-21 2009-09-24 Computerized Screening, Inc. Security system for a community based managed health kiosk system
CN102813507A (zh) * 2011-06-08 2012-12-12 中国医学科学院阜外心血管病医院 一种测量人体稳定状态血压值的装置及方法
CN102283648A (zh) * 2011-08-08 2011-12-21 深圳市倍泰健康测量分析技术有限公司 一种网络型多功能人体生理参数检测仪
JP5857810B2 (ja) * 2012-03-09 2016-02-10 オムロンヘルスケア株式会社 血圧測定装置及びその制御方法
US9710607B2 (en) * 2013-01-15 2017-07-18 Itrace Biomedical Inc. Portable electronic therapy device and the method thereof
CN104622448A (zh) * 2013-11-15 2015-05-20 马志毅 一种用于电子血压计的数据采集与管理系统及方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001224557A (ja) * 1999-09-09 2001-08-21 Matsushita Electric Ind Co Ltd データ入力装置、データ入力システム、表示データ解析装置および媒体
JP2007328464A (ja) * 2006-06-06 2007-12-20 Sharp Corp 購買活動管理装置、制御方法、制御プログラムおよびそれを記録したコンピュータ読み取り可能な記録媒体
JP2012055415A (ja) * 2010-09-07 2012-03-22 Panasonic Corp 生体情報計測システム
JP2013250681A (ja) * 2012-05-30 2013-12-12 Nec Corp 情報処理装置、および携帯通信端末、それらの制御方法ならびに制御プログラム
JP2014180361A (ja) * 2013-03-19 2014-09-29 Yuwa:Kk 生体データ管理システム

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220015737A1 (en) * 2020-07-15 2022-01-20 Echosens System and method for determining a health condition of the liver of a subject

Also Published As

Publication number Publication date
JP6726093B2 (ja) 2020-07-22
JP2018108123A (ja) 2018-07-12
RU2731445C1 (ru) 2020-09-02
CN110099606A (zh) 2019-08-06
MX2019007044A (es) 2019-09-06
CN110099606B (zh) 2021-09-10

Similar Documents

Publication Publication Date Title
WO2018123228A1 (fr) Système de traitement d'informations
US20180296091A1 (en) Imager for Medical Device
US9357921B2 (en) Wearable health monitoring system
JP4173812B2 (ja) データ収集システム
US11488250B2 (en) User verification by comparing physiological sensor data with physiological data derived from facial video
EP3407230B1 (fr) Appareil électronique et son procédé de commande
JP7073763B2 (ja) 情報処理システム、情報処理方法、電子機器、サーバ装置及び情報処理プログラム
WO2018123227A1 (fr) Dispositif terminal
US20200205724A1 (en) Electronic device and stress measurement method thereof
US10959646B2 (en) Image detection method and image detection device for determining position of user
WO2016034064A1 (fr) Capteur médical, son procédé d'utilisation et son dispositif d'actionnement
WO2018123229A1 (fr) Dispositif terminal
JP2003102692A (ja) 生体情報計測装置および健康管理システムおよび健康管理方法
US10456037B2 (en) Terminal device and information processing system
KR20210060246A (ko) 생체 데이터를 획득하는 장치 및 그 방법
US20230091997A1 (en) Blood pressure measurement method and electronic device
US20190365243A1 (en) Blood-pressure-related information display apparatus and method
US11087157B2 (en) Image detection method and image detection device utilizing dual analysis
US20200074671A1 (en) Image detection method and image detection device for selecting representative image of user
JP7468362B2 (ja) 情報入力方法、当該情報入力方法をコンピュータに実行させるプログラム、および、情報通信端末
US20230386104A1 (en) Information display device and information display method
Saha et al. SWAST KHOJ: A real-time working prototype for vital healthcare monitoring System
KR20210047041A (ko) 다중 디바이스 간의 생리적 데이터 통합 및 도시화 장치 및 그 방법
CN115985498A (zh) 智能健康监测管理方法、系统、智能镜子及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17885760

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2019118661

Country of ref document: RU

122 Ep: pct application non-entry in european phase

Ref document number: 17885760

Country of ref document: EP

Kind code of ref document: A1