JP2018108123A - Information processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing system capable of correctly grasping a health condition of a user of the terminal device.SOLUTION: The information processing system is provided with: a blood pressure manometer; a terminal device; and a server communicable with the terminal device. The terminal device includes imaging means, detection means detecting a measurement result displayed to a display of the blood pressure manometer from images of the blood pressure manometer included in captured images generated by the imaging means, and terminal transmission means transmitting the measurement result to the server. The server includes: evaluation means evaluating reliability of the measurement result by analyzing the measurement result received from the terminal device; and server transmission means transmitting error notification to the terminal device when it is evaluated by the evaluation means that reliability of the measurement result is low.SELECTED DRAWING: Figure 9

Description

  The present disclosure relates to an information processing system, and more particularly, to an information processing system including a sphygmomanometer, a terminal device, and a server configured to be able to communicate with the terminal device.

  Various measuring devices for measuring various biological information relating to the health condition of the human body such as blood pressure and pulse have been developed. The user's health condition is confirmed by taking it into a terminal device for collecting measurement data of such a measuring instrument.

  For example, Japanese Patent Laid-Open No. 2001-224557 (Patent Document 1) discloses a data input device. The data input device includes image acquisition means for obtaining an image of data displayed on the data display unit of the measuring instrument, number reading means for reading the numbers in the obtained image, and display means for displaying the read numbers. .

JP 2001-224557 A

  In recent years, systems for centrally managing data in servers have become widespread. Therefore, various measurement data (for example, blood pressure value, pulse rate, etc.) obtained by the data input device according to Patent Document 1 is transmitted to the server, and the health condition of the user is managed using the data aggregated by the server. A system that can be considered. In such a system, there is an increasing need to ensure the reliability of measurement data periodically transmitted from a terminal device such as a data input device to a server in order to accurately grasp the health state of the user.

  Patent Document 1 discloses that measurement data measured and displayed by a predetermined measurement device and outputting the analysis result to a predetermined processing device, etc., but teaches any technology related to the above needs. Absent.

  The present disclosure has been made in view of the above, and an object in one aspect is to provide an information processing system capable of more accurately grasping the health state of a user of a terminal device.

  An information processing system according to an embodiment includes a sphygmomanometer, a terminal device, and a server configured to be able to communicate with the terminal device. The terminal device transmits an imaging unit, a detection unit that detects a measurement result displayed on the display of the sphygmomanometer from a sphygmomanometer image included in the captured image generated by the imaging unit, and transmits the measurement result to the server Terminal transmitting means. The server evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device, and if the evaluation unit evaluates that the reliability of the measurement result is low, the server sends an error notification to the terminal device. Server transmitting means for transmitting.

  Preferably, the measurement result includes a measurement date and time when the measurement was performed using a sphygmomanometer. The terminal transmission means further transmits the imaging date / time of the captured image to the server. The evaluation unit calculates a period from the measurement date to the imaging date, and evaluates that the reliability of the measurement result is low when the calculated period is not within the predetermined period. The server transmission unit transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device.

  Preferably, the terminal device further includes position information acquisition means for acquiring position information of the terminal device. The terminal transmission unit further transmits the position information of the terminal device to the server. The evaluation unit determines whether or not the terminal device is present at a predetermined position based on the received position information of the terminal device. If the terminal device is not present at the predetermined position, the reliability of the measurement result is low. And evaluate. The server transmission means transmits an error notification indicating that the measurement location of the sphygmomanometer is different from the predetermined position to the terminal device.

  Preferably, the terminal transmission unit further transmits the captured image to the server. The evaluation means determines whether the sphygmomanometer is a predetermined sphygmomanometer based on the received captured image, and evaluates that the reliability of the measurement result is low when the sphygmomanometer is not the predetermined sphygmomanometer To do. The server transmission means transmits an error notification indicating that the sphygmomanometer is not a predetermined sphygmomanometer to the terminal device.

  Preferably, the evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on at least one of the brand, shape, and model of the sphygmomanometer extracted from the received captured image.

  Preferably, the captured image further includes a finger image of a person to be measured of the sphygmomanometer. The evaluation means extracts the first feature information of the finger from the finger image of the measurement subject included in the captured image, the first feature information, and the second feature information of the measurement subject's finger stored in the server in advance. If the first feature information and the second feature information do not match, it is evaluated that the reliability of the measurement result is low. The server transmission unit transmits an error notification to the terminal device that the finger image of the measured person included in the captured image is different from the finger image of the measured person registered in advance.

  According to the present disclosure, it is possible to more accurately grasp the health status of the user of the terminal device.

1 is a diagram illustrating a schematic configuration of an information processing system. It is a block diagram showing an example of the hardware constitutions of a terminal device. It is a figure which shows an example of the external appearance of the main-body part of a blood pressure meter. It is a figure which shows the operation | movement outline | summary of an information processing system. It is a figure which shows the screen displayed on the display of a terminal device, when a blood pressure meter is imaged. It is a figure which shows an example of the error notification displayed on the display of a terminal device. It is a figure which shows an example of the captured image containing a blood pressure meter and a to-be-measured person's finger. It is a figure which shows an example of the captured image of the scene where the to-be-measured person wears the wrist type blood pressure monitor. It is a block diagram which shows the function structure of a terminal device and a server. It is a flowchart which shows an example of the process sequence of a terminal device and a server. It is a flowchart which shows an example of the reliability evaluation processing procedure according to this Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.

<System configuration>
FIG. 1 is a diagram illustrating a schematic configuration of the information processing system 1.

  Referring to FIG. 1, information processing system 1 includes a plurality of terminal devices 10 </ b> A and 10 </ b> B that are user terminals, blood pressure monitors 20 </ b> A and 20 </ b> B for measuring a user's blood pressure, a server 30, and a network 40. . In the present embodiment, it is assumed that terminal device 10A is a user A terminal and terminal device 10B is a user B terminal. In the following, for convenience of explanation, the terminal devices 10A and 10B may be collectively referred to as “terminal device 10”.

  The sphygmomanometer 20A is a stationary upper arm sphygmomanometer in which a main body and a cuff (arm band) are separate bodies. The sphygmomanometer 20B is a wristwatch type wrist sphygmomanometer in which a main body and a cuff are integrated. The sphygmomanometer 20B has a function of wearing a wrist for a long time like a wristwatch and measuring a pulsation every beat for 24 hours continuously, a function of always wearing it and measuring by simply pressing a measurement start button, etc. . Thereby, the sphygmomanometer 20B can always measure the blood pressure of the user. Hereinafter, for convenience of explanation, the sphygmomanometers 20A and 20B may be collectively referred to as “sphygmomanometer 20”.

  The terminal device 10 is, for example, a smartphone having a camera and a touch panel. The terminal device 10 has a function of detecting a measurement result displayed on the display of the sphygmomanometer 20 from a captured image generated by imaging the sphygmomanometer 20 using a camera. Hereinafter, a smartphone will be described as a representative example of a “terminal device”. However, the terminal device may be another terminal device having an imaging function such as a foldable mobile phone, a tablet terminal device, and a PDA (Personal Data Assistance).

  The network 40 for connecting the terminal device 10 and the server 30 to each other includes various networks such as the Internet and a mobile terminal communication network.

  The server 30 stores various data transmitted from the terminal device 10. Specifically, the server 30 stores the identification information (user ID) of the user and the identification information (terminal ID) of the terminal device 10 in the database 32 in association with each other. The server 30 manages various data transmitted from each terminal device 10 for each user ID (and terminal ID) using the database 32. In the database 32, for example, measurement results such as the blood pressure value of the user A transmitted from the terminal device 10A to the server 30 are stored.

<Hardware configuration>
(Terminal device)
FIG. 2 is a block diagram illustrating an example of a hardware configuration of the terminal device 10. With reference to FIG. 2, the terminal device 10 includes, as main components, a processor 152, a memory 154, an input device 156, a display 158, a wireless communication unit 160, a communication antenna 162, a camera 163, and a memory. It includes an interface (I / F) 164, a communication interface (I / F) 166, a speaker 168, a microphone 170, and a GPS controller 172.

  The processor 152 is typically an arithmetic processing unit such as a CPU (Central Processing Unit) or an MPU (Multi Processing Unit). The processor 152 functions as a control unit that controls the operation of each unit of the terminal device 10 by reading and executing the program stored in the memory 154. The processor 152 implements each process (step) of the terminal device 10 to be described later by executing the program.

  The memory 154 is realized by a RAM (Random Access Memory), a ROM (Read-Only Memory), a flash memory, or the like. The memory 154 stores a program executed by the processor 152, data used by the processor 152, and the like.

  The input device 156 receives an operation input to the terminal device 10. Typically, the input device 156 is realized by a touch panel. The touch panel is provided on a display 158 having a function as a display unit, and is, for example, a capacitance type. The touch panel detects a touch operation on the touch panel by an external object every predetermined time, and inputs touch coordinates to the processor 152. However, the input device 156 may include a button or the like.

  The wireless communication unit 160 connects to the mobile communication network via the communication antenna 162 and transmits and receives signals for wireless communication. Thereby, the terminal device 10 can communicate with another communication device (for example, the server 30) via a mobile communication network such as LTE (Long Term Evolution), for example.

  The camera 163 is realized by, for example, a charge coupled device (CCD) method, a complementary mental oxide semiconductor (CMOS) method, or other methods.

  The memory interface 164 reads data from the external storage medium 165. The processor 152 reads data stored in the storage medium 165 via the memory interface 164 and stores the data in the memory 154. The processor 152 reads data from the memory 154 and stores the data in the external storage medium 165 via the memory interface 164.

  The storage medium 165 is non-volatile such as a CD (Compact Disc), a DVD (Digital Versatile Disk), a BD (Blu-ray (registered trademark) Disc), a USB (Universal Serial Bus) memory, and an SD (Secure Digital) memory card. Includes media for storing programs.

  The communication interface (I / F) 166 is a communication interface for exchanging various data with other devices, and is realized by an adapter, a connector, or the like. In this embodiment, BLE (Bluetooth (registered trademark) low energy) is adopted as a communication method. However, the communication method may be a wireless communication method using a wireless LAN or the like, or a wired communication method using USB (Universal Serial Bus) or the like.

  The speaker 168 converts the sound signal given from the processor 152 into sound and outputs it to the outside of the terminal device 10. The microphone 170 receives an audio input to the terminal device 10 and gives an audio signal corresponding to the audio input to the processor 152.

  The GPS controller 172 receives the GPS signal or the position signal (positioning signal) from the base station and acquires the position information of the terminal device 10. The GPS controller 172 inputs the acquired position information of the terminal device 10 to the processor 152.

  The terminal device 10 includes various sensors (acceleration sensor and angular velocity sensor), a timer unit for measuring time, and the like.

(server)
The server 30 only needs to provide information processing as described below as a whole, and a known hardware configuration can be adopted. For example, the server 30 receives a processor for executing various processes, a memory for storing programs and data, a communication interface for transmitting and receiving various data to and from the terminal device 10, and instructions from an administrator. Including an input interface.

(Sphygmomanometer)
The sphygmomanometer 20 only needs to provide information processing as described below as a whole, and a known hardware configuration can be adopted. For example, the sphygmomanometer 20 includes a processor for executing various processes, a memory for storing programs and data, a display for displaying measurement data, and an input interface for receiving instructions from a user. (For example, buttons, switches, etc.), a cuff that can be wound around the user's upper arm (or wrist), a cuff pressure adjusting mechanism such as a piezoelectric pump and an exhaust valve, a pressure sensor for detecting the cuff pressure, A time measuring unit for measuring time and a temperature sensor for detecting outside air temperature are included.

  FIG. 3 is a diagram showing an example of the appearance of the main body of the sphygmomanometer 20A. Referring to FIG. 3, main body portion 22 of blood pressure monitor 20 </ b> A includes a display 24, a forward / back button 26, a lamp 27, a user number switch 28, and a blood pressure measurement start / stop button 29. Note that brand information 41 (for example, brand “AAA”) and model information 43 for the blood pressure monitor 21 (for example, model “XYZ-ABC”) are provided on the outer surface of the main body 22. The user number switch 28 is used when storing measurement results for two persons separately. In the example of FIG. 3, the user with the number “1” is selected. The lamp 27 is a lamp indicating whether the cuff is wound properly, and is shown to be appropriate in the example of FIG.

  A measurement result is displayed on the display 24. Specifically, the measurement result is displayed in the region 52 with the maximum blood pressure value (for example, 118 mmHg), the minimum blood pressure value (for example, 78 mmHg) and the pulse rate (for example, 70 nights / minute) displayed in the region 50. The measurement date and time (for example, July 1, 7:30), the user number (for example, “1”) displayed in the area 54, and the current temperature (for example, 24 degrees) displayed in the area 56 And various messages displayed in the area 58 (for example, a message indicating the completion of measurement). The measurement result may include information indicating the pulse wave state, information indicating the suitability of the cuff winding method, and the like.

<Overview of operation>
FIG. 4 is a diagram showing an outline of the operation of the information processing system 1. Here, it is assumed that the user of the terminal device 10 performs blood pressure measurement using the blood pressure monitor 20A. FIG. 5 is a diagram showing a screen displayed on the display 158 of the terminal device 10 when the sphygmomanometer 20A is imaged. FIG. 6 is a diagram illustrating an example of an error notification displayed on the display 158 of the terminal device 10.

  Referring to FIG. 4, sphygmomanometer 20A measures the blood pressure value (maximum blood pressure value, minimum blood pressure value) and pulse rate of the user, and displays the measurement result on display 24 (sequence SQ10).

  Using the camera 163, the terminal device 10 captures (captures) the sphygmomanometer 20A with the measurement result displayed on the display 24 (sequence SQ12). Terminal apparatus 10 detects a measurement result from the captured image (sequence SQ14). For example, as illustrated in FIG. 5, a screen 500 including four corner frames 510 is displayed on the display 158 of the terminal device 10 in the imaging mode. The user takes an image so that the display 24 of the sphygmomanometer 20 </ b> A fits within the frame 510. Thereby, the terminal device 10 detects the measurement result by analyzing the captured image using a known OCR technique or the like and an image recognition technique or the like.

  For example, the frame 510 is displayed as a frame indicating the outer four corners of a recognition range (analysis range) in which a character string can be recognized. Therefore, the inside of the frame 510 is a recognition range. The terminal device 10 executes processing for recognizing a measurement result that is captured so as to be within the recognition range. Specifically, the terminal device 10 recognizes various character strings included in the measurement result. The “character” in the present embodiment means a symbol that combines lines, dots, etc. to transmit and record a word (language), and not only alphanumeric characters, kanji, kana characters, etc., but also pictograms In addition, an arbitrary figure such as a stamp is attached with an identification code.

  Here, the terminal device 10 stores screen information indicating what information is displayed in which area of the display 24 of the sphygmomanometer 20 </ b> A in the memory 154. Therefore, for example, when the image is captured so that the display 24 fits within the frame 510 that is the recognition range, the terminal device 10 uses the screen information to determine what information each recognized character string is. Can be identified. For example, in the terminal device 10, a plurality of character strings “118”, “78”, and “70” recognized in the area 50 of the display 24 within the frame 510 are respectively a maximum blood pressure value, a minimum blood pressure value, and a pulse rate. Can be identified.

  Further, the terminal device 10 receives an instruction from the user and specifies that the subject is the blood pressure monitor 20A. Alternatively, the terminal device 10 extracts the sphygmomanometer characteristic information (shape, model, brand) and the like from the captured image, and compares the extracted characteristic information with the pre-stored characteristic information of each sphygmomanometer. Thus, it may be specified that the subject is the blood pressure monitor 20A.

  Referring to FIG. 4 again, terminal device 10 transmits various information including measurement data and other information to server 30 via network 40 (sequence SQ16). The other information is, for example, an imaging date / time, a user ID, a terminal ID, and the like.

  Server 30 evaluates the reliability of the measurement result based on a predetermined evaluation method (sequence SQ18). For example, the server 30 evaluates that the reliability of the measurement result is low when the period from the measurement date to the imaging date is not within a predetermined period. In this case, the server 30 does not store the measurement result in the database 32.

  If server 30 evaluates that the reliability of the measurement result is low, server 30 sends an error notification to terminal device 10 (sequence SQ20). For example, since the period from the time of measurement to the time of imaging is too long, the server 30 transmits an error notification indicating that the measurement result is unreliable to the terminal device 10. Terminal apparatus 10 displays the error notification received from server 30 on display 158 (sequence SQ22). For example, as illustrated in FIG. 6, the terminal device 10 has a low reliability such as a message 610 such as “It is a measurement result with low reliability” or “a period from measurement to imaging is too long”. An error notification screen 600 including a message 620 indicating the above is displayed on the display 158. The error notification screen 600 may further include a message prompting the user to perform remeasurement.

  If the server 30 evaluates that the reliability of the measurement data is high (not low) based on a predetermined evaluation method, the server 30 notifies the terminal device 10 that the measurement data is normal. You may send it. In this case, the server 30 stores the measurement data in the database 32.

<Evaluation method>
In the present embodiment, the server 30 evaluates the reliability of the measurement result received from the terminal device 10 according to various evaluation methods. Here, an evaluation method executed by the server 30 will be described.

(Evaluation method: Part 1)
In the evaluation method (part 1), the reliability of the measurement result is evaluated based on the period from the measurement date and time to the imaging date and time. Specifically, the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20A and the imaging date and time when the sphygmomanometer 20A is captured to the server 30. The server 30 calculates the period from the measurement date and time to the imaging date and time, and evaluates that the reliability of the measurement result is low when the calculated period (calculation period) is not within a predetermined period (for example, within 1 minute). If the calculation period is within the predetermined period, it is evaluated that the measurement result has high reliability. The reason for evaluating the reliability in this way will be described below.

  If the period from the measurement date to the imaging date is not within the predetermined period, it is considered that the user of the terminal device 10 who is the subject does not immediately take a blood pressure monitor using the camera after measuring the blood pressure. . From this, it is impossible to deny the possibility that the measurement results will be tampered with by any method, so that the reliability of the measurement results is evaluated to be low.

  In addition, if the time of the sphygmomanometer clock is set incorrectly, an error also occurs in the calculation period. In such a case, it is considered that the calculation period does not fall within the predetermined period even if the blood pressure measurement is performed immediately after the user performs blood pressure measurement using the camera. Since blood pressure fluctuates even during the day, an index (that is, measurement date and time) indicating when (morning or night) during the day is used to accurately grasp the user's health status. It becomes an important factor. From this, when the calculation period is not within the predetermined period, the possibility that the measurement date and time is not accurate cannot be denied, so that it is evaluated that the reliability of the measurement result is low.

(Evaluation method: Part 2)
In the evaluation method (part 2), the reliability of the measurement result is evaluated based on the measurement location. Specifically, the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20 </ b> A and the position information of the own device to the server 30. The server 30 determines whether or not the terminal device 10 exists at a predetermined measurement location based on the position information of the terminal device 10. The server 30 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined measurement location, and evaluates that the reliability of the measurement result is high when it exists at the predetermined measurement location. The position information of the predetermined measurement location is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. The reason for evaluating the reliability in this way will be described below.

  When mentally nervous, the blood pressure rises more than when resting. For example, when a person who normally measures blood pressure at home measures blood pressure at a hospital, there is a possibility that the blood pressure may rise more than at home due to a feeling of mental tension. Therefore, an index indicating whether the measurement location at the time of blood pressure measurement is the same as the usual location (predetermined measurement location) is an important factor in accurately grasping the health condition of the user. From this, when the terminal device 10 does not exist at a predetermined measurement location, the possibility that the blood pressure changes according to the measurement location cannot be denied, and therefore, it is evaluated that the reliability of the measurement result is low.

  Note that the measurement date and time may be further compared with the reception date and time when the server 30 received the position information in order to determine with high accuracy that the terminal device 10 was present at the predetermined measurement location at the time of blood pressure measurement. Specifically, when the position information of the terminal device 10 indicates a predetermined measurement location and the time from the measurement date to the reception date is within a predetermined time, the server 30 performs the blood pressure measurement. Sometimes it is determined that it was present at a predetermined measurement location. On the other hand, even if the position information of the terminal device 10 indicates a predetermined measurement location, the server 30 is present at the predetermined measurement location when blood pressure is measured if the time is not within the predetermined time. Judge that it was not. In this case, the server 30 evaluates that the reliability of the measurement result is low.

(Evaluation method: Part 3)
In the evaluation method (No. 3), the reliability of the measurement result is evaluated based on the brand, model and shape of the sphygmomanometer. Specifically, the terminal device 10 transmits the captured image of the sphygmomanometer 20 </ b> A to the server 30. The server 30 determines whether or not the sphygmomanometer 20A is an authenticated sphygmomanometer based on the captured image. The server 30 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20A is not an authenticated sphygmomanometer, and evaluates that the reliability of the measurement result is high when the sphygmomanometer 20A is an authenticated sphygmomanometer. Specifically, the server 30 extracts brand information, model, shape, and the like of the sphygmomanometer 20A based on the captured image of the sphygmomanometer 20A. Based on these pieces of information, the server 30 determines whether the sphygmomanometer 20A is an authenticated sphygmomanometer. For example, it is assumed that the blood pressure monitor of brand X is an authenticated blood pressure monitor. In this case, when the extracted brand information indicates brand X, the server 30 determines that the sphygmomanometer 20A is an authenticated sphygmomanometer.

(Evaluation method: 4)
In the evaluation method (part 4), the reliability of the measurement result is evaluated based on the finger image of the user (measured person). Here, it is assumed that the person to be measured images the blood pressure monitor 20A and his / her finger using the camera 163 of the terminal device 10A.

  FIG. 7 is a diagram illustrating an example of a captured image including a sphygmomanometer and a finger of a measurement subject. The screen 700 in FIG. 7 shows an image of a measurement subject in which a left finger is brought close to the sphygmomanometer 20A when the sphygmomanometer 20A, which is an upper arm sphygmomanometer, is used to measure the cuff around the left arm. It represents the situation.

  The terminal device 10 </ b> A transmits to the server 30 a captured image including an image of the sphygmomanometer 20 </ b> A and a finger image of the measurement subject as shown on the screen 700. The server 30 extracts finger characteristic information from the finger image of the measurement subject. The server 30 determines whether or not the finger feature information stored in association with the terminal ID (and user ID) of the terminal device 10A matches the extracted finger feature information. If the stored feature information does not match the extracted feature information, the server 30 determines that the person to be measured is not the user A (the user of the terminal device 10A), and the reliability of the measurement result. Is evaluated as low. When these pieces of feature information match, the server 30 determines that the person to be measured is the user A and evaluates that the reliability of the measurement result is high.

  Note that the example of FIG. 7 shows that the entire five fingers are imaged, but if the finger feature information is comparable, one or more specific fingers (for example, only the index finger) are included. You may image as follows. In addition, when the palm feature information stored in association with the terminal ID of the terminal device 10A matches the palm feature information of the person to be measured extracted from the captured image, the measurement result is evaluated as highly reliable. When the feature information does not match, it may be evaluated that the reliability of the measurement result is low.

  Next, when using a wrist sphygmomanometer, the reliability of the measurement result may be evaluated based on the wearing state.

  FIG. 8 is a diagram illustrating an example of a captured image of a scene in which the measurement subject wears a wrist sphygmomanometer. A screen 800 in FIG. 8 shows a state in which the measurement subject takes an image of a state in which the sphygmomanometer 20B is worn when the cuff is wrapped around the left wrist using the sphygmomanometer 20B which is a wrist sphygmomanometer. Yes.

  As shown on the screen 800, the terminal device 10 transmits a captured image in a state where the sphygmomanometer 20 </ b> B is attached to the wrist of the measurement subject to the server 30. Specifically, even in the case of a wrist blood pressure monitor, the reliability of the measurement result is evaluated based on the characteristic information of the finger (and palm) of the person to be measured, as in the case of the upper arm blood pressure monitor. Therefore, the terminal device 10 transmits a captured image (captured image as illustrated in FIG. 8) including the sphygmomanometer 20 </ b> B to the measurement subject's wrist and including the measurement subject's fingers. .

  First, when the server 30 determines that the sphygmomanometer 20B is not attached, the server 30 evaluates that the reliability of the measurement result is low. For example, when the image of the sphygmomanometer 20B and the image of the finger and wrist of the measurement subject are not included in the captured image, the server 30 determines that the sphygmomanometer 20B is not attached. Assess that the reliability of the measurement results is low.

  If the server 30 determines that the sphygmomanometer 20B is attached, does the hand feature information stored in association with the terminal ID of the terminal device 10A match the extracted hand feature information? Further determine whether or not. If the stored feature information does not match the extracted feature information, the server 30 determines that the measurement subject is not the user A and evaluates that the reliability of the measurement result is low. When these pieces of feature information match, the server 30 determines that the person to be measured is the user A and evaluates that the reliability of the measurement result is high.

<Functional configuration>
FIG. 9 is a block diagram illustrating functional configurations of the terminal device 10 and the server 30. With reference to FIG. 9, the terminal device 10 includes an imaging unit 202, a display control unit 204, a detection unit 206, a position information acquisition unit 208, and a terminal communication unit 210. The server 30 includes a server communication unit 252, an evaluation unit 254, and a database 32.

  The imaging unit 202 of the terminal device 10 captures a subject and generates a captured image. In the present embodiment, the imaging unit 202 generates a captured image including an image of the sphygmomanometer 20 as a subject. The imaging unit 202 is a function that is realized mainly by the cooperation of the processor 152 and the camera 163. The imaging unit 202 outputs the generated captured image to the display control unit 204, the detection unit 206, and the terminal communication unit 210.

  The display control unit 204 causes the display 158 to display captured images generated by sequentially capturing images by the imaging unit 202.

  The detection unit 206 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the image of the sphygmomanometer 20 included in the captured image generated by the imaging unit 202. The measurement result includes, for example, a systolic blood pressure value, a diastolic blood pressure value, a pulse rate, a measurement date and time, an air temperature, a user number, various messages, information indicating whether or not a cuff is wound, and information indicating a pulse wave state. The detection unit 206 outputs the detected measurement result to the terminal communication unit 210.

  The position information acquisition unit 208 acquires position information of the terminal device 10 based on the GPS signal or the position signal from the base station. The position information acquisition unit 208 is a function mainly realized by the GPS controller 172. The position information acquisition unit 208 outputs the acquired position information to the terminal communication unit 210.

  The terminal communication unit 210 transmits various information including the measurement result detected by the detection unit 206 and other information to the server 30. Other information includes, for example, the user ID, the terminal ID, the captured image generated by the imaging unit 202, the imaging date and time of the captured image, and the location information of the terminal device 10 acquired by the location information acquisition unit 208.

  The server communication unit 252 of the server 30 receives various information from the terminal device 10. The server communication unit 252 outputs various types of information to the evaluation unit 254.

  The evaluation unit 254 evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device 10. When the evaluation unit 254 evaluates that the reliability of the measurement result is low, the server communication unit 252 transmits an error notification to the terminal device 10.

  Specifically, in an aspect, the evaluation unit 254 calculates a period from the measurement date and time to the imaging date and time, and determines whether or not the calculated period is within a predetermined period. If the calculated period is not within the predetermined period, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device 10.

  In another aspect, the evaluation unit 254 determines whether or not the terminal device 10 exists at a predetermined position based on the position information of the terminal device 10 received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the terminal device 10 does not exist at the predetermined position. Information indicating the predetermined position is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. In this case, the server communication unit 252 transmits an error notification indicating that the measurement location of the sphygmomanometer 20 is different from the predetermined position to the terminal device 10.

  In yet another aspect, the evaluation unit 254 determines whether or not the sphygmomanometer 20 is a predetermined sphygmomanometer based on the captured image received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20 is not a predetermined sphygmomanometer. More specifically, the evaluation unit 254 extracts at least one of the brand, model, and shape of the sphygmomanometer 20 from the captured image. The evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the extracted information. When the evaluation unit 254 evaluates that the reliability of the measurement result is low, the server communication unit 252 transmits an error notification that the sphygmomanometer 20 is not a predetermined sphygmomanometer to the terminal device 10. The predetermined sphygmomanometer is, for example, a sphygmomanometer approved by the administrator of the server 30 by satisfying conditions such as measurement accuracy.

  In yet another aspect, the evaluation unit 254 extracts the finger feature information Fa from the finger image of the measurement subject included in the captured image. The evaluation unit 254 determines whether or not the feature information Fa matches the feature information Fb of the measurement subject's finger stored in the memory of the server 30 in advance. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the feature information Fa and the feature information Fb do not match. In this case, the server communication unit 252 transmits an error notification to the terminal device 10 that the finger image of the measurement subject included in the captured image is different from the finger image of the measurement subject stored in advance. The feature information Fb is stored in the memory of the server 30 in association with the terminal ID and the user ID.

  The evaluation unit 254 may evaluate the reliability of the measurement result based on the plurality of evaluation items described above. For example, “period from the measurement date to the imaging date” is set as the evaluation item E1, “positional information of the terminal device 10” is set as the evaluation item E2, “sphygmomanometer used for measurement” is set as the evaluation item E3, The included “finger image of the person to be measured” is set as the evaluation item E4. In this case, if the evaluation unit 254 evaluates that one of the evaluation items E1 to E4 is low in reliability of the measurement result according to the evaluation method described above, the reliability of the measurement result for the remaining evaluation items. Even if it is not evaluated as low, it is finally evaluated that the reliability of the measurement result is low. That is, the evaluation unit 254 finally evaluates that all of the evaluation items E1 to E4 are high in reliability of the measurement result only when the reliability of the measurement result is not evaluated according to the above-described evaluation method. To do. It should be noted that which evaluation item is used to evaluate the measurement result may be arbitrarily set by an administrator of the server 30 or the like.

  The evaluation unit 254 outputs the evaluation result to the server communication unit 252. When evaluating that the reliability of the measurement result is low, the evaluation unit 254 discards the measurement result without storing it in the database 32. When the evaluation unit 254 evaluates that the reliability of the measurement result is high, the evaluation unit 254 stores the measurement result in the database 32 in association with the terminal ID and the user ID.

  If the evaluation unit 254 evaluates that the reliability of the measurement result is high, the server communication unit 252 notifies that the measurement result is normal (for example, that the measurement result is normally stored in the database 32). Notification) may be transmitted to the terminal device 10.

  The terminal communication unit 210 of the terminal device 10 receives various notifications (for example, error notification and normal notification) transmitted from the server 30. The terminal communication unit 210 outputs the received various notifications to the display control unit 204. The display control unit 204 displays various notifications on the display 158.

<Processing procedure>
FIG. 10 is a flowchart illustrating an example of a processing procedure of the terminal device 10 and the server 30.

  Referring to FIG. 10, the processor 152 of the terminal device 10 generates a captured image of the sphygmomanometer 20 captured using the camera 163 (step S100). The processor 152 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the captured image (step S102). The processor 152 transmits various information to the server 30 via the wireless communication unit 160 (or communication interface 166) (step S104). Here, the various information includes a measurement result, a user ID, a terminal ID, a captured image, a captured date and time, and position information of the terminal device 10. The measurement result includes a maximum blood pressure value, a minimum blood pressure value, a pulse rate, and a measurement date and time.

  The processor of the server 30 (hereinafter referred to as “server processor”) receives various types of information transmitted from the terminal device 10 via the communication interface (step S106). The server processor executes a reliability evaluation process of the measurement result based on various information (step S110).

  FIG. 11 is a flowchart illustrating an example of a reliability evaluation processing procedure. Referring to FIG. 11, the server processor determines whether or not the period from the measurement date to the imaging date is within a predetermined period (step S202). If the period is not within the predetermined period (NO in step S202), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the period is within the predetermined period (YES in step S202), the server processor determines whether or not the terminal device 10 exists at a predetermined position (step S204).

  If the terminal device 10 does not exist at the predetermined position (NO in step S204), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If terminal device 10 is present at a predetermined position (YES in step S204), the server processor determines whether or not sphygmomanometer 20 used for measurement is a predetermined sphygmomanometer (step S206).

  If sphygmomanometer 20 is not a predetermined sphygmomanometer (NO in step S206), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the sphygmomanometer 20 is a predetermined sphygmomanometer (YES in step S206), the server processor records the characteristic information of the finger of the person to be measured included in the received captured image and the target stored in the memory of the server 30. It is determined whether or not the feature information of the measurer's finger matches (step S208).

  If these pieces of feature information do not match (NO in step S208), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If these pieces of feature information match (YES in step S208), the server processor evaluates that the reliability of the measurement result is high (step S210), and ends the reliability evaluation process.

  Referring to FIG. 10 again, the server processor determines whether or not the reliability of the measurement result is evaluated to be low in the reliability evaluation process (step S112). When the server processor evaluates that the reliability of the measurement result is low (YES in step S112), the server processor transmits an error notification to the terminal device 10 via the communication interface (step S114). When the server processor evaluates that the reliability of the measurement result is high (NO in step S112), the server processor stores the measurement result in the database 32 (step S116). Subsequently, the server processor transmits a notification that the measurement result has been normally stored in the database 32 to the terminal device 10 via the communication interface (step S118).

  The terminal device 10 receives various notifications from the server 30 via the wireless communication unit 160 (or the communication interface 166) (step S120). The terminal device 10 displays various notifications on the display 158 (step S122) and ends the process. Note that the terminal device 10 may output various notifications as voices via the speaker 168.

<Advantages>
According to the present embodiment, the reliability of the measurement result transmitted from the terminal device 10 to the server 30 is evaluated, and when the reliability is evaluated to be low, an error notification is transmitted from the server 30 to the terminal device 10. . Thereby, while being able to ensure the reliability of the measurement result stored in the server 30, the user can grasp the reliability of the measurement result in real time. As a result, for example, it is possible to reduce the possibility that the user is overconfident in his / her health condition or becomes too worried about his / her health condition. In addition, a system in which an administrator of the server 30 gives the user some kind of merit (for example, a reduction in medical insurance premiums when the health condition is good) according to the health condition of the user of the terminal device 10. If so, the system can be properly operated.

<Other embodiments>
(1) In the above-described embodiment, the configuration in which the server 30 evaluates the reliability of the measurement result based on the four evaluation items E1 to E4 has been described, but the configuration is not limited thereto. For example, the server 30 may evaluate the reliability of the measurement result based on the information indicating the temperature information included in the measurement result and the suitability information on how to wind the cuff. Specifically, the server 30 may determine that the reliability of the measurement result is low when the air temperature is lower than a predetermined temperature or when the cuff winding method is not appropriate.

  Furthermore, you may evaluate the reliability of a measurement result as follows. Specifically, the evaluation unit 254 of the server 30 determines that the difference between the measurement time Ta1 included in the current measurement result and the measurement time Ta2 included in the past measurement result (for example, yesterday's measurement result) is within a predetermined time. It is determined whether or not (for example, within 5 minutes). For example, the evaluation unit 254 determines whether the measurement on one day and the measurement on another day are performed at substantially the same time. Further, the evaluation unit 254 determines whether or not the difference between the imaging time Tb1 included in the current measurement result and the imaging time Tb2 included in the past measurement result is within a predetermined time. For example, the evaluation unit 254 determines whether or not imaging after measurement on one day and imaging after measurement on another day are performed at approximately the same time.

  Further, the evaluation unit 254 determines whether or not the sphygmomanometer X1 used in the current measurement is the same as the sphygmomanometer X2 used in the past measurement. For example, the evaluation unit 254 makes the determination by comparing information extracted from the captured image of the sphygmomanometer X1 (brand information, model, shape, etc.) with information extracted from the captured image of the sphygmomanometer X2. .

  Then, the evaluation unit 254 determines that the difference between the measurement time Ta1 and the measurement time Ta2 is within a predetermined time, the difference between the imaging time Tb1 and the imaging time Tb2 is within a predetermined time, and the sphygmomanometer X1 and the blood pressure It is determined whether or not the condition that the total X2 is the same is satisfied. When the evaluation unit 254 determines that the condition is satisfied, the measurement value M1 (any one of the highest blood pressure value, the lowest blood pressure value, and the pulse rate) included in the current measurement result and the past measurement result are included. It is determined whether the difference from the measured value M2 is within a predetermined value.

  When the evaluation unit 254 determines that the difference between the measurement value M1 and the measurement value M2 is not within a predetermined value, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, for example, the server communication unit 252 transmits, as an error notification, a notification that alerts whether impersonation or the like is not performed to the terminal device 10. Alternatively, the server communication unit 252 transmits to the terminal device 10 a notification that it is necessary to pay attention to health conditions such as changes in physical condition and symptoms.

  (2) In the above-described embodiment, it is possible to provide a program for causing a computer to function and executing control as described in the above flowchart. Such a program is recorded on a non-temporary computer-readable recording medium such as a flexible disk attached to the computer, a CD (Compact Disk Read Only Memory), a secondary storage device, a main storage device, and a memory card. It can also be provided as a program product. Alternatively, the program can be provided by being recorded on a recording medium such as a hard disk built in the computer. A program can also be provided by downloading via a network.

  The program may be a program module that is provided as a part of an operating system (OS) of a computer and that calls necessary modules in a predetermined arrangement at a predetermined timing to execute processing. In that case, the program itself does not include the module, and the process is executed in cooperation with the OS. A program that does not include such a module can also be included in the program according to the present embodiment.

  Further, the program according to the present embodiment may be provided by being incorporated in a part of another program. Even in this case, the program itself does not include the module included in the other program, and the process is executed in cooperation with the other program. A program incorporated in such another program can also be included in the program according to the present embodiment.

  (3) The configuration exemplified as the above-described embodiment is an example of the configuration of the present invention, and can be combined with another known technique, and a part thereof is not deviated from the gist of the present invention. It is also possible to change and configure such as omitting. In the above-described embodiment, the processing and configuration described in the other embodiments may be adopted as appropriate.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  DESCRIPTION OF SYMBOLS 1 Information processing system, 10 Terminal device, 20 Blood pressure monitor, 22 Main part, 24,158 Display, 26 Forward / back button, 27 Lamp, 28 User number switch, 29 Stop button, 30 Server, 32 Database, 40 Network, 152 Processor, 154 memory, 156 input device, 160 wireless communication unit, 162 communication antenna, 163 camera, 164 memory interface, 165 storage medium, 166 communication interface, 168 speaker, 170 microphone, 172 controller, 202 imaging unit, 204 display control unit 206 Detection unit 208 Position information acquisition unit 210 Terminal communication unit 252 Server communication unit 254 Evaluation unit

Claims (6)

An information processing system comprising a sphygmomanometer, a terminal device, and a server configured to be able to communicate with the terminal device,
The terminal device
Imaging means;
Detecting means for detecting a measurement result displayed on the display of the sphygmomanometer from the image of the sphygmomanometer included in the captured image generated by the imaging unit;
Terminal transmitting means for transmitting the measurement result to the server,
The server
An evaluation means for evaluating the reliability of the measurement result by analyzing the measurement result received from the terminal device;
An information processing system comprising: a server transmission unit that transmits an error notification to the terminal device when the evaluation unit evaluates that the reliability of the measurement result is low. The measurement result includes a measurement date and time when measurement was performed using the sphygmomanometer,
The terminal transmission means further transmits the imaging date and time of the captured image to the server;
The evaluation means calculates a period from the measurement date and time to the imaging date and time, and if the calculated period is not within a predetermined period, evaluates that the reliability of the measurement result is low,
The information processing system according to claim 1, wherein the server transmission unit transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device. The terminal device further includes position information acquisition means for acquiring position information of the terminal device,
The terminal transmission means further transmits the location information of the terminal device to the server,
The evaluation means determines whether or not the terminal device exists at a predetermined position based on the received position information of the terminal device, and when the terminal device does not exist at the predetermined position, Assessing that the measurement results are not reliable
The information processing system according to claim 1, wherein the server transmission unit transmits an error notification indicating that a measurement location of the sphygmomanometer is different from the predetermined position to the terminal device. The terminal transmission means further transmits the captured image to the server,
The evaluation unit determines whether the sphygmomanometer is a predetermined sphygmomanometer based on the received captured image. If the sphygmomanometer is not the predetermined sphygmomanometer, Evaluated as unreliable,
The information processing system according to claim 1, wherein the server transmission unit transmits an error notification indicating that the sphygmomanometer is not the predetermined sphygmomanometer to the terminal device.   The evaluation means determines whether or not the sphygmomanometer is the predetermined sphygmomanometer based on at least one of the brand, shape, and model of the sphygmomanometer extracted from the received captured image. The information processing system according to claim 4. The captured image further includes a finger image of a person to be measured of the sphygmomanometer,
The evaluation means extracts first feature information of a finger from the finger image of the person to be measured included in the captured image, and the first feature information and the finger of the person to be measured that are stored in advance in the server. Whether the second feature information matches, and if the first feature information and the second feature information do not match, evaluate that the reliability of the measurement result is low,
The server transmission means transmits an error notification to the terminal device that the finger image of the measured person included in the captured image is different from the finger image of the measured person registered in advance. Or the information processing system of 5.