CN110099606B

CN110099606B - Information processing system

Info

Publication number: CN110099606B
Application number: CN201780076309.0A
Authority: CN
Inventors: 出野彻; 北村隆
Original assignee: Omron Corp; Omron Healthcare Co Ltd
Current assignee: Omron Corp; Omron Healthcare Co Ltd
Priority date: 2016-12-28
Filing date: 2017-10-20
Publication date: 2021-09-10
Anticipated expiration: 2037-10-20
Also published as: JP6726093B2; RU2731445C1; WO2018123228A1; MX2019007044A; CN110099606A; JP2018108123A

Abstract

An information processing system (1) is provided with: the blood pressure monitor comprises a blood pressure monitor (20A), a terminal device (10A), and a server (30) configured to be capable of communicating with the terminal device (10A). A terminal device (10A) is provided with: an imaging unit (202); a detection unit (206) that detects the measurement result displayed on the display (24) of the sphygmomanometer (20A) from the image of the sphygmomanometer (20A) included in the captured image generated by the imaging unit (202); and a terminal transmission unit (210) that transmits the measurement result to the server (30). The server (30) comprises: an evaluation unit (254) which evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device (10A); and a server transmission unit (252) that transmits an error notification to the terminal device (10A) when the evaluation unit (254) evaluates that the reliability of the measurement result is low.

Description

Information processing system

Technical Field

The present disclosure relates to an information processing system, and more particularly, to an information processing system including a sphygmomanometer, a terminal device, and a server configured to be communicable with the terminal device.

Background

Various measurement apparatuses have been developed that measure various biological information related to the health state of a human body, such as blood pressure and pulse. The measurement data of such a measurement device is taken into a terminal device for collecting the measurement data, and the health status of the user is checked.

For example, japanese patent laying-open No. 2001-224557 (patent document 1) discloses a data input device. The data input device includes: an image acquisition unit that acquires an image of data displayed on a data display unit of a measurement instrument; a digital reading unit that reads a number in the obtained image; and a display unit that displays the read number.

Documents of the prior art

Patent document

Patent document 1: japanese laid-open patent publication No. 2001-224557

Disclosure of Invention

Problems to be solved by the invention

In recent years, a system for aggregating and managing data in a server has become widespread. Therefore, the following system is conceivable: various measurement data (for example, blood pressure values, pulse rate, etc.) obtained by the data input device of patent document 1 are transmitted to a server, and the health status of the user is managed using the data collected by the server. In such a system, in order to accurately grasp the health status of the user, there is an increasing demand for ensuring the reliability of measurement data periodically transmitted from a terminal device such as a data input device to a server.

Patent document 1 discloses, for example, analyzing measurement data measured and displayed by a predetermined measurement device and outputting the analysis result to a predetermined processing device, but does not teach any technique relating to the above-mentioned need.

The present disclosure has been made in view of the above circumstances, and an object of the present disclosure is to provide an information processing system capable of more accurately grasping the health status of a user of a terminal device.

Means for solving the problems

An information processing system according to an embodiment includes a sphygmomanometer, a terminal device, and a server configured to be communicable with the terminal device. The terminal device includes: a shooting part; a detection unit that detects a measurement result displayed on a display of the sphygmomanometer from among images of the sphygmomanometer contained in the captured image generated by the imaging unit; and a terminal transmission unit that transmits the measurement result to the server. The server includes: an evaluation unit that evaluates the reliability of the measurement result by analyzing the measurement result received from the terminal device; and a server transmission unit that transmits an error notification to the terminal device when the evaluation unit evaluates that the reliability of the measurement result is low.

Preferably, the measurement result includes the measurement date and time of the measurement using the sphygmomanometer. The terminal transmission unit also transmits the date and time of the image captured to the server. The evaluation unit calculates a period from the measurement date and time to the imaging date and time, and evaluates that the reliability of the measurement result is low when the calculated period is not within a predetermined period. The server transmission unit transmits an error notification indicating that the calculated period is not within a predetermined period to the terminal device.

Preferably, the terminal device further includes a position information acquisition unit that acquires position information of the terminal device. The terminal transmission unit also transmits the position information of the terminal device to the server. The evaluation unit determines whether or not the terminal device is present at a predetermined position based on the received position information of the terminal device, and evaluates that the reliability of the measurement result is low when the terminal device is not present at the predetermined position. The server transmission unit transmits an error notification indicating that the measurement location of the sphygmomanometer is different from a predetermined location to the terminal device.

Preferably, the terminal transmission unit further transmits the captured image to the server. The evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on the received captured image, and evaluates that the reliability of the measurement result is low if the sphygmomanometer is not the predetermined sphygmomanometer. The server transmission unit transmits an error notification indicating that the sphygmomanometer is not the predetermined sphygmomanometer to the terminal device.

Preferably, the evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on at least 1 of the brand, shape and model of the sphygmomanometer extracted from the received captured image.

Preferably, the captured image further includes an image of a finger of the subject of the sphygmomanometer. The evaluation unit extracts 1 st feature information of the finger from the finger image of the measurement subject included in the captured image, determines whether or not the 1 st feature information matches 2 nd feature information of the finger of the measurement subject stored in advance in the server, and evaluates that the reliability of the measurement result is low if the 1 st feature information does not match the 2 nd feature information. The server transmission unit transmits an error notification indicating that the finger image of the measurement subject included in the captured image is different from a pre-registered finger image of the measurement subject to the terminal device.

Effects of the invention

According to the present disclosure, the health status of the user of the terminal device can be grasped more accurately.

Drawings

Fig. 1 is a diagram showing a schematic configuration of an information processing system.

Fig. 2 is a block diagram showing an example of a hardware configuration of the terminal device.

Fig. 3 is a diagram showing an example of the appearance of the main body of the sphygmomanometer.

Fig. 4 is a diagram showing an outline of an operation of the information processing system.

Fig. 5 is a diagram showing a screen displayed on a display of the blood pressure monitor terminal device.

Fig. 6 is a diagram showing an example of an error notification displayed on the display of the terminal device.

Fig. 7 is a diagram showing an example of a captured image including a sphygmomanometer and a finger of a measurement subject.

Fig. 8 is a diagram showing an example of a captured image of a scene in which the measurement subject wears the wrist sphygmomanometer.

Fig. 9 is a block diagram showing a functional configuration of a terminal device and a server.

Fig. 10 is a flowchart showing an example of a processing procedure of the terminal device and the server.

Fig. 11 is a flowchart showing an example of the reliability evaluation processing procedure according to the present embodiment.

Detailed Description

Embodiments of the present invention will be described below with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description about the above will not be repeated.

< System construction >

Fig. 1 is a diagram showing a schematic configuration of an information processing system 1.

Referring to fig. 1, an information processing system 1 includes a plurality of

terminal devices

10A, 10B as user terminals,

blood pressure meters

20A, 20B for measuring the blood pressure of a user, a server 30, and a network 40. In the present embodiment, it is assumed that the terminal device 10A is a terminal of the user a and the terminal device 10B is a terminal of the user B. For convenience of description, the

terminal devices

10A and 10B may be collectively referred to as "terminal device 10".

The sphygmomanometer 20A is a fixed-type upper arm sphygmomanometer in which a main body is separated from a cuff (arm band). The sphygmomanometer 20B is a wrist type sphygmomanometer of a wristwatch type in which a main body and a cuff are integrated. The sphygmomanometer 20B has a function of measuring pulsation for twenty-four hours continuously for each pulse by being worn on the arm for a long time like a wristwatch, a function of measuring by pressing a measurement start button by being worn at all times, and the like. Thus, the sphygmomanometer 20B can constantly measure the blood pressure of the user. Hereinafter, for convenience of explanation, the

blood pressure meters

20A and 20B may be collectively referred to as "blood pressure meter 20".

The terminal device 10 is, for example, a smartphone having a camera and a touch panel. The terminal device 10 has the following functions: the measurement result displayed on the display of the sphygmomanometer 20 is detected from the captured image generated by capturing the sphygmomanometer 20 with the camera. Hereinafter, a typical example in which a smartphone is used as a "terminal device" will be described. However, the terminal device may be another terminal device having an imaging function, such as a folding mobile phone, a tablet terminal device, or a PDA (Personal Data assistant).

The network 40 for connecting the terminal device 10 and the server 30 to each other includes various networks such as the internet and a mobile terminal communication network.

The server 30 stores various data transmitted from the terminal device 10. Specifically, the server 30 associates and stores identification information (user ID) of the user and identification information (terminal ID) of the terminal device 10 to the database 32. The server 30 manages various data transmitted from the terminal devices 10 for each user ID (and terminal ID) using the database 32. The database 32 stores measurement results such as the blood pressure value of the user a transmitted from the terminal device 10A to the server 30, for example.

< hardware construction >

(terminal device)

Fig. 2 is a block diagram showing an example of the hardware configuration of the terminal device 10. Referring to fig. 2, the terminal device 10 includes, as main components: a processor 152, a memory 154, an input device 156, a display 158, a wireless communication section 160, a communication antenna 162, a camera 163, a memory interface (I/F)164, a communication interface (I/F)166, a speaker 168, a microphone 170, and a GPS controller 172.

The processor 152 is typically an arithmetic Processing Unit such as a CPU (Central Processing Unit) or an MPU (Multi Processing Unit). The processor 152 reads the program stored in the memory 154 and executes the program, thereby functioning as a control unit that controls the operation of each unit of the terminal device 10. The processor 152 executes the program to realize each process (step) of the terminal device 10 described later.

The Memory 154 is implemented by a RAM (Random Access Memory), a ROM (Read-Only Memory), a flash Memory, or the like. The memory 154 stores a program executed by the processor 152, data used by the processor 152, and the like.

The input device 156 receives an operation input to the terminal device 10. Typically, the input device 156 is implemented by a touch panel. The touch panel is provided on a display 158 having a function as a display unit, and is, for example, of a capacitance type. The touch panel detects a touch operation of an external object on the touch panel at every predetermined time, and inputs touch coordinates to the processor 152. However, the input device 156 may also include buttons or the like.

The wireless communication unit 160 is connected to a mobile communication network via a communication antenna 162 and transmits and receives a signal for performing wireless communication. Thus, the terminal device 10 can communicate with another communication device (e.g., the server 30) via a mobile communication network such as LTE (Long Term Evolution).

The camera 163 can be implemented by, for example, a CCD (Charge Coupled Device) system, a CMOS (Complementary metal Oxide Semiconductor) system, or other systems.

The memory interface 164 reads data from an external storage medium 165. The processor 152 reads data stored in the storage medium 165 via the memory interface 164 and stores the data in the memory 154. The processor 152 reads data from the memory 154 and stores the data in an external storage medium 165 via the memory interface 164.

The storage medium 165 includes a nonvolatile storage medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), a BD (Blu-ray Disc), a USB (Universal Serial Bus) memory, and an SD (Secure Digital) memory card.

The communication interface (I/F)166 is a communication interface for exchanging various data with other devices, and is implemented by an adapter, a connector, or the like. In the present embodiment, BLE (bluetooth (registered trademark)) low energy is used as a communication method. However, the communication method may be a wireless communication method such as a wireless LAN, or a wired communication method using usb (universal Serial bus) or the like.

The speaker 168 converts a sound signal supplied from the processor 152 into sound and outputs the sound to the outside of the terminal apparatus 10. The microphone 170 receives an audio input to the terminal device 10, and supplies an audio signal corresponding to the audio input to the processor 152.

The GPS controller 172 receives a GPS signal or a position signal (positioning signal) from a base station to acquire position information of the terminal device 10. The GPS controller 172 inputs the acquired position information of the terminal device 10 to the processor 152.

The terminal device 10 includes various sensors (an acceleration sensor and an angular velocity sensor), a timer unit for counting time, and the like.

(Server)

The server 30 may provide the information processing described later as a whole, and a known hardware configuration may be adopted. For example, the server 30 includes: a processor for performing various processes; a memory for storing programs, data, and the like; a communication interface for transmitting and receiving various data to and from the terminal device 10; and an input interface for receiving an instruction from an administrator.

(Sphygmomanometer)

The sphygmomanometer 20 may be provided as a whole by information processing described later, and a known hardware configuration may be adopted. For example, the blood pressure monitor 20 includes: a processor for performing various processes; a memory for storing programs, data, and the like; a display for displaying measurement data and the like; an input interface (e.g., a button, a switch, or the like) for receiving an instruction from a user; a cuff that can be wrapped around the upper wrist (or wrist) of a user; cuff pressure adjusting mechanisms such as a piezoelectric pump and an exhaust valve; a pressure sensor for detecting a cuff pressure; a time counting unit for counting time; and a temperature sensor that detects an outside air temperature.

Fig. 3 is a diagram showing an example of the appearance of the main body of the sphygmomanometer 20A. Referring to fig. 3, the main body 22 of the sphygmomanometer 20A includes: a display 24, a forward/backward button 26, a lamp 27, a user number switch 28, and a start/stop button 29 for blood pressure measurement. Furthermore, brand information 41 (for example, brand "AAA") and model information 43 (for example, model "XYZ-ABC") of the sphygmomanometer 20 are provided on the outer surface of the main body 22. The user number switch 28 is used when the measurement results of 2 persons are stored separately. In the example of fig. 3, the user numbered "1" is selected. The lamp 27 is a lamp indicating whether or not the wrapping condition of the cuff is appropriate, and is shown in the example of fig. 3 as appropriate.

The display 24 displays the measurement results. Specifically, the assay results include: the highest blood pressure value (e.g., 118mmHg), the lowest blood pressure value (e.g., 78mmHg), and the pulse rate (e.g., 70 beats/minute) displayed in region 50; the measurement date and time displayed in the area 52 (for example, 7 months, 1 days, 7 hours, 30 minutes); the user number (e.g., "1") displayed in the area 54; the current air temperature (e.g., 24 degrees) displayed in region 56; and various messages (e.g., messages indicating completion of the assay) displayed in the area 58. The measurement result may include information indicating the state of the pulse wave, information indicating whether the wrapping state of the cuff is appropriate, and the like.

< summary of action >

Fig. 4 is a diagram showing an outline of the operation of the information processing system 1. Here, it is assumed that the user of the terminal device 10 performs blood pressure measurement using the sphygmomanometer 20A. Fig. 5 is a diagram showing a screen displayed on the display 158 of the terminal device 10 when the sphygmomanometer 20A is imaged. Fig. 6 is a diagram showing an example of an error notification displayed on the display 158 of the terminal device 10.

Referring to fig. 4, the sphygmomanometer 20A measures the blood pressure value (the highest blood pressure value, the lowest blood pressure value) and the pulse rate of the user, and displays the measurement result on the display 24 (sequence SQ 10).

The terminal device 10 uses the camera 163 to capture an image (image) of the sphygmomanometer 20A with the measurement result displayed on the display 24 (sequence SQ 12). The terminal device 10 detects the measurement result from the captured image (sequence SQ 14). For example, as shown in fig. 5, the display 158 of the terminal apparatus 10 in the shooting mode displays a screen 500 of a frame 510 including four corners. The user takes an image so that the display 24 of the sphygmomanometer 20A is housed in the frame 510. Thus, the terminal device 10 analyzes the captured image by using a known OCR technique or the like, an image recognition technique, or the like, and detects the measurement result.

For example, the frame 510 is displayed as a frame indicating four outer corners of a recognition range (analysis range) in which a character string can be recognized. Therefore, the inside of the frame 510 becomes the recognition range. The terminal device 10 executes a process of recognizing the measurement result captured so as to be received in the recognition range. Specifically, the terminal device 10 recognizes various character strings included in the measurement result. The "character" in the present embodiment is a symbol in which lines, dots, and the like are combined to transmit and record a word (language), and includes not only an english alphanumeric symbol, a kanji character, a kana character, and the like, but also a character in which an identification code is attached to an arbitrary figure such as a pictograph, a stamp, and the like.

Here, the terminal device 10 stores screen information indicating which information is displayed in which area of the display 24 of the sphygmomanometer 20A in the memory 154. Therefore, for example, when the display 24 is captured so as to be received in the frame 510 as the recognition range, the terminal device 10 can determine which information each character string recognized is by using the screen information. For example, the terminal device 10 can determine that the character strings "118", "78", and "70" recognized in the area 50 of the display 24 received in the box 510 are character strings indicating the highest blood pressure value, the lowest blood pressure value, and the pulse rate, respectively.

The terminal device 10 receives an instruction from the user to specify that the subject is the sphygmomanometer 20A. Alternatively, the terminal device 10 may extract feature information (shape, model, brand) of the sphygmomanometer from the captured image, and compare the extracted feature information with feature information of each sphygmomanometer stored in advance, thereby specifying that the subject is the sphygmomanometer 20A.

Referring again to fig. 4, the terminal device 10 transmits various information including measurement data and other information to the server 30 via the network 40 (sequence SQ 16). Other information is, for example, shooting date and time, user ID, terminal ID, and the like.

The server 30 evaluates the reliability of the measurement result based on a predetermined evaluation method (sequence SQ 18). For example, when the period from the measurement date and time to the imaging date and time is not within the predetermined period, the server 30 evaluates that the reliability of the measurement result is low. In this case, the server 30 does not store the measurement result in the database 32.

If it is evaluated that the reliability of the measurement result is low, the server 30 notifies the terminal device 10 of an error (sequence SQ 20). For example, the server 30 transmits an error notification indicating that the measurement result cannot be relied upon because the period from the measurement time to the imaging time is too long, to the terminal device 10. The terminal device 10 displays the error notification received from the server 30 on the display 158 (sequence SQ 22). For example, as shown in fig. 6, the terminal device 10 includes a message 610 such as "is a measurement result with low reliability" and "the period from the measurement time to the imaging time is too long. "and so on" are displayed on display 158 on error notification screen 600 of message 620 indicating the reason for the low reliability. The error notification screen 600 may further include a message for prompting the user to perform the measurement again.

The server 30 may transmit a notification indicating that the measurement data is normal to the terminal device 10 when it is evaluated that the reliability of the measurement data is high (not low) based on a predetermined evaluation method. In this case, the server 30 stores the measurement data in the database 32.

< evaluation mode >

In the present embodiment, the server 30 evaluates the reliability of the measurement result received from the terminal device 10 according to various evaluation methods. Here, an evaluation method performed by the server 30 will be described.

(evaluation method: one of)

In the evaluation method (one), the reliability of the measurement result is evaluated based on the period from the measurement date and time to the imaging date and time. Specifically, the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20A and the imaging date and time when the sphygmomanometer 20A was captured to the server 30. The server 30 calculates a period from the measurement date and time to the imaging date and time, and evaluates that the reliability of the measurement result is low when the calculated period (calculation period) is not within a predetermined period (for example, within 1 minute), and evaluates that the reliability of the measurement result is high when the calculated period is within the predetermined period. The reason for evaluating the reliability in this manner will be described below.

When the period from the measurement date and time to the imaging date and time is not within the predetermined period, it is considered that the user of the terminal device 10 as the measurement subject does not use the camera to image the sphygmomanometer immediately after the blood pressure measurement is performed. In this regard, since the possibility of falsification or the like of the measurement result by some method cannot be denied, the reliability of the measurement result is evaluated to be low.

In addition, when the time of the clock of the sphygmomanometer is set incorrectly, an error occurs in the calculation period. In this case, it is considered that the calculation period does not fall within the predetermined period even if the user uses the camera to photograph the sphygmomanometer immediately after the blood pressure measurement. Since blood pressure varies even in 1 day, an index (i.e., a measurement date and time) indicating when the measurement was performed in 1 day (morning or night) is an important factor in accurately grasping the health status of the user. In this regard, when the calculated period is not within the predetermined period, the possibility that the measurement date and time is incorrect cannot be denied, and therefore, the reliability of the measurement result is evaluated to be low.

(second evaluation method)

In the second evaluation method (i), the reliability of the measurement result is evaluated based on the measurement location. Specifically, the terminal device 10 transmits the measurement result detected from the captured image of the sphygmomanometer 20A and the positional information of the device to the server 30. The server 30 determines whether or not the terminal device 10 is present at a predetermined measurement location based on the position information of the terminal device 10. The server 30 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined measurement location, and evaluates that the reliability of the measurement result is high when the terminal device is present at the predetermined measurement location. The positional information of the predetermined measurement location is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. The reason for evaluating the reliability in this manner will be described below.

In a case where the patient is mentally stressed, the blood pressure rises as compared with the rest state. For example, when a person who normally performs blood pressure measurement at home measures blood pressure in a hospital, the blood pressure may be increased compared to the blood pressure measured at home due to mental stress. Therefore, an index as to whether or not the measurement location at the time of blood pressure measurement is the same location as usual (predetermined measurement location) is an important element in accurately grasping the health state of the user. In this regard, when the terminal device 10 is not present at a predetermined measurement location, the possibility that the blood pressure has changed depending on the measurement location cannot be denied, and therefore, the reliability of the measurement result is evaluated to be low.

In order to more accurately determine that the terminal device 10 is present at the predetermined measurement location during the blood pressure measurement, the measurement date and time and the reception date and time when the server 30 receives the position information may be further compared. Specifically, when the position information of the terminal device 10 indicates a predetermined measurement location and the time from the measurement date and time to the reception date and time is within a predetermined time, the server 30 determines that the terminal device 10 is present at the predetermined measurement location when the blood pressure is measured. On the other hand, if the time is not within the predetermined time even though the position information of the terminal device 10 indicates the predetermined measurement location, the server 30 determines that the terminal device 10 is not present at the predetermined measurement location at the time of blood pressure measurement. In this case, the server 30 evaluates that the reliability of the measurement result is low.

(evaluation method III)

In the third evaluation method (i), the reliability of the measurement result is evaluated based on the brand, model, shape, and the like of the sphygmomanometer. Specifically, the terminal device 10 transmits the captured image of the sphygmomanometer 20A to the server 30. The server 30 determines whether or not the sphygmomanometer 20A is an authenticated sphygmomanometer based on the captured image. The server 30 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20A is not an authenticated sphygmomanometer, and that the reliability of the measurement result is high when the sphygmomanometer is an authenticated sphygmomanometer. Specifically, the server 30 extracts brand information, model, shape, and the like of the sphygmomanometer 20A based on the captured image of the sphygmomanometer 20A. The server 30 determines whether or not the sphygmomanometer 20A is an authenticated sphygmomanometer based on these pieces of information. For example, assume that the sphygmomanometer of brand X is an authenticated sphygmomanometer. In this case, when the extracted brand information indicates the brand X, the server 30 determines that the sphygmomanometer 20A is the authenticated sphygmomanometer.

(evaluation method: IV)

In the evaluation method (fourth), reliability of the measurement result is evaluated based on the finger image of the user (the measurement subject). Here, assume that the measurement subject uses the camera 163 of the terminal device 10A to capture images of the sphygmomanometer 20A and his/her finger.

Fig. 7 is a diagram showing an example of a captured image including a sphygmomanometer and a finger of a measurement subject. A screen 700 in fig. 7 shows an image of the subject taking a measurement with the left finger close to the sphygmomanometer 20A when the cuff is wrapped around the left arm part using the sphygmomanometer 20A as the upper arm type sphygmomanometer.

The terminal device 10A transmits a captured image including the image of the sphygmomanometer 20A and the finger image of the measurement subject as shown in the screen 700 to the server 30. The server 30 extracts feature information of the finger from the finger image of the measured person. The server 30 determines whether or not the feature information of the finger stored in association with the terminal ID (and the user ID) of the terminal device 10A matches the extracted feature information of the finger. When the stored feature information does not match the extracted feature information, the server 30 determines that the measurement subject is not the user a (the user of the terminal device 10A), and evaluates that the reliability of the measurement result is low. When the feature information matches, the server 30 determines that the measurement subject is the user a, and evaluates that the reliability of the measurement result is high.

In the example of fig. 7, all 5 fingers are imaged, but imaging may be performed so that 1 or more specific fingers (for example, only the index finger) are included as long as the characteristic information of the fingers can be compared. In addition, when the feature information of the palm stored in association with the terminal ID of the terminal device 10A matches the feature information of the palm of the measurement subject extracted from the captured image, the reliability of the measurement result may be evaluated to be high, and when these feature information do not match, the reliability of the measurement result may be evaluated to be low.

Next, when the wrist sphygmomanometer is used, the reliability of the measurement result may be evaluated based on the wearing state.

Fig. 8 is a diagram showing an example of a captured image of a scene in which the measurement subject wears the wrist sphygmomanometer. A screen 800 in fig. 8 shows an image of a state in which the subject wears the sphygmomanometer 20B when performing measurement by winding the cuff around the left wrist using the sphygmomanometer 20B as a wrist sphygmomanometer.

The terminal device 10 transmits the captured image of the measurement subject with the sphygmomanometer 20B worn on the wrist thereof as shown in the screen 800 to the server 30. Specifically, in the case of the wrist type sphygmomanometer, as in the case of the upper arm type sphygmomanometer, the reliability of the measurement result is evaluated based on the feature information of the finger (and palm) of the measurement subject. Therefore, the terminal device 10 transmits the captured image (the captured image shown in fig. 8) including the finger of the measurement subject in a state where the sphygmomanometer 20B is worn on the wrist of the measurement subject to the server 30.

First, when the server 30 determines that the blood pressure monitor 20B is not worn, it evaluates that the reliability of the measurement result is low. For example, when the image of the sphygmomanometer 20B and the image of the finger and wrist of the measurement subject are not included in the captured image, the server 30 determines that the blood pressure monitor 20B is not worn, and evaluates that the reliability of the measurement result is low.

When determining that the blood pressure monitor 20B is worn, the server 30 further determines whether or not the feature information of the finger stored in association with the terminal ID of the terminal device 10A matches the extracted feature information of the finger. When the stored feature information does not match the extracted feature information, the server 30 determines that the measurement subject is not the user a, and evaluates that the reliability of the measurement result is low. When the feature information matches, the server 30 determines that the measurement subject is the user a, and evaluates that the reliability of the measurement result is high.

< functional constitution >

Fig. 9 is a block diagram showing a functional configuration of the terminal device 10 and the server 30. Referring to fig. 9, the terminal device 10 includes: an imaging unit 202, a display control unit 204, a detection unit 206, a positional information acquisition unit 208, and a terminal communication unit 210. The server 30 includes a server communication unit 252, an evaluation unit 254, and the database 32.

The image pickup unit 202 of the terminal device 10 picks up an image of a subject to generate a picked-up image. In the present embodiment, the imaging unit 202 generates an image including an image of the sphygmomanometer 20 as an object. The imaging unit 202 is a function realized mainly by the cooperation of the processor 152 and the camera 163. The imaging unit 202 outputs the generated captured image to the display control unit 204, the detection unit 206, and the terminal communication unit 210.

The display control unit 204 displays the captured images sequentially captured by the imaging unit 202 on the display 158.

The detection unit 206 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from the image of the sphygmomanometer 20 included in the captured image generated by the imaging unit 202. The measurement result includes, for example, a maximum blood pressure value, a minimum blood pressure value, a pulse rate, a measurement date and time, an air temperature, a user number, various messages, information indicating whether the wrapping state of the cuff is appropriate, and information indicating the state of the pulse wave. The detection unit 206 outputs the detected measurement result to the terminal communication unit 210.

The positional information acquisition unit 208 acquires positional information of the terminal device 10 based on a GPS signal or a positional signal from a base station. The position information acquisition unit 208 is a function realized mainly by the GPS controller 172. The positional information acquisition unit 208 outputs the acquired positional information to the terminal communication unit 210.

The terminal communication unit 210 transmits various information including the measurement result detected by the detection unit 206 and other information to the server 30. The other information includes, for example, the user ID, the terminal ID, the captured image generated by the imaging unit 202, the date and time of imaging of the captured image, and the positional information of the terminal device 10 acquired by the positional information acquiring unit 208.

The server communication unit 252 of the server 30 receives various information from the terminal device 10. The server communication unit 252 outputs various information to the evaluation unit 254.

The evaluation unit 254 analyzes the measurement result received from the terminal device 10 to evaluate the reliability of the measurement result. The server communication unit 252 transmits an error notification to the terminal device 10 when the evaluation unit 254 evaluates that the reliability of the measurement result is low.

Specifically, in one aspect, the evaluation unit 254 calculates a period from the measurement date and time to the imaging date and time, and determines whether or not the calculated period is within a predetermined period. When the calculated period is not within the predetermined period, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits an error notification indicating that the calculated period is not within the predetermined period to the terminal device 10.

On the other hand, the evaluation unit 254 determines whether or not the terminal device 10 is present at a predetermined position based on the position information of the terminal device 10 received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the terminal device 10 is not present at the predetermined position. The information indicating the predetermined position is stored in advance in the memory of the server 30 in association with the terminal ID and the user ID. In this case, the server communication unit 252 transmits an error notification indicating that the measurement location of the sphygmomanometer 20 is different from the predetermined location to the terminal device 10.

In still another aspect, the evaluation unit 254 determines whether or not the sphygmomanometer 20 is a predetermined sphygmomanometer based on the captured image received from the terminal device 10. The evaluation unit 254 evaluates that the reliability of the measurement result is low when the sphygmomanometer 20 is not a predetermined sphygmomanometer. More specifically, the evaluation unit 254 extracts at least 1 of the brand, model, and shape of the sphygmomanometer 20 from the captured image. The evaluation unit 254 determines whether the sphygmomanometer 20 is a predetermined sphygmomanometer based on the extracted information. When the evaluation unit 254 evaluates that the reliability of the measurement result is low, the server communication unit 252 transmits an error notification indicating that the sphygmomanometer 20 is not the predetermined sphygmomanometer to the terminal device 10. The predetermined blood pressure monitor is permitted by the administrator or the like of the server 30, for example, because the condition such as the measurement accuracy is satisfied.

In another aspect, the evaluation unit 254 extracts the feature information Fa of the finger from the finger image of the measurement subject included in the captured image. The evaluation unit 254 determines whether or not the feature information Fa matches the feature information Fb of the finger of the measurement subject stored in advance in the memory of the server 30. When the feature information Fa does not match the feature information Fb, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits an error notification indicating that the finger image of the measurement subject included in the captured image is different from the pre-stored finger image of the measurement subject to the terminal device 10. The feature information Fb is stored in the memory of the server 30 in association with the terminal ID and the user ID.

The evaluation unit 254 may evaluate the reliability of the measurement result based on the plurality of evaluation items described above. For example, the "period from the measurement date and time to the imaging date and time" is set as the evaluation item E1, the "position information of the terminal device 10" is set as the evaluation item E2, the "sphygmomanometer used in the measurement" is set as the evaluation item E3, and the "finger image of the subject included in the captured image" is set as the evaluation item E4. In this case, if 1 of the evaluation items E1 to E4 is evaluated as having low reliability of the measurement result according to the above-described evaluation method, the evaluation unit 254 finally evaluates that the reliability of the measurement result is low even if the remaining evaluation items are not evaluated as having low reliability of the measurement result. That is, the evaluation unit 254 finally evaluates that the reliability of the measurement result is high only when all of the evaluation items E1 to E4 are not evaluated as low in reliability of the measurement result according to the above-described evaluation method. The evaluation of the measurement result for each evaluation item may be arbitrarily set by an administrator or the like of the server 30.

The evaluation unit 254 outputs the evaluation result to the server communication unit 252. When the reliability of the measurement result is evaluated to be low, the evaluation unit 254 discards the measurement result without storing the measurement result in the database 32. When the reliability of the measurement result is evaluated to be high, the evaluation unit 254 stores the measurement result in the database 32 in association with the terminal ID and the user ID.

When the evaluation unit 254 evaluates that the reliability of the measurement result is high, the server communication unit 252 transmits a notification indicating that the measurement result is normal (for example, a notification indicating that the measurement result is normally stored in the database 32) to the terminal device 10.

The terminal communication unit 210 of the terminal device 10 receives various notifications (e.g., error notifications and normal notifications) transmitted from the server 30. The terminal communication unit 210 outputs the received various notifications to the display control unit 204. The display control unit 204 causes the display 158 to display various notifications.

< processing procedure >

Fig. 10 is a flowchart showing an example of a processing procedure of the terminal device 10 and the server 30.

Referring to fig. 10, the processor 152 of the terminal device 10 generates a captured image of the sphygmomanometer 20 captured using the camera 163 (step S100). The processor 152 detects the measurement result displayed on the display 24 of the sphygmomanometer 20 from among the captured images (step S102). The processor 152 transmits various information to the server 30 via the wireless communication section 160 (or the communication interface 166) (step S104). Here, the various information includes the measurement result, the user ID, the terminal ID, the captured image, the date and time of capture, and the position information of the terminal device 10. The measurement result includes a maximum blood pressure value, a minimum blood pressure value, a pulse rate, and a measurement date and time.

The processor of the server 30 (hereinafter referred to as a "server processor") receives various information transmitted from the terminal device 10 via the communication interface (step S106). The server processor executes reliability evaluation processing of the measurement result based on various information (step S110).

Fig. 11 is a flowchart showing an example of the reliability evaluation processing procedure. Referring to fig. 11, the server processor determines whether or not the period from the measurement date and time to the imaging date and time is within a predetermined period (step S202). If the period is not within the predetermined period (no in step S202), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the period is within the predetermined period (yes in step S202), the server processor determines whether or not the terminal device 10 is present at the predetermined position (step S204).

If the terminal device 10 is not present at the predetermined position (no in step S204), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. When the terminal device 10 is present at a predetermined position (yes in step S204), the server processor determines whether or not the sphygmomanometer 20 used for measurement is a predetermined sphygmomanometer (step S206).

If the blood pressure monitor 20 is not the predetermined blood pressure monitor (no in step S206), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. When the sphygmomanometer 20 is a predetermined sphygmomanometer (yes in step S206), the server processor determines whether or not the feature information of the finger of the measurement subject included in the received captured image matches the feature information of the finger of the measurement subject stored in the memory of the server 30 (step S208).

If the pieces of feature information do not match (no in step S208), the server processor evaluates that the reliability of the measurement result is low (step S212), and ends the reliability evaluation process. If the pieces of feature information match (yes in step S208), the server processor evaluates that the reliability of the measurement result is high (step S210), and ends the reliability evaluation process.

Referring again to fig. 10, the server processor determines whether or not the reliability of the measurement result is evaluated to be low in the reliability evaluation processing (step S112). If the server processor evaluates that the reliability of the measurement result is low (yes in step S112), the server processor transmits an error notification to the terminal device 10 via the communication interface (step S114). If the server processor evaluates that the reliability of the measurement result is high (no in step S112), the server processor stores the measurement result in the database 32 (step S116). Next, the server processor transmits a notification indicating that the measurement result has been normally stored in the database 32 to the terminal device 10 via the communication interface (step S118).

The terminal device 10 receives various notifications from the server 30 via the wireless communication unit 160 (or the communication interface 166) (step S120). The terminal device 10 displays various notifications on the display 158 (step S122), and ends the processing. The terminal device 10 may output various notifications by sound via the speaker 168.

< advantage >

According to the present embodiment, when the reliability of the measurement result transmitted from the terminal device 10 to the server 30 is evaluated and the reliability is evaluated to be low, an error notification is transmitted from the server 30 to the terminal device 10. This ensures the reliability of the measurement result stored in the server 30, and the user can grasp the reliability of the measurement result in real time. This reduces the possibility that the user may be too confident about the health status of the user or may be too anxious about the health status of the user. In addition, when the administrator using the server 30 provides some benefit (for example, reduction of medical insurance fee or the like in the case of good health status) to the system of the user of the terminal device 10 according to the health status of the user, the system can be suitably used.

< other embodiments >

(1) In the above-described embodiment, the server 30 evaluates the reliability of the measurement results based on the 4 evaluation items E1 to E4, but the present invention is not limited to this configuration. For example, the server 30 may evaluate the reliability of the measurement result based on the air temperature included in the measurement result and information indicating whether the wrapping state of the cuff is appropriate. Specifically, the server 30 may determine that the reliability of the measurement result is low when the air temperature is lower than a predetermined temperature or when the wrapping state of the cuff is not appropriate.

Furthermore, the reliability of the measurement results may also be evaluated as follows. Specifically, the evaluation unit 254 of the server 30 determines whether or not the difference between the measurement time Ta1 included in the current measurement result and the measurement time Ta2 included in the past measurement result (for example, yesterday measurement result) is within a predetermined time (for example, within 5 minutes). For example, the evaluation unit 254 determines whether or not measurement is performed on one day and measurement is performed on another day at substantially the same time. The evaluation unit 254 determines whether or not the difference between the shooting time Tb1 included in the current measurement result and the shooting time Tb2 included in the past measurement result is within a predetermined time. For example, the evaluation unit 254 determines whether or not the imaging after the measurement on one day and the imaging after the measurement on the other day are performed at substantially the same time.

The evaluation unit 254 also determines whether or not the sphygmomanometer X1 used in the current measurement is the same as the sphygmomanometer X2 used in the past measurement. The evaluation unit 254 makes this determination by, for example, comparing information (brand information, model number, shape, and the like) extracted from the captured image of the sphygmomanometer X1 with information extracted from the captured image of the sphygmomanometer X2.

Then, the evaluation unit 254 determines whether or not the following condition is satisfied: the difference between the measurement time Ta1 and the measurement time Ta2 is within a predetermined time, the difference between the imaging time Tb1 and the imaging time Tb2 is within a predetermined time, and the sphygmomanometer X1 and the sphygmomanometer X2 are the same. When determining that the condition is satisfied, the evaluation unit 254 determines whether or not the difference between the measurement value M1 (any one of the highest blood pressure value, the lowest blood pressure value, and the pulse rate) included in the current measurement result and the measurement value M2 included in the past measurement result is within a predetermined value.

When determining that the difference between the measurement value M1 and the measurement value M2 is not within the predetermined value, the evaluation unit 254 evaluates that the reliability of the measurement result is low. In this case, the server communication unit 252 transmits, for example, a notification of whether or not to take notice of spoofing or the like to the terminal device 10 as an error notification. Alternatively, the server communication unit 252 transmits a notification indicating that attention is required to the health state such as a change in physical condition or symptoms to the terminal device 10.

(2) In the above-described embodiment, a program that causes a computer to function to execute the control described in the above-described flowchart may be provided. Such a program can be recorded on a non-transitory computer-readable recording medium such as a floppy Disk, a CD-ROM (Compact Disk Read Only Memory), a secondary storage device, a main storage device, and a Memory card attached to a computer, and provided as a program product. Alternatively, the program may be provided by being recorded in a recording medium such as a hard disk incorporated in a computer. In addition, the program can also be provided by downloading via a network.

The program may be a program that calls out necessary ones of program modules provided as part of an Operating System (OS) of the computer in a predetermined arrangement and at a predetermined timing to execute processing. In this case, the program itself does not include the above-described module, but executes processing in cooperation with the OS. Such a program not including a module may be included in the program of the present embodiment.

The program according to the present embodiment may be provided by being embedded in a part of another program. In this case, the program itself does not include the module included in the other program, but executes the processing in cooperation with the other program. Such a program embedded in another program can be included in the program of the present embodiment.

(3) The configuration exemplified as the above embodiment is an example of the configuration of the present invention, and may be combined with other known techniques, or may be configured by performing modifications such as omitting a part thereof, without departing from the scope of the present invention. In the above-described embodiment, the processing and the configuration described in the other embodiments may be appropriately performed.

The presently disclosed embodiments are to be considered in all respects as illustrative and not restrictive. The scope of the present invention is given by the claims rather than the above description, and is intended to include all modifications within the meaning and range equivalent to the claims.

Description of the reference numerals

1: an information processing system; 10: a terminal device; 20: a sphygmomanometer; 22: a main body portion; 24. 158: a display; 26: a forward/backward button; 27: a lamp; 28: a user number switch; 29: a stop button; 30: a server; 32: a database; 40: a network; 152: a processor; 154: a memory; 156: an input device; 160: a wireless communication unit; 162: a communication antenna; 163: a camera; 164: a memory interface; 165: a storage medium; 166: a communication interface; 168: a speaker; 170: a microphone; 172: a controller; 202: a shooting part; 204: a display control unit; 206: a detection unit; 208: a position information acquisition unit; 210: a terminal communication unit; 252: a server communication unit; 254: an evaluation unit.

Claims

1. An information processing system including a sphygmomanometer, a terminal device, and a server configured to be communicable with the terminal device, the information processing system being characterized in that,

the terminal device includes:

a shooting part;

a detection unit that detects a measurement result displayed on a display of the sphygmomanometer from among images of the sphygmomanometer included in the captured image generated by the imaging unit; and

a terminal transmission unit for transmitting the measurement result to the server,

the server includes:

an evaluation unit that evaluates reliability of the measurement result by analyzing the measurement result received from the terminal device; and

a server transmission unit that transmits an error notification to the terminal device when the evaluation unit evaluates that the reliability of the measurement result is low,

the measurement result includes the date and time of measurement performed using the sphygmomanometer,

the terminal transmitting section further transmits a shooting date and time of the shot image to the server,

the evaluation unit calculates a period from the measurement date and time to the imaging date and time, and evaluates that the reliability of the measurement result is low when the calculated period is not within a predetermined period,

the server transmission unit transmits an error notification indicating that the calculated period is not within the predetermined period, to the terminal device.

2. The information processing system according to claim 1,

the terminal device further includes a position information acquiring unit for acquiring position information of the terminal device,

the terminal transmitting unit further transmits the position information of the terminal device to the server,

the evaluation unit determines whether or not the terminal device is present at a predetermined position based on the received position information of the terminal device, and evaluates that the reliability of the measurement result is low when the terminal device is not present at the predetermined position,

the server transmission unit transmits an error notification indicating that the measurement location of the sphygmomanometer is different from the predetermined location to the terminal device.

3. An information processing system including a sphygmomanometer, a terminal device, and a server configured to be communicable with the terminal device, the information processing system being characterized in that,

the terminal device includes:

a shooting part;

the server includes:

the terminal transmitting part further transmits the photographed image to the server,

the evaluation unit determines whether or not the sphygmomanometer is a predetermined sphygmomanometer based on the received captured image, and evaluates that the reliability of the measurement result is low when the sphygmomanometer is not the predetermined sphygmomanometer,

the server transmission unit transmits an error notification indicating that the sphygmomanometer is not the predetermined sphygmomanometer to the terminal device.

4. The information processing system according to claim 3,

the evaluation unit determines whether or not the sphygmomanometer is the predetermined sphygmomanometer based on at least 1 of the brand, shape and model of the sphygmomanometer extracted from the received captured image.

5. The information processing system according to claim 3 or 4,

the captured image further includes an image of a finger of the subject of the sphygmomanometer,

the evaluation unit extracts 1 st feature information of a finger from the finger image of the measurement subject included in the captured image, determines whether or not the 1 st feature information matches 2 nd feature information of the finger of the measurement subject stored in advance in the server, and evaluates that the reliability of the measurement result is low when the 1 st feature information does not match the 2 nd feature information,

the server transmission unit transmits an error notification indicating that the finger image of the measurement subject included in the captured image is different from the pre-registered finger image of the measurement subject to the terminal device.