JP2008229092A - Personal digital assistant - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a personal digital assistant which measures and stores log data which keeps conditional information, biological information, positional information or the like related with each other without constraining user's everyday life physically and in terms of time. <P>SOLUTION: The personal digital assistant acquires biological information of a wearer. The personal digital assistant includes a heart rate information acquiring section 300 having a plurality of heart rate sensor electrodes and an amplifying section for amplifying the current from the plurality of heart rate sensor electrodes, a wearing detection section 400 for detecting whether a user wears the device or not, and a storing section 800 that stores biology-condition correlated data by correlating biological data acquired by the heart rate information acquiring section 300 and wearing/nonwearing data acquired by the wearing detection section 400. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a portable information terminal device such as a mobile phone or a PDA device that incorporates a non-contact type heart rate sensor and can biologically measure biological information in general life.

  In recent years, personal digital assistants such as mobile phones and PDAs are widely used. Various attempts have been made to perform personal health management using such portable information terminal devices. As an example of such a trial, for example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2004-321252) discloses a portable biological information measuring device that includes a pressing surface that is pressed toward the wrist, and the pressing surface. A pressure detecting element that is pressed from the epidermis toward the radial artery and detects a radial artery wave; a vibration sensor that is provided on the pressing surface and is pressed toward the wrist bone; and the vibration sensor There is disclosed a portable biological information measuring device including a heart sound extracting means for extracting a heart sound from a signal output from the device.

Patent Document 2 (Japanese Patent Laid-Open No. 2005-237469) discloses portable measuring devices (50a,..., 50aa,..., 50a,..., 150a,. , 250a,..., 450a,..., And measuring apparatus (10a,...) That measures body movement information, which is information related to the movement of the user's body, without contact with the user. .., 30a,..., 210a,..., And output devices (20a,..., 20ab,. , 120a,..., 220a,...), And portable measuring instruments (50a,...) Are disclosed.
JP 2004-321252 A Japanese Patent Laid-Open No. 2005-237469

However, in the prior art method described in Patent Document 1, heart rate and electrocardiogram measurement is highly restrictive because the electrodes must be brought into contact with the skin, and psychological bias is also taken into account, so that data of daily true biological information is obtained. There is a problem that it is difficult to say that can be acquired accurately. There is also a problem that only spot sampling measurement can be performed in a short time. Also,
On the other hand, since the thing of patent document 2 is a portable measuring device provided with the measuring device which measures a user without contact, the above-mentioned psychological bias, the problem of spot sampling, etc. Absent. However, in the portable measuring device described in Patent Document 2, what is the state of the user (whether the device is worn, sleeping or waking up)? It is not possible to detect whether the user is walking, or the like, and the user's status information does not correspond to the biological information, which is a problem. This is because, for example, biometric information is highly dependent on user status information. For example, if the user is very crowded, the heart rate may increase due to stress, and if you are sleeping, you can get a relaxed and stable heart rate. Will be. However, the technology described in Patent Document 2 does not disclose any technique for associating such user status information with biological information.

  In order to solve the above problems, the present invention provides a portable information terminal such as a mobile phone or a PDA device that can specify a position, a sensor using a non-contact capacitive electrode, and an acceleration sensor that detects the posture and movement of a human body. Built-in gyro sensor and strain gauge sensor that detects the posture of the information terminal itself, and wears it in the breast pocket of clothes (shirts) to measure biological information according to the daily living environment (ecological) Yes.

  When a person is moving (living), the portable information terminal device according to the present invention is always placed in the breast pocket. A mechanism for measuring heartbeats and electrocardiograms is provided by using an acceleration (gyro) sensor to determine whether a device is placed in a normal shirt pocket. In addition, the portable information terminal device according to the present invention includes a strain gauge, and is configured to be able to sense the posture of the portable information terminal device that fits in a pocket using the weight of the terminal.

  In addition, the portable information terminal device according to the present invention has a function capable of measuring the position by the GPS positioning unit, and can record incidental information indicating when and where the biometric data is in the environment. Moreover, since the communication function is provided, the collected biometric data can be transmitted to a remote place such as a management center when necessary.

  At the time of transmission, it is provided with a function that can change the remote call (incoming) sound and volume to a predetermined one according to the state of heartbeat / electrocardiogram. With such a function of the present invention, a person who has received a call at a remote location can intuitively determine the details of the data based on the meaning and symbolism of the ringing tone, and can immediately cope with an emergency situation.

  In order to achieve the above-described configuration, the invention according to claim 1 is a portable information terminal device that acquires biometric data of a wearer, and includes a plurality of heart rate sensor electrodes and currents from the plurality of heart rate sensor electrodes. Obtained from a heart rate information acquisition unit comprising an amplification unit for amplification, a wear detection unit for detecting whether or not a user is wearing a device, biometric data obtained from the heart rate information acquisition unit, and the wear detection unit And a storage unit that stores data relating to wearing / non-wearing as biometric / state correspondence data in association with each other.

  The invention according to claim 2 is the portable information terminal device according to claim 1, further comprising a posture detection unit that detects the posture of the user, and data relating to the posture acquired from the posture detection unit is also provided. The biometric / state correspondence data is included in the storage unit and stored in the storage unit.

  The invention according to claim 3 is the portable information terminal device according to claim 1 or 2, further comprising an operation detection unit that detects a user's operation, and an operation acquired from the operation detection unit. The data relating to is included in the biological / state correspondence data and stored in the storage unit.

  An invention according to claim 4 is the portable information terminal device according to any one of claims 1 to 3, further comprising a position information acquisition unit that acquires a location of the device, and the position information acquisition Data relating to position information acquired from the unit is included in the biological / state correspondence data and stored in the storage unit as the biological / state / position correspondence data.

  The invention according to claim 5 is the portable information terminal device according to any one of claims 1 to 4, wherein the living body / state correspondence data or the living body / state / position correspondence data is communicated to the outside. It has an external communication output unit for outputting.

  The invention according to claim 6 is the portable information terminal device according to any one of claims 1 to 5, wherein the biometric data acquired by the heart rate information acquisition unit is a heart rate of a user wearing the mobile phone. Number and ECG data.

  The invention according to claim 7 is the portable information terminal device according to claim 5 or claim 6, wherein the call form on the receiving side that receives the communication output from the external communication output unit is the state of the biometric data It changes according to.

  According to the portable information terminal device of the present invention, it is possible to easily measure and record biological information corresponding to the state of the user with almost no physical and time constraints in the daily life of the user. . Further, according to the portable information terminal device of the present invention, it is possible to perform health management and biological information management with peace of mind in cooperation with a home, a medical center, a management center, a home server, and the like using a transmission / reception function. In addition, according to the portable information terminal device of the present invention, it is possible to acquire log data in which user status information is associated with biological information and position information, so that more accurate health management is performed. Can do.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an external perspective view of a portable information terminal device according to an embodiment of the present invention, and FIG. 2 is a diagram schematically showing a block configuration of the portable information terminal device according to the embodiment of the present invention. In the present embodiment, a mobile phone is described as an example of the portable information terminal device, but the portable information terminal device of the present invention includes a portable information device such as a PDA. 1 and 2, 100 is a mobile phone, 200 is a determination processing unit, 300 is a heart rate information acquisition unit, 310 to 340 are heart rate sensor electrodes, 400 is a wearing / posture / motion detection unit, 410 is a 3D motion sensor, 420 Is a G sensor, 430 is a gyro sensor, 440 and 450 are strain gauges, 500 is a position information acquisition unit, 510 is a GPS positioning unit, 600 is an input / output unit, 610 is a display, 620 is a speaker, 630 is a key input unit, 640 Is a microphone, 700 is an external communication output unit, 710 is a communication I / F unit, 720 is a communication line unit, 730 is a vehicle control / information I / F unit, 800 is a storage unit, 810 is a living body / motion / position information recording log 820 indicate personal information and PIM, respectively.

  The mobile phone 100 according to the present embodiment includes a heartbeat information acquisition unit 300, a wearing / posture / motion detection unit 400, a position information acquisition unit 500, and an input / output unit 600, in addition to a configuration for a call as a normal mobile phone. , An external communication output unit 700 and a storage unit 800.

  1A shows a state where the hinge structure portion of the mobile phone 100 is opened, and FIG. 1B shows a state where the hinge structure portion of the mobile phone 100 is closed. Heart rate sensor electrodes 310 to 340 are provided on the front and back of the exterior when the hinge structure portion of the mobile phone 100 is closed, and the user puts the mobile phone 100 in a chest pocket or the like to carry the mobile phone 100 Sometimes (when the user wears the mobile phone 100), the heart rate sensor electrodes 310 and 320 or the heart rate sensor electrodes 330 and 340 come into contact with the user's chest. The heart rate sensor electrodes 310 to 340 are configured to acquire information (heart rate / electrocardiogram) and the like related to the heart of the user wearing the mobile phone 100, and include, for example, capacitive electrodes. As such a capacitive electrode, for example, those described in JP-A-2005-511174 can be used.

  In addition, strain gauges 440 and 450 are provided on the exterior portion of the mobile phone 100 so as to be partially exposed, and the user is wearing the mobile phone 100 by detecting the pressing force (pressure) on the mobile phone 100. It is used as information related to whether or not Further, inside the mobile phone 100, sensors such as a G sensor 420 and a gyro sensor 430 as a 3D motion sensor 410 are provided, and are used in a form described later.

  In the block diagram of the portable information terminal device according to the embodiment of the present invention shown in FIG. 2, the determination processing unit 200 is an electronic control unit, which is a ROM holding a CPU and a program operating on the CPU, and a work area of the CPU. This is a general-purpose information processing mechanism including a RAM.

  The heart rate information acquisition unit 300 includes heart rate sensor electrodes 310 to 340 and an amplification unit that amplifies a weak current collected from these electrodes, and is a heart rate that is information related to the heart of the user wearing the mobile phone 100. Get number and ECG data. Respiratory rate data can also be obtained by analyzing the acquired heart rate or electrocardiogram data.

  The wearing / posture / motion detection unit 400 includes a G sensor 420 (acceleration watch), a gyro sensor 430, strain gauges 440 and 450, which are 3D motion sensors 410, and a processing unit for signals acquired by these sensors. The wearing / posture / motion detecting unit 400 has a wearing detection function for detecting whether the user of the mobile phone 100 is wearing the mobile phone 100 or not. Also, the wearing / posture / motion detection unit 400 has a posture detection function for detecting what posture (sleeping or waking up) the user wearing the mobile phone 100 is. In addition, the wearing / posture / motion detecting unit 400 has an operation detecting function for detecting what kind of operation the user wearing the mobile phone 100 is performing.

  The position information acquisition unit 500 acquires the location (position information) of the mobile phone 100. As such a configuration, the mobile phone 100 of the present invention uses a GPS positioning unit 510 that receives a GPS signal from a GPS satellite and calculates its own position. The portable information terminal device of the present invention can use other positioning methods without using such a GPS positioning method as long as it can acquire position information.

  The input / output unit 600 constitutes an input / output interface of the mobile phone 100, and includes a display 610 that displays characters, graphics, and image information, a speaker 620 that outputs sound, and a key input unit 630 that inputs characters. And a microphone 640 for inputting voice. The input / output unit 600 is not limited to the above configuration, and other man-machine interface mechanisms can be used.

  The external communication output unit 700 is a communication output unit for transmitting biometric data acquired by the mobile phone 100 to the outside. The communication I / F unit 710 is a communication interface such as a wireless LAN or Bluetooth, the communication line unit 720 is a call line of the mobile phone 100, and the vehicle control / information I / F unit 730 is, for example, This is an interface for communicating with an in-vehicle LAN mounted on a vehicle or the like or an in-vehicle navigation system. The external communication output unit 700 configured as described above transmits information on the biological / motion / position information recording log 810 to the management center, and outputs an alarm and emergency occurrence information when there is an abnormality in the biological information. To do.

The storage unit 800 includes a relatively large-capacity storage device such as a hard disk, and includes a living body / operation / position information recording log 810 and personal information / PIM 820.
The living body / motion / position information recording log 810 includes data related to the user's wearing state / posture state / motion state acquired by the mounting / posture / motion detection unit 400, and position information acquired by the position information acquisition unit 500. The biometric data acquired by the heart rate information acquisition unit 300 is recorded in association with each other. The personal information / PIM 820 is a personal information file of a user who uses the mobile phone 100 or a personal information manager. Here, the personal information file is basic information (average heartbeat (learning from past history), heart rate determination threshold, medical history, doctor contact information) that can be held by the user. In addition, in this personal information file, consent information for automatic information transmission described later can be preset.

  Next, the operation of the mobile phone 100 configured as described above will be described. FIG. 3 is a flowchart related to the processing of the portable information terminal device (mobile phone 100) according to the embodiment of the present invention. In the flowchart of FIG. 3, when the mobile phone 100 is turned on and processing is started in step S <b> 100, the process proceeds to step S <b> 101 and the user's personal information file is read from the personal information / PIM 820. A setting change interrupt or the like can be executed between step S100 and step S101 as necessary.

  The setting change interrupt is for accepting a reset or change of the personal information by the key input unit 630. Such a change operation can be performed by remote operation through communication or GUI display on the screen of the display 610.

  In step S102, it is determined whether or not the operation is continued. If the decision result in the step S102 is NO, the process advances to a step S117 to end the process. If the decision result in the step S102 is YES, the process advances to a step S103.

  In step S103, attachment detection is performed. FIG. 4 is a diagram for explaining mounting detection in the mounting / posture / motion detection unit 400 of the portable information terminal device (mobile phone 100) according to the embodiment of the present invention. In the detection of the mounting of the mobile phone 100 according to the present invention, as shown in FIG. 4, for example, whether or not there is a main body in a breast pocket is detected by using the weight of the main body with the strain gauges 440 and 450.

  Next, in step S104, body movement detection is performed. FIG. 5 is a diagram for explaining posture detection in the mounting / posture / motion detection unit 400 of the portable information terminal device (mobile phone 100) according to the embodiment of the present invention, and FIG. 6 relates to the embodiment of the present invention. It is a figure explaining the operation | movement detection in the mounting | wearing / attitude | pose / motion detection part 400 of a portable information terminal device (cellular phone 100). As shown in FIGS. 4 and 5, in the body motion detection, information such as whether or not the user wearing the mobile phone 100 is moving or is walking is used as G sensor 420. (Acceleration sensor) and gyro sensor 430 detect.

  Next, in step S <b> 105, biometric data is read from the heart rate information acquisition unit 300. Here, the reading of the biological data is to read the electrocardiogram and the heartbeat data (electrocardiogram / heart rate) from the heartbeat sensor electrodes 310 to 340. At this time, if it cannot be read due to disturbance noise or an error, it is recorded that it has not been measured.

  In step S <b> 106, the position information is read from the position information acquisition unit 500. In this step, the current location and time of the mobile phone 100 are read based on GPS information from the GPS positioning unit 510.

  Next, step S107 is a step in which log data is edited and recorded. The log data editing & recording step includes the user status information acquired in steps S103 and S104, the biometric data read in step S105, the position information data and date / time data read in step S106. The log is linked to the original and recorded in the living body / motion / position information recording log 810 as log data. Further, when PIM application software is installed in the mobile phone 100 terminal, it is possible to associate the PIM information with the personal information / PIM 820 with the date / time data.

  Next, in step S108, the state of mind and body of the user wearing the mobile phone 100 is estimated. In the estimation of the state of mind and body in step S108, an emergency state or the like is estimated from electrocardiogram and heart rate data which are biological data. Respiratory rate data may also be used to estimate emergency conditions. In this step, in order to absorb individual differences, it is desirable to use personal information + absolute value as the determination threshold. Such individual differences can be absorbed by setting the personal information file.

  Next, in step S109, it is determined from the estimated mind-body state whether or not the mind-body condition is abnormal. The condition (abnormal condition) for determination in step S109 is to determine whether or not the result of determining the psychosomatic state is an emergency situation.

  If the result of determination in step S109 is N (that is, there is no problem with the mind and body state), the process returns to step S102. If the result of determination in step S109 is Y (that is, a problem has occurred in the mind and body state), the process proceeds to step S110.

  In step S110, a message is output to the display 610 and the speaker 620 for user status confirmation. Such a message asks the user himself / herself for a confirmation response in the event of an emergency, and prevents errors due to malfunction or disturbance by this step.

  In step S111, it is determined whether the person is good. The principal good response in this step is a confirmation response by the user himself / herself that the state of the user himself / herself is good.

  The user responds if there is no problem with his / her health. That is, this case is a case where Y is determined in step S111. If it determines with Y in step S111, it will return to step S102.

  If the user is aware that there is a problem with the person's health, the answer is N in step S111, and the process proceeds to steps S112 and subsequent steps related to an emergency. Further, even when the response does not remain due to a physical abnormality, after waiting for a certain time, the process proceeds to a step of automatically making an emergency call by setting N in step S111. Such a certain number of hours and whether or not to proceed automatically can be set in advance in the personal information file.

  In step S112, it is determined whether or not there is a communication notification setting in the personal information file setting. When the result of determination in step S112 is N, the process proceeds to step S115, and when it is Y, the process proceeds to step S113.

  In step S113, if there is a communication notification setting in the personal information file setting, a telephone contact is made to a pre-registered contact. If the automatic operation is agreed in advance as a personal information file, it is automatically performed. In step S113, information on alarm / emergency occurrence is output. For this purpose, data editing at the time of communication is performed. A process of changing the ringing tone according to the degree of urgency is performed. In this way, the called party can grasp the approximate contents at the same time as the incoming call. Even if the person is in a physical condition that cannot be answered or answered, an emergency can be notified. The contact information registered in advance may be a home, a medical center, a management center, a home server, or the like.

  When making a telephone contact to a registered contact, a setting is made to change the ringing (incoming) sound and volume to a predetermined one by the personal information file. According to such a setting, a person who has received a call at a remote location can intuitively determine the details of the data based on the meaning and symbolism of the ringing tone, and can immediately cope with an emergency state. Further, such a telephone contact may be made to a home, a medical center, a management center, a home server, etc. by a personal information file.

  In step S114, log information output processing is performed. Log data for such log information output processing includes log data acquired in the middle determination processing B), real-time biometric data, and the like, which are transmitted to a medical center, a management center, a home server, and the like.

  E) Steps S115 and S116, which are vehicle control notification processes, are optional predetermined. These steps are premised on vehicles equipped with intelligent functions such as vehicle computers, in-vehicle LANs, and navigation systems.

  In step S115, it is determined whether or not the user wearing the mobile phone 100 is in the vehicle, and it is determined whether or not an emergency has occurred in the vehicle. As such a determination processing method, a function of remote communication (used for hands-free phone etc.) between the mobile phone 100 main body and the vehicle side by Bluetooth communication can be used.

  If the result of determination in step S115 is N, the process proceeds to step S102, and if Y, the process proceeds to subsequent step S116.

  In step S116, a notification signal is output to the vehicle stop control. When the occurrence of an emergency is in a vehicle, signal information is output to the vehicle in order to safely stop the vehicle in an emergency. This signal is used as information for car navigation for safely stopping the vehicle, a vehicle stabilization control system for stabilizing the vehicle, and a side slip prevention device.

  As described above, according to the portable information terminal device of the present invention, it is possible to easily measure and record the biological information corresponding to the user's state with almost no physical and temporal constraints in the daily life of the user. I can do it. Further, according to the portable information terminal device of the present invention, it is possible to perform health management and biological information management with peace of mind in cooperation with a home, a medical center, a management center, a home server, and the like using a transmission / reception function. In addition, according to the portable information terminal device of the present invention, it is possible to acquire log data in which user status information is associated with biological information and position information, so that more accurate health management is performed. Can do.

1 is an external perspective view of a portable information terminal device according to an embodiment of the present invention. It is a figure which shows the outline of a block structure of the portable information terminal device which concerns on embodiment of this invention. It is a figure which shows the flowchart regarding the process of the portable information terminal device which concerns on embodiment of this invention. It is a figure explaining mounting | wearing detection in the mounting | wearing / attitude | position / motion detection part 400 of the portable information terminal device (cellular phone 100) which concerns on embodiment of this invention. It is a figure explaining the attitude | position detection in the mounting | wearing / attitude | position / motion detection part 400 of the portable information terminal device (cellular phone 100) which concerns on embodiment of this invention. It is a figure explaining the operation | movement detection in the mounting | wearing / attitude | pose / motion detection part 400 of the portable information terminal device (cellular phone 100) which concerns on embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Mobile phone, 200 ... Judgment processing part, 300 ... Heart rate information acquisition part, 310-340 ... Heart rate sensor electrode, 400 ... Wearing / posture / motion detection part, 410 ... 3D motion sensor, 420 ... G sensor, 430 ... gyro sensor, 440,450 ... strain gauge, 500 ... position information acquisition unit, 510 ... GPS positioning unit, 600 ... input / output 610 ... Display, 620 ... Speaker, 630 ... Key input unit, 640 ... Microphone, 700 ... External communication output unit, 710 ... Communication I / F unit, 720 ...・ Communication line unit, 730 ... Vehicle control / information I / F unit, 800 ... storage unit, 810 ... biological / motion / position information recording log, 820 ... personal information / PIM

Claims (7)

A portable information terminal device that acquires wearer's biometric data,
A heart rate information acquisition unit comprising a plurality of heart rate sensor electrodes and an amplifying unit for amplifying currents from the plurality of heart rate sensor electrodes;
A wearing detection unit that detects whether or not the user is wearing a device;
And a storage unit that stores the biometric data acquired from the heartbeat information acquisition unit and the wear / non-wearing data acquired from the mounting detection unit in association with each other and stored as biometric / state correspondence data. Portable information terminal equipment. 2. The apparatus according to claim 1, further comprising an attitude detection unit that detects a user's attitude, and data related to the attitude acquired from the attitude detection unit is included in the biological / state correspondence data and stored in the storage unit. The portable information terminal device described in 1. 2. A motion detection unit for detecting a user's motion, wherein data relating to the motion acquired from the motion detection unit is included in the biological / state correspondence data and stored in the storage unit. Or the portable information terminal device of Claim 2. A position information acquisition unit that acquires the location of the device is included, and the data related to the position information acquired from the position information acquisition unit is included in the biological / state correspondence data, and the biological / state / position correspondence data The portable information terminal device according to any one of claims 1 to 3, wherein the portable information terminal device is stored in the storage unit. The portable information terminal device according to any one of claims 1 to 4, further comprising an external communication output unit that outputs the biological / state correspondence data or the biological / state / position correspondence data to the outside. The portable information terminal device according to any one of claims 1 to 5, wherein the biometric data acquired by the heart rate information acquisition unit is a heart rate and electrocardiogram data of a user wearing a mobile phone. The portable information terminal device according to claim 5 or 6, wherein a call form on a receiving side that receives a communication output from the external communication output unit is changed according to a state of biometric data.

Images