WO2018003751A1

WO2018003751A1 - Living body monitoring device, living body monitoring method, and living body monitoring system

Info

Publication number: WO2018003751A1
Application number: PCT/JP2017/023431
Authority: WO
Inventors: 真和岡田; 将司古後
Original assignee: コニカミノルタ株式会社
Priority date: 2016-06-29
Filing date: 2017-06-26
Publication date: 2018-01-04
Also published as: JP6930536B2; JPWO2018003751A1

Abstract

According to the present invention, an acquisition unit acquires a biological signal for a monitored person that is being monitored. On the basis of the biological signal acquired by the acquisition unit, a detection unit detects whether the breathing of the monitored person is abnormal. When the detection unit has detected a breathing abnormality for the monitored person, a processing unit makes a storage unit store images of the monitored person that were captured by an imaging unit 12 during a span of time that includes the time at which the breathing abnormality was detected.

Description

Biological monitoring device, biological monitoring method, and biological monitoring system

The present invention relates to a technique for monitoring a respiratory abnormality of a monitored person, for example, a person who needs nursing or a person who needs care (hereinafter referred to as a nurse who needs nursing) as a monitored person.

Japan (Japan) is an aging society due to the improvement of living standards accompanying the post-war high economic growth, the improvement of sanitation environment and the improvement of medical standards, and more specifically the ratio of the population over 65 years old to the total population It is a super-aging society with an aging rate exceeding 21%. According to the statistics of September 2013, the elderly population is about 3.186 million, the aging rate is 25.0%, and 1 in 4 people are elderly. And in 2035, the population of elderly people is estimated to be about 37.41 million, and one in three people will be elderly people (Statistics Bureau, Ministry of Internal Affairs and Communications, Japan). In such an aging society, an increase in the number of nurses requiring medical attention due to illness, injury, aging, etc. is expected, compared to a normal society that is not an aging society.

Such nurses are required to enter hospitals and other facilities such as welfare facilities for the elderly (such as short-term welfare facilities for the elderly, nursing homes for the elderly and special nursing homes for the elderly under Japanese law) and receive nursing care. In facilities such as hospitals and welfare facilities for the elderly, for example, those who need nursing care such as nurses or caregivers, etc. Nurses, etc.) confirm their safety by periodically patrols. However, since the number of nurses and the like is reduced in the quasi-night shift and night shift hours compared to the day shift hours, the work load per person increases, and therefore the work load must be reduced. For this reason, in recent years, a monitored person monitoring device that monitors (monitors) a patient who needs nursing is monitored and developed.

Examples of techniques related to monitoring of a monitored person include a living body monitoring apparatus that monitors the living body of the monitored person and a posture detection apparatus that detects the posture of the monitored person. As the former, for example, Patent Document 1 generates movement amount waveform data by performing image processing on images (frames) continuously projected by projecting infrared rays onto a person to be monitored. An apparatus for detecting respiratory abnormality of a monitored person using movement amount waveform data is disclosed. As the latter, for example, Patent Document 2 discloses a detection unit that irradiates a person to be monitored with microwaves and detects a microwave reflected by the person to be monitored, and a respiratory component included in the microwaves detected by the detection unit. Disclosed is an apparatus for detecting a sleeping posture of a monitored person, comprising: an extracting unit for extracting; and a determining unit for determining a body position during sleep based on a signal intensity of a respiratory component extracted by the extracting unit. ing.

When the monitored person has a respiratory abnormality, information regarding the posture of the monitored person sleeping, and the face direction, jaw direction, and mouth direction (hereinafter referred to as the face direction) of the monitored person is as follows: This is important information for investigating the cause of respiratory abnormalities and coping with respiratory abnormalities (for example, securing the airway). Specifically, sleep apnea syndrome, which is a type of respiratory abnormality, is caused by the fact that when the human is sleeping in a supine posture, the tongue sinks into the throat due to gravity, causing the airway to be blocked. It is supposed to be. When sleep apnea syndrome occurs, the posture of the monitored person and the orientation of the face of the monitored person are information for investigating the cause of sleep apnea syndrome. Therefore, a technique is desired that can acquire such information when respiratory abnormality of the monitored person is detected.

JP 2002-175582 A JP 2014-207934 A

An object of the present invention is to provide a living body monitoring apparatus, a living body monitoring method, and a living body monitoring system capable of acquiring information related to the posture of the monitored person and the orientation of the face and the like when a respiratory abnormality of the monitored person is detected. Is to provide.

The living body monitoring apparatus according to the first aspect of the present invention includes an acquisition unit, a detection unit, a storage unit, and a processing unit. The acquisition unit acquires a biological signal of a monitored person to be monitored. The detection unit detects whether or not the monitored person's breathing is abnormal based on the biological signal acquired by the acquisition unit. The processing unit is configured to display the image of the monitored person captured by the imaging unit during a time period including when the abnormal breathing of the monitored person is detected by the detecting unit. It memorize | stores in the said memory | storage part.

The above and other objects, features and advantages of the present invention will become apparent from the following detailed description and the accompanying drawings.

It is explanatory drawing explaining the structure of the to-be-monitored person monitoring system which concerns on embodiment. It is a schematic diagram which shows the living room where the sensor apparatus is arrange | positioned. It is a block diagram which shows the structure of the sensor apparatus with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is explanatory drawing explaining various respiration waveform patterns. It is a block diagram which shows the structure of the portable terminal device with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is a block diagram which shows the structure of the management server apparatus with which the to-be-monitored person monitoring system which concerns on embodiment is equipped. It is a flowchart explaining the abnormal breathing detection and image recording which are performed by the monitored person monitoring system concerning an embodiment. It is a block diagram which shows the structure of the sensor apparatus with which the modification 1 is equipped. 12 is a flowchart for explaining respiratory abnormality detection and image recording executed by the monitored person monitoring system according to Modification 1. It is a block diagram which shows the structure of the sensor apparatus with which the modification 2 is equipped. It is a block diagram which shows the structure of the management server apparatus with which the modification 2 is equipped.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the structure which attached | subjected the same code | symbol shows that it is the same structure, The description is abbreviate | omitted about the content which has already demonstrated the structure. In this specification, when referring generically, it shows with the reference symbol which abbreviate | omitted the suffix, and when referring to an individual structure, it shows with the reference symbol which attached | subjected the suffix.

The monitored person monitoring system according to the embodiment is a system that monitors a monitored person to be monitored (in other words, a watching target person to be watched over) using a plurality of devices, and a terminal device And a monitored person monitoring device that is connected to the terminal device so as to be communicable, detects a predetermined event (event) related to the monitored person, and notifies the terminal device of the event. The monitored person monitoring device may be integrally configured by a single device. However, in this specification, the monitored person monitoring device is connected to the sensor device and the sensor device and the terminal device so as to communicate with each other. By providing the management server device, the two types of devices are configured separately. The sensor device detects the predetermined event related to the monitored person and notifies (reports or transmits) the management server device. Upon receiving the notification from the sensor device, the management server device manages the event that has received the notification, and re-notifies the event to a predetermined terminal device associated with the sensor device. Send. Although the terminal device may be one type of device, in the present specification, the terminal device is two types of devices, a fixed terminal device and a mobile terminal device. The main difference between these fixed terminal devices and portable terminal devices is that the fixed terminal device is fixedly operated, and the portable terminal device is operated by being carried by a supervisor NS (user) such as a nurse or a caregiver. Is a point. Since the fixed terminal device and the mobile terminal device are substantially the same, the mobile terminal device will be mainly described below.

FIG. 1 is an explanatory diagram illustrating a configuration of a monitored person monitoring system MS according to the embodiment. More specifically, the monitored person monitoring system MS includes, for example, one or a plurality of sensor devices SU (SU-1 to SU-4), a management server device SV, a fixed terminal device SP, and one or a plurality of ones. It includes a portable terminal device TA (TA-1, TA-2) and a private branch exchange (PBX, Private Branch eXchange) CX, which are wired or wireless, such as a network (network, communication) such as a LAN (Local Area Network). Line) Connected to be communicable via NW. The network NW may be provided with repeaters such as repeaters, bridges, and routers that relay communication signals. In the example shown in FIG. 1, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, the plurality of portable terminal devices TA-1, TA-2, and the private branch exchange CX include an L2 switch. Are connected to each other by a wired / wireless LAN (for example, a LAN in accordance with the IEEE 802.11 standard) NW including the LS and the access point AP. More specifically, the plurality of sensor devices SU-1 to SU-4, the management server device SV, the fixed terminal device SP, and the private branch exchange CX are connected to the line concentrator LS, and the plurality of portable terminal devices TA-1, TA-2. Is connected to the line concentrator LS via the access point AP. The network NW configures a so-called intranet by using Internet protocol groups such as TCP (Transmission Control Protocol) and IP (Internet Protocol). The private branch exchange CX is connected to the telephone TL via the public telephone network PN.

The monitored person monitoring system MS is arranged at an appropriate place according to the monitored person Ob. The monitored person Ob is, for example, a person who needs nursing due to illness or injury, a person who needs care due to a decrease in physical ability, or a single person living alone. In particular, from the viewpoint of enabling early detection and early action, the monitored person Ob may be a person who needs the detection when a predetermined unfavorable event such as an abnormal state occurs in the person. preferable. For this reason, the monitored person monitoring system MS is suitably arranged in a building such as a hospital, a welfare facility for the elderly, and a dwelling unit according to the type of the monitored person Ob. In the example illustrated in FIG. 1, the monitored person monitoring system MS is disposed in a building of a care facility that includes a plurality of rooms RM in which a plurality of monitored persons Ob live and a plurality of rooms such as a nurse station.

The sensor device SU has a communication function that communicates with other devices SV, SP, TA via the network NW, detects a predetermined event related to the monitored person Ob, and sends the detected event to the management server device SV. To the terminal devices SP and TA, generate an image including a moving image, and distribute the moving image to the terminal devices SP and TA. The predetermined event preferably includes an event that needs to be dealt with.

FIG. 1 shows four first to fourth sensor devices SU-1 to SU-4 as an example, and the first sensor device SU-1 is one of the monitored persons Ob. The second sensor device SU-2 is arranged in a room RM-2 (not shown) of Mr. B Ob-2 who is one of the monitored persons Ob. The third sensor device SU-3 is disposed in the room RM-3 (not shown) of Mr. C Ob-3, one of the monitored subjects Ob, and the fourth sensor device SU-4 It is arranged in the room RM-4 (not shown) of Mr. D Ob-4, one of the monitored persons Ob.

The management server device SV has a communication function that communicates with other devices SU, SP, TA via the network NW, and receives a notification of a predetermined event related to the monitored person Ob from the sensor device SU. It is a device that manages information related to monitoring Ob (monitoring information). When the management server device SV receives the first event notification communication signal from the sensor device SU as the event notification, the management server device SV relates to the monitoring of the monitored person Ob based on each information accommodated in the first event notification communication signal. A predetermined terminal device that stores (records) monitoring information and associates a communication signal (second event notification communication signal) containing the monitoring information related to monitoring of the monitored person Ob in advance with the sensor device SU. Send to SP, TA. For this purpose, the management server device SV indicates the notification destination (re-notification destination, re-notification destination, transmission destination) such as the first event notification communication signal transmitted from the sensor device SU and the notification of the sensor ID that is the transmission source. A correspondence relationship (notification destination correspondence relationship) with a terminal (re-notification destination) terminal ID and a communication address thereof are stored. The terminal ID (terminal device identifier) is an identifier for identifying and identifying the terminal devices SP and TA. Then, the management server device SV provides the client with data corresponding to the request of the client (in this embodiment, the fixed terminal device SP and the portable terminal device TA). Such a management server device SV can be configured by, for example, a computer with a communication function.

The fixed terminal device SP is a device that functions as a user interface (UI) of the monitored person monitoring system MS. In order to achieve this function, the fixed terminal device SP transmits a communication function for communicating with other devices SU, SV, TA via the network NW, a display function for displaying predetermined information, and predetermined instructions and data. An input function or the like is provided, and predetermined instructions and data to be given to the management server device SV and the portable terminal device TA are input, or monitoring information obtained by the sensor device SU is displayed. Such a fixed terminal device SP can be configured by, for example, a computer with a communication function.

The supervisor NS is carrying the portable terminal device TA. The mobile terminal device TA communicates with other devices SV, SP, SU via the network NW, a display function for displaying predetermined information, an input function for inputting predetermined instructions and data, and a voice call. A monitoring function (including a moving image) obtained by the sensor device SU by inputting a predetermined instruction and data to be provided to the management server device SV and the sensor device SU or by notification from the management server device SV. This is a device for displaying or making a nurse call response or calling by voice call with the sensor device SU.

The sensor device SU will be described in detail. The sensor device SU detects the abnormal breathing of the monitored person Ob in addition to the functions described above (for example, the function of generating a moving image of the monitored person Ob, the function of performing a voice call with the terminal devices SP and TA). By doing so, it has a function of monitoring the living body of the monitored person Ob. The sensor device SU will be described in detail from the viewpoint of this function. FIG. 2 is a schematic diagram showing a living room RM in which the sensor device SU is arranged. In the living room RM, the bed 1 of the monitored person Ob is provided. The bed 1 is a futon 5 laid on the bed 3. The bed 1 is not limited to this, and may be, for example, a futon 5 laid in a tatami mat or a futon 5 laid on the floor. FIG. 2 shows a state in which the monitored person Ob is sleeping on the bed 1, and only the head of the monitored person Ob appears in the body of the monitored person Ob. A sensor device SU is attached to the ceiling 7 of the living room RM.

FIG. 3 is a block diagram illustrating a configuration of the sensor device SU provided in the monitored person monitoring system MS according to the embodiment. The sensor device SU (biological monitoring device, respiratory abnormality detection device) includes a Doppler sensor unit 10, a respiratory abnormality detection unit 11, an imaging unit 12, an imaging control unit 13, an image recording unit 14, and a sensor side control processing unit (SU control processing unit). ) 15 and a sensor-side communication interface unit (SU communication IF unit) 16. In FIG. 2, among the blocks constituting the sensor device SU, the imaging unit 12 and the Doppler sensor unit 10 are shown, and the other blocks are omitted.

The Doppler sensor unit 10 is a device that detects a biological signal of the monitored person Ob. The Doppler sensor unit 10 functions as an acquisition unit and acquires a biological signal of the monitored person Ob. The Doppler sensor unit 10 is a body motion sensor that transmits a transmission wave, receives a reflection wave of a transmission wave reflected by an object, and outputs a Doppler signal DS of a Doppler frequency component based on the transmission wave and the reflection wave. When the object is moving, the frequency of the reflected wave is shifted in proportion to the moving speed of the object due to the so-called Doppler effect, so that a difference (Doppler frequency component) occurs between the frequency of the transmitted wave and the frequency of the reflected wave. The Doppler sensor unit 10 generates a Doppler frequency component signal as a Doppler signal DS. The transmission wave may be an ultrasonic wave, a microwave, or the like, but is a microwave in the embodiment. Since the microwave can be transmitted through the clothing and reflected from the body surface of the monitored person Ob, the movement of the body surface can be detected even when the monitored person Ob is wearing clothes.

Referring to FIG. 2, the Doppler sensor unit 10 is installed on the ceiling surface above the bed 3 used by the monitored person Ob. The installation location of the Doppler sensor unit 10 is not limited to this, and the Doppler sensor unit 10 may be installed, for example, under the mat of the bed 3 used by the monitored person Ob, 3 may be installed at a position where a transmission wave is transmitted from the direction of the side 3 toward the monitored person Ob.

3, the respiratory abnormality detection unit 11 includes a waveform generation unit 111, a waveform pattern selection unit 112, and a coincidence determination unit 113. The respiratory abnormality detection unit 11 functions as a detection unit. The detection unit detects whether or not respiration of the monitored person Ob is abnormal based on the biological signal acquired by the acquisition unit (Doppler sensor unit 10).

The waveform generation unit 111 extracts a respiratory signal component from the Doppler signal DS output by the Doppler sensor unit 10 using wavelet analysis or the like. The waveform generation unit 111 generates a respiration signal indicating the relationship between time and signal intensity using the respiration signal component. The waveform of this breathing signal indicates the breathing state of the monitored person Ob. As described above, the waveform generation unit 111 functions as a generation unit, and generates a respiratory signal indicating the respiratory state of the monitored person Ob using the biological signal acquired by the acquisition unit (Doppler sensor unit 10).

The respiratory waveform pattern indicated by the respiratory signal will be described. FIG. 4 is an explanatory diagram for explaining various respiratory waveform patterns P. FIG. 4 shows a respiratory waveform pattern PA for normal breathing, a respiratory waveform pattern PB for stopping breathing, a respiratory waveform pattern PC for sleep apnea syndrome, a respiratory waveform pattern PD for slow breathing, and a tachypnea Respiratory waveform pattern PE, respiratory waveform pattern PF of hypopnea, respiratory waveform pattern PG of hyperpnea, respiratory waveform pattern PH of Chainstalk breath, respiratory waveform pattern PI of Kusmaul breath, and The respiratory waveform pattern PJ of ataxic breathing (Biot breathing) is shown.

Except for the normal respiratory waveform pattern PA, the respiratory waveform pattern P is abnormal respiratory. The respiration waveform pattern P of abnormal breathing has a different waveform pattern. In the respiratory waveform pattern PB of the respiratory stop, the state where the respiratory waveform is flat continues. When the state where the respiration waveform is flat continues, the respiration abnormality detection unit 11 determines that respiration is stopped. Whether or not a respiratory abnormality other than respiratory arrest is determined is determined using pattern matching described later. There are eight types of respiratory waveform patterns P of respiratory abnormalities to be subjected to pattern matching (respiratory waveform pattern PC to respiratory waveform pattern PJ). These respiration waveform patterns P are specific examples of a plurality of respiration waveform patterns indicating each of a plurality of types of respiration abnormalities.

If there are many types of respiratory waveform patterns of respiratory abnormalities that are subject to pattern matching, there is a high possibility of misjudgment in pattern matching because there are similar patterns among these respiratory waveform patterns. Become. The misjudgment includes determining normal breathing but abnormal breathing, and wrongly determining the type of respiratory abnormality. The former causes unnecessary rushing of the supervisor NS, and the latter causes a delay in coping with respiratory abnormalities. Therefore, in the embodiment, there is a possibility of erroneous determination in pattern matching by reducing the types of respiratory waveform patterns of respiratory abnormalities to be subjected to pattern matching based on the index indicating the health state of the monitored subject Ob. Lower.

It is known that the index indicating the health condition of the monitored person Ob and the type of respiratory abnormality are related. The index indicating the health condition will be described taking weight as an example. It has been found that if there is a large amount of weight loss, one of slow breathing, chain stalk breathing, and ataxic breathing (Biot breathing) is likely, and the possibility of other types of respiratory abnormalities is low. The present inventor created an example of a table showing the relationship between the index indicating the health condition of the monitored person Ob and the type of respiratory abnormality. This is shown in Table 1. The index indicating the health state is exemplified by body temperature, weight, blood pressure, meal amount, and sleep time.

When the body temperature during the day is high (for example, 37.5 degrees or more), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is a respiratory waveform pattern PE (tachypnea). When the body temperature during the day is low (for example, 35.5 degrees or less), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is a respiratory waveform pattern PE (tachypnea) and a respiratory waveform pattern. PG (hyperventilation). The body temperature during the day is a body temperature measured at a time when the monitored person Ob is waking up except during sleep. In general, the body temperature of the monitored person Ob is measured after breakfast, before bathing (around 15:00) and after dinner at a welfare facility for the elderly.

When the body weight has decreased (for example, when the body weight has decreased by 10% or more compared to one month ago), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is the respiratory waveform pattern PD. (Slow breathing), respiratory waveform pattern PH (chain stalk breathing), and respiratory waveform pattern PJ (ataxic breathing (Biot breathing)). When the body weight is increased (for example, when the body weight is increased by 10% or more compared to one month ago), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is the respiratory waveform pattern PC. (Sleep Apnea Syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PI (Kusmaul breath).

When the blood pressure is reduced (for example, when the normal diastolic blood pressure (minimum blood pressure) is reduced by 10% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching Are respiratory waveform pattern PD (slow breathing), respiratory waveform pattern PE (tachypnea), respiratory waveform pattern PH (chain stalk breathing), and respiratory waveform pattern PJ (ataxic breathing (Biot Breathing)). When the blood pressure increases (for example, when the normal systolic blood pressure (maximum blood pressure) increases by 10% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality that is the target of pattern matching Are a respiratory waveform pattern PC (sleep apnea syndrome), a respiratory waveform pattern PF (hypopnea), and a respiratory waveform pattern PI (Kusmaul breath).

When the amount of meal is decreasing (for example, when it is decreased by 20% or more compared to 3 days ago), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is the respiratory waveform pattern PD (slow Breathing), breathing waveform pattern PE (tachypnea), breathing waveform pattern PH (chain stalk breathing), and breathing waveform pattern PJ (ataxic breathing (Biot breathing)).

When the sleep time is reduced (for example, when the sleep time is reduced by 20% or more compared to one week ago), the respiratory waveform pattern P of the respiratory abnormality to be subjected to pattern matching is the respiratory waveform pattern P−. C (sleep apnea syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PG (hyperventilation).

As described above, the types of respiratory waveform patterns P to be subjected to pattern matching can be reduced based on the index indicating the health state of the monitored subject Ob.

Referring to FIG. 3, waveform pattern selection unit 112 selects one of respiratory waveform pattern PC to respiratory waveform pattern PJ based on the result of determination by condition determination unit 32 (FIG. 6) described later. Then, one or more respiratory waveform patterns P to be subjected to pattern matching are selected. Respiration waveform pattern PC to respiration waveform pattern PJ are specific examples of a plurality of waveform patterns indicating each of a plurality of types of respiratory abnormalities. With reference to FIG. 4 and Table 1, for example, when the body temperature of the monitored subject Ob is 35.5 degrees or less, the waveform pattern selection unit 112 displays the respiratory waveform pattern PE (tachypnea) and the respiratory waveform pattern. Select PG (hyperventilation). This is because when the body temperature of the monitored person Ob is 35.5 degrees or less, there is a possibility of tachypnea or hyperpnea, but there is no possibility (almost no) of other respiratory abnormalities. As described above, the waveform pattern selection unit 112 functions as a selection unit, and uses a predetermined index serving as an index indicating the health state of the monitored person Ob, and a plurality of respiratory waveforms indicating each of a plurality of types of respiratory abnormalities. One or more respiratory waveform patterns P are selected from the patterns P.

The coincidence determination unit 113 pattern-matches the waveform of the respiratory signal generated by the waveform generation unit 111 with each of one or more respiratory waveform patterns P selected by the waveform pattern selection unit 112. Thereby, the coincidence determination unit 113 determines whether or not the waveform of the respiratory signal generated by the waveform generation unit 111 matches any one or more respiratory waveform patterns P selected by the waveform pattern selection unit 112. Thus, the coincidence determination unit 113 functions as a determination unit, and the waveform of the respiratory signal generated by the generation unit (waveform generation unit 111) and one or more selected by the selection unit (waveform pattern selection unit 112). Using the respiration waveform pattern P, it is determined whether the waveform of the respiration signal generated by the generation unit corresponds to one or more respiration waveform patterns P selected by the selection unit.

When the coincidence determination unit 113 makes a coincidence determination, the respiratory abnormality corresponding to the corresponding respiratory waveform pattern P is determined as the type of respiratory abnormality of the monitored subject Ob. The determination of slow breathing (FIG. 4) further includes the condition that the respiratory rate per minute is 9 or less. In the determination of tachypnea (FIG. 4), the condition that the respiratory rate per minute is 25 times or more is further added. In the determination of hypopnea (FIG. 4), a condition is further added in which the state in which the amplitude of the respiratory waveform is reduced to 50% or less continues for 10 seconds or more as compared with the amplitude of the respiratory waveform during normal times.

As described above, the respiratory abnormality detection unit 11 measures the respiratory rate per minute based on the respiratory signal in addition to the pattern matching, and measures the value of the amplitude of the respiratory waveform indicated by the respiratory signal. The respiratory abnormality detection unit 11 uses these to detect whether there is respiratory abnormality and to detect the type of respiratory abnormality.

The respiratory abnormality detection unit 11 includes, for example, CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), HDD (Hard Disk Drive), and the like, and the respiratory abnormality detection unit 11. This is realized by a program and data for executing the function. As for the function of the respiratory abnormality detection unit 11, some or all of the functions may be realized by processing by a DSP (Digital Signal Processor) instead of or by processing by the CPU. Similarly, part or all of the functions of the respiratory abnormality detection unit 11 may be realized by processing by a dedicated hardware circuit instead of or by processing with software. What has been described above is that the imaging control unit 13 (FIGS. 3, 8, and 10), the image recording unit 14 (FIGS. 3, 8, and 11), and the SU control processing unit 15 (FIGS. 3, 8, and 10) described later. 10), display control unit 22 (FIG. 5), TA control processing unit 24 (FIG. 5), care recording unit 31 (FIGS. 6 and 11), condition determination unit 32 (FIGS. 6 and 11), SV control processing The same applies to the section 33 (FIGS. 6 and 11).

The imaging unit 12 is an apparatus that captures an imaging target and generates an image of the imaging target. The image includes a still image and a moving image. The imaging unit 12 is arranged so as to be able to monitor a space where the monitored person Ob is scheduled (location space, in the example shown in FIG. 1, the room RM of the installation location), and the location space is taken as an imaging target from above. An image is taken and an image overlooking the imaging target is generated. Preferably, since there is a high probability that the entire monitored person Ob can be imaged, the imaging unit 12 is expected to be located at the head of the monitored person Ob in the bedding on which the monitored person Ob is lying (for example, a bed). It is arranged so that the imaging target can be imaged from directly above the preset planned head position (usually the position where the pillow is disposed). The sensor device SU uses the imaging unit 12 to acquire an image of the monitored person Ob taken from above the monitored person Ob, preferably an image taken from directly above the planned head position.

Such an imaging unit 12 may be a device that generates an image of visible light, but in the embodiment, it is a device that generates an infrared image so that the monitored person Ob can be monitored even in a relatively dark place. Such an imaging unit 12 is, for example, in the embodiment, an imaging optical system that forms an infrared optical image of an imaging target on a predetermined imaging surface, and a light receiving surface that is aligned with the imaging surface. An image sensor that converts an infrared optical image in the imaging target into an electrical signal, and image data that is data representing an infrared image in the imaging target by performing image processing on the output of the image sensor A digital infrared camera including an image processing unit to be generated. In the embodiment, the imaging optical system of the imaging unit 12 is preferably a wide-angle optical system (a so-called wide-angle lens (including a fisheye lens)) having an angle of view capable of imaging the entire living room RM in which the imaging unit 12 is disposed.

The imaging control unit 13 controls the imaging unit 12 to cause the imaging unit 12 to capture a moving image to be imaged. Instead of moving images, a plurality of still images (slide images) arranged in time series may be used. Thus, the imaging control unit 13 functions as a control unit and has a function of causing the imaging unit 12 to continuously image the monitored person Ob.

The image recording unit 14 records an image of the monitored person Ob. The image recording unit 14 includes a nonvolatile storage unit 141, a ring buffer 142, and a storage processing unit 143.

The non-volatile storage unit 141 (storage unit) has a function (that is, non-volatile) that retains stored information (data) even when the sensor device SU is turned off. Done by realization.

The ring buffer 142 can store a predetermined amount of information (data). When storing new information (data), the ring buffer 142 stores the predetermined amount of information (data) endlessly by discarding the old information (data) in order. It has the function to do.

The storage processing unit 143 stores the moving image captured by the imaging unit 12 in the ring buffer 142. As a result, the ring buffer 142 stores a moving image constituted by a frame a predetermined time before the latest frame in an endless manner.

When the respiratory abnormality is detected by the respiratory abnormality detection unit 11, the storage processing unit 143 reads a frame captured at a predetermined timing before the detection of the respiratory abnormality from the ring buffer 142, and stores the nonvolatile storage unit 141 (storage unit). This frame shows an image of the monitored person Ob before the time when respiratory abnormality is detected. From this frame, before the respiratory abnormality is detected, the posture of the observer Ob and the orientation of the face and the like can be known. Therefore, this frame serves as information for investigating the cause of respiratory abnormalities.

The frame imaged at a predetermined timing is, for example, a frame imaged several seconds to several tens of seconds before the reference when a respiratory abnormality is detected (for example, imaged five seconds before) Frame). As a result, the still image (one frame) of the monitored person Ob immediately before the detection of the respiratory abnormality is stored in the nonvolatile storage unit 141. Not only a still image but also a moving image may be used.

The storage processing unit 143 may generate a silhouette image in which the image of the monitored person Ob included in the frame (image) read from the ring buffer 142 is a silhouette, and store the silhouette image in the nonvolatile storage unit 141. Good. A silhouette is an image in which the outline is filled with a single color. The face of the monitored person Ob is not known from the silhouette of the monitored person Ob. Therefore, even if the situation where the image memorize | stored in the non-volatile memory | storage part 141 flows out, the privacy of the to-be-monitored person Ob can be protected. Since the posture of the monitored person Ob and the orientation of the face and the like are known from the silhouette image, the silhouette image is information for investigating the cause of the respiratory abnormality.

As described above, the storage processing unit 143 functions as a processing unit. The processing unit detects a subject imaged by the imaging unit 12 during a time period including when a respiratory abnormality is detected when the respiratory abnormality of the monitored person Ob is detected by the detection unit (the respiratory abnormality detection unit 11). An image of the observer Ob is acquired, and the acquired image is stored in the nonvolatile storage unit 141.

The SU communication IF unit 16 is a communication circuit that is connected to the SU control processing unit 15 and performs communication according to the control of the SU control processing unit 15. The SU communication IF unit 16 generates a communication signal containing data to be transferred input from the SU control processing unit 15 in accordance with a communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SV, SP, and TA via the network NW. The SU communication IF unit 16 receives communication signals from other devices SV, SP, and TA via the network NW, extracts data from the received communication signals, and the SU control processing unit 15 can process the extracted data. The data is converted into data in a proper format and output to the SU control processing unit 15. The SU communication IF unit 16 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

The SU control processing unit 15 uses each unit of the sensor device SU (Doppler sensor unit 10, respiratory abnormality detection unit 11, imaging unit 12, imaging control unit 13, image recording unit 14, SU communication IF unit 16) as a function of each unit. In response to each control, a predetermined event relating to the monitored person Ob is detected, the detected event is notified to the management server SV, a voice call is performed between the terminal devices SP and TA, and a moving image Is a device for delivering a moving image to the terminal devices SP and TA.

The sensor device SU functions as a biological monitoring device by including the respiratory abnormality detection unit 11 and the image recording unit 14. From this point of view, the monitored person monitoring system MS is a living body monitoring system.

The sensor device SU functions as a respiratory abnormality detection device by including the respiratory abnormality detection unit 11. From this point of view, the monitored person monitoring system MS is a respiratory abnormality detection system. In this case, the sensor device SU may not include the imaging unit 12, the imaging control unit 13, and the image recording unit 14.

The mobile terminal device TA will be described in detail. FIG. 5 is a block diagram illustrating a configuration of the mobile terminal device TA provided in the monitored person monitoring system MS according to the embodiment. The portable terminal device TA includes a display unit 21, a display control unit 22, an operation unit 23, a terminal side control processing unit (TA control processing unit) 24, and a terminal side communication interface unit (TA communication IF unit) 25.

The display unit 21 is realized by a liquid crystal display or the like. The display control unit 22 performs control to display an image (for example, a moving image) on the display unit 21. The operation unit 23 is a device for inputting a command or the like for operating the mobile terminal device TA. The operation unit 23 is realized by a touch panel or the like.

The TA communication IF unit 25 is a communication circuit that is connected to the TA control processing unit 24 and performs communication according to the control of the TA control processing unit 24. The TA communication IF unit 25 generates a communication signal containing the data to be transferred input from the TA control processing unit 24 in accordance with the communication protocol used in the network NW of the monitored person monitoring system MS, and the generated communication The signal is transmitted to other devices SU, SV, SP via the network NW. The TA communication IF unit 25 receives communication signals from other devices SU, SV, and SP via the network NW, extracts data from the received communication signals, and the TA control processing unit 24 can process the extracted data. The data is converted into data of a proper format and output to the TA control processing unit 24. The TA communication IF unit 25 includes, for example, a communication interface circuit that complies with the IEEE 802.11 standard or the like.

The TA control processing unit 24 controls each unit (display unit 21, display control unit 22, operation unit 23, TA communication IF unit 25) of the mobile terminal device TA according to the function of each unit, and controls the monitored person Ob. It is a device for receiving and displaying monitoring information, accepting input of implementation intention information, and answering or calling a nurse call.

The supervisor NS operates the operation unit 23 of the portable terminal device TA and inputs information serving as a care record of the monitored person Ob every day. The information includes vital data (for example, body temperature, weight, systolic blood pressure, diastolic blood pressure, etc.), daily meal amount, and daily sleep time. The TA control processing unit 24 instructs the TA communication IF unit 25 to transmit the information to the management server device SV. The TA communication IF unit 25 transmits the information to the management server SV. The information is recorded as a care record in a care recording unit 31 (FIG. 6) described later.

The management server device SV will be described. FIG. 6 is a block diagram illustrating a configuration of the management server device SV provided in the monitored person monitoring system MS according to the embodiment. The management server device SV includes a care recording unit 31, a condition determination unit 32, a management server side control processing unit (SV control processing unit) 33, and a management server side communication interface unit (SV communication IF unit) 34.

The care record unit 31 creates and stores a care record for each monitored person Ob. The care record is created on a daily basis and includes vital data (for example, body temperature, weight, systolic blood pressure, diastolic blood pressure, etc.), daily meal amount, and daily sleep time.

The condition determination unit 32 refers to the care record of the monitored person Ob at a predetermined timing, and the health condition of the monitored person Ob is determined from the eight conditions C (condition C-1 to condition C- It is determined for each monitored person Ob whether or not any of 8) applies. For example, body temperature information indicating the body temperature measured after dinner (the body temperature measured at the end of the day) is sent from the portable terminal device TA to the care recording unit 31, and the care recording unit 31 The timing when the body temperature indicated by the body temperature information is recorded in the care record.

The SV communication IF unit 34 is a communication circuit that is connected to the SV control processing unit 33 and performs communication in accordance with the control of the SV control processing unit 33. The SV communication IF unit 34 is a communication circuit similar to the SU communication IF unit 16 and includes, for example, a communication interface circuit according to the IEEE 802.11 standard or the like.

The SV control processing unit 33 controls each unit (the care recording unit 31, the condition determination unit 32, and the SV communication IF unit 34) of the management server device SV according to the function of each unit, and the predetermined event is transmitted from the sensor device SU. When the notification is received, the monitoring information related to the monitoring of the monitored person Ob is managed, the predetermined event is notified (transmitted) to the client (here, the predetermined terminal device SP, TA), and the client's request is met. It is an apparatus for providing data to the client and managing the monitored person monitoring system MS as a whole.

The respiratory abnormality detection and image recording executed by the monitored person monitoring system MS according to the embodiment will be described. FIG. 7 is a flowchart explaining this. Take monitored person Ob-1 (FIG. 1) as an example. Referring to FIG. 6, whether condition determination unit 32 meets one of eight conditions C shown in Table 1 using the care record of monitored person Ob-1 recorded in care record unit 31. Determine whether or not. There may be cases where none of the eight conditions C is met, there are cases where any one of the conditions is met, and there are cases where two or more conditions are met. Here, an example corresponding to condition C-4 (when the weight has increased by 10% or more compared to one month ago) will be described. The SV control processing unit 33 instructs the SV communication IF unit 34 to transmit the condition information indicating the condition C-4 to the sensor device SU-1. The SV communication IF unit 34 transmits the condition information to the sensor device SU-1.

Referring to FIG. 3, the SU communication IF unit 16 of the sensor device SU-1 receives the condition information, and the SU control processing unit 15 stores the condition information in the waveform pattern selection unit 112. The waveform pattern selection unit 112 is a target of pattern matching based on the conditions indicated by the condition information from the respiratory waveform patterns PC to PJ (FIG. 4) stored in advance. A respiratory waveform pattern P is selected (step S1). Here, since it corresponds to the condition C-4, the respiratory waveform pattern PC (sleep apnea syndrome), the respiratory waveform pattern PF (hypopnea), and the respiratory waveform pattern PI (Kusmaul breath) Selected.

In the sensor device SU-1, the imaging unit 12 captures a moving image with respect to the imaging target including the monitored person Ob-1, and the storage processing unit 143 stores the captured moving image in the ring buffer 142 (Step S1). S2). In parallel with this, the waveform generation unit 111 extracts a respiratory signal component from the Doppler signal DS output by the Doppler sensor unit 10. The waveform generation unit 111 generates a respiration signal indicating the relationship between time and signal intensity using the respiration signal component (step S2). The waveform of the respiration signal indicates the respiration state of the monitored person Ob-1.

The respiratory abnormality detection unit 11 determines whether or not breathing has stopped using the respiratory signal generated in step S2 (step S3). Specifically, the respiratory abnormality detection unit 11 determines that breathing has stopped when a state where the respiratory waveform is flat continues for a predetermined period.

When the respiratory abnormality detection unit 11 determines that the breathing is not stopped (No in step S3), the coincidence determination unit 113 determines that the waveform of the respiratory signal generated in step S2 is a respiratory waveform pattern PC (sleep apnea). It is determined by using pattern matching whether it corresponds to any one of syndrome, respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PI (Cuzmaul breath) (step S4). If none of the eight conditions C shown in Table 1 is applicable, the process of step S4 is not performed.

The coincidence determination unit 113 determines that the waveform of the respiratory signal generated in step S2 is a respiratory waveform pattern PC (sleep apnea syndrome), a respiratory waveform pattern PF (hypopnea), and a respiratory waveform pattern P-. When it is determined that it does not correspond to any of I (Cousmaul breathing) (No in step S4), the respiratory abnormality detection unit 11 determines that the respiratory state of the monitored person Ob-1 is normal breathing (step S5), The process returns to step S2.

The coincidence determination unit 113 determines that the respiratory signal generated in step S2 is the respiratory waveform pattern PC (sleep apnea syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PI ( When it is determined that it corresponds to any one of (Cousmaul breathing) (Yes in step S4), the SU control processing unit 15 instructs the SU communication IF unit 16 to transmit abnormality occurrence information to the management server device SV. The abnormality occurrence information includes the occurrence of respiratory abnormality, information for identifying the monitored person Ob-1 in which the respiratory abnormality has occurred (for example, the name of the monitored person Ob-1 and the number of the room RM), and the type of respiratory abnormality. Including. The abnormality occurrence information further includes an image of the monitored person Ob-1 stored in the nonvolatile storage unit 141 in step S7 described later. The SU communication IF unit 16 transmits abnormality occurrence information to the management server device SV (step S6).

Referring to FIG. 5 and FIG. 6, the management server device SV receives the abnormality occurrence information and transfers it to each mobile terminal device TA. Thereby, each portable terminal device TA notifies the monitor NS of the occurrence of abnormality. For example, the mobile terminal device TA sounds an alarm sound and causes the display unit 21 to display an image indicating the occurrence of an abnormality. This image includes the image of the monitored person Ob-1 stored in the nonvolatile storage unit 141 in step S7. Note that the storage processing unit 143 shown in FIG. 3 performs processing for converting the image of the monitored person Ob-1 into a silhouette image (an image in which the image of the monitored person Ob-1 is made into a silhouette), and converts the silhouette image into a silhouette image. When stored in the nonvolatile storage unit 141, the image of the monitored person Ob-1 included in the abnormality occurrence information is not a silhouette image, but an image of the monitored person Ob-1 before silhouette processing (the monitored person Ob-1). Can be recognized). When the image displayed on the display unit 21 is switched from the image of the monitored person Ob-1 before silhouette processing to another image, the display control unit 22 deletes the data of the image. Thereby, since the image of the monitored person Ob-1 before the silhouette process is not stored in the memory of the portable terminal device TA, the privacy of the monitored person Ob-1 can be protected.

With reference to FIG. 3 and FIG. 7, in parallel with step S6, the storage processing unit 143 captures a frame (for example, a frame captured at a predetermined timing before the respiratory abnormality is detected by the respiratory abnormality detection unit 11). Frame taken 5 seconds before) is read from the ring buffer 142 and stored in the nonvolatile storage unit 141. As a result, an image of the monitored person Ob-1 before the respiratory abnormality is detected is recorded (step S7).

When the respiratory abnormality detection unit 11 determines that the breathing of the monitored person Ob-1 is stopped (Yes in step S3), the respiratory abnormality detection unit 11 performs the processes of step S6 and step S7. The abnormality occurrence information in step S6 includes occurrence of respiratory stop and information for identifying the monitored person Ob-1 in which the respiratory stop has occurred (for example, the name of the monitored person Ob-1 and the number of the room RM). It is. The storage processing unit 143 reads, from the ring buffer 142, a frame imaged at a predetermined timing (for example, a frame imaged 5 seconds before) when the respiratory abnormality is determined by the respiratory abnormality detection unit 11, The data is stored in the nonvolatile storage unit 141. Thereby, an image of the monitored person Ob-1 before it is determined that breathing has stopped is recorded (step S7).

There are effects 1 to 4 as main effects of the embodiment. The effect 1 will be described. 3 and 7, when the sensor device SU (biological monitoring device, respiratory abnormality detection device) detects a respiratory abnormality of the monitored person Ob (Yes in step S3, Yes in step S4), the respiratory abnormality The frame (image) of the monitored person Ob captured at a predetermined timing before the detection of the image is read from the ring buffer 142 and stored in the nonvolatile storage unit 141 (step S7). In this frame, the posture of the monitored person Ob and the orientation of the face and the like are shown. Therefore, according to the embodiment, when a respiratory abnormality of the monitored person Ob is detected, information regarding the posture of the monitored person Ob and the orientation of the face or the like can be acquired simultaneously.

Effect 2 will be described. A frame imaged at a predetermined timing before the detection of the respiratory abnormality of the monitored person Ob (for example, a frame imaged several seconds to several tens of seconds before the detection of the respiratory abnormality) The posture of the monitored person Ob and the orientation of the face, etc., immediately before the monitoring person Ob's respiratory abnormality is detected are shown. These are important information for investigating the cause of respiratory abnormalities. With reference to FIG. 3 and FIG. 7, in the embodiment, before the respiratory abnormality of the monitored person Ob is detected, the moving image MI of the monitored person Ob is captured by the imaging unit 12 and the moving image MI is stored in the ring buffer 142. Store (step S2). Thus, the non-volatile storage unit 141 can store a frame imaged at a predetermined timing prior to when the respiratory abnormality of the monitored person Ob is detected without providing a large-capacity storage device ( Step S7).

Effect 3 will be described. With reference to FIG. 3 and FIG. 7, the embodiment uses a predetermined index serving as an index indicating the health state of the monitored person Ob, and includes a plurality of respiratory waveform patterns indicating each of a plurality of types of respiratory abnormalities. Then, one or more respiratory waveform patterns are selected (step S1). Thereby, since the types of respiratory waveform patterns of respiratory abnormalities can be reduced (because it can be narrowed down), in determining whether the waveform of the respiratory signal of the monitored subject Ob corresponds to the respiratory waveform pattern of respiratory abnormalities ( Step S4), erroneous determination can be reduced. Therefore, according to the present embodiment, it is possible to improve the accuracy of determining whether or not there is a respiratory abnormality and the accuracy of determining the type of respiratory abnormality.

Effect 4 will be described. With reference to FIG.4 and FIG.7, in the determination whether the waveform of the respiratory signal of the monitored person Ob corresponds to the respiratory waveform pattern P of abnormal breathing (step S4), the waveform pattern is similar. For this reason, combinations that are prone to misjudgment are empirically known. Combination of respiratory waveform pattern PC (sleep apnea syndrome) and respiratory waveform pattern PD (slow breathing), and respiratory waveform pattern PD (slow breathing) and respiratory waveform pattern PI (Kusmaul breathing) ).

When the monitored person Ob has sleep apnea syndrome, the coincidence determination unit 113 (FIG. 3) should determine that the waveform of the respiratory signal of the monitored person Ob matches the respiratory waveform pattern PC. It may be determined that the respiratory waveform pattern PD matches. Conversely, when the monitored subject Ob is slow breathing, the coincidence determination unit 113 should determine that the waveform of the respiratory signal of the monitored subject Ob matches the respiratory waveform pattern PD. It may be determined that it matches PC. The same applies to the combination of the respiratory waveform pattern PD and the respiratory waveform pattern PI.

In the embodiment, since the waveform pattern selection unit 112 selects the respiratory waveform pattern P using the condition C shown in Table 1 (step S1), the respiratory waveform pattern PC and the respiratory waveform pattern PD are simultaneously selected. May not be selected. For example, when only the condition C-4 shown in Table 1 is applicable, the respiratory waveform pattern PC is selected, but the respiratory waveform pattern PD is not selected. In such a case, the coincidence determination unit 113 should determine that the waveform of the respiratory signal of the monitored person Ob matches the respiration waveform pattern PC, but determines that it matches the respiration waveform pattern PD. Does not occur. The same applies to the combination of the respiratory waveform pattern PD and the respiratory waveform pattern PI.

There are Modification 1 and Modification 2 in the embodiment. The first modification will be described. In the embodiment, the non-volatile storage unit 141 stores an image of the monitored person Ob before a respiratory abnormality is detected. On the other hand, in the first modification, the non-volatile storage unit 141 stores an image of the monitored person Ob when a respiratory abnormality is detected.

FIG. 8 is a block diagram showing a configuration of the sensor device SU provided in the first modification. Differences from the sensor device SU provided in the embodiment shown in FIG. 3 will be described. The configuration of the image recording unit 14 is different between the first modification and the embodiment. In the first modification, when a respiratory abnormality is detected by the respiratory abnormality detection unit 11, the imaging control unit 13 causes the imaging unit 12 to capture an image of the imaging target including the monitored person Ob-1. The storage processing unit 143 stores the image in the nonvolatile storage unit 141. According to the first modification, the ring buffer 142 is not necessary.

Described below is the detection of respiratory abnormalities and image recording executed by the monitored person monitoring system MS according to the first modification. FIG. 9 is a flowchart for explaining this. Differences from the flowchart shown in FIG. 7 are as follows.

Modification 1 executes step S2a instead of step S2. In step S2a, the respiratory abnormality detection unit 11 generates a respiratory signal of the monitored person Ob-1. This process is the same as the generation of the respiratory signal in step S2.

Modification 1 executes step S6a instead of step S6. In step S6a, the SU communication IF unit 16 transmits the abnormality occurrence information to the management server device SV. This process is the same as step S6. Further, in step S6a, when the respiratory abnormality detection unit 11 determines that the monitored person Ob-1 has stopped breathing (Yes in step S3), or the respiratory signal generated in step S2a is the respiratory waveform pattern P−. When it is determined that any one of C (sleep apnea syndrome), respiratory waveform pattern PF (hypopnea), and respiratory waveform pattern PI (Kusmaul breathing) is satisfied (Yes in step S4), imaging control The unit 13 causes the imaging unit 12 to capture an image (still image or moving image) of the imaging target including the monitored person Ob-1.

Modification 1 executes step S7a instead of step S7. In step S7a, the storage processing unit 143 stores the image captured in step S6a in the nonvolatile storage unit 141. Thereby, an image of the monitored person Ob-1 when the respiratory abnormality is detected is recorded.

Modification 2 will be described. In the second modification, the management server device SV has a function of a biological monitoring device (respiratory abnormality detection device). FIG. 10 is a block diagram illustrating a configuration of the sensor device SU provided in the second modification. FIG. 11 is a block diagram illustrating a configuration of the management server device SV provided in the second modification. Differences between the sensor device SU and the server device SV provided in the embodiment shown in FIGS. 3 and 6 will be described.

In the embodiment, the respiratory abnormality detection unit 11 and the image recording unit 14 are provided in the sensor device SU. On the other hand, in the modified example 2, these are provided in the management server device SV. The SU control processing unit 15 instructs the SU communication IF unit 16 to transmit the Doppler signal DS and the moving image MI to the management server device SV. The SU communication IF unit 16 changes the Doppler signal DS and the moving image MI to communication signals communicable with the SV communication IF unit 34, and transmits the communication signal to the management server device SV.

In the embodiment, the Doppler sensor unit 10 functions as an acquisition unit that acquires a biological signal of the monitored person Ob. On the other hand, in the second modification, the SV communication IF unit 34 has the function of an acquisition unit. In the embodiment, when the storage processing unit 143 detects the respiratory abnormality of the monitored person Ob, the image of the monitored person Ob captured by the imaging unit 12 during the time period including the time when the respiratory abnormality is detected. It has the function to acquire. On the other hand, in the second modification, the SV communication IF unit 34 has the function.

(Summary of embodiment)
The biological monitoring apparatus according to the first aspect of the present embodiment includes an acquisition unit that acquires a biological signal of a monitored person to be monitored, and the monitored target based on the biological signal acquired by the acquisition unit. A detection unit that detects whether or not the person's breathing is abnormal, a storage unit, and when the respiratory abnormality of the monitored person is detected by the detection unit, during a time period that includes the detection of the respiratory abnormality A processing unit that stores the image of the monitored person captured by the imaging unit in the storage unit.

During the time period including when a respiratory abnormality is detected, the image of the monitored person captured by the imaging unit is the image of the monitored person (first image captured by the imaging unit before the respiratory abnormality is detected). Image), an image of the monitored person (second image) captured by the imaging unit when a respiratory abnormality is detected, and an image of the monitored person (third image) captured by the imaging unit after detecting the respiratory abnormality Image), an image including all of these, and two images selected from these images (for example, the first image and the second image).

The acquisition unit includes, for example, a Doppler sensor unit that outputs a Doppler signal of a Doppler frequency component as the biological signal based on a transmission wave and a reflected wave of the transmission wave.

The biological monitoring apparatus according to the first aspect of the present embodiment detects the monitored person's respiratory abnormality, and the monitored person's image captured by the imaging unit during a time period including when the respiratory abnormality is detected. Is stored in the storage unit. In this image, the posture of the monitored person sleeping and the orientation of the face and the like are shown. Therefore, according to the biological monitoring apparatus according to the first aspect of the present embodiment, when a respiratory abnormality of the monitored person is detected, information on the posture of the monitored person and the orientation of the face, etc. is acquired. it can.

The above configuration further includes a control unit that causes the imaging unit to continuously image the monitored person, and a ring buffer, and the processing unit is configured to capture the monitored person continuously imaged by the imaging unit. An image is stored in the ring buffer, and when the respiratory abnormality is detected by the detection unit, the processing unit captures the monitored person captured at a predetermined timing before the respiratory abnormality is detected. An image is read from the ring buffer and stored in the storage unit.

An image captured at a predetermined timing prior to when the respiratory abnormality of the monitored person is detected (for example, an image captured 5 seconds before the abnormal respiratory condition is detected) includes the breathing of the monitored person. The posture of the person to be monitored immediately before the abnormality is detected and the orientation of the face and the like are shown. These are important information for investigating the cause of respiratory abnormalities. In this configuration, before the respiratory abnormality of the monitored person is detected, the monitored person is continuously imaged by the imaging unit, and the image is stored in the ring buffer. Thereby, without providing a large-capacity storage device, an image captured at a predetermined timing prior to when the respiratory abnormality of the monitored person is detected can be stored in the storage unit.

In the above configuration, when the respiratory abnormality is detected by the detection unit, the imaging unit further includes a control unit that captures an image of the monitored person, and the processing unit detects the respiratory abnormality by the detection unit. When this is done, the image of the monitored person taken by the imaging unit is stored in the storage unit.

In this configuration, when a respiratory abnormality of the monitored person is detected, the image of the monitored person is captured by the imaging unit, and this image is stored in the storage unit. Therefore, a ring buffer is not necessary.

In the above configuration, the processing unit generates a silhouette image in which the image of the monitored person included in the image of the monitored person is a silhouette, and stores the silhouette image in the storage unit.

A silhouette is an image filled with a solid color inside the outline. The face of the monitored person is not known from the silhouette of the monitored person. Therefore, even if the situation where the image memorize | stored in the memory | storage part flows out, a to-be-monitored person's privacy can be protected. Since the posture of the monitored person and the orientation of the face and the like can be known from the silhouette image, the silhouette image is information for investigating the cause of respiratory abnormality.

The biological monitoring method according to the second aspect of the present embodiment includes an acquisition step of acquiring a biological signal of a monitored person to be monitored, and the monitored target based on the biological signal acquired by the acquisition step. A detection step for detecting whether or not the person's breathing is abnormal, and when the respiratory abnormality of the monitored person is detected by the detection step, during a time period including when the respiratory abnormality is detected, the imaging unit And a processing step of storing the captured image of the monitored person in a storage unit.

The biological monitoring method according to the second aspect of the present embodiment defines the biological monitoring apparatus according to the first aspect of the present embodiment from the viewpoint of the method, and the biological monitoring according to the first aspect of the present embodiment. It has the same effect as the device.

The biological monitoring system according to a third aspect of the present embodiment is a biological monitoring system including a biological monitoring device and a terminal device, and the biological monitoring device acquires a biological signal of a monitored person to be monitored. An acquisition unit, a detection unit that detects whether or not the monitored person's breathing is abnormal based on the biological signal acquired by the acquisition unit, a storage unit, and the detection unit When a respiratory abnormality is detected, a processing unit that stores an image of the monitored person captured by the imaging unit in the storage unit during a time period including the time when the respiratory abnormality is detected, and the detection unit A transmission unit that transmits an image of the monitored person captured by the imaging unit during the time period when a respiratory abnormality of the monitored person is detected, and the terminal device is The picture of the monitored person sent Comprising a receiving unit for receiving, a display control unit for displaying an image of the monitored person is received by the receiving unit to the display unit.

The biological monitoring system according to the third aspect of the present embodiment defines the biological monitoring apparatus according to the first aspect of the present embodiment from the viewpoint of the system, and the biological monitoring according to the first aspect of the present embodiment. It has the same effect as the device.

This application is based on Japanese Patent Application No. 2016-128649 filed on June 29, 2016, the contents of which are included in this application.

In order to express the present invention, the present invention has been properly and fully described through the embodiments with reference to the drawings. However, those skilled in the art can easily change and / or improve the above-described embodiments. It should be recognized that this is possible. Therefore, unless the modifications or improvements implemented by those skilled in the art are at a level that departs from the scope of the claims recited in the claims, the modifications or improvements are not covered by the claims. To be construed as inclusive.

According to the present invention, a biological monitoring device, a biological monitoring method, and a biological monitoring system can be provided.

Claims

An acquisition unit for acquiring a biological signal of a monitored person to be monitored;
A detection unit for detecting whether the monitored person's breathing is abnormal based on the biological signal acquired by the acquisition unit;
A storage unit;
When the abnormal breathing of the monitored person is detected by the detection unit, the image of the monitored person captured by the imaging unit is stored in the storage unit during a time period including the time when the abnormal breathing is detected. A biological monitoring device comprising:
A control unit that causes the imaging unit to continuously image the monitored person;
A ring buffer,
The processing unit stores the image of the monitored person continuously captured by the imaging unit in the ring buffer,
When the respiratory abnormality is detected by the detection unit, the processing unit reads, from the ring buffer, an image of the monitored person captured at a predetermined timing before the respiratory abnormality is detected. The biological monitoring apparatus according to claim 1, wherein the biological monitoring apparatus is stored in the storage unit.
A control unit that causes the imaging unit to capture an image of the monitored person when the respiratory abnormality is detected by the detection unit;
The biological monitoring apparatus according to claim 1, wherein the processing unit stores the image of the monitored person captured by the imaging unit in the storage unit when the respiratory abnormality is detected by the detection unit.
The processing unit generates a silhouette image in which the image of the monitored person included in the image of the monitored person is used as a silhouette, and stores the silhouette image in the storage unit. The biological monitoring apparatus according to 1.
5. The acquisition unit according to claim 1, wherein the acquisition unit includes a Doppler sensor unit that outputs a Doppler signal having a Doppler frequency component as the biological signal based on a transmission wave and a reflected wave of the transmission wave. Biological monitoring device.
An acquisition step of acquiring a biological signal of a monitored person to be monitored;
A detection step for detecting whether or not breathing of the monitored person is abnormal based on the biological signal acquired by the acquisition step;
When the respiratory abnormality of the monitored person is detected by the detection step, the image of the monitored person captured by the imaging unit is stored in the storage unit during a time period including the time when the respiratory abnormality is detected. A biological monitoring method comprising: a processing step.
A biological monitoring system comprising a biological monitoring device and a terminal device,
The biological monitoring device is:
An acquisition unit for acquiring a biological signal of a monitored person to be monitored;
A detection unit for detecting whether the monitored person's breathing is abnormal based on the biological signal acquired by the acquisition unit;
A storage unit;
When the abnormal breathing of the monitored person is detected by the detection unit, the image of the monitored person captured by the imaging unit is stored in the storage unit during a time period including the time when the abnormal breathing is detected. A processing unit to be
A transmission unit that transmits an image of the monitored person captured by the imaging unit during the time period when a respiratory abnormality of the monitored person is detected by the detection unit;
The terminal device
A receiving unit that receives the image of the monitored person transmitted by the transmitting unit;
A biological monitoring system comprising: a display control unit that causes a display unit to display an image of the monitored person received by the receiving unit.