JP2019152914A - Nursing facility child watching system and information processing method - Google Patents

Abstract

To provide an information processing system for accurately analyzing an object person.SOLUTION: An information processing system at least includes: an imaging device for imaging an object person; a measurement device for sensing an object person; and an information processing device to be connected to the imaging device and the measurement device. The system also includes: an image acquisition section for acquiring image data indicating the object person and a periphery of the object person from the imaging device; a biological information acquisition section for acquiring biological information of the object person from the measurement device; and an identification section for identifying the object person on the basis of image data when there are multiple object persons; a data accumulation section for accumulating accumulated data including the image data and the biological information in association with the object person identified in identification by the identification section; and an analysis section for analyzing a tendency of the object person on the basis of the accumulated data.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a childcare facility child watching system and an information processing method.

  A method for measuring so-called biological information such as human breathing or pulse is known.

  For example, there is a monitoring device that measures respiration. In this example, the monitoring device captures a moving image of the measurement subject. Then, the monitoring device analyzes the captured moving image and detects a vibration having a period considered to be respiration. A method is known in which the respiration rate can be accurately measured by measuring the respiration rate based on such a detection result even when the subject is moving a part of the body (for example, patents). Reference 1).

  There are other biological information analysis systems that measure the pulse. In this example, the biological information analysis system first accepts an image obtained by imaging the measurement subject. The biological information analysis system calculates color information based on the image and calculates a representative color for each region. Next, the biological information analysis system extracts a fundamental wave indicating a temporal change in the representative color for each region. Subsequently, the biological information analysis system calculates a difference between the fundamental waves between adjacent regions, and calculates a pulse based on the frequency of the difference. In this way, a method that can acquire biological information with high accuracy and non-contact is known (see, for example, Patent Document 2).

JP 2014-171574 A International Publication No. 2016-163019

  However, since the target person is not identified in the conventional method, the target person cannot be associated with the data acquired from the target person. Therefore, data cannot be stored in association with the target person. Therefore, in the conventional method, since there is no biological information obtained by measuring the subject over a long period of time, the subject cannot be analyzed with high accuracy in many cases.

  An object of this invention is to provide the information processing system which can analyze a subject with high precision in view of the said subject.

The present invention more preferably includes an imaging device that images a subject, and includes at least a measurement device that senses the subject, and an information processing device that is connected to the measurement device, and more preferably connected to the imaging device. An information processing system comprising:
More preferably, it further includes an image acquisition unit that acquires image data indicating the subject and the periphery of the subject from the imaging device,
A biological information acquisition unit that acquires biological information of the subject from the measurement device;
When the target person is a plurality of persons, an identification unit for identifying the target person, more preferably based on the image data;
A data accumulating unit that accumulates accumulated data including the image data and the biological information in correspondence with the subject identified by the identification by the identifying unit;
And an analysis unit that analyzes the tendency of the subject based on the accumulated data.

  An information processing system capable of analyzing a target person with high accuracy can be provided.

It is a whole lineblock diagram showing the example of use of the information processing system concerning this embodiment. It is a block diagram which shows the hardware structural example of the information processing apparatus which concerns on this embodiment. It is a flowchart which shows an example of the whole process by the information processing system which concerns on this embodiment. It is a figure which shows an example of the data input into the information processing system which concerns on this embodiment. It is a figure which shows an example of the image data and biometric information which the information processing system which concerns on this embodiment uses. It is a figure which shows the example of identification of the subject by the information processing system which concerns on this embodiment. It is a figure which shows the example of analysis which pinpoints the time when the subject person turns over by the information processing system which concerns on this embodiment. It is a figure which shows the example of the data produced | generated by the "preprocessing" by the information processing system which concerns on this embodiment. It is a block diagram which shows the example of an abnormality determination by the information processing system which concerns on this embodiment. It is a figure which shows the example of an output of the report information which the information processing system which concerns on this embodiment produced | generated. It is a figure which shows the example of the information contained in the corresponding | compatible record which the information processing system which concerns on this embodiment produces | generates. It is a figure which shows the example of the information contained in the check record which the information processing system which concerns on this embodiment produces | generates. It is a figure which shows the example of the data which the information processing system which concerns on this embodiment acquires by "operation" etc. It is a functional block diagram which shows the function structural example of the information processing system which concerns on this embodiment. It is an example of the data used by the process by the information processing system concerning this embodiment. It is an example of the data which each function which the information processing system concerning this embodiment has has.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

<Example of overall configuration>
For example, the information processing system according to the present embodiment is used with the following overall configuration.

  FIG. 1 is an overall configuration diagram illustrating a usage example of the information processing system according to the present embodiment. As illustrated, the information processing system 10 includes, for example, a server 11, an imaging device 12, and a sensor 13. In the information processing system 10, as illustrated, the server 11, the imaging device 12, and the sensor 13 are connected via a network or the like and can transmit and receive data to and from each other.

  The server 11 is an information processing device. That is, the server 11 is a PC (Personal Computer), a server, a workstation, or a combination thereof.

  The imaging device 12 is a camera or the like. As shown in the figure, the imaging device 12 images children M1 and M2, which are examples of persons to be observed, and generates image data IMG indicating the children M1 and M2 and the like.

  The sensor 13 is a measuring device that senses biological information D1 such as the children M1 and M2. In this example, the sensor 13 generates the biological information D1 based on the image data IMG generated by the imaging device 12.

  The server 11 stores biometric information D1, image data IMG, or data indicating the results of analyzing these data (hereinafter referred to as “accumulated data D2”). For example, the accumulated data D2 is accumulated in a database format or the like.

  In the illustrated example, the imaging device 12 and the sensor 13 are installed in a nursery school or the like so that the children M1 and M2 can be imaged. On the other hand, the server 11 is installed in a place that becomes a data center. The installation location of each device is not limited to the illustrated position. That is, the server 11 may be installed in a nursery school, for example. Further, there may be a plurality of imaging devices 12 and sensors 13.

  As shown in the figure, the data center is a place where the operator M3 resides. The information processing system 10 may be applied to a form other than the data center where the operator M3 resides.

  Further, as shown in the figure, the nursery school is a place where staff such as a nursery teacher M4 resides. Furthermore, the nursery teacher M4 includes a mobile terminal 14 such as a smartphone, a mobile phone, a tablet, a mobile PC, or a PHS (Personal Handy-phone System).

  Hereinafter, the entire configuration shown in the figure will be described as an example.

  The overall configuration is not limited to the illustrated configuration. That is, the information processing system 10 may further include an information processing apparatus other than the server 11, for example. Furthermore, for example, the server 11 may be an apparatus integrated with the sensor 13 or the like, or may be a virtual machine provided by a cloud service.

<Hardware configuration example>
FIG. 2 is a block diagram illustrating a hardware configuration example of the information processing apparatus according to the present embodiment. The server 11 which is an example of the information processing apparatus includes a hardware configuration including, for example, a CPU (Central Processing Unit) 11H1, a storage device 11H2, an input device 11H3, a communication device 11H4, an output device 11H5, and an interface 11H6. It is. These devices are connected by a bus as shown in the figure, and transmit / receive data to / from each other. That is, the server 11 is a computer that executes processing using hardware resources such as an arithmetic device, a control device, and a storage device based on a program or the like.

  The CPU 11H1 is an example of an arithmetic device and a control device.

  The storage device 11H2 is a memory or the like. The storage device 11H2 may include an auxiliary storage device such as a hard disk in addition to the main storage device.

  The input device 11H3 is a device that inputs an operation by an operator. For example, the input device 11H3 is a keyboard, a mouse, or a combination thereof.

  The communication device 11H4 is a device that transmits / receives data to / from an external device by wire, wireless, or a combination thereof. For example, the communication device 11H4 is a connector or an antenna.

  The output device 11H5 is a device that outputs processing results and the like to the operator. For example, the output device 11H5 is a display or the like.

  The interface 11H6 transmits / receives data to / from an external device. For example, the interface 11H6 is a connector or the like.

  Note that the information processing apparatus is not limited to the illustrated hardware configuration. That is, the information processing apparatus may have a hardware configuration that further includes apparatuses other than those illustrated. For example, the information processing apparatus may further include an arithmetic device, a control device, a storage device, or the like outside or inside. Further, the information processing apparatus may be a plurality of apparatuses instead of a single apparatus.

<Example of overall processing>
FIG. 3 is a flowchart illustrating an example of overall processing by the information processing system according to the present embodiment. Hereinafter, as shown in the figure, the entire process will be described by dividing it into “preparation”, “pre-processing”, and “operation”. Each procedure does not need to be performed continuously. Each procedure may be performed repeatedly, in parallel, redundantly, or distributedly.

S01: Data Input Example In step S01, the information processing system inputs data used in “preprocessing” and “operation” in the subsequent stage. The input data is, for example, information related to an individual such as a subject's name, ID (Identification), age, gender, facial photograph, and blood type. Also, by this process, the input data is managed as being associated with each person, for example, as accumulated data D2.

  In addition, the process which identifies an object person is performed in a back | latter stage. Data used for this identification may be input. The identification data will be described later.

  Specifically, for example, the following data is input in step S01.

  FIG. 4 is a diagram illustrating an example of data input to the information processing system according to the present embodiment. Note that all the data shown in the figure is not essential, and some data may not be input. The data name may be another name.

  As described above, after the “preliminary preparation” process is performed, the “preprocessing” and the like are performed as follows, for example. Further, the following description will be given by taking as an example a case where the subject is a child and the subject is sleeping, so-called “napping”.

S02: Example of acquiring image data from imaging device In step S02, the information processing system acquires image data obtained by imaging the subject from the imaging device. Further, the acquired image data is identified as the accumulated data after being identified in the subsequent step S04. It should be noted that the time when the image data was captured is preferably stored together with the image data.

S03: Example of acquiring biological information from measurement device In step S03, the information processing system acquires biological information from the measurement device. In addition, the acquired biological information is stored as accumulated data after being identified in the subsequent step S04. It is desirable that the time when the biometric information is acquired is stored together with the biometric information.

  For example, the image data or biometric information acquired in step S02 and step S03 is acquired in the following format.

  FIG. 5 is a diagram illustrating an example of image data and biological information used by the information processing system according to the present embodiment. The illustrated data is not limited to data that can be directly acquired from a sensor or the like, and may be generated by analyzing the acquired data.

  Further, the image data and the biological information are not limited to the illustrated data. That is, all the data shown in FIG. 5 is not essential. Further, data other than the illustrated data may be further acquired.

S04: Identification example of subject In step S04, the information processing system identifies the subject based on the image data. That is, when there are a plurality of target persons shown in the image data, the information processing system identifies each target person. For identification, for example, the shape, pattern, or color of the bedding or a combination thereof is preferably used as follows.

  FIG. 6 is a diagram illustrating an identification example of the target person by the information processing system according to the present embodiment. As illustrated, in this example, it is assumed that a plurality of children are sleeping using bedding. Further, it is assumed that the bedding is provided with a pattern PTN as a decoration as illustrated. It is assumed that all the patterns PTN are different for each bedding and can be identified by the pattern PTN.

  First, before performing such identification, for example, data is input in the form shown in the figure by “preparation” or the like, and the stored data D2 is associated with the target person for identification. The image data indicating the bedding is input in advance. For example, the image data indicates an image obtained by capturing a pattern of the bedding as shown in “bedding (image)”. As shown in the figure, the bedding used by the child is determined in advance, and as shown in the figure, the image of “bedding (image)” is linked to the child of “name”.

  Then, the information processing system captures the sleeping child and generates image data (step S02). When the image data can be acquired in this way, the information processing system identifies bedding by pattern matching or the like based on the image data, and identifies the target person. As shown in the figure, when there are a plurality of target persons and the acquired image data and biometric information cannot be linked to which target person, the information processing system accumulates data in association with the target person. Can not. In particular, when data is accumulated over a long period of time, data for the same subject cannot be accumulated unless the data accumulated so far is associated with the image data and biometric information being acquired. On the other hand, in the present embodiment, even if there are a plurality of subjects, the subjects can be identified with high accuracy, so that data can be accumulated even for a long period of time.

  Further, when the identification using the bedding is performed, for example, the subject can be identified even when the bedding covers the face of the subject.

  Note that the identification is not limited to the method of identifying only by the bedding indicated by the image data as described above. For example, identification may be performed in combination with face authentication or the like.

S05: Example of Accumulating Biometric Information In step S05, the information processing system accumulates biometric information and the like as accumulated data. The biometric information is accumulated based on the identification result in step S04. That is, biometric information is linked and stored for each identified individual.

S06: Analysis Example of Trend In step S06, the information processing system analyzes the tendency of each target person for each target person. For example, the information processing system performs the following analysis.

  FIG. 7 is a diagram illustrating an analysis example for identifying the time for the target person to turn over by the information processing system according to the present embodiment. Hereinafter, an example in which the target persons are “target person A” and “target person B” will be described.

  For example, as shown in the figure, the information processing system determines how much time has passed since each subject person started sleeping (in the figure, the time indicated as “sleep start”). Predict and output the specific result ANS.

  For example, the specified result ANS is specified based on a sleep stage or the like as illustrated. The “sleep progress diagram” shown in the figure is a diagram quoted from (http://jssr.jp/kiso/hito/hito04.html). For example, as shown in the figure, when it is assumed that the sleep stage changes, it is possible to predict a time zone or the like having a high probability of turning over from the depth of sleep or the like. That is, there are many cases where the timing of turning over is correlated with the depth of sleep. Therefore, the depth of sleep of each person is analyzed from the accumulated data and the like, and a time zone or the like with a high probability of falling over is predicted.

  Further, the specified result ANS may be specified based on a time zone in which the accumulated data is analyzed and the player has turned over in the past. In addition, the specific result ANS may be specified on the basis of the period of sleep of about 90 minutes.

  Furthermore, the timing of turning over may be the timing at which the depth changes. Specifically, the timing at which the depth changes is the timing at which the “sleep stage” changes in the “sleep progress diagram”. For example, in the illustrated example, at “1 hour”, “sleep stage” transitions from “4” to “3”. At such a timing, the roll is often hit. Therefore, the information processing system may predict the timing at which the depth changes in this way as the timing to turn over.

  In some cases, children and the like may turn into postures that make it difficult to breathe. Therefore, as described above, when the tendency of the time of turning over, etc. can be predicted in advance, nursery teachers etc. should be particularly wary of the time of turning over, etc., and prevent children from having difficulty breathing, etc. Can do.

  Further, by analyzing the tendency, the information processing system can detect an abnormality during “operation”. That is, the information processing system identifies the normal state of the child by analysis based on the accumulated data.

  When the “preprocessing” as described above is performed, for example, data can be generated in the following format.

  FIG. 8 is a diagram illustrating an example of data generated by “preprocessing” by the information processing system according to the present embodiment. Note that the result of the “pre-processing” need not be in the form shown in the figure. That is, the result of “pre-processing” may be data in a format other than the data collected in two data, “rolling determination data” and “abnormality determination data” as illustrated.

  After the above “preprocessing” and parallel or “preprocessing”, “operation” or the like is performed as follows, for example.

S07: Example of Acquisition of Image Data from Imaging Device In step S07, the information processing system acquires image data obtained by imaging the subject from the imaging device. For example, the image data is acquired by the same method as in step S02.

S08: Example of obtaining biological information from measurement device In step S08, the information processing system obtains biological information from the measurement device. For example, the biological information is acquired by the same method as in step S03.

S09: Determination example of whether or not an abnormality has occurred In step S09, the information processing system determines whether or not an abnormality has occurred in the subject. For example, the determination of abnormality is made based on the tendency analyzed as follows.

  FIG. 9 is a block diagram illustrating an abnormality determination example by the information processing system according to the present embodiment. Hereinafter, an example of detecting an abnormality using the biological information D1 of the heart rate will be described. First, as shown in the figure, accumulated data D2 is accumulated for a certain period. For example, it is assumed that the accumulated data D2 is accumulated for several months to several years (step S05). Then, the information processing system calculates a statistical value D3 based on the accumulated data D2 (step S06). The statistical value D3 is, for example, an average value “μ” or the like. In addition, the statistical value D3 includes standard deviations “σ”, “3σ”, and the like. For example, the information processing system detects an abnormality based on the statistical value D3 calculated in this way.

  Specifically, in “operation”, the information processing system acquires biological information D1 such as a heart rate (step S08). The determination of whether or not there is an abnormality is a determination of “abnormal” if it is different from the “normal state”, and “normal” if it is “normal state”. Then, whether or not “normal state” is determined, for example, by whether or not the current biological information D1 is “average value ± standard deviation (μ ± σ)”. That is, if the current biological information D1 is within the numerical value of “average value ± standard deviation (μ ± σ)”, the information processing system determines “normal state” (NO in step S09). On the other hand, if the current biological information D1 is outside the value of “average value ± standard deviation (μ ± σ)”, the information processing system determines “abnormal state” (YES in step S09).

  That is, if the heart rate is a value near the average value, the subject is determined to be in a healthy state and “normal”. On the other hand, if the heart rate is a clearly high value or a clearly low value, the subject is determined to be “abnormal”.

  Note that the method for determining whether or not there is an abnormality is not limited to the above method. For example, “average value ± standard deviation (μ ± σ)” may be “average value ± 3 × standard deviation (μ ± 3σ)”.

  The determination of whether or not there is an abnormality may be made by so-called AI (Artificial Intelligence) or the like. That is, the learning process may be performed in advance using accumulated data, abnormality determination records, and the like as learning data, and it may be determined whether there is an abnormality based on the learning result.

  Furthermore, the method for determining whether or not there is an abnormality may be a method for determining based on biological information other than the heart rate. For example, the physical condition of the subject is detected based on the image data. The physical condition includes, for example, a drought state, a state of whether or not crying, a state of whether or not coughing, the presence or absence of a runny nose, or a state of redness.

  In addition, as a result of the determination, the information processing system may output an abnormality occurrence time, a symptom, or a disease name.

  If the information processing system determines that an abnormality has occurred (YES in step S09), the information processing system proceeds to step S10. On the other hand, if the information processing system determines that no abnormality has occurred (NO in step S09), the information processing system proceeds to step S13.

S10: Notification example to childcare worker In step S10, the information processing system notifies a childcare worker or the like. That is, the information processing system notifies a childcare person or the like that an abnormality has occurred. Specifically, the information processing system issues an alarm or the like.

S11: Example of generating report information In step S11, the information processing system generates report information. In this case, since an abnormality has occurred (YES in step S09), an ambulance is arranged. First, it is assumed that a report is made to an ambulance or a medical institution by a childcare worker or an operator. In addition, for example, when the notification is made in step S10 and the action by the nursery teacher or the like does not start even after a predetermined time has passed, the operator or the like may notify the emergency contact or medical institution. . In response to this report, the information processing system generates report information based on biometric information and the like. For example, the report information is generated as follows.

  FIG. 10 is a diagram illustrating an output example of report information generated by the information processing system according to the present embodiment. For example, as shown in the figure, a screen for displaying the report information is output by a portable terminal or the like. With such a display, the report information is transmitted to emergency personnel, medical institution staff, and the like.

  Therefore, the report information includes location information that can identify the location where the abnormality occurred, the name of the subject in which the abnormality occurred, the biological information of the subject in which the abnormality occurred, an image showing the subject in which the abnormality occurred, and the abnormality occurred The information is preferably information indicating the time, the elapsed time since the occurrence of the abnormality, the name of the reporter reporting the abnormality, the contact information of the reporter, and the status of the abnormality.

  In addition, it is desirable for the report information to include items specified in the guidelines of the Cabinet Office “Children and Childcare Conference”. For example, the guideline is “Guidelines for preventing accidents and responding to accidents in educational and childcare facilities” (March 2016) (http://www8.cao.go.jp/shoushi/shinseido/meeting /kyouiku_hoiku/pdf/guideline1.pdf) (P.35 <Reference Example 5>). That is, when the information processing system generates the notification information so as to include the items as described above, it is possible to convey the matters defined in the guidelines and the like without omission. In particular, in a state where an abnormality has occurred, nursery teachers and the like are often frustrated, so it is often difficult to make a normal determination, and information transmission may be inaccurate. Therefore, by transmitting the report information in a format as shown in the figure, accurate information can be transmitted to medical personnel and the like even in an emergency.

  Specifically, as shown in the figure, when information such as “breathing cannot be detected for a certain period of time” is displayed, it is understood that an abnormality has occurred in the subject regarding breathing. For example, the information as illustrated is generated based on the determination result in step S09.

  The “abnormality occurrence time” displays the time when it is determined that an abnormality has occurred in step S09 (YES in step S09). In this way, the time when the abnormality occurred is transmitted.

  “Name”, “Gender”, “Age”, “Blood Type”, and the like are displayed based on the information input in step S01, for example. In this way, the name and the like of the subject in which an abnormality has occurred is communicated.

  The “elapsed time” displays, for example, the time elapsed from the time when it was determined that an abnormality occurred in step S09 (YES in step S09). In this way, the elapsed time after the occurrence of the abnormality is transmitted.

  The “target infant image” is displayed based on, for example, the image data acquired in step S07. In this way, an image showing the subject in which an abnormality has occurred and the state of the abnormality are transmitted.

  “Respiration”, “pulse”, “previous sleep state”, and the like are displayed based on the biological information acquired in step S08, for example. In this way, the biological information and the like of the subject who has an abnormality is transmitted.

  “Contact information” is displayed based on the information input in step S01, for example. In this way, the contact information of the reporter is communicated.

  The “reporter name” is displayed based on, for example, the information input in step S01. In this way, the name of the reporter reporting the abnormality is communicated.

  The report information is not limited to the format shown in the figure. That is, the report information may include items other than those illustrated.

S12: Example of generation of correspondence record In step S12, the information processing system generates a correspondence record.

  Childcare facilities, etc. are obliged to create a response record and submit a response record to the national or local government in the event of an accident.

  FIG. 11 is a diagram illustrating an example of information included in the correspondence record generated by the information processing system according to the present embodiment. For example, the information processing system generates items as illustrated, and inputs information corresponding to each item based on biometric information, image data, and the like.

  Specifically, the information processing system inputs the information and the like input in step S01 into “name of subject”, “sex”, “date of birth”, “location of occurrence”, and the like.

  The information processing system inputs biological information such as respiration or pulse as the “reason for decision to visit”.

  Further, the information processing system can specify the date and time when the accident occurred (that is, the time determined to be abnormal) based on biological information such as breathing or pulse. Then, using the identified result, the information processing system inputs “accident occurrence date”.

  Furthermore, the information processing system can specify the time when a report is made to a medical institution or the like by generating report information. In this way, the information processing system inputs “accident occurrence date”. Then, using the identified result, the information processing system inputs “a hospital contact (emergency request) time”.

  In addition, the form which a childcare person etc. describes may fill in each item. Thus, the information processing system supports the creation of the correspondence record by creating a part or all of the correspondence record.

  It is desirable that the response records be created as prescribed by the guidelines of the “Children and Child Care Conference” of the Cabinet Office. For example, the guideline is “Guidelines for preventing accidents and responding to accidents in educational and childcare facilities” (March 2016) (http://www8.cao.go.jp/shoushi/shinseido/meeting /kyouiku_hoiku/pdf/guideline3.pdf) (P.5 (3) Accident situation record). According to this guideline, “Do not consult with other staff before recording or during recording”, etc., so it is not clear what items should be entered, etc. The burden may be large. In view of this, the information processing system reduces the load of creating a document by providing a so-called format for items as shown in the figure. In addition, by submitting image data and the like together, it is possible to convey a more accurate accident situation.

  In addition, the information processing system desirably stores data such as correspondence records, accumulated data, image data, and biological information. That is, in the event of an accident, the information processing system is set to prohibit data deletion or change so that various data is not deleted or modified in order to investigate the situation of the accident later. In this way, the data used to elucidate the accident can be stored until elucidation.

S13: Example of generation of check record In step S13, the information processing system generates a check record such as a check sheet. Note that step S13 may be a process executed when a childcare person or the like operates. That is, in step S13, a record such as a so-called “nap check sheet” is generated. For example, the information processing system generates a check record such as a check sheet as follows.

  FIG. 12 is a diagram illustrating an example of information included in a check record generated by the information processing system according to the present embodiment. If items such as the one shown in the figure are provided, for example, the Ministry of Health, Labor and Welfare's “Non-approved Childcare Facility Guidance Supervision Standard” (http://www.mhlw.go.jp/file/06-Seisakujouhou-11900000-Koyoukintoujidoukateikyoku/0000159998. pdf) A check sheet can be created in a format that conforms to (7) Prevention of sudden infant death syndrome described in (P.42), and is automatically filled in based on the acquired biometric information and the like.

  In addition, if items such as the one shown in the figure are provided, for example, the “Handbook for Authorizing Nursery Centers” (http://www.fukushihoken.metro.tokyo.jp/kiban/ jigyosha / hoikushisetsukensa / heisei28nendohoikusyokosyukai.files / ninkahoikushokoushuukai_part5.pdf) (P.171) can be used to create a check sheet.

  Furthermore, if items such as those shown in the figure are provided, for example, “Checklist at noon” (http://www.city.kawasaki.jp/450/cmsfiles/contents/0000077/77169/2kenkouyousiki. pdf) can be created in the format described in (P.23 to P.26).

  Therefore, the information processing system supports the creation of a check record to be submitted to the country or local government as described above by generating a check sheet or the like.

  For example, the following data is acquired when performing the “operation” process as described above.

  FIG. 13 is a diagram illustrating an example of data acquired by the information processing system according to the present embodiment in “operation” or the like. For example, in the “operation” process, data as illustrated is acquired. The illustrated data may be acquired by a process other than “operation”.

  If there is data such as “noon check time” shown in the figure, the information processing system can input the check time and the like to generate a check record in step S13.

  In addition, when there is data such as “accident (abnormality) occurrence date and time, day of the week”, the information processing system can generate report information, response records, and the like in steps S11 and S12.

<Functional configuration example>
FIG. 14 is a functional block diagram illustrating a functional configuration example of the information processing system according to the present embodiment. For example, as illustrated, the information processing system 10 includes an image acquisition unit 10F1, a biological information acquisition unit 10F2, an identification unit 10F3, a data storage unit 10F4, an analysis unit 10F5, an abnormality detection unit 10F6, and notification information. The functional configuration includes a generation unit 10F7, a correspondence record generation unit 10F8, and a check record generation unit 10F9.

  The image acquisition unit 10F1 performs an image acquisition procedure for acquiring image data IMG indicating the target person such as a child and the periphery of the target person from the imaging apparatus. For example, the image acquisition unit 10F1 is realized by the interface 11H6 or the like.

  The biometric information acquisition unit 10F2 performs a biometric information acquisition procedure for acquiring the biometric information D1 of the subject person from the measurement device. For example, the biological information acquisition unit 10F2 is realized by the interface 11H6 or the like.

  The identification unit 10F3 performs an identification procedure for identifying the target person based on the image data IMG acquired by the image acquisition unit 10F1. For example, the identification unit 10F3 is realized by the CPU 11H1 or the like.

  The data storage unit 10F4 stores the biometric information D1 acquired by the biometric information acquisition unit 10F2 and the image data IMG acquired by the image acquisition unit 10F1 as storage data in association with the subject identified by the identification unit 10F3. Perform the accumulation procedure. For example, the data storage unit 10F4 is realized by the storage device 11H2 or the like.

  The analysis unit 10F5 performs an analysis procedure for analyzing the tendency of the subject based on the accumulated data accumulated by the data accumulation unit 10F4. For example, the analysis unit 10F5 is realized by the CPU 11H1 or the like.

  The abnormality detection unit 10F6 performs an abnormality detection procedure for detecting an abnormality based on the tendency. For example, the abnormality detection unit 10F6 is realized by the CPU 11H1 or the like.

  The report information generation unit 10F7, when an abnormality occurs, the location information that can identify the location where the abnormality has occurred, the name of the subject in which the abnormality has occurred, the biological information of the subject in which the abnormality has occurred, and the subject in which the abnormality has occurred. Notification information generation procedure for generating notification information that shows at least the image to show, the time when the abnormality occurred, the elapsed time since the abnormality occurred, the name of the reporter reporting the abnormality, the contact information of the reporter and the status of the abnormality, etc. I do. For example, the report information generation unit 10F7 is realized by the CPU 11H1 or the like.

  When an abnormality occurs, the correspondence record generation unit 10F8 performs a correspondence record generation procedure for generating a correspondence record in a format specified by the national or local government guidelines. For example, the correspondence record generation unit 10F8 is realized by the CPU 11H1 or the like.

  The check record generation unit 10F9 performs a check record generation procedure for generating a check record that associates the time when the biometric information is acquired, the biometric information, and the image data. For example, the check record generation unit 10F9 is realized by the CPU 11H1 or the like.

<Summary>
With the functional configuration as illustrated, the information processing system 10 can identify the target person by the identification unit 10F3. For example, the information processing system 10 identifies the target person by a method as shown in FIG. Therefore, the data storage unit 10F4 can store data for each target person. Further, even on different days, the information processing system 10 can recognize the target person with high accuracy, and thus can accumulate the accumulated data for a long period of time. For example, if there is biological information accumulated for a long period of time such as several months or more, a tendency or the like can be analyzed with high accuracy.

  Specifically, the information processing system 10 performs processing using, for example, the following data.

  FIG. 15 is an example of data used in processing by the information processing system according to the present embodiment. In this example, first, in step S01, “child ID”, “basic video”, “futon video”, and the like are input. If there is such data, the information processing system can identify the subject in step S04. Therefore, the image such as “video” acquired in step S07 or the like is associated with the target person. In this way, the information processing system can accumulate data for each target person.

  Then, as illustrated, when the biological information such as “breathing”, “pulse”, and “body motion” is acquired and the data is accumulated, for example, the information processing system can determine the sleep depth. Further, as illustrated, when there is a “child ID” and the subject person can be identified, the information processing system can determine the sleep depth for each subject person.

  Subsequently, when the tendency is analyzed, such as “turning determination data” based on the accumulated data, the information processing system can specify the time to turn over based on the determination result of the sleep depth, for example. .

  FIG. 16 is an example of data used by each function of the information processing system according to the present embodiment. Each function shown in the functional block diagram uses data as shown in the figure, for example.

  As illustrated, when the identification unit 10F3 identifies the target person, the biological information acquired by the biological information acquisition unit 10F2 such as “body temperature”, “breathing”, “pulse”, and “children's posture (orientation)” Every time, the data is accumulated by the data accumulating unit 10F4.

  When the analysis unit 10F5 performs analysis based on the accumulated data, the analysis unit 10F5 can analyze the tendency such as “abnormality determination data”. Thus, when the tendency is known, the abnormality detection unit 10F6 can detect whether there is an abnormality in “breathing” and “pulse”. Further, if there is identification data such as “child ID”, analysis and abnormality detection can be performed for each subject.

  For example, in the functional configuration including the check record generating unit 10F9, when the information processing system inputs “children's name” and the like in advance, the target person is identified and “body temperature” “Breathing”, “Pulse”, “Children's posture (orientation)”, “Children's image”, etc. can be input to the check record. By performing such processing, the information processing system can reduce the load of creating a check record document. In particular, if there are items of “breathing” and “children's posture (orientation)”, a check record that satisfies the standards set by the Ministry of Health, Labor and Welfare can be created.

  For example, in the functional configuration including the correspondence record generation unit 10F8, if the information processing system inputs “children's name”, “gender”, “birth date”, etc. in advance, the target person is identified and an abnormality is detected. When you wake up, “Children's name”, “Gender”, “Birth date”, “Accident (abnormality) occurrence date and time, day of the week”, “Breathing”, “Pulse” and “Hospital contact (emergency request) time” Etc. can be input to the correspondence record. By performing such processing, the information processing system can reduce the load of creating the correspondence record document. In particular, items such as “children's name”, personal identification results (images, etc.), “gender”, “birth date”, “accident (abnormality) occurrence date, day of the week”, and “hospital contact (emergency request) time” If there is, a response record that meets the criteria of the accident report can be created.

  For example, in the functional configuration including the notification information generation unit 10F7, the information processing system inputs the “child name”, “age (month age)”, “sex”, “blood type”, and the like in advance. If an abnormality occurs after identification, “accident (abnormality) occurrence date, day of the week”, “elapsed time since occurrence”, “child name”, “age (month)”, “sex”, “blood type” , "Breath", "Elapsed time since the end of breathing", "Pulse", "Elapsed time since the end of the pulse", "Sleep depth" and "Nursing facility information (location etc.)" Can be generated. By performing such processing, the information processing system can assist in appropriately responding to an emergency by showing report information.

<Terminology>
For example, the biological information indicates respiration, pulse, body movement, body temperature, or a combination thereof. Further, the type or setting of the measuring device may be changed depending on any biological information.

<Modification>
In the overall configuration shown in FIG. 1, the “119th notification” or the like may be performed by the operator M3 or the like. In this case, the operator M3 makes a report with reference to the report information and the like. The reported content may include a hearing result from a childcare worker or the like. At the time of this notification, the content of the notification information is read out. Therefore, it is desirable that the content to be read out is checked and recorded by the information processing system. Specifically, the information processing system recognizes the content to be read out by voice. Then, the information processing system checks whether the report information matches the read content. Next, when the report information does not match the read-out contents, the information processing system prompts correction by, for example, pointing out the contents that do not match by voice or flashing them on the screen. Like that. On the other hand, when the report information matches the read content, the information processing system displays, for example, notifying that they match. In this way, the information processing system may check the consistency of the reported content.

  In addition, the information processing system, the check result, and the like may be shared by the information processing system by generating and storing a record on the data center side or the like. For example, the reported content may be voice-recognized and recorded as the reported content. Furthermore, when the notification is made by the operator M3 or the like, the information processing system may notify the time when the notification is made to the mobile terminal 14 or the like.

  In addition, the information processing system may have a so-called escalation function. For example, when an abnormality is detected, the information processing system first notifies the mobile terminal 14 or the like (hereinafter referred to as “first contact”), that is, a childcare worker or the like. Note that the information processing system may first notify the operator M3 of an abnormality, and then the operator M3 may notify the childcare worker or the like of the abnormality. Then, the information processing system measures the time that has elapsed since the abnormality was notified to the first contact. Next, the information processing system determines whether or not the time that has passed since the abnormality notification has passed a predetermined time set in advance. The predetermined time is set in advance.

  From an emergency standpoint, it is desirable to take action as soon as possible after an abnormality occurs. Therefore, from the viewpoint of emergency, it is desirable to set the predetermined time as short as possible. On the other hand, if the time is set too short, the escalation function may be activated even if the response is in time. Therefore, it is desirable that the predetermined time is set to a value that is acceptable in an emergency and is less likely to escalate frequently. For example, the predetermined time is preferably set to a value of about “30 seconds” to “2 minutes”.

  Subsequently, when it is determined that the predetermined time has elapsed, the information processing system notifies the contact other than the mobile terminal 14 (hereinafter referred to as “second contact”) of abnormality. The second contact address is set in advance. The second contact information may be plural.

  That is, if an abnormality occurs and the childcare person does not have an appropriate response even after a predetermined time has elapsed since the abnormality notification is given, the information processing system notifies the other staff or the like of the abnormality. With such a function, for example, when a plurality of abnormalities occur and a childcare person or the like responds to one abnormality, the response of the other abnormality may be delayed. Therefore, the information processing system also notifies the second contact other than the first contact. Even in such a case, it is possible to establish a system in which a plurality of persons can respond by notifying another staff member or the like, and it is possible to prevent the response to the abnormality from being too late.

  The biological information may be acquired from other than image data. For example, the information processing system may include a sensor such as a heart rate monitor. In this case, the identification unit 10F3 connected to a sensor such as a heart rate monitor (not shown) may identify the target person based on the ID of each sensor such as a heart rate monitor and provide it to the data storage unit 10F4.

  The imaging device may have spectral sensitivity other than visible light. For example, it is desirable for the imaging device to have spectral sensitivity in the near infrared ray. When the subject is sleeping, the vicinity of the subject is often in a dark lighting condition. Therefore, when the near infrared rays have spectral sensitivity, the imaging apparatus can generate image data obtained by imaging the subject even under dark illumination conditions.

  The target audience is not limited to children. That is, the target person may be a person who is a target of so-called “watching”. Therefore, the subject may include a care recipient, an elderly person, or a sick person.

  Guidelines other than the above may be used as reference guidelines. For example, the items provided in the record may be set based on a format determined by laws, rules, recommended formats, or standards by the national, local government, or other organizations. In addition, when a guideline etc. differ for every area and an item differs, an item may be set for every area.

<Other application examples>
The best mode for carrying out the present invention has been described above with reference to the embodiments. However, the present invention is not limited to these embodiments, and various modifications can be made without departing from the scope of the present invention. And substitutions can be added.

  The configuration examples shown in the overall configuration diagram and the functional block diagram are divided according to main functions in order to facilitate understanding of the information processing method by the information processing system. Therefore, the invention of the present application is not limited by the method of dividing the processing unit, the name, and the like. In addition, the processing by the information processing system can be divided into more processing units according to the processing content. Moreover, it can also divide | segment so that one process unit may contain many processes.

  Note that all or part of each processing according to the present invention may be described by various program languages and realized by a program for causing a computer to execute an information processing method. That is, the program is a computer program for causing a computer such as an information processing apparatus or an information processing system including one or more information processing apparatuses to execute each process.

  Therefore, when the information processing method is executed based on the program, the calculation device and the control device included in the computer perform calculation and control based on the program in order to execute each process. In addition, a storage device included in the computer stores data used for processing based on a program in order to execute each processing.

  The program can be recorded and distributed on a computer-readable recording medium. The recording medium is a medium such as a magnetic tape, a flash memory, an optical disk, a magneto-optical disk, or a magnetic disk. Furthermore, the program can be distributed through a telecommunication line.

  The sensor is an example of a measurement device. A child is an example of a subject. Furthermore, the server 11 is an example of an information processing apparatus.

DESCRIPTION OF SYMBOLS 10 Information processing system 11 Server 12 Imaging device 13 Sensor 14 Portable terminal 10F1 Image acquisition part 10F2 Biometric information acquisition part 10F3 Identification part 10F4 Data accumulation part 10F5 Analysis part 10F6 Abnormality detection part 10F7 Notification information generation part 10F8 Correspondence record generation part 10F9 Check record Generation part D1 Biometric information D2 Accumulated data D3 Target person IMG Image data PTN Pattern ANS Determination result M1, M2 Child M3 Operator M4 Childcare person

Claims (15)

An information processing system having at least an imaging device that images a subject, a measurement device that senses the subject, and an information processing device connected to the imaging device and the measurement device,
An image acquisition unit that acquires image data indicating the subject and the surroundings of the subject from the imaging device;
A biological information acquisition unit that acquires biological information of the subject from the measurement device;
When the target person is a plurality of persons, an identification unit that identifies the target person based on the image data;
A data accumulating unit that accumulates accumulated data including the image data and the biological information in correspondence with the subject identified by the identification by the identifying unit;
An information processing system including an analysis unit that analyzes the tendency of the subject based on the accumulated data. The identification unit is
Identify based on the shape, pattern or color of bedding used by the subject or a combination thereof,
The information processing system according to claim 1, wherein if the bedding is the same, the information processing system identifies the same subject. The analysis unit
For each subject identified by identification by the identification unit, identify a normal state based on the accumulated data,
The information processing system according to claim 1, wherein the subject is determined to be abnormal if the biological information is not in the normal state. The analysis unit
The information processing system according to any one of claims 1 to 3, wherein a time for the subject person to turn over is specified. 5. The information processing system according to claim 1, further comprising a check record generation unit configured to generate a check record in which the biological information is acquired, the biological information, and the image data. When an abnormality occurs,
The information processing system according to any one of claims 1 to 5, further comprising a correspondence record generation unit that generates a correspondence record in a format defined by the national or local government guidelines. When an abnormality occurs,
Location information that can identify the location where the abnormality has occurred, the name of the subject in which the abnormality has occurred, the biological information of the subject in which the abnormality has occurred, an image showing the subject in which the abnormality has occurred, the time when the abnormality occurred, 7. A notification information generating unit for generating notification information including at least an elapsed time after the occurrence of an abnormality, a name of a reporter who reports the abnormality, a contact information of the reporter, and an abnormal situation. The information processing system according to any one of claims. The information processing system according to claim 7, wherein it is checked whether or not the report information matches the reported content. When an abnormality occurs and a report is made,
The information processing system according to any one of claims 1 to 8, wherein the reported content is recognized by voice. When an abnormality occurs,
Announce the abnormality to the first contact,
When a predetermined time elapses after the abnormality notification is made to the first contact,
The information processing system according to any one of claims 1 to 9, wherein an abnormality notification is further sent to the second contact address. The information processing system according to any one of claims 1 to 10, wherein the biological information indicates respiration, pulse, body motion, body temperature, or a combination thereof. The information processing system according to claim 1, wherein the target person is a child. An information processing system having at least a measurement device for sensing a child and an information processing device connected to the measurement device,
A biological information acquisition unit for acquiring biological information of the child from the measurement device;
When there are a plurality of the children, an identification unit for identifying the children,
A data accumulating unit for accumulating accumulated data including the biological information in correspondence with the child identified by the identification by the identifying unit;
An analysis unit for analyzing the tendency of the child based on the accumulated data;
An information processing system including an abnormality detection unit that detects an abnormality based on the tendency. An information processing method performed by an information processing system including at least an imaging device that images a subject, a measurement device that senses the subject, and an information processing device connected to the imaging device and the measurement device,
An image processing procedure for the information processing system to acquire image data indicating the target person and the periphery of the target person from the imaging device;
A biological information acquisition procedure in which an information processing system acquires biological information of the subject from the measurement device;
When the information processing system includes a plurality of the target persons, an identification procedure for identifying the target persons based on the image data;
A data storage procedure in which the information processing system stores the stored data including the image data and the biological information in correspondence with the subject identified by the identification by the identification procedure;
An information processing method, wherein the information processing system includes an analysis procedure for analyzing a tendency of the target person based on the accumulated data. An information processing method performed by an information processing system having at least a measurement device for sensing a child and an information processing device connected to the measurement device,
An information processing system for acquiring biological information of the child from the measuring device;
When the information processing system includes a plurality of the children, an identification procedure for identifying the children;
A data storage procedure in which the information processing system stores the stored data including the biological information in correspondence with the child identified by the identification in the identification procedure;
An analysis procedure in which the information processing system analyzes the tendency of the child based on the accumulated data;
An information processing method, wherein the information processing system includes an abnormality detection procedure for detecting an abnormality based on the tendency.

Images