JP6519181B2 - Method for monitoring trend of change in disorder degree, program for monitoring trend in change in disorder degree and device for monitoring trend in change in disorder degree - Google Patents

Description

  The present invention relates to a method of monitoring the tendency of change in disorder degree, a program for monitoring the tendency of change in disorder degree, and a device for monitoring the tendency of change in disorder degree.

  In recent years, there has been an increase in demand for nursing care facilities for elderly people. Elderly people with various levels of daily living behavior are accepted in the care facility. It has been proposed to install a camera with a wide angle of view on a television receiver in order to monitor such an elderly person, a child, etc. in a room from a remote place. In addition, there has been proposed a system for watching an elderly person based on information of a sensor installed in an elderly person's home and information of a diary inputted by the elderly person.

Japanese Patent Application Publication No. 2003-044960 JP, 2005-115413, A

  However, the staff at the nursing care facility will continue to observe daily living activities of the elderly who are moving in, even if monitoring using a camera or sensor, in order to cope with a large number of elderly people with a small number of staff members. It is difficult to do. For this reason, it is difficult to grasp changes in the ability of daily living activities of the elderly.

  In one aspect, the present invention provides a method of monitoring the tendency of change in disorder degree, a program for monitoring the tendency of change in disorder degree, and a trend monitor of the change in degree of disorder that can detect a decline in living ability of a resident. is there.

  In one aspect, the computer monitors the process of calculating the degree of randomness of the predetermined area by analyzing the tendency of the change in the degree of randomness by analyzing the captured image of the predetermined area sequentially acquired as time passes. Run. Also, the method of monitoring the tendency of the change in the degree of randomness is such that if it is detected that the tendency of the temporal change in the degree of randomness thus calculated shows a change to a tendency towards higher degree of randomness, or The computer executes processing for giving a predetermined notification when it is detected that the increasing speed indicates a change to a tendency to become faster.

  We can detect the decline in the living ability of the tenants.

FIG. 1 is a block diagram showing an example of the configuration of a monitoring system according to the embodiment. FIG. 2 is a diagram showing an example of a resident database. FIG. 3 is a diagram showing an example of the camera installation table. FIG. 4 is a diagram showing an example of a sensing information database. FIG. 5 is a diagram showing an example of the characteristic determination table. FIG. 6 is a diagram showing an example of the message database. FIG. 7 is a diagram showing an example of the state of the room of the resident of characteristic A. As shown in FIG. FIG. 8 is a diagram showing an example of the state of the room of the resident of characteristic B. As shown in FIG. FIG. 9 is a view showing an example of the state of the room of the resident of characteristic C. As shown in FIG. FIG. 10 is a diagram showing an example of the notification screen. FIG. 11 is a diagram showing another example of the notification screen. FIG. 12 is a flowchart showing an example of the recording process. FIG. 13 is a flowchart illustrating an example of the characteristic determination process. FIG. 14 is a flowchart showing an example of the characteristic determination subroutine. FIG. 15 is a flowchart illustrating an example of the notification process. FIG. 16 is a flowchart showing another example of the notification process. FIG. 17 is a flowchart illustrating another example of the notification process. FIG. 18 is a diagram showing an example of calculation of the degree of randomness when the height is used as the index of degree of randomness. FIG. 19 is a diagram illustrating an example of a computer that executes a monitoring program.

  Hereinafter, with reference to the drawings, an embodiment of a method of monitoring a tendency of change in randomness, a program of monitoring a tendency of change in randomness and a method of monitoring a tendency of change in randomness will be described in detail. The disclosed technology is not limited by the present embodiment. In addition, the following embodiments may be combined as appropriate as long as no contradiction arises.

  FIG. 1 is a block diagram showing an example of the configuration of a monitoring system according to the embodiment. The monitoring system 1 shown in FIG. 1 provides, for example, information for monitoring the state of cluttering of the living room by the tenants in a tenant-equipped tenant facility for elderly people, which is an example of the tenant facility 10. The monitoring system 1 illustrated in FIG. 1 includes cameras 11 a to 11 e, an administrator terminal 50, and a server device 100. The cameras 11 a to 11 e are installed in each of the sections 10 a of the entering facility 10. In the following description, when the cameras 11a to 11e are not distinguished from one another, they are simply referred to as the camera 11.

  The moving-in facility 10 has a plurality of sections of a room layout similar to the sections 10a, and in each section, a plurality of cameras 11 are installed at each place as in the section 10a. In addition, although the following description demonstrates as an example the division 10a among several divisions, the number of divisions is not limited, The monitoring system 1 has the camera 11 installed in arbitrary numbers of divisions It is also good. Although FIG. 1 shows the case where the system has one administrator terminal 50, the number of administrator terminals 50 is not limited, and the monitoring system 1 has an arbitrary number of administrator terminals 50. May be

  The camera 11, the administrator terminal 50, and the server apparatus 100 are communicably connected to each other via the network N. As the network N, any type of communication network such as the Internet, LAN (Local Area Network) or VPN (Virtual Private Network) can be adopted regardless of wired or wireless.

  The monitoring system 1 calculates the degree of randomness of the living room by analyzing the captured images of the living room sequentially acquired according to the passage of time with the camera 11 installed in each living room of the section 10a in which the elderly people move. If it is detected that the tendency of the temporal change in the calculated degree of randomness tends to be a higher degree of randomness or a tendency to increase the speed of the degree of randomness, the monitoring system 1 may Notify the administrator that clearing up has become impossible. As a result, since the monitoring system 1 monitors the change in the daily living movement of the resident, it is possible to detect the decline in the living ability of the resident. Also, when it is detected that the monitoring system 1 tends to change the calculated degree of randomness in time to a lower degree of randomness or a tendency in which the speed of increasing randomness becomes slower. Inform the administrator that cleaning has begun. As a result, the monitoring system 1 monitors the change in the daily living behavior of the tenant, so that it is possible to detect the tenant's effort for independence.

  The camera 11 is, for example, a network camera having a communication function, and transmits the captured image to the server device 100 by being connected to the network N. That is, the camera 11 is an imaging sensor and is a sensor that detects the state of a specific area. The camera 11 captures an image using, for example, a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor as an imaging element. The camera 11 photoelectrically converts light received by the imaging device and performs A / D (Analog / Digital) conversion to generate an image. The camera 11 transmits the generated image to the server device 100 via the network N. The camera 11 may receive an instruction such as a shooting direction from the server device 100 to change the shooting direction. Also, the camera 11 is installed, for example, at the center or corner of the ceiling of each living room of the section 10a.

  The manager terminal 50 is, for example, a computer used by a manager of the tenant facility 10. The administrator terminal 50 displays information and the like regarding the tidying up of the tenants of each section in the entering facility 10 received from the server device 100 and presents the information to the administrator. As an example of the manager terminal 50, a portable personal computer can be employed. Not only a portable terminal such as the personal computer described above but also a stationary personal computer may be adopted as the administrator terminal 50 for the administrator terminal 50. In addition to the above personal computer, the administrator terminal 50 employs, for example, a tablet terminal, a smart phone, a mobile communication terminal such as a mobile phone or PHS (Personal Handyphone System), as a portable terminal. It can also be done.

  Next, the configuration of the server device 100 will be described. As shown in FIG. 1, the server apparatus 100 includes a communication unit 110, a storage unit 120, and a control unit 130. In addition to the functional units shown in FIG. 1, the server apparatus 100 may have various functional units of a known computer, for example, functional units such as various input devices and voice output devices.

  The communication unit 110 is realized by, for example, a network interface card (NIC). The communication unit 110 is connected to the camera 11 and the administrator terminal 50 by wire or wireless via the network N, and is a communication interface that manages communication of information between the camera 11 and the administrator terminal 50. The communication unit 110 receives an image from the camera 11 and receives control information from the administrator terminal 50. The communication unit 110 outputs the received image or control information to the control unit 130. The communication unit 110 also transmits a notification screen or the like input from the control unit 130 to the administrator terminal 50.

  The storage unit 120 is realized by, for example, a semiconductor memory device such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 includes a resident database 121, a camera installation table 122, a sensing information database 123, a characteristic determination table 124, and a message database 125. In the following description, a database is abbreviated as DB. Further, the storage unit 120 stores information used for processing in the control unit 130.

  The tenant DB 121 stores tenants who move in each section in association with a manager, characteristics, and the like. FIG. 2 is a diagram showing an example of a resident database. As shown in FIG. 2, the resident DB 121 determines “room ID”, “resident name”, “administrator name”, “administrator contact address”, “standard number of edge lines”, “characteristic”, “characteristic judgment It has items such as "day" and "date of entry". Items such as the administrator name and the administrator contact address of the resident DB 121 are registered in advance using the administrator terminal 50 and the like.

  The “room ID” identifies each section of the moving-in facility 10. “Resident name” indicates a resident who moves in each section of the moving-in facility 10. A resident is a resident of a predetermined area. Here, the predetermined area may be, for example, each section of the entering facility 10 or each living room of each section. The “manager name” indicates a manager who manages the facility, for example, a care manager. The “administrator contact address” indicates, for example, an e-mail address or the like as the contact address of the administrator. The “standard number of edge lines” indicates the reference randomness, which is the randomness in a state in which the rooms in each section are organized. The edge line is, for example, a line calculated by applying an edge filter to an image obtained by capturing an image of a living room to detect a luminance gradient, calculating a linear component based on the luminance gradient, and calculating the linear component. For example, in the case of a book, since each side has a linear component, four edge lines can be calculated. The standard number of edge lines may be the sum of the standard number of edge lines of the rooms in each section, or may be the standard number of typical edge lines of a living room, for example, a living room. In the following description, the case where the number of edge lines is used as an example of the randomness and the case where the standard number of living edge lines is used will be described.

  "Characteristics" indicates the characteristics for cleaning up of the tenants in each section. The characteristics can be classified into, for example, three of characteristics A, B and C, which show different disposition characteristics. “Characteristic determination date” indicates a date on which the characteristic has been determined. "Occupancy Date" indicates the occupancy date of the resident.

  The camera installation table 122 associates and stores the number of installed cameras 11, the ID of each camera 11, the installation location, and the number of standard edge lines for each section of the entering facility 10. FIG. 3 is a diagram showing an example of the camera installation table. As shown in FIG. 3, the camera installation table 122 has items such as “room ID”, “camera installation number”, “camera ID” for each camera 11, “installation location” and “standard edge line number”.

  The “room ID” identifies each section of the moving-in facility 10. The “number of installed cameras” indicates the number of cameras 11 installed in each section identified by the room ID. The “camera ID” identifies the camera 11 installed in each room in each section. “Installation location” indicates a room in a section where each camera 11 is installed. The "standard number of edge lines" indicates the reference randomness and is the randomness in the state where the room is organized. Since the standard number of edge lines is different for each tenant, for example, the degree of randomness every morning may be acquired to obtain an average value.

  The sensing information DB 123 stores the edge line number, which is the degree of randomness of each living room at predetermined time intervals, in association with a resident-in-room flag indicating whether the resident is in the room. FIG. 4 is a diagram showing an example of a sensing information database. As shown in FIG. 4, the sensing information DB 123 has items such as “date and time”, “number of edge lines”, and “tenant occupancy flag”. The sensing information DB 123 may be provided, for example, for each living room of the compartment 10a, or the total value of the number of edge lines of each living room of the compartment 10a and whether or not the resident is in the compartment 10a. And a resident presence flag indicating the

  “Date” indicates the date when the image was received from the camera 11, or the date when the camera 11 captured the image, and, for example, when one image is captured every 10 seconds, one record every 10 seconds Do. "Edge line number" indicates the degree of randomness in the living room. The “occupant occupancy flag” indicates “1” when the occupant is in the living room and “0” if the tenant is not in the living room.

  The characteristic determination table 124 stores the characteristic and the condition of the characteristic in association with each other. FIG. 5 is a diagram showing an example of the characteristic determination table. As shown in FIG. 5, the characteristic determination table 124 has items such as “characteristic” and “condition”.

  "Characteristics" indicates the characteristics for cleaning up of the tenants in each section. The characteristics can be classified into, for example, three of characteristics A, B and C, which show different disposition characteristics. "Condition" indicates a condition for determining the characteristic. The conditions show that, for example, the characteristic A always cleans up when leaving the room, the characteristic B shows the case where the living room is scattered occasionally to some extent, and the characteristic C shows the case where it is not cleaned up.

  The message DB 125 stores the characteristic and the message notified according to the characteristic in association with each other. FIG. 6 is a diagram showing an example of the message database. As shown in FIG. 6, the message DB 125 has items such as “ID”, “characteristic”, “state immediately after leaving the room”, and “message”.

  "ID" identifies the message displayed on the notification screen. “Characteristic” corresponds to the same item of the characteristic determination table 124. Note that "all" of the characteristics indicates that all of the characteristics A, B and C are included. "The state immediately after leaving the room" indicates the state of the room immediately after the resident leaves the room. The “message” indicates the content of the message displayed on the notification screen according to the ID and the characteristic.

  Returning to the description of FIG. 1, the control unit 130 executes a program stored in an internal storage device using a RAM as a work area, for example, by a central processing unit (CPU) or a micro processing unit (MPU). Is realized by Further, the control unit 130 may be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 130 includes an acquisition unit 131, a calculation unit 132, a determination unit 133, and a notification unit 134, and implements or executes the function and action of the information processing described below. Note that the internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 1, and may be another configuration as long as it performs the information processing described later.

  The acquisition unit 131 acquires an image of a living room, that is, sensor information, from the camera 11 via the communication unit 110. The acquisition unit 131 acquires, for example, a captured image obtained by imaging the state of the living room every 10 seconds. The acquisition unit 131 outputs the acquired image to the calculation unit 132. In addition, the acquisition part 131 may acquire other information as sensor information. The acquisition unit 131 may, for example, irradiate the irradiation light into the room and acquire a captured image including the reflected light of the irradiation light. In addition, the acquisition unit 131 may acquire distance information from, for example, a distance sensor that emits a laser beam and measures the distance. The acquisition unit 131 may store the acquired captured image in the storage unit 120. Further, in the following description, as an example of the predetermined area, a case where an image of a living room is acquired will be described.

  When the image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image. The calculation unit 132 detects, for example, the brightness gradient of the image with an edge filter. The calculation unit 132 calculates, for each pixel of the image, a straight line component by combining adjacent pixels within the predetermined range of the intensity of the surrounding brightness gradient as an edge component. For example, in the calculation unit 132, a rectangular desk is installed in the living room, and when the image is taken from the ceiling direction, the boundary between the edge of the desk and the floor is a straight line, and the brightness of the desk and the floor is different. Therefore, the pixel at the boundary is combined as an edge component to calculate a linear component. In addition, for example, when the clothes are placed on the floor, the calculation unit 132 performs the same process on pixels at the border between the edge of the clothes and the floor surface, but the edges of the clothes may be curved. . At this time, the calculation unit 132 calculates a straight line component by approximating the curve with a straight line of a predetermined length. The calculation unit 132 calculates the number of straight line components, that is, the number of edge lines, based on the calculated straight line components. The calculation unit 132 associates the image capturing date and time of the image with the calculated number of edge lines, and records them in the sensing information DB 123. That is, the calculation unit 132 calculates the degree of randomness by the number of edge lines. In addition, the calculation unit 132 records, for example, the average of the number of edge lines in a state of being settled for a predetermined period in the resident DB 121 as a standard number of edge lines.

  In addition, the calculation unit 132 detects the head of a person by matching the input image with the template image of the head stored in the storage unit 120, for example. For example, when the head of the person is not detected in the living room as an example of the living room, the calculating unit 132 determines that the tenant is not in the living room (is exiting). When it is determined that the resident is not present in the room, the calculation unit 132 sets the resident room presence flag corresponding to the imaging date and time of the input image to “0”, and records it in the sensing information DB 123 .

  For example, when the head of a person is detected in the living room, the calculating unit 132 determines that the tenant is in the living room. When it is determined that the resident is in the room, the calculation unit 132 sets the resident room presence flag corresponding to the imaging date and time of the input image to “1”, and records it in the sensing information DB 123 .

  If the determination part 133 receives the instruction | indication which performs a characteristic determination process from the administrator terminal 50, it will perform characteristic determination with respect to each resident | tenant with reference to sensing information DB123. The determination unit 133 refers to the resident DB 121 to acquire the room ID of the resident, the characteristic, the characteristic acquisition date, the entering date, and the like. The determination unit 133 determines whether or not the characteristic determination is necessary. That is, the determination unit 133 determines whether the characteristic is not recorded three months after the resident moves in, or whether three months have elapsed from the characteristic determination date. If three months have passed since entering and the characteristic has not been recorded, or if three months have passed from the characteristic determination date, the determination unit 133 performs the characteristic determination on the tenant. The determination unit 133 determines whether there is a next resident if three months have passed since entering and the characteristic has been recorded, or three months have not elapsed from the characteristic determination date.

  When the characteristic determination is necessary, that is, when the characteristic determination is performed, the determination unit 133 acquires the standard edge line number from the resident DB 121. Further, the determination unit 133 acquires, from the sensing information DB 123, the number of edge lines at the start and end of the resident room flag “1” among the sensing information corresponding to the resident. That is, the determination unit 133 acquires, for example, a plurality of edge line numbers at the start and end of the resident room flag “1” from the sensing information for three months.

  The determination unit 133 determines whether the acquired number of start and end edge lines is within a predetermined range from the standard number of edge lines. When the number of edge lines at the start and end is within a predetermined range from the standard number of edge lines, the determination unit 133 records A along with the characteristic determination date in the property of the tenant of the resident DB 121. Here, “within a predetermined range from the standard edge line number” may be, for example, within ± 10% from the standard edge line number. Further, if the number of edge lines out of the number of edge lines at the start and the end is not within the predetermined range from the standard number of edge lines, for example, within 10% of the whole, the tenant in the resident DB 121 A may be recorded along with the characteristic determination date in the characteristic of.

  If the number of edge lines at the start and end is not within the predetermined range from the standard number of edge lines, the determination unit 133 may determine whether the number of edge lines at the end may be smaller than the number of edge lines at the start. Determine if When the number of edge lines at the end may be smaller than the number of edge lines at the start, the determination unit 133 records B in the property of the tenant of the resident DB 121 together with the date of the characteristic determination. Here, that the number of edge lines at the end may be smaller than the number of edge lines at the start, for example, the number of edge lines at the end may be less than 90% of the number of edge lines at the start There is a case.

  If the number of edge lines at the end is not smaller than the number of edge lines at the start, the determination unit 133 determines that the ratio of the number of edge lines at the end is greater than the number of edge lines at the start is a predetermined value It is determined whether it is above or not. If the ratio of the number of times the edge line number at the end is larger than the edge line number at the start is equal to or more than a predetermined value, the determination unit 133 determines C of the tenant's characteristics of the tenant DB 121 together with the characteristic determination date. Record. Here, the predetermined value can be, for example, 95%. If the ratio of the number of times the edge line number at the end is larger than the edge line number at the start is less than the predetermined value, the determination unit 133 ends the characteristic determination without recording the characteristic.

  Here, the state of the living room of the resident of each of the characteristics A, B and C will be described using FIGS. 7 to 9. FIG. 7 is a diagram showing an example of the state of the room of the resident of characteristic A. As shown in FIG. As shown in FIG. 7, the state 21a is the state when the resident 24 enters the living room, and the living room is not scattered, that is, the number of edge lines which is the randomness is close to the reference edge line number. It is. Next, in the state 22a, the resident 24 is acting in the room, for example, a state in which a book or magazine is taken out of a bookcase and placed on a desk, that is, the number of edge lines that are randomness is the reference number of edge lines and entry. It is a state larger than the number of edge lines. Subsequently, in the state 23a, when the resident 24 leaves the room, the scattered state is cleared up, that is, the number of edge lines which is the randomness degree is close to the reference number of edge lines.

  FIG. 8 is a diagram showing an example of the state of the room of the resident of characteristic B. As shown in FIG. As shown in FIG. 8, the state 21b is a state where the resident 24 has entered the living room, and the living room is scattered, that is, the number of edge lines which is the randomness is larger than the reference edge line number. . An example of the state 21 b is a case where the resident 24 is making a model and is in working state for several days. Next, in the state 22b, the resident 24 is acting in the room, for example, a state in which a model is being produced, ie, a state in which the number of edge lines which is the randomness is larger than the reference edge line number. The number of edge lines at time does not change much. Subsequently, in the state 23b, when the resident 24 leaves the room, the scattered state is cleared up, that is, the number of edge lines which is the randomness is close to the reference number of edge lines, which is smaller than the number of edge lines when entering. It is in the state of doing. In the state 23b, for example, there may be a case where a model produced for several days is completed and cleaned up, or a case where the model is cleaned up after several days and scattered to some extent.

  FIG. 9 is a view showing an example of the state of the room of the resident of characteristic C. As shown in FIG. As shown in FIG. 9, the state 21c is a state where the resident 24 has entered the living room, and the living room is scattered, that is, the number of edge lines which is the randomness is larger than the reference edge line number. . An example of the state 21 c is a case where the resident 24 does not clean up. Next, the state 22c is a state where the resident 24 is acting in the room, that is, the number of edge lines which is the randomness is larger than the number of reference edge lines and the number of edge lines at the time of entering the room. Subsequently, the state 23c is a state in which the resident 24 leaves the room with the room scattered, that is, a state in which the number of edge lines which is randomness is larger than the reference number of edge lines, and the number of edge lines at the time of entering the room It is in a state of increasing more. The state 23c is, for example, a case where the resident 24 does not clean up at all and scatters until the care staff comes for cleaning.

  Returning to the description of FIG. 1, the notification unit 134 executes notification processing according to an instruction to execute notification processing received from the administrator terminal 50 or an instruction to perform batch processing at a predetermined interval such as once a day. Do. The notification unit 134 acquires, from the resident DB 121, the standard edge line number and characteristics of the head tenant. The notification unit 134 acquires the number of edge lines from the start time to the end time of the resident room flag “1” from the sensing information DB 123. That is, the notification unit 134 acquires the number of edge lines at the date and time when the resident room presence flag is “1”.

  The notification unit 134 compares the number of edge lines at a plurality of different timings among the acquired number of edge lines. The notification unit 134 compares, for example, the number of edge lines at the time of entering and leaving the room. Further, the notification unit 134 compares the number of edge lines at the time of entering and leaving the room in a predetermined period such as one to three months, for example. The notification unit 134 determines whether the number of edge lines has increased or the rate of increase in the number of edge lines has increased as a result of the comparison. When the number of edge lines increases or the rate of increase in the number of edge lines increases, the notification unit 134 generates a notification screen indicating that clearing can not be performed, and the communication unit 110 and the network N It transmits and notifies to the administrator terminal 50 via it. If the number of edge lines has not increased or the rate of increase in the number of edge lines has not increased, the notification unit 134 determines whether the number of edge lines has decreased or the rate of increase has decreased. Do.

  When the number of edge lines decreases or the rate of increase decreases, the notification unit 134 generates a notification screen indicating that cleaning up has started, and sends the administrator terminal 50 via the communication unit 110 and the network N. Send and notify. That is, the notification unit 134 transmits a notification screen including a corresponding predetermined notification to the administrator terminal 50 to notify based on a temporal change in the number of edge lines which is the randomness. Here, the temporal change of the number of edge lines which is the randomness can be detected, for example, by comparing the number of edge lines acquired at a predetermined time every day. In addition, the temporal change in the number of edge lines, which is the randomness, is, for example, the timing when the tenant was detected in the room at the beginning of the day and the timing when the tenant was detected in the room at the end of the day It can detect by comparing with. If the number of edge lines has not decreased or the rate of increase has not decreased, the notification unit 134 does not notify the tenant and determines similarly for the next tenant.

  Next, the configuration corresponding to the characteristics A, B and C of the notification unit 134 will be described. The notification unit 134 executes notification processing according to an instruction for executing notification processing received from the administrator terminal 50 or an instruction for batch processing at a predetermined interval such as once a day. The notification unit 134 acquires, from the resident DB 121, the standard edge line number and characteristics of the head tenant. The notification unit 134 acquires the number of edge lines from the start time to the end time of the resident room flag “1” from the sensing information DB 123. That is, the notification unit 134 acquires the number of edge lines at the date and time when the resident room presence flag is “1”.

  The notification unit 134 determines whether the number of edge lines at the end of the resident room flag “1” exceeds the randomness, that is, the threshold of the number of edge lines. Here, the threshold of the number of edge lines is, for example, a numerical value representing the extent to which it does not reach in normal life, that is, the dispersion state in the case where an abnormality such as a resident in a living room occurs or the like. When the number of edge lines at the end exceeds the threshold of the number of edge lines, the notification unit 134 acquires the manager contact information of the tenant from the tenant DB 121. Further, the notification unit 134 generates a notification screen including the message of the ID “001” with reference to the message DB 125 and transmits the notification screen to the administrator terminal 50 via the communication unit 110 and the network N. The message of the ID "001" is, for example, a message such as "The spread of rooms has exceeded the threshold. Please confirm."

  If the number of edge lines at the end does not exceed the threshold of the number of edge lines, the notification unit 134 determines that the property of the tenant is A and the resident room flag is more than the start of the “1” flag. It is determined whether the number of edge lines at the end has increased. The notification unit 134 acquires the manager contact information of the tenant from the tenant DB 121 when the property of the tenant is A and the number of edge lines at the end is larger than the start time. Do. Further, the notification unit 134 generates a notification screen including the message of the ID “002” with reference to the message DB 125 and transmits the notification screen to the administrator terminal 50 via the communication unit 110 and the network N. The message of ID "002" is, for example, a message such as "It seems that it is not possible to clean up every time. Please look at the situation."

  When the property of the tenant is not A or the number of edge lines at the end does not increase from the start time, the notification unit 134 determines that the property of the tenant is B and the tenant is present. It is determined whether the number of edge lines at the end has increased by a predetermined value or more from the start of the room flag "1". Here, the predetermined value of the increase in the number of edge lines is a value for determining whether or not the number of edge lines at the end has significantly increased compared to the start time. For example, 0 of the number of edge lines at the start is It can be .5 times the value. That is, the notification unit 134 determines whether the number of edge lines at the end is equal to or greater than 1.5 times the number of edge lines at the start. Further, the predetermined value can be, for example, "100" which is 0.5 times when the number of edge lines at the start is "200". That is, the notification unit 134 determines whether the number of edge lines at the end is “300” or more. Further, the predetermined value may be set in advance according to the state of the living room. For example, when the reference edge line number is "100" or less, the predetermined value is "200-reference edge line number", and when the reference edge line number is "134" or more, the predetermined value is It can be 0.5 times the reference edge line number.

  If the property of the tenant is B and the number of edge lines at the end has increased by a predetermined value or more from the start time, the notification unit 134 notifies the manager of the tenant from the tenant DB 121 Get ahead. Further, the notification unit 134 refers to the message DB 125 to generate a notification screen including the message of the ID “004”, and transmits the notification screen to the administrator terminal 50 via the communication unit 110 and the network N. The message of the ID "004" is, for example, a message such as "It seems that the tidying up is getting ridiculous."

  The notification unit 134 performs the following determination if the property of the tenant is not B or the number of edge lines at the end has not increased by a predetermined value or more from the start time. As the next determination, the notification unit 134 temporarily reduces the number of edge lines during the period in which the tenant's characteristic is B and the resident room flag is “1”, but ends from the start It is determined whether the number of edge lines at the time has increased. Here, the fact that the number of edge lines temporarily decreases means, for example, that the number of edge lines at entry is "200" and increases to "300" during occupancy but decreases to "250" at exit. is there. If the property of the tenant is B and the number of edge lines is temporarily reduced, the notification unit 134 moves from the tenant DB 121 to the tenant if the number of edge lines at the end is increased from the start. The administrator's contact information Further, the notification unit 134 generates a notification screen including the message of the ID “003” with reference to the message DB 125 and transmits the notification screen to the administrator terminal 50 via the communication unit 110 and the network N. The message of the ID "003" is, for example, a message such as "It seems that it is difficult to keep up."

  If the property of the tenant is not B or the number of edge lines temporarily decreases, the notification unit 134 determines the next determination if the number of edge lines at the end does not increase from the start time. Do. As the next determination, the notification unit 134 determines whether the property of the tenant is C and the number of edge lines at the end is smaller than the start of the tenant room flag “1”. Do. The notification unit 134 acquires the manager contact information of the tenant from the tenant DB 121 when the property of the tenant is C and the number of edge lines at the end is smaller than the start time. Do. Further, the notification unit 134 generates a notification screen including the message of the ID “005” with reference to the message DB 125, and transmits the notification screen to the administrator terminal 50 via the communication unit 110 and the network N. The message of the ID "005" is, for example, a message such as "I've put out a lot of things up until now.

  If the property of the tenant is not C, or the number of edge lines at the end is not smaller than the start time, the notification unit 134 does not perform generation and transmission of a notification screen for the tenant, and next Determine the same for the tenants of. Note that the notification unit 134 generates a notification screen when detection of the change in the degree of randomness (the number of edge lines) according to the above determination continues a predetermined number of times or more, or when a predetermined number of times per unit time or more. It may be transmitted to the administrator terminal 50. The notification unit 134 generates a notification screen and transmits the notification screen to the administrator terminal 50, for example, when detecting continuously three times or more, or when detecting twice or more per unit time. It should be noted that the predetermined number of times of detection of the change in the degree of randomness or the predetermined number of times per unit time of the detection of the change of the degree of randomness may be set for each resident.

  Here, an example of the notification screen will be described using FIGS. 10 and 11. FIG. 10 is a diagram showing an example of the notification screen. As shown in FIG. 10, for example, when transmitting the message of the ID "002" of the message DB 125, the notification unit 134 generates a notification screen 25 including a message indicating that it can not be cleared every time. . FIG. 11 is a diagram showing another example of the notification screen. As shown in FIG. 11, when transmitting a message of ID “001” of the message DB 125, for example, the notification unit 134 displays the notification screen 26 including a message indicating that the room (room) has exceeded the threshold. Generate

  Next, the operation of the monitoring system 1 of the embodiment will be described. First, a recording process of recording the state of the living room in the sensing information DB 123 will be described. FIG. 12 is a flowchart showing an example of the recording process. The acquisition unit 131 of the server device 100 acquires an image of a room from the camera 11 via the communication unit 110, for example, every 10 seconds (step S1). The acquisition unit 131 outputs the acquired image to the calculation unit 132.

  When the image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image. The calculation unit 132 detects, for example, the brightness gradient of the image with an edge filter (step S2). The calculation unit 132 calculates, for each pixel of the image, a straight line component by combining adjacent pixels within the predetermined range of the intensity of the surrounding brightness gradient as an edge component (step S3). The calculation unit 132 calculates the number of edge lines based on the calculated straight line component (step S4). The calculation unit 132 associates the image capturing date and time of the image with the calculated number of edge lines, and records them in the sensing information DB 123 (step S5).

  The calculation unit 132 determines whether the resident is in the room based on the input image (step S6). When the resident is in the room (Step S6: Yes), the calculation unit 132 sets the resident room presence flag corresponding to the imaging date and time of the input image to “1”, and the sensing information DB 123 (Step S7). When the resident is not in the room (Step S6: No), the calculation unit 132 sets the resident room presence flag corresponding to the imaging date and time of the image to “0”, and records it in the sensing information DB 123 (Step S8). When the setting of the resident room presence flag is completed, the calculation unit 132 returns to step S1, and repeats the same process on the image acquired at the next timing. Thus, the state of the room and the occupancy of the resident can be correlated and recorded.

  Then, based on the number of edge lines recorded in sensing information DB123, the characteristic judging processing which judges a resident's characteristic is explained. The characteristic determination process may be executed by receiving an instruction to execute the characteristic determination process from the administrator terminal 50, or may be executed as a batch process at predetermined intervals such as once a week, for example. Good. FIG. 13 is a flowchart illustrating an example of the characteristic determination process. The determination unit 133 of the server device 100 refers to the tenant DB 121 to acquire the characteristic, the characteristic acquisition date, and the moving-in date of the first resident (step S11). The determination unit 133 determines that the characteristic is not recorded three months after the resident moves in based on the acquired property of the resident, the property acquisition date, and the moving-in date, or 3 from the property determination date It is determined whether a month has passed (step S12).

  The determination unit 133 proceeds to step S14 if three months have elapsed since entering and the characteristic is recorded or three months have not elapsed from the characteristic determination date (step S12: negative). If the characteristic has not been recorded three months after entering the residence, or if three months have elapsed from the characteristic determination date (Step S12: affirmative), the determination unit 133 determines the characteristic for the tenant. Characteristic determination is performed by a subroutine (step S13).

  Here, the characteristic determination subroutine will be described with reference to FIG. FIG. 14 is a flowchart showing an example of the characteristic determination subroutine. The determination unit 133 acquires the standard edge line number of the tenant from the resident DB 121 (step S131). Further, the determination unit 133 acquires, from the sensing information DB 123, the number of edge lines at the start and end of the resident room flag “1” among the sensing information corresponding to the resident (step S132).

  The determination unit 133 determines whether the acquired number of start and end edge lines is within a predetermined range from the standard number of edge lines (step S133). If the number of edge lines at the start and end is within the predetermined range from the standard number of edge lines (Yes at step S133), the determination unit 133 determines A as the characteristic of the tenant in the tenant DB 121 And the recording (step S134). When the recording of the characteristic is completed, the determination unit 133 ends the characteristic determination subroutine and returns to the original process.

  If the number of edge lines at the start and end is not within the predetermined range from the standard number of edge lines (No at step S133), the determination unit 133 determines that the number of edge lines at the end is smaller than the number of edge lines at the start. It is determined whether or not there is a problem (step S135). If the number of edge lines at the end may be smaller than the number of edge lines at the start (step S135: affirmative), the determination unit 133 determines B as the characteristic of the tenant of the resident DB 121 And the recording (step S136). When the recording of the characteristic is completed, the determination unit 133 ends the characteristic determination subroutine and returns to the original process.

  If the number of edge lines at the end is not smaller than the number of edge lines at the start (step S135: negative), the determination unit 133 performs the following determination. As the next determination, the determination unit 133 determines whether the ratio of the number of times the number of edge lines at the end is larger than the number of edge lines at the start is equal to or more than a predetermined value (step S137). If the rate of the number of edge lines at the end is greater than the number of edge lines at the start is equal to or greater than the predetermined value (Yes at step S137), the determination unit 133 determines the property of the tenant in the resident DB 121 Are recorded together with the characteristic determination date (step S138). When the recording of the characteristic is completed, the determination unit 133 ends the characteristic determination subroutine and returns to the original process. If the ratio of the number of times that the number of edge lines at the end is greater than the number of edge lines at the start is less than the predetermined value (No at step S137), the determination unit 133 ends the characteristic determination subroutine without recording the characteristics. And return to the original process.

  Returning to the explanation of FIG. 13, when the process of the characteristic determination subroutine ends, the determination unit 133 determines whether there is a next resident by referring to the resident DB 121 (step S14). When there is a next resident (Step S14: affirmative), the determination unit 133 acquires the next tenant's characteristic, the characteristic determination date, and the moving-in date from the resident DB 121 (Step S15). When the determination unit 133 acquires the next tenant's characteristic, the characteristic determination date, and the moving-in date, the process returns to step S12, and performs the characteristic determination process on the next tenant. If the next resident is not present (step S14: negative), the determination unit 133 ends the characteristic determination process. Thereby, the server apparatus 100 can determine the disposition characteristic of each tenant.

  Next, an example of the notification process will be described. FIG. 15 is a flowchart illustrating an example of the notification process. The notification process is performed, for example, once a day. The notification unit 134 of the server device 100 acquires the standard edge line number and characteristics of the first resident from the resident DB 121 (step S201). The notification unit 134 acquires the number of edge lines from the start time to the end time of the resident room flag “1” from the sensing information DB 123 (step S202).

  The notification unit 134 compares the number of edge lines at a plurality of different timings among the acquired number of edge lines (step S203). The notification unit 134 determines whether the number of edge lines has increased or the rate of increase in the number of edge lines has increased as a result of the comparison (step S204). When the number of edge lines increases or the rate of increase in the number of edge lines increases (step S204: Yes), the notification unit 134 generates a notification screen indicating that clearing can not be performed, and manages It transmits and notifies to the user terminal 50 (step S205). When the notification unit 134 notifies that the file can not be cleaned up, the process proceeds to step S208.

  If the number of edge lines has not increased or the rate of increase in the number of edge lines has not increased (step S 204: negative), the notification unit 134 decreases the number of edge lines or the rate of increase is decreased. It is determined whether or not (step S206). If the number of edge lines is decreasing or the increase rate is slowing (Step S206: Yes), the notifying unit 134 generates a notification screen indicating that cleaning up has started, and transmits the notification screen to the administrator terminal 50. It notifies (step S207). When the notification unit 134 notifies that cleaning has been started, the process proceeds to step S208.

  If the number of edge lines has not decreased or the increase speed has not decreased (step S206: negative), the notification unit 134 refers to the tenant DB 121 and determines whether there is a next tenant or not. It determines (step S208). When there is a next resident (Step S208: Yes), the notification unit 134 acquires the standard edge line number and characteristics of the next resident from the resident DB 121 (Step S209). When the notification unit 134 acquires the standard edge line number and characteristics of the next resident, the process returns to step S202, and performs notification processing for the next tenant. The notification unit 134 ends the notification process when there is no next resident (step S208: negative). Thereby, the server apparatus 100 can detect the decline in the living ability of the resident.

  Subsequently, another example of the notification process will be described. 16 and 17 are flowcharts showing another example of the notification process. The notification process is performed, for example, once a day. The notification unit 134 of the server device 100 acquires the standard edge line number and characteristics of the head tenant from the tenant DB 121 (step S301). The notification unit 134 acquires the number of edge lines from the start time to the end time of the resident room flag “1” from the sensing information DB 123 (step S302).

  The notification unit 134 determines whether the number of edge lines at the end of the resident room flag “1” exceeds the threshold of the number of edge lines (step S303). When the number of edge lines at the end exceeds the threshold of the number of edge lines (Step S303: Yes), the notification unit 134 acquires the manager contact information of the tenant from the tenant DB 121. Further, the notification unit 134 refers to the message DB 125 to generate a notification screen including the message of the ID “001”, and transmits the notification screen to the administrator terminal 50 (step S304). After transmitting the notification screen to the administrator terminal 50, the notification unit 134 proceeds to step S313.

  If the number of edge lines at the end does not exceed the threshold of the number of edge lines (No at Step S303), the notification unit 134 performs the following determination. As the next determination, the notification unit 134 determines whether the property of the tenant is A and the number of edge lines at the end is larger than the start of the tenant room flag “1”. (Step S305). If the property of the tenant is A and the number of edge lines at the end is larger than the start time (step S305: affirmative), the notification unit 134 determines from the tenant DB 121 that the tenant has Get admin contacts. Further, the notification unit 134 refers to the message DB 125 to generate a notification screen including the message of the ID “002”, and transmits the notification screen to the administrator terminal 50 (step S306). After transmitting the notification screen to the administrator terminal 50, the notification unit 134 proceeds to step S313.

  The notification unit 134 performs the following determination when the property of the tenant is not A or the number of edge lines at the end does not increase from the start time (step S305: negative). As the next determination, the notification unit 134 determines whether the property of the resident is B and the number of edge lines at the end has increased by a predetermined value or more from the start of the resident room flag “1”. It is determined (step S307). If the property of the tenant is B and the number of edge lines at the end has increased by a predetermined value or more than the start time (step S307: affirmative), the notification unit 134 is notified of the tenant DB 121 in question. Get tenant contact information. Further, the notification unit 134 generates a notification screen including the message of the ID “004” by referring to the message DB 125, and transmits the notification screen to the administrator terminal 50 (step S308). After transmitting the notification screen to the administrator terminal 50, the notification unit 134 proceeds to step S313.

  The notification unit 134 performs the following determination when the property of the tenant is not B or the number of edge lines at the end does not increase by a predetermined value or more from the start time (step S307: negative). As the next determination, the notification unit 134 temporarily reduces the number of edge lines during the period in which the tenant's characteristic is B and the resident room flag is “1”, but ends from the start It is determined whether the number of edge lines at the time has increased (step S309). If the property of the tenant is B and the number of edge lines temporarily decreases, the notification unit 134 determines that the number of edge lines at the end is larger than the start time (step S309: Affirmative) Acquire the manager contact information of the tenant from the tenant DB 121. Further, the notification unit 134 generates a notification screen including the message of the ID “003” with reference to the message DB 125, and transmits the notification screen to the administrator terminal 50 (step S310). After transmitting the notification screen to the administrator terminal 50, the notification unit 134 proceeds to step S313.

  If the property of the tenant is not B or the number of edge lines temporarily decreases, the notification unit 134 determines that the number of edge lines at the end does not increase from the start time (step S309: negative ), Make the following judgment. As the next determination, the notification unit 134 determines whether the property of the tenant is C and the number of edge lines at the end is smaller than the start of the tenant room flag “1”. (Step S311). If the property of the tenant is C and the number of edge lines at the end is smaller than the start time (step S311: affirmative), the notification unit 134 determines from the tenant DB 121 that the tenant has Get admin contacts. Further, the notification unit 134 generates a notification screen including the message of the ID “005” with reference to the message DB 125, and transmits the notification screen to the administrator terminal 50 (step S312). After transmitting the notification screen to the administrator terminal 50, the notification unit 134 proceeds to step S313.

  The notification unit 134 refers to the tenant DB 121 when the property of the tenant is not C or the number of edge lines at the end does not decrease from the start time (No at step S311). It is determined whether there is a resident of (step S313). When there is a next resident (Step S313: affirmative), the notification unit 134 acquires the standard edge line number and characteristics of the next resident from the resident DB 121 (Step S314). When the notification unit 134 acquires the standard edge line number and characteristics of the next resident, the process returns to step S302 to perform notification processing for the next tenant. The notification unit 134 ends the notification process when there is no next resident (step S313: negative). Thereby, the server apparatus 100 can detect the decline of the living ability according to the characteristics of the resident.

  As described above, the monitoring system 1 analyzes the captured image of the predetermined area sequentially acquired as time passes, and calculates the degree of randomness of the predetermined area. In addition, the monitoring system 1 detects that the temporal change tendency of the calculated degree of randomness indicates a change to a tendency toward higher degree of randomness, or the speed at which the degree of randomness increases increases. If it is detected to indicate a change to, then a predetermined notification is given. As a result, it is possible to detect the decline in the living ability of the resident. In addition, the monitoring system 1 can rapidly transmit the onset of dementia of the resident, changes in physical condition, and the like to the manager, and can provide care to the resident at an early stage.

  Further, in the monitoring system 1, temporal changes in the degree of randomness are detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times every day. . As a result, it is possible to detect a change in daily living ability of the resident.

  Further, in the monitoring system 1, the temporal change of the randomness is detected at the beginning of one day in the predetermined area and the predetermined area at the end of the day for the resident of the predetermined area. It is detected by comparing with the timing detected inside. As a result, it is possible to know how much the tenant cleans up every day.

  Further, the monitoring system 1 compares the degree of randomness at each of the plurality of times when the process of comparing the degrees of randomness calculated at a plurality of different timings is executed a plurality of times with the timing to be compared changed. In addition, the monitoring system 1 detects that the tendency to become higher randomness or the change to the tendency that the speed of the randomness increases becomes faster based on the comparison result of the randomness. In addition, when it is detected that the monitoring system 1 indicates a change to the above tendency, detection of the change in the degree of randomness continues a predetermined number of times or more, or a predetermined number of times per unit time or more. , Give a predetermined notification. As a result, it is possible to detect the decline in the living ability of the resident.

  Further, the monitoring system 1 sets the detection of the change of the randomness a predetermined number of times continuously or the predetermined number of times of detection of the change of the randomness per unit time for each resident of the predetermined area. As a result, it is possible to detect changes in living ability using different criteria for each resident.

  Further, the monitoring system 1 analyzes the captured image of the predetermined area sequentially acquired as time passes, and calculates the degree of randomness of the predetermined area. In addition, the monitoring system 1 detects that the temporal change tendency of the calculated randomness shows a change to a lower randomness tendency, or the speed at which the randomness increases increases. If it is detected to indicate a change to, then a predetermined notification is given. As a result, it is possible to detect the resident's effort for independence.

  Further, the monitoring system 1 compares the degree of randomness at each of the plurality of times when the process of comparing the degrees of randomness calculated at a plurality of different timings is executed a plurality of times with the timing to be compared changed. In addition, the monitoring system 1 detects a tendency to lower the degree of randomness or a change to a tendency to increase the speed of the degree of randomness based on the comparison result of the randomness. In addition, when it is detected that the monitoring system 1 indicates a change to the above tendency, detection of the change in the degree of randomness continues a predetermined number of times or more, or a predetermined number of times per unit time or more. , Give a predetermined notification. As a result, it is possible to detect the resident's effort for independence.

  Although the number of edge lines is used as the randomness in the above embodiment, the present invention is not limited to this. For example, the height in the living room measured by the distance sensor may be used as an index of the degree of randomness. FIG. 18 is a diagram showing an example of calculation of the degree of randomness when the height is used as the index of degree of randomness. As shown in FIG. 18, the server apparatus 100 acquires in advance a reference state 28 and height information 30 based on the reference state 28. In addition, the server apparatus 100 acquires the comparison target 29 in a scattered state and the height information 31 based on the comparison target 29. Here, when the comparison object 29 and the height information 31 are compared with the reference state 28 and the height information 30, it is assumed that the height information 29b related to the object 29a and the object 29a is increased. Subsequently, when the difference 32 between the height information 30 and the height information 31 is taken, the area 29c corresponding to the height information 29b can be calculated as the degree of randomness.

  Here, height information 30 and 31 irradiates light into a living room from a light source installed on a ceiling, for example, and captures an image including reflected light of irradiated light and phase information of irradiated light and reflected light The image is analyzed, and the distance is calculated and determined for each pixel of the captured image based on the phase information. That is, the height information 30 and 31 can be obtained by calculating the distance by TOF (Time Of Flight). Further, the height information 30 and 31 can be determined by, for example, irradiating irradiation light including a specific pattern from the light source into the room and calculating the distance based on the specific pattern. Furthermore, the height information 30 and 31 can be determined based on, for example, a distance measured using a distance sensor that measures the distance by irradiating the room with a laser beam. Here, as a distance sensor, for example, a rider (LIDAR: Light Detection and Ranging, or Laser Imaging Detection and Ranging, or LADAR: Laser Detection and Ranging) can be used.

  In the case where the height is used as an index of the degree of randomness in the room, the monitoring system 1 provides, for example, a terminal device for each section of the entering facility 10, and the terminal device measures the degree of randomness based on the height in the room. calculate. The terminal device calculates the degree of randomness based on the height instead of the number of edge lines, for example, as sensing information which is a part of the process of the calculation unit 132 of the server device 100, and transmits it to the server device 100. In addition, the server apparatus 100 uses the average height instead of the standard edge line number of the camera installation table 122.

  Further, each component of each unit shown in the drawings does not necessarily have to be physically configured as shown in the drawings. That is, the specific form of the dispersion and integration of each part is not limited to the illustrated one, and all or a part thereof is functionally or physically dispersed or integrated in any unit according to various loads, usage conditions, etc. Can be configured. For example, the process of calculating the sensing information of the calculation unit 132 may be performed on the camera 11 side.

  Furthermore, all or any part of various processing functions performed by each device may be executed on a CPU (or a microcomputer such as an MPU or an MCU (Micro Controller Unit)). In addition, various processing functions may be executed in whole or any part on a program analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware by wired logic. It goes without saying that it is good.

  The various processes described in the above embodiments can be realized by executing a prepared program on a computer. So, below, an example of a computer which runs a program which has the same function as the above-mentioned example is explained. FIG. 19 is a diagram illustrating an example of a computer that executes a monitoring program.

  As shown in FIG. 19, the computer 200 has a CPU 201 that executes various arithmetic processing, an input device 202 that receives data input, and a monitor 203. The computer 200 also includes a medium reading device 204 reading programs and the like from a storage medium, an interface device 205 for connecting with various devices, and a communication device 206 for connecting with other information processing devices and the like by wire or wirelessly. Have. The computer 200 also has a RAM 207 for temporarily storing various information, and a hard disk drive 208. Each of the devices 201 to 208 is connected to the bus 209.

  The hard disk drive 208 stores a monitoring program having the same function as each processing unit of the acquisition unit 131, the calculation unit 132, the determination unit 133, and the notification unit 134 illustrated in FIG. The hard disk drive 208 also stores a resident DB 121, a camera installation table 122, a sensing information DB 123, a characteristic determination table 124, a message DB 125, and various data for realizing a monitoring program. The input device 202 receives, for example, an input of various information such as management information from the administrator of the computer 200. The monitor 203 displays, for example, a screen of management information and various screens for the administrator of the computer 200. The interface device 205 is connected to, for example, a printing device. The communication device 206 has, for example, the same function as the communication unit 110 shown in FIG. 1, is connected to the network N, and exchanges various information with the administrator terminal 50, the camera 11, and other devices.

  The CPU 201 reads out each program stored in the hard disk device 208, develops the program in the RAM 207, and executes the program to perform various processes. In addition, these programs can cause the computer 200 to function as the acquisition unit 131, the calculation unit 132, the determination unit 133, and the notification unit 134 illustrated in FIG.

  The above monitoring program does not necessarily have to be stored in the hard disk drive 208. For example, the computer 200 may read out and execute a program stored in a storage medium readable by the computer 200. The storage medium readable by the computer 200 corresponds to, for example, a CD-ROM, a DVD disk, a portable recording medium such as a USB (Universal Serial Bus) memory, a semiconductor memory such as a flash memory, a hard disk drive, or the like. Alternatively, the monitoring program may be stored in a device connected to a public line, the Internet, a LAN or the like, and the computer 200 may read out the monitoring program from these and execute it.

  The following appendices are further disclosed regarding the embodiment including the present embodiment.

(Supplementary Note 1) The degree of randomness of the predetermined area is calculated by analyzing the captured image of the predetermined area sequentially acquired according to the passage of time,
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward higher randomness, or a change to a tendency that the speed of the randomness increases becomes faster Give a predetermined notification when a is detected,
A method of monitoring a tendency of change in randomness, characterized in that a computer executes processing.

(Supplementary Note 2) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day The method for monitoring the tendency of the change in the degree of randomness according to claim 1, characterized in that.

(Supplementary Note 3) The temporal change in the degree of randomness is, for a resident of the predetermined area, a timing detected at the beginning of the day in the predetermined area, and a timing change in the predetermined area at the end of the day The method for monitoring the tendency of the change in the degree of randomness according to claim 1, characterized by being detected by comparing with the timing detected in the above.

(Supplementary Note 4) In the process of performing the predetermined notification, the process of comparing the degree of randomness calculated at a plurality of different timings is executed at a plurality of times, with the timing to be compared changed and executed a plurality of times. Detection of the change in the degree of randomness when it is detected that the tendency toward the higher degree of randomness or the tendency to increase the speed of the degree of randomness tends to increase based on the comparison result of the degree of randomness The method for monitoring the tendency of the change in the degree of randomness according to claim 1, wherein the predetermined notification is performed when the predetermined number of consecutive times or more or the predetermined number of times per unit time is detected.

(Supplementary Note 5) In the process of performing the predetermined notification, a predetermined number of consecutive detections of the change in the randomness, or a predetermined number of times per unit time of the detection of the change in the randomness is the residence of the predetermined area. The method for monitoring the tendency of the change in the degree of randomness according to claim 4, wherein the method is set for each person.

(Supplementary Note 6) The degree of randomness of the predetermined area is calculated by analyzing the captured image of the predetermined area sequentially acquired according to the passage of time,
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward lower randomness, or a change to a tendency that the speed of the randomness increases becomes slower Give a predetermined notification when a is detected,
A method of monitoring a tendency of change in randomness, characterized in that a computer executes processing.

(Supplementary Note 7) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day The trend monitoring method of the change of the degree of randomness described in the supplementary note 6 characterized by the above.

(Supplementary Note 8) The temporal change in the degree of randomness is, for a resident of the predetermined area, a timing detected at the beginning of the day in the predetermined area, and a timing change in the predetermined area at the end of the day The tendency monitoring method of the change of the degree of randomness according to claim 6, characterized by being detected by comparing with the timing detected in the above.

(Supplementary Note 9) In the process of performing the predetermined notification, the process of comparing the degree of randomness calculated at a plurality of different timings is executed at a plurality of times, with the timing to be compared changed and executed a plurality of times. Detection of the change in the degree of randomness when it is detected that the lower degree of randomness tends to be the change in the degree of randomness or the tendency that the speed of the randomness increases is slowed based on the comparison result of the degree of randomness The method according to claim 6, wherein the predetermined notification is performed when the predetermined number of consecutive times or more or the predetermined number of times per unit time is detected.

(Supplementary Note 10) In the process of performing the predetermined notification, a predetermined number of consecutive detections of the change in the randomness, or a predetermined number of unit time for the detection of the change in the randomness is the residence of the predetermined area. The method for monitoring the tendency of change in degree of randomness as set forth in appendix 9, characterized by setting for each person.

(Supplementary Note 11) The degree of randomness of the predetermined area is calculated by analyzing the captured image of the predetermined area sequentially acquired according to the passage of time,
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward higher randomness, or a change to a tendency that the speed of the randomness increases becomes faster Give a predetermined notification when a is detected,
A program for monitoring the tendency of change in randomness characterized in having a computer execute the process.

(Supplementary note 12) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day The trend monitoring program of the degree of randomness change according to appendix 11, characterized in that

(Supplementary note 13) The temporal change in the randomness level is determined for the resident of the predetermined area at the beginning of the day at the timing detected in the predetermined area and at the end of the day in the predetermined area. The tendency change monitoring program of the degree of randomness according to claim 11, characterized by being detected by comparing with the timing detected in the above.

(Supplementary Note 14) In the process of performing the predetermined notification, the process of comparing the degree of randomness calculated at a plurality of different timings is executed at a plurality of times, with the timing to be compared changed and executed a plurality of times. Detection of the change in the degree of randomness when it is detected that the tendency toward the higher degree of randomness or the tendency to increase the speed of the degree of randomness tends to increase based on the comparison result of the degree of randomness The program for monitoring the tendency of change in the degree of randomness according to appendix 11, wherein the predetermined notification is performed when the predetermined number of consecutive times or more or the predetermined number of times per unit time is detected.

(Supplementary Note 15) In the process of performing the predetermined notification, the detection of the change in the randomness is continuously performed a predetermined number of times, or the predetermined number of times per unit time of the detection of the change in the randomness is the residence of the predetermined area The tendency change monitoring program of the degree of randomness according to claim 14, characterized in that it is set for each person.

(Supplementary Note 16) A randomness degree of the predetermined area is calculated by analyzing a captured image of the predetermined area sequentially acquired according to the passage of time,
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward lower randomness, or a change to a tendency that the speed of the randomness increases becomes slower Give a predetermined notification when a is detected,
A program for monitoring the tendency of change in randomness characterized in having a computer execute the process.

(Supplementary note 17) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day The trend monitoring program of the degree of randomness change as described in appendix 16, characterized in that.

(Supplementary note 18) The temporal change in the randomness level is determined for the resident of the predetermined area at a timing detected at the beginning of the day within the predetermined area, and within the predetermined area at the end of the day The tendency change monitoring program of the degree of randomness according to claim 16, characterized by being detected by comparing with the timing detected in the above.

(Supplementary Note 19) In the process of performing the predetermined notification, the process of comparing the degree of randomness calculated at a plurality of different timings is executed at a plurality of times with the timing to be compared changed and executed a plurality of times Detection of the change in the degree of randomness when it is detected that the lower degree of randomness tends to be the change in the degree of randomness or the tendency that the speed of the randomness increases is slowed based on the comparison result of the degree of randomness The program for monitoring the tendency of the degree of randomness change according to appendix 16, wherein the predetermined notification is performed when the predetermined number of consecutive times or more or the predetermined number of times per unit time is detected.

(Supplementary Note 20) In the process of performing the predetermined notification, a predetermined number of consecutive detections of the change in the randomness, or a predetermined number of unit time for the detection of the change in the randomness is the residence of the predetermined area. The tendency change monitoring program of the degree of randomness as set forth in appendix 19, characterized by being set for each person.

(Supplementary Note 21) A calculation unit that analyzes a captured image of a predetermined area sequentially acquired as time passes, and calculates the degree of randomness of the predetermined area;
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward higher randomness, or a change to a tendency that the speed of the randomness increases becomes faster A notification unit that performs a predetermined notification when
An apparatus for monitoring the tendency of change in randomness characterized by having:

(Supplementary note 22) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day The trend monitoring device of the change of the degree of randomness according to the appendix 21 characterized in that.

(Supplementary note 23) The temporal change in the randomness level is determined for the resident of the predetermined area at the beginning of the day at the timing detected in the predetermined area and at the end of the day in the predetermined area. 24. The tendency change monitoring device of the degree of randomness according to claim 21, which is detected by comparing it with the timing detected in step b.

(Supplementary Note 24) The notification unit performs the process of comparing the degree of randomness calculated at a plurality of different timings, the timing to be compared is changed, and the degree of randomness is compared at each timing. Based on the result, when it is detected that the tendency toward the higher degree of randomness or the change to the tendency for the speed of the randomness to increase becomes faster, the change in the degree of randomness is detected a predetermined number of times The apparatus for monitoring the tendency of the change in the degree of randomness according to appendix 21, wherein the predetermined notification is performed in the case where the above continuous operations are performed or when the predetermined notification or more per unit time is detected.

(Supplementary Note 25) The notification unit sets, for each resident of the predetermined area, a predetermined number of times in which the change in the randomness level is continuously detected or a predetermined number of times per unit time in the change in the randomness level. 24. The apparatus for monitoring the tendency of change in degree of randomness as set forth in appendix 24.

(Supplementary note 26) A calculation unit that analyzes a captured image of a predetermined area sequentially acquired as time passes, and calculates the degree of randomness of the predetermined area;
If it is detected that the calculated temporal change tendency of the randomness shows a change to a tendency toward lower randomness, or a change to a tendency that the speed of the randomness increases becomes slower A notification unit that performs a predetermined notification when
An apparatus for monitoring the tendency of change in randomness characterized by having:

(Supplementary note 27) The temporal change in the degree of randomness is detected by comparing the degrees of randomness calculated by analyzing captured images of the respective predetermined areas, which are acquired at predetermined times each day 26. The fluctuation monitor of the degree of randomness according to claim 26, characterized in that.

(Supplementary note 28) The temporal change in the randomness level is determined for the resident of the predetermined area at the beginning of the day at the timing detected in the predetermined area and at the end of the day in the predetermined area. 24. The apparatus for monitoring the tendency of the degree of randomness change according to note 26, wherein the apparatus is detected by comparing with the timing detected in.

(Supplementary note 29) The notification unit performs the process of comparing the degree of randomness calculated at a plurality of different timings, the timing to be compared being changed and the comparison of the degree of randomness at each timing being performed a plurality of times Based on the result, when it is detected that the lower the degree of randomness or the increase in the degree of randomness shows a change in the tendency to be slowed down, the change in the randomness is detected a predetermined number of times The apparatus for monitoring the tendency of change in the degree of randomness according to appendix 26, characterized in that the predetermined notification is performed when continuous, or when detected a predetermined number of times or more per unit time.

(Supplementary Note 30) The notification unit sets, for each resident of the predetermined area, a predetermined number of times in which the change in the randomness level is continuously detected or a predetermined number of times per unit time in the change in the randomness level. 29. The apparatus for monitoring the tendency of change in randomness as set forth in appendix 29.

DESCRIPTION OF SYMBOLS 1 surveillance system 10 entering facility 10a division 11a-11e camera 50 administrator terminal 100 server device 110 communication part 120 storage part 121 resident DB
122 Camera installation table 123 Sensing information DB
124 Characterization Table 125 Message DB
130 control unit 131 acquisition unit 132 calculation unit 133 determination unit 134 notification unit N network

Claims (6)

Analyzing the captured image of the predetermined area sequentially acquired according to the passage of time, and calculating the degree of randomness of the predetermined area;
The process of comparing the degree of randomness calculated at a plurality of different timings is changed with respect to the timing to be compared and the tendency of the temporal change of the degree of randomness is more high randomness become tendency, or, in a case where randomness is speed increase is detected to exhibit a change to tend to be faster, further wherein a change in randomness, successively detected a predetermined number of times or more, Alternatively, when a predetermined number of times or more per unit time is detected , a predetermined notification is provided.
A method of monitoring a tendency of change in randomness, characterized in that a computer executes processing. The timing to be the comparison target is a predetermined time every day, and the degree of randomness calculated by analyzing the captured image of each of the predetermined regions obtained at the predetermined time every day is compared to each other . The method according to claim 1, wherein a temporal change in the degree of randomness is detected. As the timing to be compared, for the resident of the predetermined area, the timing detected in the predetermined area at the beginning of the day, and the timing detected in the predetermined area at the end of the day The method according to claim 1 , wherein the temporal change in the degree of randomness is detected by comparing. In the process of performing the predetermined notification, a predetermined number of consecutive detections of the change in the randomness or a predetermined number per unit time of the detection of the change in the randomness is set for each resident of the predetermined area trend monitoring method of randomness of changes according to claim 1, characterized in that. Analyzing the captured image of the predetermined area sequentially acquired according to the passage of time, and calculating the degree of randomness of the predetermined area;
The process of comparing the degree of randomness calculated at a plurality of different timings is changed with the timing to be compared, and the tendency of the temporal change of the degree of randomness is more based on the result of comparison performed a plurality of times. high randomness become tendency, or, in a case where randomness is speed increase is detected to exhibit a change to tend to be faster, further wherein a change in randomness, successively detected a predetermined number of times or more, Alternatively, when a predetermined number of times or more per unit time is detected , a predetermined notification is provided.
A program for monitoring the tendency of change in randomness characterized in having a computer execute the process. A calculation unit that analyzes the captured image of a predetermined area sequentially acquired according to the passage of time and calculates the degree of randomness of the predetermined area;
The process of comparing the degree of randomness calculated at a plurality of different timings is changed with the timing to be compared, and the tendency of the temporal change of the degree of randomness is more based on the result of comparison performed a plurality of times. high randomness become tendency, or, in a case where randomness is speed increase is detected to exhibit a change to tend to be faster, further wherein a change in randomness, successively detected a predetermined number of times or more, Or a notification unit that performs predetermined notification when detection is performed a predetermined number of times or more per unit time ,
An apparatus for monitoring the tendency of change in randomness characterized by having:

Images