JP6354444B2 - Evaluation method, evaluation program, and information processing apparatus - Google Patents

Description

  The present invention relates to an evaluation method, an evaluation program, and an information processing apparatus.

  In recent years, there has been an increase in demand for nursing homes for elderly people. In the tenant facility, care may be provided to the resident by the staff. As the confirmation of the care implementation status by the staff, there is a technique for checking the care work operation based on the difference between the sample data of the operation and the imaged data for the possibility of the fraud of the care work operation.

JP 2007-004405 A

  However, it is difficult for an administrator to confirm the implementation status of care for all tenants in the tenant facility by visual observation or a monitoring camera. For example, when confirming whether or not the organization work is performed according to the care plan, the manager goes to the resident's room and confirms it visually, or confirms the image of the surveillance camera. In this case, it is difficult to compare the degree of messiness in the room before and after the arrangement work is visually performed, and it is not realistic for the surveillance camera to have a huge amount of confirmation work for all residents. There is a case.

  In one aspect, the present invention provides an evaluation method, an evaluation program, and an information processing apparatus that can output a comparison result of randomness.

  In one aspect, in the evaluation method, the computer executes a process of acquiring sensor information that is output from a sensor that detects a state of a specific area and that is generated when a predetermined exit event occurs. In the evaluation method, the computer executes a process of outputting a comparison result between the randomness obtained by analyzing the acquired sensor information and the reference randomness.

  Evaluate staff work.

FIG. 1 is a block diagram illustrating an example of the configuration of the evaluation system according to the embodiment. FIG. 2 is a diagram illustrating an example of a resident database. FIG. 3 is a diagram illustrating an example of a camera installation table. FIG. 4 is a diagram illustrating an example of the sensing information database. FIG. 5 is a diagram illustrating an example of a message database. FIG. 6 is a diagram illustrating an example of the determination work table. FIG. 7 is a diagram illustrating an example of an output screen. FIG. 8 is a diagram illustrating an example of a state in the living room. FIG. 9 is a diagram illustrating another example of a state in the living room. FIG. 10 is a diagram illustrating another example of a state in the living room. FIG. 11 is a flowchart illustrating an example of the recording process. FIG. 12 is a flowchart illustrating an example of the determination process. FIG. 13 is a flowchart illustrating an example of the comparison process. FIG. 14 is a flowchart illustrating an example of the comparison process. FIG. 15 is a diagram illustrating an example of a case where a part of a living room is compared. FIG. 16 is a diagram illustrating an example of calculation of the randomness when the height is used as an index of randomness. FIG. 17 is a diagram illustrating an example of a computer that executes an evaluation program.

  Hereinafter, embodiments of an evaluation method, an evaluation program, and an information processing apparatus disclosed in the present application will be described in detail based on the drawings. The disclosed technology is not limited by the present embodiment. Further, the following embodiments may be appropriately combined within a consistent range.

  FIG. 1 is a block diagram illustrating an example of the configuration of the evaluation system according to the embodiment. The evaluation system 1 shown in FIG. 1 includes, for example, information for evaluating the implementation status of care by a staff member, in particular, organizing work for cleaning up flickers in a room, in a resident facility with care for elderly people as an example of a resident facility 10. provide. The evaluation system 1 illustrated in FIG. 1 includes cameras 11a to 11e, an administrator terminal 50, and a server device 100. The cameras 11 a to 11 e are installed at various locations in the section 10 a of the tenant facility 10. In the following description, when the cameras 11a to 11e are not distinguished, they are simply referred to as the camera 11.

  The occupancy facility 10 has a plurality of layouts similar to the section 10a, and a plurality of cameras 11 are installed in each section in the same manner as the section 10a. In the following description, among the plurality of sections, the section 10a will be described as an example. However, the number of sections is not limited, and the evaluation system 1 includes the cameras 11 installed in an arbitrary number of sections. Also good. FIG. 1 shows the case where the system has one administrator terminal 50, but the number of administrator terminals 50 is not limited, and the evaluation system 1 has an arbitrary number of administrator terminals 50. May be.

  The camera 11, the administrator terminal 50, and the server device 100 are connected via a network N so that they can communicate with each other. For such a network N, any kind of communication network such as the Internet (Internet), LAN (Local Area Network), VPN (Virtual Private Network), etc. can be adopted regardless of wired or wireless.

  The evaluation system 1 calculates the degree of messiness based on the images captured by the cameras 11 installed in each room of the section 10a in which the elderly people move, and determines the degree of scattering in the room of the section 10a in which the elderly people move. judge. The evaluation system 1 compares the messiness degree before and after leaving the care staff, who is the staff who performs care, with the messiness level in a state where the room is cleaned, that is, organized, as the standard messiness level. The evaluation system 1 determines that the arrangement work by the care staff has been appropriately performed when the degree of randomness after the care staff leaves is within a predetermined range from the standard randomness. The evaluation system 1 determines that the arrangement work by the care staff is not properly performed when the degree of randomness after leaving the care staff is outside the predetermined range from the standard randomness. The evaluation system 1 transmits a determination result as to whether or not the organization work determined based on the comparison result between the randomness degree and the reference randomness degree has been appropriately performed, for example, to the administrator terminal 50, and a display unit (not shown) To display. Thereby, since the evaluation system 1 can show the manager of the occupancy facility 10 whether or not the arrangement work by the care staff is appropriately performed, the administrator can evaluate the arrangement work in the room by the care staff.

  The camera 11 is a network camera having a communication function, for example, and transmits a captured image to the server device 100 by being connected to the network N. That is, the camera 11 is an image sensor and is a sensor that detects the state of a specific region. The camera 11 captures an image using, for example, a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor as an image sensor. The camera 11 photoelectrically converts light received by the image sensor and performs A / D (Analog / Digital) conversion to generate an image. The camera 11 transmits the generated image to the server device 100 via the network N. The camera 11 may receive an instruction such as a shooting direction from the server device 100 and change the shooting direction. Moreover, the camera 11 is installed in the center or the corner of the ceiling of each room of the division 10a, for example.

  The manager terminal 50 is, for example, a computer used by the manager of the tenant facility 10. The administrator terminal 50 displays information relating to the organization work of each section in the occupancy facility 10 received from the server device 100 and presents it to the administrator. As an example of the administrator terminal 50, a portable personal computer can be adopted. As the administrator terminal 50, not only a portable terminal such as the above personal computer but also a stationary personal computer can be adopted as the administrator terminal 50. In addition to the personal computer described above, the administrator terminal 50 employs, for example, a mobile communication terminal such as a tablet terminal, a smartphone, a mobile phone, and a PHS (Personal Handyphone System) as a portable terminal. You can also.

  Next, the configuration of the server device 100 will be described. As illustrated in FIG. 1, the server device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. Note that the server apparatus 100 may include various functional units included in a known computer, for example, functional units such as various input devices and audio output devices, in addition to the functional units illustrated in FIG.

  The communication unit 110 is realized by, for example, a NIC (Network Interface Card). The communication unit 110 is a communication interface that is connected to the camera 11 and the administrator terminal 50 via the network N in a wired or wireless manner and manages information communication between the camera 11 and the administrator terminal 50. The communication unit 110 receives an image from the camera 11 and receives control information from the administrator terminal 50. The communication unit 110 outputs the received image or control information to the control unit 130. In addition, the communication unit 110 transmits a room ID (IDentifier) selection screen, an output screen, and the like input from the control unit 130 to the administrator terminal 50.

  The storage unit 120 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 includes a resident database 121, a camera installation table 122, a sensing information database 123, a message database 124, and a determination work table 125. In the following description, the database is abbreviated as DB. In addition, the storage unit 120 stores information used for processing in the control unit 130.

  The resident DB 121 stores occupants who move into each section in association with care staffs, managers, and the like. FIG. 2 is a diagram illustrating an example of a resident database. As shown in FIG. 2, the resident DB 121 includes items such as “room ID”, “resident name”, “care staff”, “manager name”, and “manager contact”. Each item of the resident DB 121 is registered in advance using the administrator terminal 50 or the like.

  “Room ID” identifies each section of the occupancy facility 10. “Resident name” indicates a resident who enters each section of the resident facility 10. “Care staff” indicates a staff member who performs an organization work for each room in each section. The “manager name” indicates a manager who manages the care staff, that is, a care manager. “Manager contact information” indicates, for example, an e-mail address or the like as the contact information of the administrator.

  The camera installation table 122 stores the number of cameras 11 to be installed, the ID of each camera 11, the installation location, and the number of standard edge lines in association with each section of the tenant facility 10. FIG. 3 is a diagram illustrating an example of a camera installation table. As illustrated in FIG. 3, the camera installation table 122 includes items such as “room ID”, “number of cameras installed”, “camera ID”, “installation location”, and “standard edge line number” for each camera 11.

  “Room ID” identifies each section of the occupancy facility 10. The “number of cameras installed” indicates the number of cameras 11 installed in each section identified by the room ID. “Camera ID” identifies the camera 11 installed in each room for each section. “Installation location” indicates a room or the like in a section where each camera 11 is installed. The “standard edge line number” indicates the standard randomness, and is the randomness in a state where the room is organized. The edge line is, for example, a line calculated by applying an edge filter to an image captured in a room to detect a luminance gradient, calculating a linear component based on the luminance gradient, and calculating the linear component. For example, in the case of a book, since each side has a linear component, four edge lines can be calculated. Since the “standard edge line number” is different for each resident, for example, the average value may be obtained by acquiring the degree of randomness every morning.

  The sensing information DB 123 stores the number of edge lines, which is the degree of messiness of each room every predetermined time, and a care staff entry flag indicating whether or not the care staff is entering the room. FIG. 4 is a diagram illustrating an example of the sensing information database. As shown in FIG. 4, the sensing information DB 123 includes items such as “date and time”, “number of edge lines”, and “care staff entry flag”. Note that the sensing information DB 123 may be provided for each room of the section 10a, for example, or the total value of the number of edge lines of each room of the section 10a and whether or not the care staff is entering the section 10a. A care staff entry flag may be included.

  “Date and time” indicates the date and time when an image is received from the camera 11 or the date and time when the camera 11 captures an image. For example, when one image is captured every 10 seconds, one record is recorded every 10 seconds. To do. “Number of edge lines” indicates the degree of randomness in the room. The “care staff entry flag” indicates “1” when the care staff enters the room, and indicates “0” when the care staff does not enter the room.

  The message DB 124 stores each flag indicating the comparison result of the degree of messiness before and after leaving the care staff and a message displayed on the output screen according to the combination of each flag in association with each other. FIG. 5 is a diagram illustrating an example of a message database. As illustrated in FIG. 5, the message DB 124 includes items such as “ID”, “pre-care flag”, “post-care flag”, “pre-care post-predetermined flag”, and “message”.

  “ID” identifies a message to be displayed on the output screen. The “pre-care flag”, “post-care flag” and “pre-care post-predetermined time flag” correspond to the same item in the determination work table 125, that is, the same flag. The column “*” for each flag indicates that the flag is applicable regardless of whether the flag of the determination work table 125 is “1” or “0”. “Message” indicates the content of the message displayed on the output screen in accordance with the combination of the flags.

  The determination work table 125 includes a flag relating to the degree of scattering based on the comparison result between the randomness and the reference randomness at the time when an event of entering or leaving the care staff occurs or when a predetermined time has elapsed after the care. It is stored in association with the camera ID. FIG. 6 is a diagram illustrating an example of the determination work table. As shown in FIG. 6, the determination work table 125 includes items such as “room ID”, “camera ID”, “pre-care flag”, “post-care flag”, and “post-care predetermined time flag”. The “pre-care flag”, “post-care flag” and “pre-care post-predetermined flag” have items such as “flag” and “time”, respectively.

  “Room ID” identifies each section of the occupancy facility 10. “Camera ID” identifies the camera 11 installed in each room for each section. The “pre-care flag” indicates whether or not the degree of randomness at the time when the care staff enters the room is within a predetermined range from the standard randomness. When the “flag” is “0”, the “pre-care flag” indicates that the randomness at the time when the care staff enters the room is within a predetermined range from the standard randomness, that is, the room is organized. Indicates that When the “pre-care flag” is “1”, the messiness level when the care staff enters the room is out of the predetermined range from the standard messiness level, that is, the room is messy. It shows that. “Time” indicates the time when the flag is set.

  The “post-care flag” indicates whether or not the degree of disorder when the care staff leaves the room is within a predetermined range from the standard degree of disorder. In the “post-care flag”, when the “flag” is “0”, the messiness level when the care staff leaves the room is within a predetermined range from the standard messiness level, that is, the room is arranged. It shows that. The “post-care flag” indicates that when the “flag” is “1”, the messiness level when the care staff leaves the room is out of the predetermined range from the standard messiness level, that is, the room is messy. Indicates. “Time” indicates the time when the flag is set.

  The “after-care-after-predetermined-time flag” indicates whether or not the degree of randomness at the time when the predetermined time has elapsed after the care staff leaves the room is within a predetermined range from the reference randomness. When the “flag” is “0”, the “post-care post-predetermined flag” is within a predetermined range from the reference randomness when the predetermined time has elapsed after the care staff leaves the room. That is, it shows that the living room is arranged. The “post-care post-predetermined time flag” indicates that when the “flag” is “1”, the randomness at the time when the predetermined time has elapsed after the care staff leaves the room is out of the predetermined range from the reference randomness. That is, the room is messy. Here, the predetermined time can be appropriately changed according to the resident, for example, 10 minutes, 30 minutes, 1 hour, half day, or the like. “Time” indicates the time when the flag is set.

  Returning to the description of FIG. 1, the control unit 130 executes, for example, a program stored in an internal storage device using a RAM as a work area by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. Is realized. Further, the control unit 130 may be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 130 includes an acquisition unit 131, a calculation unit 132, a determination unit 133, and an output control unit 134, and implements or executes information processing functions and operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 1, and may be another configuration as long as the information processing described below is performed.

  The acquisition unit 131 acquires an image of a living room from the camera 11 via the communication unit 110, that is, sensor information. For example, the acquisition unit 131 acquires a captured image obtained by capturing the state of the room every 10 seconds. The acquisition unit 131 outputs the acquired image to the calculation unit 132. Note that the acquisition unit 131 may acquire other information as sensor information. For example, the acquisition unit 131 may irradiate the living room with irradiation light and acquire a captured image including reflected light of the irradiation light. Moreover, the acquisition part 131 may acquire distance information from the distance sensor which irradiates a laser beam and measures distance, for example. The acquisition unit 131 may store the acquired captured image in the storage unit 120.

  When an image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image. For example, the calculation unit 132 detects the luminance gradient of the image using an edge filter. The calculation unit 132 calculates, for each pixel of the image, a linear component by combining neighboring pixels as edge components within a certain range of the intensity of the surrounding luminance gradient. For example, in the case where a rectangular desk is installed in the room and the image is taken from the ceiling direction, the calculating unit 132 has a straight line between the edge of the desk and the floor, and the desk and the floor have different luminances. Therefore, the linear component is calculated by combining the pixels at the boundary as edge components. For example, when clothing is placed on the floor, the calculation unit 132 performs the same processing on pixels at the boundary between the clothing edge and the floor surface, but the clothing edge may be a curve. . At this time, the calculation unit 132 calculates a linear component by approximating the curve with a straight line having a predetermined length. The calculation unit 132 calculates the number of straight line components, that is, the number of edge lines, based on the calculated straight line component. The calculation unit 132 records the image capturing date / time and the calculated number of edge lines in the sensing information DB 123 in association with each other. That is, the calculation unit 132 calculates the degree of randomness based on the number of edge lines.

  In addition, the calculation unit 132 detects the head of a person by matching the input image with a template image of the head stored in the storage unit 120, for example. For example, when the calculation unit 132 has one head detected in the section 10a and matches the template image of the resident's head, the care staff has not entered (exited). Is determined. When it is determined that the care staff has left, the calculation unit 132 sets the care staff entry flag corresponding to the image capturing date and time to “0” and records it in the sensing information DB 123.

  For example, when the head of the person detected in the section 10a matches the template image of the head of the care staff, the calculation unit 132 determines that the care staff has entered the room. If the calculation unit 132 determines that the care staff has entered the room, the care staff entry flag corresponding to the image capturing date and time is set to “1” and recorded in the sensing information DB 123. For example, the calculation unit 132 prints a marker representing a care staff on the uniform of the care staff and determines whether the care staff has entered the care staff when the marker is detected in the captured image. May be set to “1”. In addition, the calculation unit 132 is configured to determine whether or not the care staff has entered the room, for example, by having the care staff carry the ID card and installing it at the entrance of each section when entering or leaving each section. You may make it read to the card reader which does not. When causing the card reader to read the ID card, the calculation unit 132 can acquire information on the ID card and information indicating entry or exit and set a care staff entry flag. When the person entering the room is considered to be only the resident and the care staff, it may be determined that the care staff has entered the room when two heads are simply detected.

  When the determination unit 133 receives an instruction to execute the determination process from the administrator terminal 50, the determination unit 133 refers to the sensing information DB 123 according to an event such as the entry of a care staff and the state of the room when the event occurs. Then, it is determined whether or not the care staff has been properly arranged. The determination unit 133 refers to the resident DB 121 and acquires the room ID of the resident. The determination unit 133 generates a room ID selection screen and transmits the room ID selection screen to the administrator terminal 50 via the communication unit 110. Here, for example, the determination unit 133 extracts a resident who needs care other than the healthy person as the room ID of the resident included in the room ID selection screen. In addition, the determination unit 133 may use a floor plan of the tenant facility 10 as the room ID selection screen.

  Upon receiving the room ID selection information from the administrator terminal 50, the determination unit 133 performs comparison processing. The determination unit 133 acquires sensing information corresponding to the designated room ID from the sensing information DB 123 for a predetermined period. That is, the determination unit 133 acquires the date and time, the number of edge lines, and the care staff entry flag for a predetermined period based on the selection information of the room ID. Here, the determination unit 133 can acquire information corresponding to the room ID specified for one day, for example. Here, the determination unit 133 may select all target room IDs, or may select some room IDs.

  The determination unit 133 sequentially selects sensing information from the top of the acquired sensing information, and determines whether or not the care staff entry flag is “1”. When the care staff entry flag of the selected sensing information is not “1”, the determination unit 133 selects the next sensing information, that is, the sensing information stored in the next record, and the care staff entry flag is “ The determination of whether or not “1” is repeated. When the care staff entry flag of the selected sensing information is “1”, the determination unit 133 refers to the camera installation table 122 and selects the number of edge lines of the selected sensing information and the corresponding number of standard edge lines. And compare.

  The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines. Here, the predetermined range may be, for example, a fixed value such as “± 50” centered on the number of standard edge lines, or may be a positive value “70”, a negative value “30”, or the like. The predetermined range may be offset. Further, the predetermined range may be indicated by a ratio such as “± 20%” of the number of standard edge lines, for example, centering on the number of standard edge lines. However, when the range exceeds the minus side, a message prompting the user to reset the set value is displayed. In the examples described below, “out of range” assumes that the range in the plus direction is exceeded. When the range on the minus side is exceeded, it is desirable to prompt resetting of the standard edge line.

  When the number of edge lines of the selected sensing information is within a predetermined range from the standard edge line number, the determination unit 133 records the time, room ID, and pre-care flag “0” in the determination work table 125. When the number of edge lines of the selected sensing information is not within the predetermined range from the number of standard edge lines, the determination unit 133 records the time, room ID, and pre-care flag “1” in the determination work table 125. That is, the determination unit 133 determines the state of the room at the time when the care staff enters the room, that is, the degree of scattering. For the time, for example, the time can be used among the dates acquired from the sensing information DB 123, but all of the dates may be used.

  Here, using the camera ID “601-1” in the camera installation table 122 in FIG. 3 and the fourth line of the sensing information DB 123 in FIG. 4 as an example, the number of edge lines and the corresponding number of standard edge lines are compared. explain. Since the care staff entry flag of the selected sensing information is “1”, the determination unit 133 acquires the corresponding edge line number “299”. In addition, the determination unit 133 refers to the camera installation table 122 and acquires “120” as the number of corresponding standard edge lines. The determination unit 133 compares the number of edge lines “299” of the selected sensing information with the corresponding number of standard edge lines “120”.

  The determination unit 133 determines whether or not the number of edge lines “299” in the selected sensing information is within a predetermined range from the number of standard edge lines “120”. The predetermined range is, for example, “± 50”. Since the number of edge lines “299” is not within the range of the upper limit value “170” to the lower limit value “70” of the predetermined range, the determination unit 133 stores the time, room ID, and pre-care flag “1” in the determination work table 125. Is recorded.

  Next, when the determination unit 133 determines the state of the room when the care staff enters the room, the determination unit 133 sequentially selects the sensing information next to the selected sensing information, and the care staff room entry flag is “0”. It is determined whether or not. When the care staff entry flag of the selected sensing information is not “0”, the determination unit 133 selects the next sensing information, that is, the sensing information stored in the next record, and the care staff entry flag is “ The determination of whether or not “0” is repeated. When the care staff entry flag of the selected sensing information is “0”, the determining unit 133 refers to the camera installation table 122 and selects the number of edge lines of the selected sensing information and the corresponding number of standard edge lines. And compare.

  The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines. When the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines, the determination unit 133 associates the time, room ID, and pre-care flag with the room ID in the determination work table 125. Record “0”. When the number of edge lines of the selected sensing information is not within the predetermined range from the standard edge line number, the determination unit 133 associates the time, room ID, and pre-care flag “ Record 1 ”. That is, the determination unit 133 determines the state of the room at the time when the care staff leaves the room, that is, the degree of scattering.

  When the determination unit 133 determines the state of the room at the time when the care staff leaves the room, the determination unit 133 selects sensing information after a predetermined time after the care staff entry flag becomes “0”. The determination unit 133 refers to the camera installation table 122 and compares the number of edge lines of the selected sensing information with the corresponding number of standard edge lines. The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines. When the number of edge lines of the selected sensing information is within a predetermined range from the standard edge line number, the determination unit 133 associates the time, the room ID, and the post-care predetermined value in the determination work table 125 in association with the room ID. Record the flag “0” after time. When the number of edge lines of the selected sensing information is not within the predetermined range from the number of standard edge lines, the determination unit 133 associates the determination work table 125 with the room ID, the time, the room ID, and the predetermined time after care. The post flag “1” is recorded. That is, the determination unit 133 determines the state of the room after the predetermined time has elapsed from the time when the care staff leaves the room, that is, the degree of scattering. When the determination unit 133 determines the state of the room after a predetermined time has elapsed from the time when the care staff leaves the room, the determination unit 133 instructs the output control unit 134 to output the determination result.

  When the output control unit 134 is instructed to output the determination result from the determination unit 133, the output control unit 134 acquires a message corresponding to the flag of the determination work table 125 from the message DB 124. The output control unit 134 generates an output screen based on the acquired message and transmits the output screen to the administrator terminal 50 via the communication unit 110. That is, the output control unit 134 outputs the determination result. The output control unit 134 generates a room ID selection screen after transmitting the message, and transmits the screen to the administrator terminal 50 via the communication unit 110. The output control unit 134 determines whether information indicating that the end button has been pressed on the room ID selection screen has been received. The output control unit 134 instructs the determination unit 133 to wait for reception of the selection information of the room ID when it does not receive the information that the end button is pressed on the selection screen of the room ID. When the output control unit 134 receives information indicating that the end button has been pressed on the room ID selection screen, the output control unit 134 ends the process.

  Here, an example of the output screen will be described with reference to FIG. FIG. 7 is a diagram illustrating an example of an output screen. As shown in FIG. 7, for example, when the care staff enters the room, the output control unit 134 is messy, and when the care staff leaves the room, the care ends. An output screen 25 including a message indicating that the scatter is not sufficiently cared for is generated. That is, for example, when the pre-care flag of the determination work table 125 is “1” and the post-care flag is “1”, the output control unit 134 acquires a message with ID “002” in the message DB 124 and outputs the output screen 25. Is generated.

  Next, the state change pattern in the living room will be described with reference to FIGS. FIG. 8 is a diagram illustrating an example of a state in the living room. As shown in FIG. 8, the state 21a before the care staff enters the room and the state 22a when the care staff enters the room are messy. The state 23a at the time when the care staff leaves is arranged by the care staff appropriately performing the arrangement work in the room. Thereafter, for example, 30 minutes after the care staff leaves the room, the occupant is somewhat scattered by performing an operation such as reading a magazine. In the pattern of FIG. 8, for example, a message such as “Care in the living room has been completed.

  FIG. 9 is a diagram illustrating another example of a state in the living room. As shown in FIG. 9, in the living room, the state 21b before the care staff enters the room and the state 22b when the care staff enters the room are in a messy state. In the living room, if the care staff is not properly organizing, the state 23b when the care staff leaves is not fully organized. After that, for example, after 30 minutes of leaving the care staff, the living room is in a state that is not sufficiently arranged, that is, a messy state 24b. In the pattern of FIG. 9, for example, a message such as “Care in the living room has been completed.

  FIG. 10 is a diagram illustrating another example of a state in the living room. As shown in FIG. 10, the state 21c before the care staff enters the room and the state 22c when the care staff enters the room are messy. The state 23c at the time when the care staff leaves is arranged by the care staff appropriately performing the arrangement work in the room. Thereafter, the room becomes a state 24c in which the residents are intentionally scattered, for example, 30 minutes after leaving the care staff. In the pattern of FIG. 10, for example, the administrator terminal 50 displays, for example, “Care in the living room has been completed, and a predetermined time (30 minutes) has passed. Message is displayed. "

  In addition, as another pattern of state change, for example, there is a case where the care staff is arranged when the care staff enters the room, and the arrangement is also arranged when the care staff leaves. In this case, for example, a message such as “In the living room, it is in a sufficiently beautiful state before entering the care staff” is displayed. Also, for example, there are cases where the living room is arranged when the care staff enters the room and is scattered when the care staff leaves. In this case, for example, a message such as “There is a possibility that care staff is intentionally scattered in the living room” is displayed on the manager terminal 50.

  Next, the operation of the evaluation system 1 according to the embodiment will be described. First, the recording process which records the state of a living room in sensing information DB123 is demonstrated. FIG. 11 is a flowchart illustrating an example of the recording process. The acquisition unit 131 of the server device 100 acquires an image of a room from the camera 11 via the communication unit 110, for example, every 10 seconds (step S1). The acquisition unit 131 outputs the acquired image to the calculation unit 132.

  When an image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image. For example, the calculation unit 132 detects the luminance gradient of the image using an edge filter (step S2). For each pixel of the image, the calculating unit 132 calculates a linear component by combining adjacent pixels as edge components within a certain range of the intensity of the surrounding luminance gradient (step S3). The calculation unit 132 calculates the number of edge lines based on the calculated linear component (step S4). The calculating unit 132 records the image capturing date / time and the calculated number of edge lines in the sensing information DB 123 in association with each other (step S5).

  The calculation unit 132 determines whether the care staff has entered the room (step S6). When the care staff has entered the room (step S6: affirmative), the calculation unit 132 sets the care staff entry flag corresponding to the imaging date and time of the image to “1” (step S7), and enters the sensing information DB 123. Record. When the care staff has not entered the room (step S6: No), the calculation unit 132 sets the care staff entry flag corresponding to the image capturing date and time to “0” (step S8), and stores it in the sensing information DB 123. Record. When the recording of the care staff entry flag in the sensing information DB 123 ends, the calculation unit 132 returns to step S1 and repeats the same processing for the image acquired at the next timing. Thereby, the state in the living room and the entry or exit of the care staff can be recorded in association with each other.

  Next, determination processing for determining care staff organization work based on sensing information will be described. The determination process can be executed as a batch process at a predetermined interval such as once a day. FIG. 12 is a flowchart illustrating an example of the determination process. The determination unit 133 of the server device 100 refers to the resident DB 121 and acquires a resident's room ID and the like (step S51). The determination unit 133 generates a room ID selection screen and transmits the room ID selection screen to the administrator terminal 50 via the communication unit 110. The administrator terminal 50 displays the received room ID selection screen on a display unit (not shown) (step S52). For example, when a room ID is selected by the administrator, the manager terminal 50 transmits room ID selection information to the server apparatus 100.

  The determination unit 133 determines whether a room has been selected (step S53). That is, the determination unit 133 determines whether room ID selection information has been received from the administrator terminal 50. If the selection information of the room ID is not received from the administrator terminal 50 (No at Step S53), the determination unit 133 repeats the determination at Step S53 and waits until the selection information of the room ID is received. When the determination unit 133 receives the room ID selection information from the administrator terminal 50 (step S53: Yes), the determination unit 133 performs a comparison process (step S54).

  Here, the comparison process will be described with reference to FIGS. 13 and 14. 13 and 14 are flowcharts illustrating an example of the comparison process. The determination unit 133 acquires sensing information corresponding to the designated room ID for a predetermined period from the sensing information DB 123 (step S541). The determination unit 133 sequentially selects sensing information from the top of the acquired sensing information (step S542), and determines whether or not the care staff entry flag is “1” (step S543). If the care staff entry flag of the selected sensing information is not “1” (No at Step S543), the determination unit 133 returns to Step S542 and selects the next sensing information. That is, the determination unit 133 repeatedly determines whether or not the care staff entry flag is “1” for the sensing information.

  When the care staff entry flag of the selected sensing information is “1” (step S543: Yes), the determination unit 133 refers to the camera installation table 122, and the number of edge lines of the selected sensing information, The number of corresponding standard edge lines is compared (step S544). The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines (step S545). When the number of edge lines of the selected sensing information is within the predetermined range from the number of standard edge lines (step S545: affirmative), the determination unit 133 stores the time, room ID, and pre-care flag “ "0" is recorded (step S546). When the number of edge lines of the selected sensing information is not within the predetermined range from the number of standard edge lines (No at Step S545), the determination unit 133 stores the time, room ID, and pre-care flag “1” in the determination work table 125. Is recorded (step S547).

  The determination unit 133 sequentially selects the next sensing information after the selected sensing information (step S548), and determines whether or not the care staff entry flag is “0” (step S549). If the care staff entry flag is not “0” (No at Step S549), the determination unit 133 returns to Step S548 and selects the next sensing information. That is, the determination unit 133 repeatedly determines whether the care staff entry flag is “0” for the sensing information.

  When the care staff entry flag is “0” (Yes at step S549), the determination unit 133 refers to the camera installation table 122 and refers to the number of edge lines of the selected sensing information and the corresponding standard edge line. The number is compared (step S550). The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines (step S551). When the number of edge lines is within the predetermined range from the number of standard edge lines (step S551: Yes), the determination unit 133 associates the room ID with the time and post-care flag “0” in the determination work table 125. Is recorded (step S552). When the number of edge lines is not within the predetermined range from the number of standard edge lines (No at Step S551), the determination unit 133 sets the time and post-care flag “1” in the determination work table 125 in association with the room ID. Recording is performed (step S553).

  The determination unit 133 selects sensing information a predetermined time after the care staff entry flag becomes “0” (step S554). The determination unit 133 refers to the camera installation table 122 and compares the number of edge lines of the selected sensing information with the corresponding number of standard edge lines (step S555). The determination unit 133 determines whether or not the number of edge lines of the selected sensing information is within a predetermined range from the number of standard edge lines (step S556). When the number of edge lines is within the predetermined range from the number of standard edge lines (step S556: Yes), the determination unit 133 associates the determination work table 125 with the room ID and sets the time and a post-care predetermined time flag. “0” is recorded (step S557). When the number of edge lines of the selected sensing information is not within the predetermined range from the number of standard edge lines (No at Step S556), the determination unit 133 associates the time and care with the determination work table 125 in association with the room ID. After the predetermined time, a flag “1” is recorded (step S558). When the determination unit 133 determines the state of the room after a predetermined time has elapsed from the time when the care staff leaves the room, the determination unit 133 instructs the output control unit 134 to output the determination result.

  When the output control unit 134 is instructed to output the determination result from the determination unit 133, the output control unit 134 acquires a message corresponding to the flag of the determination work table 125 from the message DB 124. The output control unit 134 outputs the acquired message, that is, the determination result (step S559). That is, the output control unit 134 generates an output screen based on the message and transmits the output screen to the administrator terminal 50 via the communication unit 110. Thereby, based on the sensing information of the sensing information DB 123, a message related to the degree of randomness according to an event such as entering or leaving the care staff, that is, the degree of scattering can be output.

  Returning to the description of FIG. 12, after the message is transmitted, the output control unit 134 generates a room ID selection screen and transmits it to the administrator terminal 50 via the communication unit 110. The administrator terminal 50 displays the received room ID selection screen on a display unit (not shown) (step S55). The output control unit 134 determines whether information indicating that the end button has been pressed on the room ID selection screen has been received (step S56). The output control unit 134 instructs the determination unit 133 to wait for reception of the room ID selection information when it does not receive the information indicating that the end button is pressed on the room ID selection screen (step S56: No). . When the output control unit 134 receives information indicating that the end button has been pressed on the room ID selection screen (step S56: Yes), the output control unit 134 ends the determination process. Thereby, the message which concerns on the degree of randomness according to events, such as entering or leaving the care staff for every resident, can be output.

  As described above, the evaluation system 1 acquires sensor information that is output from a sensor that detects the state of a specific region, and that is obtained when a predetermined exit event occurs, and analyzes the acquired sensor information. The comparison result between the randomness obtained in this way and the standard randomness is output. As a result, the comparison result of the randomness can be output. Moreover, the work of the staff can be evaluated based on the comparison result of the degree of randomness.

  Further, the evaluation system 1 determines the degree of randomness and the reference obtained by analyzing the sensor information output from the sensor when it is detected that a staff member who performs a predetermined operation on the specific area has left the specific area. Compare messiness. The evaluation system 1 determines whether or not the predetermined work by the staff has been appropriately performed based on the comparison result, and outputs the determination result. As a result, it is possible to evaluate whether or not the staff has appropriately performed the predetermined work when the staff leaves the room.

  Further, the evaluation system 1 compares the first randomness obtained by analyzing the sensor information output from the sensor at the first time point when the exit from the specific area is detected with the reference randomness. Further, the evaluation system 1 compares the second randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference randomness. . Further, the evaluation system 1 determines whether or not the user who uses the specific area needs attention based on these comparison results, and outputs the determination result. As a result, it is possible to detect that a resident deliberately scatters after leaving the staff and to determine that attention is required. It can be carried out.

  Further, the evaluation system 1 is obtained by analyzing sensor information output from the sensor at a third time point when it is detected that a staff member who performs a predetermined operation on the specific area has entered the specific area. The third randomness is compared with the standard randomness. In addition, the evaluation system 1 appropriately performs predetermined work by the staff based on the comparison result between the third randomness degree and the reference randomness degree and the comparison result between the first randomness degree and the reference randomness degree. It is determined whether or not, and the determination result is output. As a result, the predetermined work of the staff can be evaluated based on the degree of scattering when the staff enters the room and the degree of scattering when the staff leaves.

  In addition, the evaluation system 1 performs image analysis on sensor information that is a captured image output from a sensor that is an image capturing apparatus that captures an image of a specific region, and obtains a randomness that is the number of edge lines based on the edge of the object. As a result, the degree of randomness can be easily obtained.

  Moreover, the evaluation system 1 determines that the predetermined work by the staff is not appropriately performed for the specific area when the randomness deviates from the reference randomness by a predetermined amount or more, and outputs a determination result. As a result, it is possible to suppress erroneous determination that the degree of scatter has increased due to a change in the arrangement of the room accompanying the daily life of the resident.

  Moreover, the evaluation system 1 determines that the predetermined work by the staff is not appropriately performed for a specific area when the randomness increases by a predetermined amount or more from the reference randomness, and outputs a determination result. As a result, it is possible to suppress erroneous determination that the degree of scatter has increased due to a change in the arrangement of the room accompanying the daily life of the resident.

  In addition, the evaluation system 1 detects that a predetermined entrance event has occurred by increasing the number of human heads in a captured image obtained by capturing a specific area with a sensor that is an imaging device. As a result, a predetermined entry event can be easily detected.

  In addition, the evaluation system 1 changes from a state in which a marker representing a staff is not detected to a state in which a marker is detected in a captured image obtained by capturing a specific area with a sensor that is an imaging device, thereby causing a predetermined entry event to occur. Is detected. In addition, the evaluation system 1 detects that a predetermined exit event has occurred by making a transition from a state in which the marker is detected in the captured image to a state in which the marker is not detected. As a result, it is possible to easily distinguish a person who does not perform care such as a resident's family and a staff.

  The evaluation system 1 has an ID card reader, and detects information on an ID card possessed by the staff together with information indicating entry, thereby detecting that a predetermined entry event has occurred. Moreover, the evaluation system 1 detects that the predetermined leaving event generate | occur | produced by detecting the information of ID card with the information showing leaving. As a result, it is possible to easily distinguish a person who does not perform care such as a resident's family and a staff.

  In the above embodiment, the messiness is calculated for the entire range in the room, but the present invention is not limited to this. For example, the randomness may be calculated for a part of the room and compared with the reference randomness. FIG. 15 is a diagram illustrating an example of a case where a part of a living room is compared. As shown in FIG. 15, the evaluation system 1 calculates a messiness degree for the range 27 except for a portion in the living room 26 where furniture that cannot be moved easily, such as a chiffon, is arranged. It can be compared with the reference randomness. Thereby, the calculation process of randomness can be reduced.

  Moreover, in the said Example, although the number of edge lines was used as a randomness degree, it is not limited to this. For example, the height of the room measured by the distance sensor may be used as an indicator of the degree of randomness. FIG. 16 is a diagram illustrating an example of calculation of the randomness when the height is used as an index of randomness. As illustrated in FIG. 16, the server apparatus 100 acquires a reference state 28 and height information 30 based on the reference state 28 in advance. Further, the server device 100 acquires the comparison target 29 that is in a messed state and the height information 31 based on the comparison target 29. Here, when the comparison object 29 and the height information 31 are compared with the reference state 28 and the height information 30, it is assumed that the object 29a and the height information 29b related to the object 29a are increased. Subsequently, when the difference 32 between the height information 30 and the height information 31 is taken, an area 29c corresponding to the height information 29b can be calculated as the randomness.

  Here, for example, the height information 30 and 31 is obtained by irradiating a living room from a light source installed on the ceiling and capturing an image including reflected light of the irradiated light and phase information of the irradiated light and reflected light. Then, image analysis is performed, and a distance is calculated for each pixel of the captured image based on the phase information. That is, the height information 30 and 31 can be obtained by calculating the distance by TOF (Time Of Flight). Further, the height information 30 and 31 can be obtained by, for example, irradiating irradiation light including a specific pattern from a light source into a living room, and calculating a distance based on the specific pattern. Further, the height information 30 and 31 can be obtained based on the distance measured using a distance sensor that measures the distance by irradiating the living room with laser light, for example. Here, for example, a rider (LIDAR: Light Detection and Ranging or Laser Imaging Detection and Ranging or LADAR: Laser Detection and Ranging) can be used as the distance sensor.

  When the height is used as an indicator of the degree of messiness in the room, the evaluation system 1 provides, for example, a terminal device for each section of the occupancy facility 10, and the terminal device determines the degree of messiness based on the height of the room. calculate. The terminal device calculates, for example, the degree of randomness based on height instead of the number of edge lines as sensing information that is a part of the processing of the calculation unit 132 of the server device 100, and transmits it to the server device 100.

  As described above, the evaluation system 1 is an imaging device that irradiates a specific region with irradiation light and captures an image of the specific region including the reflected light of the irradiation light and the phase information of the irradiation light and the reflected light. Sensor information which is a captured image output from a certain sensor is subjected to image analysis, and a randomness is obtained based on a distance calculated for each pixel of the captured image based on phase information. As a result, it is possible to obtain a degree of randomness considering elements in the height direction.

  Moreover, the evaluation system 1 obtains a randomness by calculating a distance based on a specific pattern of irradiation light including a specific pattern. As a result, it is possible to easily obtain the degree of randomness considering the elements in the height direction.

  In addition, the evaluation system 1 obtains a randomness degree based on distance information included in sensor information that is distance information output from a sensor that is a distance sensor that measures a distance by irradiating a specific region with laser light. . As a result, it is possible to obtain a degree of randomness considering elements in the height direction.

  In addition, each component of each part illustrated does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each unit is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in arbitrary units according to various loads or usage conditions. Can be configured. For example, the process of calculating the sensing information of the calculation unit 132 may be performed on the camera 11 side.

  Furthermore, various processing functions performed by each device may be executed entirely or arbitrarily on a CPU (or a microcomputer such as an MPU or MCU (Micro Controller Unit)). In addition, various processing functions may be executed in whole or in any part on a program that is analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware based on wired logic. Needless to say, it is good.

  By the way, the various processes described in the above embodiments can be realized by executing a program prepared in advance by a computer. Therefore, in the following, an example of a computer that executes a program having the same function as in the above embodiment will be described. FIG. 17 is a diagram illustrating an example of a computer that executes an evaluation program.

  As illustrated in FIG. 17, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives data input, and a monitor 203. The computer 200 also includes a medium reading device 204 that reads a program and the like from a storage medium, an interface device 205 for connecting to various devices, and a communication device 206 for connecting to other information processing devices and the like by wire or wirelessly. Have The computer 200 also includes a RAM 207 that temporarily stores various types of information and a hard disk device 208. Each device 201 to 208 is connected to a bus 209.

  The hard disk device 208 stores an evaluation program having the same functions as the processing units of the acquisition unit 131, the calculation unit 132, the determination unit 133, and the output control unit 134 illustrated in FIG. The hard disk device 208 also stores a resident DB 121, a camera installation table 122, a sensing information DB 123, a message DB 124, a determination work table 125, and various data for realizing an evaluation program. The input device 202 receives input of various information such as management information from an administrator of the computer 200, for example. The monitor 203 displays, for example, a management information screen and various screens for the administrator of the computer 200. The interface device 205 is connected to, for example, a printing device. For example, the communication device 206 has the same function as the communication unit 110 illustrated in FIG. 1 and is connected to the network N, and exchanges various information with the administrator terminal 50, the camera 11, and other devices.

  The CPU 201 reads out each program stored in the hard disk device 208, develops it in the RAM 207, and executes it to perform various processes. In addition, these programs can cause the computer 200 to function as the acquisition unit 131, the calculation unit 132, the determination unit 133, and the output control unit 134 illustrated in FIG.

  Note that the above evaluation program is not necessarily stored in the hard disk device 208. For example, the computer 200 may read and execute a program stored in a storage medium readable by the computer 200. The storage medium readable by the computer 200 corresponds to, for example, a portable recording medium such as a CD-ROM, a DVD disk, a USB (Universal Serial Bus) memory, a semiconductor memory such as a flash memory, a hard disk drive, and the like. Alternatively, the evaluation program may be stored in a device connected to a public line, the Internet, a LAN, or the like, and the computer 200 may read and execute the evaluation program therefrom.

  As described above, the following supplementary notes are further disclosed regarding the embodiment including the present example.

(Additional remark 1) It is sensor information output from the sensor which detects the state of a specific area, Comprising: Sensor information at the time of a predetermined leaving event occurs,
Outputting a comparison result between the randomness obtained by analyzing the acquired sensor information and the standard randomness,
An evaluation method, wherein a computer executes processing.

(Additional remark 2) The said process to output analyzes the said sensor information output from the said sensor at the time of detecting that the staff who performs a predetermined | prescribed operation | work with respect to the said specific area withdrew from the said specific area. The supplementary note 1 is characterized in that, based on a comparison result between the obtained randomness degree and a reference randomness degree, whether or not the predetermined work by the staff is appropriately performed is determined, and a determination result is output. Evaluation method.

(Additional remark 3) The said process to output is the 1st randomness obtained by analyzing the said sensor information output from the said sensor at the 1st time which detected having withdraw | exited from the said specific area | region, and the said reference | standard The result of comparison with the degree of randomness, and the second degree of randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference The evaluation method according to appendix 2, characterized in that, based on a result of comparison with the degree of randomness, whether or not a user who uses the specific area needs attention is determined and a determination result is output.

(Additional remark 4) The said process to output is further the said sensor output from the said sensor at the 3rd time which detected that the staff who performs predetermined work with respect to the said specific area entered into the said specific area Based on the comparison result between the third randomness degree obtained by analyzing information and the reference randomness degree, and the comparison result between the first randomness degree and the reference randomness degree, the predetermined number by the staff The evaluation method according to appendix 3, wherein it is determined whether or not the work has been appropriately performed, and a determination result is output.

(Additional remark 5) The said process to output carries out image analysis of the said sensor information which is the picked-up image output from the said sensor which is an imaging device which images the image of the said specific area, and is the number of edge lines based on the edge of an object. The evaluation method according to any one of appendices 2 to 4, wherein the degree of randomness is obtained.

(Additional remark 6) The said process to output is the image of the said specific area | region which irradiates irradiation light with respect to the said specific area | region, and includes the reflected light of the said irradiation light, and the phase information of the said irradiation light and the said reflected light The sensor information that is a captured image output from the sensor that is an imaging device that captures the image is subjected to image analysis, and the randomness is obtained based on the distance calculated for each pixel of the captured image based on the phase information. The evaluation method according to any one of appendices 2 to 4, characterized by:

(Supplementary note 7) The evaluation method according to supplementary note 6, wherein the output process obtains the degree of randomness by calculating a distance based on the specific pattern of the irradiation light including a specific pattern.

(Supplementary Note 8) The distance information included in the sensor information that is the distance information output from the sensor that is a distance sensor that measures the distance by irradiating the specific region with laser light. The evaluation method according to any one of appendices 2 to 4, wherein the randomness degree is obtained based on the method.

(Additional remark 9) The said process to output determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region when the said randomness deviates more than the predetermined amount from the said reference randomness. The evaluation method according to any one of appendices 2 to 8, wherein a determination result is output.

(Additional remark 10) The said process to output determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region, when the said randomness increases more than the reference | standard randomness more than predetermined amount. The evaluation method according to appendix 9, wherein a determination result is output.

(Additional remark 11) The said process to output detects that the predetermined | prescribed entrance event generate | occur | produced because the head of a person increases in the picked-up image which imaged the said specific area | region with the said sensor which is an imaging device. The evaluation method according to any one of Supplementary notes 2 to 10.

(Additional remark 12) The said process to output is predetermined by changing from the state which does not detect the marker showing the said staff in the captured image which imaged the said specific area | region with the said sensor which is an imaging device to the state which detected the said marker. It is detected that the predetermined exit event has occurred by transitioning from a state in which the marker is detected in the captured image to a state in which the marker is not detected. The evaluation method according to any one of Supplementary notes 2 to 10.

(Supplementary note 13) In the output process, the sensor has an ID card reader, and the information on the ID card possessed by the staff is detected together with the information indicating the entry, whereby a predetermined entry event has occurred. The evaluation according to any one of appendices 2 to 10, wherein the occurrence of the predetermined exit event is detected by detecting and detecting information on the ID card together with information indicating exit. Method.

(Additional remark 14) It is sensor information output from the sensor which detects the state of a specific area | region, Comprising: The sensor information when a predetermined leaving event generate | occur | produces,
Outputting a comparison result between the randomness obtained by analyzing the acquired sensor information and the standard randomness,
An evaluation program for causing a computer to execute processing.

(Additional remark 15) The said process to output analyzes the said sensor information output from the said sensor at the time of detecting that the staff who performs a predetermined | prescribed operation | work with respect to the said specific area withdraws from the said specific area. The supplementary note 14 is characterized in that, based on a comparison result between the obtained randomness and a reference randomness, it is determined whether or not the predetermined work by the staff is appropriately performed, and a determination result is output. Evaluation program.

(Supplementary Note 16) The output processing includes the first randomness obtained by analyzing the sensor information output from the sensor at the first time point when the exit from the specific area is detected, and the reference The result of comparison with the degree of randomness, and the second degree of randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference 15. The evaluation program according to appendix 14, characterized in that, based on a result of comparison with the degree of randomness, it is determined whether or not a user who uses the specific area needs attention, and a determination result is output.

(Additional remark 17) The said process to output is further the said sensor output from the said sensor at the 3rd time which detected that the staff who performs predetermined work with respect to the said specific area entered into the said specific area | region Based on the comparison result between the third randomness degree obtained by analyzing information and the reference randomness degree, and the comparison result between the first randomness degree and the reference randomness degree, the predetermined number by the staff The evaluation program according to appendix 15, wherein it is determined whether or not the work has been appropriately performed, and a determination result is output.

(Additional remark 18) The said process to output carries out image analysis of the said sensor information which is the picked-up image output from the said sensor which is an imaging device which images the image of the said specific area, and is the number of edge lines based on the edge of an object. The evaluation program according to any one of supplementary notes 15 to 17, wherein the degree of randomness is obtained.

(Additional remark 19) The process of outputting is the image of the said specific area | region which irradiates irradiation light with respect to the said specific area, and includes the reflected light of the said irradiation light, and the phase information of the said irradiation light and the said reflected light The sensor information that is a captured image output from the sensor that is an imaging device that captures the image is subjected to image analysis, and the randomness is obtained based on the distance calculated for each pixel of the captured image based on the phase information. The evaluation program according to any one of supplementary notes 15 to 17, characterized by:

(Supplementary note 20) The evaluation program according to supplementary note 19, wherein the output process obtains the degree of randomness by calculating a distance based on the specific pattern of the irradiation light including a specific pattern.

(Supplementary note 21) The distance information included in the sensor information that is the distance information output from the sensor that is a distance sensor that measures the distance by irradiating the specific region with laser light. The evaluation program according to any one of appendices 15 to 17, wherein the degree of randomness is obtained based on the score.

(Additional remark 22) The said process to output determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region when the said randomness deviates more than the predetermined amount from the said reference randomness. The evaluation program according to any one of supplementary notes 15 to 21, wherein a determination result is output.

(Additional remark 23) The said process to output determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region when the said randomness increases more than the reference | standard randomness more than predetermined amount. The evaluation program according to attachment 22, wherein the determination result is output.

(Additional remark 24) The said process to output detects that the predetermined | prescribed entrance event generate | occur | produced when the head of a person increases in the picked-up image which imaged the said specific area | region with the said sensor which is an imaging device. The evaluation program according to any one of Supplementary notes 15 to 23.

(Supplementary Note 25) The output process is performed by changing from a state in which a marker representing the staff is not detected to a state in which the marker is detected in a captured image obtained by capturing the specific region by the sensor that is an imaging device. It is detected that the predetermined exit event has occurred by transitioning from a state in which the marker is detected in the captured image to a state in which the marker is not detected. The evaluation program according to any one of Supplementary Notes 15 to 23.

(Supplementary note 26) In the output process, the sensor has an ID card reader, and the ID card information possessed by the staff is detected together with the information indicating the entry, so that a predetermined entry event has occurred. The evaluation according to any one of appendices 15 to 23, wherein the occurrence of the predetermined exit event is detected by detecting and detecting information on the ID card together with information indicating exit. program.

(Supplementary Note 27) Sensor information that is output from a sensor that detects the state of a specific area, and that acquires sensor information when a predetermined exit event occurs;
An output control unit that outputs a comparison result between the randomness obtained by analyzing the acquired sensor information and the standard randomness;
An information processing apparatus comprising:

(Additional remark 28) The said output control part analyzes the said sensor information output from the said sensor at the time of detecting that the staff who performs a predetermined | prescribed operation | work with respect to the said specific area left | separated from the said specific area. 28. The appendix 27, wherein it is determined whether or not the predetermined work by the staff has been appropriately performed based on a comparison result between the obtained randomness and a reference randomness, and a determination result is output. Information processing device.

(Supplementary note 29) The output control unit, the first randomness obtained by analyzing the sensor information output from the sensor at the first time point when the exit from the specific area is detected and the reference The result of comparison with the degree of randomness, and the second degree of randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference 28. The information processing apparatus according to appendix 27, wherein whether or not the user who uses the specific area needs attention is determined based on a comparison result with the degree of randomness, and the determination result is output.

(Supplementary Note 30) The output control unit further outputs the sensor output from the sensor at a third time point when it is detected that a staff member who performs a predetermined operation on the specific area has entered the specific area. Based on the comparison result between the third randomness degree obtained by analyzing information and the reference randomness degree, and the comparison result between the first randomness degree and the reference randomness degree, the predetermined number by the staff The information processing apparatus according to appendix 29, wherein it is determined whether or not the work has been appropriately performed, and a determination result is output.

(Additional remark 31) The said output control part image-analyzes the said sensor information which is the picked-up image output from the said sensor which is an imaging device which images the image of the said specific area | region, and is the number of edge lines based on the edge of an object. The information processing apparatus according to any one of appendices 28 to 30, wherein the certain degree of randomness is obtained.

(Supplementary Note 32) The output control unit irradiates the specific region with irradiation light and reflects the reflected light of the irradiation light, and the image of the specific region including phase information of the irradiation light and the reflected light The sensor information that is a captured image output from the sensor that is an imaging device that captures the image is subjected to image analysis, and the randomness is obtained based on the distance calculated for each pixel of the captured image based on the phase information. The information processing apparatus according to any one of supplementary notes 28 to 30, characterized by:

(Supplementary note 33) The information processing apparatus according to supplementary note 32, wherein the output control unit obtains the degree of randomness by calculating a distance based on the specific pattern of the irradiation light including a specific pattern. .

(Supplementary Note 34) The distance information included in the sensor information, which is distance information output from the sensor, which is a distance sensor that measures a distance by irradiating the specific region with laser light. 31. The information processing apparatus according to any one of appendices 28 to 30, wherein the degree of randomness is obtained based on the information.

(Additional remark 35) The said output control part determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region, when the said randomness deviates more than the predetermined amount from the said reference randomness. The information processing apparatus according to any one of appendices 28 to 34, wherein the determination result is output.

(Additional remark 36) The said output control part determines that the said predetermined | prescribed operation | work by the said staff is not performed appropriately about the said specific area | region, when the said randomness increases more than the reference | standard randomness more than predetermined amount. 36. The information processing apparatus according to appendix 35, wherein the determination result is output.

(Supplementary Note 37) The output control unit detects that a predetermined entrance event has occurred due to an increase in the number of human heads in a captured image obtained by capturing the specific area with the sensor serving as an imaging device. The information processing apparatus according to any one of supplementary notes 28 to 36.

(Additional remark 38) The said output control part is predetermined by changing from the state which does not detect the marker showing the said staff in the captured image which imaged the said specific area | region with the said sensor which is an imaging device to the state which detected the said marker. It is detected that the predetermined exit event has occurred by transitioning from a state in which the marker is detected in the captured image to a state in which the marker is not detected. The information processing apparatus according to any one of supplementary notes 28 to 36.

(Supplementary Note 39) The output control unit detects that a predetermined entry event has occurred by detecting the ID card information possessed by the staff together with information indicating entry into the room, the sensor having an ID card reader. 37. The information according to any one of appendices 28 to 36, wherein detection of the predetermined exit event is detected by detecting and detecting information on the ID card together with information indicating exit. Processing equipment.

DESCRIPTION OF SYMBOLS 1 Evaluation system 10 Resident facility 10a Section 11a-11e Camera 50 Manager terminal 100 Server apparatus 110 Communication part 120 Storage part 121 Resident DB
122 Camera installation table 123 Sensing information DB
124 Message DB
125 determination work table 130 control unit 131 acquisition unit 132 calculation unit 133 determination unit 134 output control unit N network

Claims (13)

Sensor information that is output from a sensor that detects the state of a specific area, and obtains sensor information when a predetermined exit event occurs,
At the time of staff performs a predetermined operation on the specific area is detected that exited from the specific area, the comparison result of the randomness and the reference randomness obtained by analyzing the obtained the sensor information based on, it is determined whether the predetermined operation by the staff in improper a processing you outputs the judgment result to the computer is running,
The output process includes a first randomness degree obtained by analyzing the sensor information output from the sensor at a first time point when the exit from the specific area is detected and the reference randomness degree. The comparison result and the second randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference randomness Based on the comparison result, it is determined whether or not there is a need for attention to the user who uses the specific area, and the determination result is output.
An evaluation method characterized by that. The output processing further analyzes the sensor information output from the sensor at a third time point when it is detected that a staff member who performs a predetermined operation on the specific area has entered the specific area. The predetermined work by the staff is appropriately performed based on the comparison result between the third degree of randomness and the reference degree of randomness and the comparison result between the first degree of randomness and the reference degree of randomness. The evaluation method according to claim 1 , wherein it is determined whether or not the determination has been performed, and a determination result is output. The output processing includes analyzing the sensor information, which is a captured image output from the sensor, which is an imaging device that captures an image of the specific area, and analyzing the degree of randomness that is the number of edge lines based on an edge of an object The evaluation method according to claim 1, wherein: The output processing is performed by irradiating the specific region with irradiation light and capturing an image of the specific region including reflected light of the irradiation light and phase information of the irradiation light and the reflected light. The sensor information which is a captured image output from the sensor which is a device is subjected to image analysis, and the randomness is obtained based on a distance calculated for each pixel of the captured image based on the phase information. The evaluation method according to claim 1 or 2 . The evaluation method according to claim 4 , wherein the output process obtains the degree of randomness by calculating a distance based on the specific pattern of the irradiation light including a specific pattern. The output process is based on the distance information included in the sensor information that is distance information output from the sensor that is a distance sensor that measures a distance by irradiating the specific region with laser light. evaluation method according to claim 1 or 2, characterized in that to obtain randomness. The output process determines that the predetermined work by the staff is not appropriately performed for the specific area when the randomness deviates from the reference randomness by a predetermined amount or more, and determines the determination result. The evaluation method according to claim 1 , wherein the evaluation method is output. The output process determines that the predetermined work by the staff is not appropriately performed for the specific area when the randomness increases by a predetermined amount or more from the reference randomness, and determines the determination result. The evaluation method according to claim 7 , wherein output is performed. The output process detects that a predetermined entrance event has occurred due to an increase in the head of a person in a captured image obtained by imaging the specific area by the sensor as an imaging device. The evaluation method according to any one of 1 to 8 . In the output process, a predetermined entry event is generated by transitioning from a state in which the marker representing the staff is not detected to a state in which the marker is detected in a captured image obtained by capturing the specific region by the sensor that is an imaging device. and detects the occurrence, makes a transition from a state of detecting the marker in the captured image to a state of not detecting said marker, claim 1, characterized in that for detecting that said predetermined exit event occurs The evaluation method as described in any one of -8 . In the output process, the sensor has an ID card reader, and detects information on an ID card possessed by the staff together with information indicating entry, thereby detecting that a predetermined entry event has occurred, the information of the ID card, by detecting with information representative of the exit, the evaluation method according to any one of claims 1 to 8, characterized in that for detecting that said predetermined exit event has occurred. Sensor information that is output from a sensor that detects the state of a specific area, and obtains sensor information when a predetermined exit event occurs,
At the time of staff performs a predetermined operation on the specific area is detected that exited from the specific area, the comparison result of the randomness and the reference randomness obtained by analyzing the obtained the sensor information based on, it is determined whether the predetermined operation by the staff in improper to execute the processing you outputs the determination result to the computer,
The output process includes a first randomness degree obtained by analyzing the sensor information output from the sensor at a first time point when the exit from the specific area is detected and the reference randomness degree. The comparison result and the second randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference randomness Based on the comparison result, it is determined whether or not there is a need for attention to the user who uses the specific area, and the determination result is output.
An evaluation program characterized by that. Sensor information that is output from a sensor that detects the state of a specific region, and an acquisition unit that acquires sensor information when a predetermined exit event occurs;
At the time of staff performs a predetermined operation on the specific area is detected that exited from the specific area, the comparison result of the randomness and the reference randomness obtained by analyzing the obtained the sensor information based on, it is determined whether the predetermined operation by the staff in improper and an output control section for outputting a determination result,
The output control unit includes a first randomness obtained by analyzing the sensor information output from the sensor at a first time point when detecting that the vehicle has left the specific area, and a reference randomness. The comparison result and the second randomness obtained by analyzing the sensor information output from the sensor at a second time when a predetermined time has elapsed from the first time and the reference randomness Based on the comparison result, it is determined whether or not there is a need for attention to the user who uses the specific area, and the determination result is output.
An information processing apparatus characterized by that.

Images