JP6481400B2 - Cleaning status evaluation method, cleaning status evaluation program, and cleaning status evaluation device - Google Patents

Description

  The present invention relates to a cleaning condition evaluation method, a cleaning condition evaluation program, and a cleaning condition evaluation apparatus.

  In recent years, there has been an increase in demand for nursing homes for elderly people. In the tenant facility, care may be provided to the resident by the staff. One of the care provided by the staff is cleaning the resident's room. As a cleaning of a living room, a robot has been proposed that performs self-running cleaning while recognizing obstacles such as furniture by reading a marker arranged on the ceiling of the living room.

  In addition, information on the clean or dirty state of the equipment in the hospital room and the patient room is received from the indoor unit that collects the information, and which of the patient rooms needs to be cleaned, or Systems have been proposed to monitor for occupancy.

JP 2004-185586 A Special table 2012-533385 gazette

  However, in the cleaning by the self-propelled robot, for example, since the self-propelled robot itself manages the cleaning result, that is, the travel route, if the cleaning result is evaluated only by the information from the self-propelled robot, the evaluation may not be performed correctly. Specifically, in the case of self-running robot cleaning, it is assumed that the robot is started in a state where the room is cleaned up, and if the robot is not cleaned up, the robot itself is not cleaned up May be regarded as an obstacle. In addition, when receiving information on the cleanliness or dirty status of equipment in hospital rooms and hospital rooms from indoor units, it is difficult to evaluate the cleaning results even though it can be determined whether or not cleaning is necessary. is there. In particular, when an object is small (when it is not cleared up), there is a tendency for dust and garbage to collect around and below the object. It was difficult to evaluate putting things away and cleaning the area.

  In one aspect, the present invention provides a cleaning condition evaluation method, a cleaning condition evaluation program, and a cleaning condition evaluation apparatus that can evaluate the cleaning by a staff member.

  In one aspect, in the cleaning state evaluation method, a computer executes a process of acquiring a captured image of a predetermined area. In the cleaning state evaluation method, when a cleaning member is detected in the acquired captured image, a process of calculating an evaluation value related to cleaning in the predetermined region according to a change in a detection position of the cleaning member is calculated by a computer. Will run.

  The cleaning by the staff can be evaluated.

FIG. 1 is a block diagram illustrating an example of the configuration of the evaluation system according to the first embodiment. FIG. 2 is a diagram illustrating an example of a resident database. FIG. 3 is a diagram illustrating an example of a camera installation table. FIG. 4 is a diagram illustrating an example of the passing coordinate database. FIG. 5 is a diagram illustrating an example of a coordinate recording database. FIG. 6 is a diagram illustrating an example of a message database. FIG. 7 is a diagram illustrating an example of a cleaning state. FIG. 8 is a diagram illustrating another example of the cleaning state. FIG. 9 is a diagram illustrating an example of an output screen. FIG. 10 is a flowchart illustrating an example of the evaluation process according to the first embodiment. FIG. 11 is a block diagram illustrating an example of the configuration of the evaluation system according to the second embodiment. FIG. 12 is a diagram illustrating another example of the coordinate recording database. FIG. 13 is a diagram illustrating another example of the message database. FIG. 14 is a diagram illustrating another example of the cleaning state. FIG. 15 is a diagram illustrating another example of the cleaning state. FIG. 16 is a diagram illustrating another example of the output screen. FIG. 17 is a flowchart illustrating an example of the evaluation process according to the second embodiment. FIG. 18 is a diagram illustrating an example of calculation of the randomness when the height is used as an index of randomness. FIG. 19 is a diagram illustrating an example of a computer that executes a cleaning status evaluation program.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of a cleaning condition evaluation method, a cleaning condition evaluation program, and a cleaning condition evaluation apparatus disclosed in the present application will be described in detail with reference to the drawings. The disclosed technology is not limited by the present embodiment. Further, the following embodiments may be appropriately combined within a consistent range.

  FIG. 1 is a block diagram illustrating an example of the configuration of the evaluation system according to the first embodiment. The evaluation system 1 shown in FIG. 1 includes information for evaluating the implementation status of care work by staff, particularly cleaning work to clean up the mess in the room, in a resident facility with care for elderly people, which is an example of the resident facility 10. provide. The evaluation system 1 illustrated in FIG. 1 includes cameras 11a to 11e, an administrator terminal 50, and a server device 100. The cameras 11 a to 11 e are installed at various locations in the section 10 a of the tenant facility 10. In the following description, when the cameras 11a to 11e are not distinguished, they are simply referred to as the camera 11.

  The tenant facility 10 has, for example, a plurality of sections with a floor plan similar to the section 10a, and a plurality of cameras 11 are installed in each section in the same manner as the section 10a. In the following description, among the plurality of sections, the section 10a will be described as an example. However, the number of sections is not limited, and the evaluation system 1 includes the cameras 11 installed in an arbitrary number of sections. Also good. FIG. 1 shows the case where the system has one administrator terminal 50, but the number of administrator terminals 50 is not limited, and the evaluation system 1 has an arbitrary number of administrator terminals 50. May be.

  The camera 11, the administrator terminal 50, and the server device 100 are connected via a network N so that they can communicate with each other. For such a network N, any kind of communication network such as the Internet (Internet), LAN (Local Area Network), VPN (Virtual Private Network), etc. can be adopted regardless of wired or wireless.

  The server device 100 of the evaluation system 1 acquires a captured image captured by the camera 11 installed in each room of the section 10a in which the elderly person moves, and performs cleaning according to a change in the position of the cleaning member in the captured image. The evaluation value for is calculated. That is, the server device 100 is a cleaning status evaluation device. During the cleaning, the server device 100 calculates an evaluation value indicating that the cleaning is not sufficiently performed as the area where the cleaning member is not detected increases in the area of the corner (outer frame) of the living room. The evaluation system 1 transmits a message based on the evaluation value calculated by the server device 100 to, for example, the administrator terminal 50 and displays it on a display unit (not shown). Thereby, since the evaluation system 1 can show the manager of the occupancy facility 10 whether or not the cleaning work by the staff is appropriately performed, the manager can evaluate the cleaning by the staff.

  In addition, the following description demonstrates the case where a living room is cleaned using a cleaner (vacuum cleaner) as an example of a cleaning member. Moreover, the position of a cleaning member demonstrates the case where the position of the suction inlet (a part called what is called a head, a nozzle, a brush, etc.) of a cleaner is shown, for example. Further, the position of the cleaning member can be detected by installing a marker (hereinafter referred to as a cleaning machine marker) at the suction port of the cleaning machine, for example. The position of the cleaning member may be the position of the main body of the cleaning machine in the case of, for example, a stick-type cleaning machine. Further, for example, the locus of the cleaner marker based on the width of the suction port may be used as the movement locus of the cleaning member.

  The camera 11 is a network camera having a communication function, for example, and transmits a captured image to the server device 100 by being connected to the network N. That is, the camera 11 is an imaging sensor and is a sensor that detects the state of a predetermined area. The camera 11 captures an image using, for example, a complementary metal oxide semiconductor (CMOS) image sensor or a charge coupled device (CCD) image sensor as an image sensor. The camera 11 photoelectrically converts light received by the image sensor and performs A / D (Analog / Digital) conversion to generate an image. The camera 11 transmits the generated image to the server device 100 via the network N. The camera 11 may receive an instruction such as a shooting direction from the server device 100 and change the shooting direction. Moreover, the camera 11 is installed in the center or the corner of the ceiling of each room of the division 10a, for example. The camera 11 is preferably installed at a position where the entire room where the camera 11 is installed can be seen.

  The manager terminal 50 is, for example, a computer used by the manager of the tenant facility 10. The administrator terminal 50 displays the information regarding the cleaning work of each section in the tenant facility 10 received from the server device 100 and presents it to the administrator. As an example of the administrator terminal 50, a portable personal computer can be adopted. As the administrator terminal 50, not only a portable terminal such as the above personal computer but also a stationary personal computer can be adopted as the administrator terminal 50. In addition to the personal computer described above, the administrator terminal 50 employs, for example, a mobile communication terminal such as a tablet terminal, a smartphone, a mobile phone, and a PHS (Personal Handyphone System) as a portable terminal. You can also.

  Next, the configuration of the server device 100 will be described. As illustrated in FIG. 1, the server device 100 includes a communication unit 110, a storage unit 120, and a control unit 130. Note that the server apparatus 100 may include various functional units included in a known computer, for example, functional units such as various input devices and audio output devices, in addition to the functional units illustrated in FIG.

  The communication unit 110 is realized by, for example, a NIC (Network Interface Card). The communication unit 110 is a communication interface that is connected to the camera 11 and the administrator terminal 50 via the network N in a wired or wireless manner and manages information communication between the camera 11 and the administrator terminal 50. The communication unit 110 receives an image from the camera 11 and receives control information from the administrator terminal 50. The communication unit 110 outputs the received image or control information to the control unit 130. In addition, the communication unit 110 transmits an output screen or the like input from the control unit 130 to the administrator terminal 50.

  The storage unit 120 is realized by, for example, a semiconductor memory device such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. The storage unit 120 includes a resident database 121, a camera installation table 122, a passing coordinate database 123, a coordinate recording database 124, and a message database 125. In the drawings and the following description, the database is abbreviated as DB. In addition, the storage unit 120 stores information used for processing in the control unit 130.

  The resident DB 121 stores an identifier of a resident who enters each section in association with an identifier of a care staff, an administrator, or the like. FIG. 2 is a diagram illustrating an example of a resident database. As shown in FIG. 2, the resident DB 121 includes items such as “room ID”, “resident name”, “care staff”, “manager name”, and “manager contact”. Each item of the resident DB 121 is registered in advance using the administrator terminal 50 or the like.

  The “room ID” is an identifier for identifying each section of the tenant facility 10. The “resident name” is an identifier indicating a resident who enters each section of the resident facility 10. “Care staff” is an identifier indicating a staff member who performs a cleaning operation on each room in each section. The “manager name” is an identifier indicating a manager who manages care staff, that is, a care manager. “Manager contact information” indicates, for example, an e-mail address or the like as the contact information of the administrator.

  Returning to the description of FIG. 1, the camera installation table 122 stores the number of cameras 11 to be installed, the ID of each camera 11, the installation location, and the outer frame width in association with each section of the tenant facility 10. To do. FIG. 3 is a diagram illustrating an example of a camera installation table. As illustrated in FIG. 3, the camera installation table 122 includes items such as “room ID”, “number of cameras installed”, “camera ID”, “installation location”, and “outer frame width” for each camera 11.

  The “room ID” is an identifier for identifying each section of the tenant facility 10. The “number of cameras installed” indicates the number of cameras 11 installed in each section identified by the room ID. “Camera ID” is an identifier for identifying the camera 11 installed in each room for each section. “Installation location” is an identifier indicating a room or the like in a section where each camera 11 is installed. The “outer frame width” indicates the width of the area set at the corner of the living room. More specifically, the outer frame referred to here is a region adjacent to a wall or a window in the floor of the living room, and the width is defined as the outer frame width. The outer frame width can be set, for example, in a range of 20 to 30 cm from a wall or window of a living room.

  Returning to the description of FIG. 1, the passing coordinate DB 123 stores the coordinates that the cleaner marker has passed in association with the date and time. FIG. 4 is a diagram illustrating an example of the passing coordinate database. As illustrated in FIG. 4, the passing coordinate DB 123 includes items such as “date and time” and “passing coordinates”. The passing coordinate DB 123 is stored in association with the ID of the camera 11, and the example of FIG. 4 shows an example of data stored for any one camera 11.

  “Date and time” indicates the date and time when the cleaner marker was detected in the captured image of the room received from the camera 11. For example, if the detection interval is 1 second, one record is recorded every second. “Passing coordinates” indicates, for example, coordinates through which the cleaner marker has passed when X and Y coordinates are assigned to the imaging range of the camera 11 in the room where the camera 11 is installed. When the camera 11 is installed at a position overlooking the entire room in the ceiling, the camera 11 captures images at an angle looking down on the floor direction, so that the X and Y coordinates are assigned to the entire floor of the imaged room. You can also. In addition, the coordinate allocated to the floor of a living room can be made into the mesh of a 20 cm space | interval, for example.

  In the example of FIG. 4, an example in which one coordinate is recorded in each record is shown. As described above, when the locus of movement of the cleaner marker based on the width of the suction port of the cleaner is detected, the position of the detected cleaner marker has a certain width. In this case, for example, the coordinates of the center position of the detected width may be recorded. A series of passing coordinates of the cleaner marker detected between the time when the care staff enters the room to be photographed by the camera 11 and the time when the care staff leaves the room is recorded in the passing coordinates DB 123. When a series of coordinate positions through which a marker corresponding to one cleaning machine passes are connected in time series, the movement locus of the cleaning machine can be obtained. Then, by calculating an area in which the movement locus has a predetermined width (for example, the width of the suction port of the cleaning machine), an area through which the cleaning machine has passed, that is, an area that can be regarded as having been cleaned can be shown. . Or it is good also considering the mesh specified by the X and Y coordinates shown by passage coordinates as the field which the cleaner passed. On the other hand, the area other than the area specified from the passing coordinates of the cleaning machine, that is, an area where cleaning is not performed.

  Returning to the description of FIG. 1, the coordinate recording DB 124 stores the coordinates of the portion set in the outer frame and the coordinates through which the cleaner marker has passed for each section or room. FIG. 5 is a diagram illustrating an example of a coordinate recording database. As shown in FIG. 5, the coordinate record DB 124 stores “room ID”, “camera ID”, “marker detection date / time”, “care staff exit date / time”, “outer frame coordinates”, “passing coordinates”, “determination flag”. It has items such as. When there are a plurality of cameras 11 in one room, the room ID may be omitted and stored in association with the camera ID. If there is only one camera 11 in one room, it may be stored in association with the room ID instead of the camera ID. In the following description, a room is taken as an example for the sake of simplicity, and a case where one camera 11 is provided in one room will be described.

  The “room ID” is an identifier for identifying each section or room of the tenant facility 10. “Camera ID” is an identifier for identifying the camera 11 installed in each room. “Marker detection date / time” indicates the date / time when the cleaner marker was first detected in the captured image of the room received from the camera 11 after the care staff entered the room. “Care staff leaving date” indicates the date when the care staff left. “Outer frame coordinates” indicate coordinates corresponding to the outer frame of the corner of the room set in advance. The “passing coordinates” indicates, for example, the coordinates that the cleaner marker has passed when assigned to the floor of the living room as the X and Y coordinates. The data recorded in the passing coordinate DB 123 is copied to the passing coordinate value. Details will be described later. The “determination flag” indicates a determination result as to whether or not the passing coordinates of the cleaner marker pass through an area corresponding to the outer frame. The determination flag is set to “1” when, for example, the passing coordinates pass through an area corresponding to the outer frame by 80% or more. For example, the determination flag is “2” when the passing coordinates do not pass 80% or more through the region corresponding to the outer frame.

  Returning to the description of FIG. 1, the message DB 125 displays a determination flag indicating a determination result of whether or not the passing coordinates of the cleaner marker pass through an area corresponding to the outer frame, and an output screen according to the determination flag. The message to be displayed is stored in association with it. FIG. 6 is a diagram illustrating an example of a message database. As illustrated in FIG. 6, the message DB 125 includes items such as “determination flag” and “message”.

  The “determination flag” corresponds to the same item in the coordinate record DB 124, that is, the same flag. “Message” indicates the content of a message displayed on the output screen in accordance with the determination flag.

  Returning to the description of FIG. 1, the control unit 130 executes, for example, a program stored in an internal storage device using a RAM as a work area by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. Is realized. Further, the control unit 130 may be realized by an integrated circuit such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). The control unit 130 includes an acquisition unit 131, a calculation unit 132, a determination unit 133, and an output control unit 134, and implements or executes information processing functions and operations described below. Note that the internal configuration of the control unit 130 is not limited to the configuration illustrated in FIG. 1, and may be another configuration as long as the information processing described below is performed.

  The acquisition unit 131 acquires an image of a living room from the camera 11 via the communication unit 110, that is, sensor information. For example, the acquisition unit 131 acquires a captured image obtained by capturing the state of the room every second. The acquisition unit 131 outputs the acquired image to the calculation unit 132. Note that the acquisition unit 131 may acquire other information as sensor information. For example, the acquisition unit 131 may irradiate the living room with irradiation light and acquire a captured image including reflected light of the irradiation light. Moreover, the acquisition part 131 may acquire distance information from the distance sensor which irradiates a laser beam and measures distance, for example. The acquisition unit 131 may store the acquired captured image in the storage unit 120.

  When an image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image. The calculation unit 132 detects the head of a person by matching the input image with a template image of the head stored in the storage unit 120, for example. For example, the calculation unit 132 has one head detected in the section 10a, and when it matches the template image of the resident's head, only the resident is present. That is, the calculation unit 132 determines that the care staff has not entered (leaved). If the calculation unit 132 determines that the care staff has not entered the room, the calculation unit 132 continues to monitor the entry of the care staff.

  For example, when the head of the person detected in the section 10a matches the template image of the head of the care staff, the calculation unit 132 determines that the care staff has entered the room. The calculation unit 132 determines whether the care staff has entered the room, for example, by providing a marker representing the care staff in the uniform of the care staff, and when the marker is detected in the captured image, the care staff enters the room. It may be determined that In addition, regarding the determination of whether or not the care staff has entered the calculation unit 132, for example, the care staff has an ID card and is installed at the entrance of each section when entering and leaving each section. You may make it read to the card reader which does not. When the card reader is caused to read the ID card, the calculation unit 132 can detect the entry / exit of the care staff by acquiring information on the ID card and information indicating entry / exit. When the person entering the room is considered to be only the resident and the care staff, it may be determined that the care staff has entered the room when two heads are simply detected.

  When it is determined that the care staff is in the room, the calculation unit 132 determines whether there is a cleaner marker in the image. When there is no cleaning machine marker in the image, calculation unit 132 waits until a cleaning machine marker is detected. When there is a cleaning machine marker in the image, the calculation unit 132 acquires the coordinates of the current position of the cleaning machine marker from the image and records them in the passing coordinates DB 123 as passing coordinates. The calculation unit 132 continues to record the passing coordinates until the care staff leaves. The calculation unit 132 may detect the cleaning member by recognizing the shape of the cleaning member instead of the cleaner marker. In this case, for example, the calculation unit 132 detects a state where the care staff holds the cleaning member in his / her hand and performs a cleaning operation, identifies the shape of the cleaning member in the image, acquires the current position, and passes The coordinates are recorded in the passing coordinate DB 123.

  Upon detecting the exit of the care staff, the calculation unit 132 ends the recording of the passing coordinates, and records the passing coordinates recorded in the passing coordinates DB 123 in association with the camera ID, the marker detection date, and the care staff exit date. Record in DB124. The calculation unit 132 detects, for example, a case where the number of heads that match the head template of the care staff decreases after it is determined that the care staff is in the room, or a marker of the care staff uniform. In the case where it is impossible to do so, the exit of the care staff is detected. The calculating unit 132 refers to the camera installation table 122 and calculates outer frame coordinates based on the outer frame width of the corresponding room. Note that the calculation unit 132 may store the outer frame coordinates calculated in advance for each room in the storage unit 120, and may read out the corresponding outer frame coordinates of the room from the storage unit 120 when detecting the leaving of the care staff. .

  The calculation unit 132 calculates an evaluation value related to cleaning in a predetermined area, that is, a living room, based on the passing coordinates and the outer frame coordinates. For example, the calculation unit 132 sets, as an evaluation value related to cleaning, the ratio of coordinates that overlap with the passing coordinates among all the coordinates corresponding to one camera 11 installed in the living room. Further, for example, the ratio of the passage area of the cleaning machine obtained from the passage coordinates to the area corresponding to the shooting range of the camera 11 may be used as the evaluation value for cleaning. In this case, the evaluation value regarding cleaning is an evaluation value for the entire living room. Further, the calculating unit 132 may calculate an evaluation value related to cleaning in a predetermined area of the predetermined area, that is, an area corresponding to the outer frame in one living room. For example, the calculation unit 132 sets the ratio of coordinates overlapping with the passing coordinates out of all the coordinates included in the outer frame as an evaluation value related to cleaning. Further, for example, the ratio of the portion of the passage area of the cleaning machine obtained from the passage coordinates that overlaps the area specified by the outer frame coordinates to the area of the area specified by the outer frame coordinates may be used as the evaluation value. In this case, the evaluation value related to the cleaning is an evaluation value for the outer frame, but if the area of the outer frame, that is, every corner of the living room is cleaned, the entire room including the center of the living room is cleaned. It can also be set as the evaluation value with respect to the whole living room. The calculation unit 132 outputs the calculated evaluation value related to cleaning to the determination unit 133.

  Here, the cleaning state and the evaluation value will be described with reference to FIGS. 7 and 8. FIG. 7 is a diagram illustrating an example of a cleaning state. As shown in FIG. 7, the state 21a is a state before cleaning, and the cleaning machine marker is not detected in any of the outer frame 25 and the central portion, that is, the region 26 other than the outer frame region in the living room. Next, the state 22a is a state in which the care staff 27 enters the room and the cleaner marker 28 is detected. Subsequently, the state 23 a is a state in which the care staff 27 is cleaning, and a region through which the cleaner marker 28 has passed, that is, a passage coordinate is filled as a cleaned region 29. Further, the state 24a is a state in which the cleaning by the care staff 27 is completed, that is, the care staff 27 has left, and the living room has been cleaned to the entire area 29. In the state 24a, the ratio of the coordinates that overlap with the passing coordinates to the entire outer frame coordinates among all the coordinates included in the outer frame 25 is 100%. For example, the evaluation value related to the cleaning may be “100”. it can.

  FIG. 8 is a diagram illustrating another example of the cleaning state. As shown in FIG. 8, the state 21b is a state before cleaning, and the cleaning machine marker is not detected in any of the outer frame 25 and the central portion, that is, the region 26 other than the outer frame region in the living room. Next, the state 22b is a state in which the care staff 27 enters the room and the cleaner marker 28 is detected. Subsequently, the state 23 b is a state in which the cleaning by the care staff 27 is in progress, and the area through which the cleaner marker 28 has passed, that is, the passing coordinates are filled as the cleaned area 29. Further, the state 24b is a state in which the cleaning by the care staff 27 is completed, that is, the care staff 27 has left, but the area of the outer frame 25 is hardly the cleaned area 29, and the area 26 is almost the cleaned area. 29. In the state 24b, for example, if the ratio of the coordinates overlapping the passing coordinates out of the coordinates of the entire room is 60%, the evaluation value related to the cleaning can be set to “60”. Further, in the state 24b, for example, if the ratio of the coordinates overlapping with the passing coordinates out of all the coordinates included in the outer frame 25 is 10%, the evaluation value related to the cleaning can be “10”.

  In FIG. 8, the cleaning machine marker 28 whose position changes in accordance with the cleaning work is not detected in the area expressed in white in the drawing that does not become the cleaned area 29 among all the coordinates in the living room. It can be expressed as a continuous region. In FIGS. 7 and 8, the cleaned area 29, which is expressed in black in the drawing, can be expressed as an area specified based on the detection position of the cleaner marker 28. The calculation unit 132 corresponds to an area corresponding to the outer frame in the living room, that is, an area that does not overlap with an area specified based on the detection position of the cleaner marker 28 with respect to a predetermined area in the captured image, that is, an outer frame. It can also be said that the evaluation value indicating that the cleaning is not sufficiently performed as the ratio of the area expressed in white in FIG. 8 is larger.

  Returning to the description of FIG. 1, when an evaluation value related to cleaning is input from the calculation unit 132, the determination unit 133 sets a passing coordinate in an area corresponding to the outer frame indicated by the outer frame coordinates based on the evaluation value related to cleaning. It is determined whether or not it has passed. Here, for example, if the evaluation value related to cleaning is 80% or more, the determination unit 133 determines that the passing coordinates sufficiently pass through the region corresponding to the outer frame. For example, if the evaluation value regarding cleaning is less than 80%, the determination unit 133 determines that the passing coordinates do not sufficiently pass through the region corresponding to the outer frame.

  If the determination unit 133 determines that the passing coordinates sufficiently pass through the area corresponding to the outer frame, the determination unit 133 sets the determination flag of the coordinate record DB 124 to “1” and transmits a corresponding message to the administrator. The instruction is output to the output control unit 134. If the determination unit 133 determines that the passing coordinates do not sufficiently pass through the area corresponding to the outer frame, the determination unit 133 sets the determination flag of the coordinate record DB 124 to “2” and transmits a corresponding message to the administrator. The instruction is output to the output control unit 134.

  When the output control unit 134 is instructed to transmit a message from the determination unit 133, the output control unit 134 acquires a message corresponding to the determination flag of the coordinate recording DB 124 from the message DB 125. The output control unit 134 generates an output screen based on the acquired message and transmits the output screen to the administrator terminal 50 via the communication unit 110. That is, the output control unit 134 outputs output information based on the evaluation value.

  Here, an example of the output screen will be described with reference to FIG. FIG. 9 is a diagram illustrating an example of an output screen. As shown in FIG. 9, the output control unit 134, for example, when the evaluation value related to cleaning is “60” as described above and is less than the predetermined value (80%) as in the cleaning state of FIG. 8. Generates an output screen 31 including a message indicating that the cleaning is not sufficiently performed. That is, for example, when the determination flag of the coordinate record DB 124 is “2” (when the passing coordinates do not sufficiently pass through the area corresponding to the outer frame), the output control unit 134 determines the determination flag “ 2 ”is acquired and the output screen 31 is generated. In the message in FIG. 9, “<Living>” is a place where information capable of identifying the room corresponding to the camera ID determined by the determination unit 133 is substituted.

  Next, operation | movement of the evaluation system 1 of Example 1 is demonstrated. FIG. 10 is a flowchart illustrating an example of the evaluation process according to the first embodiment. The acquisition unit 131 of the server device 100 acquires an image of a room from the camera 11 via the communication unit 110, for example, every second (step S1). The acquisition unit 131 outputs the acquired image to the calculation unit 132.

  When the image is input from the acquisition unit 131, the calculation unit 132 performs image analysis on the image and determines whether or not the care staff has entered the room (step S2). For example, the calculation unit 132 determines whether the entry of the care staff is detected by matching the head of the person detected in the image with the template image of the head of the care staff. If the calculation unit 132 does not detect the entry of the care staff (No at Step S2), the calculation unit 132 returns to Step S1 and continuously monitors the entry of the care staff.

  When calculating the care staff entry (step S2: affirmative), the calculation unit 132 determines whether or not there is a cleaner marker in the image, although not shown. When there is no cleaner marker in the image, the calculation unit 132 waits until a cleaner marker is detected (not shown). If there is a cleaner marker in the image, the calculation unit 132 acquires the current position of the cleaner marker and records it in the passage coordinates DB 123 as passage coordinates (step S3).

  The calculation unit 132 determines whether or not care staff leaving has been detected (step S4). When the leaving of the care staff is not detected (No at Step S4), the calculating unit 132 returns to Step S3, acquires the current position of the cleaner marker, and records the passing coordinates until the care staff leaves. continue. When detecting the care staff leaving (step S4: affirmative), the calculation unit 132 ends the recording of the passing coordinates, and the passing coordinates recorded in the passing coordinates DB 123 include the camera ID, the marker detection date and time, and the care. It is recorded in the coordinate record DB 124 in association with the staff withdrawal date / time. The calculation unit 132 calculates an evaluation value related to cleaning based on the passing coordinates and the outer frame coordinates. The calculation unit 132 outputs the calculated evaluation value related to cleaning to the determination unit 133.

  When the evaluation value related to cleaning is input from the calculation unit 132, the determination unit 133 determines whether or not the passing coordinates sufficiently pass through an area corresponding to the outer frame indicated by the outer frame coordinates based on the evaluation value related to cleaning. Is determined (step S5). If the determination unit 133 determines that the passing coordinates have sufficiently passed through the area corresponding to the outer frame (step S5: Yes), the determination flag of the coordinate recording DB 124 is set to “1” and the corresponding message is managed. An instruction to be transmitted to the user is output to the output control unit 134. When the output control unit 134 is instructed to transmit a message from the determination unit 133, the output control unit 134 acquires a message corresponding to the determination flag “1” of the coordinate recording DB 124 from the message DB 125. The output control unit 134 generates an output screen based on the acquired message and transmits it to the administrator terminal 50 via the communication unit 110 (step S6).

  If the determination unit 133 determines that the passing coordinates do not sufficiently pass through the area corresponding to the outer frame (step S5: No), the determination flag of the coordinate recording DB 124 is set to “2” and the corresponding message is set. Is transmitted to the output control unit 134. When the output control unit 134 is instructed to transmit a message from the determination unit 133, the output control unit 134 acquires a message corresponding to the determination flag “2” of the coordinate recording DB 124 from the message DB 125. The output control unit 134 generates an output screen based on the acquired message, and transmits the output screen to the administrator terminal 50 via the communication unit 110 (step S7). Thereby, since the evaluation system 1 can show the manager of the tenant facility 10 whether or not the cleaning work by the care staff is appropriately performed, the manager can evaluate the cleaning by the staff.

  As described above, when the server apparatus 100 acquires a captured image of a predetermined area and detects a cleaning member in the acquired captured image, the server apparatus 100 evaluates the cleaning in the predetermined area according to the change in the detection position of the cleaning member. Calculate the value. As a result, the cleaning by the staff can be evaluated.

  Further, the server device 100 is more sufficiently cleaned as the ratio of the area that does not overlap the area specified based on the detection position of the cleaning member to the predetermined area in the captured image is larger. An evaluation value indicating that the data has not been calculated is calculated. As a result, it can be evaluated whether or not every corner of the room is cleaned.

  In addition, the server apparatus 100 uses a predetermined outer frame area among the predetermined areas as the predetermined area. As a result, it can be evaluated whether or not every corner of the room is cleaned.

  Further, the server apparatus 100 detects the cleaning member by detecting a predetermined mark attached to the cleaning member or recognizing the shape of the cleaning member. As a result, the cleaning work by the staff can be easily identified.

  Moreover, in the said Example 1, although the cleaning condition was evaluated by determining whether the cleaning member passed the area | region of the outer frame of a living room, it is not limited to this. For example, when an edge of an object in a living room is detected from a captured image and the edge is not detected from the captured image because the care staff has cleared the object, the cleaning member has passed the position where the edge was originally detected. The cleaning status may be determined by determining whether or not. That is, after clearing things placed in the room, it may be determined whether the cleaned place is being cleaned. The embodiment in this case will be described below as Example 2.

  FIG. 11 is a block diagram illustrating an example of the configuration of the evaluation system according to the second embodiment. Note that the same components as those in the evaluation system 1 of the first embodiment are denoted by the same reference numerals, and the description of the overlapping configuration and operation is omitted. The evaluation system 2 of the second embodiment is different from the evaluation system 1 of the first embodiment in that the edge of the object in the room is detected from the captured image, and the edge is not detected by the cleaning work by the care staff. In this point, it is determined whether or not the cleaning member has passed through the detected position.

  The evaluation system 2 according to the second embodiment includes cameras 11a to 11e, an administrator terminal 50, and a server device 200. The cameras 11 a to 11 e are installed at various locations in the section 10 a of the tenant facility 10 as in the first embodiment. In the following description, as in the first embodiment, when the cameras 11a to 11e are not distinguished, they are simply referred to as the camera 11. The camera 11, the administrator terminal 50, and the server device 200 are connected via a network N so that they can communicate with each other.

  The server device 200 differs from the server device 100 in that it has a coordinate record DB 224 and a message DB 225 instead of the coordinate record DB 124 and the message DB 125. Further, the server device 200 is different from the server device 100 in that it includes a calculation unit 232 and a determination unit 233 instead of the calculation unit 132 and the determination unit 133.

  The coordinate record DB 224 of the server device 200 stores, for each section or room, scatter coordinates when entering the care staff and detecting a cleaner marker, coordinates that require cleaning, and coordinates that the cleaner has passed. FIG. 12 is a diagram illustrating another example of the coordinate recording database. As shown in FIG. 12, the coordinate record DB 224 includes “room ID”, “camera ID”, “care staff entry date / time”, “marker detection date / time”, “care staff exit date / time”, “scattering coordinates when entering the room”, It has an item such as “scattering coordinates at the time of marker detection”. The coordinate record DB 224 has items such as “cleaning coordinates required”, “passing coordinates”, and “determination flag”. When there are a plurality of cameras 11 in one room, the room ID may be omitted and stored in association with the camera ID. If there is only one camera 11 in one room, it may be stored in association with the room ID instead of the camera ID. In the following description, a room is taken as an example for the sake of simplicity, and a case where one camera 11 is provided in one room will be described.

  The “room ID” is an identifier for identifying each section or room of the tenant facility 10. “Camera ID” is an identifier for identifying the camera 11 installed in each room. “Care staff entry date and time” indicates the date and time when the care staff entered the room. “Marker detection date / time” indicates the date / time when the cleaner marker was first detected in the captured image of the room received from the camera 11 when the care staff entered the room. “Care staff leaving date” indicates the date when the care staff left. The “scattering coordinates at the time of entering the room” indicates the coordinates of the scattered area in the room when the care staff enters the room. For example, the interior of the room is divided into a plurality of meshes, the edges of the objects in the room are detected from the captured image captured by the camera 11, and the meshes having more edges than the predetermined value are scattered. Can be determined. As coordinates, one coordinate representing each mesh may be determined in advance for each mesh, and representative coordinates of the mesh determined to be scattered may be indicated. The “scattering coordinates at the time of marker detection” indicates the coordinates of a scattered area in the room at the time when the cleaner marker is detected.

  “Cleaning coordinates required” indicates the coordinates of a region where no edge is detected by comparing the scatter coordinates when entering the room and the scatter coordinates when detecting the marker. In other words, the cleaning-required coordinates indicate the coordinates of an area where an object has been cleared by the care staff. “Passing coordinates” indicates, for example, coordinates through which the cleaner marker has passed when X and Y coordinates are assigned to the imaging range of the camera 11 in the room where the camera 11 is installed. When the camera 11 is installed at a position overlooking the entire room in the ceiling, the camera 11 captures images at an angle looking down on the floor direction, so that the X and Y coordinates are assigned to the entire floor of the imaged room. You can also. The “determination flag” indicates a determination result as to whether or not the passing coordinates of the cleaning machine marker pass through the area indicated by the cleaning required coordinates. The determination flag is set to “3”, for example, when the passing coordinates pass 80% or more through the area indicated by the cleaning required coordinates. The determination flag is set to “4”, for example, when the passing coordinates do not pass 80% or more through the area indicated by the cleaning required coordinates. Note that the determination flag may be a combination of the first and second embodiments. In this case, the determination flag is set to “1” when, for example, the passing coordinates pass through an area corresponding to the outer frame by 80% or more. For example, the determination flag is “2” when the passing coordinates do not pass 80% or more through the region corresponding to the outer frame.

  Returning to the description of FIG. 11, the message DB 225 stores a determination flag indicating the determination result of the passing coordinates of the cleaner marker and a message displayed on the output screen in association with the determination flag. FIG. 13 is a diagram illustrating another example of the message database. As illustrated in FIG. 13, the message DB 225 includes items such as “determination flag” and “message”.

  The “determination flag” corresponds to the same item in the coordinate record DB 124 and the coordinate record DB 224, that is, the same flag. “Message” indicates the content of a message displayed on the output screen in accordance with the determination flag.

  Returning to the description of FIG. 11, when an image is input from the acquisition unit 131, the calculation unit 232 performs image analysis on the image. Similar to the calculation unit 132, the calculation unit 232 determines whether a care staff has entered the room. If the calculation unit 232 determines that the care staff has not entered the room, the calculation unit 232 continues to monitor the entry of the care staff.

  When it is determined that the care staff is in the room, the calculation unit 232 calculates an edge (edge line), that is, a linear component, from the input image. For example, the calculation unit 232 detects the luminance gradient of the image using an edge filter. For each pixel of the image, the calculation unit 232 calculates a straight line component by combining neighboring pixels as edge components within a certain range of the intensity of the surrounding luminance gradient. For example, when a rectangular desk is installed in a living room and the photographing is performed from the ceiling direction, the calculation unit 232 has a straight line between the edge of the desk and the floor surface, and the desk and the floor have different luminances. Therefore, the linear component is calculated by combining the pixels at the boundary as edge components. Further, for example, when clothes are placed on the floor, the calculation unit 232 performs the same processing on pixels at the boundary between the edge of the clothes and the floor surface, but the edge of the clothes may be a curve. . At this time, the calculation unit 232 calculates a linear component by approximating the curve with a straight line having a predetermined length. The calculation unit 232 records the coordinates where the calculated edge line exists in the coordinate recording DB 224 as the scatter coordinates when entering the room.

  The calculation unit 232 determines whether or not there is a cleaner marker in the image after recording the scattered coordinates at the time of entering the room. When there is no cleaner marker in the image, the calculation unit 232 waits until the cleaner marker is detected. When there is a cleaner marker in the image, that is, when the cleaner marker is detected, the calculation unit 232 calculates an edge line from the input image. The calculation unit 232 records the coordinates where the calculated edge line exists in the coordinate record DB 224 as the scatter coordinates when the marker is detected.

  The calculation unit 232 calculates the cleaning required coordinates based on the scatter coordinates when entering the room and the scatter coordinates when detecting the marker. For example, the calculation unit 232 calculates, as the cleaning required coordinates, coordinates that do not match between the scatter coordinates when entering the room and the scatter coordinates when detecting the marker. That is, the calculation unit 232 calculates, as the cleaning-required coordinates, coordinates where the edge line no longer exists when the cleaning machine marker is detected, among the coordinates where the edge line exists when the care staff enters the room. The area calculated as the cleaning-required coordinates corresponds to, for example, an area where an object is placed when the care staff enters the room, and the object disappears because the care staff clears the object before applying the vacuum cleaner. The calculation unit 232 records the calculated cleaning required coordinates in the coordinate record DB 224.

  Further, when there is a cleaning machine marker in the image, the calculation unit 232 acquires the current position of the cleaning machine marker and records it in the passing coordinate DB 123 as passing coordinates. The calculation unit 232 continues recording the passing coordinates until the care staff leaves. When detecting the care staff leaving, the calculation unit 232 ends the recording of the passing coordinates, and records the passing coordinates recorded in the passing coordinates DB 123 in the coordinate recording DB 224 in association with the room ID or the like.

  The calculation unit 232 refers to the coordinate record DB 224, compares the passing coordinates and the cleaning required coordinates, and calculates an evaluation value related to cleaning in a predetermined area, that is, the living room. For example, the calculation unit 232 sets a ratio of coordinates that overlap with the passing coordinates among the cleaning-necessary coordinates as an evaluation value related to cleaning. The calculation unit 232 outputs the calculated evaluation value related to cleaning to the determination unit 233.

  Here, a cleaning state and an evaluation value will be described with reference to FIGS. 14 and 15. FIG. 14 is a diagram illustrating another example of the cleaning state. As shown in FIG. 14, the state 41a is a state before cleaning and an object is placed in the room. In the state 41a, the furniture 47 is arranged in the living room. Next, the state 42a is a state immediately before the care staff 48 enters the room and starts to clean up the objects placed in the room. Subsequently, the state 43a is a state in which the care staff 48 has completed the cleanup of the object placed in the region 46 and the cleaning machine marker 49 has been detected. Note that the coordinates of the area 46 at this time are areas where the detected edges are no longer detected, and are the coordinates that require cleaning. The state 44 a is a state in which the care staff 48 is cleaning, and the coordinates of the area through which the cleaning machine marker 49 has passed, that is, the passing coordinates are filled as the cleaned area 51 in accordance with the movement locus 50 of the cleaning machine marker 49. . Further, the state 45a is a state in which the cleaning by the care staff 48 has been completed, and the region 46 where the object has been placed is a cleaned region 51. In the state 45a, when the passing coordinates are compared with the cleaning required coordinates corresponding to the region 46, the ratio of the coordinates that overlap with the passing coordinates out of the cleaning required coordinates is 100%. 100 ".

  FIG. 15 is a diagram illustrating another example of the cleaning state. As shown in FIG. 15, the state 41b is a state before cleaning and an object is placed in the room. In the state 41b, furniture 47 is arranged in the living room. Next, the state 42b is a state immediately before the care staff 48 enters the room and starts to clean up the objects placed in the room. Subsequently, the state 43b is a state in which the care staff 48 has completed the cleanup of the object placed in the region 46 and the cleaning machine marker 49 has been detected. Note that the coordinates of the area 46 at this time are areas where the detected edges are no longer detected, and are the coordinates that require cleaning. The state 44b is a state in which the care staff 48 is cleaning, and the coordinates of the area through which the cleaning machine marker 49 has passed, that is, the passing coordinates are filled in as the cleaned area 51 in accordance with the movement locus 50 of the cleaning machine marker 49. . Further, the state 45b is a state in which the cleaning by the care staff 48 has been completed, and a part of the region 46 where an object has been placed is a cleaned region 51. In the state 45b, when the passing coordinates are compared with the cleaning required coordinates corresponding to the region 46, for example, if the ratio of the coordinates that overlap with the passing coordinates among the cleaning required coordinates is 50%, the evaluation value related to the cleaning is It can be “50”. In the drawing, the area which is expressed in white and does not become the cleaned area 51 among all the coordinates in the room is expressed as a continuous area where the cleaning machine marker 49 whose position changes according to the cleaning operation is not detected. can do. It can also be said that the calculation unit 232 calculates an evaluation value indicating that the cleaning is not sufficiently performed as the ratio of the continuous area that is not detected as the position of the cleaning machine marker 49 with respect to the cleaning required coordinate 46 is larger. .

  Returning to the description of FIG. 11, when the evaluation value related to cleaning is input from the calculation unit 232, the determination unit 233 determines whether or not the passing coordinates sufficiently pass through the cleaning required coordinates based on the evaluation value related to cleaning. Determine. Here, for example, when the evaluation value related to cleaning is 80% or more, the determination unit 233 determines that the passing coordinates sufficiently pass the cleaning coordinates. For example, if the evaluation value regarding cleaning is less than 80%, the determination unit 233 determines that the passing coordinates do not sufficiently pass the cleaning coordinates.

  If the determination unit 233 determines that the passing coordinates have sufficiently passed the cleaning required coordinates, the determination flag of the coordinate record DB 224 is set to “3”, and an instruction to transmit the corresponding message to the administrator is output. The data is output to the control unit 134. If the determination unit 233 determines that the passing coordinates do not sufficiently pass the cleaning required coordinates, the determination unit 233 sets the determination flag of the coordinate record DB 224 to “4” and outputs an instruction to transmit the corresponding message to the administrator. The data is output to the control unit 134.

  Here, an example of the output screen will be described with reference to FIG. FIG. 16 is a diagram illustrating another example of the output screen. As shown in FIG. 16, the output control unit 134 is sufficient when the evaluation value related to cleaning is equal to or greater than a predetermined value (80%), for example, as in the cleaning state of FIG. 14. An output screen 61 including a message indicating that it has been cleaned is generated. That is, for example, when the determination flag of the coordinate record DB 224 is “3”, the output control unit 134 acquires the message of the determination flag “3” of the message DB 225 and generates the output screen 61. In the message in FIG. 16, “<room name>” is a place where information that can identify the room corresponding to the camera ID determined by the determination unit 233 is substituted.

  Next, operation | movement of the evaluation system 2 of Example 2 is demonstrated. FIG. 17 is a flowchart illustrating an example of the evaluation process according to the second embodiment. The acquisition unit 131 of the server device 200 acquires an image of a living room, for example, every second from the camera 11 via the communication unit 110 (step S11). The acquisition unit 131 outputs the acquired image to the calculation unit 232.

  When the image is input from the acquisition unit 131, the calculation unit 232 performs image analysis on the image and determines whether or not the care staff has entered the room (step S12). If the calculation unit 232 does not detect the entry of the care staff (No at Step S12), the calculation unit 232 returns to Step S11 and continues to monitor the entry of the care staff.

  When it is determined that the care staff has entered the room (Step S12: Yes), the calculation unit 232 calculates an edge line from the input image. The calculation unit 232 records the coordinates where the calculated edge line exists in the coordinate recording DB 224 as the scatter coordinates when entering the room (step S13).

  The calculation unit 232 determines whether or not there is a cleaner marker in the image after recording the scattered coordinates at the time of entering the room (not shown). When there is no cleaner marker in the image, the calculation unit 232 waits until a cleaner marker is detected (not shown). When calculating the vacuum cleaner marker, the calculation unit 232 calculates an edge line from the input image. The calculating unit 232 records the coordinates where the calculated edge line exists in the coordinate recording DB 224 as the scattered coordinates at the time of marker detection (step S14).

  The calculation unit 232 calculates the cleaning required coordinates based on the scatter coordinates when entering the room and the scatter coordinates when detecting the marker. As an example of the cleaning required coordinates, there are coordinates that existed as flicker coordinates when entering the room, but did not exist as flicker coordinates when detecting the marker. The calculation unit 232 records the calculated cleaning required coordinates in the coordinate recording DB 224 (step S15). In addition, when there is a cleaner marker in the image, the calculation unit 232 acquires the current position of the cleaner marker and records it in the passage coordinates DB 123 as passage coordinates (step S16).

  The calculating unit 232 determines whether or not care staff leaving has been detected (step S17). When the leaving of the care staff is not detected (No at Step S17), the calculating unit 232 returns to Step S16, acquires the current position of the cleaner marker, and records the passing coordinates until the care staff leaves. continue. When the calculating unit 232 detects the leaving of the care staff (Step S17: Yes), the calculation of the passing coordinates is terminated, and the passing coordinates recorded in the passing coordinates DB 123 are associated with the room ID or the like and the coordinate recording DB 224. To record.

  The calculation unit 232 refers to the coordinate record DB 224, compares the passing coordinates with the cleaning required coordinates, and calculates an evaluation value related to cleaning in the living room (step S18). The calculation unit 232 outputs the calculated evaluation value related to cleaning to the determination unit 233.

  When the evaluation value related to cleaning is input from the calculation unit 232, the determination unit 233 determines whether or not the passing coordinates sufficiently pass the cleaning required coordinates based on the evaluation value related to cleaning (step S19). If the determination unit 233 determines that the passing coordinates have sufficiently passed the cleaning required coordinates (step S19: Yes), the determination flag of the coordinate record DB 224 is set to “3” and a corresponding message is transmitted to the administrator. Instruction to output to the output control unit 134. When the output control unit 134 is instructed to transmit a message from the determination unit 233, the output control unit 134 acquires a message corresponding to the determination flag “3” of the coordinate recording DB 224 from the message DB 225. The output control unit 134 generates an output screen based on the acquired message, and transmits it to the administrator terminal 50 via the communication unit 110 (step S20).

  If the determination unit 233 determines that the passing coordinates do not sufficiently pass through the cleaning required coordinates (No at Step S19), the determination flag of the coordinate record DB 224 is set to “4” and a corresponding message is sent to the administrator. An instruction to transmit to the output control unit 134 is output. When the output control unit 134 is instructed to transmit a message from the determination unit 233, the output control unit 134 acquires a message corresponding to the determination flag “4” in the coordinate recording DB 224 from the message DB 225. The output control unit 134 generates an output screen based on the acquired message and transmits it to the administrator terminal 50 via the communication unit 110 (step S21). Thereby, since the evaluation system 2 can present to the manager of the resident facility 10 whether or not the cleaning work after the cleaning by the care staff is properly performed, the manager evaluates the cleaning after the cleaning by the staff. it can.

  As described above, when no edge is detected at a position where an edge has been detected in the past, the server device 200 thereafter determines whether the position of the cleaning member has been detected at that position or around that position. The evaluation value regarding cleaning is calculated. As a result, the cleaning after cleaning by the staff can be evaluated.

  Further, the server device 200 uses a line based on the outline of an object placed in a predetermined area in the captured image as an edge. As a result, it can be determined that the objects in the room have been cleared.

  Further, the server device 200 identifies the original position of the edge whose position has changed after entering the staff among the edges detected from the captured image, and determines whether or not the cleaning member has passed the identified original position. Then, different evaluation values are calculated depending on whether or not it has passed. Further, the server device 200 further outputs output information based on the calculated evaluation value. As a result, the cleaning after cleaning by the staff can be evaluated.

  Moreover, in the said Example 2, although the display screen of the message was displayed on the administrator terminal 50, it is not limited to this. For example, as shown in FIG. 14 or FIG. 15, the manager terminal 50 is caused to display a display screen in which the position of the edge and the movement locus of the cleaning member in the living room are superimposed on the area corresponding to the cleaning required coordinates. It may be. Thereby, the specific movement of the cleaning member can be easily determined.

  Moreover, in the said Example 2, although the display screen was displayed on the administrator terminal 50, it is not limited to this. For example, the server device 200 may be provided with a display unit (not shown) and a display control unit that displays a display screen on the display unit, so that the display control unit displays the display screen on the display unit.

  As described above, the server device 200 acquires the position of the edge detected in the predetermined area detected before the cleaning work is started, and performs the cleaning in the predetermined area during the cleaning operation. Acquire the movement trajectory of the member. In addition, the server device 200 causes the administrator terminal 50 to display the acquired edge position and the acquired movement locus information on the image obtained by capturing a predetermined area when the cleaning operation is completed. As a result, it is possible to manage whether or not the place where the cleaning is to be performed is surely cleaned.

  Moreover, the cleaning member from which the server apparatus 200 acquires the movement trajectory has a suction port, and acquires a trajectory based on the width of the suction port as the movement trajectory of the cleaning member. As a result, the cleaned area can be easily identified.

  In the second embodiment, the cleaning-required coordinates are calculated based on the edge line of the object. However, the present invention is not limited to this. For example, the degree of randomness may be calculated based on the height of the room measured by the distance sensor, and the cleaning required coordinates may be calculated based on the degree of randomness. FIG. 18 is a diagram illustrating an example of calculation of the randomness when the height is used as an index of randomness. As illustrated in FIG. 18, the server device 200 acquires a reference state 71 and height information 73 based on the reference state 71 in advance. In addition, the server device 200 acquires the comparison object 72 that is in a messy state and the height information 74 based on the comparison object 72. Here, when the comparison object 72 and the height information 74 are compared with the reference state 71 and the height information 73, it is assumed that the height information 72b related to the object 72a and the object 72a is increased. Subsequently, when the difference 75 of the entire area between the height information 73 and the height information 74 is taken, an area 72c indicated by diagonal lines in the drawing corresponding to the height information 72b can be calculated as the degree of randomness.

  Here, for example, the height information 73 and 74 is obtained by irradiating a living room from a light source installed on a ceiling and capturing an image including reflected light of irradiation light and phase information of irradiation light and reflected light. Then, image analysis is performed, and a distance is calculated for each pixel of the captured image based on the phase information. That is, the height information 73 and 74 can be obtained by calculating the distance by TOF (Time Of Flight). Further, the height information 73 and 74 can be obtained by, for example, irradiating irradiation light including a specific pattern from a light source into a living room and calculating a distance based on the specific pattern. Further, the height information 73 and 74 can be obtained based on the distance measured using a distance sensor that measures the distance by irradiating the living room with laser light, for example. Here, for example, a rider (LIDAR: Light Detection and Ranging or Laser Imaging Detection and Ranging or LADAR: Laser Detection and Ranging) can be used as the distance sensor.

  When the height is used as an indicator of the degree of messiness in the living room and the cleaning coordinates are calculated based on the degree of messiness, the evaluation system 2 provides, for example, a terminal device for each section of the occupancy facility 10, and the terminal device The messiness is calculated based on the height of the room. For example, the terminal device calculates the cleaning-required coordinates based on the messiness based on the height, instead of the edge line when entering the room and detecting the marker, which is part of the processing of the calculation unit 232 of the server device 200, and the server To device 200. That is, the evaluation system 2 can compare the randomness at the time when the care staff enters the room with the randomness at the time of detection of the cleaner marker, and set the coordinates of the area where the randomness is reduced as the cleaning required coordinates. Thereby, the cleaning required coordinate can be calculated in consideration of the element in the height direction.

  In addition, each component of each part illustrated does not necessarily need to be physically configured as illustrated. In other words, the specific form of distribution / integration of each unit is not limited to that shown in the figure, and all or a part thereof may be functionally or physically distributed / integrated in arbitrary units according to various loads or usage conditions. Can be configured. For example, the calculation unit 132 and the determination unit 133 may be integrated.

  Furthermore, various processing functions performed by each device may be executed entirely or arbitrarily on a CPU (or a microcomputer such as an MPU or MCU (Micro Controller Unit)). In addition, various processing functions may be executed in whole or in any part on a program that is analyzed and executed by a CPU (or a microcomputer such as an MPU or MCU) or on hardware based on wired logic. Needless to say, it is good.

  By the way, the various processes described in the above embodiments can be realized by executing a program prepared in advance by a computer. Therefore, in the following, an example of a computer that executes a program having the same function as in the above embodiment will be described. FIG. 19 is a diagram illustrating an example of a computer that executes a cleaning status evaluation program.

  As illustrated in FIG. 19, the computer 300 includes a CPU 301 that executes various arithmetic processes, an input device 302 that receives data input, and a monitor 303. The computer 300 also includes a medium reading device 304 that reads a program and the like from a storage medium, an interface device 305 for connecting to various devices, and a communication device 306 for connecting to other information processing devices and the like by wire or wirelessly. Have The computer 300 also includes a RAM 307 that temporarily stores various types of information and a hard disk device 308. Each device 301 to 308 is connected to a bus 309.

  The hard disk device 308 has the same functions as the processing units of the acquisition unit 131, the calculation unit 132 or the calculation unit 232, the determination unit 133 or the determination unit 233, and the output control unit 134 illustrated in FIG. The cleaning status evaluation program is stored. The hard disk device 308 stores a resident DB 121, a camera installation table 122, a passing coordinate DB 123, and a coordinate recording DB 124 or a coordinate recording DB 224. The hard disk device 308 stores a message DB 125 or a message DB 225, and various data for realizing a cleaning status evaluation program. The input device 302 receives input of various information such as management information from the administrator of the computer 300, for example. The monitor 303 displays, for example, a management information screen and various screens for the administrator of the computer 300. The interface device 305 is connected to, for example, a printing device. For example, the communication device 306 has the same function as the communication unit 110 illustrated in FIG. 1 or 11 and is connected to the network N, and exchanges various information with the administrator terminal 50, the camera 11, and other devices.

  The CPU 301 reads out each program stored in the hard disk device 308, develops it in the RAM 307, and executes it to perform various processes. Further, these programs can cause the computer 300 to function as the acquisition unit 131, the calculation unit 132 or the calculation unit 232, the determination unit 133 or the determination unit 233, and the output control unit 134 illustrated in FIG. .

  Note that the cleaning status evaluation program is not necessarily stored in the hard disk device 308. For example, the computer 300 may read and execute a program stored in a storage medium readable by the computer 300. The storage medium readable by the computer 300 corresponds to, for example, a portable recording medium such as a CD-ROM, a DVD disk, a USB (Universal Serial Bus) memory, a semiconductor memory such as a flash memory, a hard disk drive, and the like. Alternatively, the cleaning status evaluation program may be stored in a device connected to a public line, the Internet, a LAN, or the like, and the computer 300 may read and execute the cleaning status evaluation program.

  As described above, the following supplementary notes are further disclosed regarding the embodiment including the present example.

(Appendix 1) Obtaining a captured image of a predetermined area,
When the cleaning member is detected in the acquired captured image, the computer executes a process of calculating an evaluation value related to cleaning in the predetermined region in accordance with a change in the detection position of the cleaning member. How to evaluate the situation.

(Additional remark 2) As the ratio of the area | region which does not overlap the area | region specified based on the detection position of the said cleaning member among the said predetermined area with respect to the predetermined area in the said captured image with respect to the predetermined area in the said captured image is larger, The evaluation method of the cleaning situation according to supplementary note 1, wherein an evaluation value indicating that the cleaning is not sufficiently performed is calculated.

(Additional remark 3) The said predetermined area is an area | region of the predetermined outer frame among the said predetermined areas, The cleaning condition evaluation method of Additional remark 2 characterized by the above-mentioned.

(Additional remark 4) The detection of the said cleaning member is detected by the detection of the predetermined | prescribed mark attached | subjected to the said cleaning member, or the shape recognition of the said cleaning member. Evaluation method of the cleaning situation described.

(Additional remark 5) The said process to calculate is, when the said edge is no longer detected about the position where the edge was detected in the past, after that, whether the position of the said cleaning member was detected in the periphery of the position The evaluation value of the cleaning status according to appendix 1, wherein an evaluation value related to the cleaning is calculated according to the method.

(Additional remark 6) The said edge is a line based on the outline of the object placed in the said predetermined area | region in the said captured image, The evaluation method of the cleaning condition of Additional remark 5 characterized by the above-mentioned.

(Additional remark 7) The said calculation process specifies the original position of the edge from which the position changed after entering a staff among the edges detected from the said captured image, and a cleaning member passes the area | region containing the said original position. To determine whether or not it has passed, and calculate a different evaluation value depending on whether it passed or not,
Further, the computer executes a process of outputting output information based on the calculated evaluation value.

(Appendix 8) Acquire the position of the edge detected in the predetermined area detected before the cleaning work is started,
Obtaining a movement trajectory of the cleaning member within the predetermined area at the time when the cleaning operation is performed;
The computer executes a process of superimposing and displaying the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined area when the cleaning operation is completed. Evaluation method of the cleaning situation.

(Additional remark 9) The said cleaning member has a suction inlet, The movement locus | trajectory of the said cleaning member is a locus | trajectory based on the width | variety of the said suction inlet, The evaluation method of the cleaning condition of Additional remark 8 characterized by the above-mentioned.

(Appendix 10) Obtaining a captured image of a predetermined area,
When a cleaning member is detected in the acquired captured image, the cleaning is performed by causing a computer to execute a process of calculating an evaluation value related to cleaning in the predetermined region in accordance with a change in a detection position of the cleaning member. Situation assessment program.

(Additional remark 11) The said process to calculate is more so that the ratio of the area | region which does not overlap with the area | region specified based on the detection position of the said cleaning member among this predetermined area with respect to the predetermined area in the said captured image is larger. The evaluation program of the cleaning situation according to appendix 10, wherein an evaluation value indicating that the cleaning is not sufficiently performed is calculated.

(Additional remark 12) The said predetermined area is an area | region of the predetermined outer frame among the said predetermined areas, The cleaning condition evaluation program of Additional remark 11 characterized by the above-mentioned.

(Additional remark 13) Detection of the said cleaning member is detected by the detection of the predetermined | prescribed mark attached | subjected to the said cleaning member, or the shape recognition of the said cleaning member, Any one of Additional remarks 10-12 characterized by the above-mentioned. The cleaning status evaluation program described.

(Additional remark 14) When the said edge is no longer detected about the position where the edge was detected in the past, the process to calculate is whether the position of the said cleaning member was detected after that position or the periphery of the position after that The cleaning condition evaluation program according to appendix 10, wherein an evaluation value related to the cleaning is calculated according to the above.

(Additional remark 15) The said edge is a line based on the outline of the object placed in the said predetermined area | region in the said captured image, The cleaning condition evaluation program of Additional remark 14 characterized by the above-mentioned.

(Additional remark 16) The said calculation process specifies the original position of the edge from which the position changed after entering a staff among the edges detected from the said captured image, and a cleaning member passes the area | region containing the said original position. To determine whether or not it has passed, and calculate a different evaluation value depending on whether it passed or not,
Furthermore, the cleaning status evaluation program according to appendix 10, wherein the computer executes a process of outputting output information based on the calculated evaluation value.

(Additional remark 17) The position of the edge detected in the predetermined | prescribed area | region detected before the cleaning operation was started is acquired,
Obtaining a movement trajectory of the cleaning member within the predetermined area at the time when the cleaning operation is performed;
Causing the computer to execute a process of superimposing and displaying the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined region when the cleaning operation is completed. An evaluation program for cleaning status.

(Additional remark 18) The said cleaning member has a suction inlet, The movement locus | trajectory of the said cleaning member is a locus | trajectory based on the width | variety of the said suction inlet, The cleaning condition evaluation program of Additional remark 17 characterized by the above-mentioned.

(Supplementary Note 19) An acquisition unit that acquires a captured image of a predetermined region;
A cleaning unit comprising: a calculation unit that calculates an evaluation value related to cleaning in the predetermined region in accordance with a change in a detection position of the cleaning member when a cleaning member is detected in the acquired captured image. Evaluation device.

(Additional remark 20) The said calculation part is cleaning more, so that the ratio of the area | region which does not overlap the area | region specified based on the detection position of the said cleaning member among this predetermined area with respect to the predetermined area in the said captured image is large. 20. The cleaning condition evaluation apparatus according to appendix 19, wherein an evaluation value indicating that the amount of the cleaning is not sufficiently performed is calculated.

(Additional remark 21) The said predetermined area is an area | region of the predetermined outer frame among the said predetermined areas, The cleaning condition evaluation apparatus of Additional remark 20 characterized by the above-mentioned.

(Additional remark 22) The detection of the said cleaning member is detected by the detection of the predetermined | prescribed mark attached | subjected to the said cleaning member, or the shape recognition of the said cleaning member, Any one of Additional remarks 19-21 characterized by the above-mentioned. The cleaning status evaluation device described.

(Additional remark 23) When the said edge is no longer detected about the position from which the edge was detected in the past, the said calculation part is whether the position of the said cleaning member was detected after that position or its position after that Accordingly, the cleaning evaluation apparatus according to appendix 19, wherein an evaluation value related to the cleaning is calculated.

(Additional remark 24) The said edge is a line based on the outline of the object placed in the said predetermined area | region in the said captured image, The cleaning condition evaluation apparatus of Additional remark 23 characterized by the above-mentioned.

(Additional remark 25) The said calculation part pinpointed the original position of the edge from which the position changed after entering a staff among the edges detected from the said captured image, and the cleaning member passed the area | region containing the said original position. Whether or not it passes and calculates a different evaluation value depending on whether or not it passes,
Furthermore, the cleaning condition evaluation apparatus according to appendix 19, further comprising an output control unit that outputs output information based on the calculated evaluation value.

(Additional remark 26) The position of the edge detected in the predetermined area | region detected before the cleaning operation | work is started is acquired, and the movement of the cleaning member in the said predetermined area | region in the time when the said cleaning operation is performed An acquisition unit for acquiring a trajectory;
A display control unit that superimposes and displays the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined region when the cleaning operation is completed. A cleaning status evaluation device.

(Additional remark 27) The said cleaning member has a suction inlet, The movement locus | trajectory of the said cleaning member is a locus | trajectory based on the width | variety of the said suction inlet, The cleaning condition evaluation apparatus of Additional remark 26 characterized by the above-mentioned.

DESCRIPTION OF SYMBOLS 1, 2 Evaluation system 10 Resident facility 10a Section 11a-11e Camera 50 Manager terminal 100,200 Server apparatus 110 Communication part 120 Storage part 121 Resident DB
122 Camera installation table 123 Pass coordinates DB
124,224 coordinate record DB
125,225 Message DB
DESCRIPTION OF SYMBOLS 130 Control part 131 Acquisition part 132,232 Calculation part 133,233 Determination part 134 Output control part N Network

Claims (11)

Obtain a captured image of a predetermined area,
When the cleaning member is detected in the acquired captured image, the smaller the ratio of the area specified based on the detection position of the cleaning member in the predetermined area to be evaluated in the captured image, the more the predetermined The evaluation method of the cleaning condition characterized by performing the process which calculates the evaluation value which shows that cleaning is not fully performed as an evaluation value regarding the cleaning in the area | region of this. Wherein the predetermined area is out of the predetermined area, the evaluation method of cleaning conditions according to claim 1, characterized in that a region of the predetermined outer frame. The method of evaluating a cleaning status according to claim 1 or 2 , wherein the cleaning member is detected by detecting a predetermined mark attached to the cleaning member or recognizing the shape of the cleaning member.   In the case where the edge is not detected for the position where the edge has been detected in the past, the calculation process is performed according to whether or not the position of the cleaning member is detected at that position or around that position. 2. The cleaning status evaluation method according to claim 1, wherein an evaluation value related to the cleaning is calculated. The cleaning method according to claim 4 , wherein the edge is a line based on an outline of an object placed in the predetermined area in the captured image. The calculation process specifies an original position of an edge detected from the captured image whose position has changed after entering a staff member, and whether or not a cleaning member has passed through an area including the original position. And calculate a different evaluation value depending on whether it passes or not,
Furthermore, the computer performs the process which outputs the output information based on the calculated said evaluation value, The cleaning condition evaluation method of Claim 1 characterized by the above-mentioned. Acquire the position of the detected edge within a predetermined area detected before the cleaning work is started,
Obtaining a movement trajectory based on the width of the suction port of the cleaning member in the predetermined area in the time when the cleaning operation is performed;
The computer executes a process of superimposing and displaying the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined area when the cleaning operation is completed. Evaluation method of the cleaning situation. Obtain a captured image of a predetermined area,
When the cleaning member is detected in the acquired captured image, the smaller the ratio of the area specified based on the detection position of the cleaning member in the predetermined area to be evaluated in the captured image, the more the predetermined An evaluation program for a cleaning situation, characterized by causing a computer to execute a process of calculating an evaluation value indicating that the cleaning is not sufficiently performed as an evaluation value related to cleaning in the area. Acquire the position of the detected edge within a predetermined area detected before the cleaning work is started,
Obtaining a movement trajectory based on the width of the suction port of the cleaning member in the predetermined area in the time when the cleaning operation is performed;
Causing the computer to execute a process of superimposing and displaying the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined region when the cleaning operation is completed. An evaluation program for cleaning status. An acquisition unit for acquiring a captured image of a predetermined area;
When the cleaning member is detected in the acquired captured image, the smaller the ratio of the area specified based on the detection position of the cleaning member in the predetermined area to be evaluated in the captured image, the more the predetermined And a calculation unit that calculates an evaluation value indicating that the cleaning is not sufficiently performed as an evaluation value related to the cleaning in the region. The position of the edge detected in the predetermined area detected before the cleaning work is started, and the width of the suction port of the cleaning member in the predetermined area at the time when the cleaning work is performed An acquisition unit for acquiring a movement trajectory based on
A display control unit that superimposes and displays the acquired position of the edge and the acquired information of the movement locus on an image obtained by imaging the predetermined region when the cleaning operation is completed. A cleaning status evaluation device.

Images