JP6489383B2 - Stay status display system and stay status display method - Google Patents

Description

  The present invention relates to a stay status display system and a stay status display method for generating display information related to a person's stay status in a target area based on video captured by a camera installed in a facility.

  In facilities such as office buildings, a monitoring system is widely used in which a camera for photographing the inside of the facility is installed and the situation inside the facility is monitored by the image of the camera. By using this camera video to obtain information about the staying status of people in the facility and presenting that information to the user, it is easy to see whether the person you want to meet for the purpose is at your seat. The convenience of the user can be improved.

  As a technology for presenting such a person's stay status to the user, conventionally, information on the presence status of the person based on the video of the camera, specifically, presence / vacancy, during a meeting, during a call, refusal to meet There is known a technique for acquiring information related to, etc., presenting the information to the user, and presenting statistical information regarding the occupation ratio such as the seating rate / vacancy rate, the degree of congestion, and the crowded location to the user ( Patent Document 1).

JP 2002-260110 A

  Now, for a user who wants to know whether a person is present at his / her seat in the office (office), he / she can be shown the stay status (attended status) regarding whether the person is present at his / her own seat. In addition to this, as information that the user desires, there is a case where it is desired to know whether or not there is a person in the conference room, that is, whether or not the conference room is being used. The content of the information that you want is different.

  However, in the conventional technology, only information regarding whether or not a person is in a specific place is presented to the user, and information on contents desired by the user can be presented to the user according to the place where the person stays. There was a problem that I could not.

  Therefore, the present invention provides a stay status display system and a stay status display capable of presenting a user with appropriate information according to the area where the person stays as information on the stay status of the person in each area in the facility. The main purpose is to provide a method.

The stay status display system according to the present invention performs processing for acquiring video captured by a camera installed in a facility and generating display information related to a person's stay status in a target area based on camera setting information of the camera. A stay status display system executed by a processor, wherein the processor cuts out a video at each time with a predetermined sampling period of a detection area in which a preset person's stay is assumed on the video. About the cut-out video of the time, it is determined whether or not a person stays in the detection area using a discriminator that has previously learned two classes of stay state and absence state, and stays related to the stay state of the person for each detection area acquires information has been set in the area attributes and display items of the target area stored as the camera setting information A configuration for generating the display information that reflects the stay information Te.

Also, the stay status display method of the present invention acquires video captured by a camera installed in a facility, and generates display information related to the stay status of a person in the target area based on camera setting information of the camera. A stay status display method in which processing is executed by a processor, and a video at each time with a predetermined sampling period in a detection area assumed to be a person's stay set in advance on the video is cut out. About the cut-out video, it is determined whether or not a person stays in the detection area by using an identifier that has previously learned two classes of stay state and absence state, and stay information regarding the stay state of the person in each detection area is obtained. acquired, anti the stay information according to the setting of the area attributes and display items of the target area stored as the camera setting information A configuration for generating the display information is.

According to the present invention, the presence / absence of a person staying in the detection area is determined using a discriminator that has previously learned two classes of stay state and absence state, and stay information relating to the stay state of the person for each detection area is obtained. In order to generate the display information reflecting the stay information according to the setting of the area attribute and display item of the target area acquired and stored as the camera setting information, the user is provided with information of appropriate contents according to the place where the person stays Can be presented.

Overall configuration diagram of stay status display system according to the first embodiment Explanatory drawing which shows the layout of each room in the facility which concerns on 1st Embodiment, and the installation condition of the camera 1 Explanatory drawing which shows the setting condition of the detection area with respect to the image | video of the camera 1 which concerns on 1st Embodiment. The block diagram which shows schematic structure of the facility management apparatus 3 and user terminal 4 which concern on 1st Embodiment. Explanatory drawing which shows the content of the camera setting information which concerns on 1st Embodiment Explanatory drawing which shows the attendance map screen which concerns on 1st Embodiment. Explanatory drawing which shows the area list screen which concerns on 1st Embodiment. The block diagram which shows schematic structure of the facility management apparatus 3 and user terminal 4 which concern on 2nd Embodiment. Explanatory drawing which shows the area list screen which concerns on 2nd Embodiment. Explanatory drawing which shows the attendance map screen which concerns on 2nd Embodiment. Explanatory drawing which shows the change state of the person icon which concerns on 2nd Embodiment. Explanatory drawing which shows the principal part of the attendance map screen which concerns on 2nd Embodiment. The block diagram which shows schematic structure of the facility management apparatus 3 and user terminal 4 which concern on 3rd Embodiment. Explanatory drawing which shows the area list screen which concerns on 3rd Embodiment. Explanatory drawing which shows the principal part of the area list screen which concerns on 3rd Embodiment. Explanatory drawing which shows the modification of the area list screen which concerns on 3rd Embodiment. The flowchart which shows the process sequence of the facility management apparatus 3 which concerns on 3rd Embodiment. The flowchart which shows the modification of the process sequence of the facility management apparatus 3 which concerns on 3rd Embodiment. The block diagram which shows schematic structure of the facility management apparatus 3 and user terminal 4 which concern on 4th Embodiment. Explanatory drawing which shows the setting condition of the detection area which concerns on 4th Embodiment The flowchart which shows the process sequence of the facility management apparatus 3 which concerns on 4th Embodiment. The flowchart which shows the modification of the process sequence of the facility management apparatus 3 which concerns on 4th Embodiment. Explanatory drawing which shows the detection area edit screen which concerns on 4th Embodiment The block diagram which shows schematic structure of the facility management apparatus 3 and user terminal 4 which concern on 5th Embodiment. Explanatory drawing which shows the attendance map edit screen which concerns on 5th Embodiment Explanatory drawing which shows the principal part of the attendance map edit screen which concerns on 5th Embodiment. Explanatory drawing which shows the area map edit screen which concerns on 5th Embodiment

A first invention made to solve the above problem is to obtain a picture taken by a camera installed in a facility, and display related to a person's stay in a target area based on camera setting information of the camera A stay status display system in which processing for generating information is executed by a processor, the processor at each time having a predetermined sampling period of a detection area in which a person staying preset on the video is assumed A video is cut out, and for each cut-out video at each time, the presence / absence of a person staying in the detection area is determined using a discriminator that has previously learned two classes of stay state and absence state . acquires stay information on staying condition of the person, the area attributes and display items of the target area stored as the camera setting information Set according to the configuration of generating the display information that reflects the stay information.

According to this, it is determined whether or not a person stays in the detection area by using a discriminator that has previously learned two classes of stay state and absence state, and stay information relating to the stay state of the person for each detection area is acquired. In order to generate display information reflecting the stay information according to the area attribute and display item settings of the target area stored as camera setting information , information appropriate to the place where the person stays is presented to the user can do.

  In the second invention, the processor generates the display information according to the display item according to whether the area attribute of the room to be the target area is an office room, a conference room, or a common room. The configuration is as follows.

  According to this, information of contents suitable for each of the office room, the conference room, and the common room can be presented to the user.

  According to a third aspect of the present invention, the processor generates the display information using a use state of an aggregate area obtained by aggregating a plurality of the detection areas as the display item.

  According to this, the information of the suitable content according to the place where a person stays can be shown to a user.

  In addition, according to a fourth aspect of the present invention, the area attribute includes a first area attribute having a person's presence status in each of the detection areas as the display item, and a use status of the entire target area as the display item. And a third area attribute for displaying the usage status of each section set in the target area as a display item.

  According to this, the information of the suitable content according to the place where a person stays can be shown to a user.

  According to a fifth aspect of the present invention, the processor generates the display information in which a fixed image indicating the stay status is superimposed on an area map representing a layout of the target area.

  According to this, it is possible to easily present information with appropriate contents according to the place where the person stays to the user.

According to a sixth aspect of the present invention, there is provided a processor for acquiring a picture taken by a camera installed in a facility and generating display information relating to a staying status of a person in a target area based on camera setting information of the camera. Is a stay status display method executed by the above-mentioned method, wherein a video of each time with a predetermined sampling period of a detection area assumed to be staying on the video set in advance is cut out, and the cut out video at each time Determining whether or not a person stays in the detection area using a discriminator that has previously learned two classes of stay state and absence state, and obtaining stay information regarding the stay state of the person for each detection area; table that reflects the stay information according to the setting of the area attributes and display items of the target area stored as the camera setting information A configuration to generate the information.

  According to this, similarly to the first invention, it is possible to present information with appropriate contents according to the place where the person stays to the user.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 is an overall configuration diagram of a stay status display system according to the first embodiment.

  This stay status display system presents to a user information related to the stay status of a person in each room (target area) in a facility, and includes a camera 1, a recorder 2, a facility management device 3, and a user terminal 4. It is equipped with. The camera 1, the recorder 2, the facility management apparatus 3, and the user terminal 4 are connected via a network.

  The camera 1 is installed in each room (target area) in the facility, and photographs a person staying in each room.

  The recorder 2 accumulates video transmitted from the camera 1.

  The facility management device 3 receives the video transmitted from the camera 1 and the recorder 2 and analyzes the video to generate display information regarding the staying status of the person in each room (target area) in the facility.

  The user terminal 4 is a PC or tablet terminal operated by the user. Based on the display information transmitted from the facility management device 3, the user terminal 4 displays a screen regarding the staying status of the person in each room (target area) in the facility, and the user browses this screen, The user can check the staying status of the person in each room in the facility.

  Next, the layout of each room in the facility according to the first embodiment and the installation status of the camera 1 will be described. FIG. 2 is an explanatory diagram showing the layout of each room in the facility and the installation status of the camera 1.

  In the present embodiment, the facility is provided with an office (office) shown in FIG. 2A, a conference room shown in FIG. 2B, and a common room shown in FIG.

  In the office shown in FIG. 2 (A), desks and chairs are arranged side by side, and a seat composed of a pair of desks and chairs is assigned to each person, and each person sits on his / her seat. Do business. In the conference room shown in FIG. 2B, a plurality of chairs are arranged around one table, and one group rents the entire room for use. In the common room shown in FIG. 2C, a plurality of tables are arranged, and a plurality of chairs are arranged around each table. One table and a plurality of chairs around the tables have one partition. A (divided area) is formed, and one group is rented out and used.

  A camera 1 is installed on the ceiling of each room of the office, the conference room, and the common room, and photographs a person staying in each room. In this case, the camera 1 may be an omnidirectional camera that captures a 360-degree range using a fisheye lens, but a box camera that captures a range of a predetermined angle of view is also possible.

  Next, the setting state of the detection area for the video of the camera 1 according to the first embodiment will be described. FIG. 3 is an explanatory diagram illustrating a detection area setting state for the video of the camera 1.

  In this embodiment, as shown in FIGS. 3A, 3B, and 3C, a detection area (a dotted rectangular area) is set in advance on the video of the camera 1. This detection area is set to a position where the body of the person seated in the seat is assumed to exist, and the size of the person's body is used as a reference so that one detection area corresponds to one person. Is set.

  In the present embodiment, the presence detection process is performed based on the detection area set on the video of the camera 1. In the presence detection process, the stay of a person in the detection area on the video is detected, and stay information regarding the stay status of the person for each detection area is acquired.

  Here, in this embodiment, room attributes (area attributes) set in advance for each room (target area), specifically, display items corresponding to each of the office (office room), the conference room, and the common room are displayed. Therefore, the display information reflecting the stay information is generated.

  As shown in FIG. 3A, in the case of an office (first area attribute), the staying status of a person in each detection area, that is, the seating status for each seat becomes a display item, Based on the status, whether or not a person is present in each seat is displayed.

  As shown in FIG. 3B, in the case of a conference room (second area attribute), display information is generated with the use status of an aggregate area obtained by aggregating a plurality of detection areas as a display item. In particular, here, the usage status of one room (target area) as a whole is a display item, and the usage status regarding whether each room is in use is displayed. At this time, with the entire room (target area) as one determination area, it is determined whether each room is in use based on the stay information. Note that if a stay of one or more persons is detected in one room, the room may be determined to be in use.

  As shown in FIG. 3C, in the case of a shared room (third area attribute), display information is generated using the usage status of an aggregate area in which a plurality of detection areas are aggregated as a display item, as in a conference room. To do. In particular, here, the usage status of each section (divided area) set in a room (target area) is a display item, and the usage status regarding whether each section is in use is displayed. At this time, using one section including a plurality of detection areas as one determination area, it is determined whether each section is in use based on the stay information. If a stay of one or more persons is detected in one section, it may be determined that the section is in use.

  The detection area may be set by performing an operation in which the user specifies the range of the detection area on the screen on which the video of the camera 1 is displayed. However, as in the fourth embodiment described later, An object (a chair and a desk) may be detected from the video of the camera 1 and a detection area may be set based on the detection result.

  Next, schematic configurations of the facility management apparatus 3 and the user terminal 4 according to the first embodiment will be described. FIG. 4 is a block diagram illustrating a schematic configuration of the facility management apparatus 3 and the user terminal 4.

  The facility management apparatus 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25.

  The communication unit 21 performs communication between the camera 1 and the recorder 2 and receives video transmitted from the camera 1 and the recorder 2.

  The storage unit 23 stores various types of setting information such as video received by the communication unit 21, setting information related to the detection area and setting information related to the camera (see FIG. 5), a program executed by the processor 22, and the like.

  On the monitor 24, a screen (not shown) for inputting a detection area is displayed. In the input device 25, an operator performs an operation of inputting a detection area.

  The processor 22 performs various processes by executing a program stored in the storage unit 23. In this embodiment, each process of presence detection, area determination, and screen control is performed.

  In the presence detection process, based on the video of the camera 1, a person's stay in a detection area in which a person's stay set in advance on the video is assumed is detected at regular intervals, and the regular time in each detection area is detected. The stay information on the stay situation of each person is acquired.

  In this embodiment, when a person stays, some change occurs in the video. Therefore, based on the change state of the video in the detection area, it is detected whether the person is present in the seat. Specifically, first, a video of a detection area at each time is cut out from a video at each time with a predetermined sampling period (for example, 1 minute). Then, the video change rate is acquired for the video in the detection area at each time. At this time, the video change rate with respect to the video at the immediately preceding time is obtained by comparison with the video at the immediately preceding time after the sampling period. Next, the presence or absence of a person staying in the detection area is determined based on the video change rate at each time. Then, based on the determination result, the stay information indicating whether or not the person stays at each time with the sampling period is generated. In the presence detection process, it is possible to use a discriminator that has previously learned two classes of the presence state and the absence state by deep learning. In the presence detection process, the classifier obtains the likelihood (probability) as the presence state and the likelihood as the absence state with respect to the image of the detection area, and compares the two likelihoods. It can be determined whether the user is present or absent.

  In the area determination process, based on the stay information, the usage status of the aggregate area in which a plurality of detection areas are aggregated is determined according to the room attribute (area attribute). That is, in a room where one group exclusively uses the entire room, such as a conference room, the use status regarding whether or not the room is in use is determined. Further, in a room where a plurality of sections are set in the target area, such as a shared room, the use status regarding whether or not each section is in use is determined.

  In the screen control process, the screen displayed on the user terminal 4 is controlled. In the present embodiment, display information related to the stay status presentation screen (see FIGS. 6 and 7) is generated. This stay status presentation screen is updated at regular intervals according to the detection result (stay information) of presence detection and the determination result of area determination.

  Note that the facility management apparatus 3 can present the current stay status to the user in real time by performing processing using the current video acquired from the camera 1. Moreover, the past stay situation can be presented to the user by performing processing using the past video acquired from the recorder 2. As a result, the administrator can grasp the usage status of each room in the past, review the room layout, etc., and check the improvement status when the room layout is changed. .

  The user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35.

  The communication unit 31 communicates with the facility management apparatus 3. The storage unit 33 stores a program executed by the processor 22 and the like. The processor 32 controls the operation of each unit of the user terminal 4, and in response to an operation of the input device 35 by the user, a request for displaying a stay status presentation screen (see FIGS. 6 and 7) is sent from the communication unit 31 to the facility management apparatus 3. Send to. And if the display information regarding the stay status presentation screen transmitted from the facility management apparatus 3 is received by the communication unit 31, the stay status presentation screen is displayed on the monitor 34 based on the display information.

  When the user terminal 4 is a tablet terminal or the like, the input device 35 is a touch panel, and is combined with a display panel that is a monitor 34 to constitute a touch panel display.

  Next, camera setting information stored in the storage unit 23 of the facility management apparatus 3 according to the first embodiment will be described. FIG. 5 is an explanatory diagram showing the contents of the camera setting information.

  In the camera setting information, a camera ID, a camera name, a room number, and a room attribute (area attribute) are registered. Based on the camera setting information, the processor 22 acquires the room attribute of each room, and generates display information according to the display item corresponding to the room attribute.

  In this embodiment, one room is set as one target area, and a room attribute (area attribute) is set for each room. However, one room is divided into a plurality of divided areas, and the division is performed. An area attribute may be set for each area.

  Next, the stay status presentation screen displayed on the user terminal 4 according to the first embodiment will be described. FIG. 6 is an explanatory diagram showing an attendance map screen as a stay status presentation screen. FIG. 7 is an explanatory diagram showing an area list screen as a stay status presentation screen.

  In the present embodiment, a stay status presentation screen showing the stay status of a person in each room in the facility is displayed on the user terminal 4.

  The presence map screen shown in FIG. 6 and the area list screen shown in FIG. 7 are provided with tabs 41 for the respective floors (1F, 2F, 3F). When this tab 41 is selected, the screen of the selected floor is displayed. In the case of the office (3F), by selecting a room on the same screen as the area list screen (see FIG. 9) shown in the second embodiment, the screen changes to the attendance map screen shown in FIG.

  In the office (office), the presence status of the person in each of the detection areas set for each seat is a display item, and as shown in FIG. A presence map 42 (stay map) representing the presence status (stay status) of each person is displayed. In the seating map 42, a seat icon 43 (standard image) representing the seating status for each seat is superimposed on an area map 44 (map image) representing the layout of the office (target area). A desk image 45 is drawn on the area map 44.

  The seat icon 43 displays characters “present” or “not present” depending on the presence status (present and absent). Further, the seat icon 43 changes in color according to the presence status, and is displayed in red when the user is present, and is displayed in green when the user is absent. Note that the display mode of the seat icon 43 in the office is not limited to this, and it is only necessary to be able to identify the presence status (present and absent), and a person icon or the like described later can be used.

  In the conference room, the usage status of the entire conference room (target area) is a display item. As shown in FIG. 7A, an area icon 46 indicating the usage status of each conference room is displayed on the area list screen. . In this area icon 46, characters “in use” or “available” are displayed according to the use situation. Further, the area icon 46 changes its color according to the use situation, and is displayed in red when in use, and is displayed in green when available in an empty state.

  In the common room, the usage status of each section (divided area) set in the common room (target area) is a display item, and as shown in FIG. A section icon 47 representing the situation is displayed. In the section icon 47, characters “in use” or “available” are displayed according to the use status. The section icon 47 changes in color according to the usage status, and is displayed in red when in use, and in green when available in an empty state.

  In the present embodiment, the seat icon 43 is superimposed on the area map 44 representing the office layout in the office stay status presentation screen (attended map screen) shown in FIG. You may make it superimpose the seat icon 43 on. In this case, it is preferable to perform processing for correcting the distortion of the video.

(Second Embodiment)
Next, a second embodiment will be described. Note that points not particularly mentioned here are the same as in the above embodiment. FIG. 8 is a block diagram illustrating a schematic configuration of the facility management apparatus 3 and the user terminal 4 according to the second embodiment.

  In the first embodiment, an attendance map (see FIG. 6) is displayed. With this attendance map, the presence status of a person in the office can be confirmed, but each person can be easily identified. Can not. Therefore, in the present embodiment, a person icon including a person's face image is displayed on an attendance map so that the attendance status of a plurality of persons can be checked together and each person can be easily identified.

  The facility management apparatus 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24, and an input device 25, as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment. In addition, the storage unit 23 stores schedule information of each person.

  The processor 22 performs each process of presence detection and screen control in the same manner as in the first embodiment, but also performs each process of schedule cooperation and mail cooperation. The presence detection process is the same as in the first embodiment.

  In the screen control process, display information related to the area list screen (see FIG. 9) and the attendance map screen (see FIG. 10) is generated.

  In the process of schedule cooperation, according to the user's operation on the attendance map screen (see FIG. 10), person schedule information is acquired from the storage unit, and the schedule information is displayed on the screen.

  In the mail linkage process, the mail application program installed in the user terminal 4 is activated in response to a user operation on the attendance map screen (see FIG. 10), and an e-mail creation screen is displayed on the user terminal 4. .

  In the present embodiment, the facility management apparatus 3 stores the schedule information of each person, but this schedule information may be acquired from an apparatus dedicated to schedule management. The facility management device 3 itself may perform schedule management.

  Similarly to the first embodiment, the user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35.

  The communication unit 31 communicates with the facility management apparatus 3. The storage unit 33 stores a program executed by the processor 22 and the like. The processor 32 controls the operation of each unit of the user terminal 4, and in response to an operation of the input device 35 by the user, displays a request for displaying an area list screen (see FIG. 9) or an attendance map screen (see FIG. 10) as a communication unit. 31 to the facility management apparatus 3. And if the display information regarding the area list screen and stay status presentation screen transmitted from the facility management apparatus 3 is received by the communication unit 31, the area list screen and the stay status presentation screen are displayed on the monitor 34 based on the display information.

  Further, the processor 32 executes the mail application program stored in the storage unit 33 in accordance with a user operation on the attendance map screen (see FIG. 10), and causes the monitor 34 to display an email creation screen.

  Next, an area list screen displayed on the user terminal 4 according to the second embodiment will be described. FIG. 9 is an explanatory diagram showing an area list screen.

  This area list screen is provided with tabs 41 for each floor (1F, 2F, 3F). When this tab 41 is selected, the area list screen for the selected floor is displayed. Here, when the tab 41 of the floor (3F) where the office (office) is located is selected, a plurality of area icons 51 representing each office (target area) are displayed side by side.

  In this area list screen, when the user selects the area icon 51 of the room where the seat of the person who wants to check the presence status is selected and changes the screen, the screen changes to the presence map screen (see FIG. 10). The attendance status of each person in the selected room is displayed on the attendance map screen.

  Here, as an operation for changing the screen, for example, when the input device 35 is a mouse, a scroll operation, that is, when the pointer is overlaid on the area icon 51 and the scroll button of the mouse is operated, the area icon 51 is displayed. Is enlarged and transitions to the attendance map screen. Further, when the input device 35 is a touch panel, a pinch out or swipe operation may be performed.

  Next, an attendance map screen displayed on the user terminal 4 according to the second embodiment will be described. FIG. 10 is an explanatory diagram showing an attendance map screen. FIG. 11 is an explanatory diagram showing a change state of the person icon 53. FIG. 12 is an explanatory diagram showing the main part of the presence map screen.

  As shown in FIG. 10, an attendance map 52 (stay map) representing the presence status (stay status) of each person is displayed on the attendance map screen. In this attendance map 52, a person icon 53 (person image) for each person who has a seat in a target room is superimposed on an area map 44 (map image) representing the layout of the office (target area). . A desk image 45 is drawn on the area map 44.

  The person icon 53 is displayed at a position corresponding to each person's seat, specifically at the position of the chair on which each person is seated. In the person icon 53, a person's face image (face image) is embedded. Thereby, a person can be easily identified.

  In the present embodiment, a room (target area) is selected on the area list screen (see FIG. 9), and the attendance map screen is displayed. By selecting one department from the department list, an attendance map screen of a room with the selected department may be displayed.

  In this embodiment, the person icon 53 in which a face image is embedded is arranged on the area map 44 as a person image for identifying each person. This person image is a feature of the appearance of the person. It may be an image (caricature, avatar) that is drawn schematically, or a character that identifies an individual, that is, a character that represents a person's name or a person's attribute (affiliation or title). There may be.

  As shown in FIG. 11, the display form of the person icon 53 changes depending on the person's presence status. In the example shown in FIG. 11A, the color of the face image of the person icon 53 changes depending on the presence or absence of a person. Specifically, the face image is displayed in color when the user is present, and the face image is displayed in gray when the user is absent. As a result, the user can immediately confirm whether or not a person is present.

  Further, when the person icon 53 is currently absent, the display form changes according to the absence time. In the example shown in FIG. 11B, the color of the portion other than the face image of the person icon 53 changes depending on the presence or absence of a person. For example, when the absence time is short, it is displayed in blue, when the absence time is long, it is displayed in red, and when the absence time is long, it changes from blue to red.

  Here, the absence time includes the past absence time, that is, the time from when the person left the seat to the present time, and the future absence time (predicted absence time), that is, from the present time to the time when the person is scheduled to return to the seat. The user can specify in which absence time the person icon 53 is to be displayed. The past absence time can be calculated based on the stay information acquired by the presence detection. Further, the future absence time can be calculated from the schedule information.

  A legend 54 indicating the length of absence time represented by the color of the person icon 53 is displayed on the presence map screen shown in FIG.

  In addition, on the presence map screen, when a predetermined operation is performed on the person icon 53, a transition is made to a schedule screen (not shown), and the schedule of the person can be confirmed. In the example shown in FIG. 12A, when “schedule” is selected from the pop-up menu 55 displayed by performing a left click operation on the person icon 53, the screen shifts to the schedule screen for that person. Thereby, the user can confirm the schedule of the person.

  Further, when a predetermined operation is performed on the person icon 53, a transition is made to a mail creation screen (not shown), and an e-mail addressed to that person can be created. In the example shown in FIG. 12A, when “E-mail” is selected from the pop-up menu 55, the screen changes to a mail creation screen. In the mail creation screen, since the destination address is set in advance, it is possible to save the trouble of inputting the address.

  Note that “schedule” and “e-mail” may be selected from a list box (not shown) displayed by performing a right-click operation on the area icon. Further, when the input device 35 is a touch panel, such as when the user terminal 4 is a tablet terminal, a transition to the schedule screen or the mail creation screen is made by an operation such as tap, double tap, or long tap (long press). You can do it.

  When a predetermined operation is performed on the person icon 53, the past and future attendance status of the person is displayed. In the example shown in FIG. 12B, a balloon 57 is displayed by a mouse-over operation in which the pointer is over the person icon 53. The balloon 57 includes information indicating the past presence status, that is, information indicating when the user has been absent (from 15:00), and future presence status, that is, when the user is present (from when the user is absent) ) (Information not scheduled from 17:00). As a result, the user can confirm the presence status of the person in the past and the future.

  Here, the past presence status of the person may be acquired from the stay information representing the presence or absence of the person at each time, which is acquired by the presence detection process. Moreover, what is necessary is just to acquire the future seating condition of a person from schedule information.

  In this embodiment, the pop-up menu 55 is displayed by the left click operation, the list box (not shown) is displayed by the right click operation, and the balloon 57 is displayed by the mouse over operation. The operation is not limited to such an operation.

(Third embodiment)
Next, a third embodiment will be described. Note that points not particularly mentioned here are the same as in the above embodiment. FIG. 13 is a block diagram illustrating a schematic configuration of the facility management apparatus 3 and the user terminal 4 according to the third embodiment.

  In the first embodiment (see FIG. 7A), the usage status of the conference room (target area) is presented to the user. However, if the conference room can be used by reservation, the conference room is currently used. If it is not booked, the conference room cannot be used. Therefore, in this embodiment, the reservation status is presented to the user as well as the conference room usage status.

  The facility management apparatus 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24, and an input device 25, as in the first embodiment.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment, but in addition to this, the storage unit 23 stores schedule information related to conference room usage reservation.

  The processor 22 performs each process of presence detection, area determination, screen control, reservation management, schedule cooperation, and mail cooperation.

  In the presence detection process, the stay of a person in the detection area is detected at regular intervals based on the video of the camera 1, and the stay information regarding the stay status of the person at regular intervals in the conference room is acquired.

  In the area determination process, based on the stay information, the stay status of the person in the conference room, that is, the use status regarding whether or not the conference room is currently used is determined at regular intervals.

  In the screen control process, display information related to an area list screen (see FIG. 14) that displays the usage status and reservation status of the conference room (target area) is generated.

  In the reservation management process, a schedule relating to conference room use reservation is managed. Specifically, a reservation screen (not shown) is displayed on the user terminal 4 to cause the user to perform a conference room use reservation operation, and a process of accepting a conference room use reservation according to the operation is performed. . In addition, a cancel screen (not shown) is displayed on the user terminal 4 to cause the user to perform an operation of canceling the use reservation, and according to the operation, a process of canceling the use reservation and updating the reservation information is performed. .

  Further, in the reservation management process, a cancel disable flag that disables cancellation of the use reservation is set by the user specifying at the time of reservation.

  Further, in the reservation management process, when a conference room is reserved but is left unused, the process for canceling the reservation for the conference room is periodically performed.

  In the schedule linkage processing, the reservation schedule information of the conference room is acquired from the storage unit 23 in accordance with the user operation on the area list screen (see FIG. 14), and the reservation schedule information is displayed on the screen.

  In the mail linkage process, the mail application program installed in the user terminal 4 is activated in response to a user operation on the area list screen (see FIG. 14), and an email creation screen is displayed on the user terminal 4.

  In the present embodiment, the facility management apparatus 3 manages the schedule relating to the conference room use reservation, but a reservation management-dedicated apparatus may be provided separately. In this case, the schedule information is acquired from the reservation management apparatus, and when the use reservation needs to be canceled, a notification instructing the cancellation of the use reservation is transmitted from the facility management apparatus 3 to the reservation management apparatus. do it.

  Similarly to the first embodiment, the user terminal 4 includes a communication unit 31, a processor 32, a storage unit 33, a monitor 34, and an input device 35.

  The communication unit 31 communicates with the facility management apparatus 3. The storage unit 33 stores a program executed by the processor 22 and the like. The processor 32 controls the operation of each unit of the user terminal 4 and transmits a display request for an area list screen (see FIG. 14) from the communication unit 31 to the facility management apparatus 3 in accordance with the operation of the input device 35 by the user. When the communication unit 31 receives display information related to the area list screen transmitted from the facility management device 3, the area list screen is displayed on the monitor 34 based on the display information.

  Further, the processor 32 executes the mail application program stored in the storage unit 33 in accordance with a user operation on the area list screen (see FIG. 14), and causes the monitor 34 to display an email creation screen.

  Next, an area list screen according to the third embodiment will be described. FIG. 14 is an explanatory diagram showing an area list screen. FIG. 15 is an explanatory diagram showing a main part of the area list screen.

  As shown in FIG. 14, the area list screen (usage status presentation screen) is provided with a tab 41 for each floor (1F, 2F, 3F). When this tab 41 is selected, the area of the selected floor is displayed. A list screen is displayed. Here, when the tab 41 on the floor (1F) where the conference room is located is selected, a plurality of area icons 61 (standard images) representing each conference room (target area) are displayed side by side.

  The display mode of the area icon 61 changes according to the current usage status of the conference room. For example, it is displayed in red when in use, and is displayed in green when not in use.

  Further, on this area list screen, when a predetermined operation is performed on the area icon 61, a transition is made to a schedule screen (not shown), and the reservation schedule of the conference room can be confirmed. In the example shown in FIG. 15A, when “Schedule” is selected from the pop-up menu 65 displayed by performing a left-click operation on the area icon 61, a transition is made to the conference room reservation schedule screen.

  In addition, when a predetermined operation is performed on the area icon 61, a transition is made to a mail creation screen (not shown) to create an e-mail addressed to the current reservation person of the selected conference room (target area). Can do. In the example shown in FIG. 15A, when “E-mail” is selected from the pop-up menu 65, a transition is made to a mail creation screen. In the mail creation screen, since the destination address is set in advance, it is possible to save the trouble of inputting the address.

  Note that “schedule” and “e-mail” may be selected from a list box (not shown) displayed by performing a right-click operation on the area icon 61. Further, when the input device 35 is a touch panel such as when the user terminal 4 is a tablet terminal, a transition to the reservation schedule screen or the mail creation screen is made by an operation such as tap, double tap, or long tap (long press). What should I do?

  When a predetermined operation is performed on the area icon 61, the current reservation status of the conference room (target area) is displayed. In the example shown in FIG. 15B, a balloon 67 is displayed by a mouse-over operation in which the pointer is over the area icon 61. This balloon 67 describes the current reservation status of the conference room (no reservation) and the current usage status of the conference room (not used from 15:00).

  Thereby, the user can easily confirm whether or not a conference room that is not currently used is reserved. Furthermore, the user can easily confirm whether a conference room that has not been used is originally reserved, or whether the conference has ended earlier than scheduled and the conference room is empty.

  In this embodiment, the pop-up menu 65 is displayed by the left click operation, the list box (not shown) is displayed by the right click operation, and the balloon 67 is displayed by the mouse over operation. The operation is not limited to such an operation.

  Next, a modification of the area list screen according to the third embodiment will be described. FIG. 16 is an explanatory diagram showing a modification of the area list screen.

  In the example shown in FIG. 14, the display form (color) of the area icon 61 representing each conference room (target area) is changed according to the current usage status of the conference room. In a conference room in which a cancellation impossible flag that disables reservation cancellation is set, the area icon 61 is displayed as grayed out in an inoperable state.

  Note that the area icon 61 may be hidden when the cancel impossible flag is set.

  Next, a processing procedure of the facility management apparatus 3 according to the third embodiment will be described. FIG. 17 is a flowchart showing the processing procedure of the facility management apparatus 3.

  In this embodiment, the process of canceling the reservation for use of a conference room that is left unused is periodically performed. In addition, the process shown below is sequentially performed for each conference room.

  Specifically, first, the processor 22 determines whether or not a reservation is currently made in the target conference room (ST101). If no reservation is currently made in the target conference room (No in ST101), the process ends.

  On the other hand, if there is a reservation in the target conference room (Yes in ST101), it is next determined whether or not a cancelable flag is set for the reservation (ST102). If the cancel disable flag is set (Yes in ST102), the process ends.

  On the other hand, if the cancel disable flag is not set (No in ST102), it is next determined whether or not the conference room is currently in use (ST103). If the conference room is currently in use (Yes in ST103), the process ends.

  On the other hand, if the conference room is not currently in use (No in ST103), it is next determined whether or not a predetermined time (for example, 15 minutes) has passed without being used (ST104). If the predetermined time has not passed without being used (Yes in ST104), the process ends.

  On the other hand, when a predetermined time has passed without being used (No in ST104), a notification to cancel the reservation (cancellation notification) is transmitted to the user terminal 4 of the reservation by e-mail or the like (ST105). Then, processing for canceling the use reservation and updating the reservation information is performed (ST106).

  In addition, when the conference room is reserved but not used, the conference room is not used at all from the beginning of the reservation time, or the conference is finished earlier than scheduled and the conference room is empty There is. For this reason, in the elapse determination of the predetermined time (ST104), if no use is made from the beginning of the reservation time, the determination may be made based on the elapse time (left time) from the start time of the reserved use time. In addition, when the reserved usage time is in an empty state, it may be determined based on the elapsed time after the empty state.

  When the reservation is canceled in this way and the reservation information is updated, the updated reservation information is reflected in the area list screen (see FIG. 14) that displays the usage status of the conference room and displayed by a mouse-over operation. In the balloon 67 (see FIG. 15B), it is displayed that the reservation has been canceled.

  Next, a modified example of the processing procedure of the facility management apparatus 3 according to the third embodiment will be described. FIG. 18 is a flowchart showing a modification of the processing procedure of the facility management apparatus 3.

  In the example shown in FIG. 17, the process of canceling the reservation for use of a conference room that is left unused is periodically performed. In this modification, an area list screen that displays the use status of a conference room In FIG. 14, the user selects a conference room as a trigger and starts a process for canceling the conference room use reservation.

  Specifically, first, in the processor 22, an operation for selecting a conference room (target area) on the area list screen (see FIG. 14), specifically, a click or mouse-over operation on the area icon 61 was performed. (Yes in ST111), it is determined whether or not a reservation is currently made in the target conference room (ST101). If no reservation is currently made in the target conference room (No in ST101), the process ends.

  On the other hand, if there is a reservation in the target conference room (Yes in ST101), it is next determined whether or not a cancelable flag is set for the reservation (ST102). If the cancel disable flag is set (Yes in ST102), the process ends.

  On the other hand, if the cancel disable flag is not set (No in ST102), it is next determined whether or not the conference room is currently in use (ST103). If the conference room is currently in use (Yes in ST103), the process ends.

  On the other hand, if the conference room is not currently in use (No in ST103), a notification to cancel the reservation (cancellation notification) is transmitted to the user terminal 4 of the reservation person by e-mail or the like (ST105). Then, it is determined whether or not there is a reply to accept the cancellation of the reservation (ST112). Here, when there is a reply to accept the cancellation of the reservation (Yes in ST112), a process for canceling the use reservation and updating the reservation information is performed (ST106).

  On the other hand, if there is no reply to accept the cancellation of the use reservation (No in ST112), it is next determined whether or not the use status has changed during use (ST113). If the usage status has changed during use (Yes in ST113), the process ends.

  On the other hand, if the usage status has not changed during use (No in ST113), it is next determined whether or not a predetermined time has elapsed since the cancellation notification was transmitted (ST114). Here, if the predetermined time has not elapsed since the cancellation notification was transmitted (No in ST114), the process returns to the determination (ST112) of whether or not there is a reply to accept the cancellation of the reservation.

  On the other hand, if a predetermined time has elapsed since the cancellation notification was transmitted (Yes in ST114), the reservation is canceled and the reservation information is updated (ST1016).

  As described above, in this modification, the user who wants to use the conference room browses the area list screen (see FIG. 14, the usage status presentation screen), confirms the usage status of the conference room, and further selects the conference room to be used. At the timing when the reservation status is confirmed, processing for canceling the conference room use reservation is started. As a result, the user waits for cancellation, and the use reservation of the conference room that is left unused is quickly canceled, and the conference room can be used early. Note that there are cases where a plurality of users confirm the usage status of the conference room, and waiting for cancellation may conflict. In this case, only the user who has accessed first is accepted as a user waiting for cancellation, and a message (not shown) indicating that the conference room cannot be used (with registration for waiting for cancellation) is displayed for the second and subsequent users. It is good to make it display on.

  In particular, in this modified example, when there is a reply to accept the cancellation of the usage reservation in response to the notification to cancel the usage reservation (cancellation notification), the usage reservation is canceled and the reservation information is updated. . In addition, when there is no reply to accept the cancellation of the usage reservation after sending the notification to cancel the usage reservation and the usage status of the conference room remains unchanged during use , Forcibly cancel the use reservation and update the reservation information. Accordingly, it is possible to quickly cancel the reservation for use of a conference room that is not used or a conference room that is unlikely to be used, thereby effectively using the conference room.

  When the conference room usage reservation is canceled, the area list screen (see FIG. 14, usage status presentation screen) is displayed, and the user terminal 4 on which the user has operated the screen indicates that the usage reservation has been canceled. The notification may be transmitted by e-mail or the like. Thereby, since a user can grasp | ascertain quickly that the utilization reservation of the meeting room was cancelled | released, a meeting room can be utilized at an early stage.

  In this embodiment, an example in which a conference room is a target area has been described. However, the target area is not limited to this and may be a room used for purposes other than a conference. The same applies to a case where a reservation is required for each of a plurality of sections set in one room serving as a target area, such as a shared room.

(Fourth embodiment)
Next, a fourth embodiment will be described. Note that points not particularly mentioned here are the same as in the above embodiment. FIG. 19 is a block diagram illustrating a schematic configuration of the facility management apparatus 3 and the user terminal 4 according to the fourth embodiment.

  In a store such as a restaurant, there are cases where a customer and a store clerk can freely move a chair and a table during business hours, that is, free layout. In this case, since the detection area set on the video for detecting the presence of a person is shifted from the actual seat position, the accuracy of presence detection is reduced.

  Therefore, in this embodiment, a fixed object that is installed in a store and defines the staying position of a person, specifically, the position of a table and a chair is detected, and a detection area is set based on the detection result. By periodically performing this process, the detection area can be updated as needed, and even if the customer or store clerk moves the chair and the table, it is possible to avoid a decrease in the accuracy of presence detection.

  As in the first embodiment, the facility management device 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment.

  The processor 22 performs processes of person detection, object detection, detection area setting, and detection area correction. In addition, the processor performs each process of presence detection and screen control as in the first embodiment.

  In the person detection process, a person is detected from the video acquired from the camera 1. If a person is present in the video, the detection accuracy of the chair and the table is lowered in the object detection process. Therefore, when a person is detected from the video, the subsequent object detection and detection area setting processes are not performed.

  In the object detection process, the chair and the table are detected from the video acquired from the camera 1, and the position information of the chair and the table is acquired. Prior to the object detection process, it is preferable that the classifiers learn in advance the chairs and tables (fixed objects) installed in the store, and the object detection is performed by learning the fixed objects. Can be improved.

  In the detection area setting process, based on the position information of the chair and the table acquired in the object detection process, a detection area that is a target for presence detection of whether or not a person is present is set. At this time, since the chair and the table at a position away from the camera 1 appear small in the video, the size of the detection area is corrected according to the distance from the camera 1.

  In the detection area correction process, when there is an error in the detection area set in the detection area setting process, the detection area edit screen (see FIG. 23) is displayed on the monitor 24, and the detection area edit screen is displayed. The position and size of the detection area are corrected according to the operation of the operator.

  In the present embodiment, as in the first embodiment, the stay information related to the stay status of the person is acquired by the presence detection, and the display information is generated based on the stay information. Similar to the first embodiment, a stay map (attended map) may be generated. Thereby, in a large-scale store, a customer's stay situation can be grasped at a glance.

  Further, based on the stay information, statistical information related to the operation status of the store, such as the customer seat occupancy time, the seating rate, and the average stay time, may be generated, and display information related to the statistical information may be generated. .

  Next, detection area setting states according to the fourth embodiment will be described. FIG. 20 is an explanatory diagram showing the setting status of the detection area.

  The video of the camera 1 shows a table and a chair installed in the store, and the table and the chair are detected by object detection for the video, and a detection area is set on the video based on the detection result. .

  Next, a processing procedure of the facility management apparatus 3 according to the fourth embodiment will be described. FIG. 21 is a flowchart showing the processing procedure of the facility management apparatus 3.

  In the present embodiment, a fixed object that is installed in a store and defines the staying position of a person, specifically the position of a table and a chair, is detected, and a detection area is set based on the detection result. The detection area is updated at any time by periodically performing this process at regular intervals (for example, 15 minutes or 30 minutes).

  Specifically, first, the processor 22 acquires a video of the camera 1 and performs processing for detecting a person from the video (ST201). Then, it is determined whether or not a person has been detected in the person detection process (ST202).

  If no person is detected (No in ST202), a process for detecting an object (chair and table) from the video of the camera 1 is performed (ST203). Then, the detected position of the object is compared with the position of the object registered in the area setting information of the storage unit 23 to determine whether or not the position of the object has changed (ST204).

  If there is a change in the position of the object (Yes in ST204), a detection area is set based on the detected position information of the object and the area setting information is updated (ST205). That is, the position information of the detection area newly set based on the position of the detected object is registered in the area setting information.

  On the other hand, when a person is detected (Yes in ST202) or when the position of the object is not changed (No in ST204), the object detection and area setting processes are not performed.

  In this embodiment, the person detection is performed prior to the object detection. However, the person detection may not be performed. In addition, the user may be able to select whether or not to perform person detection in the user settings.

  Next, a modified example of the processing procedure of the facility management apparatus 3 according to the fourth embodiment will be described. FIG. 22 is a flowchart showing a modification of the processing procedure of the facility management apparatus 3.

  In the example shown in FIG. 21, the object detection and area setting processes are performed at a timing when no person is detected. However, in this modification, object detection and area setting are performed for a place where no person is detected. Do processing. That is, the target area is divided into a plurality of divided areas, and object detection and area setting processing are performed on the divided areas where no person is detected. The divided area may be, for example, a cell obtained by dividing the target area with a uniform size.

  Specifically, first, the processor 22 performs processing for detecting a person from the video of the camera 1 for the first divided area (ST211). Then, it is determined whether or not a person has been detected in the person detection process (ST212).

  If no person is detected (No in ST21), a process of detecting an object from the video for the divided area is performed (ST213). Then, the detected position of the object is compared with the position of the object registered in the area setting information of the storage unit 23 to determine whether or not the position of the object has changed (ST214).

  If there is a change in the position of the object (Yes in ST214), a detection area is set based on the detected position information of the object and the area setting information is updated (ST215). That is, the position information of the detection area newly set based on the position of the detected object is registered in the area setting information.

  Next, it is determined whether or not all divided areas have been completed (ST216). If all the divided areas have not been completed (No in ST216), the process proceeds to the next divided area.

  On the other hand, when a person is detected in the person detection process (Yes in ST212) or when the position of the object is not changed (No in ST214), the object detection and area setting processes for the divided areas are performed. Without proceeding, the process proceeds to the division area end determination (ST216).

  Next, the detection area edit screen according to the fourth embodiment will be described. FIG. 23 is an explanatory diagram showing a detection area editing screen.

  In the present embodiment, the position information of the chair and the table is acquired by detecting the object with respect to the image, and the detection area is set based on the position information. In the object detection process, for example, the baggage is erroneously detected as the chair or the table. In this case, the position and size of the detection area are inappropriate. Therefore, in the present embodiment, the position and size of the detection area can be corrected on the detection area edit screen shown in FIG.

  On this detection area edit screen, a frame line 71 (detection area image) representing the range of the detection area is displayed on the video 72 of the camera 1 based on the position information of the detection area acquired in the area setting process. It can be checked whether the position and size of the area are different from the actual one. Here, when the position and size of the detection area are different from the actual one, the position and size of the detection area can be corrected by selecting the frame line 71 of the detection area and performing the movement or size change operation. Can do.

  For example, a correction operation can be performed by left-clicking to select the frame line 71 of the detection area, and the frame line 71 of the detection area can be moved to a correct position by a drag and drop operation. When the detection area frame 71 is selected and the pointer is placed on the detection area frame 71, the pointer changes to a double-pointed arrow, and the size of the detection area frame 71 can be corrected. it can.

  The detection area correction screen includes an “add” button 75 and a “delete” button 76. When the “add” button 75 is operated, a new detection area frame line 71 appears on the image 72, and the detection area frame line 71 is moved or resized to operate the detection area frame line 71. Can be set to an appropriate position and size. Further, when the “delete” button 76 is operated, the frame line 71 of the detection area in the selected state can be deleted.

  In the present embodiment, the frame line 71 of the detection area is displayed on the video 72 of the camera 1, but at this time, image processing for correcting distortion appearing in the video of the omnidirectional camera may be performed. .

(Fifth embodiment)
Next, a fifth embodiment will be described. Note that points not particularly mentioned here are the same as in the above embodiment. FIG. 24 is a block diagram illustrating a schematic configuration of the facility management apparatus 3 and the user terminal 4 according to the fifth embodiment.

  In the second embodiment, the presence map 52 (see FIG. 10) indicating the presence status of each person is displayed on the user terminal 4, but in the present embodiment, the facility management device 3 allows the operator to perform an editing operation. An attendance map 52 is created.

  In this embodiment, the attendance map 52 is created by the facility management apparatus 3, but an application program for attendance map editing is installed on the user terminal 4 operated by the administrator, and the user The presence map 52 may be created by the terminal 4.

  As in the first embodiment, the facility management device 3 includes a communication unit 21, a processor 22, a storage unit 23, a monitor 24 (display device), and an input device 25.

  The communication unit 21, the storage unit 23, the monitor 24, and the input device 25 are the same as those in the first embodiment. In addition, the storage unit 23 stores affiliation information and face images of each person.

  The processor 22 performs processes such as person list generation, person icon generation, object detection, area map generation, area map correction, and attendance map generation. In addition, the processor 22 performs each process of presence detection and screen control, as in the first embodiment.

  In the process of generating a person list, a person list 81 (see FIG. 25) to be displayed on the attendance map editing screen is generated based on the affiliation information of each person acquired from the storage unit 23.

  In the person icon generation process, a person icon 53 (see FIG. 25) in which the face image of each person acquired from the storage unit 23 is embedded is generated.

  In the object detection process, an object is detected from the video of the camera 1 and the position information of the object in the office (target area) is acquired. In this embodiment, the chair and the desk are detected from the video, and the position information of the chair and the desk is acquired.

  In the area map generation process, an area map 44 (see FIG. 25) representing the layout of the office (target area) is generated based on the chair and desk position information.

  In the attendance map generation process, an attendance map edit screen (see FIG. 25) is displayed on the monitor 24, and the seat of each person on the area map 44 is displayed in accordance with the operator's operation on the attendance map edit screen. An attendance map 52 in which a person icon 53 is arranged at a position is generated.

  In the area map correction process, if there is an error in the area map 44 generated in the area map generation process, an area map editing screen (see FIG. 27) is displayed on the monitor 24, and the operator operates on the area map editing screen. Then, the area map 44 is corrected.

  In the present embodiment, the facility management apparatus 3 stores the affiliation information and face image of each person. However, the affiliation information and face image may be acquired from an apparatus dedicated to organization management. Further, the facility management apparatus 3 itself may perform organization management.

  Next, an attendance map edit screen displayed on the monitor 24 according to the fifth embodiment will be described. FIG. 25 is an explanatory diagram showing an attendance map editing screen. FIG. 26 is an explanatory diagram showing the main part of the attendance map editing screen.

  In the facility management apparatus 3, the attendance map editing screen shown in FIG. 25 is displayed on the monitor 24, and the attendance map 52 is created by the operator performing an editing operation. The attendance map is edited when the system is introduced. It is also performed when the layout of the office (target area) is changed or when a person is changed.

  A tab 41 for each floor (1F, 2F, 3F) is provided on the attendance map editing screen. When this tab 41 is selected, the screen of the selected floor is displayed. At this time, a screen similar to the area list screen (see FIG. 9) shown in the second embodiment is displayed. By selecting a room to be edited, the screen changes to an attendance map editing screen shown in FIG.

  A person list 81 is displayed on the attendance map editing screen. The person list 81 displays a list of person names and person icons 53 (person images) in a state of being classified based on the organization structure to which the person belongs. Specifically, the names of the groups, the names of the teams constituting each group, the names of the persons belonging to each team, and the person icon 53 are displayed side by side. A person face image is embedded in the person icon 53.

  In addition, an area map 44 (area image) representing the target room is displayed on the attendance map editing screen. In this area map 44, a seat frame 83 (object image) in which a person icon 53 is arranged is drawn at the position of the seat (chair) (fixed position of each person), and the desk image 45 (object image) is placed at the desk position. ) Is drawn.

  The person icon 53 displayed in the person list 81 can be moved onto the area map 44 and pasted on the seat frame 83 of the area map 44 by a predetermined operation, for example, a drag and drop operation. By performing the operation of pasting the person icon 53 on the area map 44 for each person in sequence, an attendance map in which the person icon 53 of each person is arranged at the position of each person's seat is completed.

  At this time, if control is performed so that the person icon 53 is pasted only on the seat frame 83 of the area map 44, an operator's editing operation of pasting the person icon 53 on the area map 44 becomes easy.

  In this embodiment, the person icon 53 is arranged on the area map 44 on which the seat frame 83 and the desk image 45 are drawn as the area image representing the target area. However, the person icon 53 is displayed on the video of the camera 1. 53 may be arranged. In this case, it is preferable to perform image processing for correcting image distortion.

  As shown in FIG. 26, when a predetermined operation, for example, a mouse over operation is performed on the person icon 53 pasted on the seat frame 83 of the area map 44, the name of the person corresponding to the person icon 53 and A balloon 85 describing the affiliation (group, team) is displayed. As a result, the operator can confirm whether there is an error in the person icon 53 arranged in the area map 44.

  In this embodiment, the balloon 85 is displayed by a mouse-over operation. However, the present invention is not limited to such an operation.

  Next, an area map editing screen according to the fifth embodiment will be described. FIG. 27 is an explanatory diagram showing an area map editing screen.

  In this embodiment, the position information of the chair and the desk is acquired by object detection on the video, and the area map 44 on which the seat frame 83 and the image 45 of the desk are drawn is generated based on the position information. When erroneous detection occurs, the position and size of the seat frame 83 and the desk image 45 on the area map 44 become different from the actual ones. Therefore, in the present embodiment, the position and size of the seat frame 83 and the desk image 45 on the area map can be corrected on the area map editing screen shown in FIG.

  On this area map editing screen, the area map 44 generated by the area map generation processing is displayed on the video 86 of the camera 1 to check whether the position and size of the seat frame 83 and the desk image 45 are different from the actual ones. Can do. Here, when the position and size of the seat frame 83 and the desk image 45 are different from the actual one, the seat frame 83 and the desk image 45 are selected, and the seat frame is moved and resized. 83 and the position and size of the desk image 45 can be corrected.

  For example, a correction operation can be performed by selecting the seat frame 83 with a left click, and the seat frame 83 can be moved to a correct position by a drag and drop operation. In addition, when the seat frame 83 is selected, when the pointer is overlaid on the frame line of the seat frame 83, the pointer changes to a double-sided arrow, and the size of the seat frame 83 can be corrected. Note that the position and size of the desk image 45 can also be corrected in the same manner as the seat frame 83.

  The area map editing screen is provided with an “add” button 87 and a “delete” button 88. When the “add” button 87 is operated, a new seat frame 83 and a desk image 45 appear on the area map 44, and the seat frame 83 and the desk image 45 are moved and resized to perform a seat frame. 83 and the desk image 45 can be set to an appropriate position and size. Further, when the “delete” button 88 is operated, the seat frame 83 and the desk image 45 in the selected state can be deleted.

  In the present embodiment, the area map 44 is displayed on the video 86 of the camera 1, but at this time, image processing for correcting distortion appearing in the video of the omnidirectional camera may be performed.

  As described above, the embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can be applied to embodiments in which changes, replacements, additions, omissions, and the like have been performed. Moreover, it is also possible to combine each component demonstrated by said embodiment into a new embodiment.

  The stay status display system and the stay status display method according to the present invention can present, to the user, information with appropriate contents according to the area where the person stays as information on the stay status of the person in each area in the facility. The present invention is useful as a stay status display system, a stay status display method, and the like that generate display information related to the stay status of a person in a target area based on video captured by a camera installed in a facility.

DESCRIPTION OF SYMBOLS 1 Camera 2 Recorder 3 Facility management apparatus 4 User terminal 22 Processor 42 Seat map 43 Seat icon 44 Area map 46 Area icon 47 Section icon

Claims (6)

A stay status display system in which a processor acquires a video image taken by a camera installed in a facility and generates display information related to a person's stay status in a target area based on camera setting information of the camera. There,
The processor is
Cut out a video at each time with a predetermined sampling period in a detection area where a predetermined person's stay is assumed on the video,
About the cut-out video at each time, it is determined whether or not a person stays in the detection area by using a discriminator that has previously learned two classes of stay state and absence state, and the person's stay status in each detection area Get stay information about
A stay status display system that generates the display information reflecting the stay information according to the setting of the area attribute and display item of the target area stored as the camera setting information . The processor is
The said display information is produced | generated according to the said display item according to whether the said area attribute of the room used as said object area is an office room, a meeting room, or a common room. Stay status display system. The processor is
The stay status display system according to claim 1 or 2, wherein the display information is generated by using, as the display item, a usage status of an aggregate area in which a plurality of the detection areas are aggregated.   The area attribute includes a first area attribute having the presence status of a person in each of the detection areas as the display item, and a second area attribute having the usage status of the entire target area as the display item. 4. The stay status display system according to claim 3, wherein there is a third area attribute that displays the usage status of each section set in the target area as the display item. The processor is
The stay status display system according to any one of claims 1 to 4, wherein the display information is generated by superimposing a fixed image indicating the stay status on an area map representing a layout of the target area. A stay status display method in which a processor acquires a video shot by a camera installed in a facility, and generates a display information related to a person's stay status in a target area based on camera setting information of the camera. There,
Cut out a video at each time with a predetermined sampling period in a detection area where a predetermined person's stay is assumed on the video,
About the cut-out video at each time, it is determined whether or not a person stays in the detection area by using a discriminator that has previously learned two classes of stay state and absence state, and the person's stay status in each detection area Get stay information about
A stay status display method, wherein the display information reflecting the stay information is generated in accordance with an area attribute and display item setting of the target area stored as the camera setting information .

Images