JP5979415B2 - Monitoring system and telephone system - Google Patents

Description

  The present invention relates to a monitoring system that acquires presence information related to a person's location, and a telephone system that provides presence information acquired by the monitoring system to a telephone terminal device.

  If the location of a person who freely moves in a monitored area such as a business office can be grasped in real time, it can be used for various purposes, and a great effect can be obtained in improving the efficiency of business.

  As a technique for grasping the location of such a person, conventionally, a person is imaged by a camera at the time of personal authentication by a card reader, and the person image obtained at this time is stored in association with a person ID. A technique is known in which a person image associated with an ID is compared with an image captured by a camera installed at another location to identify a person captured by the camera (see Patent Document 1).

JP 2009-193424 A

  However, in the conventional technique, a person is identified by a captured image obtained by a camera by a method such as face recognition using a facial feature point. However, in order to ensure high identification accuracy, it is necessary to use a high-resolution captured image. Therefore, since the amount of data to be processed becomes enormous, there is a problem that high processing capability is required and the cost is increased. In addition, as the number of target persons increases, it becomes difficult to identify the person. Especially, in the method of identifying a person using the color pattern of clothes, the same clothes (work clothes) should be used by many people. In such a case, it is difficult to identify a person, and there is a problem that there is a limit to improving the accuracy of person identification.

  The present invention has been devised to solve such problems of the prior art, and its main purpose is to reduce the processing load and to accurately grasp the location of a person. It is to provide a configured monitoring system and telephone system.

The monitoring system of the present invention includes an imaging unit installed in a monitoring target space, a tracking unit for tracking an object recognized as a person from a captured image in the imaging unit, and a personal authentication installed in the monitoring target space Means, an object management means for setting a specific person who has been personally authenticated by the personal authentication means, an object tracked by the tracking means, a current position of the object tracked by the tracking means, and the object management Presence information acquisition means for creating presence information relating to the location of the person from the person set as the object by the means, and the object management means is configured such that when an event that causes object confusion occurs during the tracking process, Set multiple people in the object and set multiple Grant probability representing a probability is identity for each object, a configuration for changing the probability depending on events occurring in the course of tracking.

  The telephone system according to the present invention includes the monitoring system, storage means for storing the presence information acquired by the presence information acquisition means, a telephone terminal device assigned to each user, and the user using the telephone terminal device. And an information providing unit that obtains presence information about a person's location from the storage unit and provides it to the telephone terminal device when making a call.

  According to the present invention, it is only necessary to detect an object recognized as a person from a captured image by the imaging unit, and it is not necessary to identify a person from the captured image, so that the processing load of the image processing unit can be reduced. Further, since the location of the person is acquired from the current position of the object tracked by the tracking means, the location of the person can be grasped with high accuracy. In addition, when a user tries to make a call, the user can know the location of the person who is the other party and can determine in advance whether or not to make a call. It can be avoided, and there is no need to re-call the phone, improving convenience.

Overall configuration diagram of system according to this embodiment Plan view showing an example of a business establishment that becomes the monitoring target space of this system Explanatory drawing which shows the registration contents of the establishment map database 44 Explanatory diagram showing the registration contents of the seat database 45 Explanatory drawing which shows the registration content of the camera database 46 Explanatory drawing which shows the registration contents of the entry / exit management system database 47, the entrance / exit management system database 48, and the office equipment management system database 49 Explanatory drawing which shows the content of the presence information memorize | stored in the presence information storage part 41 Explanatory drawing which shows the registration content of the person action database 42 Explanatory drawing which shows the registration contents of the object database 43 Explanatory drawing which shows the registration content of the person schedule database 50 Explanatory drawing which shows the registration contents of the action history database 51 Explanatory drawing which shows the registration content of the location history database 52 Explanatory drawing which shows the registration content of the person attribute database 53 Explanatory diagram showing the registration contents of the department database 54 Flow chart showing operation procedure of each unit when personal authentication is performed by the card reader 4 of the leaving / exiting management system 11 Schematic plan view showing a first example in which the probability of a person changes Explanatory drawing which shows the situation where the probability of a person changes in the example shown in FIG. Schematic plan view showing a second example in which the probability of a person changes Explanatory drawing which shows the situation where the probability of a person changes in the example shown in FIG. Schematic plan view showing a third example in which the probability of a person changes Explanatory drawing which shows the situation where the probability of a person changes in the example shown in FIG. Flow chart showing operation procedure of each unit when personal authentication is performed by the card reader 4 of the entrance / exit management system 12 Explanatory drawing showing an example when object confusion occurs Flow chart showing the operation procedure of each part when object confusion occurs Flow chart showing the operation procedure of each part when a person sits in the seat Explanatory drawing which shows the display screen of the smart phone 5 in call partner designation mode The flowchart which shows the operation | movement procedure of each part in the other party designation | designated mode shown in FIG. Explanatory drawing which shows the display screen of the smart phone 5 in person search mode The flowchart which shows the operation | movement procedure of each part in the person search mode shown in FIG. Explanatory drawing which shows the display screen of the smart phone 5 in department display mode The flowchart which shows the operation | movement procedure of each part in the department display mode shown in FIG. Explanatory drawing which shows another example of the display screen of the smart phone 5.

  A first invention made to solve the above-described problems is an imaging unit installed in a monitoring target space, a tracking unit that tracks an object recognized as a person from an image captured by the imaging unit, and the monitoring target A personal authentication means installed in the space; an object management means for setting a specific person who has received personal authentication by the personal authentication means to an object tracked by the tracking means; and an object tracked by the tracking means. Presence information acquisition means for creating presence information relating to the location of the person from the current position of the person and the person set as the object by the object management means.

  According to this, it is only necessary to detect an object recognized as a person from a captured image by the imaging unit, and it is not necessary to identify a person from the captured image, so that the processing load of the image processing unit can be reduced. Further, since the location of the person is acquired from the current position of the object tracked by the tracking means, the location of the person can be grasped with high accuracy.

  In addition, according to a second aspect of the present invention, when an event that causes object confusion occurs during the tracking process, the object management means sets a plurality of persons in duplicate in one object, and prioritizes the plurality of persons. It is set as the structure which gives.

  According to this, even if an event that causes object confusion occurs in the tracking process, the object tracking can be continued without interruption. And since the location of a person is indeterminate but can be grasped, presence information of many persons can be provided.

  In addition, according to a third aspect of the present invention, when a plurality of persons are set to be duplicated in an object, the object management means assigns a probability indicating the probability of being an individual to each of the plurality of persons, and is generated during the tracking process. The probability is changed according to the event.

  According to this, it is possible to determine the priority order of a plurality of persons set in duplicate on one object with high or low probability. Since the probability given to the person is changed to an appropriate value according to various events that occur in the tracking process, the accuracy of the person setting for the object can be increased. In this case, it is preferable to increase the probability when an event that increases the probability that the user is the person and lower the probability if an event that decreases the probability that the person is the user.

  The fourth invention further comprises storage means for storing information relating to a schedule for each person, wherein the object management means obtains the schedule of the person set for the object from the storage means, and And the current position of the object are compared, and the person setting for the object is changed based on the consistency between the two.

  According to this, the validity of the person set for the object can be determined by comparing the schedule of the person set for the object with the current position of the object, thereby improving the accuracy of the person setting for the object. be able to. In this case, the information regarding the schedule relates to business trips, vacations, meetings, telecommuting, and the like.

  According to a fifth aspect of the present invention, there is provided a feature extraction unit that acquires behavior feature information representing a feature related to past behavior for each person, and a storage unit that stores the behavior feature information for each person acquired by the feature extraction unit. The object management means obtains the behavior feature information of the person set for the object from the storage means, compares the behavior feature information of the person with the current behavior of the object, and matches both The person setting for the object is changed based on the property.

  According to this, it is possible to determine the validity of the person set in the object by comparing the characteristics of the person's past action with the current action of the object, thereby improving the accuracy of the person setting for the object. be able to. In this case, the behavior feature information relates to walking speed and the like.

  According to a sixth aspect of the present invention, there is provided a feature extracting means for acquiring presence position feature information representing a feature relating to a past presence position for each person, and a storage means for storing the presence position feature information for each person acquired by the feature extraction means The object management means acquires the person's presence position feature information set for the object from the storage means, and compares the person's presence position feature information with the current position of the object. The person setting for the object is changed based on the consistency between the two.

  According to this, the validity of the person set for the object can be judged by comparing the characteristic of the person's past position with the current position of the object, and thereby the accuracy of the person setting for the object. Can be increased. In this case, the presence position feature information relates to a time ratio in which a person exists at a specific position.

  In addition, according to a seventh aspect of the invention, when the object management means detects that an event in which the objects being tracked are confused with each other, the person set as one object is set as the other object, and each object The probability of the original person set to is reduced.

  According to this, even if an event in which objects are confused (passing or folding) occurs, it can be continued without canceling the person setting for the object. Then, a probability that accurately reflects the ambiguity of the person setting can be given to the person set as the object. In this case, a probability corresponding to each case of passing and folding may be set in advance, and the probability may be given to the person set as the object.

  According to an eighth aspect of the invention, the object management means reduces the probability of a person set as an object when detecting that an event occurs in which the object being tracked temporarily passes through the blind spot of the imaging means. And

  According to this, even if an event occurs in which the object temporarily passes through the blind spot of the camera 21, it is possible to continue without canceling the person setting for the object. Then, a probability that accurately reflects the ambiguity of the person setting can be given to the person set as the object.

  In addition, according to a ninth aspect, when the object management means detects that the object being tracked enters a section where the imaging means is not installed, tracking of the object is interrupted, and thereafter, from the section When an object that comes out is detected, the person who has been set as the object that has entered the section until then is set as the object.

  According to this, a person can be set to an object without excess or deficiency, and the accuracy of person setting for the object can be improved. In this case, when there are a plurality of persons in a section where the camera 21 is not installed, the same probability may be given to those persons according to the number of persons who have entered the section. Moreover, you may make it provide the probability according to the order which entered the division.

  The tenth invention further comprises storage means for storing the position of the seat for each person, and the object management means detects that the object being tracked is seated in the seat from the storage means to the seat. A set person is acquired, the person is compared with the person set for the object, and if both match, the probability of the person is increased.

  According to this, a probability that accurately reflects the certainty of the person setting can be given to the person set to the object, and the accuracy of the person setting for the object can be improved.

  An eleventh aspect of the invention is directed to a user terminal device assigned to each user, a storage unit that stores presence information acquired by the presence information acquisition unit, and the user terminal that acquires the presence information from the storage unit. And an information providing means provided to the apparatus.

  According to this, the user can know the location of the person with his / her user terminal device.

  The twelfth aspect of the invention further comprises storage means for storing a plurality of sections obtained by dividing the monitoring target space in correspondence with coordinates set in the monitoring target space, wherein the presence information acquisition means includes: The section corresponding to the coordinates indicating the current position is acquired from the storage unit, and the information providing unit provides the user terminal device with the name of the section acquired by the presence information acquiring unit as the location of a person. .

  According to this, the user can know the location of the person by the name of the section, and the location of the person can be easily understood.

  In a thirteenth aspect of the invention, the partition is divided in stages at a plurality of division levels.

  According to this, when the location of a person can be specified by a section with a small division level, the user can grasp the location of the person in detail by representing the location of the person with the section with the small division level. it can. Further, when the location of a person can be specified only by a section with a large division level, the user can grasp the location of the person without fail by indicating the location of the person with the section with the large division level.

  In a fourteenth aspect of the invention, the user terminal device includes a display unit that displays an image, and the information providing unit displays screen data that displays a current position of a person existing in the section on the image representing the section. Is transmitted to the user terminal device, and the user terminal device is configured to display an image based on the screen data received from the information providing unit on the display unit.

  According to this, the user can grasp the situation of the person in detail. In this case, the current position of the person existing in the section may be displayed as an avatar (an image representing the person) on the section layout.

  In a fifteenth aspect of the invention, the personal authentication means is a card reader that is provided in conjunction with at least one of an entry / exit management system, an office equipment management system, and an entry / exit management system, and reads a card for identifying a person. It has a certain configuration.

  According to this, since it is not necessary to install a card reader specially for the monitoring system, the cost can be reduced.

  According to a sixteenth aspect of the present invention, the monitoring system, storage means for storing presence information acquired by the presence information acquisition means, a telephone terminal device assigned to each user, and a user makes a telephone call using the telephone terminal device. Information providing means for obtaining presence information about the location of the person from the storage means and providing the presence information to the telephone terminal device.

  According to this, when a user tries to make a call, the location of the person who is the other party can be grasped, and whether or not the call can be made can be determined in advance. Calls can be avoided, and there is no hassle of re-calling, improving convenience.

  The seventeenth aspect of the invention further comprises storage means for storing information related to a schedule for each person, and the information providing means obtains information related to the schedule of the person from the storage means and provides the information to the telephone terminal device. And

  According to this, since the user can know the schedule together with the location of the person, it is possible to grasp the situation of the person who is the other party in detail, and when there is a problem in making a call now, Based on this, it is possible to determine when to make a call.

  According to an eighteenth aspect of the invention, the information providing means provides the telephone terminal device with information relating to a person's occupancy status in a person designated by the user at the telephone terminal device or a room in a department.

  According to this, since the user can know in advance the person in the room, by selecting the other party in the room and calling the person directly, It is possible to save the trouble of having a person take a call and to improve convenience.

  The nineteenth aspect of the invention further comprises storage means for storing information relating to attributes for each person, wherein the information providing means obtains information relating to person attributes from the storage means and provides the information to the telephone terminal device. And

  According to this, since the user can select a person who is familiar with the requirement based on information on the attributes of the person in the room, it is possible to save time and effort for finding a person who is familiar with the requirement. Can be increased.

  The twentieth invention further comprises storage means for storing information relating to attributes for each person, and search means for searching the storage means for a person whose attribute corresponds to a keyword input by the user at the telephone terminal device. The information providing means is configured to provide information related to the person acquired by the searching means to the telephone terminal device.

  According to this, when a user does not know a person who is familiar with a specific message, the user can know the person who is familiar with the message by inputting the keyword of the message on the telephone terminal device, which improves convenience. it can.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is an overall configuration diagram of a system according to the present embodiment. This system includes an object tracking device 1 that captures an image of a monitoring target space, tracks an object recognized as a person, and obtains the position thereof, a presence management device 2 that generates and manages presence information about the location of the person, and presence management A storage device 3 for storing information necessary for generating presence information and the like in the device 2, a card reader (personal authentication means) 4 for performing personal authentication, and a presence management device 2 assigned to each user. A smartphone (user terminal device, telephone terminal device) 5 to which information is provided, and a PC (user terminal device) 6 assigned to each user are mainly configured.

  The object tracking device 1 includes a camera (imaging unit) 21 and a tracking unit (tracking unit) 22. A plurality of cameras 21 are installed at appropriate positions in the monitoring target space of the present system. This camera 21 is an all-around camera, for example, and is installed on the ceiling of a room or hallway. The tracking unit 22 tracks an object appearing in an image captured by the camera 21, and performs image processing on the captured image output from the camera 21 to thereby recognize an object (person image) recognized as a person in the captured image. ) Is detected, and coordinates indicating the current position of the object are output.

  As a specific algorithm for extracting a moving object in an image, for example, a method using a background reference image is known. In this method, a background reference image that has been input and stored in advance and a captured image are compared, and a portion where a difference has occurred is extracted as a difference region. However, this method has a problem that it becomes difficult to extract a moving object if the lighting condition varies between the reference image and the current image. However, in an environment where the lighting condition is relatively stable, such as indoors, the moving object Can be detected effectively. In addition, detection accuracy can be dramatically improved by appropriately selecting and using a plurality of background reference images prepared in advance based on the average luminance value or local luminance value of the current image captured by the camera. Are known.

  A method is known in which the moving object detected in this way is determined to be a person, for example, by matching with a specific pattern.

  The presence management device 2 includes an object management unit (object management unit) 31, a presence information acquisition unit (presence information acquisition unit) 32, a feature extraction unit (feature extraction unit) 33, a search unit (search unit) 34, And an information providing unit (information providing means) 35.

  The object management unit 31 sets a specific person as an object tracked by the object tracking device 1. The presence information acquisition unit 32 creates presence information related to the location of the person from the current position of the object for which the person is set by the object management unit 31. The feature extraction unit 33 acquires behavior feature information that represents a feature related to the behavior of each person and presence location feature information that represents a feature related to the presence position from past behavior and location of each person. The search unit 34 performs various search processes on the information stored in the storage device 3. The information providing unit 35 provides presence information and the like to the smartphone 5 and the PC 6.

  In addition to this, the presence management device 2 may acquire a captured image from the object tracking device 1 and identify an object by a clothing color or the like in the object management unit 31 based on the captured image.

  The storage device 3 includes a presence information storage unit (storage means) 41 that stores presence information generated by the presence management device 2. The storage device 3 also includes databases (storage means) 42 to 55 that store information necessary for generating presence information. These databases 42 to 55 will be described in detail later.

  The card reader 4 reads a card (for example, an IC card type employee card) possessed by each person, and a personal authentication system that performs personal authentication by the card reader 4, that is, an entry / exit management system 11, an entrance / exit management system 12, And the office equipment management system 13 respectively. This eliminates the need for a special card reader for the monitoring system, thereby reducing costs.

  The card reader 4 of each of the systems 11 to 13 is connected to the presence management device 2 via a network and provides personal authentication information (person and time) to the presence management device 2. The function of providing information to the presence management device 2 can be provided in the card reader 4 itself, but may be provided in a server (not shown) that manages the card reader 4 in each of the systems 11 to 13.

  The exit / exit management system 11 manages employee exit / exit, and a card reader 4 is installed at the gate entering the site. Even if the card reader 4 does not perform personal authentication, it passes through the gate. The individual does not enter the office on time management. The entrance / exit management system 12 manages the entrance / exit of the employee's room. A card reader 4 is installed at the entrance / exit of the room, and the individual can not enter the room without personal authentication using the card reader 4. . If entry / exit is performed without performing personal authentication by sharing, etc., entry / exit is restricted by the so-called anti-pass function every time personal authentication is performed by the card reader 4 thereafter. The anti-pass function also operates when the personal authentication is performed by the entrance / exit management system 12 in the situation where the personal authentication is not performed by the above-mentioned exit / exit management system 11. The office machine management system 13 manages the usage status of office machines (for example, copiers, fax machines, printers, and multifunction machines) for each user. A card reader 4 is installed for each office machine. Office equipment cannot be used without personal authentication by the card reader 4. In addition, it is also possible to add a cafeteria payment system that uses a card for payment at the cafeteria. That is, in this embodiment, any card reader connected to the network can be used for presence management.

  Further, in this system, as a system for providing information on a schedule for each person necessary for specifying a person corresponding to an object tracked by the object tracking device 1, a conference room reservation system 14, a business trip application system 15, An attendance management (vacation application) system 16 and a personal schedule management system 17 are connected to the presence management apparatus 2 via a network, and information acquired from these systems 14 to 17 is stored in the storage device 3. The conference room reservation system 14 manages conference room reservation, the business trip application system 15 manages employee business trips, and the attendance management system 16 manages employee vacations. The personal schedule management system 17 manages personal schedules such as telecommuting.

  The smartphone 5 can perform a call via a telephone line and data communication via a network. In addition, the smartphone 5 includes a touch panel display that serves as both a display unit for displaying an image and an operation unit, and displays presence information provided from the presence management device 2. Furthermore, an application for controlling screen display and screen operation based on screen data transmitted from the presence management device 2 is introduced to the smartphone 5.

  The PC 6 includes a display unit that displays an image and an operation unit. This PC 6 is installed in a seat arranged in a room of a department to which a person belongs (a room in which a person normally resides). The PC 6 is connected to the presence management device 2 via a network, and provides personal authentication information (authentication time, identification information of the PC 6, person ID, etc.) to the presence management device 2 when personal authentication is performed using a password or the like during login. . The function of providing information to the presence management apparatus 2 can be provided in the PC 6 itself, but may be provided in a server (not shown) that manages the PC 6 in the PC management system.

  In the PC 6, the presence management device 2 and the storage device 3 are accessed with the administrator authority, and information input work for various settings and update of stored information is performed. Further, the PC 6 accesses the conference room reservation system 14, the business trip application system 15, the attendance management (vacation application) system 16, and the personal schedule management system 17 to input information related to each system, that is, conference room reservation, business trip Operations such as application, leave application, and personal schedule registration are performed by the user. Further, the PC 6 displays presence information provided from the presence management device 2. When the PC 6 is fixed at a specific position like a desktop PC, location information registered in advance may be provided to the presence management device 2. On the other hand, when the PC 6 is portable like a notebook PC, the position information is not determined and the position information is not provided. However, the PC 6 has a function of correcting the presence information provided from the presence management device 2. It may be allowed.

  Next, the databases 42 to 55 provided in the storage device 3 will be described. As will be described in detail later, in this embodiment, a relational database is constructed.

  As shown in FIG. 1, the storage device 3 divides the monitoring target space of the system into a plurality of sections in advance, and stores the sections in correspondence with the coordinates set in the monitoring target space. A map database 44 is provided. The presence information acquisition unit 32 acquires a section corresponding to the coordinates indicating the current position of the object from the business establishment map database 44, and creates presence information including the coordinates indicating the current position and the name of the section corresponding thereto.

  FIG. 2 is a plan view showing an example of a business office that becomes a monitoring target space of the present system. In the present embodiment, the section (location) is divided in stages at a plurality of division levels. Here, it is divided at the first to third division levels. At the first division level, the entire site of the office is divided into the north back gate side, the west main gate side, building A (5 floors), courtyard, building B (7 floors), East JR side, and the south side. It is divided into each section. In the second division level, the building is divided in units of floors (floors) as a middle division. In the third division level, each floor of the building is divided into division units such as a living room, a conference room, a hallway, and a break room as small sections. It should be noted that more detailed sections can be set. For example, sections such as doors, copiers, desk rows, and seats may be set in the living room.

  Note that the detailed location of the individual by the camera 21 may be limited to, for example, the third division level. For example, in the first division level, detailed information such that a specific individual is “where in the south of the business office” is generally considered to have a small information value.

  Assuming that the section is divided in stages at a plurality of division levels in this way, if the person's location can be specified by a section by a small division level, the person's location is determined by the section by the small division level. By representing, the user can grasp the location of the person in detail. Further, when the location of a person can be specified only by a section with a large division level, the user can grasp the location of the person without fail by indicating the location of the person with the section with the large division level.

  FIG. 3A is an explanatory diagram showing the registration contents of the business establishment map database 44. The office map database 44 is accessed using a domain code, x coordinate, y coordinate, and z coordinate which are primary keys. This establishment map database 44 stores each division (location) name for each establishment (domain) which is the monitoring target space of this system and coordinates in the establishment site. Information on location name, department code, etc. is registered according to the subdivision. The domain code is a code representing the name of the office. In FIG. 3B, the name of the office is registered in association with the domain code as the primary key. The department code is a code associated with the department name (see FIG. 14). With this business location map database 44, it is possible to identify a section (place) where a person exists from the coordinates indicating the current position of the object acquired by the object tracking device 1, and thereby present the location of the person in an easy-to-understand manner to the user. be able to.

  In this business establishment map database 44, the x-coordinate and the y-coordinate indicate positions on a plane, and are set, for example, at 1 m intervals. The z coordinate indicates the position in the height direction, and here, the number of floors of the building is set. For example, when the office map database 44 is accessed by specifying domain code = 1, x coordinate = 1, y coordinate = 1, z coordinate = 1, major classification = north back gate side, middle classification = null, minor classification = The value of null is returned. Here, if null is returned, it means that a location name or the like is not assigned to the classification. In addition, since z ≧ 2 representing the second floor does not exist for the company outdoor, null is also returned in this case. Note that the domain code x-coordinate, y-coordinate, and z-coordinate are sorted in ascending order in advance, thereby realizing high-speed database access.

  FIG. 4 is an explanatory diagram showing the registration contents of the seat database 45. The seat database 45 stores the seat position for each person, and registers information such as a person ID, a domain code, and installation position coordinates. By accessing the business establishment map database 44 using the domain code and the installation location coordinates, a location name such as “A building 3F room” and a department name such as “HR 1T” via the department code Can be obtained. Conversely, by accessing the seat database 45 using the person ID, it is possible to acquire the coordinates of the seat on which the person mainly works. The presence management device 2 detects the seating of the object on the seat from the current position coordinates of the object by referring to the seat database 45, and compares the seat with the person set in the object. Whether or not he / she is seated can be detected.

  As described above, the seat database 45 may be accessed using the domain code and the installation position coordinates as keys, and may be accessed using the person ID as a key. Therefore, in actual operation, the access performance is improved by separating the database sorted in ascending order based on the person ID and the database sorted based on the domain code and the installation position coordinates.

  FIG. 5 is an explanatory diagram showing the registered contents of the camera database 46. The camera database 46 stores the installation position of the camera 21 of the object tracking device 1 and registers information related to the camera ID and installation position coordinates. The camera database 46 is accessed using the photographing camera ID as a primary key, and returns a domain code where the camera is installed and installation position information. By using the domain code and the installation position coordinates to access the business establishment map database 44, the installation location name can be obtained.

  Each of the cameras 21 is assigned an imaging space (monitoring area) obtained by appropriately dividing the monitoring target space of this system, and the tracking unit 22 determines the imaging space of the camera 21 from the position of the object on the image captured by the camera 21. The relative coordinates above can be acquired, and the absolute coordinates on the monitoring target space of this system can be acquired from the relative coordinates and the installation position of the camera 21. Specifically, when one camera 21 is installed in a living room or the like, height information corresponding to the object being tracked is extracted from a database (for example, stored in the person attribute database 53), and is extracted from the image. The distance between the camera 21 and the object may be estimated based on the object position and length. Further, when a plurality of cameras 21 are installed in the room, it is preferable to perform a stereo view with the plurality of cameras 21 and measure the distance to the object based on the parallax. When the camera 21 is a so-called omnidirectional camera, the object position is grasped as an angle, but it can be converted into x and y coordinates by adding distance information thereto.

  FIG. 6 is an explanatory diagram showing registration contents of the entry / exit management system database 47, the entrance / exit management system database 48, and the office equipment management system database 49.

  The entry / exit management system database 47 shown in FIG. 6A manages information related to the installation position of the card reader 4 of the entry / exit management system 11, and information such as card reader ID and installation position coordinates is registered. . The access / exit management system database 47 returns a domain code and installation position coordinates by being accessed using the card reader ID as a primary key.

  The entry / exit management system database 48 shown in FIG. 6B manages information related to the installation position of the card reader 4 of the entry / exit management system 12, and information such as the card reader ID and installation position coordinates is registered. . The entrance / exit management system database 48 returns a domain code and installation position coordinates by being accessed using the card reader ID as a main key.

  The office equipment management system database 49 shown in FIG. 6C manages information related to the installation position of the card reader 4 of the office equipment management system 13, and the ID of the office equipment provided with the card reader 4 that performs personal authentication. Information on installation position coordinates and the like are registered. The office machine management system database 49 returns a domain code and installation position coordinates by being accessed using the copy machine ID as a primary key.

  By using the return values (domain code and installation position coordinates) returned from the entry / exit management system database 47, the entrance / exit management system database 48, and the office equipment management system database 49, the establishment map database 44 is accessed. The name of the place where each card reader or copier is installed can be acquired.

  In the presence management device 2, when personal authentication is performed by the card reader 4, the card reader ID is provided directly from the card reader 4 or from the server of each of the systems 11 to 13, and these databases 47 to 49 are referred to. Thus, the installation position of the card reader that has been subjected to personal authentication can be acquired, and the current position of the person who has received personal authentication can be acquired from the installation position of the card reader.

  As shown in FIG. 1, the presence management device 2 includes an object management unit 31. When an event that can identify a person occurs, the object management unit 31 is tracked by the object tracking device 1. Set a specific person for the object. In particular, in the present embodiment, when the personal authentication is performed by the personal authentication system, that is, the card reader 4 and the PC 6 of the entry / exit management system 11, the entrance / exit management system 12, and the office equipment management system 13, the person may be specified. Therefore, when personal authentication is performed with these, a specific person who has received the personal authentication is set in the object.

  In addition, the presence management device 2 includes a presence information acquisition unit 32. In the presence information acquisition unit 32, the current position of the object tracked by the object tracking device 1 and the person set as the object by the object management unit 31 To create presence information about the location of the person. Presence information acquired by the presence information acquisition unit 32 is stored in a presence information storage unit (storage unit) 41 provided in the storage device 3, and this presence information is updated as needed as the object moves.

  Here, if the personal authentication means (card reader 4 or PC 6) is installed within the monitoring range of the object tracking device 1, a specific person who has received personal authentication is set as the object, and the current position of the object is set. The location of a person. On the other hand, if the personal authentication means is installed outside the monitoring range of the object tracking device 1, the person cannot be set for the object, but the installation position of the personal authentication means can be the person's location.

  As a result, the image processing means (here, the tracking unit 22) that processes the image captured by the camera 21 only needs to detect an object that is recognized as a person from the captured image, and does not need to identify the person from the captured image. The processing load on the image processing means can be reduced. Further, the location of the person can be obtained with high accuracy from the current position of the object tracked by the object tracking device 1.

  FIG. 7 is an explanatory diagram showing the contents of presence information stored in the presence information storage unit 41. Here, as the presence information, a person ID, an object ID, information on attendance, the name of the affiliated office, the coordinates of the current position, and the name of the location are stored. Further, the presence information storage unit 41 also stores incidental information such as information related to a schedule for each person and information related to a person attribute.

  Presence information is searched for necessary items from the person action database 42, the person schedule database 50, the person attribute database 53, etc., which will be described later, using the person ID as a key, and the object database 43 is searched using the person ID as a key to search for the corresponding object. It is obtained by acquiring the existence coordinates. Note that the presence information may be updated in real time, or may be a view created whenever a user instruction is given in consideration of the load on the database.

  As shown in FIG. 1, a personal behavior database 42 is provided in the storage device 3. This person behavior database 42 manages the behavior of the day for each person, that is, the status of attendance such as vacation or business trip, and the time of personal authentication in the card reader 4 and the PC 6. The object management unit 31 of the presence management apparatus 2 can refer to the person behavior database 42 to determine whether or not the person is in the premises of the office that is the monitoring target space of the system. If it is clear that the person is not in the space, the person is excluded from the object setting targets, and the person set in the object is canceled.

  FIG. 8 is an explanatory diagram showing the registered contents of the person behavior database 42. This person behavior database 42 is accessed using a person ID as a main key, and information related to attendance, work time, leaving time, login time at PC6, logoff time at PC6, and the like are registered. The personal behavior database 42 is updated each time personal authentication is performed by the card reader 4 and login / logoff is performed on the PC 6. Information on attendance is acquired from the attendance management system 16. The time for leaving the company and the time for leaving the company are acquired directly from the card reader 4 of the management system 11 or from a server (not shown). The login time and logoff time of the PC 6 are acquired directly from the PC 6 or from a server (not shown).

  In the object management unit 31, a plurality of persons can be set for one object, and when an event occurs that causes object confusion in the tracking process, a plurality of persons are set to the object in duplicate, Priorities are given to the plurality of persons. This priority is given in descending order of the probability that the person is the person in accordance with an event that causes confusion of objects.

  As a result, even if an event that causes object confusion occurs in the tracking process, the object tracking can be continued without interruption. Then, although the location of the person is in an indefinite state, it can be grasped, and presence information of many persons can be provided. In this way, when an event that causes object confusion occurs in the tracking process, by allowing an uncertain state regarding the location of the person, the number of persons who cannot provide presence information is reduced, and convenience is increased. Secured.

  In particular, when a plurality of persons are set to be duplicated in an object, the object management unit 31 gives a probability representing the probability of being the person for each of the plurality of persons, and the probability according to an event that occurs in the tracking process. , That is, when an event that increases the probability of being a person occurs increases the probability, and when an event that decreases the probability of being an individual occurs, the probability decreases and an event that can identify a person occurs, that is, an individual When authentication is performed, the probability of the person is set to 100%.

  As a result, it is possible to determine the priority of a plurality of persons set in duplicate on one object with high or low probability. Since the probability given to the person is changed to an appropriate value according to various events that occur in the tracking process, the accuracy of the person setting for the object can be increased.

  In addition, in order to manage information (object data) related to person setting for an object by the object management unit 31, an object database 43 is provided in the storage device 3 as shown in FIG. FIG. 9 is an explanatory diagram showing registered contents in the object database 43. In the object database 43, an object ID, a camera ID, a current position (domain code and x, y, z coordinates), a person ID, and a probability that the object matches the person are registered.

  In the object management unit 31, when a person is newly set for an object, object data is generated and registered in the object database 43. When the object management unit 31 acquires information related to the current position of the object from the object tracking device 1, the object database 43 is updated. In addition, when an event that changes the probability of a person occurs and the object management unit 31 changes the probability of the person, the object database 43 is updated.

  Further, as shown in FIG. 1, the storage device 3 is provided with a person schedule database 50. The person schedule database 50 stores information related to a schedule for each person. The object management unit 31 of the presence management apparatus 2 acquires a person's schedule set for the object from the person schedule database 50, compares the person's schedule with the current position of the object, and checks the consistency between the two. Change the person settings for an object based on

  That is, when the person's schedule set for the object is compared with the current position of the object and the two match, the object is specified as one person, that is, the person set for the object in the object database Or the probability of a person set as an object is increased. Conversely, if the schedule of the person set for the object and the current position of the object do not match, the person set for the object is canceled or the probability of the person is lowered.

  FIG. 10 is an explanatory diagram showing the registered contents of the person schedule database 50. In this person schedule database 50, information related to person ID, schedule type (classification), reservation place, date and time, scheduled start time, scheduled end time, and schedule contents is registered, and accessed using the person ID as a main key. Information to be registered in the person schedule database 50 is acquired from the conference room reservation system 14, the business trip application system 15, the attendance management system 16, and the personal schedule management system 17, and when there is a new input or change in each system 14-17. The person schedule database 50 is updated.

  In this way, the validity of the person set for the object can be determined by comparing the schedule of the person set for the object with the current position of the object, thereby improving the accuracy of the person setting for the object. be able to.

  As shown in FIG. 1, the presence management apparatus 2 includes a feature extraction unit 33. The feature extraction unit 33 acquires behavior feature information representing features related to past behavior for each person, and The feature information is stored in the action history database 51. Then, the object management unit 31 acquires the behavior feature information of the person set for the object from the behavior history database 51, compares the behavior feature information of the person with the current behavior of the object, Change person settings for an object based on gender.

  In other words, the behavior feature information of the person set for the object is compared with the current action of the object, and if both are similar, it is determined that the person set for the object is likely to be the person. Thus, the object is specified as one person, that is, the probability of the person set to the object is set to 100%, or the probability of the person set to the object is increased. On the other hand, when the behavior feature information of the person set for the object and the current behavior of the object are greatly different, the probability of the person set for the object is lowered.

  In this way, the validity of the person set for the object can be judged by comparing the characteristics of the past action for each person with the current action of the object, thereby improving the accuracy of the person setting for the object. Can be increased.

  FIG. 11 is an explanatory diagram showing registered contents in the action history database 51. In the behavior history database 51, information on a person ID, a walking speed, and whether or not a smoking room has been entered is registered. The walking speed varies from person to person, and entry to the smoking room is limited to persons who have a smoking habit. For this reason, the validity of the person set to the object can be determined based on the characteristics regarding these actions.

  This behavior history database 51 is updated as needed based on presence information. At this time, the walking speed is calculated from the coordinates of the current position of the presence information, averaged if necessary, and registered in the action history database 51. If the presence information confirms that the smoking room has been entered, the entry is changed from no entry (0) to entry (1).

  A person frequently contacts a specific person in a meeting or standing talk, and the person who frequently contacts each person is different. For this reason, the contact frequency with a specific person may be collected for each person, and the action feature information regarding the contact person may be registered in the action history database 51, and the person setting of the object may be changed based on this. . In this case, when it is detected that the objects are in contact with each other, the person set for each object is compared with a person with a high contact frequency related to the person, and if they match, the object is identified as that person. Or the probability of the person set to the object is increased. In the action history database 51, a predetermined number of persons having a high contact frequency in a certain past period may be registered from the top.

  Here, it is convenient if the contact frequency is expressed as a cumulative total of time in which a plurality of objects exist simultaneously within a predetermined distance (for example, several meters). Whether or not the objects are in contact with each other may be determined based on the distance between the objects and the duration, and a state in which the objects are closer than a predetermined distance (for example, several meters) is a predetermined time. If it continues (for example, for 10 minutes), it will be judged that it is in a contact state.

  In addition, since the route (traffic line) that a person walks and the lockers that the person uses also differ depending on the person, these pieces of information are registered in the action history database 51 as action feature information to determine the validity of the person setting of the object. Can be used. In addition, since a person's action depends on time, that is, the person moves to a specific place at a specific time, the place and the time are associated with each other and registered in the action history database 51 to set the person setting of the object. It can be used for validity judgment.

  In addition, the feature extraction unit 33 of the presence management device 2 acquires presence position feature information representing a feature related to a past presence position for each person, and the presence position feature information is stored in the presence position history database 52. Then, the object management unit 31 acquires the presence position feature information of the person set for the object from the presence position history database 52, and compares the person's presence position feature information with the current presence position of the object. The person setting for the object is changed based on the consistency between the two.

  In other words, the presence position feature information of the person set for the object is compared with the current position of the object, and if both are similar, it is determined that the person set for the object is likely to be the person. Thus, the object is specified as one person, that is, the probability of the person set to the object is set to 100%, or the probability of the person set to the object is increased. On the other hand, if the presence position feature information of the person set for the object is significantly different from the current position of the object, the probability of the person set for the object is lowered.

  In this way, the validity of the person set for the object can be determined by comparing the characteristics related to the person's past position with the current position of the object, and thus the accuracy of the person setting for the object can be determined. Can be increased.

  FIG. 12 is an explanatory diagram showing the contents registered in the presence location history database 52. Information relating to the person ID, the ratio of the existence time, the position coordinates, and the place name is registered in the presence position history database 52, and accessed using the person ID as a main key. The existence time ratio is a ratio of the time during which a person exists in a certain period in the past (for example, for one month). If this existence time ratio is high, the person exists at the place for a long time, and the place is indicated by the person. If the current position of the object is a position having a high existence time ratio, there is a high probability that the person set in the object is the person himself / herself. In the present embodiment, when the presence position history database 52 is accessed using the person ID as a key, a plurality of records are hit as shown in FIG. 12 (first normal form). This eliminates a situation (non-normal form) in which a repetitive description appears in one record and the data length is indefinite.

  This location history database 52 is updated as needed based on presence information. At this time, the presence time ratio is calculated by counting the coordinates of the current position of the presence information, and the obtained existence time ratio is registered in the presence history database 52. In the presence position history database 52, a predetermined number of coordinate positions having a high existence time ratio may be registered from the top.

  The feature extraction unit 33 acquires the behavior feature information and the presence position feature information based on the presence information. The behavior feature information and the presence position feature information are updated every time the presence information is updated.

  Further, as shown in FIG. 1, the presence management device 2 includes an information providing unit 35. The information providing unit 35 acquires presence information related to the location of the person from the presence information storage unit 41 and provides it to the smartphone 5 and the PC 6. Thereby, the user can know the location of the person with his / her smartphone 5 or PC 6.

  In particular, in this embodiment, as shown in FIGS. 2 and 3, in the business establishment map database 44, a plurality of sections obtained by dividing the monitoring target space of this system are set to the coordinates set in the business establishment and the monitoring target space. The presence information acquisition unit 32 refers to the business establishment map database 44, acquires a section corresponding to the coordinates indicating the current position of the object tracked by the object tracking device 1, and stores the information. The providing unit 35 provides the name of the section acquired by the presence information acquiring unit 32 to the smartphone 5 or the PC 6 as the location of the person. As a result, the user can know the location of the person by the name of the section, and the location of the person can be easily understood.

  As shown in FIG. 1, the information providing unit 35 of the presence management device 2 provides the smartphone 5 and the PC 6 with the person attribute information related to the person's attribute together with the presence information related to the person's whereabouts as necessary. The storage device 3 is provided with a person attribute database 53 that stores person attribute information for each person.

  FIG. 13 is an explanatory diagram showing the registration contents of the person attribute database 53. In this person attribute database 53, information related to person ID, name, specialized field, field in charge, department code, qualification, and server room entry permission is registered and accessed using the person ID as a main key. By providing such person attribute information to the user together with presence information, it is possible to easily select a person who is familiar with the inquiries. This point will be described in detail later as a telephone system that provides information to the smartphone 5.

  In addition, when providing information to the smart phone 5, the situation which acquires person ID from the person name input with the smart phone can be considered. Considering the search efficiency at this time, it is desirable to prepare a second person attribute database that is sorted in ascending or descending order using the name as a key.

  Further, as shown in FIG. 1, a department database 54 is provided in the storage device 3. FIG. 14 is an explanatory diagram showing the contents registered in the department database 54. This department database 54 registers department codes and department names in association with each other, and is accessed using the department codes as primary keys.

  The storage device 3 is provided with a telephone database 55. The telephone database 55 manages the telephone number of the smartphone 5 assigned to each person. When the smartphone 5 inquires about a request, the telephone database 55 provides the smartphone 5 with the necessary person's telephone number, thereby You can easily call someone you don't know. This point will be described in detail later as a telephone system that provides information to the smartphone 5.

  Next, the operation of this system when personal authentication is performed by the card reader 4 of the leaving / exiting management system 11 will be described. FIG. 15 is a flowchart showing an operation procedure of each unit when personal authentication is performed by the card reader 4 of the leaving / exiting management system 11.

  Here, first, when a person enters the office, if the card is held over the card reader 4 installed at the entrance of the site in the exit / exit management system 11, the card is read and personal authentication is performed (ST101). Then, personal authentication information (card reader ID, person ID, and authentication time) is transmitted to the presence management apparatus 2 (ST102).

  Based on the personal authentication information received from the card reader 4, the presence management device 2 refers to the attendance / exit management system database 47 to obtain the installation position of the card reader 4 that has been authenticated, and this person (ST201). Next, the office hours of the person corresponding to the person behavior database 42 are registered (ST202). Then, the attribute information of the corresponding person is acquired from the person attribute database 53 (ST203), and the presence information related to the location of the person and the incidental information related to the schedule and the attributes (see FIG. 7) stored in the presence information storage unit 41 are obtained. Update (ST204).

  Next, a situation in which the probability of a person set as an object changes according to a person's action will be described using a specific example. In the following description, the domain code shown in FIG.

  FIG. 16 is a schematic plan view showing a first example in which the probability of a person changes. FIG. 17 is an explanatory diagram showing a situation where the probability of a person changes in the example shown in FIG.

  In the example shown in FIG. 16, the card reader 4 of the entrance / exit management system 12 is installed at the entrance of the room, and a person who wants to enter the room performs personal authentication with the card reader 4. In the living room, the conference room, and the break room, a camera 21 that captures the interior of the room is provided. A person who enters the room is imaged, and an object that appears in the captured image is tracked. The position is output sequentially. Desks serving as seats for each person are arranged in the living room, and a PC 6 is installed on each desk.

  Here, the person B (object 01) enters the room after performing personal authentication with the card reader 4 of the entrance / exit management system 12 installed at the entrance of the room, and then enters the break room. Person C (object 02) and person D (object 03) have already entered the rest room. Thereafter, the person B leaves the break room and performs personal authentication with the card reader 4 in order to use the copy machine. Next, the person B talks with the person K who is seated in his / her seat, then sits in his / her seat and starts work in the seat.

  FIG. 18 is a schematic plan view showing a second example in which the probability of a person changes. FIG. 19 is an explanatory diagram showing a situation where the probability of a person changes in the example shown in FIG.

  In the example shown in FIG. 18, the person B (object 01) enters the room after performing personal authentication with the card reader 4 at the entrance of the room. Then, the conference room is entered through the living room and a meeting is held. Two other people are present in the conference room. When the conference ends, the person B leaves the conference room, sits in his seat through the shadow behind the blind spot of the camera 21, and starts work in that seat.

  FIG. 20 is a schematic plan view showing a third example in which the probability of a person changes. FIG. 21 is an explanatory diagram showing a situation where the probability of a person changes in the example shown in the figure.

  In the example shown in FIG. 20, the person B (object 01) performs personal authentication with the card reader 4 at the entrance of the room, enters the room, then sits in his / her seat, and starts work in that seat. Thereafter, the person B leaves the room and enters the toilet. Then, since the person B comes out of the toilet and returns to the living room, the person B enters the living room after performing personal authentication with the card reader 4 at the entrance of the living room.

  In each example shown in FIG. 16 to FIG. 21, when person B enters the living room, personal authentication is performed by the card reader 4 of the entrance / exit management system 12 installed at the entrance of the living room, so that the vicinity of the entrance of the living room Can be identified as the person B who has received the personal authentication, so that the person B is set to the object 01 with a probability of 100%, and then the tracking of the object 01 that has entered the room is started.

  Here, the operation of this system when personal authentication is performed by the card reader 4 of the entrance / exit management system 12 will be described. FIG. 22 is a flowchart showing the operation procedure of each part when personal authentication is performed by the card reader 4 of the entrance / exit management system 12.

  Here, first, when a person enters the room, when the card is held over the card reader 4 installed at the entrance of the room in the entrance / exit management system 12, the card is read and personal authentication is performed (ST111). Then, personal authentication information (card reader ID, person ID, and authentication time) is transmitted to the presence management apparatus 2 (ST112).

  The presence management device 2 refers to the entry / exit management system database 48 based on the personal authentication information received from the card reader 4 and acquires the installation position of the card reader 4 on which personal authentication has been performed. The current position of the person is set (ST211). Then, referring to the camera database 46, the ID of the camera 21 installed in the room where the person enters is acquired, and an instruction to start tracking with the camera 21 is transmitted to the object tracking device 1 (ST212).

  When the object tracking device 1 receives the tracking start instruction from the presence management device 2, the object tracking device 1 detects an object that has passed through the entrance of the living room and starts tracking the object. Object tracking information (camera ID, object Current position (relative coordinates) and time) are periodically transmitted to the presence management device 2.

  Based on the first object tracking information received from the object tracking device 1, the presence management device 2 adds a new ID to the object and adds it to the object database 43 (ST213), and sets an authenticated person for the object. . Also, the camera database 46 is referenced to obtain the coordinates of the installation position of the captured camera 21, the absolute coordinates of the object are obtained from the coordinates of the camera 21 and the relative coordinates of the object, and are registered in the object database 43. . Thereafter, the object database 43 is updated every time the object tracking information is received (ST214).

  In addition, the feature extraction unit 33 of the presence management device 2 acquires the walking speed from the change in the coordinates of the object that is sequentially updated by the tracking of the camera 21 (ST215), and stores the action history database 51 for the person set to the object. Update (ST216). Further, the person attribute information of the person set in the object is acquired from the person attribute database 53, and the presence information of the person is updated (ST217).

  Further, in each example shown in FIGS. 16 to 21, when the object 01 enters the room, the tracking of the object 01 by the camera 21 installed in the room is started, and the current of the object 01 that changes as the object 01 moves. The position is transmitted from the object tracking device 1 to the presence management device 2 as needed, and the object database 43 is updated. At this time, there is an error in the tracking function of the object tracking device 1, and there is a possibility that it will be confused with other things in the tracking process (not only a person but also a planter plant). . For this reason, as shown in FIGS. 17, 19, and 21, the probability of the person B is gradually lowered as the object 01 moves (with time).

  Next, a case where an object enters a break room will be described. In the example shown in FIG. 16, the object 01 enters the break room. At this time, the tracking of the object 01 is inherited from the camera 21 in the living room to the camera 21 in the break room. The inheritance of the object is performed based on the coordinates of the object. That is, the coordinates of the object are obtained from the position of the object appearing in the captured image of the camera 21, but if the coordinates of the object according to the captured image of the two cameras 21 match at the same time, the two objects are determined as the same object. An object is inherited between 21. Since there is an error in the inheritance of this object, the probability of the person B decreases according to the inheritance of the camera 21 as shown in FIG.

  In the example shown in FIG. 16, in addition to the object 01 in which the person B is set, the objects 02 and 03 in which the persons C and D are set exist in the break room. At this time, since the person usually does not move much while in the break room, when the number of persons in the break room is small, the objects 01, 02, 03 do not confuse, but the objects 01, 02, 03 are mutually connected. If one person is hidden by the other person when viewed from the direction of the camera 21, the objects 01, 02, 03 may be confused. In this case, the object 01 is set. The probability of the person B is lowered, and the persons C and D set in the objects 02 and 03 are set in the object 01, respectively. As in the example of the break room, in a place where people are likely to be crowded, it is desirable to arrange the camera 21 so as to image the group of people from directly above. This effectively solves the problem of the person being hidden by the person.

  Also, as shown in FIG. 16, when person B performs personal authentication with the card reader 4 of the copier, the object 01 in the vicinity of the card reader 4 can be specified as the person B and set as the object 01. The probability of the person B is 100%. In the example shown in FIG. 16, people B, C, and D are set in the object 01 due to the confusion of the objects 01, 02, and 03 in the break room, but the card reader 4 performs personal authentication. As a result, the probability of the person B returns to 100%. Conversely, for the objects 02 and 03, the probability of the person B is 0%.

  Next, a case where object confusion occurs when the objects being tracked approach each other will be described. In the example shown in FIG. 18, the object 01 set with the person B and the object 02 set with the person A leave after approaching each other. At this time, the two objects 01 and 02 move in either direction. Since it is not clear whether or not the person setting for the objects 01 and 02 is ambiguous.

  FIG. 23 is an explanatory diagram illustrating an example in which object confusion occurs. When two objects move away after approaching, there are two cases: a case where two objects pass each other as shown in FIG. 23B, and a case where two objects fold back as shown in FIG. However, it is impossible to discriminate between passing and folding, and object confusion occurs.

  Therefore, in the present embodiment, when the object management unit 31 detects that an event in which the objects being tracked are confused with each other, the person (person ID) set for one object is set for the other object. The probability of the original person set for each object is lowered. As a result, even if an event (passing or folding) occurs in which objects are confused with each other, it is possible to continue without canceling the person setting for the object. Then, a probability that accurately reflects the ambiguity of the person setting can be given to the person set as the object.

  Here, in consideration of the two cases of passing and folding, a preset probability is given to the person set for each object. That is, since passing is considered to occur more frequently than folding, the probability of passing is higher than folding, for example, 80% for passing and 20% for folding.

  Specifically, as shown in FIG. 23A, in the object 01 in which the person B is set, the probability of the person B is lowered to 80%, and the person A set in the other object 02 is newly added. Is set as a second candidate with a probability of 20%. In the object 02 in which the person A is set, the probability of the person A is lowered to 80%, and the person B set in the other object 01 is newly set as a second candidate with a probability of 20%.

  Here, the operation of the present system when object confusion occurs will be described. FIG. 24 is a flowchart illustrating an operation procedure of each unit when object confusion occurs.

  Here, first, object tracking is started in the object tracking device 1, and object tracking information indicating the current position of each object is sequentially transmitted to the presence management device 2 (ST131).

  When the presence management device 2 detects confusion between two objects based on the current position of each object based on the object tracking information received from the object tracking device 1 (ST231), the probability of the person set as the object as described above And the object database 43 is updated (ST232). Then, the presence information of the person whose probability has been changed is updated (ST233).

  In the example shown in FIG. 16, the object 01 set with the person B and the object 04 set with the person K approach each other by standing, causing the objects 01 and 04 to be confused. When the object 05 set with the person L passes through the vicinity of the set object 01, the objects 01 and 05 are confused, whereby the persons 01 and K are set in the object 01.

  Next, a case where an object enters a section where the person's location is clear based on the person's schedule will be described. In the example shown in FIG. 18, the object 01 enters the conference room. Persons (in this case, persons B, I, and G) who participate in the meeting at a specific meeting room at a specific time are clear from the person schedule database, and the person B set as the object 01 has a meeting in the meeting room where the person entered. If it is planned to participate in the object 01, it is highly possible that the object 01 is the person B, and it can be almost determined that the object 01 is the person B.

  Therefore, in this embodiment, when it is detected that an object has entered a section where the location of the person is clear based on the person's schedule, the person's schedule set for the object is acquired from the person schedule database 50, and the object If the section containing the character matches the person's schedule, the probability of the person is increased. In addition, when leaving the room immediately after entering the meeting room, it is considered that the person does not participate in the meeting. Therefore, as shown in FIG. 19, the probability of the person as the time passes after entering the meeting room is increased. You should raise it.

  If a plurality of persons are set in the object, the person who participates in the meeting in the meeting room is compared with the person set in the object to increase the probability of the common person. In the example shown in FIG. 18, the persons A and B are set in the object 01 due to the difference with the object 02. However, since the person A is not among the persons participating in the meeting in the conference room, the object 01 is the person B. The person A set as the object 01 is canceled and the probability of the person B is increased to 100%.

  Next, a case where the object passes through the blind spot of the camera 21 will be described. In the example shown in FIG. 18, the object 01 passes through the shadow of the pillar that is the blind spot of the camera 21. At this time, since the tracking of the object 01 is interrupted for a moment, the person setting for the object becomes ambiguous.

  Therefore, in the present embodiment, when the object management unit detects that an event occurs in which the object being tracked temporarily passes through the blind spot of the camera 21, the probability of the person set as the object is lowered. . As a result, even if an event occurs in which the object temporarily passes through the blind spot of the camera 21, it is possible to continue without canceling the person setting for the object. Then, a probability that accurately reflects the ambiguity of the person setting can be given to the person set as the object.

  At this time, the probability may be changed in consideration of the time from when the object enters the blind spot of the camera 21 to when the object coming out of the blind spot of the camera 21 is detected. When the object enters the blind spot of the camera 21, the uncertainty of the person setting increases with time. Therefore, the probability may be changed according to the elapsed time after the object enters the blind spot of the camera 21, that is, the probability may be set lower as the elapsed time becomes longer. If appears, set a probability of 90%.

  In the example shown in FIG. 18, another object 05 with the person H set is behind the pillar. For this reason, confusion occurs between the object 01 in which the person B is set and the object 05 in which the person H is set.

  At this time, if the object can be identified by the color of clothes, the object coming out of the shadow of the pillar can be specified, and the object coming out of the shadow of the pillar in consideration of the object identification error In 01, the person H set in the object 05 hidden behind the pillar is newly set with a low probability (for example, 10%).

  On the other hand, if the object cannot be identified, the priority (high probability) of the person is set in consideration of the time from when the object enters the shadow of the pillar until the object that comes out of the shadow of the pillar is detected. It is good to set. That is, since there is a high possibility that the person hidden behind the pillar first comes out of the pillar behind first, the probability of the person hidden behind the pillar first is set high. Further, since the person in the room is known in advance by the entrance / exit management system 12 or the like, the person having a low probability among the persons in the room is set as the object coming out from the shadow of the pillar. If there is one person who is not set as an object, that person is set as the object.

  Next, a case will be described in which tracking of an object is interrupted when the object enters a section where the camera 21 is not installed. In the example shown in FIG. 20, the object 01 in which the person B is set enters the toilet. However, since the camera 21 is not installed in the toilet, the tracking of the object 01 is interrupted.

  Therefore, in this embodiment, when the object management unit 31 detects that the object being tracked enters a section where the camera 21 is not installed, the tracking of the object is interrupted, and then comes out of the section. When the detected object is detected, the person who has been set for the object that has entered the section is set for that object. Thereby, a person can be set to an object without excess and deficiency, and the accuracy of the person setting with respect to an object can be improved.

  In the example shown in FIG. 20, in addition to the object 01 in which the person B is set, two objects in which the persons A and C are set are already in the toilet, and the object that has come out of the toilet is the person A, Either B or C. Therefore, when the object 11 coming out of the toilet is detected, persons A, B, and C are set in the object 11.

  At this time, the same probability according to the number of persons in the toilet is given to the persons A, B, and C, that is, the probability 1/3 is assigned to the persons A, B, and C, respectively. Further, different probabilities may be given according to the order of entering the toilet. That is, since the person who entered the toilet first is likely to come out first, the probability of the person who entered the toilet first is increased.

  If an object can be identified by features such as clothing color, the feature is registered in the object database, and when an object that has come out of the toilet is detected, the object is taken out of the toilet based on the feature of the object. It is possible to determine which object is the object before entering the toilet. In this case, the probability of the person set for the object may be lowered in consideration of the error of object identification.

  Further, since the object 01 in which the person B is set enters the toilet, it is obvious that the person B set in the object 01 is in the toilet. Therefore, during the period until the object coming out of the toilet is detected, the current position coordinates of the object 01 remain unknown, and the person B's location is registered in the presence information as a toilet.

  In the example shown in FIG. 20, when the object 11 coming out of the toilet returns to the living room, personal authentication is performed by the card reader 4 of the entrance / exit management system installed at the entrance of the living room. The object 11 can be specified as the person B, the probability of the person B set as the object 11 is increased to 100%, and the other persons A and C are canceled.

  Note that if presence information is collected uniformly, there is a risk of conflicting privacy issues. For example, an object that has entered a toilet may be deleted from the object database. Even if it does in this way, since personal authentication is normally performed with the card reader 4 of the door which passes when returning to a living room, it is thought that the influence in a substantial surface is small.

  In each example shown in FIGS. 16 to 21, the object 01 is seated in a seat. A person set in this seat, that is, a person who uses the seat as his seat, a person set in the object, If they match, the possibility that the person is seated in his / her seat is very high, and it can be almost determined that the object 01 is the person B.

  Therefore, in this embodiment, when the object management unit detects that the object being tracked is seated in the seat, the seat database 45 is accessed using the current position (installation position coordinates) obtained from the object database 43 as a key. And the person set in the object is compared with the person set in the object, and if they match, the probability of the person is increased. Accordingly, it is possible to give the person set to the object a probability that accurately reflects the certainty of the person setting, and it is possible to improve the accuracy of the person setting for the object. When a plurality of persons are set as objects, if one of them matches the person set as the seat, the probability of the person is increased. And lower the probability of other people.

  However, since there is a possibility that another person will be seated, the probability of the person is not immediately set to 100%. When another person is seated, the person leaves the seat in a short time, and therefore, as shown in FIG. 17, the probability is increased as time passes after the object is seated on the seat. In the example shown in FIG. 18, the person H is set to the object 01 from the middle. In such a case, the probability of the person B serving as his seat is a value close to 100% (for example, 99%). ) And the probability of the person H who does not become his seat is a value close to 0% (for example, 1%).

  Here, the operation of the present system when a person sits on the seat will be described. FIG. 25 is a flowchart showing an operation procedure of each unit when a person sits on a seat.

  Here, first, object tracking is started in the object tracking device 1, and object tracking information indicating the current position of each object is sequentially transmitted to the presence management device 2 (ST141).

  When the presence management device 2 detects that the object is seated based on the current position of the object based on the object tracking information received from the object tracking device 1 and the seat position coordinates acquired from the seat database 45 (ST241), The person ID of the seat is obtained from the seat database 45, and this is compared with the person set for the object (ST242). If there is a match, the probability of the person set for the object as described above is obtained. Change and update the object database 43 (ST243). Then, the presence information of the person whose probability has been changed is updated (ST244).

  Next, a telephone system that provides presence information related to the location of a person from the presence management apparatus 2 to the smartphone 5 will be described.

  In the present embodiment, as shown in FIG. 1, the presence management apparatus 2 includes an information providing unit 35, and this information providing unit 35 is a presence related to the location of a person when a user makes a call with the smartphone 5. Information is acquired from the presence information storage unit 41 and provided to the smartphone 5.

  As a result, when the user makes a call with the smartphone 5, the location of the person who is the other party can be grasped, and whether or not the call can be made can be determined in advance. And avoid the hassle of re-calling.

  In addition, the information providing unit 35 of the presence management apparatus 2 acquires information related to the person's schedule from the person schedule database 50 and provides the smartphone 5 with the presence information.

  As a result, the user can know the schedule along with the location of the person, so that the situation of the person who is the other party can be grasped in detail, and if there is a problem in making a call at present, it is based on the schedule. To determine when to make a call.

  In addition, the information providing unit 35 of the presence management device 2 provides the smartphone 5 with information related to the occupancy status of the person specified by the user on the smartphone 5 or the person in the room of the department. Further, the information providing unit 35 acquires information related to the attributes of the person from the person attribute database 53 and provides the information to the smartphone 5.

  As a result, the user can know in advance who is in the room, so by selecting the other party from the person in the room and calling the person directly, It is possible to save the trouble of having to take a phone call and improve convenience. Furthermore, since the user can select a person who is familiar with the requirement based on information about the attributes of the person in the room, it is possible to save the trouble of searching for a person who is familiar with the requirement and improve convenience. be able to.

  In addition, the presence management device 2 includes a search unit 34 that performs various search processes. The search unit 34 performs a process of searching the person attribute database 53 for a person whose attribute corresponds to the keyword input by the user on the smartphone 5, and the information providing unit 35 stores information on the person acquired by the search unit 34 on the smartphone 5. provide.

  As a result, when the user does not know a person who is familiar with a specific message, the user can know the person who is familiar with the message by inputting the keyword of the message on the smartphone 5, and convenience can be improved.

  In the present embodiment, the presence information of a person is displayed as an image on the smartphone 5. That is, the information providing unit 35 of the presence management apparatus 2 generates screen data that displays the current position of a person existing in the section on an image representing the section such as a living room or a meeting room, and uses the screen data as a smartphone. Send to 5. The smartphone 5 displays an image based on the screen data received from the presence management device 2 on the display unit. Thereby, the user can grasp the situation of a person in detail.

  In particular, in the present embodiment, the information providing unit 35 generates screen data in which a current position of a person existing in the section is displayed as an avatar (an image representing the person) on the layout drawing of the section such as a living room or a meeting room. Display on the smartphone 5. At this time, the information providing unit 35 obtains the current position of the person in the room from the presence information and generates screen data. Further, in the present embodiment, when the section to be displayed is a room such as a living room or a conference room, a layout drawing of the room in which a desk installed in the room is described is created. This room layout can be generated by acquiring room coordinates from the business establishment map database 44 and by acquiring seat coordinates from the seat database 45. Of course, it is also possible to prepare drawings and photographs such as floor plan of each room, desk layout, etc. in advance and display the acquired coordinates in a superimposed manner.

  Further, the information providing unit 35 of the presence management device 2 acquires the telephone number of the person to be displayed on the smartphone 5 from the telephone database 55 and provides it to the smartphone 5. This saves the user from having to look up the phone number.

  In the present embodiment, the screen display and the screen operation are controlled based on the screen data transmitted from the presence management device 2 by the application installed in the smartphone 5. At this time, by selecting (touching) a person displayed on the screen using the touch panel display, information on the person (attribute information and telephone number) is extracted, and the person's attribute information is displayed on the screen, or the telephone number is displayed. Based on the call processing.

  Next, a specific operation of the smartphone 5 in accordance with the content of the call request will be described.

  First, the call partner designation mode will be described. This call partner designation mode is used when calling a specific person.

  Conventionally, when making a call to a specific person, the person in the office calls the room of the other person, but if the other person is absent on a vacation or business trip, another person takes over. Answering a call will waste your call. Further, although it is possible to make a call to a portable telephone terminal device possessed by a person who is a partner, there is a problem that, for example, if a person is in a meeting in a conference room, the person is inconvenienced.

  In order to deal with such a problem, in the present embodiment, presence information of the designated person is displayed on the smartphone 5 in a call partner designation mode in which a person who is a call partner is designated on the smartphone 5 as described below. It is like that.

  FIG. 26 is an explanatory diagram showing a display screen of the smartphone 5 in the call partner designation mode. FIG. 27 is a flowchart showing the operation procedure of each part in the call partner designation mode shown in FIG.

  First, on the smartphone 5, when the user inputs the other party to call (ST151), as shown in FIG. 26A, a button for displaying presence information together with the person ID of the designated person is displayed on the screen. When this button is operated to display presence information (ST152), the designated partner person ID is transmitted to the presence management apparatus 2.

  The presence management device 2 first searches the person attribute database 53 using the name of the person designated by the smartphone 5 to obtain the person ID. Next, presence information shown in FIG. 7 is searched using this person ID, and position information is read (ST251). Next, a person ID belonging to the same position coordinate is searched from the presence information to extract a person who is in the same room as the designated person (ST252).

  On the other hand, when the presence information is used only as a view in order to reduce the access load of the database (that is, when the presence information is not updated in real time), the presence management device 2 first searches the person attribute database 53. The object database 43 is searched using the obtained person ID. Then, the current location is acquired from the object database 43 using the hit object ID as a key (see FIG. 9), and the establishment map database 44 is accessed using the acquired current location as a key to construct presence information for each of the large and small categories. To do. Next, the object database 43 is searched based on the current position acquired by the above-mentioned process, and the person who is in the same room as the designated person (when there are a plurality of persons corresponding to the same object, the probability is the highest) (Person) is extracted (ST252). And the screen data which displayed the present position of the person by the avatar on the layout drawing of a room are produced | generated, and it transmits to the smart phone 5 (ST253). At this time, if the designated person is not in his / her room, the schedule of the designated person is acquired from the person schedule database 50 and screen data is generated so that the schedule is also displayed on the screen.

  In the smartphone 5, based on the screen data received from the presence management device 2, as shown in FIGS. 26 (B) and (C), a screen in which the current position of the person in the room on the layout plan is displayed as an avatar. Is displayed (ST153). FIG. 26B shows a case where the designated person is in the conference room, and FIG. 26C shows a case where the designated person is in his / her own room. Thereby, the user can know in which room the designated person is located.

  In addition, as shown in FIG. 26B, when the designated person is in a room different from his / her own room, a room display for displaying the occupancy status of the other person in the person's room is displayed. A button is displayed. In addition, this screen displays the schedule of the designated person, here the scheduled end time of the meeting.

  Here, as shown in FIG. 26C, when the designated person A is present in his / her room, there is no problem in making a call to the person A. In this case (ST154) Yes), the person A's avatar is operated to select the person A as the call partner (ST155). Thereby, a transmission process is performed to person A's smartphone 5 (ST156).

  On the other hand, as shown in FIG. 26B, if the designated person A is in a meeting, there is a problem in making a call to the person A. Sees the scheduled end time of the conference displayed on the screen and makes a call after the conference ends. Further, if it is a message that can be answered by another person in the same department even if it is not the designated person A (No in ST154), the room display button is operated by operating the room display button as shown in FIG. (ST157).

  The presence management device 2 searches for the room of the person A in the seat database 45, the person attribute database 53, etc. in response to an instruction to display the room on the smartphone 5 (ST254), and the occupancy status of another person in the room Is acquired from the presence information (ST255), and screen data in which the current position of the person is displayed as an avatar on the layout diagram of the room is generated and transmitted to the smartphone 5 (ST256).

  On the other hand, when the presence information is used only as a view, the presence management device 2 searches the person attribute database 53 by name and acquires the department code to which the person A belongs. Then, the department map database 44 is searched using the department code to obtain a combination of x, y, and z coordinates associated with the department code (since the room has a considerable size, these coordinates are Multiple sets are detected). By searching the object database 43 using these coordinates, a person ID existing in a space indicated by a plurality of coordinate sets may be acquired, and image data for displaying an avatar together with the coordinates may be generated.

  On the smartphone 5, based on the screen data received from the presence management device 2, as shown in FIG. 26E, a screen displaying the current position of the person in the room on the layout diagram of the room of the person A is displayed as an avatar. Is displayed. As a result, the user knows which person is in the room of the person A. For example, when the person B is selected as the other party by operating the avatar of the person B (ST159), the user B is addressed to the smartphone 5 of the person B. Transmission processing is performed (ST156).

  Thus, when the user calls a specific person with the smartphone 5, the presence information of the person designated as the other party of the telephone is displayed on the smartphone 5, and therefore the user may be absent. It is possible to determine in advance whether or not to call a designated person. For this reason, the user can avoid a useless call, and the trouble of making a call again is eliminated. Since another person who is present in the same room as the designated person is displayed, the user only has to select an appropriate person, and convenience is improved. Furthermore, since the schedule of the designated person is displayed, the user can determine when to make a call.

  In addition, since a screen in which the current position of the person in the room is displayed as an avatar is displayed on the layout drawing of the room, it is possible to easily find a person to call from among the persons in the room. Here, the avatar is a simple one in which a name is added to a circle, but an image imitating a person may be displayed.

  By the way, in this system, since a plurality of persons can be set to be duplicated for one object, there may be a plurality of objects corresponding to the person designated as the other party. In this case, first, the location based on the current position of the object assigned with the highest probability is displayed as the first candidate, and the location based on the current position of the object with the low probability is displayed as a candidate for the next rank as necessary. You may be able to.

  In the example shown in FIG. 26, the designated person is in a specific room (conference room or living room). However, in this system, the current position of the moving person can be grasped. Even if the current location of the person is known, the location of the person may not be represented by the name of the specific place, for example, when the person is between the break room and the conference room. In this case, the location of the person is presented in the area, for example, it may be displayed in words or a figure that the designated person is between the break room and the conference room.

  In the example shown in FIG. 26, when the designated person is in the conference room, the scheduled meeting end time is displayed with reference to the person schedule database 50. As described above, the designated person Even when the user is moving and not in a specific room, the person schedule database 50 may be referred to display the schedule of the designated person. For example, if a meeting is registered in the schedule of the designated person, information related to the meeting (time, meeting room, meeting contents, participants, etc.) is displayed. Thereby, the user can grasp in detail the behavior of the designated person by considering the schedule in addition to the location of the designated person. For example, the fact that the designated person is between the break room and the conference room and that there is a schedule for the conference makes it possible to grasp that the designated person is currently moving to the conference room.

  Next, the person search mode will be described. This person search mode is used when making a call by searching for a person who is familiar with a specific message.

  Conventionally, if you do not know a person who is familiar with a specific requirement, you will make a call by selecting an appropriate department related to the requirement. Probability is high. In addition, there is a case where another department is introduced to make a call again. However, if there is no person who is familiar with the requirement, it is necessary to make a call again, which is very troublesome.

  In order to deal with such a problem, in the present embodiment, as described below, the person corresponding to the entered keyword and the presence information thereof are stored in the smartphone 5 in the person search mode for searching for a person who is familiar with the business by keyword. It is displayed.

  FIG. 28 is an explanatory diagram showing a display screen of the smartphone 5 in the person search mode. FIG. 29 is a flowchart showing the operation procedure of each part in the person search mode shown in FIG. Here, an example of making an inquiry to a person familiar with “handling of dangerous goods” will be described.

  First, when the user inputs the keyword “hazardous material handling” on the smartphone 5 (ST171), as shown in FIG. 28A, a button for starting a search together with the input keyword (hazardous material handling) is displayed on the screen. When this search start button is operated to start the search (ST172), the input keyword is transmitted to the presence management device 2.

  The presence management apparatus 2 searches the person attribute database 53 for a person corresponding to the keyword received from the smartphone 5 (ST271), and if a corresponding person is found, reads the presence information of the person (ST272). Then, screen data for displaying the presence information of the person is generated and transmitted to the smartphone 5 (ST273).

  In the smartphone 5, based on the screen data received from the presence management device 2, as shown in FIG. 28 (B), the person ID, name and presence information of the person who is familiar with “handling of dangerous goods” are described. The displayed screen is displayed (ST173). As a result, the user can select an appropriate person by looking at the presence information for each person and, as shown in FIG. 28 (C), by operating the person's button and selecting that person as the call partner ( ST174). Transmission processing is performed for the person's smartphone 5 (ST175).

  In this way, by inputting the keyword of the requirement, a person who is familiar with the requirement is presented, so that it is possible to save the user from having to look up the person. Since the location of the corresponding person is also displayed, it can be determined whether there is any problem in making a call, so that the call is not wasted or troublesome to make a call again.

  Here, the presence information related to the location of the person is displayed in characters together with the name of the person. However, similar to the example shown in FIG. 26, the presence information is displayed as an image, that is, on the partition layout diagram. You may make it display the present position of the person who exists in a division by an avatar. In this case, by selecting a person's name button, the screen may be changed to a screen on which presence information is imaged.

  Next, the department display mode will be described. This department display mode is used when calling a specific department.

  Conventionally, if you know the department related to the business but do not know the person who is familiar with the business, first call the department related to the business, tell the business, and the person who received the call There was a problem in that it was troublesome to relay the phone call by selecting an appropriate person from among them.

  In order to deal with such a problem, in the present embodiment, as will be described below, presence information and person attribute information of a person belonging to the designated department are stored in the department designation mode for designating the department for which the smartphone 5 inquires about the business. It is displayed on the smartphone 5.

  FIG. 30 is an explanatory diagram showing a display screen of the smartphone 5 in the department designation mode. FIG. 31 is a flowchart showing the operation procedure of each part in the department designation mode shown in FIG. Here, an example of making an inquiry to personnel regarding attendance management will be described.

  First, in the smart phone 5, when the name of the room (personnel room) of the department to be inquired is input from the menu of the room display (ST181), as shown in FIG. A button for displaying the person's occupancy status is displayed, and when the occupancy display is instructed by operating the occupancy display button (ST182), information on the occupancy of the designated department is transmitted to the presence management device 2.

  The presence management apparatus 2 searches the office map database 44 for a room for personnel (ST281), and reads presence information of a person belonging to personnel (ST282). And the screen data which displayed the current position of the person who is occupying the room layout of the personnel room by the avatar are generated and transmitted to the smartphone 5 (ST283).

  On the smartphone 5, based on the screen data received from the presence management device 2, as shown in FIG. 30B, a screen displaying the current position of the person in the room on the personnel room layout diagram is displayed. (ST183). Here, as shown in FIGS. 30C and 30D, when a person's avatar is selected (ST184), the person ID of the selected person is transmitted to the presence management apparatus 2.

  The presence management device 2 reads the person attribute information of the corresponding person from the person attribute database 53 based on the person ID received from the smartphone 5 (ST284), and transmits the person attribute information to the smartphone 5 (ST285).

  On the smartphone 5, as shown in FIGS. 30C and 30D, the name and attribute of the person, that is, information such as the field in charge and qualification is displayed hop-up (ST185), and the user inquires about the business. Choose the best person. In this example, since person L is in charge of attendance management, as shown in FIG. 30E, when the call start button displayed when the avatar of person L is selected (ST186), Transmission processing is performed for the L smartphone 5 (ST187).

  In this way, when the user calls a department related to the business, the presence information and attribute information of the person belonging to the department is displayed on the smartphone 5, so that the user You can know if a person is in the room. Thus, the user only has to select a person who is familiar with the requirement and is present in the room, and can save the trouble of having another person take the call.

  FIG. 32 is an explanatory diagram illustrating another example of the display screen of the smartphone 5. This is a screen on which a person's occupancy status is displayed on the room layout. In the examples shown in FIGS. 26 and 30, only the persons who are present in the room of the department are displayed on the screen. However, here, all the persons belonging to the department are displayed, and each person is present or absent. , Vacation, and business trip are displayed in an identifiable manner. In particular, here, buttons for selecting a person are displayed in different colors. Also in this example, as in the example shown in FIGS. 26 and 30, when a person is selected as shown in FIG. 32B, outgoing processing is performed for the person's smartphone 5.

  In the present embodiment, an example in which presence information is provided from the presence management device 2 to the smartphone 5 has been described in detail. However, the presence information provided by the presence management device 2 is limited to such a telephone terminal device. Instead, presence information may be provided from the presence management apparatus 2 to the PC 6 and displayed on the display of the PC 6.

  In this embodiment, the database is constructed and stored in the storage device 3 different from the information providing source necessary for the presence management device 2 to generate presence information and the like. You may make it acquire necessary information from the beginning suitably. Note that if the information is stored in the storage device 3 different from the information provider, the information provider may spontaneously send predetermined information regardless of the request from the presence management device 2, Control when the number of information providers increases can be simplified.

  Further, in the present embodiment, presence information related to the location of a person is imaged and displayed, that is, the current position of a person existing in the section is displayed on the section layout by an avatar. It is also possible to display only with characters. It is also possible to directly use the image captured by the camera 21 and display necessary information such as the person's name at the position of the person image in the captured image.

  In the present embodiment, the image captured by the camera 21 is used only for tracking an object. However, a person may be identified from the captured image using a face recognition technique or the like. In this case, since the accuracy of person identification is not so high, the identification result of the person is used as an auxiliary, and if the probability of identity is high from the identification result of the person, the probability of the person set in the object is increased. Good.

  Further, in this embodiment, an example in which the monitoring system that acquires presence information related to the location of a person is applied to a telephone system that provides presence information to a telephone terminal device has been described. However, the monitoring system according to the present invention is not limited to this. , A system for watching children on and going to school, a system for grasping the location of a person when a disaster such as an earthquake occurs, and an object that cannot set a specific person (employee) Or it can apply to the system etc. which judge and monitor as a suspicious person.

  The monitoring system and the telephone system according to the present invention have the effect that the processing load is small and can accurately grasp the location of the person, and the monitoring system that acquires the presence information regarding the location of the person, and the monitoring system This is useful as a telephone system that provides the telephone terminal device with the presence information acquired in (1).

1 Object Tracking Device 2 Presence Management Device 3 Storage Device 4 Card Reader (Personal Authentication Means)
5 Smartphone (user terminal device, telephone terminal device)
6 PC (user terminal equipment)
11 Exit / Exit Management System 12 Entrance / Exit Management System 13 Office Equipment Management System 14 Meeting Room Reservation System 15 Business Trip Application System 16 Attendance Management System 17 Personal Schedule Management System 21 Camera (Imaging Means)
22 Tracking part (tracking means)
31 Object management section (object management means)
32 Presence information acquisition unit (presence information acquisition means)
33 Feature extraction unit (feature extraction means)
34 Search part (search means)
35 Information provision section (information provision means)
41 Presence information storage unit (storage means)
42-55 database (storage means)

Claims (18)

Imaging means installed in the monitored space;
Tracking means for tracking an object recognized as a person from a captured image in the imaging means;
Personal authentication means installed in the monitored space;
An object management means for setting a specific person who has received personal authentication by the personal authentication means to an object tracked by the tracking means;
Presence information acquisition means for creating presence information on the location of the person from the current position of the object tracked by the tracking means and the person set in the object by the object management means ,
When an event occurs that causes object confusion during the tracking process, the object management unit sets a plurality of persons in duplicate in one object, and gives a probability of representing the probability of being an individual to each of the plurality of persons. And the probability is changed according to an event that has occurred during the tracking process . It further comprises storage means for storing information regarding the schedule for each person,
The object management means acquires the schedule of the person set for the object from the storage means, compares the schedule of the person with the current position of the object, and sets the person for the object based on the consistency between the two. The monitoring system according to claim 1 , wherein the monitoring system is changed. Feature extraction means for acquiring behavior feature information representing features related to past behavior for each person;
Storage means for storing behavior feature information for each person acquired by the feature extraction means,
The object management means acquires the behavior feature information of the person set for the object from the storage means, compares the behavior feature information of the person with the current behavior of the object, and based on the consistency between the two monitoring system according to claim 1 or claim 2, characterized in that to change the person setting for the object Te. Feature extraction means for acquiring presence location feature information representing features related to past locations for each person;
Storage means for storing presence position feature information for each person acquired by the feature extraction means,
The object management means acquires the presence position feature information of the person set for the object from the storage means, compares the presence position feature information of the person with the current position of the object, and matches the consistency between the two. 4. The monitoring system according to claim 1, wherein a person setting for the object is changed based on the object. When the object management means detects that a phenomenon occurs in which the objects being tracked are confused with each other, the object management means sets the person set for one object as the other object and the original person set for each object. The monitoring system according to claim 1 , wherein the probability is lowered. 2. The object management unit according to claim 1 , wherein when the event that the object being tracked temporarily passes through the blind spot of the imaging unit is detected, the probability of the person set as the object is lowered. The monitoring system described. When the object management means detects that the object being tracked enters a section where the imaging means is not installed, the object management means interrupts tracking of the object, and then detects an object that has come out of the section, The monitoring system according to claim 1 , wherein a person who has been set as an object that has entered the section is set as the object. It further comprises storage means for storing the seat position for each person,
When the object management means detects that the object being tracked is seated in a seat, the object management means acquires the person set in the seat from the storage means, compares the person and the person set in the object, The monitoring system according to claim 1 , wherein if both match, the probability of the person is increased. A user terminal device assigned to each user;
Storage means for storing presence information acquired by the presence information acquisition means;
9. The monitoring system according to claim 1, further comprising information providing means for acquiring the presence information from the storage means and providing the presence information to the user terminal device. A storage unit that stores a plurality of sections obtained by dividing the monitoring target space in association with coordinates set in the monitoring target space;
The presence information acquisition means acquires a section corresponding to coordinates indicating the current position of the object from the storage means,
The monitoring system according to claim 9 , wherein the information providing unit provides the user terminal device with the section name acquired by the presence information acquiring unit as a person's location. The monitoring system according to claim 10 , wherein the partition is divided in stages at a plurality of division levels. The user terminal device includes a display unit that displays an image,
The information providing unit generates screen data displaying a current position of a person existing in the section on an image representing the section and sends the screen data to the user terminal device. The user terminal device receives the information from the information providing unit. The monitoring system according to claim 9 , wherein an image based on the screen data is displayed on the display unit. The personal authentication means is a card reader provided in conjunction with at least one of an entry / exit management system, an office equipment management system, and an entrance / exit management system, and reads a card for identifying a person. The monitoring system according to any one of claims 1 to 12 . A monitoring system according to any one of claims 1 to 8 ,
Storage means for storing presence information acquired by the presence information acquisition means;
A telephone terminal assigned to each user;
A telephone system comprising: information providing means for obtaining presence information relating to a person's location from the storage means and providing the telephone terminal device with the presence information when a user makes a call with the telephone terminal device. It further comprises storage means for storing information regarding the schedule for each person,
15. The telephone system according to claim 14 , wherein the information providing unit obtains information related to a person's schedule from the storage unit and provides the information to the telephone terminal device. The telephone system according to claim 14 , wherein the information providing unit provides the telephone terminal device with information related to a person's occupancy status in a person designated by the user or a department room in the telephone terminal device. Storage means for storing information on attributes for each person;
17. The telephone system according to claim 16 , wherein the information providing unit obtains information relating to a person attribute from the storage unit and provides the information to the telephone terminal device. Storage means for storing information on attributes for each person;
A search unit that searches the storage unit for a person whose attribute corresponds to the keyword input by the user in the telephone terminal device;
15. The telephone system according to claim 14 , wherein the information providing unit provides the telephone terminal device with information related to the person acquired by the search unit.

Images