JP2007082197A - Monitoring system and its method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a monitoring system which can save time and effort of judgement by a user itself in the case that an investigation of person is conducted, and provide its method. <P>SOLUTION: When a user wants to know an information of a person's presence under monitor of a camera portion (4), if a request of presence information is inputted into a request source terminal (1), the request of presence information is transmitted to a camera connection terminal (3) via network (2) from the request source terminal (1). The camera connection terminal (3) is provided with a presence distinction processing portion (32) which distinguishes presence information of presence/vacancy, under meeting, on the telephone, and meeting reject from pictures photoed by the camera portion (4). If request receiver (31) receives the request of presence information, the presence information distinguished by the presence distinction processing portion (32) is transmitted from a result output portion (33) to the request source terminal (1) via the network (2), and the presence information is informed to the user. Moreover, when the presence information distinguished by the presence distinction processing portion (32) changed from before, presence information is newly transmitted from the result output portion (33), and a change of the presence information is informed to the user. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an attendance monitoring system and a method thereof, and more particularly, to an attendance monitoring system and a method thereof that can save time and effort for a user himself / herself when conducting a person survey.

  With the development of networks such as the Internet and Intranet and image coding technology, camera images can be viewed at remote locations, and network cameras that transmit live video to a terminal over the network are being commercialized.

  For example, the camera AXIS2100 (product model number: 0106-1) manufactured by Axis Communications Co., Ltd. can display a camera image on a browser via a network using an image encoding technique defined by JPEG (Joint Photographic Coding Experts Group). Network camera. The JPEG standard is defined by ISO / IEC (International Organization for Standardization / International Electrotechnical Commission) 10918. As an application using this network camera, application to human presence confirmation is increasing in recent years. As the person presence confirmation, for example, grasping the crowded situation of customers in the store, confirmation of the presence / absence of employees and labor management in the office, etc. are important techniques for confirming the person presence.

  As a conventional technique for confirming the presence of a person, FIG. 18 shows an image display system on the Web (World Wide Web). As shown in FIG. 18, the conventional image display system on the Web includes a PC terminal 91 owned by a user who is an image request destination, a network camera 92, the Internet, and a network 2 including an intranet.

  The network 2 connects the PC terminal 91 and the network camera 92 to each other. The user designates an IP (Internet Protocol) address of the network camera 92 on the browser of the PC terminal 91 in order to request an image. The network camera 92 captures an image with a designated IP address, uses the obtained image as image data, JPEG-compresses the image data, and uses the compressed image data as JPEG image data via the network 2 on the PC terminal 91. Send to. The PC terminal 91 receives the JPEG image data and displays it on the browser as an image requested by the user. By using this image display system on the Web, it is possible to confirm the presence of a remote person.

  Japanese Patent Application Laid-Open No. 2000-78276 automatically grasps the presence / absence status of the other party who made the call, responds with an absence message, and informs the sender of the presence / absence of the receiver. A “seating management system, occupancy management method, and storage medium” that makes it easy to recognize a seat at low cost is disclosed.

  This presence management system is a computer device having a camera, communication means, means for monitoring input information from the camera, and means for determining the presence / absence state of a person included in the input information. The present invention is characterized by comprising means for changing a telephone response according to the determination result of presence / absence.

  Japanese Patent Laid-Open No. 8-55288 discloses a “monitoring system” that can reliably determine the presence or absence of an obstacle in any environment in a monitoring system that detects the presence / absence of an object with respect to a background based on image information. ing.

  This monitoring system is a monitoring system that detects presence / absence of an object with respect to a background based on image information, a pattern forming unit for forming a pattern on the background, an imaging unit for inputting a background image, and an object with respect to the background. A background image storage means for storing a background image when it does not exist, a pattern comparison means for comparing a current image input from the imaging means with a background image stored in the background image storage means, and a pattern comparison means And determining means for determining whether or not an object exists from the output.

  Japanese Patent Application Laid-Open No. 8-249545 discloses a “communication support system” that makes it easy to capture opportunities for more reliable communication based on the presence state of a communication partner in a communication system.

  This communication support system is configured by a network connecting a plurality of communication terminals and a plurality of communication terminals that can use video or audio or video and audio. In each of the plurality of communication terminals, identification means for identifying whether the user is present, and other communication that has made a request to send presence information when a change from absence to presence is detected by the identification result of the identification means Means for transmitting presence information of the user of the communication terminal to the terminal, and viewing angle information or auditory information based on presence information transmitted from another communication terminal by requesting transmission of presence information from the communication terminal And means for expressing the presence in the form of.

  In Japanese Patent Publication No. 7-105844, there is known a “vacant seat notification system” that prevents the user from forgetting to operate by not having to perform the absentee registration / cancellation operation from the terminal accommodated in the exchange. Yes.

  This absentee notification method includes a lighting switch monitoring device for monitoring whether a lighting switch for turning on / off a lighting device on a floor where a called terminal is installed is on or off, and each lighting switch in a telephone switchboard, A lighting memory that stores the telephone number of each called terminal in association with each other, and searches for the lighting memory when an incoming call arrives at the terminal, selects a lighting switch that corresponds to the telephone number of the terminal, and selects the selected lighting switch. Identifying means for identifying whether or not the lighting switch is lit, and a connecting means for connecting the calling terminal and the absentee notification device when the identifying means identifies that the lighting switch is extinguished It is characterized by comprising.

JP 2000-78276 A JP-A-8-55288 JP-A-8-249545 Japanese Patent Publication No. 7-105844

  By the way, according to the above-described conventional technology, there is no notification function of person presence information indicating the presence of a person. For this reason, when the person to be investigated is vacant, in order for the user to know the person's return, the image must be displayed frequently and the user himself / herself must determine the presence / vacancy state from the display image. As a result, the user takes time and labor to check the existence of the person.

  In addition, according to the conventional technology described above, there is no function for notifying behavior state information indicating the state of behavior of a person. For this reason, when the person who wants to investigate is taking an action that cannot be seen (for example, during a meeting), the above-mentioned notification function of the presence / vacancy state of the person is not sufficient, In order for the user to know the state of the person's action, the image must be displayed frequently and the user himself / herself must determine the state of the person's action from the display image. As a result, the user takes time and labor to check the state of the person's action.

Further, according to the above-described conventional technology, since the image is directly presented, there is a risk of infringing on the privacy of the subject.
Furthermore, according to the above-described conventional technology, only the current state of the person is displayed as an image, and the state is not statistically processed. For this reason, it cannot be used for store management or employee management.

  An object of the present invention is to provide an attendance monitoring system and a method thereof that can save the user from having to make a judgment by himself / herself when investigating a person.

  Another object of the present invention is to provide an attendance monitoring system and method that can save the user from having to judge the presence / absence from the display image.

  Still another object of the present invention is to provide an attended monitoring system and method that can save the user from having to determine the behavior state of a person from a display image.

  It is still another object of the present invention to provide a presence monitoring system and method that can prevent the risk of privacy violation.

  Still another object of the present invention is to provide an attendance monitoring system and method that can be used for management of stores and employees.

  Hereinafter, means for solving the problem will be described using the numbers and symbols used in [Best Mode for Carrying Out the Invention]. These numbers and symbols are added to clarify the correspondence between the description of [Claims] and the description of [Best Mode for Carrying Out the Invention]. It should not be used to interpret the technical scope of the invention described in “

  An attendance monitoring system according to the present invention includes a network (2), a camera unit (4) that captures a predetermined area as a first image, a camera connection terminal (3) connected to the camera unit (4), A request source terminal (1) that generates survey information for investigating the presence or absence of a subject in the area of (2) and transmits the survey information to the camera connection terminal (3) via the network (2). The camera connection terminal (3) determines the presence / absence of the subject in the predetermined area based on the first image captured at the first time point in response to the reception of the survey information, and results information indicating the determination result Is transmitted to the request source terminal (1) via the network (2).

  An attendance monitoring system according to the present invention includes a network (2), a camera unit (4) that captures a predetermined area as a first image, a camera connection terminal (3) connected to the camera unit (4), A request source terminal (1) that generates survey information for investigating the presence or absence of a subject in the area of (2) and transmits the survey information to the camera connection terminal (3) via the network (2). The camera connection terminal (3) receives the subject in a predetermined area based on the first image captured at the first time point in response to the reception of the survey information and the second image at a time point different from the first time point. The result information indicating the determination result is transmitted to the request source terminal (1) via the network (2).

  An attendance monitoring system according to the present invention includes a network (2), a camera unit (4) that captures a predetermined area as a first image, a camera connection terminal (3) connected to the camera unit (4), A request source terminal (1) that generates survey information for investigating the presence or absence of a subject in the area of (2) and transmits the survey information to the camera connection terminal (3) via the network (2). The camera connection terminal (3) is predetermined based on the first image taken at the first time point in response to the reception of the survey information and the second image corresponding to a predetermined region at a time point different from the first time point. The presence / absence of the subject in the area is determined, and result information indicating the determination result is transmitted to the request source terminal (1) via the network (2).

  The presence monitoring system according to the present invention includes a network (2), a server (5), a camera unit (4) that captures a predetermined area as a first image, and a camera connection terminal connected to the camera unit (4). (3) and a request source terminal (1) that generates survey information for investigating the existence of a subject in a predetermined area and transmits the survey information to the camera connection terminal (3) via the network (2). Including. The camera connection terminal (3) receives the subject in a predetermined area based on the first image captured at the first time point in response to the reception of the survey information and the second image at a time point different from the first time point. The result information indicating the determination result is transmitted to the server (5) via the network (2). The request source terminal (1) retrieves the result information from the server (5) via the network (2).

  The presence monitoring system according to the present invention includes a network (2), a server (5), a camera unit (4) that captures a predetermined area as a first image, and a camera connection terminal connected to the camera unit (4). (3) and a request source terminal (1) that generates survey information for investigating the existence of a subject in a predetermined area and transmits the survey information to the camera connection terminal (3) via the network (2). Including. The camera connection terminal (3) is predetermined based on the first image taken at the first time point in response to the reception of the survey information and the second image corresponding to a predetermined region at a time point different from the first time point. The presence / absence of the subject in the area is determined, and result information indicating the determination result is transmitted to the server (5) via the network (2). The request source terminal (1) retrieves the result information from the server (5) via the network (2).

  The server (5) receives the result information from the camera connection terminal (3) at a specific time, and updates the result information received before the specific time to the result information received at the specific time. Alternatively, the server (5) receives the result information from the camera connection terminal (3) and accumulates the received result information. The camera connection terminal (3) transmits the result information in one form of website data and e-mail.

  In addition, the camera connection terminal (3) has a request input unit (31) for receiving survey information, and a predetermined input based on the first image and the second image in response to reception of the survey information of the request input unit (31). The presence / absence determination processing unit (32) for generating the result information indicating the determination result and the result information generated by the presence determination processing unit (32) are determined. And an output unit (33).

  The presence determination processing unit (32) includes an image storage unit (32a) that stores a second image taken before the first time point. The presence determination processing unit (32) stores the first luminance of the first image captured at the first time point in response to the reception of the survey information from the request input unit (31) and the image storage unit (32a). Based on the luminance difference from the second luminance of the second image thus determined, the presence / absence of the subject in a predetermined area is determined, and result information indicating the determination result is generated.

  The result output unit (33) includes a first result information storage unit (33a) for storing result information. The result output unit (33) compares the result information generated by the presence determination processing unit (32) with the result information stored in the first result information storage unit (33a), and based on the comparison result. The result information generated by the presence determination processing unit (32) is transmitted.

  The camera connection terminal (3) is stored in the second result information storage unit (6) for storing the result information generated by the presence determination processing unit (32) and the second result information storage unit (6). A statistical information calculation unit (7) that calculates statistical information indicating the statistics of the determination result based on the result information and generates result information including the statistical information.

  The presence monitoring system according to the present invention inputs a network (2), a camera unit (4) that captures a predetermined area as a first image, and survey information for investigating the presence or absence of a subject in the predetermined area. And a request source terminal (1) that receives the first image from the camera unit (4) via the network (2). The request source terminal (1) determines the presence / absence of the subject in the predetermined area based on the first image captured at the first time point in response to the input of the survey information, and results information indicating the determination result Is output.

  The presence monitoring system according to the present invention inputs a network (2), a camera unit (4) that captures a predetermined area as a first image, and survey information for investigating the presence or absence of a subject in the predetermined area. And a request source terminal (1) that receives the first image from the camera unit (4) via the network (2). The request source terminal (1) receives the subject in a predetermined area based on the first image captured at the first time point in response to the input of the survey information and the second image at a time point different from the first time point. The result information indicating the result of the determination is output.

  The presence monitoring system according to the present invention inputs a network (2), a camera unit (4) that captures a predetermined area as a first image, and survey information for investigating the presence or absence of a subject in the predetermined area. And a request source terminal (1) that receives the first image from the camera unit (4) via the network (2). The request source terminal (1) is predetermined based on the first image taken at the first time point in response to the input of the survey information and the second image corresponding to a predetermined region at a time point different from the first time point. The presence / absence of the subject in this area is determined, and result information indicating the determination result is output.

  Further, the request source terminal (1) is predetermined based on the request input unit (11) for inputting the survey information and the first image and the second image in response to the input of the survey information of the request input unit (11). The presence / absence determination processing unit (12) that generates the result information indicating the determination result and the result information generated by the presence determination processing unit (12) are determined. And an output unit (13).

  The presence determination processing unit (12) includes an image storage unit (12a) that stores a second image taken before the first time point. The presence determination processing unit (12) stores the first luminance of the first image taken at the first time point in response to the input of the survey information of the request input unit (11) and the image storage unit (12a). Based on the luminance difference from the second luminance of the second image thus determined, the presence / absence of the subject in a predetermined area is determined, and result information indicating the determination result is generated.

  The result output unit (13) includes a first result information storage unit (33a) for storing result information. The result output unit (13) compares the result information generated by the presence determination processing unit (12) with the result information stored in the first result information storage unit (13a), and based on the comparison result. The result information generated by the presence determination processing unit (32) is transmitted.

  The request source terminal (1) is stored in the second result information storage unit (6) for storing the result information generated by the presence determination processing unit (12) and the second result information storage unit (6). A statistical information calculation unit (7) that calculates statistical information indicating the statistics of the determination result based on the result information and generates result information including the statistical information.

  The result information is information on at least one of a seated state and a vacant seat state of the subject.

  The result information includes at least one of a subject's presence status, a subject's vacancy status, a subject's conference status, a subject's phone status, and a subject's visit refusal status. Information.

  The result information includes at least one of a state where electricity is turned on by the subject, a state where electricity is turned off by the subject, a state where the door is opened by the subject, and a state where the door is closed by the subject. Is one piece of information.

  Based on the first image taken at the first time point and the time when the first image was taken at the first time point, the presence determination processing unit (12, 32) Result information corresponding to at least one of the state, the state of the subject's vacant seat, the presence region where the subject is present in the predetermined region, and the position of the subject is generated.

  The statistical information calculation unit (7) is at least one of a state where the subject is present, a state where the subject is vacant, a region where the subject is present in a predetermined region, and the position of the subject. Statistical information corresponding to at least one of the attendance rate by the subject, the vacancy rate by the subject, the degree of congestion by the subject, and the crowded location by the subject is calculated based on the result information corresponding to To do.

  The statistical information calculation unit (7) calculates a value corresponding to a luminance difference between the first luminance of the first image captured at the first time point and the second luminance of the stored second image, and a predetermined threshold value. Based on the result of the determination, the ratio of the existing area where the subject is present in the predetermined area is calculated as the degree of congestion.

  The presence determination processing unit (12, 32) divides each block into a plurality of blocks such that the first image and the second image correspond to each other, and the first block among the plurality of blocks of the divided first image. A predetermined region based on a block luminance difference between the third luminance of the first image corresponding to the second luminance and the fourth luminance of the second image corresponding to the first block among the plurality of blocks of the divided second image The existence area where the subject is present is generated as result information. The statistical information calculation unit (7) determines the block luminance difference and the predetermined threshold, and calculates the ratio of the existing area where the subject is present in the predetermined area as a crowded place based on the determination result.

  The presence monitoring method according to the present invention includes: (a) capturing a predetermined area as a first image; (b) receiving survey information for investigating the presence / absence of a subject in the predetermined area; (C) The presence / absence of the subject in the predetermined area is determined based on the first image captured at the first time point in response to the reception of the survey information and the second image at a time point different from the first time point. A step, (d) generating result information indicating a discrimination result, and (e) transmitting the generated result information.

  The presence monitoring method according to the present invention further includes (f) storing a second image taken before the first time point.

  The presence monitoring method according to the present invention includes (g) a step of storing result information, (h) result information generated in step (d), and result information stored in step (g). And (i) performing the step (e) based on the result of the comparison.

  The presence monitoring method according to the present invention includes: (j) a step of calculating statistical information indicating statistics of a result of determination based on the result information stored in step (g); and (k) a result including statistical information. Generating information.

  The second image corresponds to a predetermined area. The step (c) is based on the first image taken at the first time point in response to receiving the survey information and the second image corresponding to the predetermined region at a time point different from the first time point. The presence / absence of the subject in the area is determined.

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (31) that receives survey information for investigating the presence or absence of a subject in the predetermined area. And the presence of the subject in the predetermined area based on the first image taken by the camera unit (4) at the first time point in response to the reception of the survey information of the request input unit (31). The presence determination processing unit (32) that generates result information indicating the determination result, and the result output unit (33) that transmits the result information generated by the presence determination processing unit (32) via the network (2). ).

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (31) that receives survey information for investigating the presence or absence of a subject in the predetermined area. ), The first image taken by the camera unit (4) at the first time point in response to the reception of the survey information of the request input unit (31), and the second image at a time point different from the first time point The presence determination processing unit (32) for determining the presence or absence of the subject in the predetermined area and generating result information indicating the determination result, and the result information generated by the presence determination processing unit (32) And a result output unit (33) for transmitting via (2).

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (31) that receives survey information for investigating the presence or absence of a subject in the predetermined area. ) And the first image captured by the camera unit (4) at the first time point in response to the reception of the survey information of the request input unit (31), and a predetermined region at a time point different from the first time point Based on the second image, the presence determination processing unit (32) that determines presence / absence of a subject in a predetermined area and generates result information indicating the determination result, and the presence determination processing unit (32) A result output unit (33) for transmitting the obtained result information via the network (2).

  In addition, the presence determination processing unit (32) includes an image storage unit (32a) that stores a second image taken before the first time point. The presence determination processing unit (32) stores the first luminance of the first image captured at the first time point in response to the reception of the survey information from the request input unit (31) and the image storage unit (32a). Based on the luminance difference from the second luminance of the second image thus determined, the presence / absence of the subject in a predetermined area is determined, and result information indicating the determination result is generated.

  The result output unit (33) includes a first result information storage unit (33a) that stores result information. The result output unit (33) compares the result information generated by the presence determination processing unit (32) with the result information stored in the first result information storage unit (33a), and based on the comparison result. The result information generated by the presence determination processing unit (32) is transmitted.

  The presence monitoring apparatus according to the present invention further stores the result information generated by the presence determination processing unit (32) in the second result information storage unit (6) and the second result information storage unit (6). A statistical information calculation unit (7) that calculates statistical information indicating the statistics of the determination result based on the obtained result information, and generates result information including the statistical information.

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (11) that inputs survey information for investigating the presence or absence of a subject in the predetermined area. ), A presence determination processing unit (12) that receives the first image from the camera unit (4) via the network (2), and a result of outputting the result information generated by the presence determination processing unit (12) And an output unit (13). The presence determination processing unit (12) responds to the input of the survey information from the request input unit (11), based on the first image photographed by the camera unit (4) at the first time point, The presence / absence of the photographer is determined, and result information indicating the determination result is generated.

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (11) that inputs survey information for investigating the presence or absence of a subject in the predetermined area. ), A presence determination processing unit (12) that receives the first image from the camera unit (4) via the network (2), and a result of outputting the result information generated by the presence determination processing unit (12) And an output unit (13). The presence determination processing unit (12) responds to the input of the survey information of the request input unit (11), and the first image captured by the camera unit (4) at the first time point is different from the first time point. The presence / absence of the subject in a predetermined area is determined based on the second image, and result information indicating the determination result is generated.

  The presence monitoring apparatus according to the present invention includes a camera unit (4) that captures a predetermined area as a first image, and a request input unit (11) that inputs survey information for investigating the presence or absence of a subject in the predetermined area. ), A presence determination processing unit (12) that receives the first image from the camera unit (4) via the network (2), and a result of outputting the result information generated by the presence determination processing unit (12) And an output unit (13). The presence determination processing unit (12) responds to the input of the survey information of the request input unit (11), and the first image captured by the camera unit (4) at the first time point is different from the first time point. The presence / absence of the subject in the predetermined area is determined based on the second image corresponding to the predetermined area, and result information indicating the determination result is generated.

  The presence determination processing unit (12) includes an image storage unit (12a) that stores a second image taken before the first time point. The presence determination processing unit (12) stores the first luminance of the first image taken at the first time point in response to the input of the survey information of the request input unit (11) and the image storage unit (12a). Based on the luminance difference from the second luminance of the second image thus determined, the presence / absence of the subject in a predetermined area is determined, and result information indicating the determination result is generated.

  The result output unit (13) includes a first result information storage unit (33a) for storing result information. The result output unit (13) compares the result information generated by the presence determination processing unit (12) with the result information stored in the first result information storage unit (13a), and based on the comparison result. The result information generated by the presence determination processing unit (32) is transmitted.

  The presence monitoring apparatus according to the present invention further stores the result information generated by the presence determination processing unit (12) in the second result information storage unit (6) and the second result information storage unit (6). A statistical information calculation unit (7) that calculates statistical information indicating the statistics of the determination result based on the obtained result information, and generates result information including the statistical information.

  The presence monitoring server according to the present invention is connected to a camera unit (4) that captures a predetermined area as a first image and a request source terminal (1) via a network (2), and is to be imaged in the predetermined area. Receiving means (51) for receiving investigation information for investigating the presence or absence of a person, and a first photographed by the camera unit (4) at a first time point in response to reception of investigation information by the receiving means (51) Based on the image, presence / absence determination means (52) for determining the presence / absence of a subject in a predetermined area and generating result information indicating the determination result, and result information generated by the presence determination means (32) Transmission means (53) for transmitting via the network (2).

  The presence monitoring server according to the present invention is connected to a camera unit (4) that captures a predetermined area as a first image and a request source terminal (1) via a network (2), and is to be imaged in the predetermined area. Receiving means (51) for receiving investigation information for investigating the presence or absence of a person, and a first photographed by the camera unit (4) at a first time point in response to reception of investigation information by the receiving means (51) Presence determination means (52) for determining the presence or absence of a subject in a predetermined area based on the image and a second image at a time point different from the first time point, and generating result information indicating the result of the determination; Transmission means (53) for transmitting the result information generated by the seat discrimination means (32) via the network (2).

  The presence monitoring server according to the present invention is connected to a camera unit (4) that captures a predetermined area as a first image and a request source terminal (1) via a network (2), and is to be imaged in the predetermined area. Receiving means (51) for receiving investigation information for investigating the presence or absence of a person, and a first photographed by the camera unit (4) at a first time point in response to reception of investigation information by the receiving means (51) A presence determination unit that determines presence / absence of a subject in a predetermined region based on the image and a second image corresponding to the predetermined region at a time point different from the first time point, and generates result information indicating the determination result (52) and transmission means (53) for transmitting the result information generated by the presence determination means (32) via the network (2).

  In addition, the presence determination unit (52) includes an image storage unit (52) that stores a second image taken before the first time point. The presence determination unit (52) stores the first luminance of the first image taken at the first time point in response to the reception of the survey information of the reception unit (51) and the image storage unit (52). Based on the luminance difference between the second image and the second luminance, the presence / absence of the subject in the predetermined area is determined, and result information indicating the determination result is generated.

  The transmission means (53) includes a result information storage unit (53) for storing result information. The transmission means (53) compares the result information generated by the presence determination means (52) with the result information stored in the result information storage unit (53), and based on the comparison result, the presence determination means The result information generated by (52) is transmitted.

  The presence monitoring server according to the present invention further includes a generation result information storage unit (6) for storing result information generated by the presence determination unit (52) and a result stored in the generation result information storage unit (6). Statistical information calculation means (7) for calculating statistical information indicating the statistics of the discrimination result based on the information and generating result information including the statistical information is provided.

  The presence monitoring server is connected to the camera unit (4) via the network (2).

  The program according to the present invention includes: (a) photographing a predetermined area as a first image; (b) receiving survey information for investigating the presence or absence of a subject in the predetermined area; and (c) Determining the presence or absence of a subject in a predetermined area based on a first image taken at a first time in response to receiving survey information and a second image at a time different from the first time; (D) Cause a computer to execute each step of generating result information indicating the result of discrimination and (e) a step of transmitting the generated result information.

  The program according to the present invention further causes the computer to execute (f) a step of storing the second image taken before the first time point.

  The program according to the present invention includes (g) a step of storing result information, and (h) a step of comparing the result information generated in step (d) with the result information stored in step (g). And (i) the step of executing the step of (e) based on the result of the comparison is further executed by the computer.

  The program according to the present invention includes: (j) calculating statistical information indicating the statistics of the discrimination result based on the result information stored in step (g); and (k) generating result information including the statistical information. And causing the computer to further execute each step.

  The monitoring system and the method thereof according to the present invention can save the user from making a judgment by himself / herself when investigating a person.

  The monitoring system and method of the present invention can save the user the trouble of determining the seated / vacant state from the display image.

  The monitoring system and the method of the present invention can save the user the trouble of determining the action state of the person from the display image.

  The monitoring system and method of the present invention can prevent the risk of privacy infringement.

  The monitoring system and method of the present invention can be used for the management of stores and employees.

  Embodiments of a presence monitoring system according to the present invention will be described below with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of an attendance monitoring system according to the first embodiment.

  As shown in FIG. 1, the presence monitoring system according to the first embodiment includes a request source terminal 1 owned by a user who is a request destination of an image, a network 2 including the Internet and an intranet, and a predetermined area as an image. It includes a camera unit 4 for photographing and a camera connection terminal 3 connected to the camera unit 4. The network 2 connects the request source terminal 1 and the camera connection terminal 3 to each other. The camera connection terminal 3 can execute a program recorded on the recording medium 8.

  The request source terminal 1 generates requested presence information for investigating the presence or absence of a subject in a predetermined area, and transmits the requested presence information to the camera connection terminal 3 via the network 2.

  The camera connection terminal 3 responds to reception of the requested presence information, and an image captured at a specific time point and an image corresponding to a predetermined area at a time point different from the specific time point (for example, captured before the specific time point) The presence / absence of the subject in the predetermined area is determined based on the background image or the image where the subject is present), and the presence information indicating the determination result is transmitted to the request source terminal 1 via the network 2.

  The user inputs requested presence information from the request source terminal 1 when he / she wants to know the presence status of the person at the monitoring location of the camera unit 4. The requested presence information is transmitted from the request source terminal 1 to the camera connection terminal 3 via the network 2. The camera connection terminal 3 receives the requested presence information and determines presence information from image information indicating an image captured by the camera unit 4. This presence information is transmitted to the request source terminal 1 via the network 2 and presented to the request source terminal 1. The user is notified of the presence state by the presence information.

  The camera connection terminal 3 includes a request input unit 31, a presence determination processing unit 32, and a result output unit 33.

  The request input unit 31 receives the requested presence information transmitted from the request source terminal 1.

  The presence determination processing unit 32 responds to reception of the requested presence information, and an image captured at a specific time point and an image corresponding to a predetermined area at a time point different from the specific time point (for example, before the specific time point) The presence / absence of the subject in a predetermined area is determined based on the background image or the image where the subject is present), and presence information indicating the determination result is generated. The presence determination processing unit 32 includes a memory 32a that stores an image previously captured by the camera unit 4 as image information. The presence determination processing unit 32 acquires an image photographed by the camera unit 4 as image information, and performs determination processing for determining presence information from the acquired image information and stored image information. At this time, this determination process may be repeated regardless of the requested presence information, and for power saving, this determination process is started when the request input unit 31 receives the required presence information, and the end condition You may end when you satisfy. The termination condition includes a change in presence information, a certain period of time, and a stop command issued by the user.

  The result output unit 33 compares the presence information generated by the presence determination processing unit 32 with the stored presence information, and the presence information generated by the presence determination processing unit 32 based on the comparison result. Send. As a result, the output unit 33 includes a memory 33 a that stores the presence information generated by the presence determination processing unit 32. The result output unit 33 outputs (transmits) the presence information generated by the presence determination processing unit 32. In addition, the result output unit 33 displays a new presence when the determined presence information has changed from before (for example, when the determined presence information has changed with respect to the presence information stored in the memory 33a). Output processing for outputting seat information is performed. This output process starts when the request presence information is received by the request input unit 31 and ends when a certain end condition, for example, the end condition is satisfied.

  In the end condition, the change in presence information means, for example, that the presence information detected by the presence determination processing unit 32 changes from vacant or during a meeting to presence. The passage of a certain period of time means that a certain period of time has elapsed since the user generated the requested presence information. The generation of a cancel command by the user means that the user generates a cancel command by, for example, pressing a cancel icon on the browser of the request source terminal 1, and the request input unit 31 receives the cancel command.

  The presence determination processing unit 32 is a predetermined area based on the luminance difference between the luminance of the image captured at a specific time and the luminance of the stored image in response to reception of the requested presence information of the request input unit 31. The presence / absence of the person to be photographed is determined, and presence information indicating the determination result is generated. As described above, the presence determination processing unit 32 uses the image information indicating the image captured by the camera unit 4 to perform image processing to indicate the presence information such as presence, vacant seat, meeting, phone call, and meeting refusal of the subject. Is determined. As the image processing method performed by the presence determination processing unit 32, (A) determination of presence information based on the subject's presence and vacancy, and (B) determination of presence information during the subject's meeting, (C) Discrimination of presence information during the telephone call of the subject and (D) Discrimination of presence information due to rejection of the subject's visit.

  First, (A) a method for discriminating presence information based on a subject's presence and vacancy will be described. (A) As a method for discriminating the presence information based on the subject's presence or absence, (A1) a method for determining the presence of motion based on a difference between frames, and (A2) a method for determining the presence of a person based on a background difference. It is done.

  (A1) In the method of determining the presence of motion by the inter-frame difference, the luminance difference between images that are temporally different from the image stored in the memory 32a of the presence determination processing unit 32 in advance is taken. The presence determination processing unit 32 is present when there is a movement of the photographed person (the movement of the photographed person indicated by the camera unit 4). Occasionally, it is possible to determine whether there is a vacant seat or not. At this time, even if there is movement of the photographed person, a difference may occur due to noise. Therefore, a difference greater than a certain threshold is set as the movement of the photographed person, and a difference equal to or smaller than the threshold is set as noise. Can be prevented. Further, in order to cope with the fact that the noise is temporarily regarded as a subject's movement due to the occurrence of a large noise whose difference is equal to or greater than a threshold value, the user is present when the difference occurs for the number of pixels equal to or greater than the threshold value. Also, in order to deal with the fact that a person's stationary state does not cause the subject's movement to be misidentified as a vacant seat, the person's stationary state is utilized within a certain period of time, and the difference within a certain period of time is used. When a certain threshold or more is detected, the presence is determined.

  (A2) In the method of determining the presence of a person by background difference, a background image (background image indicated by the camera unit 4) in which no person exists is stored in the memory 32a of the presence determination processing unit 32 in advance. When the presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, a difference occurs when a person is present. When there is no seat, it can be determined whether the seat is vacant or not. At this time, even if there is no person, a difference may occur due to noise. Therefore, a difference equal to or greater than a certain threshold is defined as a person area (existing area where a subject in a predetermined area exists), and a difference equal to or less than a certain threshold is determined as noise. By doing so, erroneous discrimination due to noise can be prevented. Also, in order to deal with the case where the noise is temporarily considered to be a part of a person due to the occurrence of a large noise whose difference is equal to or greater than the threshold, the user is present when the difference occurs for the number of pixels equal to or greater than the threshold. Furthermore, when dealing with the fact that a background luminance difference occurs between the current image and the background image due to a change in illumination, the average luminance change value in the image or within a predetermined range is obtained, and the background luminance difference and the average The difference from the brightness change value is taken, and if this difference occurs, the user may be present.

  Next, (B) a method for determining presence information during a meeting of a subject person will be described.

  (B) In the method for determining presence information during a meeting of a subject person, for example, a background image in which no person exists is stored in advance in the memory 32 a of the presence determination processing unit 32. When the presence determination processing unit 32 takes the luminance difference between the background image and the current image, a difference occurs in the place where the person exists, and the number of persons is counted by regarding one lump where the difference is connected as one person, If there are multiple people, it is determined that the meeting is in progress. When noise is present, one noise is counted as one person, and by making a difference greater than a certain threshold a person and making a difference less than a certain threshold noise, erroneous discrimination due to noise can be prevented. In addition, a threshold is also set for the area of the block where the differences are connected, and if the area is equal to or smaller than the certain threshold, it is assumed that noise is detected, thereby reducing erroneous determination of counting noise as one person. Furthermore, when dealing with the fact that a background luminance difference occurs between the current image and the background image due to a change in illumination, the average luminance change value in the image or within a predetermined range is obtained, and the background luminance difference and the average The difference from the brightness change value is taken, and if this difference occurs, the user may be present.

  Next, (C) a method for determining presence information during a telephone call of a person to be photographed will be described.

  (C) In the method for determining presence information during a telephone call of a subject, for example, a telephone area (an area around the telephone indicated by the camera unit 4) and a telephone image (camera) in an image when the telephone is not being used The telephone image shown by the unit 4) is stored in the memory 32a of the presence determination processing unit 32 in advance. The presence determination processing unit 32 utilizes the fact that the brightness difference between the telephone image with the handset disconnected and the stored telephone image when not in use is large, and the current image in the stored telephone area in the image (current The difference between the displayed image) and the stored telephone image is obtained, and it is determined that a call is made when there is a difference. If noise is present, a difference occurs even if it is not used, so a threshold is provided, and if there is a difference greater than a certain threshold, it is determined that a call is in progress. Further, in order to temporarily cope with the occurrence of a large noise whose difference is equal to or greater than a threshold value, the user is present when the difference occurs for the number of pixels equal to or greater than the threshold value. Furthermore, when dealing with the fact that a background luminance difference occurs between the current image and the background image due to a change in illumination, the average luminance change value in the image or within a predetermined range is obtained, and the background luminance difference and the average The difference from the brightness change value is taken, and if this difference occurs, the user may be present.

  Next, (D) a method for discriminating presence information by refusal of a visitor's visit will be described.

  (D) In the method of determining presence information by refusal of the person to be interviewed, for example, when the person to be photographed wants to refrain from visiting, a sign such as a plate indicating refusal of meeting is placed on the camera. The image of the sign of refusal of visit is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 searches the image for a sign image, and determines that the visit is rejected when the sign image exists. For example, the search algorithm takes an area of the size of the stored image from the current image, takes a luminance difference between the stored image and the image extracted from the current image, and the two images match When the difference does not occur, it is determined that it is a sign of refusal to visit, and when the difference occurs, another area is extracted and the process is repeated until the entire image is searched. Even if there is a match if there is noise, a difference occurs. Therefore, if there is no difference greater than a certain threshold, it is determined that the visit is rejected. Further, in order to cope with the occurrence of a large noise whose difference is equal to or greater than a threshold value, if the number of pixels having a difference equal to or greater than a certain threshold value is equal to or less than a threshold value, it is determined that the mark is a sign. Furthermore, when dealing with the fact that a difference occurs even if two images match due to a change in illumination, an average luminance change value in the image or within a predetermined range is obtained, and the luminance difference between the two images and the average A difference from the luminance change value may be taken, and if this difference does not occur, it may be determined that it is a sign.

  As a result, the presence monitoring system according to the first embodiment performs image processing from the obtained camera image and notifies the user of the result, so that the user does not have to make a decision when performing a person survey. Can do.

  For example, a bit string or text information can be considered as a format of the requested presence information or presence information. An example of a bit string and an example of text information are shown in FIGS. 15 and 16, respectively.

  FIG. 15 is a diagram showing a format when the requested presence information and presence information are bit strings.

  FIG. 16 is a diagram showing a format when the requested presence information and presence information are text information.

  FIGS. 15 and 16 show the case where the request destination address is “target@nec.com”, the request source address is “user@nec.com”, and the presence information is “present” and “on the phone”.

  In the case of the bit string of FIG. 15, with respect to the requested presence information, the first x bit of the bit string indicates the request destination address “target@nec.com”, and the y bit that follows follows indicates the request source address “user@nec.com”. The bit value indicating the next presence information request is “1”. As for presence information, each bit indicates the presence of each state, the bit value indicating presence or absence is “1”, the bit value indicating that the conference is in progress, “0”, indicating that the phone is busy The bit value is “1”, and the bit value indicating visit rejection is “0”.

  In the case of the text information in FIG. 16, with respect to the requested presence information, the TargetAddress value indicating the request destination address is “target@nec.com”, the MyAddress value is “user@nec.com”, and indicates the presence information request. The value of Request is “Yes”. Regarding presence information, the value of Exist indicating presence or absence is “Yes”, the value of Meeting indicating “No” is “No”, the value of Phone indicating “on the phone” is “Yes”, and Reject indicating the meeting refusal The value of “No” is “No”. Alternatively, the value of Status may be “Phone”.

  Next, the operation of the presence monitoring system according to the first embodiment will be described with reference to FIGS.

  FIG. 6 is a flowchart showing an operation of performing discrimination processing after receiving (1) requested presence information in the presence monitoring system according to the first embodiment.

  FIG. 7 is a flowchart showing an operation of (2) always performing a discrimination process in the presence monitoring system according to the first embodiment.

  The presence monitoring system according to the first embodiment is divided into (1) an operation for performing a determination process after receiving requested presence information and (2) an operation for always performing a determination process.

  First, with reference to FIG. 6, (1) an operation for performing a discrimination process after receiving requested presence information will be described.

  (1) As an operation for performing the determination process after receiving the requested presence information, it is not necessary to perform the determination process in vain, reducing the load on the camera connection terminal 3 and operating only when necessary to save power. There are effects such as being able to plan.

  As shown in FIG. 6, when a user wants to know the presence state of a person at the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 101). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can specify the address destination owned by the camera connection terminal 3 corresponding to the selected partner by selecting the name of the other party. The request source terminal 1 transmits the requested presence information to the camera connection terminal 3 via the network 2 to the address corresponding to the selected partner (step 102). The requested presence information includes the name of the selected partner, the address owned by the camera connection terminal 3 corresponding to the selected partner, and the address owned by the request source terminal 1 that is the request source. The requested presence information is received from the request source terminal 1 via the network 2 to the camera connection terminal 3 which is the designated address destination (step 103).

  Next, the request input unit 31 of the camera connection terminal 3 receives the requested presence information from the request source terminal 1 via the network 2, and stores the name of the selected partner included in the received requested presence information. The information is output to the seat determination processing unit 32, and the address owned by the request source terminal 1 included in the received requested presence information is output to the result output unit 33. The presence determination processing unit 32 inputs the name of the selected partner included in the request presence information from the request input unit 31, and acquires an image photographed by the camera unit 4 corresponding to the input name as image information. (Step 104).

  Next, the presence determination processing unit 32 determines presence information such as presence, vacant seat, meeting, telephone call, and meeting refusal of the subject by image processing from the acquired image information (step 105). Here, as the determination of presence information by image processing, the above-described methods (A) to (D) are used.

  The presence determination processing unit 32 checks whether the result output unit 33 has transmitted at least one presence information after receiving the requested presence information (step 106). As a result of the investigation, if the memory 33a of the result output unit 33 does not store presence information (step 106-NO), the presence determination processing unit 32 has not transmitted presence information (not transmitted once). ). The result output unit 33 transmits the presence information determined by the presence determination processing unit 32 to the request source terminal 1 (step 108), and stores the presence information in the memory 33a. As a result of the investigation, when the memory 33a of the result output unit 33 stores the presence information (step 106-YES), the presence determination processing unit 32 determines that the presence information has been transmitted at least once. To do.

  When the result output unit 33 determines that the presence determination processing unit 32 has already transmitted the information in step 106 (step 106-YES), for example, the presence information such as vacant seats or a seated state from a meeting has been previously displayed. In order to determine whether or not it has changed, the determined presence information (current presence information) is compared with the presence information (previous presence information) stored in the memory 33a (step 107). ). As a result of the comparison, if they do not match, that is, if they have changed (step 107-YES), the result output unit 33 transmits the determined presence information to the request source terminal 1 which is the address destination of the request source (step 108) The determined presence information is stored in the memory 33a.

  Thereafter, the result output unit 33 determines whether or not an end condition such as a change in presence information stored in the memory 33a, elapse of a certain period of time, and a stop instruction by the user received by the request input unit 31 is satisfied. Is determined (step 109). If not satisfied (step 109—NO), the result output unit 33 outputs non-termination information to the presence determination processing unit 32 and returns to step 104 to acquire image information from the camera unit 4.

  Judgment whether the termination condition is satisfied can be realized as follows. The change in presence information is set as an end condition when the presence information stored in the memory 33a changes in step 107. The elapse of a certain time starts a timer stored in the result output unit 33 when receiving a request, and is set as an end condition when the certain time elapses. For example, when the user clicks on a stop icon in the window on the display of the request source terminal 1 or when the window is deleted, the stop command is transmitted from the request source terminal 1 and the camera connection terminal 3 Is a termination condition when a stop command is received.

  The reason for terminating the operation according to the termination condition is that it can save power by not operating when unnecessary, prevent overloading of the camera connection terminal that performs presence determination processing, and the user issues a stop command. This is to prevent overloading of the network due to the presence information being continuously transmitted when it is forgotten.

  Next, the request source terminal 1 receives the presence information transmitted via the network 2 (step 110), presents the presence state on the display by the presence information, and notifies the user (step 111). As a presentation method, presence information is output and displayed in characters in a window displayed on the display, or presence information is displayed in a Web browser. The presence monitoring system according to Embodiment 1 updates the presence information display when the presence information changes.

  (1) As an operation of performing the discrimination process after receiving the requested presence information of the presence monitoring system according to the first embodiment, it is not necessary to perform the discrimination process wastefully, reducing the load on the camera connection terminal 3 Power saving can be achieved by operating only in such cases.

  Next, with reference to FIG. 7, (2) the operation of always performing the discrimination process will be described.

  (2) By transmitting the presence information obtained when the requested presence information is received as an operation for always performing the determination process, it is not necessary to wait for the transmission until the determination process is completed, thereby shortening the response time. There are effects such as being able to plan.

  As shown in FIG. 7, when the user wants to know the presence state of a person in the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 101). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can specify the address destination owned by the camera connection terminal 3 corresponding to the selected partner by selecting the name of the other party. The request source terminal 1 transmits the requested presence information to the address corresponding to the selected partner (step 102). The requested presence information includes the name of the selected partner, the address owned by the camera connection terminal 3, and the address owned by the request source terminal 1 that is the request source. The requested presence information is received from the request source terminal 1 via the network 2 to the camera connection terminal 3 which is the designated address destination (step 103).

  The presence determination processing unit 32 of the camera connection terminal 3 acquires image information indicating an image captured by the camera unit 4 (step 121), and the presence of the photographed person, vacant seat, during a conference, during a telephone call, or during a telephone call rejection And so on (step 122), and step 121 and step 122 are repeated. Here, as the determination of presence information by image processing, the above-described methods (A) to (D) are used. The determined presence information is stored in the memory 32 a of the presence determination processing unit 32.

  Next, the request input unit 31 of the camera connection terminal 3 receives the requested presence information from the request source terminal 1 via the network 2, and stores the name of the selected partner included in the received requested presence information. The information is output to the seat determination processing unit 32, and the address owned by the request source terminal 1 included in the received requested presence information is output to the result output unit 33. The presence determination processing unit 32 inputs the name of the selected partner included in the requested presence information from the request input unit 31, and uses the presence information already obtained by the camera unit 4 corresponding to the input name. Obtained from the memory 32a (step 123).

  Next, the presence determination processing unit 32 determines presence information such as presence, vacant seat, meeting, telephone call, and meeting refusal of the subject by image processing from the acquired image information (step 105). Here, as the determination of presence information by image processing, the above-described methods (A) to (D) are used.

  The presence determination processing unit 32 checks whether the result output unit 33 has transmitted at least one presence information after receiving the requested presence information (step 124). As a result of the investigation, if the memory 33a of the result output unit 33 does not store the presence information (step 124-NO), the presence determination processing unit 32 has not transmitted the presence information (not transmitted at least once). ). The result output unit 33 transmits the presence information determined by the presence determination processing unit 32 to the request source terminal 1 (step 126), and stores the presence information in the memory 33a. As a result of the investigation, if the memory 33a of the result output unit 33 stores the presence information (step 124-YES), the presence determination processing unit 32 determines that the presence information has been transmitted at least once. To do.

  When the result output unit 33 determines in step 124 that the presence determination processing unit 32 has already transmitted (step 124 -YES), for example, the presence information such as the vacant seat or the presence state from the meeting has previously been present. In order to determine whether or not it has changed, the determined presence information (the presence information stored in the memory 32a) is compared with the presence information stored in the memory 33a (step 125). As a result of the comparison, if they do not match, that is, if they have changed (step 125-YES), the result output unit 33 transmits the determined presence information to the request source terminal 1 that is the address destination of the request source (step 126) The determined presence information (the presence information stored in the memory 32a) is stored in the memory 33a.

  Thereafter, the result output unit 33 determines whether or not an end condition such as a change in presence information stored in the memory 33a, elapse of a certain period of time, and a stop instruction by the user received by the request input unit 31 is satisfied. Is determined (step 127). If not satisfied (step 127—NO), the result output unit 33 outputs the unfinished information to the presence determination processing unit 32 and returns to step 123 to acquire the presence information.

  Judgment whether the termination condition is satisfied can be realized as follows. The change in presence information is set as an end condition when the presence information stored in the memory 33a changes in step 125. The elapse of a certain time starts a timer stored in the result output unit 33 when receiving a request, and is set as an end condition when the certain time elapses. For example, when the user clicks on a stop icon in the window on the display of the request source terminal 1 or when the window is deleted, the stop command is transmitted from the request source terminal 1 and the camera connection terminal 3 Is a termination condition when a stop command is received.

  The reason for terminating the operation according to the termination condition is to prevent overloading of the network due to the presence information being continuously transmitted when the user forgets to issue a stop command.

  Next, the request source terminal 1 receives the presence information transmitted via the network 2 (step 110), presents the presence state on the display by the presence information, and notifies the user (step 111). As a presentation method, presence information is output and displayed in characters in a window displayed on the display, or presence information is displayed in a Web browser. The presence monitoring system according to Embodiment 1 updates the presence information display when the presence information changes.

  (2) In the presence monitoring system according to the first embodiment, as the operation of always performing the discrimination process, the presence information obtained when the requested presence information is received is transmitted until the discrimination process is completed. The response time can be shortened.

  Thereby, the presence monitoring system according to Embodiment 1 can save the user from having to determine the presence state from the image by outputting the presence information when the presence information changes. In addition, the presence monitoring system according to Embodiment 1 can protect the privacy of the photographed person because the image is not presented to the user.

  The presence monitoring system according to Embodiment 1 is not limited to the above description. The present invention can be used not only for the presence of a person at a monitoring location but also for determining the status of the monitoring location. For example, the state determination of the monitoring place includes an on / off state of electricity, an open / closed state of a door, and the like.

  The status determination of the monitoring place can be realized as follows.

  In order to determine whether the electricity is on or off, the average luminance of the pixels in the captured screen is obtained. If the average luminance is less than or equal to a threshold value, the light is turned off.

  As for the open / closed state of the door, for example, the door region (region around the door indicated by the camera unit 4) in the image and the door image (shown by the camera unit 4) in the state where the door is closed, as in the determination method during the phone call. Door image) is stored in the memory 32a of the presence determination processing unit 32 in advance. The presence determination processing unit 32 uses the fact that the brightness difference between the door image with the door opened and the door image with the stored door closed is large, in the stored door area in the image. This can be realized by a method of obtaining a difference between the current image and the door image and determining that the door is open when the difference exists. If there is noise, a difference occurs even if the door is closed, so a threshold is provided, and it is determined that the door is open when there is a difference greater than a certain threshold. Further, in order to cope with the generation of a large noise whose difference is equal to or greater than a threshold value, it is assumed that the door is opened when the difference occurs for the number of pixels equal to or greater than a certain threshold value. Furthermore, when dealing with a difference in brightness between the current image and the stored door image due to a change in lighting, an average brightness change value in the image or within a predetermined range is obtained, and the door image brightness The difference between the difference and the average luminance change value may be taken, and it may be determined that the door is open when this difference occurs.

  In addition, the presence monitoring system according to Embodiment 1 uses the pointing unit to point the icon displayed on the screen as an input form of the requested presence information, and an address or person to be specified together with the presence information acquisition command from the keyboard There is also a form such as entering a name.

  Further, the presence monitoring system according to the first embodiment is not limited to a mode in which the camera unit 4 and the camera connection terminal 3 are directly connected, and the camera unit 4 and the camera connection terminal 3 are connected via the network 2. May be.

  Further, the presence monitoring system according to the first embodiment is not limited to the camera connection terminal 3 and may be a server.

  As described above, according to the presence monitoring system according to the first embodiment, image processing is performed from the obtained camera image, and the result is notified to the user. This saves you time and effort.

  Also, according to the presence monitoring system according to the first embodiment, the presence / vacancy state is recognized by image processing from the obtained camera image, and the presence / absence state changes when the presence / vacancy state changes. -Since the user is notified of the vacant seat state, it is possible to save the user from having to determine the seated / vacant state from the display image.

  In addition, according to the presence monitoring system according to the first embodiment, the person's action state is recognized by image processing from the obtained camera image, and the person's action state is changed via the network when the person's action state changes. Therefore, it is possible to save the user from having to determine the behavior state of the person from the display image.

  In addition, according to the presence monitoring system according to the first embodiment, since no image is presented and only presence information is presented to the user, the risk of privacy infringement can be prevented.

  Furthermore, according to the attendance monitoring system according to the first embodiment, it is possible to manage stores and employees by providing attendance information and statistical information such as attendance rate, vacancy rate, congestion degree, and crowded place. Can be useful.

(Embodiment 2)
The presence monitoring system according to the second embodiment adds a server for storing presence information to the configuration of the first embodiment, and the user acquires the presence information from the server. In addition to the effect, presence information can be confirmed by a general Web browser or mailer.

  An attendance monitoring system according to Embodiment 2 will be described with reference to FIG. In the configuration of the presence monitoring system according to the second embodiment, the same reference numerals are given to the same configurations as those in the first embodiment. In the presence monitoring system according to the second embodiment, the operation in the configuration with the server added will be described, and the operation described in the first embodiment will be omitted.

  FIG. 2 is a block diagram illustrating a configuration of the presence monitoring system according to the second embodiment.

  As shown in FIG. 2, the presence monitoring system according to the second embodiment includes a request source terminal 1 owned by a user who is a request destination of an image, a network 2 including the Internet and an intranet, and a predetermined area as an image. A camera unit 4 for photographing, a camera connection terminal 3 connected to the camera unit 4, a server 5 including a Web server, a mail server, and the like. The server 5 and the camera connection terminal 3 are connected directly or via the network 2. The network 2 connects the request source terminal 1 and the camera connection terminal 3 to each other. The camera connection terminal 3 can execute a program recorded on the recording medium 8.

  The request source terminal 1 generates requested presence information for investigating the presence or absence of a subject in a predetermined area, and transmits the requested presence information to the camera connection terminal 3 via the network 2.

  The camera connection terminal 3 responds to reception of the requested presence information, and an image captured at a specific time point and an image corresponding to a predetermined area at a time point different from the specific time point (for example, captured before the specific time point) Based on the background image or the image in which the subject is present), the presence / absence of the subject in the predetermined area is determined, and the presence information indicating the determination result is displayed in the network 2 in one form of website data and e-mail. To the server 5 via.

The request source terminal 1 extracts presence information from the server 5 via the network 2. The camera connection terminal 3 includes a request input unit 31, an attendance determination processing unit 32, and a result output unit 33.

  The request input unit 31 receives the requested presence information transmitted from the request source terminal 1.

  The presence determination processing unit 32 includes a memory 32a that stores an image previously captured by the camera unit 4 as image information. The presence determination processing unit 32 acquires an image photographed by the camera unit 4 as image information, and performs determination processing for determining presence information from the acquired image information and stored image information. The presence information determined in the camera connection terminal 3 is stored in the server 5 and transmitted to the request source terminal 1 in response to a user request. The presence determination processing unit 32 repeatedly performs determination processing for determining the presence state from the image information. This determination processing is performed regardless of the requested presence information. However, in order to save power, the determination is started when the request input unit 31 receives the requested presence information, and is described in a certain end condition, for example, the first embodiment. The process may be terminated when the termination condition is satisfied.

  In addition, the presence determination processing unit 32 is predetermined based on the luminance difference between the luminance of the image captured at a specific time and the luminance of the stored image in response to reception of the requested presence information of the request input unit 31. The presence / absence of the subject in the area is determined, and presence information indicating the determination result is generated. The image processing method performed by the presence determination processing unit 32 is the same as in the first embodiment.

  The result output unit 33 compares the presence information generated by the presence determination processing unit 32 with the stored presence information, and the presence information generated by the presence determination processing unit 32 based on the comparison result. Send. As a result, the output unit 33 includes a memory 33 a that stores the presence information generated by the presence determination processing unit 32. The result output unit 33 outputs (transmits) the presence information generated by the presence determination processing unit 32 to the server 5 via the network 2 or directly without passing through the network 2. In addition, the result output unit 33 displays a new presence when the determined presence information has changed from before (for example, when the determined presence information has changed with respect to the presence information stored in the memory 33a). Output processing for outputting seat information is performed. This output process may be always output, or may be started when the request presence information is received by the request input unit 31, and may be ended when the end condition described in the first embodiment is satisfied, for example. . As a method of storing presence information in the server 5, only the latest presence information may be stored so as to update the presence information on the server 5, or the presence information may be accumulated. That is, the server 5 receives the presence information from the camera connection terminal 3 at a specific time, and updates the presence information received before the specific time to the presence information received at the specific time. Alternatively, the server 5 receives the presence information from the camera connection terminal 3 and accumulates the received presence information.

  When the user wants to know the presence status of the person at the monitoring location of the camera unit 4, the user inputs the requested presence information to the request source terminal 1. The request source terminal 1 transmits the requested presence information to the server 5 via the network 2 and performs the presence information acquisition operation for acquiring the presence information on the server 5 from the server 5 via the network 2. The presence information acquisition operation starts when the requested presence information is input to the request source terminal 1, and the operation is repeated at a certain time interval, and satisfies a certain end condition, for example, the end condition described in the first embodiment. End at the moment.

  Examples of the output transmission form include website data and electronic mail. When the output transmission form is Web site data, the presence information on the Web site data of the server 5 is updated when the determination result of the presence determination processing unit 32 changes. When the user transmits the requested presence information, the request source terminal 1 appropriately acquires (writes) the website data of the server 5 via the network 2 and displays the website on the display, thereby displaying the presence information to the user. Present. When the output transmission form is an electronic mail, when the user transmits the requested presence information, the request source terminal 1 transmits an electronic mail describing the current presence information to the server 5. The user reads mail from the request source terminal 1 as appropriate. When the vacant seat changes to the seated state, an e-mail in which the seating information is described is transmitted to the server 5 again to notify the return.

  Thereby, in addition to the operation and effect of the first embodiment, the presence monitoring system according to the second embodiment can check the presence information with a general Web browser or mailer.

  Next, the operation of the presence monitoring system according to the second embodiment will be described with reference to FIGS.

  FIG. 8A is a flowchart illustrating the operation of the camera connection terminal when the output transmission form is Web site data in the presence monitoring system according to the second embodiment, and FIG. 8B is a flowchart illustrating the present embodiment. It is a flowchart figure which shows operation | movement of the request origin terminal in the presence monitoring system which concerns on form 2 in case (3) output transmission forms are website data.

  FIG. 9 is a flowchart showing an operation when the (4) output transmission form is mail in the presence monitoring system according to the second embodiment.

  The presence monitoring system according to the second embodiment is divided into (3) an operation when the output transmission form is website data and (4) an operation when the output transmission form is mail.

  First, with reference to FIG. 8, (3) operation | movement in case an output transmission form is website data is demonstrated.

  As shown in FIG. 8A, the presence determination processing unit 32 of the camera connection terminal 3 acquires image information indicating an image captured by the camera unit 4 (step 205), and the presence of the subject person is present. Then, the presence information such as vacant seat, meeting, telephone, refusal of visit is discriminated (step 206). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used.

  The result output unit 33 uses the determined presence information (current presence information) in order to determine whether the presence information has changed from before, for example, vacant seats or the state of being in a meeting. The presence information (previous presence information) stored in the memory 33a is compared (step 207). As a result of the comparison, if they do not match, that is, if they have changed (step 207—YES), the result output unit 33 transmits the determined presence information to the server 5 (step 208) and is stored on the server 5 The present presence information is updated or accumulated (step 209), and the determined presence information is stored in the memory 33a. Thereafter, the camera connection terminal 3 repeats Steps 205 to 209.

  As shown in FIG. 8B, when the user wants to know the presence state of the person at the place where the camera unit 4 is installed, the user inputs the requested presence information from the request source terminal 1 (step 201). ). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can specify an address destination owned by the server 5 corresponding to the selected partner by selecting the name of the partner. The request source terminal 1 transmits the requested presence information to the server 5 to the address corresponding to the selected partner. In this case, the requested presence information includes an address owned by the server 5 and an address owned by the request source terminal 1 that is the request source. The request source terminal 1 acquires Web site data in which presence information is written from the server 5 that is an address destination corresponding to the selected partner via the network 2 (step 202). The request source terminal 1 displays the Web site data obtained from the server 5 on the browser, thereby presenting the presence state on the display and notifying the user (step 203). The presentation method is presented in the same manner as in the first embodiment. Thereafter, the request source terminal 1 determines whether the end condition is satisfied using the end condition described in the first embodiment and its determination method (step 204), and if not satisfied (step 204-NO), the step 202 to step 204 are repeated.

  Next, with reference to FIG. 9, (4) operation | movement in case an output transmission form is a mail is demonstrated.

  As shown in FIG. 9, when the user wants to know the presence state of a person in the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 201). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user designates the address destination owned by the camera connection terminal 3 corresponding to the selected partner and the address destination owned by the server 5 corresponding to the selected partner by selecting the name of the partner. Can do. The request source terminal 1 transmits the requested presence information to the camera connection terminal 3 and the server 5 via the network 2 at the address corresponding to the selected partner (step 211). In this case, the requested presence information transmitted to the camera connection terminal 3 corresponds to the name of the selected partner, the address owned by the camera connection terminal 3 corresponding to the selected partner, and the selected partner. The address owned by the server 5 and the address owned by the request source terminal 1 that is the request source are included. The requested presence information transmitted to the server 5 includes the name of the selected partner, the address owned by the server 5 corresponding to the selected partner, and the address owned by the request source terminal 1 that is the request source. And are included. The requested presence information is received from the request source terminal 1 via the network 2 to the camera connection terminal 3 which is the designated address destination (step 212).

  Next, the request input unit 31 of the camera connection terminal 3 receives the requested presence information from the request source terminal 1 via the network 2, and stores the name of the selected partner included in the received requested presence information. It outputs to the seat discrimination | determination process part 32, and outputs to the result output part 33 the address which the server 5 corresponding to the selected other party included in the received request | requirement presence information. The presence determination processing unit 32 inputs the name of the selected partner included in the request presence information from the request input unit 31, and acquires an image photographed by the camera unit 4 corresponding to the input name as image information. (Step 205).

  Next, the presence determination processing unit 32 determines presence information such as presence, vacancy, during a conference, during a telephone call, and refusal of visit from the acquired image information by image processing (step 206). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used.

  The result output unit 33 uses the determined presence information (current presence information) in order to determine whether the presence information has changed from before, for example, vacant seats or the state of being in a meeting. The presence information (previous presence information) stored in the memory 33a is compared (step 207). As a result of the comparison, if they do not match, that is, if they have changed (step 207—YES), the result output unit 33 transmits the determined presence information to the server 5 (step 208) and is stored on the server 5 The present presence information is updated or accumulated (step 209), and the determined presence information is stored in the memory 33a. Thereafter, the camera connection terminal 3 determines whether the end condition is satisfied using the end condition described in the first embodiment and its determination method (step 213), and if not satisfied (step 213—NO), the step Repeat steps 205-209.

  The reason why the output operation is ended by the end condition is that when the output transmission form is e-mail, when the person is in and out of the shooting place, the seating state and the vacant state are repeated, or the subject is busy, This is in order to prevent a large number of e-mails from being received when the status changes one after another, such as being present, during a conference, being present, or during a call.

  Further, the request source terminal 1 acquires Web site data in which presence information is written from the server 5 which is an address destination corresponding to the selected partner via the network 2 (step 202). The request source terminal 1 displays the Web site data obtained from the server 5 on the browser, thereby presenting the presence state on the display and notifying the user (step 203). The presentation method is presented in the same manner as in the first embodiment.

  As a result, the presence monitoring system according to the second embodiment stores the presence information in the server, and the user acquires the presence information from the server. The presence information can be confirmed with a browser or mailer.

  The presence monitoring system according to Embodiment 2 is not limited to the above description. The present invention can be used not only for the presence of a person at a monitoring location but also for determining the status of the monitoring location. For example, the state determination of the monitoring place includes an on / off state of electricity, an open / closed state of a door, and the like.

  The status determination of the monitoring place can be realized as follows.

  In order to determine whether the electricity is on or off, the average luminance of the pixels in the captured screen is obtained. If the average luminance is less than or equal to a threshold value, the light is turned off.

  As for the open / closed state of the door, for example, the door region (region around the door indicated by the camera unit 4) in the image and the door image (shown by the camera unit 4) in the state where the door is closed, as in the determination method during the phone call. Door image) is stored in the memory 32a of the presence determination processing unit 32 in advance. The presence determination processing unit 32 uses the fact that the brightness difference between the door image with the door opened and the door image with the stored door closed is large, in the stored door area in the image. This can be realized by a method of obtaining a difference between the current image and the door image and determining that the door is open when the difference exists. If there is noise, a difference occurs even if the door is closed, so a threshold is provided, and it is determined that the door is open when there is a difference greater than a certain threshold. Further, in order to cope with the generation of a large noise whose difference is equal to or greater than a threshold value, it is assumed that the door is opened when the difference occurs for the number of pixels equal to or greater than a certain threshold value. Furthermore, when dealing with a difference in brightness between the current image and the stored door image due to a change in lighting, an average brightness change value in the image or within a predetermined range is obtained, and the door image brightness The difference between the difference and the average luminance change value may be taken, and it may be determined that the door is open when this difference occurs.

  In addition, the presence monitoring system according to the second embodiment uses the pointing unit to point the icon displayed on the screen as an input form of the request information, and an address or person name to be specified together with the presence information acquisition command from the keyboard. There is also a form such as inputting.

  Further, the presence monitoring system according to the second embodiment is not limited to a mode in which the camera unit 4 and the camera connection terminal 3 are directly connected, and the camera unit 4 and the camera connection terminal 3 are connected via the network 2. May be.

  As described above, in the presence monitoring system according to the second embodiment, in addition to the operation and effect of the first embodiment, presence information can be confirmed by a general Web browser or mailer.

(Embodiment 3)
The presence monitoring system according to the third embodiment performs the presence determination process at the user's terminal, and in addition to the effect of the first embodiment, the load due to the determination process when a plurality of requested presence information occurs simultaneously. It can be distributed to each terminal.

  An attendance monitoring system according to Embodiment 3 will be described with reference to FIG.

  FIG. 3 is a block diagram showing a configuration of an attendance monitoring system according to the third embodiment.

  As shown in FIG. 3, the presence monitoring system according to the third embodiment includes a request source terminal 1 owned by a user who is an image request source, a network 2 including the Internet, an intranet, etc., and a predetermined area as an image. And a camera unit 4 for photographing. The network 2 connects the request source terminal 1 and the camera unit 4 to each other. Further, the request source terminal 1 can execute the program recorded in the recording medium 8.

The request source terminal 1 inputs requested presence information for investigating the presence or absence of a subject in a predetermined area, and receives an image from the camera unit 4 via the network 2. The request source terminal 1 responds to the input of requested presence information and an image taken at a specific time and an image corresponding to a predetermined area at a time different from the specific time (for example, taken before the specific time) Based on the background image or the image where the photographed person is present), the presence / absence of the photographed person in the predetermined area is determined, and the presence information indicating the determination result is output. When requesting the presence information from the request source terminal 1 when the user wants to know the presence status, the presence status determined by the request source terminal 1 is presented, and the user is notified of the presence status.

  The request source terminal 1 includes a request input unit 11, a presence determination processing unit 12, and a result output unit 13.

  Requested presence information is input to the request input unit 11 by the user.

  The presence determination processing unit 12 responds to the input of requested presence information, an image captured at a specific time point, and an image corresponding to a predetermined area at a time point different from the specific time point (for example, before the specific time point) The presence / absence of the subject in a predetermined area is determined based on the background image or the image where the subject exists), and presence information indicating the determination result is generated. The presence determination processing unit 12 includes a memory 12a that stores an image photographed by the camera unit 4 as image information. The presence determination processing unit 12 acquires an image captured by the camera unit 4 as image information via the network 2 and performs determination processing for determining presence information from the acquired image information and stored image information. Repeat. This determination process is started when requested presence information is input to the request input unit 11 for power saving, and ends when a certain end condition, for example, the end condition described in the first embodiment is satisfied. Also good.

  In addition, the presence determination processing unit 12 is predetermined based on the luminance difference between the luminance of the image captured at a specific time point and the luminance of the stored image in response to the input of the required presence information of the request input unit 11. The presence / absence of the subject in the area is determined, and presence information indicating the determination result is generated. The image processing method performed by the presence determination processing unit 12 is the same as in the first embodiment.

  The result output unit 13 compares the presence information generated by the presence determination processing unit 12 with the stored presence information, and the presence information generated by the presence determination processing unit 12 based on the comparison result. Send. As a result, the output unit 13 includes a memory 13 a that stores the presence information generated by the presence determination processing unit 12. The result output unit 13 outputs the presence information generated by the presence determination processing unit 12. In addition, the result output unit 13 displays a new presence when the determined presence information has changed from before (for example, when the determined presence information has changed with respect to the presence information stored in the memory 13a). Output processing for outputting seat information is performed. This output process starts when the requested presence information is input to the request input unit 11 and ends when the end condition described in the first embodiment is satisfied.

  Thereby, in addition to the effect of Embodiment 1, the presence monitoring system according to Embodiment 3 can distribute the load caused by the determination processing when a plurality of requested presence information is generated simultaneously to each terminal.

  Next, the operation of the presence monitoring system according to the third embodiment will be described with reference to FIGS.

  FIG. 10 is a flowchart showing an operation of performing a discrimination process after (5) requested presence information is input in the presence monitoring system according to the third embodiment.

  FIG. 11 is a flowchart showing the operation of (6) always performing the discrimination process in the presence monitoring system according to the third embodiment.

  The presence monitoring system according to the third embodiment is divided into (5) an operation for performing determination processing after input of requested presence information and (6) an operation for performing determination processing at all times.

  First, with reference to FIG. 10, (5) an operation for performing the determination process after the requested presence information is input will be described.

  As shown in FIG. 10, when a user wants to know the presence state of a person in the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 301). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can designate the camera unit 4 corresponding to the selected partner by selecting the name of the partner. The request input unit 11 outputs the requested presence information to the presence determination processing unit 12 and the result output unit 13.

  The presence determination processing unit 12 accesses the camera unit 4 corresponding to the selected partner via the network 2 and acquires an image photographed by the camera unit 4 as image information (step 302).

  Next, the presence determination processing unit 12 determines presence information such as a subject's presence, vacancy, during a conference, during a telephone call, and refusal to visit from the acquired image information by image processing (step 303). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used.

  The presence determination processing unit 12 checks whether or not the result output unit 13 has output at least one presence information after inputting the requested presence information (step 304). As a result of the investigation, when the memory 13a of the result output unit 13 does not store the presence information (step 304-NO), the presence determination processing unit 12 has not transmitted the presence information (not transmitted at least once). ). The result output unit 13 outputs the presence information determined by the presence determination processing unit 12 (step 306), and stores the presence information in the memory 13a. The presentation method is presented in the same manner as in the first embodiment. As a result of the investigation, if the memory 13a of the result output unit 13 stores the presence information (step 304-YES), the presence determination processing unit 12 determines that at least one presence information has been transmitted. To do.

  When the result output unit 13 determines in step 304 that the presence determination processing unit 12 has already transmitted (step 304—YES), for example, the presence information such as a vacant seat or a seated state from a meeting has been previously displayed. In order to determine whether or not it has changed, the determined presence information (current presence information) is compared with the presence information (previous presence information) stored in the memory 13a (step 305). ). As a result of the comparison, if they do not match, that is, if they have changed (step 305—YES), the result output unit 13 outputs the determined presence information (step 306) and stores the presence information in the memory 13a. . The presentation method is presented in the same manner as in the first embodiment.

  After that, the result output unit 13 determines whether the end condition is satisfied using the end condition described in the first embodiment and the determination method (step 307), and if not satisfied (step 307-NO), the step Steps 302 to 307 are repeated.

  Next, with reference to FIG. 11, (6) operation | movement which always performs discrimination | determination processing is demonstrated.

  As shown in FIG. 11, when the user wants to know the presence state of a person in the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 301). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can designate the camera unit 4 corresponding to the selected partner by selecting the name of the partner. The request input unit 11 outputs the requested presence information to the presence determination processing unit 12 and the result output unit 13.

  The presence determination processing unit 12 of the request source terminal 1 acquires image information indicating an image captured by the camera unit 4 via the network 2 (step 311), and the presence of the subject, vacancy, during a meeting, During the telephone call, presence information such as visit rejection is discriminated (step 312), and step 311 and step 312 are repeated. Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used. The determined presence information is stored in the memory 12 a of the presence determination processing unit 12.

  Next, the presence determination processing unit 12 inputs the requested presence information from the request input unit 11, and based on the input requested presence information, the presence already obtained by the camera unit 4 in step 312. Information is acquired from the memory 12a (step 313).

  The presence determination processing unit 12 checks whether or not the result output unit 13 has output at least one presence information after inputting the requested presence information (step 304). As a result of the investigation, when the memory 13a of the result output unit 13 does not store the presence information (step 304-NO), the presence determination processing unit 12 has not transmitted the presence information (not transmitted at least once). ). The result output unit 13 outputs the presence information determined by the presence determination processing unit 12 (step 306), and stores the presence information in the memory 13a. The presentation method is presented in the same manner as in the first embodiment. As a result of the investigation, if the memory 13a of the result output unit 13 stores the presence information (step 304-YES), the presence determination processing unit 12 determines that at least one presence information has been transmitted. To do.

  When the result output unit 13 determines in step 304 that the presence determination processing unit 12 has already transmitted (step 304—YES), for example, the presence information such as a vacant seat or a seated state from a meeting has been previously displayed. In order to determine whether or not it has changed, the determined presence information (current presence information) is compared with the presence information (previous presence information) stored in the memory 13a (step 305). ). As a result of the comparison, if they do not match, that is, if they have changed (step 305—YES), the result output unit 13 outputs the determined presence information (step 306) and stores the presence information in the memory 13a. . The presentation method is presented in the same manner as in the first embodiment.

  After that, the result output unit 13 determines whether the end condition is satisfied using the end condition described in the first embodiment and the determination method (step 307), and if not satisfied (step 307-NO), the step 313, Step 304 to Step 307 are repeated.

  As a result, the presence monitoring system according to the third embodiment performs the presence determination process at the user's terminal, so that the load due to the determination process when a plurality of requested presence information is generated simultaneously can be distributed to each terminal. it can.

  The presence monitoring system according to Embodiment 3 is not limited to the above description. The present invention can be used not only for the presence of a person at a monitoring location but also for determining the status of the monitoring location. For example, the state determination of the monitoring place includes an on / off state of electricity, an open / closed state of a door, and the like.

  The status determination of the monitoring place can be realized as follows.

  In order to determine whether the electricity is on or off, the average luminance of the pixels in the captured screen is obtained. If the average luminance is less than or equal to a threshold value, the light is turned off.

  As for the open / closed state of the door, for example, the door area in the image with the door closed (area around the door indicated by the camera 4) and the door image (the door position indicated by the camera 4) are the same as in the determination method during the phone call. Image) is stored in advance in the memory 12a of the presence determination processing unit 12. The presence determination processing unit 12 uses the fact that the brightness difference between the door image in the state where the door is opened and the door image in the state where the stored door is closed is large, in the stored door area in the image. This can be realized by a method of obtaining a difference between the current image and the door image and determining that the door is open when the difference exists. If there is noise, a difference occurs even if the door is closed, so a threshold is provided, and it is determined that the door is open when there is a difference greater than a certain threshold. Further, in order to cope with the generation of a large noise whose difference is equal to or greater than a threshold value, it is assumed that the door is opened when the difference occurs for the number of pixels equal to or greater than a certain threshold value. Furthermore, when dealing with a difference in brightness between the current image and the stored door image due to a change in lighting, an average brightness change value in the image or within a predetermined range is obtained, and the door image brightness The difference between the difference and the average luminance change value may be taken, and it may be determined that the door is open when this difference occurs.

  In addition, the presence monitoring system according to the third embodiment uses the pointing unit to point the icon displayed on the screen as the request information input form, and the address or person name to be specified together with the presence information acquisition command from the keyboard. There is also a form such as inputting.

  As described above, in the presence monitoring system according to the third embodiment, in addition to the effects of the first embodiment, it is possible to distribute the load caused by the determination processing when a plurality of requested presence information is generated simultaneously to each terminal. .

(Embodiment 4)
The presence monitoring system according to the fourth embodiment is a form in which a discrimination processing unit is incorporated in the server having the configuration of the second embodiment. When the user acquires the presence information from the server, the presence information can be confirmed by a general Web browser or mailer.

  An attendance monitoring system according to Embodiment 4 will be described with reference to FIG. In the configuration of the presence monitoring system according to the fourth embodiment, the same reference numerals are given to the same configurations as those in the first embodiment.

  FIG. 4 is a block diagram showing a configuration of an attendance monitoring system according to the fourth embodiment.

  As shown in FIG. 4, the presence monitoring system according to the fourth embodiment includes a request source terminal 1 owned by a user who is an image request destination, a network 2 including the Internet and an intranet, and a predetermined area as an image. A camera unit 4 for photographing, and a server 5 connected to the camera unit 4. The network 2 connects the request source terminal 1 and the server 5 to each other. The server 5 can execute a program recorded on the recording medium 8.

  The request source terminal 1 generates requested presence information for investigating the presence / absence of a subject in a predetermined area, and transmits the requested presence information to the server 5 via the network 2.

  The server 5 responds to the reception of the requested presence information by taking an image taken at a specific time and an image corresponding to a predetermined area at a time different from the specific time (for example, a background image taken before the specific time Or the presence of the subject in the predetermined area, and the presence information indicating the result of the discrimination through the network 2 in one form of website data and e-mail. To the request source terminal 1.

The request source terminal 1 extracts presence information from the server 5 via the network 2. The server 5 includes a request input unit 51, an presence determination processing unit 52, and an presence information storage unit 53.

  The request input unit 51 receives the requested presence information transmitted from the request source terminal 1.

  The presence determination processing unit 52 includes a memory 52a that stores an image previously captured by the camera unit 4 as image information. The presence determination processing unit 52 acquires an image photographed by the camera unit 4 as image information, and performs determination processing for determining presence information from the acquired image information and stored image information. The presence information determined in the server 5 is stored in the server 5 and transmitted to the request source terminal 1 in response to a user request. The presence determination processing unit 52 repeatedly performs determination processing for determining the presence state from the image information. This determination processing is performed regardless of the requested presence information. However, in order to save power, the determination is started when the request input unit 51 receives the requested presence information, and is described in a certain end condition, for example, in the first embodiment. The process may be terminated when the termination condition is satisfied.

  In addition, the presence determination processing unit 52 is predetermined based on the luminance difference between the luminance of the image captured at a specific time and the luminance of the stored image in response to reception of the requested presence information of the request input unit 51. The presence / absence of the subject in the area is determined, and presence information indicating the determination result is generated. The image processing method performed by the presence determination processing unit 52 is the same as in the first embodiment.

  The presence information storage unit 53 compares the presence information generated by the presence determination processing unit 52 with the stored presence information, and the presence information generated by the presence determination processing unit 52 based on the comparison result. Send seat information. The presence information storage unit 53 corresponds to a memory that stores the presence information generated by the presence determination processing unit 52. The presence information storage unit 53 outputs (transmits) the presence information generated by the presence determination processing unit 52 to the request source terminal 1 via the network 2 or directly without passing through the network 2. The presence information determined by the presence determination processing unit 52 is converted into an output transmission form by the presence information storage unit 53 and held. Here, it may be held only when the determined presence information and the presence information held in the presence information storage unit 53 are different, or may be held constantly. As for the presence information storage method in the presence information storage unit 53, the presence information previously held in the presence information storage unit 53 may be updated and only the latest presence information may be stored. Seat information may be accumulated. In addition, the presence information storage unit 53 displays a new presence when the determined presence information has changed from before (for example, when the determined presence information has changed relative to the stored presence information). Performs output processing to output information. This output process may be output at all times, or may be started when the request presence information is received by the request input unit 51, and may be ended when the end condition described in the first embodiment is satisfied, for example. .

  When the user wants to know the presence status of the person at the monitoring location of the camera unit 4, the user inputs the requested presence information to the request source terminal 1. The request source terminal 1 transmits the requested presence information to the server 5 via the network 2 and performs the presence information acquisition operation for acquiring the presence information on the server 5 from the server 5 via the network 2. The presence information acquisition operation starts when the requested presence information is input to the request source terminal 1, and the operation is repeated at a certain time interval, and satisfies a certain end condition, for example, the end condition described in the first embodiment. End at the moment.

  Examples of the output transmission form include website data and electronic mail. When the output transmission form is website data, the presence information on the website data of the server 5 is updated when the determination result of the presence determination processing unit 52 changes. When the user transmits the requested presence information, the request source terminal 1 appropriately acquires the website data of the server 5 via the network 2 and presents the presence information to the user by displaying the website on the display. . When the output transmission form is electronic mail, when the user transmits the requested presence information, the request source terminal 1 transmits an electronic mail describing the current presence information to the request source terminal 1. The user reads mail from the request source terminal 1 as appropriate. When changing from vacant seats to seated seats, an e-mail in which seating information is described is transmitted again to the request source terminal 1 to notify the return of seats.

  Thereby, in addition to the operation and effect of the first embodiment, the presence monitoring system according to the fourth embodiment can confirm the presence information with a general Web browser or mailer.

  Next, the operation of the presence monitoring system according to the fourth embodiment will be described with reference to FIGS.

  12A is a flowchart showing the operation of the camera connection terminal when the output transmission form is Web site data in the presence monitoring system according to the fourth embodiment, and FIG. 12B is a flowchart showing the operation of the present embodiment. It is a flowchart figure which shows the operation | movement of the request origin terminal in the presence monitoring system which concerns on form 4 when the output transmission form is website data.

  FIG. 13 is a flowchart showing an operation when the (8) output transmission form is mail in the presence monitoring system according to the fourth embodiment.

  The presence monitoring system according to the fourth embodiment is divided into (7) operation when the output transmission form is website data and (8) operation when the output transmission form is mail.

  First, with reference to FIG. 12, (7) operation | movement in case an output transmission form is website data is demonstrated.

  As shown in FIG. 12B, the presence determination processing unit 52 of the server 5 acquires image information indicating an image captured by the camera unit 4 (step 505), and the presence of the subject, The presence information such as during a conference, during a telephone call, or a visit refusal is determined (step 506). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used.

  The presence information storage unit 53 determines the presence information (current presence information, for example) in order to determine whether the presence information has changed from before, such as a vacant seat or a seated state from a meeting. ) And the stored presence information (previous presence information) are compared (step 507). As a result of the comparison, if they do not match, that is, if there is a change (step 507-YES), the presence information storage unit 53 updates or accumulates the currently determined presence information (step 508), and determines the presence Memorize seat information. Thereafter, the server 5 repeats Steps 505 to 508.

  As shown in FIG. 12A, when a user wants to know the presence state of a person in the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 501). ). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can specify an address destination owned by the server 5 corresponding to the selected partner by selecting the name of the partner. The request source terminal 1 transmits the request presence information to the request source terminal 1 to the address corresponding to the selected partner. In this case, the requested presence information includes an address owned by the server 5 and an address owned by the request source terminal 1 that is the request source. The request source terminal 1 acquires Web site data in which presence information is written from the server 5 that is an address destination corresponding to the selected partner via the network 2 (step 502). The request source terminal 1 displays the Web site data obtained from the server 5 on the browser, thereby presenting the presence state on the display and notifying the user (step 503). The presentation method is presented in the same manner as in the first embodiment. Thereafter, the request source terminal 1 determines whether the end condition is satisfied using the end condition described in the first embodiment and its determination method (step 504), and if not satisfied (step 504-NO), step 502-Step 504 is repeated.

  Next, with reference to FIG. 13, (8) operation | movement in case an output transmission form is a mail is demonstrated.

  As shown in FIG. 13, when the user wants to know the presence state of a person at the place where the camera unit 4 is installed, the user inputs requested presence information from the request source terminal 1 (step 501). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name of the person who wants to know the presence information as the requested presence information. At this time, the user can specify the address destination owned by the server 5 corresponding to the selected partner and the address destination owned by the server 5 corresponding to the selected partner by selecting the name of the partner. . The request source terminal 1 transmits the requested presence information to the server 5 and the request source terminal 1 via the network 2 to the address corresponding to the selected partner (step 511). In this case, the requested presence information transmitted to the server 5 includes the name of the selected partner, the address owned by the server 5 corresponding to the selected partner, and the request source terminal 1 that is the request source. Address. The requested presence information is received from the request source terminal 1 via the network 2 to the server 5 that is the designated address destination (step 512).

  Next, the request input unit 51 of the server 5 receives the requested presence information from the request source terminal 1 via the network 2 and determines the presence of the name of the selected partner included in the received requested presence information. The information is output to the processing unit 52, and the name of the selected partner included in the received requested presence information is output to the presence information storage unit 53. The presence determination processing unit 52 inputs the name of the selected partner included in the requested presence information from the request input unit 51, and acquires an image photographed by the camera unit 4 corresponding to the input name as image information. (Step 505).

  Next, the presence determination processing unit 52 determines presence information such as a subject's presence, vacancy, during a meeting, during a telephone call, and refusal to meet by image processing from the acquired image information (step 506). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment are used.

  The presence information storage unit 53 determines the presence information (current presence information, for example) in order to determine whether the presence information has changed from before, such as a vacant seat or a seated state from a meeting. ) And the stored presence information (previous presence information) are compared (step 507). As a result of the comparison, if they do not match, that is, if there is a change (step 507-YES), the presence information storage unit 53 updates or accumulates the currently determined presence information (step 508), and determines the presence Memorize seat information. Thereafter, the server 5 determines whether the end condition is satisfied using the end condition described in the first embodiment and its determination method (step 513). If not satisfied (step 513—NO), the server 505 Step 208 is repeated.

  The reason why the output operation is ended by the end condition is that when the output transmission form is e-mail, when the person is in and out of the shooting place, the seating state and the vacant state are repeated, or the subject is busy, This is in order to prevent a large number of e-mails from being received when the status changes one after another, such as being present, during a conference, being present, or during a call.

  Further, the request source terminal 1 acquires Web site data in which presence information is written from the server 5 which is an address destination corresponding to the selected partner via the network 2 (step 502). The request source terminal 1 displays the Web site data obtained from the server 5 on the browser, thereby presenting the presence state on the display and notifying the user (step 503). The presentation method is presented in the same manner as in the first embodiment.

  Thereby, the presence monitoring system according to the fourth embodiment stores the presence information in the server, and the user acquires the presence information from the server. Therefore, a dedicated terminal and application are unnecessary, and a general Web The presence information can be confirmed with a browser or mailer.

  The presence monitoring system according to Embodiment 4 is not limited to the above description. The present invention can be used not only for the presence of a person at a monitoring location but also for determining the status of the monitoring location. For example, the state determination of the monitoring place includes an on / off state of electricity, an open / closed state of a door, and the like.

  The status determination of the monitoring place can be realized as follows.

  In order to determine whether the electricity is on or off, the average luminance of the pixels in the captured screen is obtained. If the average luminance is less than or equal to a threshold value, the light is turned off.

  As for the open / closed state of the door, for example, the door region (region around the door indicated by the camera unit 4) in the image and the door image (shown by the camera unit 4) in the state where the door is closed, as in the determination method during the phone call. Door image) is stored in advance in the memory 52 a of the presence determination processing unit 52. The presence determination processing unit 52 uses the fact that the brightness difference between the door image with the door opened and the door image with the stored door closed is large, in the stored door area in the image. This can be realized by a method of obtaining a difference between the current image and the door image and determining that the door is open when the difference exists. If there is noise, a difference occurs even if the door is closed, so a threshold is provided, and it is determined that the door is open when there is a difference greater than a certain threshold. Further, in order to cope with the generation of a large noise whose difference is equal to or greater than a threshold value, it is assumed that the door is opened when the difference occurs for the number of pixels equal to or greater than a certain threshold value. Furthermore, when dealing with a difference in brightness between the current image and the stored door image due to a change in lighting, an average brightness change value in the image or within a predetermined range is obtained, and the door image brightness The difference between the difference and the average luminance change value may be taken, and it may be determined that the door is open when this difference occurs.

  In addition, the presence monitoring system according to the fourth embodiment, as an input form of request information, points an icon displayed on the screen by a pointing unit, and specifies an address or a person name to be specified together with a presence information acquisition command from a keyboard. There is also a form such as inputting.

  Further, the presence monitoring system according to the fourth embodiment is not limited to the form in which the camera unit 4 and the server 5 are directly connected, and the camera unit 4 and the server 5 may be connected via the network 2.

  As described above, in the presence monitoring system according to the fourth embodiment, in addition to the operation and effect of the first embodiment, presence information can be confirmed by a general Web browser or mailer.

(Embodiment 5)
An attendance monitoring system according to the fifth embodiment adds an attendance information storage unit and a statistical information calculation unit to the configuration of the first embodiment, and performs statistical calculation from the attendance information, thereby In addition to the operation and effect of 1, useful information such as the congestion rate can be obtained.

  An attendance monitoring system according to Embodiment 5 will be described with reference to FIG. In the configuration of the presence monitoring system according to the fifth embodiment, the same reference numerals are given to the same configurations as those in the first embodiment. In the presence monitoring system according to the fifth embodiment, the operation in the configuration in which the presence information storage unit and the statistical information calculation unit are added will be described, and the operation described in the first embodiment will be omitted.

  FIG. 5 is a block diagram showing a configuration of an attendance monitoring system according to the fifth embodiment.

  As shown in FIG. 5, the presence monitoring system according to the fifth embodiment includes a request source terminal 1 owned by a user who is a request destination of an image, a network 2 including the Internet and an intranet, and a predetermined area as an image. It includes a camera unit 4 for photographing and a camera connection terminal 3 connected to the camera unit 4. The network 2 connects the request source terminal 1 and the camera connection terminal 3 to each other. The camera connection terminal 3 can execute a program recorded on the recording medium 8.

  The request source terminal 1 generates requested presence information for investigating the presence or absence of a subject in a predetermined area, and transmits the requested presence information to the camera connection terminal 3 via the network 2.

  The camera connection terminal 3 responds to reception of the requested presence information, and an image captured at a specific time point and an image corresponding to a predetermined area at a time point different from the specific time point (for example, captured before the specific time point) The presence / absence of the subject in the predetermined area is determined based on the background image or the image where the subject is present), and the presence information indicating the determination result is transmitted to the request source terminal 1 via the network 2.

  The camera connection terminal 3 includes a request input unit 31, a presence determination processing unit 32, a result output unit 33, a presence information storage unit 6, and a statistical information calculation unit 7.

  The request input unit 31 receives the requested presence information transmitted from the request source terminal 1.

  The presence determination processing unit 32 includes a memory 32a that stores an image previously captured by the camera unit 4 as image information. The presence determination processing unit 32 acquires an image captured by the camera unit 4 as image information, and performs determination processing for determining presence information necessary for statistical information from the acquired image information and stored image information. Do. The presence information necessary for the statistical information includes presence / vacancy, position, number of persons, ratio of person area to certain area, time, and the like.

  In addition, the presence determination processing unit 32 is predetermined based on the luminance difference between the luminance of the image captured at a specific time and the luminance of the stored image in response to reception of the requested presence information of the request input unit 31. The presence / absence of the subject in the area is determined, and presence information indicating the determination result is generated. The image processing method performed by the presence determination processing unit 32 is the same as in the first embodiment.

  The presence information storage unit 6 stores the presence information generated by the presence determination processing unit 32.

  The user inputs request statistical information for requesting statistical information from the request source terminal 1. The request statistical information is transmitted from the request source terminal 1 to the camera connection terminal 3 via the network 2. The request input unit 31 of the camera connection terminal 3 receives the request statistical information and outputs the received request statistical information to the statistical information calculation unit 7.

  The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information), and calculates statistical information based on the time series presence information. The calculated statistical information is transmitted from the result output unit 33 to the request source terminal 1 via the network 2. The transmitted statistical information is presented to the user at the request source terminal 1.

  Further, the statistical information calculation unit 7 calculates statistical information indicating statistics of the determination result by the presence determination processing unit 32 based on the presence information stored in the presence information storage unit 6, and includes the statistical information. Generate seat information. Thereby, the user can present presence information including statistical information by transmitting only the requested presence information to the camera connection terminal 3.

  The result output unit 33 compares the presence information generated by the presence determination processing unit 32 with the stored presence information, and the presence information generated by the presence determination processing unit 32 based on the comparison result. Send. As a result, the output unit 33 includes a memory 33 a that stores the presence information generated by the presence determination processing unit 32. The result output unit 33 outputs (transmits) the presence information generated by the presence determination processing unit 32 and the statistical information calculated by the statistical information calculation unit 7. In addition, the result output unit 33 displays a new presence when the determined presence information has changed from before (for example, when the determined presence information has changed with respect to the presence information stored in the memory 33a). Output processing for outputting seat information is performed.

  According to the attendance monitoring system according to the fifth embodiment, the attendance and vacancy status of the place photographed by the camera unit 4 is recorded, and information on the attendance rate and the vacancy rate is used to manage employees. And store congestion management. In the management of employees, it is possible to save work space by grasping the seating status of employees and sharing the desks of employees with different seating time zones. In addition, it is possible to accurately grasp the work situation in a workplace where desk work is performed all day. In store congestion management, for example, by measuring the congestion rate in each time zone of the day by image processing and statistically determining the change in the congestion rate and the location where it is congested, customers can concentrate on which sales floor. It is possible to ascertain whether there is a lot of traffic in the time zone, the flow of customers in the store, etc., which helps to secure sales floors and secure space, thereby reducing congestion and improving the rate of return.

  The statistical information mentioned above includes the occupancy rate such as the seating rate and vacancy rate, the degree of congestion, the crowded place, the flow of customers in the store, etc. The presence information necessary for this statistical information is as described above. , Presence / vacancy, ratio of person area (existing area where a subject is present in a predetermined area), position of person (photographer), and time. The presence determination processing unit 32 is based on the image taken at the specific time and the time when the image was taken at the specific time, and the presence of the subject, the vacant state of the subject, The presence information corresponding to at least one of the presence area where the subject is present in the predetermined area and the position of the subject is generated. The statistical information calculation unit 7 corresponds to at least one of the presence state of the photographed person, the vacant state of the photographed person, the existence area where the photographed person exists in a predetermined area, and the position of the photographed person Statistical information corresponding to at least one of the presence rate by the photographed person, the vacancy rate by the photographed person, the degree of congestion by the photographed person, and the crowded place by the photographed person is calculated based on the presence information .

  The camera connection terminal 3 uses (S) the occupancy rate such as the seating rate and the vacancy rate, (T) the congestion degree of the store, (U) the crowded location of the store, based on the attendance information necessary for the statistical information described above and the statistical information. (V) The flow of customers in the store can be obtained.

  First, (S) a method for obtaining the occupation ratio such as the seating ratio and the vacancy ratio will be described.

  (S) In the method for obtaining the occupation ratio such as the seating ratio and the vacancy ratio, first, the background difference is performed by the method (A2) described in the first embodiment. A background image (background image indicated by the camera unit 4) designating a seat range where no person exists is stored in the memory 32a of the presence determination processing unit 32 in advance. When the presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, a difference occurs when a person is present. When there is no seat, the seating / vacancy is determined by making it vacant, and the seating / vacancy is output to the seating information storage unit 6 as seating information. The presence information storage unit 6 stores the presence information from the presence determination processing unit 32.

  The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information), and the presence information occupied during a certain time indicated by the time series presence information. The total seat time is calculated as statistical information. The calculated statistical information indicates the occupation rate such as the seating rate and the vacancy rate.

  Next, (T) A method for obtaining the degree of congestion of the store will be described. (T) There are two methods (T1) and (T2) for obtaining the congestion degree of the store.

  (T1) As a method for determining the degree of congestion of a store, first, background difference is performed by the method (A2) described in the first embodiment. A background image (background image indicated by the camera unit 4) designating a store area (store range) in which no person exists is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, and a difference occurs when a person exists. Sometimes the presence of a person area (corresponding to the above-mentioned presence) and the absence of the person area (corresponding to the above-mentioned vacant seat) are determined by determining that the person area does not exist. As the determination, the presence determination processing unit 32 can obtain the difference pixel ratio (the ratio of the existing pixels or the ratio of the person area to the store area) with respect to all the pixels in the image. Is output to the presence information storage unit 6. The presence information storage unit 6 stores the presence information from the presence determination processing unit 32. The statistical information calculation unit 7 determines a value corresponding to the luminance difference between the luminance of the image captured at a specific time point and the luminance of the stored image, and a predetermined threshold value, and determines a predetermined threshold based on the determination result. The ratio of the existing area where the subject is present in the area is calculated as the degree of congestion. The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information) and occupies a certain time indicated by the time series presence information. Calculate the cumulative congestion time as statistical information. The calculated statistical information indicates the congestion level of the store. That is, the statistical information calculation unit 7 accumulates presence information in units of one week, and by averaging each time of each day of the week, it can be understood which time zone of which day of the week is crowded, and the congestion degree statistics You can ask for information.

  (T2) As another method for obtaining the congestion degree of the store, first, the background difference is performed by the method (A2) described in the first embodiment. A background image (background image indicated by the camera unit 4) designating a store area (store range) in which no person exists is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, and a difference occurs when a person exists. Sometimes the presence of a person area (corresponding to the above-mentioned presence) and the absence of the person area (corresponding to the above-mentioned vacant seat) are determined by determining that the person area does not exist. As the determination, the presence determination processing unit 32 distinguishes the separated object regions by performing labeling that gives the same label to both pixels when the two adjacent pixels have the above-described presence pixel ratio. The number of customers existing in the store can be obtained by regarding one object region as one person, and this number is output to the presence information storage unit 6 as presence information. The presence information storage unit 6 stores the presence information from the presence determination processing unit 32. The statistical information calculation unit 7 determines a value corresponding to the luminance difference between the luminance of the image captured at a specific time point and the luminance of the stored image, and a predetermined threshold value, and determines a predetermined threshold based on the determination result. The ratio of the existing area where the subject is present in the area is calculated as the degree of congestion. The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information) and occupies a certain time indicated by the time series presence information. The cumulative total congestion time (the ratio of the stored number of people to 100% when a certain number of people is placed) is calculated as statistical information. The calculated statistical information indicates the congestion level of the store. That is, the statistical information calculation unit 7 accumulates presence information in units of one week, and by averaging each time of each day of the week, it can be understood which time zone of which day of the week is crowded, and the congestion degree statistics You can ask for information.

  Next, (U) a method for obtaining a crowded place in a store will be described.

  (U) In the method for obtaining a crowded place in a store, first, background difference is performed by the method (A2) described in the first embodiment. A background image (background image indicated by the camera unit 4) designating a store area (store range) in which no person exists is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, and a difference occurs when a person exists. Sometimes the presence of a person area (corresponding to the above-mentioned presence) and the absence of the person area (corresponding to the above-mentioned vacant seat) are determined by determining that the person area does not exist. The presence determination processing unit 32 divides each of the image and the background image into a plurality of blocks so as to correspond to each other, the luminance of the image corresponding to the first block among the plurality of blocks of the divided image, and the division Based on the luminance difference of the block with the luminance of the background image corresponding to the first block among the plurality of blocks of the background image thus generated, the presence area where the subject in the predetermined area exists is generated as presence information. . That is, the presence determination processing unit 32 divides the screen into blocks of a certain size as the determination, and calculates the ratio of the difference existing pixels (the ratio of the existing pixels or the ratio of the person area to the store area) to the block area. The ratio can be obtained, and this ratio is output to the presence information storage unit 6 as presence information. The presence information storage unit 6 stores the presence information from the presence determination processing unit 32 together with the time.

  The statistical information calculation unit 7 determines the luminance difference of the block and a predetermined threshold, and calculates the ratio of the existing area where the subject is present in the predetermined area as a crowded place based on the determination result. The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information) and occupies a certain time indicated by the time series presence information. Calculate the cumulative congestion time as statistical information. The calculated statistical information indicates a crowded place. That is, the statistical information calculation unit 7 can obtain the statistical information of the crowded place by averaging the presence information for each time of day of the week and setting a block having a ratio equal to or greater than a certain threshold as the crowded place.

  Next, (V) a method for obtaining the flow of customers in the store will be described.

  (V) In the method for obtaining the flow of customers in the store, first, background difference is performed by the method (A2) described in the first embodiment. A background image (background image indicated by the camera unit 4) designating a store area (store range) in which no person exists is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 takes a luminance difference between the background image and the current image at each pixel, and a difference occurs when a person exists. Sometimes the presence of a person area (corresponding to the above-mentioned presence) and the absence of the person area (corresponding to the above-mentioned vacant seat) are determined by determining that the person area does not exist. As the determination, the presence determination processing unit 32 extracts a person area by labeling the difference, regards the position average of all the pixels constituting one person area as the position of the person, Is output to the presence information storage unit 6 as presence information. The presence information storage unit 6 stores the presence information from the presence determination processing unit 32.

The statistical information calculation unit 7 arranges a plurality of presence information stored in the presence information storage unit 6 in time series (time series presence information), and a person occupied during a certain time indicated by the time series presence information The cumulative total of the time that exists is calculated as statistical information. The calculated statistical information indicates the flow of customers in the store. That is, the statistical information calculation unit 7 can obtain the flow of customers in the store by tracking a person using time series information of presence information indicated by the presence position. For tracking method for a person, for example, regarded as the motion difference between the present position at time t1 of a person _{(x t1, y t1)} and the location at time _{t2 (x t2, y t2)} , the person at time t location of _(x t, _{y t)} to predict the location obtained by adding motion to the location at time t1 and _{(2x t1 -x t2, 2y t1} -y t2), all persons present at a position in the time t obtained The person can be tracked by regarding the person closest to the predicted position as the tracking target person.

  Thereby, the presence monitoring system according to Embodiment 5 can obtain useful information such as the congestion rate by performing statistical calculation from the presence information.

  As the format of request statistical information and statistical information, for example, a method realized by a bit string or a method realized as text information can be considered. An example of a bit string and an example of text information are shown in FIG.

  FIG. 17A is a diagram showing a format when the statistical information is a bit string, and FIG. 17B is a diagram showing a format when the statistical information is text information.

  FIG. 17 shows that the time is “January 1, 2001 11:59:59”, the presence information is “present”, the number of people is “3”, and the location of the person is “(100, 100), ( 200, 300), (300, 50) ", the degree of congestion is" 80% ", and the congestion location is" 0%, 0%, 50%, 80%, 70%, 30%, 0%, 0% " It is.

  In the case of a bit string, the requested statistical information is the same as the requested presence information. As shown in FIG. 17A, the statistical information includes a bit value indicating time, a bit value indicating presence or absence, and the number of people. A bit value indicating the presence position of the person, a bit value indicating the degree of congestion, and a bit value indicating the congestion place.

  In the case of text information, the requested statistical information is the same as the requested presence information. As shown in FIG. 17B, the time value indicating the time is “2001/01/01” for the statistical information. The value of Exist indicating information is “Yes”, the value of Number indicating the number of people is “3”, and the value of Place indicating the position of the person is “(100, 100), (200, 300), (300, 50)”. "The value of Jam Rate indicating the degree of congestion is" 0.8 ", and the value of Jam Place indicating the congestion place is" 0, 0, 0.5, 0.8, 0.7, 0.3, 0, 0 " "

  Next, the operation of the presence monitoring system according to the fifth embodiment will be described with reference to FIG.

  FIG. 14 is a flowchart showing the operation of the presence monitoring system according to the fifth embodiment.

  As shown in FIG. 14, the presence determination processing unit 32 of the camera connection terminal 3 acquires image information indicating an image captured by the camera unit 4 (step 404), and the presence of the subject, The presence information such as the position of the person is determined (step 405). Here, for the determination of presence information by image processing, the methods (A) to (D) described in the first embodiment and the methods (S) to (V) described above are used. The presence information storage unit 6 of the camera connection terminal 3 stores the determined presence information together with the time (step 406). The camera connection terminal 3 repeats Step 404 and Step 406.

  When the user wants to know statistical information such as presence / vacancy in the place where the camera unit 4 is installed, the user inputs the requested presence information from the request source terminal 1 (step 401). As an input form, for example, a requested presence information input window is displayed on the display of the request source terminal 1. The user selects the name (person or store) of the other party who wants to know the presence information as the requested presence information. At this time, in the case of a person, if the user selects statistical information in the options of presence information and statistical information, the user can specify an address destination owned by the camera connection terminal 3 corresponding to the selected person. In the case of a store, the user can select the type of statistical information and specify an address destination owned by the camera connection terminal 3 corresponding to the selected store. Further, the request source terminal 1 transmits the requested presence information to an address corresponding to the selected partner (person or store) (step 402). The requested presence information includes the name of the selected partner, the address owned by the camera connection terminal 3, and the address owned by the request source terminal 1 that is the request source. The requested presence information is received from the request source terminal 1 via the network 2 to the camera connection terminal 3 which is the designated address destination (step 403).

  Next, the request input unit 31 of the camera connection terminal 3 receives the requested presence information from the request source terminal 1 via the network 2, and stores the name of the selected partner included in the received requested presence information. The information is output to the seat determination processing unit 32, and the address owned by the request source terminal 1 included in the received requested presence information is output to the result output unit 33. The presence determination processing unit 32 inputs the name of the selected partner included in the request presence information from the request input unit 31 and the presence information (already obtained by the camera unit 4 corresponding to the input name ( For example, the presence information for the past month) is acquired from the presence information storage unit 6 (step 407).

  Next, the statistical information calculation unit 7 calculates statistical information from the presence information acquired from the presence information storage unit 6 (step 408), and outputs the calculated statistical information to the result output unit 33. Here, as the calculation of statistical information, the above-described methods (S) to (V) are used. The result output unit 33 transmits the statistical information calculated by the statistical information calculation unit 7 to the request source terminal 1 (step 409).

  Next, the request source terminal 1 receives the statistical information transmitted via the network 2 (step 410), presents the presence / vacancy on the display by the statistical information, and notifies the user (step 411). As a presentation method, presentation may be performed in the same manner as in the first embodiment, and a graph may be displayed in addition to characters.

  Thereby, the presence monitoring system according to Embodiment 5 can obtain useful information such as the congestion rate by performing statistical calculation from the presence information.

  The presence monitoring system according to Embodiment 5 is not limited to the above description. The present invention can be used not only for the presence of a person at a monitoring location but also for determining the status of the monitoring location. For example, the state determination of the monitoring place includes an on / off state of electricity, an open / closed state of a door, and the like.

  The status determination of the monitoring place can be realized as follows.

  In order to determine whether the electricity is on or off, the average luminance of the pixels in the captured screen is obtained. If the average luminance is less than or equal to a threshold value, the light is turned off.

  As for the open / closed state of the door, for example, the door area in the image with the door closed (area around the door indicated by the camera 4) and the door image (the door position indicated by the camera 4) are the same as in the determination method during the phone call. Image) is stored in advance in the memory 32a of the presence determination processing unit 32. The presence determination processing unit 32 uses the fact that the brightness difference between the door image with the door opened and the door image with the stored door closed is large, in the stored door area in the image. This can be realized by a method of obtaining a difference between the current image and the door image and determining that the door is open when the difference exists. If there is noise, a difference occurs even if the door is closed, so a threshold is provided, and it is determined that the door is open when there is a difference greater than a certain threshold. Further, in order to cope with the generation of a large noise whose difference is equal to or greater than a threshold value, it is assumed that the door is opened when the difference occurs for the number of pixels equal to or greater than a certain threshold value. Furthermore, when dealing with a difference in brightness between the current image and the stored door image due to a change in lighting, an average brightness change value in the image or within a predetermined range is obtained, and the door image brightness The difference between the difference and the average luminance change value may be taken, and it may be determined that the door is open when this difference occurs.

  In addition, the presence monitoring system according to the fifth embodiment, as an input form of the request information, points the icon displayed on the screen by the pointing unit, and specifies the address or person name to be specified together with the presence information acquisition command from the keyboard. There is also a form such as inputting.

  Further, the presence monitoring system according to the fifth embodiment is not limited to a mode in which the camera unit 4 and the camera connection terminal 3 are directly connected, and the camera unit 4 and the camera connection terminal 3 are connected via the network 2. May be.

  In addition, the presence information storage unit 6 and the statistical information calculation unit 7 are not limited to being added only to the presence monitoring system according to the fifth embodiment, and can be added to the first to fourth embodiments. In this case, the presence information storage unit 6 and the statistical information calculation unit 7 are provided in the camera connection terminal 3 of the presence monitoring system according to the first or second embodiment, and the request of the presence monitoring system according to the third embodiment. It is desirable to be provided in the former terminal 1 and in the server 5 of the presence monitoring system according to the fourth embodiment.

  Further, the presence monitoring system according to the fifth embodiment is not limited to the camera connection terminal 3 and may be a server.

  As described above, the presence monitoring system according to the fifth embodiment can obtain useful information such as the congestion rate by performing statistical calculation from the presence information in addition to the effects of the first embodiment. it can.

FIG. 1 is a block diagram showing the configuration of the monitoring system according to the first embodiment. FIG. 2 is a block diagram showing the configuration of the monitoring system according to the second embodiment. FIG. 3 is a block diagram illustrating a configuration of the monitoring system according to the third embodiment. FIG. 4 is a block diagram showing the configuration of the monitoring system according to the fourth embodiment. FIG. 5 is a block diagram showing a configuration of the monitoring system according to the fifth embodiment. FIG. 6 is a flowchart showing an operation of performing a discrimination process after receiving (1) requested presence information in the monitoring system according to the first embodiment. FIG. 7 is a flowchart showing the operation of (2) always performing the discrimination process in the monitoring system according to the first embodiment. FIG. 8A is a flowchart showing the operation of the camera connection terminal when the output transmission form is website data in the monitoring system according to the second embodiment, and FIG. 8B is a flowchart showing the second embodiment. It is a flowchart figure which shows operation | movement of the request origin terminal in case the monitoring system which concerns on (3) output transmission form is Web site data. FIG. 9 is a flowchart showing an operation when (4) output transmission form is mail in the monitoring system according to the second embodiment. FIG. 10 is a flowchart showing an operation of performing a discrimination process after (5) requested presence information is input in the monitoring system according to the third embodiment. FIG. 11 is a flowchart showing the operation of (6) always performing the discrimination process in the monitoring system according to the third embodiment. FIG. 12A is a flowchart showing the operation of the camera connection terminal when the output transmission form is Web site data in the monitoring system according to the fourth embodiment, and FIG. 12B is the flowchart showing the fourth embodiment. It is a flowchart figure which shows operation | movement of a request origin terminal in case the monitoring system which concerns on (7) output transmission form is Web site data. FIG. 13 is a flowchart showing an operation when the output transmission form is mail in the monitoring system according to the fourth embodiment. FIG. 14 is a flowchart showing the operation of the monitoring system according to the fifth embodiment. FIG. 15 is a diagram showing a format when the requested presence information and presence information are bit strings. FIG. 16 is a diagram showing a format when the requested presence information and presence information are text information. FIG. 17A is a diagram showing a format when the statistical information is a bit string, and FIG. 17B is a diagram showing a format when the statistical information is text information. FIG. 18 is a block diagram showing the configuration of a conventional image display system on the Web.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Request source terminal 2 Network 3 Camera connection terminal 4 Camera part 5 Server 6 Attendance information storage part 7 Statistical information calculation part 8 Recording medium 11 Request input part 12 Attendance discrimination | determination part 12a Memory 13 Result output part 13a Memory 31 Request input Unit 32 Presence determination processing unit 32a Memory 33 Result output unit 33a Memory 51 Request input unit 52 Presence determination processing unit 53 Presence information storage unit 91 PC terminal 92 Network camera

Claims (20)

Comparing the images of a plurality of stores taken at different times to determine the presence of the subject in the image;
And a statistical analysis of the presence ratio. Comparing a plurality of store images taken at different points in time to determine an area in which the subject is present;
And a statistical analysis step using the existing area.   The monitoring method according to claim 1, wherein the statistical analysis is related to a congestion degree of a store.   The monitoring method according to claim 1, wherein the statistical analysis is related to a crowded place in a store.   The monitoring method according to claim 1, wherein the statistical analysis is related to a flow of customers in the store. A camera unit that captures and transmits a predetermined area as an image;
A requesting terminal connected to the network and transmitting survey request information;
Connected to the network, and according to the survey request information, compares the images of a plurality of stores taken at different points in time to determine the presence of a person to be photographed in the image, and statistically analyzes the presence ratio. And a camera connection terminal that outputs the result to the request source terminal. A camera unit that captures and transmits a predetermined area as an image;
A requesting terminal connected to the network and transmitting survey request information;
Connected to the network, and according to the survey request information, compares the images of a plurality of stores taken at different points in time to determine the area where the subject is present in the image, and uses the existing area And a camera connection terminal that statistically analyzes the result and outputs the result to the request source terminal.   The monitoring system according to claim 6 or 7, wherein the statistical analysis is related to a congestion degree of a store.   The monitoring system according to claim 6 or 7, wherein the statistical analysis is related to a crowded place in a store.   The monitoring system according to claim 6 or 7, wherein the statistical analysis relates to a flow of customers in the store. A monitoring device connected via a network to a request source terminal that transmits survey request information,
A camera unit that captures and transmits a predetermined area as an image;
According to the survey request information, images of a plurality of stores taken at different points in time are compared to determine the presence of a person to be photographed in the image, and the ratio of the presence is statistically analyzed, and the result is the request. A monitoring apparatus comprising: a camera connection terminal that outputs to an original terminal. A monitoring device connected via a network to a request source terminal that transmits survey request information,
A camera unit that captures and transmits a predetermined area as an image;
According to the survey request information, compare the images of a plurality of stores taken at different points in time to determine the area where the subject is present in the image, and perform statistical analysis using the existing area, A monitoring apparatus comprising: a camera connection terminal that outputs a result to the request source terminal.   The monitoring apparatus according to claim 11, wherein the statistical analysis is related to a congestion degree of a store.   The monitoring apparatus according to claim 11 or 12, wherein the statistical analysis is related to a crowded place in a store.   The monitoring apparatus according to claim 11, wherein the statistical analysis is related to a flow of customers in the store. A monitoring server connected to a requesting terminal that transmits survey request information via a network, connected to a camera unit that captures and transmits a predetermined area as an image,
According to the survey request information, images of a plurality of stores taken at different points in time are compared to determine the presence of a person to be photographed in the image, and the ratio of the presence is statistically analyzed, and the result is the request A monitoring server that outputs to a former terminal. A monitoring server connected to a requesting terminal that transmits survey request information via a network, connected to a camera unit that captures and transmits a predetermined area as an image,
According to the survey request information, compare the images of a plurality of stores taken at different points in time to determine the area where the subject is present in the image, and perform statistical analysis using the existing area, A monitoring server that outputs a result to the request source terminal.   The monitoring server according to claim 16 or 17, wherein the statistical analysis is related to a congestion degree of a store.   The monitoring server according to claim 16 or 17, wherein the statistical analysis is related to a crowded place in a store.   The monitoring server according to claim 16 or 17, wherein the statistical analysis relates to a flow of customers in a store.

Images