JP2018097843A - Information processing apparatus, method for controlling information processing apparatus, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism that can easily grasp a result of continuous use of a predetermined area by a single person.SOLUTION: An information processing apparatus counts the period of continuous use of a predetermined area by a single person as a result of use, by using a result of recognition of people captured in a plurality of pieces of time-series image data, and displays a result of counting.SELECTED DRAWING: Figure 7

Description

  The present invention relates to an information processing apparatus, a control method for the information processing apparatus, and a program, and more particularly to a mechanism capable of easily grasping a continuous use record of a predetermined area in the same person.

  In general, companies have so-called “free spaces” in which meetings can be held without reservations, in addition to conference rooms that require reservations.

  Free space has the advantage that if a sudden meeting occurs, you can have a meeting immediately in the free space, but because there is no reservation required, who is currently using the free space up to the location of the free space There is a demerit that it is necessary to move and check, and if it is not free, it is necessary to return once.

  Therefore, it is conceivable that it is possible to check whether there is a person in the free space by shooting the free space with a network camera and allowing the user to check the shot video.

  Patent Document 1 discloses a mechanism that allows a user to check a captured video by shooting a conference room with a network camera.

JP 2012-34151 A

  By the way, in the free space, because it is not known how long the user in the free space is in the free space, "I'm about to be free because it's about 2 hours soon" or " There is another demerit that it is difficult to predict the time when there is free space such as “it will not be free”.

  This demerit is a demerit that is not solved even if the conference room is photographed with a network camera and the photographed video can be confirmed by the user.

  Therefore, even if the technique disclosed in Patent Document 1 is used, the user needs to check the video of the network camera on a small scale.

  An object of this invention is to provide the structure which can grasp | ascertain the continuous use track record of the predetermined area in the same person easily.

  The present invention provides a management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area, and a recognition result of a person shown in the plurality of time-series image data managed by the management unit , And a display control means for controlling to display a count result by the counting means.

  The present invention is also a control method of an information processing apparatus including a management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area, and the counting unit of the information processing apparatus includes: A counting step of counting a continuous use record of the predetermined area in the same person using a recognition result of a person shown in a plurality of time-series image data managed by the management means; and a display of the information processing apparatus The control means includes a display control step for controlling to display the count result in the counting step.

  In addition, the present invention is a program that can be read and executed by an information processing apparatus including a management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area. Counting means for counting a continuous use record of the predetermined area in the same person using a recognition result of a person shown in a plurality of time-series image data managed by the management means, and a count result by the counting means It is made to function as a display control means which controls to display.

  According to the present invention, it is possible to easily grasp the continuous use record of a predetermined area in the same person.

It is a figure which shows an example of the whole structure of the monitoring system in embodiment of this invention. It is a figure which shows an example of the hardware constitutions of the information processing apparatus applicable to the server 100 and client PC101 in embodiment of this invention. It is a figure which shows an example of a hardware structure of the network camera which concerns on embodiment of this invention. It is a figure which shows an example of the floor of the building in which the monitoring system in embodiment of this invention was introduced. It is a figure which shows an example of the browsing screen of the image data of the network camera 102 in embodiment of this invention. It is a figure which shows an example of the browsing screen of the image data of the network camera 102 in embodiment of this invention. It is a figure which shows an example of the browsing screen of the image data of the network camera 102 in embodiment of this invention. It is a figure which shows an example of the warning mail in embodiment of this invention. It is a figure which shows an example of a user's stay time count process in embodiment of this invention. It is a figure which shows an example of the display process which displays the image data of the network camera 102 which image | photographs the space 401 selected according to user operation in embodiment of this invention. It is a figure which shows other embodiment of a user's stay time count process in embodiment of this invention. It is a figure which shows an example of the user information table in embodiment of this invention. It is a figure which shows other embodiment of a user's stay time count process in embodiment of this invention. It is a figure which shows an example of the use performance count process of a user's free space in embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. The embodiment described below shows an example when the present invention is specifically implemented, and is one of the specific embodiments having the configurations described in the claims.

  First, an example of the overall configuration of the monitoring system in the embodiment of the present invention will be described with reference to FIG.

  In a monitoring system (information processing system) according to an embodiment of the present invention, a server 100, a client PC 101, and a network camera 102 are connected via a wireless (or wired) LAN 120 so that they can communicate with each other. Note that the system configuration in FIG. 1 is an example, and there are various configuration examples depending on the application and purpose.

  The server 100 stores and manages image data captured by the network camera 102. Further, the server 100 analyzes the image data stored and managed by the server 100, and counts the time that the user stays in the area where the user is photographing with the network camera and the identification of the user included in the image data. Furthermore, the server 100 has a function of notifying when the counted time becomes a predetermined time or more.

  The monitoring system in the embodiment of the present invention includes a plurality of network cameras 102 and performs communication using the TCP / IP protocol. Each network camera 102 is uniquely assigned with a fixed IP address, and a network group. An external port number assigned for each is assigned.

  Therefore, the server 100 can identify which network camera 102 the received image data is transmitted from, and can determine which network camera 102 the received image data is transmitted from. Corresponding storage management is possible.

  The network camera 102 is provided, for example, for each meeting space (hereinafter, also referred to as “free space” or simply “space”) on the floor of a company building, and photographs a user who enters and exits each meeting space.

  The client PC 101 is used by a user to browse image data (video from the network camera 102) managed by the server 100. The user can browse the image data by logging into the monitoring system via the client PC 101. The user can check whether there is a user in the meeting space by viewing the image. This is the end of the description of FIG.

  Next, an example of the hardware configuration of the information processing apparatus applicable to the server 100 and the client PC 101 illustrated in FIG. 1 will be described with reference to FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. In the ROM 202 or the external memory 211, a BIOS (Basic Input / Output System), an operating system program (hereinafter referred to as OS), which is a control program of the CPU 201, and various functions described later that are necessary for realizing the functions executed by the PC. Programs and so on are stored.

  A RAM 203 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program necessary for execution of processing from the ROM 202 or the external memory 211 into the RAM 203 and executing the loaded program.

  An input controller 205 controls input from a pointing device such as a keyboard (KB) 209. A video controller 206 controls display on a display device such as a CRT display (CRT) 210. In FIG. 2, although described as CRT 210, the display device is not limited to the CRT, but may be another display device such as a liquid crystal display.

  A memory controller 207 is provided in an external storage device (hard disk (HD)), a flexible disk (FD), or a PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 211 such as a compact flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the CRT 210 by executing outline font rasterization processing on a display information area in the RAM 203, for example. In addition, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the CRT 210.

  Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 203 as necessary. Further, a setting file used when executing the program is also stored in the external memory 211, and detailed description thereof will be described later. This is the end of the description of FIG.

  Next, an example of a hardware configuration of the network camera 102 illustrated in FIG. 1 will be described with reference to FIG. FIG. 3 is a configuration diagram illustrating a hardware configuration of the network camera 102.

  The CPU 301 comprehensively controls each device and controller connected to the system bus 304. Further, the ROM 302 or the external memory 305 is necessary for realizing the functions executed by the BIOS (Basic Input / Output System), the operating system program (hereinafter referred to as OS), and the image processing server 108, which are control programs of the CPU 301. Various programs to be described later are stored. A RAM 303 functions as a main memory, work area, and the like for the CPU 301.

  The CPU 301 implements various operations by loading a program or the like necessary for execution of processing into the RAM 303 and executing the program.

  The memory controller (MC) 306 is a compact connected via an adapter to a hard disk (HD) or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, image data, and the like. Controls access to an external memory 305 such as a flash memory or smart media (registered trademark).

  The camera unit 307 is connected to the image processing unit 308 and performs photoelectric conversion on the light obtained through the lens directed toward the monitoring target by a light receiving cell such as a CCD or CMOS, and then outputs an RGB signal. Or a complementary color signal is output to the image processing unit 308.

  The image processing unit 308 performs white balance adjustment, gamma processing, and sharpness processing based on the RGB signal and the color collection signal, and further performs YC signal processing to generate a luminance signal Y and a chroma signal (hereinafter referred to as YC signal). Then, the YC signal is compressed in a predetermined compression format (for example, JPEG format or Motion JPEG format), and the compressed data is temporarily stored in the external memory 305 as image data.

  A communication I / F controller (communication I / FC) 309 connects and communicates with an external device via a network, executes communication control processing on the network, and stores an image stored in the external memory 305. Data is transmitted to the external device by the communication I / F controller 309. This is the end of the description of FIG.

  Next, an example of a floor of a building in which the monitoring system according to the embodiment of the present invention is introduced will be described with reference to FIG. FIG. 4 is a view of the floor as viewed from above.

  As shown in FIG. 4, in the floor 400, each space 401 (one space in the dotted frame) is partitioned by a partition except for the entrance.

  The network camera 102 is installed in each space 401 so that the entire space 401 can be photographed. A desk 402 is arranged in the space 401. Reference numeral 403 denotes a user in the space 401.

  In the monitoring system according to the embodiment of the present invention, the space 401 is not reserved and used from the system, but is a so-called “free space” that anyone can use freely if it is free.

  Therefore, if there is no network camera 102, for example, when a user on a floor different from the floor 400 wants to use the space 401, it is necessary to move to the floor 400 and check whether the space 401 is free. If it is not free, it is necessary to return or wait until it is free.

  Therefore, in the monitoring system according to the embodiment of the invention, the network camera 102 is installed in the space 401, and the user can check the image data (video) of the network camera 102 via the client PC 101, thereby eliminating the above-described trouble. It is possible to do.

  However, even if the user can check the image data of the network camera 102 via the client PC 101, since the user who uses the space 401 does not know how much time the space 401 is occupied from the video, After all, the user needs to check the image data on a small scale, which is troublesome.

  Therefore, in the monitoring system according to the embodiment of the present invention, the server 100 analyzes the image data acquired from the network camera, determines whether there is a user in the space 401, and counts the time in the space if there is a user. When receiving a request for browsing the image data of the network camera 102 from the user via the client PC 101, the network camera is configured so that the user can recognize the staying time of the user in the space 401 using the counted time information. A browsing screen for image data 102 is generated.

  By doing so, since the user can consider the approximate time when the space 401 is available, it is only necessary to check the image data of the network camera 102 in the time zone that is available, thereby reducing the trouble of checking the image data. Is possible.

  In this embodiment, each space 401 is physically divided by partition to partition the space 401. However, as another embodiment, image data obtained by photographing the floor 400 with the network camera 102. It is also possible to set one space 401 per desk by, for example, specifying a desk or chair from the image data. By doing so, it becomes possible to partition each space 401 without physically partitioning by partition.

  As a method of specifying a desk or chair, a method of specifying a plurality of image data obtained by photographing a desk or chair by loading the server 100 in advance and learning the desk or chair can be considered.

  The browsing screen of the image data of the network camera 102 generated so that the user can recognize the staying time of the user in the space 401 is, for example, the screen shown in FIGS.

  Now, an example of the image data browsing screen of the network camera 102 will be described with reference to FIGS.

  FIG. 5 is an example of a screen generated by the server 100 in accordance with a request from the client PC 101 and displayed on the display 210 of the client PC 101.

  FIG. 6 is an example of a screen generated by the server 100 in accordance with a request from the client PC 101 and displayed on the display 210 of the client PC 101, and is another embodiment of the screen of FIG.

  In the embodiment of the present invention, FIG. 5 and FIG. 6 assume a screen in which the actual floor 400 is illustrated, but as another embodiment, the network camera 102 capable of photographing the entire floor 400 is used as the floor 400. The actual image data captured by the network camera 102 may be displayed on the screen as shown in FIGS.

  Further, when the network camera 102 capable of photographing the entire floor 400 is installed on the floor 400, each space 401 is configured by the network camera 102 capable of photographing the entire floor 400 without installing the network camera 102 for each space 401. By setting the presets of the network camera 102 so that images are taken sequentially, it is possible to count the usage records of users who use each space 401.

  A floor 500 indicates an area corresponding to the floor 400. A desk icon 506 is an icon corresponding to the desk 402. A space 501 indicates an area corresponding to the space 401.

  A space name 502 indicates a name for identifying each space 501. The network camera icon 504 is an icon corresponding to the network camera 102 installed in each space.

  The user icon 503 is an icon arranged on the corresponding space 501 when it is determined that there is a user in the space 401 as a result of analyzing the image data acquired by the server 100 from the network camera. When there are a plurality of users in the space 401, a plurality of user icons 503 are arranged.

  Also, the user icon 503 changes its color depending on the time that the user indicated by the user icon 503 stays in the space 401, and confirms the legend 505 to determine how much time each color has elapsed. Thus, the user can recognize. In the present embodiment, the color changes depending on the time the user stays. However, it is only necessary that the user can recognize the passage of time. As shown in the stay time 601 and the stay time 602 in FIG. It may be displayed near the icon 503.

  In FIG. 6, the stay time 601 and the stay time 602 are displayed near the user icon 503 instead of changing the color of the user icon 503. Further, as shown in the stay time 601 and the stay time 602, when there are a plurality of people, the stay time is displayed under each user icon 503.

  The screens shown in FIGS. 5 and 6 use each space 501 unlike the case where the stay time screen of the user who uses the space 501 is generated and displayed for each space 501 (for example, FIG. 7). Since it is possible to check the staying time of the user at once, there is an effect that visibility is improved for the user.

  FIG. 7 shows the selected space 501 displayed on the display 210 of the client PC 101 when the space name 502 or the network camera icon 504 is selected on the screens of FIGS. 5 and 6 according to the user operation. It is an example of the screen which displays the image data of the network camera 102 to image | photograph.

  As the space name 701, the same space name as the selected space name 502 is displayed on the screens of FIGS. 5 and 6 according to the user operation.

  The image data area 702 displays image data captured by the network camera 102 that captures the space 401 indicated by the space name 701.

  A user 703 indicates a user included in image data captured by the network camera 102. The user 703 is subjected to anonymization processing (specifically, for example, mask processing) by the server 100 so that an individual cannot be identified from the viewpoint of protecting personal information.

  When executing the anonymization process, the color of the mask is changed according to the time that the user stays with the passage of time. As another embodiment, the staying time may be displayed like the staying time 602 in FIG.

  In the embodiment of the present invention, the screen of FIG. 7 is displayed on the display 210 of the client PC 101 by selecting the space name 502 or the network camera icon 504 according to the user operation on the screens of FIGS. As another embodiment, instead of displaying the screens of FIGS. 5 and 6 on the display 210 of the client PC 101, the space name list screen is displayed instead, and the screen is selected from the list. You may display the image data of the network camera 102 which image | photographs a space on the screen of FIG. Above, description of FIGS. 5-7 is complete | finished.

  Next, using FIG. 8 and FIG. 12, a method for warning the user who has used the space 401 for a long time in the embodiment of the present invention will be described.

  Since the free space is a space provided for the user to make a meeting in a short time, it is not preferable for the same user to use the free space for a long time.

  Therefore, in the embodiment of the present invention, when the result that the server 100 counts the time that the same user stays in the space 401 is equal to or longer than the predetermined time, the space 401 is transferred to another user by notifying. Can be encouraged.

  As a means of notification, for example, a method of notifying by sending the warning mail shown in FIG. 8 to the user who has stayed in the space 401 for a long time or the department head of the organization to which the user belongs, A method may be considered in which a speaker is provided at 401 and a sound is notified from the speaker.

  When a warning mail is transmitted to a user, first, face image data (face image data 1205) obtained by photographing the face of a user (for example, an employee in a company) who may use the space 401 in advance. ) Is associated with user information reflected in the image data and managed in the external memory 211 of the server 100, and the image data acquired by the server 100 from the network camera 102 and the face image data 1205 are used using a known technique. To be identified.

  Next, for example, using the user information table shown in FIG. 12, the user's mail address (mail address 1202) or the mail address of the user's affiliation (mail address 1204) is specified, and the mail is transmitted. .

  FIG. 12 is a diagram showing an example of the user information table in the embodiment of the present invention. The user information table is stored in the external memory 211 of the server 100.

The user information table includes a user name 1201 indicating a user, an email address 1202 of the user indicated by the user name 1201, an belonging length name 1203 indicating the belonging length of the user indicated by the user name 1201, and an belonging length indicated by the belonging length name 1203. The user's face image data 1205 indicated by the e-mail address 1204 and the user name 1201 is registered in association with each other.
Above, description of FIG. 8 and FIG. 12 is complete | finished.

  Next, an example of a user's stay time counting process in the embodiment of the present invention will be described with reference to FIG.

  Each process shown in the flowchart of FIG. 9 is a process in which the CPU 201 of the server 100 reads and executes a predetermined program.

  In step S901, the server 100 activates the network camera 102 and sequentially acquires image data (video) from the network camera 102 (step S902).

  Step S902 and steps S1102, S1302, and S1402, which will be described later, are an example of a management unit that manages image data captured by an imaging unit that captures a predetermined area in the present invention, and imaging that captures a predetermined area. It is an example of the management means which manages the several time series image data imaged with the means.

  In step S903, the server 100 analyzes the image data sequentially acquired in step S902 to determine whether the user is shown. If the user is reflected, the server 100 shifts the process to step S905. If the user is not reflected, the server 100 shifts the process to step S904.

  Step S903, step S1103, and step S1303, which will be described later, are examples of determination means for determining whether a person is reflected in the image data managed by the management means in the present invention.

  In step S <b> 904, the server 100 determines whether an instruction to end this process has been received from the client PC 101 of the administrator who can communicate with the server 100. If the server 100 has received an end instruction, the process ends. If not, the server 100 returns the process to step S903.

  In step S905, the server 100 starts counting the staying time (also referred to as actual use) of the user determined to be reflected in step S903. The counted time is temporarily stored in the external memory 211 of the server 100 in association with the space name 502 of the space where the user is shown.

  Step S905, step S1105, and step S1303, which will be described later, are measuring means for measuring the time during which a person is shown when the determination means determines that a person is shown in the image data. Step S905, Step S1105, Step S1303, and Step S1403, which will be described later, use the recognition result of a person shown in a plurality of time-series image data managed by the management means in the present invention. It is an example of the counting means which counts the continuous use performance of the said predetermined area in the same person.

  In step S906, the server 100 determines whether the stay time specified by the count in step S905 has reached a predetermined time or more. If the stay time is equal to or longer than the predetermined time, the server 100 proceeds to step S907. If the stay time does not satisfy the predetermined time, the server 100 proceeds to step S908.

  In step S907, the server 100 performs notification (notification) processing. Specifically, the notification process is, for example, a method of notifying by sending the warning mail shown in FIG. 8 to the user who has stayed in the space 401 for a long time or the department head of the organization to which the user belongs. Alternatively, a method of providing a speaker in the space 401 and notifying by sound from the speaker can be considered.

  In step S908, the server 100 determines whether the user determined to be reflected in step S903 has left the seat according to whether the user no longer appears in the image data sequentially acquired in step S902. Judged as a seat).

  In step S909, if the user leaves the server, the server 100 temporarily stops the stay time count started in step S905. If the user is not away, the server 100 returns the process to step S905.

  In step S910, as in step S903, the server 100 sequentially acquires the image data acquired in step S902 (specifically, images taken by the network camera 102 after it is determined that the user has left in step S908). Data) is analyzed to determine whether the user is shown. If the user is reflected, the server 100 shifts the process to step S913. If the user is not reflected, the server 100 shifts the process to step S911.

  In step S911, the server 100 determines whether or not a predetermined time has elapsed since it was determined that the user had left the seat in step S908. If the predetermined time has elapsed, the server 100 shifts the process to step S912. If the predetermined time has not elapsed, the server 100 returns the process to step S910.

  In step S912, the server 100 determines that the user has stopped using the space 401, resets the staying time that started counting in step S905, and returns the process to step S903.

  In step S913, the server 100 determines whether the user determined to be reflected in step S910 and the user determined to be reflected in step S903 are the same user (same determination means in the present invention), and the same user If so, the process proceeds to step S915, and if not the same user, the process proceeds to step S914.

  In the process of step S913, as a method of determining whether the user who is determined that the server 100 is reflected in step S910 and the user who is determined to be reflected in step S903 are the same user, the user is determined in each step. Such as a bag or a PC on the desk 402 at the timing when it is determined that the user's facial feature amount reflected in the image data determined to be reflected matches each other, or at the timing when it is determined that the user has left the seat in step S908. It is determined whether or not an object remains, and if there is an object remaining, it is assumed that the user will return only if he / she is temporarily away, and the user who is determined to be reflected in step S913 is A method of determining that the user who has temporarily left the seat has returned, that is, the same user, can be considered.

  In step S <b> 914, the server 100 determines that another user is reflected from the user determined to be reflected in step S <b> 903, resets the staying time that started counting in step S <b> 905, and starts counting from 0. Is started, and the process proceeds to step S905.

  In step S915, the server 100 resumes the count of the staying time temporarily stopped in step S909, and the process proceeds to step S905.

  In this embodiment, the stay time count is temporarily stopped when it is determined that the user has left the seat in step S908. However, as another example, the stay time count may be continued without being paused. Above, description of FIG. 9 is complete | finished.

  Next, an example of display processing for displaying the image data of the network camera 102 that captures the space 401 selected according to the user operation in the embodiment of the present invention will be described with reference to FIG.

  Each process shown in the flowchart of FIG. 10 is a process in which the CPU 201 of the server 100 or the CPU 201 of the client PC 101 reads and executes a predetermined program.

  Note that the processing in FIG. 10 is disclosed at the timing when a login request is made from the client PC 101 to the server 100 in step S1001, and may be started in the middle of the processing in FIG.

  In step S <b> 1001, the client PC 101 makes a login request to the monitoring system including the user ID of the user and authentication information such as a password in accordance with the user operation.

  In step S1002, the server 100 executes login processing to the monitoring system according to the login request transmitted from the client PC 101 in step S1001. Specifically, the server 100 determines whether the user ID and password included in the login request transmitted from the client PC 101 match the user ID and password managed by the external memory 211 of the server 100 and logs in. Process to allow or reject.

  In step S <b> 1003, the server 100 acquires the stay status count status of each space 401 from the external memory 211.

  In step S1004, the server 100 generates the screen shown in FIG. 5 or FIG. 6 using the staying time count status of each space 401 acquired in step S1003, and transmits the screen to the client PC 101.

  In step S1005, the client PC 101 displays the screen transmitted from the server 100 in step S1004 on the display 210 of the client PC 101.

  In step S1006, the client PC 101 receives selection of a space name 502 desired to be browsed from the user on the screen shown in FIG. 5 or 6 displayed on the display 210 in step S1005.

  In step S <b> 1007, the client PC 101 transmits information on the space name 502 that has been selected in step S <b> 1006 to the server 100.

  In step S1008, the server 100 receives the information of the space name 502 transmitted from the client PC 101 in step S1007. In step S1009, the screen including the video of the network camera 102 that captures the space 401 indicated by the space name 502 is displayed. (For example, FIG. 7) is generated and transmitted to the client PC 101.

  In step S1010, the client PC 101 receives the screen transmitted from the server 100 in step S1009 and displays it on the display 210 of the client PC 101.

  Step S1010 is display control means for controlling to display a screen including the image data in accordance with the image data acquisition request in the present invention, and using the measurement result by the measurement means, the image of the person is displayed. It is an example of display control means for controlling to display the screen so that it can be identified, and step S1005 and step S1010 are for displaying the count result by the count means in the present invention. It is an example of the display control means to control. This is the end of the description of FIG.

  Next, another embodiment of the user stay time counting process in the embodiment of the present invention will be described with reference to FIG.

  In FIG. 9, when the server 100 finishes the process of step S912 (that is, when the user in the space 401 is no longer in the space 401), the server 100 has shifted to the process of step S903. When the user disappears from 401, the user who is thought to use the space 401 next time, that is, when the user is in the space 401, browses the image data of the space 401 via the client PC 101. The user is notified that the space 401 is empty.

  Each process shown in the flowchart of FIG. 11 is a process in which the CPU 201 of the server 100 reads and executes a predetermined program.

  In order to realize the processing of FIG. 11, in this embodiment, when a space selection is received in accordance with a user operation in step S1006, the space name 502 of the space that has received the selection and the user name 1201 of the user who has made the selection. If there are a plurality of selected users, the order of the selected users is managed in association with the external memory 211 of the server 100.

  Each process from step S1101 to step S1115 is the same as each process from step S901 to step S915 in FIG.

  In step S1116, the server 100 determines that the user is shown in step S1103 and before the process of step S1112 is executed, in step S1006 of FIG. 10, the space 401 in which the user is shown. It is determined whether there is a user who made the selection. If there is a user who has selected the space 401 in step S1006 of FIG. 10, the process proceeds to step S1117. If there is no user who has selected the space 401, the process proceeds to step S1103. .

  In step S1117, the server 100 refers to the user information table in FIG. 12, and in step S1006 in FIG. 10, the space 401 is added to the mail address 1202 associated with the user name 1201 of the user who selected the space 401. Send an e-mail indicating that it is available. When there are a plurality of users who have selected the space 401, the mail is transmitted in the order of the selected users. This is the end of the description of FIG.

  Next, another embodiment of the user stay time counting process in the embodiment of the present invention will be described with reference to FIG.

  In the present embodiment, when there are a plurality of users in the space 401, the staying time is started from the timing at which all the users seem to have been prepared.

  Because, when a meeting is usually made by multiple people, it should start after all of them have gathered, and if the stay time is counted from the timing of the first visit, even if the stay time is long There is a possibility that the time after the meeting has started has not passed so much, and if there is a user who has confirmed the elapsed time in that situation, there is a possibility that it will be misunderstood that it is almost time.

  For this reason, in the present embodiment, the counting of the staying time is started from the timing when all the users seem to have been prepared.

  Each process shown in the flowchart of FIG. 13 is a process in which the CPU 201 of the server 100 reads and executes a predetermined program.

  Each process from step S1301 to step S1315 is the same as each process from step S901 to step S915 in FIG.

  In step S <b> 1316, the server 100 determines whether the stay time that has started counting in step S <b> 1305 has passed a predetermined time serving as a determination criterion for executing the processing in steps S <b> 1317 and S <b> 1318. If the predetermined time has elapsed, the server 100 proceeds to step S1306, and if the predetermined time has not elapsed, the server 100 proceeds to step S1317.

  In step S1317, the server 100 determines whether the number of users reflected in the image data acquired from the network camera 102 has increased.

  If the number of users has increased, the server 100 shifts the process to step S1318, and if not, returns the process to step S1316.

  In step S1318, the server 100 resets the staying time that started counting in step S1305 and starts counting from zero.

In the case of the embodiment shown in FIG. 13, in step S1308, the server 100 determines whether all the users determined to be reflected in the image data acquired from the network camera 102 have left their seats. If not, the process returns to step S1305. When the process returns to step S1305, the processes from step S1316 to step S1318 are not performed.
This is the end of the description of FIG.

  Next, another embodiment in which the counting method is different from the user stay time counting process shown in FIG. 9 in the embodiment of the present invention will be described using FIG. FIG. 14 is a diagram illustrating an example of a usage record counting process of a user's free space.

  In the present embodiment, instead of counting the user's stay time, the server 100 acquires image data captured by the network camera 102 at every predetermined timing (for example, every 1 minute), and is identical to the acquired image data. The server 100 counts the number of times the user is shown.

  Each process shown in the flowchart of FIG. 14 is a process in which the CPU 201 of the server 100 reads and executes a predetermined program.

  Each process from step S1401 to step S1404 is the same as each process from step S901 to step S904 in FIG.

  In step S1405, the server 100 starts counting the number of times the user who is determined to be reflected in step S1403 is reflected. More specifically, when the user first appears in the image data sequentially acquired from the network camera 102 in step S1402, the first count is performed, and the user also applies to the image data next to the image data that the user first reflected. If it is reflected, “+1” is counted, and thereafter the count is incremented by 1 as long as the user is continuously reflected.

  Note that the counted number is temporarily stored in the external memory 211 of the server 100 in association with the space name 502 of the space in which the user is shown.

  Step S1405 is a counting unit that counts the continuous use record of the predetermined area in the same person using the recognition result of the person shown in a plurality of time-series image data managed by the management unit in the present invention. It is an example.

  In step S1406, the server 100 counts in step S1405, and determines whether the number of counts stored in the external memory 211 of the server 100 is equal to or greater than a predetermined number (for example, 60 times) set in advance. If the count number is equal to or greater than the predetermined number, the server 100 proceeds to step S1407. If the count number does not reach the predetermined number, the server 100 proceeds to step S1408.

  In step S1407, the server 100 performs notification (notification) processing. Specifically, the notification process is, for example, a method of notifying by sending the warning mail shown in FIG. 8 to the user who has stayed in the space 401 for a long time or the department head of the organization to which the user belongs. Alternatively, a method of providing a speaker in the space 401 and notifying by sound from the speaker can be considered.

  In step S1408, the server 100 determines whether the user determined to be reflected in step S1403 has left the seat according to whether the user no longer appears in the image data sequentially acquired in step S1402. Judged as a seat).

  If the user leaves the table, the server 100 shifts the process to step S1409, pauses the count started in step S1405, and returns the process to step S1405 if the user is not away.

  In step S1409, as in step S1403, the server 100 sequentially acquires the image data acquired in step S1402 (specifically, images taken by the network camera 102 after it is determined that the user has left in step S1408). Data) is analyzed to determine whether the user is shown.

  If the user is reflected, the server 100 shifts the process to step S1412. If the user is not reflected, the server 100 shifts the process to step S1410.

  If it is determined that the user is not shown, the server 100 counts the number of times the user is not shown and temporarily associates it with the space name 502 of the space where the user is not shown in the external memory 211 of the server 100. To remember.

  In step S1410, the server 100 determines whether or not the number of times the user is not continuously reflected in the image data captured by the network camera 102 after determining that the user has left the seat in step S1408 is a predetermined number or more. It is specified by referring to the number of times stored in the external memory 211 of the server 100 in S1409.

  The server 100 moves the process to step S1411 if the number of times the user is not continuously reflected is equal to or greater than the predetermined number, and moves to step S1409 if the number is less than the predetermined number.

  In step S1411, the server 100 determines that the user has stopped using the space 401, starts counting in step S1405, resets the number of times stored in the external memory 211 of the server 100, and returns the process to step S1403.

  In step S1412, the server 100 determines whether the user determined to be reflected in step S1410 and the user determined to be reflected in step S1403 are the same user. If not a user, the process proceeds to step S1413.

  In step S <b> 1413, the server 100 determines that a user other than the user determined to be reflected in step S <b> 1403 is reflected, starts counting in step S <b> 1405, and stores the count in the external memory 211 of the server 100. The number of times is reset, the count is started from 0, and the process proceeds to step S1405.

In step S1414, the server 100 starts counting in step S1405, restarts counting the number of times stored in the external memory 211 of the server 100, and proceeds to step S1405.
This is the end of the description of FIG.

Note that step S1105 in FIG. 11 and step S1305 in FIG. 13 are in step S1405 in FIG. 14, step S1106 in FIG. 11 and step S1306 in FIG. 13 are in step S1406 in FIG. 14, step S1111 in FIG. Step S1311 in FIG. 14 is Step S1410 in FIG. 14, Step S1112 in FIG. 11 and Step S1312 in FIG. 13 are in Step S1411 in FIG. 14, Step S1114 in FIG. 11 and Step S1314 in FIG. 11 is applied to the embodiment of FIGS. 11 and 13 by changing the processing from step S1115 of FIG. 11 and step S1315 of FIG. 13 to step S1414 of FIG. Because I count Without counting the number of times the same user is reflected) it is possible.
When counting the number of times the same user is shown instead of counting the staying time of the user, on the screens of FIGS. 5 to 7, for example, the color of the user icon 503 or the mask is changed depending on the counted number of times. Or the counted number of times is displayed instead of the staying time 602.

  As mentioned above, according to this invention, the continuous use track record of the predetermined area in the same person can be grasped | ascertained easily.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, or the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed as being limited thereto. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 Server 101 Client PC
102 Network camera

Claims (13)

A management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area;
Counting means for counting a continuous use record of the predetermined area in the same person using a recognition result of a person shown in a plurality of time-series image data managed by the management means;
An information processing apparatus comprising: display control means for controlling to display a count result by the counting means.   The information processing apparatus according to claim 1, wherein the counting unit counts a usage time of the predetermined area in the same person as the usage record.   The information processing apparatus according to claim 1, wherein the counting unit counts the number of times the same person is continuously recognized in the predetermined area as the usage record. A determination means for determining whether the person shown in the image data is no longer shown in the image data;
The information processing apparatus according to claim 1, wherein the counting unit temporarily stops counting by the counting unit when the determining unit determines that the person is no longer reflected in the image data. The determination means determines whether the person is reflected in the image data again after determining that the person is not reflected in the image data;
If it is determined by the determination means that a person is reflected in the image data again, the same determination means for determining whether the person is the same as the person who was previously determined to be reflected in the image data by the determination means. Prepared,
The counting means restarts counting by the counting means when it is determined by the same determining means that the person is the same person, and when it is determined by the same determining means that the person is not the same person, 5. The information processing apparatus according to claim 4, wherein the count is reset and then restarted. The determination unit determines whether or not all of the persons appear in the image data when a plurality of persons appear in the image data;
The counting means temporarily stops counting by the counting means when all the persons appearing in the image data are judged not to appear in the image data by the judging means, and appears in the image data. 6. The information according to claim 4, wherein when it is determined that even one person is reflected in the image data, the counting by the counting unit is continued without being paused. Processing equipment.   Acquired when a person who is determined to be reflected in the image data by the determination means receives a request for acquiring the image data before the determination means determines that the image data is no longer reflected in the image data. The information processing apparatus according to claim 4, further comprising a notification unit that notifies a request source that a person is no longer in the area.   The display control means displays a screen in which the person shown in the image data is masked, and further changes the color of the mask according to the usage results counted by the counting means, thereby the predetermined area of the person. The information processing apparatus according to any one of claims 1 to 7, wherein the information processing apparatus is controlled so as to display the screen that makes it possible to identify the continued use record of the information.   9. The information processing apparatus according to claim 1, further comprising a notification unit configured to notify that when the usage record counted by the counting unit exceeds a predetermined value.   10. The counting unit according to claim 1, wherein when it is determined that a plurality of persons are shown in the one image data managed by the managing unit, the counting unit counts a use record for each person. The information processing apparatus according to any one of claims. The management unit manages a plurality of time-series image data captured by an imaging unit that captures a plurality of different predetermined areas,
The counting means counts a continuous use record of the predetermined area in the same person for each predetermined area,
The said display control means controls so that the screen which put together the continuous use track record of the said predetermined area in the same person for every said predetermined area may be displayed. The information processing apparatus according to item 1. A control method of an information processing apparatus including a management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area,
The count means of the information processing apparatus uses the recognition result of a person shown in a plurality of time-series image data managed by the management means, and counts the continuous use record of the predetermined area in the same person Process,
The display control means of the said information processing apparatus is provided with the display control process controlled to display the count result in the said count process. The control method of the information processing apparatus characterized by the above-mentioned. A program that can be read and executed by an information processing apparatus including a management unit that manages a plurality of time-series image data captured by an imaging unit that captures a predetermined area,
The information processing apparatus;
Counting means for counting a continuous use record of the predetermined area in the same person using a recognition result of a person shown in a plurality of time-series image data managed by the management means;
A program that functions as display control means for controlling to display a count result by the counting means.

Images