WO2018221030A1

WO2018221030A1 - Headcount management device, and headcount management method and program

Info

Publication number: WO2018221030A1
Application number: PCT/JP2018/015324
Authority: WO
Inventors: 太一松井
Original assignee: キヤノン株式会社
Priority date: 2017-05-30
Filing date: 2018-04-12
Publication date: 2018-12-06
Also published as: US11250273B2; JP2018207175A; CN110709857B; JP6910208B2; US20200097736A1; EP3633986A1; CN110709857A; EP3633986A4

Abstract

This headcount management device manages, on the basis of image data obtained by an image capturing means, a headcount, sets any one among a regional headcount for counting the number of people present in a prescribed region of the corresponding image data and a passing headcount for counting the number of people passing a prescribed line set in the corresponding image data, constructs, from the corresponding image data, a head counting result according to the corresponding setting, and displays the corresponding head counting result. When the corresponding area headcount is set, the headcount management device constructs, as the corresponding head counting result, a still image, and when the corresponding passing headcount is set, the headcount management device constructs, as the corresponding head counting result, a moving picture.

Description

Number management device, number management method and program

The present invention relates to a number management device, a number management method, and a program.

In recent years, surveillance cameras are being installed in various places. In addition, recently, a security camera has been installed in a building, and an image taken by the monitoring camera is reproduced and viewed by a building administrator, etc., so that analysis for the purpose of security and sales promotion can be performed. Development is underway.

For example, Patent Document 1 discloses a technique for detecting the number of specific objects such as a person from an image captured by an imaging device and outputting information corresponding to the number. Patent Document 2 describes a technique for displaying the detected result in an easy-to-understand manner for an administrator or the like. Specifically, Patent Document 2 displays a histogram of the number of visitors to a predetermined area by time zone, and is selected in response to selection of a graph of an arbitrary time zone of the histogram. A system for displaying an image picked up by an image pickup device during a predetermined time period is disclosed.

JP 2014-6586 A JP 2010-181920 A

Depending on the purpose of image analysis, it is necessary to know the number of people in a given area and the number of people who pass through a given position in the given area according to time zones, taking into account human movements. . It is also important to present (display) the counted number of people in an easy-to-understand manner to an administrator or the like. However, the technique disclosed in the above document does not satisfy such a requirement.

In view of the above problems, the present disclosure provides a technique for detecting the number of persons existing in a predetermined area and the number of persons passing through a predetermined position of the predetermined area and performing display corresponding to each detection method. To do.

As a means for achieving the above object, the number management device of the present invention has the following configuration. That is, a number management device that manages the number of people for each time zone based on image data obtained by an imaging unit, the area number count for counting the number of persons existing in a predetermined area of the image data, and the image data Setting means for setting one of passing person counts for counting the number of persons passing through a predetermined line set in the display, and a display for displaying the result of counting people from the image data in accordance with the setting by the setting means And when the area number count is set by the setting means, the display control means is a still image photographed by the imaging means in a time zone corresponding to the selected number of people count result. Is displayed, and when the passing means count is set by the setting means, in the time zone corresponding to the selected count result Playing a moving image taken by serial imaging means.

According to the present invention, it is possible to detect the number of persons existing in a predetermined area and the number of persons passing through a predetermined position of the predetermined area, and display corresponding to each detection method.

Other features and advantages of the present invention will become apparent from the following description with reference to the accompanying drawings. In the accompanying drawings, the same or similar components are denoted by the same reference numerals.

The accompanying drawings are included in the specification, constitute a part thereof, show an embodiment of the present invention, and are used to explain the principle of the present invention together with the description.
FIG. 1 is a diagram illustrating an example of a functional configuration of the number management device. FIG. 2 is a diagram illustrating an example of a hardware configuration of the number management device. FIG. 3 is a diagram illustrating an example of an image of the main window of the display unit 208. FIG. 4 is a diagram showing an example of an image of the main window of the display unit 208 during the area number counting. FIG. 5 is a diagram showing an example of an image of the main window of the display unit 208 during the passing number counting. FIG. 6A is a diagram showing a graph setting dialog image when counting the number of people in the area. FIG. 6B is a diagram showing a graph setting dialog image when the number of passing people is counted. FIG. 7 is a diagram showing an area number count graph image. FIG. 8A is a diagram showing an image of the area number counting result. FIG. 8B is a diagram showing an area number count result image. FIG. 9 is a diagram showing a passing person count graph image. FIG. 10 is a diagram showing a passing person count result image.

Hereinafter, with reference to the accompanying drawings, the present invention will be described in detail based on the embodiments. The configurations shown in the following embodiments are merely examples, and the present invention is not limited to the illustrated configurations.

FIG. 1 shows an example of a functional configuration of the number management device 101 in the embodiment of the present invention. The number management device 101 includes an object detection unit 102, a graph creation unit 103, a result image creation unit 104, an image acquisition unit 105, a file input / output unit 106, and a display control unit 107 as functional configurations.

The image data 108 is image data generated by being imaged by a camera (not shown) as an imaging means connected to the number management device 101. The image data 108 is stored in an HDD (Hard Disc Drive) 204 (FIG. 2) as a recording unit of the number management device 101. Note that the image data 108 may be a moving image or a still image. The image acquisition unit 105 can acquire the image data 108 and output it to the display control unit 107, the result image creation unit 104, and the object detection unit 102. The object detection unit 102 measures the number of persons in the image data 108. The object detection unit 102 can measure the number of persons by, for example, using a known image processing technique to identify and detect a person and measure the number of detected persons.

The result image creation unit 104 creates a result image (number of people count result image) to be presented to the user from the image data received from the image acquisition unit 105 and the data received from the database 109 via the file input / output unit 106. . In the present embodiment, the result image creation unit 104 is configured to create a result image, but it is also possible to create a result other than an image. The graph creation unit 103 receives information set in the display unit 208 (FIG. 2) from the user via the operation unit 207 (FIG. 2) via the display control unit 107, and creates a graph based on the information. . The display control unit 107 performs display control on the display unit 208 (FIG. 2). For example, the display control unit 107 displays information received from the image acquisition unit 105, the graph creation unit 103, the result image creation unit 104, and the like on the display unit 208 and is displayed on the display unit 208. The information is transmitted to the graph creation unit 103, the result image creation unit 104, and the like. The file input / output unit 106 performs input / output of the database 109.

FIG. 2 shows an example of a hardware configuration of the number management device 101 in the embodiment of the present invention. The number management device 101 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Read Only Memory) 203, an HDD 204, a network interface 205, an operation unit 207, and a display unit 208 as hardware configurations. Is done.

The CPU 201 performs overall control of the number management device 101. The ROM 202 stores a program and the like for the CPU 201 to control the number management device 101. Note that a secondary storage device may be used instead of the ROM 202. The RAM 203 is a memory for developing a program read from the ROM 202 and executing processing. The RAM 203 is also used as a storage area for temporarily storing data to be subjected to various processes as a temporary storage memory. The HDD 204 stores the database 109. The network interface 205 is an interface for performing communication via the network 206 and acquiring the connection destination image data 108. The display unit 208 is a device having a screen such as a display for displaying information received from the image acquisition unit 105, the graph creation unit 103, the result image creation unit 104, and the like. The operation unit 207 is used by an input operation by a user, and includes, for example, a mouse or a touch panel.

As described above, the hardware configuration of the number management device 101 has the same hardware components as those mounted on a general PC (Personal Computer). Therefore, it is possible to implement various functions realized by the number management device 101 as software that operates on a general PC.

Subsequently, the operation of the number management device 101 will be described. First, the display control unit 107 displays the image data 108 received via the image acquisition unit 105 on the screen of the display unit 208. FIG. 3 shows an example of an image of the main window on the screen of the display unit 208. In FIG. 3, the main window 301 includes an image display area 302, an area number counting button 303, a passing number counting button 304, and a graph setting dialog activation button 305.

In the image display area 302, an image of the image data 108 acquired by the image acquisition unit 105 via the network interface 205 is displayed. The area number counting button 303 is a button for instructing to count the number of persons existing in a predetermined area for each time period. The passing person count button 304 is a button for instructing to count the number of persons passing through a predetermined position in a predetermined area by time period. The graph setting dialog activation button 305 is a button for instructing the display unit 208 to display a graph setting dialog for performing settings for creating and displaying a graph.

Hereinafter, an operation of the number management device 101 when the user selects the area number counting button 303, the passing number counting button 304, or the graph setting dialog start button 305 via the operation unit 207 will be described.

First, a case where the user selects the area number counting button 303 via the operation unit 207 will be described. Note that the image data 108 on which the object detection unit 102 measures the number of people when the area number counting button 303 is selected is a moving image or a still image. In response to the selection of the area number counting button 303, the object detection unit 102 measures the number of persons (number of persons) in the image data 108. The object detection unit 102 continuously acquires the image data 108 and continuously measures the number of people. The object detection unit 102 further associates the information of the imaging time of the image data 108 to be counted, the number of people to be measured, the coordinates and size in the image of the detected person, and the image data 108, and enters the file as measurement data. Output to the output unit 106. The file input / output unit 106 stores the measurement data received from the object detection unit 102 in the database 109. Note that the data storage destination is not limited to the database 109.

FIG. 4 shows an example of an image of the main window on the screen of the display unit 208 when the object detection unit 102 is counting the number of people when the area number counting button 303 is selected. The image data 108 is displayed by the display control unit 107 in the main window 401 on the screen of the display unit 208. In addition, the display control unit 107 displays information on the number of people measured by the object detection unit 102 on the main window 401 as shown in Equation 402.

Next, a case where the user selects the passing person count button 304 via the operation unit 207 will be described. Note that the image data 108 on which the object detection unit 102 measures the number of people when the passing number counting button 304 is selected is a moving image. In response to selection of the passing person count button 304, the object detection unit 102 passes the detection line (passing line) set in the image of the image data 108 in the same direction (positive direction) as the set direction. And the number of people who passed in the opposite direction (reverse direction) of the set direction. The detection line and direction may be set by the user as will be described later with reference to FIG. 6B, or may be set by the CPU 201 by giving a predetermined condition to the number management device 101. The object detection unit 102 measures the number of people who have passed in the forward direction as the number of people in In, and measures the number of people who have passed in the reverse direction as the number of people in Out.

The object detection unit 102 continuously acquires the image data 108 and continuously measures the number of people. The object detection unit 102 further captures the image data 108 to be counted, the number of people, the coordinates and size of the detected person in the image, the set detection line, the set direction (forward direction), and the image data. 108 are associated with each other and output to the file input / output unit 106 as measurement data. The file input / output unit 106 stores the measurement data received from the object detection unit 102 in the database 109. Note that the data storage destination is not limited to the database 109.

FIG. 5 shows an example of an image of the main window on the screen of the display unit 208 when the object detection unit 102 is counting the number of people when the passing person count button 304 is selected. The image data 108 is displayed by the display control unit 107 in the main window 501 on the screen of the display unit 208. Further, the display control unit 107 displays the detection line 502 and the forward arrow 503 on the main window 501. Further, the display control unit 107 displays information on the number of In persons and the number of Out persons measured by the object detection unit 102 on the main window 501 as shown in Expression 504.

Next, a case where the user selects the graph setting dialog start button 305 via the operation unit 207 will be described. In response to the selection of the graph setting dialog activation button 305, the display control unit 107 displays a graph setting dialog on the screen of the display unit 208 for performing settings for creating and displaying a graph.

6A and 6B show an example of the graph setting dialog. FIG. 6A shows a graph setting dialog 601 in the case where “area count” is selected by the user in a type setting area 603 to be described later. FIG. 6B shows a graph setting dialog 611 in the case where the “passing person count” is selected by the user in the type setting area 603. In response to the user completing various settings in the

graph setting dialog

601 or 611 via the operation unit 207, the graph creating unit 103 performs graphing processing.

6A includes a start date / end date and time setting area 602, a type setting area 603, a search button 604, a detection area setting area 605, a totaling unit setting area 606, and a display / cancel button 607. An operation to each button / area is performed via the operation unit 207.

The start date / end date / time setting area 602 is an area for setting a graph creation target period, and the user sets the target period by specifying the start date / time and the end date / time. In the type setting area 603, the user can select either “area count” or “passed count” from a pull-down list, for example. When “area count” is selected, the graph creation unit 103 creates a graph corresponding to the number of people measured in response to the selection of the area count button 303. When “passing person count” is selected, the graph creating unit 103 creates a graph corresponding to the number of persons measured by selecting the passing person count button 304.

When the user completes the settings for the start date / end date and time setting area 602 and the type setting area 603 and selects the search button 604, the CPU 201 corresponds to the settings for the start date and time / end date and time setting area 602 and the type setting area 603. The selected detection area setting area 605 and totaling unit setting area 606 are displayed. The detection area setting area 605 is an area for setting an area to be imaged, and the user can select the area from, for example, a pull-down list. The detection area setting area 605 may be configured so that an imaging unit that has generated the image data 108 can be designated. The aggregation unit setting area 606 is an area for setting an aggregation unit time for creating a graph, and the user can select the area from, for example, a pull-down list.

When the setting up to the aggregation unit setting area 606 is completed and the display button is selected from the display / cancel buttons 607 by the user, the graph creation unit 103 creates a graph based on the set information. . When the graph is created, the display control unit 107 displays a screen as shown in FIG. When correcting the setting, the user selects the cancel button from the display / cancel buttons 607 and performs the setting again.

On the other hand, the graph setting dialog 611 in FIG. 6B includes a start date / end date and time setting area 612, a type setting area 613, a search button 614, a detection line setting area 615, a totaling unit setting area 616, and a display / cancel button 617. The An operation to each button / area is performed via the operation unit 207.

A start date / end date / time setting area 612, a type setting area 613, a search button 614, a totaling unit setting area 616, and a display / cancel button 617 are the start date / time / end date / time setting area 602, the type setting area 603, and the type setting area 603, respectively. Since it is the same as the search button 604, the total unit setting area 606, and the display / cancel button 607, description thereof is omitted. The detection line setting area 615 selects the detection line 502 as shown in FIG. 5 and the direction to be the positive direction from, for example, a pull-down list.

When the setting up to the total unit setting area 616 is completed and the display button is selected from the display / cancel buttons 607 by the user, the graph creating unit 103 creates a graph based on the set information. . When the graph is created, the display control unit 107 displays a screen as shown in FIG. When correcting the setting, the user selects the cancel button from the display / cancel buttons 607 and performs the setting again.

It should be noted that the graph setting dialogs shown in FIGS. 6A and 6B are examples, and other configurations may be used as long as settings for creating and displaying graphs can be made.

FIG. 7 shows an example of the area count graph 701 created by the graph creation unit 103 according to the user setting in the graph setting dialog 601 shown in FIG. 6A and displayed on the screen of the display unit 208 by the display control unit 107. It is. In the area number count graph 701, the vertical axis represents the number of people and the horizontal axis represents time, and the time shown on the horizontal axis is at least the start date / time and end date / time set in the start date / end date / time setting area 602 in FIG. 6A. Including the period. A bar graph 702, which is one of the graph elements, has a total unit time set in the total unit setting area 606 in FIG. 6A (in the example of FIG. 7, the total unit time is 4 minutes). The average of the number of people counted when the measurement process is performed a plurality of times within the period of 09:12 is shown. Moreover, in FIG. 7, each bar graph as each graph element shows the average of the number of people counted in each counting unit time, but instead, the maximum number of people, the minimum number of people measured in each counting unit time, Alternatively, a combination thereof may be used. Further, in the case of measuring only once in each total unit time, the number of persons as they are is displayed as a graph as a measurement result.

Here, in response to the user selecting the bar graph 702 via the operation unit 207, the result image creation unit 104 is measured in the time zone of the total time unit in which the selected bar graph 702 exists and is stored in the database 109. Among the stored measurement data, the measurement data with the earliest imaging time is selected. Then, the result image creation unit 104 acquires the number of persons to be measured, the coordinates and size in the image of the detected person, and image data included in the selected measurement data from the database 109 via the file input / output unit 106. The result image creation unit 104 may acquire the image data 108 from the image acquisition unit 105 when the image data cannot be acquired from the measurement data. Subsequently, the result image creation unit 104 creates a result from the acquired data. In the present embodiment, the result image creation unit 104 creates an area number counting result image to be displayed on the display unit 208 as a result.

FIG. 8A shows the area number counting result image 801 created by the result image creating unit 104 in this way. The area number counting result image 801 is a still image, for example, an image in which the ellipse 802 obtained from the coordinates and size of the detected person and the measured number 803 are superimposed on the image data to be measured. The area person count result image 801 is displayed in the image display area 302. Instead of the ellipse 802, another figure indicating the detected person may be used.

Although FIG. 8A shows an example in which the area number counting result image 801 for one measurement data is created and displayed from one bar graph that is one graph element, the present invention is not limited to this. For example, the result image creation unit 104 creates a plurality of area person count result images corresponding to all the measurement data measured in the time zone of the total unit time in which one bar graph exists and stored in the database, and display control is performed. The unit 107 may display them in chronological order or simultaneously. The result image creation unit 104 can also create images indicating a plurality of detected persons as the plurality of area count result image 801, and the display control unit 107 can display them in chronological order or simultaneously. Yes (FIG. 8B).

FIG. 9 shows an example of a passing person count graph 901 created by the graph creation unit 103 in accordance with the user setting in the graph setting dialog 611 shown in FIG. 6B and displayed on the screen of the display unit 208 by the display control unit 107. It is. In the passing person count graph 901, the vertical axis represents the number of people and the horizontal axis represents time, and the time shown on the horizontal axis is the start date / time and end date / time set in at least the start date / end date / time setting area 612 in FIG. 6B. Including the period. The

bar graphs

902 and 903 are between 11:10 and 11:20 along the total unit time set in the total unit setting area 616 in FIG. 6B (in the example of FIG. 7, the total unit time is 10 minutes). The number of In counted and the number of Out counted are shown.

Here, in response to the user selecting the bar graph 902 via the operation unit 207, the result image creation unit 104 operates as follows.
(1) The measurement data with the earliest imaging time is selected from the measurement data measured and stored in the database 109 in the total unit time period in which the selected bar graph 902 exists.
(2) The number of people to be measured, the coordinates and size in the image of the detected person, and the image data included in the selected measurement data are acquired from the database 109 via the file input / output unit 106. When the image data cannot be acquired from the measurement data, the image data 108 is acquired from the image acquisition unit 105.
(3) A passing person count result image to be displayed as a result on the display unit 208 is created from the acquired data. FIG. 10 shows a passing person count result image 1001 created by the result image creation unit 104 in this way. The passing person count result image 1001 is a moving image. For example, an ellipse 1002 obtained from the coordinates and size of a detected person, a detection line 1003, an arrow 1004 indicating a positive direction, and a measurement person number 1005 are displayed on the image data to be measured. This is a superimposed image. The passing person count result image 1001 is reproduced and displayed in the image display area 302. Instead of the ellipse 1002, another figure indicating the detected person may be used.
(4) Returning to (1), the measurement data at the next earlier imaging time in the time zone of the total unit time in which the bar graph 902 exists is selected. If no measurement data exists, the process ends.

In addition, as the display form (form of the passing person count result image 1001) of (3) above, the following forms are also conceivable.
(A) When a bar graph representing the number of people who passed through the detection line in the positive direction (the number of people in In) is selected, only the images at the moment of passing the detection line in the positive direction (predetermined time before and after) are passed through. A count result image 1001 is created and displayed as at least part of the count result image 1001.
(B) When a bar graph representing the number of people who passed through the detection line in the reverse direction (the number of people at Out) is selected, only the image at the moment of passing through the detection line in the reverse direction (a predetermined time before and after plus) It is created and displayed as at least part of the passing person count result image 1001.
(C) When a bar graph representing the number of people in either the forward direction or the reverse direction (the number of people in In and the number of people in Out) is selected, the data of the time unit of the time unit in which the bar graph exists regardless of the direction Are generated as at least a part of the passing person count result image 1001 and are displayed in chronological order or simultaneously.

As described above, according to the present embodiment, the measurement result is stored, the stored result is recalled later, a specific period is graphed and displayed, and the measurement result image that is an element of the graph is displayed from the displayed graph. Can be displayed. Here, by changing the display form according to the type of the number of persons to be measured, it is possible to provide a display that is easier for the user to analyze.

(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

The present invention is not limited to the above embodiment, and various changes and modifications can be made without departing from the spirit and scope of the present invention. Therefore, in order to make the scope of the present invention public, the following claims are attached.

This application claims priority based on Japanese Patent Application No. 2017-107067 filed on May 30, 2017, the entire contents of which are incorporated herein by reference.

Claims

A number management device for managing the number of people for each time zone based on image data obtained by an imaging means,
A setting means for setting one of an area number count for counting the number of persons existing in the predetermined area of the image data, and a passing number count for counting the number of persons passing through the predetermined line set in the image data;
Display control means for displaying a result of counting people from the image data in accordance with the setting by the setting means,
The display control means, when the area count is set by the setting means, displays a still image taken by the imaging means in a time zone corresponding to the selected number of people count result, and the setting means When the number of passing people count is set, a number management device that plays back a moving picture taken by the imaging means in a time zone corresponding to a selected number of people count result.
When the area count is set by the setting means, the display control means graphs the average number of persons, the maximum number of persons, the minimum number of persons existing in the predetermined area, or the number of combinations thereof for each time period. The number management device according to claim 1, wherein the number management device is displayed.
When the passing means count is set by the setting means, the display control means graphs and displays the number of persons by time zone passing through the predetermined line in a predetermined direction and in a direction opposite to the predetermined direction. The number management device according to claim 2.
The display control means includes
When the area count is set by the setting means, the display control means is responsive to the fact that one of the elements of the graph indicating the number of persons for each time period is selected by the user. A still image obtained by superimposing information on the counted number of persons and a figure indicating the person corresponding to the coordinates and size of the detected person on the image data from the image data captured in a time zone in which the element is present The number management device according to claim 2, wherein the number management device is displayed.
When the area count is set by the setting means, in response to one of the graphs indicating the number of persons for each time period being selected by the user, the display control means The number management device according to claim 4, wherein a still image including a counted person is displayed from the image data picked up in a time zone in which a person exists.
When the passing means count is set by the setting means, in response to one of the elements of the graph indicating the number of persons for each time zone being selected by the user, the counted number of persons, the coordinates of the detected person, 4. The number management device according to claim 2, wherein a moving image in which information of the figure corresponding to the size, the predetermined line, and the predetermined direction is superimposed is created as the number of people count result. 5. .
A number management device for managing the number of people for each time zone based on image data obtained by an imaging means,
A setting means for setting one of an area number count for counting the number of persons existing in the predetermined area of the image data, and a passing number count for counting the number of persons passing through the predetermined line set in the image data;
When the area count is set by the setting means, a still image is displayed as the count result. When the passing count is set by the setting means, a moving image is displayed on the display section as the count count result. Display control means for displaying;
The number management device characterized by having.
A number management method for managing the number of people for each time zone based on image data obtained by an imaging means,
A setting step for setting one of an area number count for counting the number of persons existing in a predetermined area of the image data and a passing number count for counting the number of persons passing through a predetermined line set in the image data;
A display control step of displaying a result of counting people from the image data on a display unit according to the setting in the setting step,
In the display control step, when the area number count is set in the setting step, a still image photographed by the imaging unit is displayed in a time zone corresponding to the selected number of people count result, and in the setting step A number management method characterized in that, when the passing person count is set, a moving image shot by the imaging means is reproduced in a time zone corresponding to the selected number of people count result.
A number management method for managing the number of people for each time zone based on image data obtained by an imaging means,
A setting step for setting one of an area number count for counting the number of persons existing in a predetermined area of the image data and a passing number count for counting the number of persons passing through a predetermined line set in the image data;
When the area count is set in the setting step, a still image is displayed as the count result, and when the passing count is set in the setting step, a moving image is displayed on the display unit as the count result. A display control process to display;
A method for managing the number of persons, characterized by comprising:
A program for causing a computer to function as the number management device according to any one of claims 1 to 7.