JP2020149544A - Information processing device, information processing method, and program - Google Patents

Abstract

To adaptively display a graph intended by a user in accordance with a type of counting the number of persons.SOLUTION: An information processing device has display control means for causing display means to display a graph obtained by arranging a count result of the number of persons accumulated for a first period and a count result of the number of persons accumulated for a second period being a past period from the first period, the display control means displays a graph showing the count result accumulated for the period by a first accumulation method and the count result accumulated for the second period by the first accumulation method in the case of displaying a graph showing the count result obtained by counting the number of persons existing in an area designated on an image, and display means is caused to display a graph showing a count result accumulated for the first period by a second accumulation method and a count result accumulated for the second period by the second accumulation method in the case of displaying a graph showing a count result obtained by counting the number of persons passing through a line designated on the image.SELECTED DRAWING: Figure 6

Description

The present invention relates to information processing technology.

Conventionally, a system for counting the number of people included in an image taken by an imaging device is known. In such a system, it is possible to grasp the temporal transition of the number of people by displaying the information showing the result of counting the number of people on a graph.

Patent Document 1 discloses a technique for creating and displaying a graph based on numerical data given as a time series.

JP-A-2009-245128

In Patent Document 1, numerical data given as a time series is aggregated according to a set aggregation period, but when the number of people in an area in an image is graphed, there are the following problems. When counting the number of people in the area, the same person may be counted in the previous and next frames, so the graph displayed by calculating the total value in a certain period will be a graph different from the user's intention. .. On the other hand, when counting the number of people passing through a predetermined position in an image, the graph displayed by calculating the average value in a certain period is a graph different from the intention of the user.

Therefore, an object of the present invention is to adaptively display a graph intended by a user according to the type of number counting.

In order to solve the above problems, for example, the information processing device according to the present invention has the following configuration. That is, it is an information processing device that displays the result of the number of people counted based on the image captured by the imaging means, and the count result of the number of people aggregated in the first period and the past of the first period. It has a display control means for causing a display means to display a graph in which the count results of the number of people aggregated in the second period, which is a period, are arranged, and the display control means exists in a region designated on the image. When displaying a graph showing the count result of counting the number of people, the count result aggregated in the first period by the first aggregation method and the count aggregated in the second period by the first aggregation method. Display a graph showing the results and
When displaying a graph showing the count result of counting the number of people passing through the line specified on the image, the count counted in the first period by a second counting method different from the first counting method. It is characterized in that the display means displays a graph showing the result and the count result aggregated in the second period by the second aggregation method.

According to the present invention, it is possible to adaptively display a graph intended by the user according to the type of number counting.

It is a figure which shows the system configuration. It is a figure which shows the functional block of an image pickup apparatus. It is a figure which shows the functional block of an information processing apparatus. It is a figure for demonstrating the area count processing and passage count processing. It is a figure which shows an example of the graph which is displayed on the display. It is a flowchart of the process which displays the graph which shows the count result. It is a graph which shows the count result in the case of area count processing. It is a graph which shows the count result in the case of a pass count process. It is a figure which shows the hardware configuration of each apparatus.

Hereinafter, embodiments according to the present invention will be described with reference to the accompanying drawings. The configuration shown in the following embodiments is only an example, and is not limited to the illustrated configuration.

(Embodiment 1)
FIG. 1 is a diagram showing a system configuration according to the present embodiment. The system in this embodiment includes an information processing device 100, an image pickup device 110, a recording device 120, and a display 130.

The information processing device 100, the image pickup device 110, and the recording device 120 are connected to each other via the network 140. The network 140 is realized from a plurality of routers, switches, cables, etc. that conform to communication standards such as Ethernet (registered trademark).

The network 140 may be realized by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless Lan), a WAN (Wide Area Network), or the like.

The information processing device 100 is realized by, for example, a personal computer or the like in which a program for realizing an information processing function described later is installed.

The image pickup device 110 is a device for capturing an image. The image pickup device 110 associates the image data based on the captured image, the information of the image pickup time at which the image was captured, and the identification information which is the information for identifying the image pickup device 110 with the information processing device 100 and the information processing device 100 via the network 140. It is transmitted to an external device such as the recording device 120. In the system according to this embodiment, the number of image pickup devices 110 is one, but there may be a plurality of image pickup devices 110.

The recording device 120 records the image data of the image captured by the imaging device 110, the information of the imaging time at which the image was captured, and the identification information for identifying the imaging device 110 in association with each other. Then, in accordance with the request from the information processing device 100, the recording device 120 transmits the recorded data (image, identification information, etc.) to the information processing device 100.

The display 130 is composed of an LCD (Liquid Crystal Display) or the like, and displays the information processing result of the information processing device 100, the image captured by the image pickup device 110, and the like. The display 130 is connected to the information processing device 100 via a display cable compliant with a communication standard such as HDMI (registered trademark) (High Definition Multimedia Interface).

In addition, the display 130 functions as a display means, and displays an image captured by the image pickup apparatus 110, a setting screen related to information processing described later, and the like. At least any two or all of the display 130, the information processing device 100, and the recording device 120 may be provided in a single housing.

The information processing result of the information processing device 100 and the image captured by the image pickup device 110 are not limited to the display 130 connected to the information processing device 100 via the display cable, for example, the following external device. It may be displayed on the display of. That is, it may be displayed on the display of a mobile device such as a smartphone or tablet terminal connected via the network 140.

Next, the processing of the image pickup apparatus 110 according to the present embodiment will be described with reference to the functional block of the image pickup apparatus 110 according to the present embodiment shown in FIG. Each function other than the imaging unit 201 shown in FIG. 2 is realized as follows by using a ROM (Read Only Memory) 920 and a CPU (Central Processing Unit) 900, which will be described later with reference to FIG. It shall be. Each function other than the imaging unit 201 shown in FIG. 2 is realized by the CPU 900 of the imaging device 110 executing a computer program stored in the ROM 020 of the imaging device 110.

The storage unit 200 can be realized by a RAM (Random Access Memory) 910, an HDD (Hard Disk Drive) 930, or the like, and stores identification information for identifying the image pickup device 110, model information which is information indicating the model of the image pickup device 110, and the like. To do. Further, the storage unit 200 stores the image data generated by the image processing unit 202 described later. The image pickup unit 201 is composed of an image pickup element (not shown) such as a CCD (charge coupled device) sensor or a CMOS (complementary metal diode sensor) sensor. Then, the imaging unit 201 photoelectrically converts the subject image formed through the lens of the imaging device 110 to generate an electric signal. The image processing unit 202 generates image data by performing a process of converting an electrical signal photoelectrically converted by the imaging unit 201 into a predetermined digital signal, a compression coding process, and the like.

The communication unit 203 can be realized by an I / F (Interface) 940, which will be described later with reference to FIG. 9, and communicates with the information processing device 100 and the recording device 120 via the network 140. For example, the communication unit 203 transmits the image data generated by the image processing unit 202 to an external device (information processing device 100, storage device 120, etc.), or receives a control command for controlling the image pickup device 110. To do.

The control unit 204 can be realized by the CPU 900 described later with reference to FIG. 9, and is based on a control command which is a command obtained from the information processing device 100 via the communication unit 203 and is a command for controlling the image pickup device 110. The image pickup device 110 is controlled. The control command is, for example, a command for controlling pan / tilt / zoom of the image pickup apparatus 110. In this case, the control unit 204 changes the imaging direction and the zoom magnification of the imaging device 110 by controlling the pan / tilt / zoom of the imaging device 110 based on the control command acquired via the communication unit 203. The imaging direction of the imaging device 110 indicates the direction of the optical axis of the lens of the imaging device 110. Further, the control command includes, for example, a command for instructing the image pickup apparatus 110 to capture an image.

Next, the information processing of the information processing apparatus 100 according to the present embodiment will be described with reference to the functional block of the information processing apparatus 100 according to the present embodiment shown in FIG. In the case of the present embodiment, each function shown in FIG. 2 is realized as follows by using the ROM 920 and the CPU 900, which will be described later with reference to FIG. 9. Each function shown in FIG. 2 is realized by the CPU 900 of the information processing device 100 executing a computer program stored in the ROM 920 of the information processing device 100.

The communication unit 300 can be realized by the I / F 940 described later with reference to FIG. 9, and communicates with the image pickup device 110 and the recording device 120 via the network 140. The communication unit 300 receives, for example, image data of an image captured by the image pickup device 110, or transmits a control command for controlling the image pickup device 110 to the image pickup device 110.

The storage unit 301 can be realized by a RAM 910, an HDD 930, or the like described later with reference to FIG. 9, and stores information and data related to information processing by the information processing device 100. For example, the storage unit 301 stores information regarding the position of a person detected from the image.

The operation receiving unit 302 receives an operation performed by the user via an input device (not shown) such as a keyboard or a mouse. For example, the operation reception unit 302 is used to calculate information indicating the position of a line in an image used for determining whether or not a person has passed on the image, and the number of areas on the image that include a person. Accepts information indicating the position of the area.

The detection unit 303 detects a specific object from the image. For example, the detection unit 303 detects a specific object from an image by using a collation pattern (dictionary). When a person is detected from an image with a specific object as a person, the detection accuracy can be expected to be improved by using both the matching pattern when the person is facing forward and the matching pattern when the person is facing sideways. For example, a collation pattern for collating with an image of a human body facing in front (back) and a collating pattern for collating with an image of a person in landscape orientation are held, and based on the installation state of the image pickup apparatus 110 and the user's specification. You can use both.

Further, the collation pattern may be prepared from another angle such as from an oblique direction or from an upward direction. In addition, when detecting a person, it is not always necessary to prepare a collation pattern (dictionary) showing the characteristics of the whole body, and a collation pattern is prepared for a part of the person such as the upper body, lower body, head, face, and legs. You may. The detection unit 303 may have a function of detecting a person as a specific object from an image, and is not limited to the pattern matching process.

In the following description, the detection unit 303 in the present embodiment shall detect the upper body of the person from the image by using the matching pattern of the upper body of the person. Then, the detection unit 303 identifies the image area of the whole body of the person from the area (image area) of the image showing the upper body of the detected person. For example, the detection unit 303 uses an image area in which the vertical size of the image area showing the upper body of the person is enlarged downward by a predetermined magnification (for example, 2 times) in the vertical direction of the image as the image area of the whole body of the person. Identify. The position of the person detected by the detection unit 303 is assumed to be the coordinates of the center of gravity in the image region of the whole body of the person, with the upper left end point of the image as the origin.

The tracking unit 304 tracks a person detected by the detection unit 303. The tracking unit 304 in the present embodiment performs the following processing on the frame of the image captured by the image pickup apparatus 110, for example. That is, when the same person as the person detected by the detection unit 303 from the image of the frame one or more before the current frame exists in the image of the current frame, the tracking unit 304 sets the people in each frame. Correspond. That is, a person is tracked between images for a plurality of frames that are close in time. The following method can be used as a method for determining that the tracking unit 304 is the same person over images of a plurality of frames. For example, it is a method of determining that the person is the same person if the predicted movement position of the person and the position of the detected person are within a certain distance by using the movement vector of the detected person. In addition, the tracking unit 304 may associate a person with a high correlation between images of a plurality of frames by using the color, shape, size (number of pixels), and the like of the person. As described above, the tracking unit 304 is not limited to a specific method as long as it can perform a process of determining that the person is the same person over a plurality of frames of images and performing tracking.

The setting unit 305 makes settings related to information processing by the information processing device 100. For example, the setting unit 305 sets a line used for counting the number of passages of a specific object included in the image based on the operation by the user received by the operation reception unit 302. In the following description, the process of counting a specific object passing through the line is referred to as a pass count process.

The setting unit 305 also sets a counting area, which is an area included in the image and is a target area for counting the number of specific objects, based on the operation by the user received by the operation receiving unit 302. In the following description, the process of counting the number of specific objects in the count area is referred to as the area count process.

The calculation unit 306 executes the pass count process. The calculation unit 306 in the present embodiment determines whether the predetermined position of the specific object tracked by the tracking unit 304 has passed the line set by the setting unit 305, and determines the number of specific objects that have passed through the line. Count. For example, the calculation unit 306 determines whether the center of gravity point in the image region of the whole body of the person tracked by the tracking unit 304 has passed the line, and counts the number of people determined to have passed. Information indicating the number of persons who have passed the line counted by the passage counting process of the calculation unit 306 for the captured image is stored in the storage unit 301 in association with the information indicating the time when the image was captured.

In addition, the calculation unit 306 executes the area counting process. The calculation unit 306 in the present embodiment counts the number of specific objects included in the count area set by the setting unit 305. For example, the calculation unit 306 determines whether a predetermined position (center of gravity point or the like) of the person detected by the detection unit 303 is included in the count area, and counts the number of persons determined to be included in the count area. The information indicating the number of persons included in the count area counted by the area counting process of the calculation unit 306 for the captured image is stored in the storage unit 301 in association with the information indicating the time when the image was captured. ..

The display control unit 307 displays an image captured by the image pickup apparatus 110, a setting screen for setting information processing according to the present embodiment, information indicating the result of information processing, and the like on the display 130. Further, the display control unit 307 displays on the display 130 a graph or a table which is the result of taking in the data of the counted number of people in the time series stored in the storage unit 301 and totaling the data.

The count processing such as the pass count process or the area count process in the present embodiment may be executed by an external device that can be connected to the information processing device 100. For example, a computer (not shown) or an imaging device 110 connected to the information processing device 100 via a network has a detection unit 303, a tracking unit 304, a setting unit 305, and a calculation unit 306, and has a pass count. Processing or area counting processing may be executed. In this case, information indicating the result of the count of the pass count process or the area count process executed by the computer or the image pickup apparatus 110 may be transmitted to the information processing apparatus 100.

Although the passage count process and the area count process will be described as the count process according to the present embodiment, for example, the attribute-specific count process, which is the process of counting the number according to the attribute of a specific object, may be included. The attribute-based counting process is, for example, a process of determining attributes such as the gender and age of a person included in an image and counting the number of people for each gender and age. As a method for determining the gender and age of the person included in the image, a known technique may be used, and for example, the following processing may be executed. For example, as a method of determining whether a person included in an image is a man, a feature amount is extracted from the person included in the image, and the degree of similarity between the pre-registered male feature amount and the extracted feature amount is calculated. Then, if the calculated similarity is equal to or higher than the threshold value, it is determined that the person is a man.

Here, the area counting process and the passing counting process will be described in more detail with reference to FIG. First, the area counting process will be described in more detail with reference to FIG. 4A. FIG. 4A is a diagram showing how the area counting process is being executed. In the image 400 shown in FIG. 4A, four persons 402 to 405 are present in the count area 401 set by the setting unit 305. Further, a display 406 indicating a count result by the area count process is superimposed on the image 400, and "4", which is the number of people in the count area 401, is displayed on the display 406. Further, if the persons 402 to 405 are detected in the count area 401 in the image of the next frame of the image 400, the counted number of people shown in the display 406 is "4". That is, even if the person detected from the image of the past frame and the person detected from the image of the current frame are the same person, they are repeatedly counted. Therefore, as the number of count results on the time series by the area count process, it is necessary to aggregate the average value of a predetermined period, not the total value of the counted number of people between different frames.

Next, the pass count process will be described in more detail with reference to FIG. 4 (b). FIG. 4B is a diagram showing how the number of passing people is counted. In the image 440 shown in FIG. 4B, the line 441 set by the setting unit 305 is displayed, and the persons 443 to 446 are included. It is assumed that the four persons 443 to 446 are moving in the direction 442 from the upper right to the lower left of the image. A display 447 showing the count result by the pass count process is superimposed on the image 400, and when the person 443 and the person 444 pass through the line 441, the number of people counted is “2” on the display 447. In this way, regardless of how many people are detected in the image in the current frame, the total number of people who have passed the line 441 in the past is the number counted. When the person 445 passes the line 441 in the image of the frame after this, the number of people counted becomes 3 regardless of whether another person is detected from the image of the frame. In the pass count process, the total value of the number of people who have passed the line is calculated, so the total value of a certain period is also used when totaling the number of people in the pass count process in order to display the count result on a graph.

The display control unit 307 displays the data of the number of people in the time series counted by these different counting methods as a graph or a table. The graph shown in FIG. 5 is an example of a screen displayed by the display control unit 307. A line graph can be used to display the long-term transition of the number of people, a pie chart can be used to display the composition ratio of attributes such as the age and gender of a person, and a graph to be compared with past data can be displayed. The information processing apparatus 100 in the present embodiment performs the following processing in order to display a graph to be compared with past data, such as comparison of data of this year and last year. That is, the information processing apparatus 100 changes the counting method of the counted number of people in the time series according to either the graph showing the count result by the pass count process or the graph showing the count result by the area count process. .. A detailed description of the process of differentiating the counting method of the counted number of people in the time series according to the type of the counting process will be described later.

The information processing of the information processing apparatus 100 according to the present embodiment will be described in more detail with reference to FIGS. 6 to 8. FIG. 6 is a flowchart showing a process flow for displaying a graph showing the result of the number of people counted from the image. In the present embodiment, the process shown in FIG. 6 shall be started according to an instruction by the user. The processing of the flowchart shown in FIG. 6 is executed by each functional block shown in FIG. 2 realized by executing the computer program stored in the ROM 920 of the information processing device 100 by the CPU 900 of the information processing device 100. It is explained as.

First, in S601, the calculation unit 306 acquires the data of the number of people in the time series counted by the pass count process and the data of the number of people in the time series counted by the area count process. At this time, the calculation unit 306 may acquire the data of the number of people in the time series stored in the storage unit 301, or may perform the pass count process or the area count process on the time series from another external device capable of executing the pass count process or the area count process. Data on the number of people may be acquired.

Next, in S602, the calculation unit 306 divides the acquired data into a first period and a second period which is a period past the first period. The first period and the second period are, for example, this year and last year, this month and last month, this week and last week, today and yesterday, and the first period and the second period to be compared depending on the operation by the user. The period of 2 is determined.

Next, in S603, the calculation unit 306 has selected the display of the graph of the count result by the area count process by the user, or the user has selected the display of the graph of the count result by the pass count process. To determine if. Specifically, the operation receiving unit 302 receives an operation for displaying a graph of the count result by the area count process or an operation for displaying the graph of the count result by the pass count process. The calculation unit 306 is selected to display a graph of the count result by the area count process or to display the graph of the count result by the pass count process based on the operation received by the operation reception unit 302. To determine if.

When it is determined in S603 that the display of the graph of the count result by the area count process is selected by the user (Yes in S603), the transition to S604 is performed. In S604, the calculation unit 306 further divides the data divided in the first period and the second period in S602 for each time zone. This time zone may be any time interval such as 1 minute or 1 hour that can divide the day into equal intervals, and is determined according to the user's selection. For example, when the first period is this week, the second period is last week, and the time zone is one hour, the calculation unit 306 data on the number of people by the time-series area counting process in this week, which is the first period. Is divided every hour. Further, in this case, the calculation unit 306 divides the data of the number of people by the area counting process on the time series in the last week, which is the second period, every hour.

Next, in S605, the calculation unit 306 aggregates the data of the number of people by the area counting process in the first period by the first aggregation method, and the data of the number of people by the area counting process in the second period is the first. Aggregate by the aggregation method. In the present embodiment, the count result aggregated in the first period by the first aggregation method is the average value of the number of people in the first period for each time zone. For example, when the first period is this week and the time zone is one hour, the calculation unit 306 calculates the average value of the number of people counted from 0:00 to 1:00 on all days of this week. Similarly, the calculation unit 306 calculates the average number of people on all days of this week in each time zone from 1:00 to 2:00, from 2:00 to 3:00, and from 23:00 to 24:00 in 1-hour increments. To do.

Further, in the present embodiment, the count result aggregated in the second period by the first aggregation method is the average value of the number of people in the second section for each time zone. For example, if the first period is this week and the second period to be compared is last week, the calculation unit 306 counts from 0:00 to 1:00 on all days of last week, as in the above explanation. Calculate the average value of the number of people. Similarly, the calculation unit 306 calculates the average value of the number of people on all days of the last week in each time zone from 1:00 to 2:00, from 2:00 to 3:00, and from 23:00 to 24:00 in 1-hour increments. To do.

A graph in which the count results aggregated in the first period by the first aggregation method and the count results aggregated in the second period by the first aggregation method are arranged is displayed by the display control unit 307 in S608. Displayed at 130. An example of the graph displayed in this way is the graph shown in FIGS. 7 (a) and 7 (b). In the example shown in FIG. 7 (a), this week (first period) and last week (second period), the average number of people in each time zone of all days of this week and each time zone of all days of last week The average number of people is displayed side by side. On the other hand, in the example shown in Fig. 7 (b), this year (first period) and last year (second period), the average number of people in each time zone on all days of this year and the last year The average number of people in each time zone of all days is displayed side by side.

Here, the description of the process of S603 is returned. When the display of the graph of the count result by the area count process is not selected in S603, that is, when the display of the graph of the count result by the pass count process is selected (No in S603), the transition to S606 occurs.

In S606, the calculation unit 306 determines the aggregation period according to the period to be compared. Specifically, a related table in which the period to be compared (the first period and the second period) and the aggregation period are associated is stored in advance. Then, the calculation unit 306 determines the aggregation period based on the period to be compared and the related table. For example, in the calculation unit 306, if the first period to be compared is this year and the second period is last year, the aggregation period is one month, the first period is this week, and the second period is last week. If so, the aggregation period is one day.

Next, in S607, the data of the number of people in the first period is aggregated by the second aggregation method, and the data of the number of people in the second period is aggregated by the second aggregation method. The second tabulation method here is different from the first tabulation method. In the present embodiment, the count result aggregated in the first period by the second aggregation method is the total value of the number of people who have passed the line for each predetermined period (aggregation period) in the first period. On the other hand, the count result aggregated in the second period by the second aggregation method is the total value of the number of people who have passed the line for each predetermined period (aggregation period) in the second period.

The predetermined period here is determined based on the related table according to the first period and the second period, which are the periods to be compared. For example, if the first period is this year and the second period is last year, the predetermined period (aggregation period) is one month, and if the first period is this week and the second period is last week, it is predetermined. The period (aggregation period) of is one day.

For example, if the first period is this week and the second period is last week, in the case of this embodiment, the predetermined period (aggregation period) is every day, and the calculation unit 306 is for each day of the week in this week. Calculate the total number of people passing by. In this case, the calculation unit 306 further calculates the total number of people passing by each day of the week in the second period, last week.

A graph in which the count results aggregated in the first period by the second aggregation method and the count results aggregated in the second period by the second aggregation method are arranged is displayed by the display control unit 307 in S608. Displayed at 130. An example of the graph displayed in this way is the graph shown in FIGS. 8 (a) and 8 (b). In the example shown in FIG. 8 (a), the total number of people who passed the line for each day of the week this week (first period) and last week (second period) and the line for each day of the week last week are shown. The total number of people who passed is displayed side by side. On the other hand, in the example shown in FIG. 8 (b), the total number of people who passed the monthly line of this year and the monthly value of last year for this year (first period) and last year (second period). The total value of the number of people who passed the line is displayed side by side.

The time zone used in S604 shown in FIG. 6 is determined according to the user's selection, but may be determined by, for example, the following processing. That is, the calculation unit 306 approximates the number of people data on the time series counted by the area counting process to the Sin function by an approximation method such as the least squares method. Then, the calculation unit 306 may calculate the data cycle from the approximated Sin function, and set the time zone by multiplying the calculated cycle by a predetermined constant such as 1/10 of the cycle. Further, the calculation unit 306 may change the constant to be multiplied by the cycle according to the length of the calculated cycle. For example, the calculation unit 306 may multiply the calculated cycle by a constant that shortens the time zone for data having a short cycle, and may multiply the calculated cycle by calculating a constant that lengthens the time zone for data having a long cycle. As described above, if the calculated cycle is short, the time zone is short, and if the calculated cycle is long, the time zone is long, so that the user can more easily recognize the tendency of the data.

As described above, when the information processing apparatus 100 according to the present embodiment displays the count result by the area count process, it displays a graph in which the average value for each time zone is calculated. On the other hand, when displaying the count result by the pass count process, the information processing apparatus 100 displays a graph calculated by calculating the total value of the number of people who have passed the line for each aggregation period according to the period to be compared. By doing so, it is possible to adaptively display the graph intended by the user according to the type of number counting.

(Other embodiments)
Next, with reference to FIG. 9, the hardware configuration of the information processing apparatus 100 for realizing each function of each embodiment will be described. Although the hardware configuration of the information processing device 100 will be described in the following description, it is assumed that the recording device 120 and the imaging device 110 are also realized by the same hardware configuration.

The information processing apparatus 100 in the present embodiment includes a CPU 900, a RAM 910, a ROM 920, an HDD 930, and an I / F 940.

The CPU 900 is a central processing unit that controls the information processing device 100 in an integrated manner. The RAM 910 temporarily stores a computer program executed by the CPU 900. The RAM 910 also provides a work area used by the CPU 900 to execute processing. Further, the RAM 910 functions as, for example, a frame memory or a buffer memory.

The ROM 920 stores a program or the like for the CPU 900 to control the information processing device 100. The HDD 930 is a storage device for recording image data and the like.

The I / F 940 communicates with an external device via the network 140 according to TCP / IP, HTTP, or the like.

In the description of each of the above-described embodiments, an example in which the CPU 900 executes the processing will be described, but at least a part of the processing of the CPU 900 may be performed by dedicated hardware. For example, the process of displaying a GUI (GRAPHICAL USER INTERDEFACE) or image data on the display 130 may be executed by a GPU (GRAPHICS PROCESSING UNIT). Further, the process of reading the program code from the ROM 920 and expanding it into the RAM 910 may be executed by a DMA (Direct Memory Access) that functions as a transfer device.

The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-described embodiment. The program may be supplied to a system or device having a processor via a network or storage medium. The present invention can also be realized by a circuit (for example, an ASIC) that realizes one or more functions of the above-described embodiment. Further, each part of the information processing apparatus 100 may be realized by the hardware shown in FIG. 9 or by software.

Although the present invention has been described above together with the embodiments, the above embodiments are merely examples of implementation of the present invention, and the technical scope of the present invention is construed in a limited manner by these. It's not a thing. That is, the present invention can be implemented in various forms without departing from the technical idea or its main features. For example, a combination of the respective embodiments is also included in the disclosure contents of the present specification.

100 Information processing device 110 Imaging device 300 Communication unit 301 Storage unit 302 Operation reception unit 303 Detection unit 304 Tracking unit 305 Setting unit 306 Calculation unit 307 Display control unit

Claims (13)

An information processing device that displays the results of the number of people counted based on the images captured by the imaging means.
Display control for displaying a graph in which the count result of the number of people aggregated in the first period and the count result of the number of people aggregated in the second period, which is a period earlier than the first period, are displayed on the display means. Have a means,
When the display control means displays a graph showing the count result of counting the number of people existing in the area designated on the image, the count result aggregated in the first period by the first aggregation method and the count result are aggregated. A graph showing the count results aggregated in the second period by the first aggregation method is displayed.
When displaying a graph showing the count result of counting the number of people passing through the line specified on the image, the count totaled in the first period by a second totaling method different from the first totaling method. An information processing apparatus characterized in that the display means displays a graph showing a result and a count result aggregated in the second period by the second aggregation method. The count result aggregated in the first period by the first aggregation method is an average value of the number of people existing in the area counted in the predetermined time zone in the first period.
The count result aggregated in the second period by the first aggregation method is an average value of the number of people existing in the area counted in the predetermined time zone in the second period. The information processing device according to claim 1. The count result aggregated in the first period by the second aggregation method is the total value of the number of people who have passed the line counted in the predetermined period in the first period.
Claim 1 or 2 characterized in that the count result aggregated in the second period by the second aggregation method is the total value of the number of people counted in the predetermined period in the second period. The information processing device described in. A detection means for detecting a person included in an image captured by the image pickup means, and
It further has a calculation means for counting the number of people detected by the detection means.
The information processing device according to any one of claims 1 to 3, wherein the calculation means counts the number of people existing in a region designated on the image. Further having a tracking means for tracking a person detected by the detection means,
The information processing apparatus according to claim 4, wherein the calculation means counts the number of people passing through a line designated on the image. One of claims 1 to 5, wherein the first period and the second period are either this year and last year, this month and last month, this week and last week, or today and yesterday. The information processing device described in. It is an information processing method of an information processing device that displays the result of the number of people counted based on the image captured by the imaging means.
Display control for displaying a graph in which the count result of the number of people aggregated in the first period and the count result of the number of people aggregated in the second period, which is a period earlier than the first period, are displayed on the display means. Have a process,
In the display control step, when displaying a graph showing the count result of counting the number of people existing in the area designated on the image, the count result aggregated in the first period by the first aggregation method and the count result aggregated in the first period A graph showing the count results aggregated in the second period by the first aggregation method is displayed.
When displaying a graph showing the count result of counting the number of people passing through the line specified on the image, the count totaled in the first period by a second totaling method different from the first totaling method. An information processing method comprising displaying a graph showing a result and a count result aggregated in the second period by the second aggregation method on the display means. The count result aggregated in the first period by the first aggregation method is an average value of the number of people existing in the area counted in the predetermined time zone in the first period.
The count result aggregated in the second period by the first aggregation method is an average value of the number of people existing in the area counted in the predetermined time zone in the second period. The information processing method according to claim 7. The count result aggregated in the first period by the second aggregation method is the total value of the number of people who have passed the line counted in the predetermined period in the first period.
Claim 7 or 8 characterized in that the count result aggregated in the second period by the second aggregation method is the total value of the number of people counted in the predetermined period in the second period. Information processing method described in. A detection step for detecting a person included in an image captured by the imaging means, and
It further has a calculation step of counting the number of people detected by the detection step.
The information processing method according to any one of claims 7 to 9, wherein in the calculation step, the number of people existing in the area designated on the image is counted. Further having a tracking method for tracking a person detected by the detection method,
The information processing method according to claim 10, wherein in the calculation method, the number of people passing through a line designated on the image is counted. One of claims 7 to 11, wherein the first period and the second period are either this year and last year, this month and last month, this week and last week, or today and yesterday. Information processing method described in. A program for causing a computer to function as each means of the information processing apparatus according to any one of claims 1 to 6.

Images