JP6222703B2 - Heat map image generation apparatus, heat map image generation method, and heat map image generation program - Google Patents

Description

  The present invention relates to a heat map image generation apparatus, a heat map image generation method, and a heat map image generation program that generate a so-called heat map image that visualizes movement in space.

  A so-called heat map that visualizes movement in space is known. For example, Patent Document 1 describes a security video that incorporates a heat map in which cumulative activity detected by a sensor is encoded. The time zone is shown on the heat map, the user clicks a point in the heat map, selects a camera that can see its location, and starts playing the video from the beginning of that time segment It is possible to do.

  Patent Document 2 describes that a heat map is created by categorizing a user's whereabouts based on stay time from position data (latitude / longitude) obtained by a GPS sensor. In this heat map, you can know the distribution of the user's position at each staying place, the place where the staying time is long is dark, and the place with movement at that place is distributed over a wide range Yes.

JP 2009-134688 A JP 2010-72811 A

  In patent document 1, the heat map is created by coding the cumulative activity detected by the sensor. Therefore, it is necessary to provide a sensor in addition to the video camera. On the other hand, Patent Document 2 describes that a heat map is created from position data obtained by a GPS sensor, and it seems that the GPS sensor of Patent Document 2 can be used as the sensor of Patent Document 1. However, providing a sensor other than a video camera to obtain a heat map complicates the apparatus and increases the cost.

  Accordingly, the present invention provides a heat map image generation device, a heat map image generation method, and a heat map image generation program capable of generating a heat map image only from an image acquired by an imaging device such as a video camera. For the purpose.

  The heat map image generation device of the present invention obtains an image as a background (hereinafter referred to as “background image”) from a plurality of consecutive frames that are sequentially acquired by the imaging device, and is sequentially acquired by the imaging device. For each of a plurality of consecutive frames, a difference is sequentially taken between the image of each frame and the background image, and the number of occurrences of the difference within a predetermined time is counted for each area in the frame divided in advance. And a heat map image generating means for generating an image whose expression is changed for each area according to the number of times counted for each area by the counting means.

  In addition, the heat map image generation method of the present invention obtains an image (background image) as a background from images of a plurality of consecutive frames sequentially acquired by the imaging device, and performs a process of acquiring a plurality of consecutive frames sequentially acquired by the imaging device. For each frame, sequentially take a difference between the image of each frame and the background image, and count the number of occurrences of the difference within a predetermined time for each area in the pre-divided frame, for each area The method includes generating an image whose expression is changed for each region in accordance with the counted number.

  In addition, the heat map image generation program of the present invention obtains an image (background image) as a background from a plurality of continuous frame images sequentially acquired by the imaging device, and continuously acquires sequentially by the imaging device. For each frame of the plurality of frames, sequentially taking a difference between the image of each frame and the background image, and counting the number of times that the difference has occurred within a predetermined time for each area in the frame that is pre-segmented, This is for executing generation of an image whose expression is changed for each area according to the number of times counted for each area.

  According to the above-described invention, the number of times that a difference has occurred within a predetermined time between the images of the frames of the plurality of consecutive frames and the background image is counted for each region in the pre-divided frame. An image whose expression is changed for each region according to the number of times counted, that is, a heat map image is generated.

  The heat map image generation apparatus of the present invention is a base server installed at an imaging base and connected to the imaging apparatus. The base server having a counting means and an aggregation server connected to the base server by an electric communication line. And a configuration including an aggregation server having a heat map image generation means. As a result, the base server at the imaging base counts the number of times that a difference has occurred within a predetermined time between the image of each frame of a plurality of consecutive frames and the background image for each region in the frame that has been pre-divided. Then, the aggregation server generates an image whose expression is changed for each area according to the number of times counted for each area, that is, a heat map image.

  At this time, the base server obtains image data (hereinafter referred to as “reference image”) that is a reference frame (hereinafter referred to as “reference frame”) at predetermined timings from a plurality of consecutive frames of images sequentially acquired by the imaging device. Reference image transmission means for transmitting the data to the aggregation server, and each frame after a plurality of consecutive reference frames sequentially acquired by the imaging device, sequentially with the image of each frame and the background image An extraction region that calculates a third region that surrounds both the first region in which a difference is generated and the second region in which a difference is generated between the image of the frame immediately before each frame and the background image Calculating means, and extracted image transmission means for sequentially extracting the image data of the third region of each frame from the image of each frame and transmitting it to the aggregation server. It is desirable to include an image synthesizing means for synthesizing the video image from the image data of the third region of the reference image data and each frame transmitted from.

  As a result, in addition to the generation of the heat map image as described above, the areas that have changed before and after the images of a plurality of consecutive frames are extracted, transmitted to the aggregation server, and combined. A first region where a difference is generated between the image of each frame of the plurality of frames and the background image, and a second region where a difference is generated between the image of the frame immediately before each frame and the background image The image data of the third region that surrounds both are extracted, transmitted to the aggregation server, and a synthesized moving image is obtained.

  The heat map image generation device of the present invention includes an aggregation server connected to the imaging device via an electric communication line, and the imaging device transmits a plurality of frames of images to the aggregation server. And a heat map image generating means. As a result, based on the images of the plurality of frames transmitted from the imaging device to the aggregation server, for each region within the pre-divided frames, the images of the consecutive frames of the frames and the background image are within a predetermined time. The number of times the difference is generated is counted, and an image whose expression is changed for each region according to the number counted for each region, that is, a heat map image is generated.

  The heat map image generation apparatus of the present invention includes a storage server connected to the imaging device by an electric communication line, and an aggregation server connected to the storage server by an electric communication line, and the imaging device has an image of a plurality of frames. The storage server has means for storing a plurality of frames of images transmitted from the imaging device, and the aggregation server has a means for acquiring a plurality of frames of images from the storage server, And a heat map image generating means. As a result, a plurality of consecutive frames of images sequentially acquired by the imaging device are transmitted from the imaging device to the storage server and stored, and a plurality of frames of images stored in the storage server are acquired by the aggregation server and classified in advance. For each area in the frame, the number of times that a difference has occurred within a predetermined time between the image of each frame of a plurality of consecutive frames and the background image is counted, and the area according to the number counted for each area An image whose expression is changed every time, that is, a heat map image is generated.

  According to the present invention, it is possible to generate a heat map image only from an image acquired by an imaging device such as a video camera.

It is a schematic block diagram of the heat map image generation apparatus in 1st Embodiment of this invention. It is a schematic block diagram of the heat map image generation apparatus in 2nd Embodiment of this invention. It is a schematic block diagram of the heat map image generation apparatus in 3rd Embodiment of this invention. It is a schematic block diagram of the heat map image generation apparatus in 4th Embodiment of this invention. (A)-(c) is explanatory drawing which shows the example of the image of the result of having taken the difference between each image of a continuous frame, and a background image. It is a schematic block diagram of the heat map image generation apparatus in 5th Embodiment of this invention. It is a block diagram of the heat map image generation apparatus of FIG. It is explanatory drawing of the image of the continuous several frame acquired sequentially by an imaging device. It is a figure which shows the example of an image of several frames. It is a figure which shows the example of an image which took the difference of the image of each frame of (a), (b), (c) of FIG. 9, and each background image. FIG. 9A is a diagram showing the difference generation area of the frame of FIG. 9A and the first area surrounding it, and FIG. 9B is the difference generation area of the frame of FIG. 9B and the second area surrounding them. FIG. 9C is a diagram showing a third area surrounding both the difference occurrence area of the frame of FIG. 9A and the difference occurrence area of the frame of FIG. 9B. It is explanatory drawing which showed the 3rd area | region shown in FIG.11 (c) in the flame | frame of FIG.9 (b). It is explanatory drawing which showed the 3rd area | region shown in FIG.11 (c) in the flame | frame of Fig.9 (a).

(Embodiment 1)
FIG. 1 is a schematic configuration diagram of a heat map image generating apparatus according to the first embodiment of the present invention.
In FIG. 1, the heat map image generation device according to the first embodiment of the present invention takes a difference between the image of each of a plurality of consecutive frames sequentially acquired by the imaging device 2 and the background image, and classifies them in advance. Counting means 50 that counts areas where a difference is generated for each area in the frame, and heat map image generating means that generates an image whose expression is changed for each area according to the number of times counted for each area by the counting means 50 51.

  The imaging device 2 is a device that acquires images of a plurality of continuous frames by capturing still images at a predetermined time interval (for example, an interval of 1/120 seconds to 1 second). The counting unit 50 obtains an image (background image) as a background from a plurality of consecutive frames acquired sequentially by the imaging device 2, and for each of the consecutive plurality of frames sequentially acquired by the imaging device 2, Sequentially, a difference is taken between the image of each frame and the background image, and the number of occurrences of the difference within a predetermined time is counted for each region in the frame divided in advance.

  In the present embodiment, an averaged image of a plurality of frames immediately before each frame for which a difference is taken is used as the background image. For example, when calculating a region where a difference from the background image has occurred for one frame for which the difference is taken, the counting means 50 sets the average of the images of 100 frames immediately before this one frame as the background image. Then, for each frame for which a difference is taken, the images of the immediately preceding 100 frames are averaged to obtain a background image, and a difference is taken between the image of each frame and the background image.

  Then, the counting means 50 counts the number of times that a difference has occurred within a predetermined time for each region in the frame divided in advance. 5A to 5C show examples of images obtained as a result of taking a difference between each image of a continuous frame and a background image. Also, FIGS. 5A to 5C show a grid obtained by dividing the frame imaged by the imaging device 2 into a plurality of grid-like areas in advance, and the number of times counted by the counting means 50 in each area. Is displayed.

  The heat map image generating unit 51 generates an image in which the expression such as color and shade is changed for each region according to the number of times counted by the counting unit 50. For example, in FIG. 5C, an image is generated in which the color is changed according to the number of counts in each region, or the shade is changed depending on the number of counts.

  In the heat map image generation device having the above-described configuration, the image of each frame of a plurality of consecutive frames and the background image are obtained for each region in the frame divided in advance from only the image acquired by the imaging device 2 such as a video camera. The number of times the difference occurs within a predetermined time is counted, and an image whose expression is changed for each region according to the number counted for each region, that is, a heat map image is generated.

  Note that the heat map image generation apparatus having the above-described configuration is provided on various computers such as a general-purpose server, a personal computer, a microcomputer, a PDA (personal information terminal), a pocket computer, a smartphone, a feature phone (mobile phone), and a portable game machine. Thus, it is realized by executing a program for causing the computer to function as each of the means 50 and 51. At this time, the image pickup apparatus 2 can be one built in the above-described computer or one externally connected.

(Embodiment 2)
FIG. 2 is a schematic configuration diagram of a heat map image generation apparatus according to the second embodiment of the present invention.
In FIG. 2, the heat map image generation apparatus according to the second embodiment of the present invention is connected to one or a plurality of imaging apparatuses 2 installed at an imaging base, and one or a plurality of imaging apparatuses 2 by an electric communication line N. And an aggregation server 4.

  The imaging device 2 has a function of transmitting a plurality of frames of images to the aggregation server 4 through the electric communication line N. The aggregation server 4 includes the count unit 50 and the heat map image generation unit 51 described above. The aggregation server 4 processes a plurality of frames of images transmitted from one or a plurality of imaging devices 2 for each of the one or a plurality of imaging devices 2, and creates respective heat map images. The aggregation server 4 is realized by executing a program for causing this computer to function as each of the means 50 and 51 on various computers as described above.

  In the heat map image generation device having the above configuration, images acquired by one or a plurality of imaging devices 2 installed at the imaging base are aggregated to the aggregation server 4 and acquired by the imaging server 2 of each imaging base by the aggregation server 4. A heat map image is generated only from the processed image.

(Embodiment 3)
FIG. 3 is a schematic configuration diagram of a heat map image generation apparatus according to the third embodiment of the present invention.
In FIG. 3, the heat map image generation apparatus according to the second embodiment of the present invention is connected to one or a plurality of imaging apparatuses 2 installed at an imaging base, and one or a plurality of imaging apparatuses 2 by an electric communication line N. The storage server 6 and the aggregation server 4 connected to the storage server 6 via the telecommunication line N are configured. Note that the telecommunication line N connecting the imaging device 2 and the storage server 6 and the telecommunication line N connecting the storage server 6 and the aggregation server 4 may be the same telecommunication line or different telecommunication lines.

  The imaging device 2 has a function of transmitting a plurality of frames of images to the storage server 6 through the electric communication line N. The accumulation server 6 includes storage means 60 that accumulates a plurality of frames of images transmitted from one or a plurality of imaging devices 2 for each of the one or a plurality of imaging devices 2. The storage server 6 is realized by executing a program for causing the computer to function as each of the means 60 on various computers as described above.

  The aggregation server 4 includes an image acquisition unit 52 that acquires images of a plurality of frames from the accumulation server 6, the above-described counting unit 50, and a heat map image generation unit 51. The aggregation server 4 is realized by executing a program for causing this computer to function as each of the means 50, 51, 52 on various computers as described above.

  In the heat map image generation device having the above-described configuration, images acquired by one or a plurality of imaging devices 2 installed at the imaging base are temporarily stored in the storage server 6, and the aggregation server 4 is obtained from only the images stored in the storage server 6. Thus, a heat map image of each imaging base is generated.

(Embodiment 4)
FIG. 4 is a schematic configuration diagram of a heat map image generation device according to the fourth embodiment of the present invention.
In FIG. 5, the heat map image generation device according to the fourth exemplary embodiment of the present invention includes one or a plurality of imaging devices 2 installed at an imaging base and one or a plurality of imaging devices 2 connected to each other. A base server 3 and an aggregation server 4 connected to one or a plurality of base servers 3 by a telecommunication line N are configured.

  The base server 3 has the count means 50 described above. The base server 3 is installed for each imaging base. Each base server 3 is connected to one or a plurality of imaging devices 2. The base server 3 counts the number of times that a difference has occurred within a predetermined time for each area in the frame that has been divided in advance by the counting means 50 from the image acquired by the imaging device 2, and the result is transmitted to the telecommunication line. N is transmitted to the aggregation server 4 through N. The base server 3 is realized by executing a program for causing the computer to function as the counting means 50 on various computers as described above.

  The aggregation server 4 includes the heat map image generation unit 51 described above. Based on the count result transmitted from the base server 3, the aggregation server 4 generates an image in which the expression such as color and shading is changed for each region by the heat map image generation unit 51. The aggregation server 4 is realized by executing a program for causing the computer to function as the heat map image generation unit 51 on various computers as described above.

  In the heat map image generation device having the above configuration, only the result counted by the counting means 50 of the base server 3 from the images acquired by the one or plural imaging devices 2 respectively installed at the one or plural imaging bases is the aggregation server. 4 and the aggregation server 4 generates a heat map image of each imaging base.

(Embodiment 5)
6 is a schematic configuration diagram of a heat map image generation device according to a fifth embodiment of the present invention, FIG. 7 is a block diagram of the heat map image generation device of FIG. 6, and FIG. 8 is a plurality of consecutive frames sequentially acquired by the imaging device. It is explanatory drawing of the image of.

  In FIG. 6, the heat map image generation device according to the fifth embodiment of the present invention is installed at the imaging base, the base server 3 to which the imaging device 2 is connected, and the base server 3 connected to the base server 3 by the telecommunication line N. And server 4.

  As shown in FIG. 7, the base server 3 includes a storage unit 10 that temporarily stores images of a plurality of consecutive frames sequentially acquired by the imaging device 2, and a reference frame (reference frame) at each predetermined timing. ) Image data (reference image data) to be transmitted to the aggregation server 4, and a region (hereinafter referred to as the following) that functions as the count means 50 and that is extracted from each frame after the reference frames of a plurality of frames. Counting means / extraction area calculation means 12 for calculating the extraction area), and extracted image transmission means 13 for sequentially extracting the image data of the extraction area of each frame from the image of each frame and transmitting it to the aggregation server 4 And have.

  The base server 3 is realized by executing a program for causing the computer to function as each of the means 10 to 13 on various computers as described above.

  As shown in FIG. 8, the reference image transmission means 11 includes a plurality of consecutive frames 20a, 20b,..., 20c, 20d, 20e, 20f, 20g, 20h, 20i, which are sequentially acquired by the imaging device 2. 20j, 20k,..., The data (reference image data) of the images 20a, 20d, 20j of the reference frame (reference frame) is transmitted to the aggregation server 4 at predetermined timings. The reference frame is determined for each timing such as a preset time (for example, an interval of 30 seconds or an interval of 1 minute) or a preset number of frames.

  The counting unit / extraction area calculating unit 12 obtains an image (background image) as a background from images of a plurality of consecutive frames sequentially acquired by the imaging device 2, functions as the above-described counting unit 50, and also functions as the imaging device 2. For each frame after a plurality of consecutive reference frames sequentially obtained by the first region in which a difference is generated between the image of each frame and the background image, and the frame immediately before each frame A third area surrounding both the image and the second area where the difference is generated between the background image is calculated. The third area is an area (extraction area) extracted by the extracted image transmission means 13.

  Here, the background image is an averaged image of a plurality of frames immediately before each frame. For example, when calculating an area where the difference between the frame 20d and the background image has occurred, the counting unit / extracted area calculating unit 12 uses the average of the images of 100 frames immediately before the frame 20d as the background image. . Then, the difference between this background image and the frame 20d is taken. FIGS. 9A to 9C show examples of images of the frames 20d, 20e, and 20f, and FIGS. 10A to 10C show frames 20d, 20e, and 20f of FIGS. 9A to 9C. The example of the image which took the difference of each image and each background image is shown, respectively.

  The counting unit / extraction area calculating unit 12 sequentially performs such difference processing for each of the frames 20e to 20i after the reference frame 20d, and a difference occurs between the image of each of the frames 20e to 20i and the background image. A third region (extraction region) that surrounds both the first region and the second region where the difference between the images of the frames 20d to 20h immediately before the frames 20e to 20i and the background image is generated. To do. FIG. 11A shows a difference generation area 31 of the frame 20d and a first area 41 surrounding the difference generation area 31. FIG. 11B shows the difference generation areas 32a and 32b of the frame 20e and the second area 42 surrounding them. FIG. 11C shows a third area (extraction area) 43 that surrounds both the difference occurrence area 31 of the frame 20d and the difference occurrence areas 32a and 32b of the frame 20e.

  In the present embodiment, the counting means / extraction area calculation means 12 calculates an area surrounded by a rectangle composed of two horizontal lines and two vertical lines in order to simplify the arithmetic processing. The present invention is not limited to this. In short, any pixel area may be used as long as pixel areas in which differences are generated are grouped to calculate an area surrounded by one area.

  The counting means / extraction area calculation means 12 calculates third area information (hereinafter referred to as “extraction area information”) that specifies the position and size of the third area (extraction area) for each frame. In the example of FIG. 11C, the counting unit / extracted area calculating unit 12 uses the coordinates (X, Y) of the position of the upper left corner of the third area 43 and the size of the third area 43 ( Width W and height H) are calculated.

  The extracted image transmission unit 13 sequentially extracts the image data of the third area of each frame calculated by the counting unit / extraction area calculation unit 12 from the image of each frame and transmits the image data to the aggregation server 4. In the example of FIG. 9, the extracted image transmission means 13 extracts the image data of the third area 43 shown in FIG. 11C from the image of the frame 20e as shown in FIG. Further, the extracted image transmission means 13 transmits the extracted area information (coordinates (X, Y), width W and height H) to the aggregation server 4 in addition to the image data of the third area 43.

  On the other hand, as shown in FIG. 7, the aggregation server 4 functions as the above-described heat map image generation unit 51 and also generates a moving image from the reference image data transmitted from the base server 3 and the image data of the third region of each frame. A heat map image generating unit / image combining unit 14 to be combined, a storage unit 15 for storing a moving image combined by the heat map image generating unit / image combining unit 14, and a computer 5 (via a telecommunication line N) 6), a moving image providing unit 16 for providing the moving image stored in the storage unit 15 is provided. The aggregation server 4 is realized by executing a program for causing the computer to function as each of the means 14 to 16 on various computers as described above.

  The heat map image generating unit / image synthesizing unit 14 is similar to the heat map image generating unit 51 described above, and the heat map is obtained by changing the expression such as color and shading for each region based on the count result transmitted from the base server 3. While generating an image, a moving image is synthesized from the reference image data transmitted from the base server 3 and the image data of the third region of each frame, and the synthesized moving image is stored in the storage unit 15. In the present embodiment, the heat map image generation unit / image synthesis unit 14 sequentially replaces a part of the reference image data with the image data of the third region of each frame based on the extraction region information of each frame. Synthesize moving images.

  In the example of FIG. 9, the heat map image generation unit / image synthesis unit 14 applies the width W and the height from the coordinates (X, Y) to the image of the reference frame 20d shown in FIG. 13 based on the extraction area information of the frame 20e. A part of the image data of the height H is replaced with the image data of the third region 43 of the frame 20e shown in FIG. Then, the heat map image generation unit / image composition unit 14 also sequentially applies the image data of the third region of the frame 20f to the image of the immediately preceding frame 20e based on the extraction region information of the frame 20f for the next frame 20f. A moving image is synthesized by replacing with.

  The moving image providing means 16 provides the heat map image and moving image stored in the storage means 15 in response to a request from the computer 5 connected via the telecommunication line N. When the moving image providing means 16 designates the imaging device 2 for each imaging base from the computer 5 and requests one or both of the heat map image and the moving image, the moving image providing means 16 determines which of the requested heat map image and moving image. Either or both are acquired from the storage means 15 and provided to the computer 5 via the telecommunication line N.

  In the heat map image generation apparatus having the above-described configuration, the base server 3 installed at each imaging base has a predetermined timing in addition to the count result from consecutive frames of images sequentially acquired by one or a plurality of imaging apparatuses 2. The image data of the reference frame is transmitted to the aggregation server 4 by the reference image transmission means 11, and the image of each frame after this reference frame is sequentially added to the first of the frames calculated by the counting means / extraction area calculation means 12. The three areas of image data are extracted by the extracted image transmission means 13 and transmitted to the aggregation server 4.

  On the other hand, the aggregation server 4 generates a heat map image in which expression such as color and shading is changed for each region based on the count result transmitted from the base server 3, and the reference image data transmitted from the base server 3 Then, a moving image is synthesized from the image data of the third area of each frame transmitted sequentially, and stored in the storage means 15. The aggregation server 4 provides the heat map image and the moving image stored in the storage unit 15 in response to a request from the computer 5 connected via the telecommunication line N.

  As described above, in the heat map image generation apparatus according to the present embodiment, a plurality of continuous frames are used instead of extracting and transmitting to the aggregation server 4 and synthesizing regions that have changed before and after the images of the continuous multiple frames. Both the first area in which a difference occurs between the image of each frame and the background image, and the second area in which a difference occurs between the image of the frame immediately before each frame and the background image Since the image data of the third area (extraction area) surrounding the image is extracted, transmitted to the aggregation server 4 and synthesized, there is an influence due to fluctuations of light in the areas where there is a change before and after the continuous image of a plurality of frames. As a result, the amount of transmission can be suppressed while preventing the occurrence of motion image blurring and afterimages.

  In the present embodiment, the reference frame is changed at a timing such as a preset time or the number of frames, but may be changed at another timing. For example, it is possible to change the timing when a difference of a certain amount or more occurs (for example, timing when 80% of the pixels are changed).

  In the present embodiment, an averaged image of a plurality of frames immediately before each frame is used as a background image. However, an image of a reference frame is used as a background image, or a plurality of frames immediately before a reference frame is used. It is also possible to use an averaged image. Note that if the image of the reference frame is used as the background image, a difference occurs in every part and the transmission amount increases. However, as in the present embodiment, the images of a plurality of frames immediately before each frame are used as the background image. The occurrence of the difference can be suppressed by using the averaged value.

  The heat map image generation apparatus, the heat map image generation method, and the heat map image generation program of the present invention are useful as an apparatus, a method, and a program for generating a heat map image that visualizes movement in space.

DESCRIPTION OF SYMBOLS 2 Imaging device 3 Base server 4 Aggregation server 5 Computer 6 Storage server 10, 15 Storage means 11 Reference image transmission means 12 Count means and extraction area calculation means 13 Extracted image transmission means 14 Heat map image generation means and image composition means 16 Moving image Providing means 50 Counting means 51 Heat map image generating means 52 Image acquiring means

Claims (6)

A background image (hereinafter referred to as “background image”) is obtained by averaging images of a plurality of consecutive frames sequentially acquired at predetermined time intervals by the imaging device, and sequentially acquired by the imaging device. For each frame of a plurality of consecutive frames, a difference is sequentially taken between the image of each frame and the background image, and a difference is generated within a predetermined time for each area in the frame divided in advance. A counting means for counting the number of times;
A heat map image generation apparatus comprising: a heat map image generation unit configured to generate an image whose expression is changed for each region according to the number of times counted for each region by the counting unit. A base server installed at an imaging base and connected to the imaging device, the base server having the counting means;
The heat map image generation apparatus according to claim 1, wherein the heat map image generation apparatus includes an aggregation server connected to the base server via an electric communication line and having the heat map image generation unit. An aggregation server connected to the imaging device by an electric communication line;
The imaging device is configured to transmit the images of the plurality of frames to the aggregation server;
The heat map image generation apparatus according to claim 1, wherein the aggregation server includes the counting unit and the heat map image generation unit. A storage server connected to the imaging device via a telecommunication line;
An aggregation server connected to the storage server by a telecommunication line,
The imaging device is configured to transmit the images of the plurality of frames to the storage server;
The storage server has means for storing the images of the plurality of frames transmitted from the imaging device;
The heat map image generation apparatus according to claim 1, wherein the aggregation server includes means for acquiring the images of the plurality of frames from the storage server, the count means, and the heat map image generation means. A background image (hereinafter referred to as “background image”) is obtained by averaging images of a plurality of consecutive frames sequentially acquired at predetermined time intervals by the imaging device, and sequentially acquired by the imaging device. For each frame of a plurality of consecutive frames, a difference is sequentially taken between the image of each frame and the background image, and a difference is generated within a predetermined time for each area in the frame divided in advance. Counting times,
A heat map image generation method including generating an image whose expression is changed for each area according to the number of times counted for each area. On the computer,
A background image (hereinafter referred to as “background image”) is obtained by averaging images of a plurality of consecutive frames sequentially acquired at predetermined time intervals by the imaging device, and sequentially acquired by the imaging device. For each frame of a plurality of consecutive frames, a difference is sequentially taken between the image of each frame and the background image, and a difference is generated within a predetermined time for each area in the frame divided in advance. Counting times,
The heat map image generation program for performing producing | generating the image which changed the expression for every said area | region according to the frequency | count counted for every said area | region.