JP2012084077A - Information display device and information display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display device which can easily recognize imaging content in relation to a range or the like set within the imaging range.SOLUTION: An information display device includes a display 4. In the information display device, imaging information obtained by imaging a preset imaging range using a camera 1 is acquired. A processing range included in the imaging range is set. Based on the imaging information corresponding to the set processing range, graphics corresponding to imaging content of the imaging information is created. The information display device also includes a control unit 2 for allowing the created graphics to be displayed on the display 4, brought into correspondence with the processing range corresponding to the imaging information of the imaging content corresponding to the graphics.

Description

  The present invention belongs to the technical field of information display devices and information display programs. More specifically, the present invention belongs to the technical field of an information display device that displays the contents of imaging information captured using an imaging device such as a camera, and an information display program used for the information display.

  2. Description of the Related Art Conventionally, for example, by taking an image of a movement mode of a customer in a store or the like for a predetermined time, for example, it is used as a study material when considering an efficient product display in the store. At this time, when displaying an image obtained by imaging the movement mode, various character information corresponding to the image is also displayed. Here, as a technique for displaying character information and the like corresponding to an image together with the image, for example, there is a technique disclosed in Patent Document 1 below. In the technique disclosed in Patent Document 1, the display mode of character information and the like corresponding to each subject is changed based on distance information indicating the distance from the imaging position to the subject viewed.

JP 2009-230431 A (FIGS. 2 to 6 and FIGS. 8 to 11 etc.)

  However, in the technique disclosed in Patent Document 1, the content of text information and the like displayed together with the subject is arbitrary, and in the technique disclosed in Patent Document 1, depending on the state and form of the subject. Therefore, it is not considered to change the contents such as character information. Furthermore, the technique disclosed in Patent Document 1 merely displays the corresponding character information and the like for each of the subjects displayed in one image, and considers the range and area in the image. Thus, the subject and the character information corresponding to the subject are not displayed. Therefore, even if the technique disclosed in Patent Document 1 is applied to the image analysis for the examination material as described above, there is a problem that a desired analysis result cannot be obtained.

  Therefore, the present invention has been made in view of the above-described problems, and the problem is that an information display device capable of easily recognizing captured content in relation to a range set within the captured range and the like. The object is to provide an information display program used for the information display.

  In order to solve the above problem, the invention according to claim 1 acquires imaging information obtained by imaging a display unit such as a display and a preset imaging range using an imaging unit such as a camera. Sub-information corresponding to the imaging content of the imaging information based on the imaging information corresponding to the acquisition means, the setting means such as a control device for setting the processing range included in the imaging range, and the imaging information corresponding to the set processing range And a control device for displaying the generated sub-information on the display unit in correspondence with the processing range corresponding to the imaging information of the imaging content corresponding to the sub-information. Display control means.

  According to the first aspect of the present invention, the sub-information generated based on the imaging information corresponding to the processing range included in the imaging range is made to correspond to the processing range corresponding to the imaging information of the imaging content corresponding to the sub-information. Therefore, the imaging content of the imaging information corresponding to the processing range can be displayed easily and recognizable using the sub information.

  In order to solve the above-mentioned problem, the invention according to claim 2 is the information display device according to claim 1, wherein the display control unit is configured to capture the generated sub-information with respect to the imaging content corresponding to the sub-information. It is comprised so that it may display on the said display means with the said imaging information.

  According to the second aspect of the invention, in addition to the operation of the first aspect of the invention, the sub information is displayed on the display unit together with the imaging information of the imaging content corresponding to the sub information, so that it corresponds to the processing range. The imaging content of the imaging information to be displayed can be displayed more easily and recognizable.

  In order to solve the above-mentioned problem, the invention according to claim 3 is the information display device according to claim 1 or 2, wherein the imaging range includes a place where the moving body moves. The imaging information is imaging information obtained by the imaging unit imaging the imaging range including the location, and the generation unit is the number of moving bodies based on the imaging information. A moving body number detecting means such as a control device for detecting the number for each processing range, wherein the generating means stores the sub information for each processing range including moving body number information indicating the detected number of moving bodies. The display control means is configured to generate and display the generated sub information on the display means for each processing range corresponding to the sub information.

  According to the invention described in claim 3, in addition to the operation of the invention described in claim 1 or 2, the moving body number information based on the imaging information corresponding to the imaging range including the place where the moving body moves. Is generated and displayed for each processing range, so that the number of passes of the moving body for each processing range within the imaging range can be displayed easily and recognizable.

  In order to solve the above-mentioned problem, the invention according to claim 4 is the information display device according to claim 3, wherein the display control means includes the moving body number information indicating the different moving body numbers. The processing ranges corresponding to the sub information are configured to be displayed on the display unit in different display modes corresponding to the different numbers of moving bodies.

  According to invention of Claim 4, in addition to the effect | action of invention of Claim 3, the processing range which the sub-information containing the moving body number information which shows the different moving body number respond | corresponds to the said different moving body. Since the display means displays in a different display mode corresponding to the number, the processing range corresponding to a certain number of moving objects is displayed so as to be distinguishable from other processing ranges corresponding to the number of moving objects different from the number of moving objects. Can be made.

  In order to solve the above-mentioned problem, the invention according to claim 5 is the information display device according to claim 3 or 4, which is used to select one of the processing ranges on the display means. The display control means is configured to display the sub information corresponding to the processing range selected by the selection means on the display means.

  According to the invention described in claim 5, in addition to the operation of the invention described in claim 3 or claim 4, the sub information corresponding to the processing range selected by the selection means is displayed. It is possible to display the sub information in a recognizable range within a processing range where the sub information is desired to be displayed at an appropriate timing.

  In order to solve the above-mentioned problem, an invention according to claim 6 is the information display device according to claim 5, wherein the display control means corresponds to the sub-range corresponding to the processing range selected by the selection means. Information is configured to be displayed on the display unit with emphasis over the sub information corresponding to the other processing ranges.

  According to the invention described in claim 6, in addition to the operation of the invention described in claim 5, the sub information corresponding to the selected processing range is emphasized more than the sub information corresponding to the other processing ranges. Since the sub information is displayed, the sub information in the processing range in which the sub information is desired to be displayed can be easily recognizable.

  In order to solve the above problem, the invention according to claim 7 is the information display device according to claim 1 or 2, wherein the imaging range includes a place where the moving body moves. The imaging information is imaging information obtained by the imaging unit imaging the imaging range including the location, and the generation unit moves the moving body with respect to the processing range based on the imaging information. A movement mode detection unit such as a control device that detects modes in time series is provided, wherein the generation unit generates the sub-information including movement mode information indicating the movement modes detected in time series, and displays the display The control unit is configured to display the generated sub information on the display unit in time series in association with the processing range.

  According to the invention described in claim 7, in addition to the operation of the invention described in claim 1 or 2, the movement mode information is obtained based on the imaging information corresponding to the imaging range including the place where the moving body moves. Since the sub-information including it is generated and displayed in time series, the movement mode within the imaging range can be displayed easily and recognizable along the time series.

  In order to solve the above-mentioned problem, the invention according to claim 8 is the information display device according to claim 7, wherein the moving mode detecting means determines whether the moving body has reached the edge of the processing range. When the display control means detects that the moving body has reached the edge, the display control means processes the sub-information including the movement mode information indicating the moving mode of the reached moving body. The display unit is configured to display in time series in association with the range.

  According to the invention described in claim 8, in addition to the action of the invention described in claim 7, when it is detected that the moving body has reached the edge of the processing range, the moving mode of the reached moving body is changed. Since the sub information including the movement mode information to be displayed is displayed in time series, the movement mode of the moving body with respect to the set processing range can be displayed easily and recognizable.

  In order to solve the above-mentioned problem, the invention according to claim 9 is the information display device according to claim 8, wherein the movement mode detection means is a moving direction of the moving body or the processing range of the moving body. At least one of the entry directions to the vehicle is detected in time series as the movement mode, and the generation unit generates the sub-information including the movement mode information indicating the detected at least one of the movement directions. Configured.

  According to the ninth aspect of the invention, in addition to the action of the eighth aspect of the invention, the sub information including movement mode information indicating at least one of the moving direction of the moving body or the approach direction with respect to the processing range. Is generated and displayed in time series, so that the moving direction of the moving body can be displayed in a specifically recognizable manner.

  In order to solve the above-mentioned problem, the invention described in claim 10 is characterized in that a computer included in an information display device provided with a display means is stored in the acquisition means according to any one of claims 1 to 9. , Function as the setting means, the generation means, and the display control means.

  According to the invention described in claim 10, the sub-information generated based on the imaging information corresponding to the processing range included in the imaging range is made to correspond to the processing range corresponding to the imaging information corresponding to the imaging content. Since the computer functions so as to be displayed, the imaging content of the imaging information corresponding to the processing range can be displayed easily and recognizable using the sub information.

  According to the present invention, the sub information generated based on the imaging information corresponding to the processing range included in the imaging range is displayed in correspondence with the processing range corresponding to the imaging information of the imaging content corresponding to the sub-information. The imaging content of the imaging information corresponding to the processing range can be displayed so as to be easily recognizable using the sub information.

  Therefore, the present invention can be widely applied to the analysis of imaging contents corresponding to the processing range.

1 is a block diagram showing a schematic configuration of an information display device according to a first embodiment. It is a flowchart which shows the process of the control apparatus which concerns on 1st Embodiment, (a) is a flowchart which shows the whole process, (b) is a flowchart which shows the detail of an initial setting process. (C) is a flowchart showing details of the moving object number calculation process, and (d) is a flowchart showing details of the graphic information creation process. It is a figure which shows the example of a display which concerns on 1st Embodiment, (a) is a figure which shows a 1st display example, (b) is a figure which shows a 2nd example of a display. It is a flowchart which shows the process of the control apparatus which concerns on 2nd Embodiment, (a) is a flowchart which shows the whole process, (b) is a flowchart which shows the detail of an initial setting process. (C) is a flowchart showing details of the entry determination process, and (d) is a flowchart showing details of the graphic information creation process. It is a figure which shows the example of a display concerning 2nd Embodiment, (a) is a figure which illustrates the coordinate in a display area, (b) is a figure which shows a display example.

  Next, modes for carrying out the present invention will be described based on the drawings. In addition, each embodiment described below is an embodiment when the present invention is applied to an information display device that captures and displays a movement mode of a customer in an imaging range set in a store or the like, for example. .

(I) First Embodiment First, a first embodiment according to the present invention will be described with reference to FIGS. 1 is a block diagram showing a schematic configuration of the information display device according to the first embodiment, FIG. 2 is a flowchart showing processing of a control device included in the information display device, and FIG. 3 is a diagram showing the first embodiment. It is a figure which shows the example of a display concerning.

  As shown in FIG. 1, the information display device S according to the first embodiment is realized by a camera 1 as an example of an imaging unit including, for example, a CCD (Charge Coupled Device), specifically, a personal computer or the like. An example of a setting unit, an example of a generation unit, an example of a display control unit, an example of a moving body number detection unit, an example of a movement mode detection unit, and a display as an example of a display unit including a liquid crystal display or the like 4 and, for example, an operation unit 5 as an example of a selection unit including a mouse and a keyboard, a log recording unit 3, a graphic image recording unit 6, an analysis result recording unit 7, and a graphic recording unit 8 including, for example, a hard disk. It is configured. The control device 2 includes an interface 20, an image processing unit 21, a data analysis unit 22, and a graphic creation unit 23. Note that the image processing unit 21, the data analysis unit 22, and the graphic creation unit 23 are functionally realized by a CPU included in the personal computer or the like operating based on a program corresponding to a flowchart described later. Is. The log recording unit 3, the graphic image recording unit 6, the analysis result recording unit 7, and the graphic recording unit 8 may be provided in a single server device that is separate from the control device 2.

  In these configurations, the camera 1 is installed, for example, so that the entire interior of the store is in the imaging range. Then, the camera 1 captures the state of a person such as a customer or an employee who travels in the store from a fixed point, generates imaging information, and outputs it to the interface 20. This imaging information is a moving image obtained by imaging the imaging range for a preset time. A person who comes and goes in the store, which is the imaging range, is imaged as a moving object in the moving image. In addition to people, this moving object may include luggage, animals, and the like that move within the store. Next, the interface 20 executes a preset input process on the output imaging information and outputs it to the image processing unit 21. The image processing unit 21 performs a moving object detection process and a moving object tracking process on each moving object included in the output imaging information, generates log data for each moving object, and outputs the log data to the log recording unit 3.

  Next, the moving object detection process and the moving object tracking process executed in the image processing unit 21 will be described. All of these processes are similar to the conventional moving object detection process and moving object tracking process. In the moving object detection process, a moving object that moves within the imaging range is detected, and in the moving object tracking process, a process of tracking the detected moving object with the movement is executed.

  That is, first, in the image processing unit 21, a part or the whole of the imaging range is set as a monitoring area. The monitoring area coordinates indicating the position in the imaging range as the monitoring area, and the width information and the height information indicating the size of the monitoring area are preset in the image processing unit 21 as monitoring area information. Thereby, the image processing unit 21 detects a moving object moving within the imaging range from the imaging information, time information indicating the time when the moving object is detected, coordinate information indicating the position of the detected moving object in the monitoring area, and the moving object. The moving object identification information for identifying itself from other moving objects is generated. The generated time information, coordinate information, moving object identification information, and the monitoring area information are output as log data to the log recording unit 3 and recorded in a nonvolatile manner. Further, the image processing unit 21 tracks the movement of the moving object once detected, generates the time information, the coordinate information, and the moving object identification information at predetermined time intervals, and includes these and the monitoring area information. The log data is continuously generated / output as the moving object moves and recorded in the log recording unit 3. Note that a moving object that has once left the monitoring area and then enters the monitoring area again is treated as a separate moving object in the moving object detection process or the like, even if the moving object is the same as the moving object itself. By each process by the image processing unit 21 described above, log data indicating the movement mode of each moving object included in the imaging information is sequentially accumulated in the log recording unit 3 for each moving object.

  The log recording unit 3 sequentially records the log data output from the image processing unit 21 in a nonvolatile manner, and outputs the log data to the data analysis unit 22 in response to a request from the data analysis unit 22. Next, the data analysis unit 22 reads each log data from the log recording unit 3 as an analysis process of the image captured by the camera 1, and for each analysis region described later set in advance within the imaging range of the camera 1. The number of moving objects moving in the analysis area is detected. Thereafter, the data analysis unit 22 generates moving object information including the moving object number information indicating the number of detected moving objects and the time information indicating the time when the moving object moves within the analysis region, and temporarily controls the moving object information. The data is stored in a memory (not shown) in the device 2. This moving body information is output to the graphic creation unit 23 in response to a request from the graphic creation unit 23 later. The moving body number information included in the moving body information indicates the number of persons who have passed through each analysis region when the moving body is a person. Here, the analysis area refers to one area obtained by equally dividing the monitoring area into a predetermined number of areas, for example, and serves as a reference area when detecting the number of moving objects. This analysis region corresponds to an example of a “processing range” according to the present invention.

  Based on the moving body information output from the data analysis unit 22, the graphic creation unit 23 displays an image as imaging information corresponding to each analysis area and the content of the moving body information corresponding to the analysis area on the display 4. Image information is generated. Specifically, the graphic creation unit 23 generates graphic information for displaying the contents of the moving body information corresponding to each analysis region in correspondence with the display position on the display 4 of the analysis region corresponding to the analysis region. The graphic information is, for example, information for displaying the content of the moving object information in correspondence with the display position on the display 4 in the analysis area corresponding to the graphic information using a graphic image such as a so-called “speech balloon”. ). This graphic image is stored / accumulated in advance in the graphic image recording unit 6, and the graphic creating unit 23 reads out the necessary graphic image from the graphic image recording unit 6 and creates the graphic information for each analysis region. The moving body information output from the data analysis unit 22 is stored / accumulated in the analysis result recording unit 7 via the graphic creation unit 23 as an analysis result for each analysis region. Further, the graphic information created by the graphic creating unit 23 is recorded in the graphic recording unit 8 together with the corresponding moving body information.

  After that, the graphic creating unit 23 includes the moving body information when instructed by the user's operation on the operation unit 5 to display the moving body information as the analysis result recorded in the analysis result recording unit 7 on the display 4. Graphic information is read from the graphic recording unit 8. Thereafter, the graphic creation unit 23 makes the image included in the analysis region corresponding to the moving body information included in the read graphic information (the image itself captured by the camera 1) correspond to the display position on the display 4 of the analysis region. Then, a graphic corresponding to the graphic information including the moving object information is displayed. Specifically, the graphic creating unit 23 selects a certain analysis area on the display 4 by placing a mouse pointer corresponding to a mouse operation in the operation unit 5 at a display position on the display 4 of the analysis area, for example. Then, together with the image included in the analysis area, a graphic corresponding to graphic information including the moving body information corresponding to the display position on the display 4 of the analysis area is displayed. In addition, the graphic creation unit 23 corresponds to the number of moving bodies indicated by the moving body number information included in the moving body information, and the display mode (display color or highlighted mode) of the analysis region corresponding to the moving body information. May be changed.

  Next, the processing in the control device 2 according to the first embodiment will be described more specifically with reference to FIGS. 2 and 3, processing in the data analysis unit 22 and the graphic creation unit 23 of the control device 2 that is a feature point of the first embodiment will be described.

  As shown in FIG. 2A, when the data analysis unit 22 of the control device 2 according to the first embodiment acquires log data from the log recording unit 3 (step S1), analysis of an image captured by the camera 1 is performed. Initial setting for performing the process is executed (step S2). In this initial setting, as shown in FIG. 2B, as the unit time for performing the analysis process, the time of the log data for starting the analysis process and the time of the log data for ending the analysis process are 5 (step S20), and the number of analysis areas for analyzing the number of moving objects is specified by the operation unit 5 (step S21). Next, designation of which graphic image is used when displaying the moving body information is also performed by the operation unit 5 (step S22). The designation in this step S22 is, among the various graphic images (display frame for displaying moving body information or graphic images used as highlight display) including the above “speech balloon” recorded in the graphic image recording unit 6. It is the designation of which graphic image to use.

  When the initial setting is completed in step S2, the data analysis unit 22 calculates the number of moving objects moving in each analysis region (step S3). In this calculation of the number of moving objects, as shown in FIG. 2C, the data analysis unit 22 first acquires log data within the unit time designated in step S20 from the log recording unit 3 (step S30). The log data includes time information indicating the time when the moving object is detected as described above, coordinate information indicating the position of the detected moving object in the monitoring area, and moving object identification information for identifying the moving object itself from other moving objects. In addition, the monitoring area information is included. Next, the data analysis unit 22 confirms whether or not the number of moving objects calculation process in step S32 described later has been executed for the number of analysis regions specified in step S21 (step S31). If the moving object number calculation process is executed for the number of analysis regions in step S31 (step S31; YES), the data analysis unit 22 temporarily stores the number of moving objects for each analysis region in the memory as an analysis result ( Step S33). On the other hand, when the number of moving object calculation processes is not executed for the number of analysis areas in step S31 (step S31; NO), the data analysis unit 22 selects one analysis area for which the moving object number calculation process is not executed, From the coordinates in the monitoring area of the analysis area and the position coordinates of the moving object whose movement has been detected, the number of moving objects that have moved in the analysis area is calculated for each moving object identification information (step S32). Note that the moving object number calculation process itself in step S32 is to calculate the number of moving objects that have moved in the analysis area for each moving object identification information by the same method as in the prior art. Thereafter, the data analysis unit 22 proceeds to step S31.

  When the number of moving objects can be calculated for each analysis region in step S3, the graphic creation unit 23 creates the graphic information to be displayed on the display 4 (step S4). In this graphic information creation, as shown in FIG. 2D, the graphic creation unit 23 acquires the graphic image designated in step S22 as the graphic image used for graphic display from the graphic image recording unit 6 (step S40). ). Next, the graphic creating unit 23 checks whether or not steps S42 to S44 described later have been executed for the number of analysis regions specified in step S21 (step S41). If each process is executed for the number of analysis areas in step S41 (step S41; YES), the graphic creation unit 23 proceeds to an operation of step S5 described later. On the other hand, when each process is not executed for the number of analysis areas in step S41 (step S41; NO), the graphic creating unit 23 selects one analysis area for which each process is not executed, and about the analysis area Text information corresponding to the above moving body information is created as a comment (step S42), and the created text information is inserted as a comment into the graphic image acquired in step S40 (step S43). A comment displayed as a part of this graphic corresponds to an example of “sub information” according to the present invention. Next, the graphic creating unit 23 sets the coordinates in the monitoring area of the analysis area that is the target of steps S42 and S43 at that time as the display coordinates of the graphic image in which the comment is inserted in step S43 (step S44). Thereafter, the graphic creating unit 23 proceeds to step S41.

  Next, referring back to FIG. 2A, the graphic creation unit 23 records the analysis result temporarily stored in step S33 in the analysis result recording unit 7 (step S5), and further the graphic created in step S4. Information is recorded in the graphic recording unit 8 (step S6), and an image corresponding to the imaging information corresponding to the monitoring area among the imaging information captured by the camera 1 is displayed on the display 4 (step S7).

  Next, the graphic creating unit 23 confirms whether or not an operation for ending the process in the control device 2 according to the first embodiment has been executed in the operation unit 5 (step S8). When the operation to the end is executed in step S8 (step S8; YES), the control device 2 ends the process according to the first embodiment. On the other hand, when the operation for ending is not performed in step 8 (step S8; NO), the graphic creating unit 23 next displays the image corresponding to the imaging information on the display 4 in the state where it is displayed. It is confirmed whether or not the mouse pointer is detected at a position corresponding to any analysis region (step S9). When the mouse pointer is not detected at any position in step S9 (step S9; NO), the graphic creating unit 23 proceeds to step S8. On the other hand, when the mouse pointer is detected at any position in step S9 (step S9; YES), the graphic creating unit 23 assumes that the analysis area corresponding to the position has been selected by the user and corresponds to that position. A graphic corresponding to the graphic information corresponding to the analysis area is displayed at the display position (the position set in step S44) (step S10). This graphic information is read from the graphic recording unit 8 every time the process of step S10 is performed. Thereafter, the graphic creation unit 23 proceeds to step S8.

  When the process as the control device 2 according to the first embodiment described above is executed, for example, as illustrated in FIG. 3A, on the image corresponding to the monitoring area PA displayed on the display 4. A plurality of analysis areas AR are set, and a graphic G corresponding to the analysis area PA at the position where the mouse pointer C is placed is displayed in a pop-up manner, for example. In this graphic G, moving body information corresponding to the graphic G is included as illustrated in FIG. As illustrated in FIG. 3B, in addition to the display illustrated in FIG. 3A, only moving object information (comments) displayed in the graphic G is stored in a sub-region SB different from the graphic G. You may comprise so that it may display. At this time, when the mouse pointer C is moved to the position of another analysis area AR, the graphic G and the display in the sub area SB are deleted. Further, as illustrated in FIG. 3, in addition to displaying the graphic G, the graphic creating unit 23 displays the display mode (display) on the display 4 of the analysis area AR corresponding to the number of moving objects for each analysis area AR. The color or highlight mode may be changed.

  As described above, according to the processing of the information display device S of the first embodiment, as illustrated in FIG. 3, the graphic G generated based on the imaging information corresponding to the analysis area AR included in the imaging range. Is displayed in correspondence with the analysis area AR to which it corresponds, so that the imaging content corresponding to the analysis area AR can be displayed easily and recognizable using the graphic G.

  Further, since the graphic G is displayed together with the imaging content corresponding to the graphic G, the imaging content corresponding to the analysis area AR can be displayed more easily and recognizable.

  Further, since the graphic G including the moving object number information is generated and displayed for each analysis area AR based on the imaging information corresponding to the imaging range including the place where the moving object moves, the number of moving objects for each analysis area AR within the imaging range. Can be displayed easily and recognizable.

  Furthermore, when the analysis areas AR corresponding to the graphics G including the moving object number information indicating the different moving object numbers are displayed in different display modes corresponding to the different moving object numbers, the analyzing areas corresponding to a certain moving object number are displayed. The AR can be displayed so as to be distinguishable from other analysis areas AR corresponding to the number of moving objects different from the number of moving objects.

  In addition, since the graphic G corresponding to the analysis area AR selected by the mouse or the like is displayed, the graphic G in the analysis area AR that is desired to be displayed at an appropriate timing according to the user's intention. Can be displayed in a recognizable manner.

  In the case where the graphic G corresponding to each analysis area AR is being displayed, when the graphic G corresponding to the analysis area AR selected by the mouse pointer C is displayed, the analysis selected by the mouse pointer C is displayed. The graphic G corresponding to the area AR can be highlighted with respect to the graphic G corresponding to the other analysis area AR. Specifically, for example, the size of the graphic G itself corresponding to the analysis area AR selected by the mouse pointer C is made larger than that of the other graphic G, the color is changed, or the thickness of the character included therein is changed. Highlighting such as changing can be considered. In this case, the graphic G corresponding to the selected analysis area AR is displayed in a more emphasized manner than the graphic G corresponding to the other analysis area AR, so that the analysis area AR in which the graphic G is desired to be displayed is displayed. The graphic G can be displayed so that it can be easily recognized.

  As text information to be displayed as a comment in the graphic G, in addition to the above, for example, the level division status based on the number of moving objects (such as “large” / “small”) and the number of moving objects for each analysis area AR are concentrated. You may include a time zone.

(II) Second Embodiment Next, a second embodiment, which is another embodiment of the present invention, will be described with reference to FIGS. FIG. 4 is a flowchart showing processing of the control device according to the second embodiment, and FIG. 5 is a diagram showing a display example and the like according to the second embodiment.

  In the analysis processing according to the first embodiment described above, the case where the moving body information for each analysis area AR is displayed as a graphic G, for example, in a pop-up manner has been described. However, in the analysis processing according to the second embodiment described below, A flow line of a moving object moving in the monitoring area is detected and information related to the detected flow line is displayed. Note that the hardware configuration of the information display apparatus according to the second embodiment is basically the same as that of the information processing apparatus S according to the first embodiment, and therefore the following description relates to the first embodiment. The operation of the information processing apparatus according to the second embodiment will be described with reference to the member numbers of the information processing apparatus S. Also, in the flowchart shown in FIG. 4, the same processes as those of the information display device S according to the first embodiment shown in FIG. Further, in the following description, processing in the data analysis unit 22 and the graphic creation unit 23 of the control device 2 that is a feature point of the second embodiment will be described. In the analysis processing according to the second embodiment, the number of moving objects detected in the analysis processing according to the first embodiment is not detected. Therefore, the moving object information displayed in the graphic according to the second embodiment does not include the number of moving objects.

  As shown in FIG. 4A, when the data analysis unit 22 of the control device 2 according to the second embodiment acquires log data from the log recording unit 3 (step S1), the analysis processing according to the second embodiment is performed. Initial setting for performing is performed (step S10). In this initial setting, as shown in FIG. 4 (b), after executing the unit time designation process similar to step S20 according to the first embodiment, the designated area for further analyzing the flow line of the moving object is operated. It is specified by the part 5 (step S25). The designated area according to the second embodiment is a certain closed area in the monitoring area, and the moving mode of the moving object entering and exiting the area is an area to be subjected to analysis processing according to the second embodiment. This designated area corresponds to an example of a “processing range” according to the present invention. Thereafter, the data analysis unit 22 executes the same graphic image designation process as that in step S22 according to the first embodiment.

  When the initial setting is completed in step S10, the data analysis unit 22 acquires log data within the unit time designated in step S20 from the log recording unit 3 (step S11). Next, the data analysis unit 22 confirms whether or not each process of steps S13, S14, S5, S6, and S15 described later has been executed for all the log data acquired in step S11 (step S12). If each process has been executed for all the log data in step S12 (step S12; YES), the data analysis unit 22 ends the analysis process according to the second embodiment. On the other hand, when each process is not executed for all the log data in step S12 (step S12; NO), the data analysis unit 22 next acquires the log data acquired in step S11 in the designated area designated in step S25. It is determined whether or not the moving object corresponding to has entered (step S13). In this entry determination, as shown in FIG. 4C, the data analysis unit 22 first detects whether any moving body has entered the designated area (step S130), and if no moving body has entered. (Step S130; NO), that effect is temporarily stored in the memory as an analysis result (Step S133). On the other hand, if any moving object is in the designated area in step S130 (step S130; YES), the data analysis unit 22 acquires the time of entry from the log data of the entering moving object (step S131). ). Next, the data analysis unit 22 calculates the approach direction to the designated area and the moving direction of the moving object at that time (step S132). In this step S132, as illustrated in FIG. 5A, for the designated area DA set to have a width of 100 dots and a height of 50 dots in the monitoring area with the upper left as the origin (see step S25), The distances between the center CT of the moving object M and the four sides of the designated area DA (distances indicated by the symbols “Lx1,” “Lx2,” “Ly1,” and “Ly2” in FIG. 5A) are calculated. Next, the data analysis unit 22 extracts the shortest distance among the calculated distances to each side (in the example illustrated in FIG. 5A, the distance indicated by the symbol “Ly2”), and the distance The direction of the side is the approach direction. In the case of FIG. 5A, the approach direction is calculated as “from above”. The moving direction of the moving object is detected by a method similar to the conventional method based on the change in the coordinate information of the moving object included in the log data acquired in time series. Thereafter, the data analysis unit 22 temporarily stores the approach direction and the movement direction calculated in step S132 in the memory as analysis results for the moving object (step S133).

  If entry determination is performed in step S13, the graphic creation part 23 will perform the process similar to each process of step S40, S42, S43, and S44 which concerns on 1st Embodiment next as graphic information creation process of step S14. This is performed for each moving object using the approach direction and the moving direction as a result of the entry determination in step S13. In this case, the same process as the process of step S41 according to the first embodiment is not performed. Further, as described above, the moving body information according to the second embodiment does not include the moving body number information according to the first embodiment. Instead, the information indicating the approach direction, the time of intrusion into the designated area DA, and the like ( FIG. 5 (b)) is included. Note that the moving object information according to the second embodiment may include the time during which the moving object stayed in the designated area DA in addition to the approach direction to the designated area DA and the moving direction of the moving object. In this case, in steps S132 and S133, the data analysis unit 22 refers to the log data corresponding to the moving object in addition to the entry direction to the designated area DA and the moving direction of the moving object at that time, and specifies the moving object. The stay time in the designated area DA from the entry time into the area DA is calculated, and the analysis result including the result in the moving body information is temporarily stored in the memory. This stay time calculation process is continuously executed while the moving object stays in the designated area DA.

  Next, returning to FIG. 4A, the graphic creation unit 23 records the analysis result temporarily stored in step S133 in the analysis result recording unit 7 (step S5), and further the graphic created in step S14. Information is recorded in the graphic recording unit 8 (step S6), and a graphic corresponding to the recorded graphic information is displayed on the display 4 (step S15). Thereafter, the graphic creating unit 23 proceeds to step S12, and executes the processes of steps S12 to S15 and S5 and S6 for the next log data. That is, the processes of steps S12 to S15 and S5 and S6 are repeated in time series based on each log data.

  When the process as the control device 2 according to the second embodiment described above is executed, as illustrated in FIG. 5B, for example, on the image corresponding to the monitoring area PA displayed on the display 4 The designated area DA is displayed, and the flow lines L1 to L3 of the moving bodies M1 to M3 that enter (or have entered) the corresponding area DA are displayed corresponding to the designated area DA. In addition, graphics G1 to G3 including moving body information including an approach direction and the like of each moving body M1 to M3 with respect to the designated area DA are displayed at, for example, the entry positions of the moving bodies M1 to M3 with respect to the designated area DA. At this time, the display modes such as the colors of the moving bodies M1 to M3 may be different from each other. When the stay time in the designated area DA described above is included in the graphic as moving object information, each stay in the graphics G1 to G3 is added to the stay direction in addition to the direction of entry of the moving objects M1 to M3 with respect to the designated area DA. The moving body information including the time information indicating the time is included.

  As described above, according to the processing of the information display device S of the second embodiment, as illustrated in FIG. 5B, it corresponds to the graphics G1 to G3 generated based on the imaging information. Since the display is performed in correspondence with the designated area DA, the captured content corresponding to the designated area DA can be displayed easily and recognizable using the graphics G1 to G3.

  Further, since the graphics G1 to G3 are displayed together with the imaging contents corresponding to the graphics G1 to G3, the imaging contents corresponding to the designated area DA can be displayed more easily and recognizable.

  Furthermore, since the flow lines L1 to L3 and the graphics G1 to G3 are generated and displayed in time series based on the imaging information corresponding to the imaging range including the place where the moving object moves, the moving objects M1 to M3 in the imaging range are displayed. The movement mode can be displayed in a recognizable manner along the time series.

  Furthermore, when it is detected that the moving object has reached the edge of the designated area DA, the flow lines L1 to L3 and the graphics G1 to G3 indicating the movement mode of the reached moving object are displayed in time series, so that it is set. The moving mode of the moving object with respect to the designated area DA can be displayed so that it can be easily recognized.

  In addition, since the flow lines L1 to L3 and the graphics G1 to G3 indicating at least one of the moving direction of the moving object or the entering direction with respect to the designated area DA are generated and displayed in time series, the moving direction of the moving object is specified. Can be displayed in a recognizable manner.

  When an image corresponding to the imaging information is displayed together with the flow lines L1 to L3 and the graphics G1 to G3, it is shown in the image by replacing it with, for example, an illustration instead of a raw image. It can also be configured to protect human privacy.

  Also, the programs corresponding to the flowcharts shown in FIGS. 3 and 4 are recorded on a recording medium such as a flexible disk or a hard disk, or acquired and recorded via a network such as the Internet, By reading and executing with a microcomputer or the like, the microcomputer or the like can be caused to function as the data analysis unit 22 and the graphic creation unit 23 according to the embodiment.

  As described above, the present invention can be used in the field of information display devices, and is particularly remarkable when applied to the field of image analysis using an image captured by a camera and display of the analysis result. Effects can be obtained.

DESCRIPTION OF SYMBOLS 1 Camera 2 Control apparatus 3 Log recording part 4 Display 5 Operation part 6 Graphic image recording part 7 Analysis result recording part 8 Graphic recording part 20 Interface 21 Image processing part 22 Data analysis part 23 Graphic creation part S Information display apparatus C Mouse pointer PA Monitoring area AR analysis area SB sub area G, G1, G2, G3 Graphics L1, L2, L3 Flow line M, M1, M2, M3 Moving object CT center DA Specified area

Claims (10)

Display means;
An acquisition unit for acquiring imaging information obtained by imaging a preset imaging range using an imaging unit;
Setting means for setting a processing range included in the imaging range;
Generating means for generating sub-information corresponding to the imaging content of the imaging information based on the imaging information corresponding to the set processing range;
Display control means for displaying the generated sub-information on the display means in correspondence with the processing range corresponding to the imaging information of the imaging content corresponding to the sub-information;
An information display device comprising: The information display device according to claim 1,
The display control means causes the display means to display the generated sub information together with the imaging information of the imaging content corresponding to the sub information. In the information display device according to claim 1 or 2,
The imaging range includes a place where the moving body moves,
The imaging information is imaging information obtained by the imaging unit imaging the imaging range including the location,
The generation unit includes a moving body number detecting unit that detects the number of moving bodies, which is the number of the moving bodies, for each processing range based on the imaging information,
The generating means generates the sub-information for each processing range including moving body number information indicating the detected number of moving bodies,
The display control means causes the display means to display the generated sub information for each processing range corresponding to the sub information. The information display device according to claim 3,
The display control means displays the processing ranges corresponding to the sub-information including the moving body number information indicating the different moving body numbers on the display means in different display modes corresponding to the different moving body numbers. An information display device characterized in that In the information display device according to claim 3 or 4,
Further comprising selection means used to select any of the processing ranges on the display means;
The display control means causes the display means to display the sub information corresponding to the processing range selected by the selection means. The information display device according to claim 5,
The display control unit causes the display unit to display the sub information corresponding to the processing range selected by the selection unit with emphasis over the sub information corresponding to the other processing range. Information display device. In the information display device according to claim 1 or 2,
The imaging range includes a place where the moving body moves,
The imaging information is imaging information obtained by the imaging unit imaging the imaging range including the location,
The generation unit includes a movement mode detection unit that detects a movement mode of the moving body with respect to the processing range in time series based on the imaging information.
The generation means generates the sub information including movement mode information indicating the movement mode detected in time series,
The display control means causes the display means to display the generated sub information in time series in association with the processing range. The information display device according to claim 7,
The movement mode detection means detects whether the moving body has reached the edge of the processing range,
When it is detected that the moving body has reached the edge, the display control means associates the sub information including the movement mode information indicating the moving mode of the reached moving body with the processing range. An information display device that displays on the display means in time series. The information display device according to claim 8,
The movement mode detection means detects at least one of a moving direction of the moving body or an approach direction of the moving body with respect to the processing range as the moving mode in time series,
The information display device, wherein the generation unit generates the sub-information including the movement mode information indicating at least one of the detected ones. The acquisition unit according to any one of claims 1 to 9, wherein a computer included in an information display device including a display unit is provided.
The setting means;
The generating means; and
The display control means;
An information display program characterized in that it functions as a program.

Images